2024-04-23T18:21:18.091 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-23T18:21:18.091 DEBUG:teuthology.run:Teuthology command: teuthology --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} --verbose --owner scheduled_soumyakoduri@teuthology --archive /home/teuthworker/archive/soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi/7670059 --name soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi -- /home/teuthworker/archive/soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi/7670059/orig.config.yaml 2024-04-23T18:21:18.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T18:21:18.231 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi/7670059 branch: wip-skoduri-lc-stall description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7670059' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-skoduri-lc-stall ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: e2b3a3002f404c8e61fd792e773abde1ec60016e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e2b3a3002f404c8e61fd792e773abde1ec60016e rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-skoduri-lc-stall sha1: e2b3a3002f404c8e61fd792e773abde1ec60016e owner: scheduled_soumyakoduri@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 sha1: e2b3a3002f404c8e61fd792e773abde1ec60016e sleep_before_teardown: 0 suite: rgw suite_branch: wip-skoduri-lc-stall suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e2b3a3002f404c8e61fd792e773abde1ec60016e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e2b3a3002f404c8e61fd792e773abde1ec60016e targets: smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOxStYenuUjaV6lvXp6MLOhsDDMT8b3/vaOmlUJ5OmLJ2wZDCD255ulajnoG8xkKEWU6MH9kO+Vsq+EJd/e+nBg= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5qkN/I9xUsUBeIgiMg2tSVAdt3TWIn5/LjwYtoctqwyMXsvs1jSUPDFNAL6PKKkOzixbJWy8PVlj9shrL0VoY= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-23_17:18:46 tube: smithi user: soumyakoduri verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-23T18:21:18.231 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e2b3a3002f404c8e61fd792e773abde1ec60016e/qa; will attempt to use it 2024-04-23T18:21:18.232 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e2b3a3002f404c8e61fd792e773abde1ec60016e/qa/tasks 2024-04-23T18:21:18.232 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-23T18:21:18.234 INFO:teuthology.task.internal:Checking packages... 2024-04-23T18:21:18.256 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e2b3a3002f404c8e61fd792e773abde1ec60016e' 2024-04-23T18:21:18.256 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T18:21:18.256 INFO:teuthology.packaging:ref: None 2024-04-23T18:21:18.256 INFO:teuthology.packaging:tag: None 2024-04-23T18:21:18.256 INFO:teuthology.packaging:branch: wip-skoduri-lc-stall 2024-04-23T18:21:18.256 INFO:teuthology.packaging:sha1: e2b3a3002f404c8e61fd792e773abde1ec60016e 2024-04-23T18:21:18.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-skoduri-lc-stall 2024-04-23T18:21:18.398 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3217.ge2b3a300 2024-04-23T18:21:18.399 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-23T18:21:18.407 INFO:teuthology.task.internal:no buildpackages task found 2024-04-23T18:21:18.407 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-23T18:21:18.428 INFO:teuthology.task.internal:Saving configuration 2024-04-23T18:21:18.439 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-23T18:21:18.445 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-23T18:21:18.469 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi/7670059', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 18:16:16.525059', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOxStYenuUjaV6lvXp6MLOhsDDMT8b3/vaOmlUJ5OmLJ2wZDCD255ulajnoG8xkKEWU6MH9kO+Vsq+EJd/e+nBg='} 2024-04-23T18:21:18.493 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi/7670059', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 18:16:16.527133', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5qkN/I9xUsUBeIgiMg2tSVAdt3TWIn5/LjwYtoctqwyMXsvs1jSUPDFNAL6PKKkOzixbJWy8PVlj9shrL0VoY='} 2024-04-23T18:21:18.493 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-23T18:21:18.499 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-04-23T18:21:18.499 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-23T18:21:18.499 INFO:teuthology.run_tasks:Running task console_log... 2024-04-23T18:21:18.568 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe2d97450d0>, signals=[15]) 2024-04-23T18:21:18.568 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-23T18:21:18.574 INFO:teuthology.task.internal:Opening connections... 2024-04-23T18:21:18.575 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-04-23T18:21:18.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:21:18.657 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-04-23T18:21:18.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:21:18.729 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-23T18:21:18.736 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-04-23T18:21:18.755 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-04-23T18:21:18.755 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-04-23T18:21:18.813 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-04-23T18:21:18.813 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2024-04-23T18:21:18.813 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-04-23T18:21:18.813 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-04-23T18:21:18.813 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2024-04-23T18:21:18.814 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2024-04-23T18:21:18.814 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T18:21:18.814 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-04-23T18:21:18.814 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2024-04-23T18:21:18.814 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T18:21:18.814 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-04-23T18:21:18.814 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T18:21:18.814 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T18:21:18.814 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T18:21:18.815 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-04-23T18:21:18.839 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-04-23T18:21:18.856 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-04-23T18:21:18.857 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-04-23T18:21:18.913 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-04-23T18:21:18.913 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-04-23T18:21:18.913 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-04-23T18:21:18.913 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-04-23T18:21:18.913 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-04-23T18:21:18.913 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-04-23T18:21:18.913 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T18:21:18.914 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-04-23T18:21:18.914 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-04-23T18:21:18.914 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T18:21:18.914 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-04-23T18:21:18.914 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T18:21:18.914 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T18:21:18.914 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T18:21:18.914 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-04-23T18:21:18.930 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-23T18:21:18.938 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-23T18:21:18.943 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-23T18:21:18.943 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-04-23T18:21:18.946 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-04-23T18:21:18.969 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-23T18:21:18.975 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-23T18:21:18.975 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-04-23T18:21:19.004 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-04-23T18:21:19.029 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-23T18:21:19.087 INFO:teuthology.run_tasks:Running task kernel... 2024-04-23T18:21:19.101 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-23T18:21:19.101 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-23T18:21:19.102 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T18:21:19.102 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T18:21:19.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:21:19.118 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-04-23T18:21:19.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:21:19.120 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-04-23T18:21:19.175 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-437.el9.x86_64 2024-04-23T18:21:19.175 INFO:teuthology.task.kernel:Running kernel on smithi119: 5.14.0-437.el9.x86_64 2024-04-23T18:21:19.175 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum install -y kernel 2024-04-23T18:21:19.178 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-437.el9.x86_64 2024-04-23T18:21:19.178 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.14.0-437.el9.x86_64 2024-04-23T18:21:19.178 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2024-04-23T18:21:22.200 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.0 MB 00:01 2024-04-23T18:21:22.575 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.0 MB 00:01 2024-04-23T18:21:24.859 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-23T18:21:25.817 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 19 MB 00:02 2024-04-23T18:21:30.035 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.2 MB 00:01 2024-04-23T18:21:30.101 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-23T18:21:31.995 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-23T18:21:32.371 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 16 kB 00:01 2024-04-23T18:21:33.687 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-23T18:21:34.322 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-23T18:21:38.653 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-23T18:21:39.636 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-23T18:21:40.517 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-23T18:21:40.518 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-23T18:21:40.604 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:21:40.605 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-04-23T18:21:40.605 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:21:40.711 DEBUG:teuthology.orchestra.run.smithi119:> echo no | sudo yum reinstall kernel || true 2024-04-23T18:21:41.245 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:03 ago on Tue 23 Apr 2024 06:21:38 PM UTC. 2024-04-23T18:21:41.363 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:21:41.379 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:21:41.379 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2024-04-23T18:21:41.379 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:21:41.379 INFO:teuthology.orchestra.run.smithi119.stdout:Reinstalling: 2024-04-23T18:21:41.379 INFO:teuthology.orchestra.run.smithi119.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T18:21:41.379 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:21:41.379 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:21:41.379 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:21:41.379 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:21:41.379 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 255 k 2024-04-23T18:21:41.379 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 0 2024-04-23T18:21:41.380 INFO:teuthology.orchestra.run.smithi119.stderr:Operation aborted. 2024-04-23T18:21:41.433 INFO:teuthology.orchestra.run.smithi119.stdout:Is this ok [y/N]: 2024-04-23T18:21:41.434 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum reinstall -y kernel || true 2024-04-23T18:21:41.601 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-23T18:21:41.601 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-23T18:21:41.696 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:21:41.697 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-23T18:21:41.697 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:21:41.809 DEBUG:teuthology.orchestra.run.smithi062:> echo no | sudo yum reinstall kernel || true 2024-04-23T18:21:41.922 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:03 ago on Tue 23 Apr 2024 06:21:38 PM UTC. 2024-04-23T18:21:42.038 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:21:42.039 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:21:42.039 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2024-04-23T18:21:42.039 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:21:42.039 INFO:teuthology.orchestra.run.smithi119.stdout:Reinstalling: 2024-04-23T18:21:42.039 INFO:teuthology.orchestra.run.smithi119.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T18:21:42.039 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:21:42.039 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:21:42.040 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:21:42.040 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:21:42.040 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 255 k 2024-04-23T18:21:42.040 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 0 2024-04-23T18:21:42.040 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:21:42.369 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:03 ago on Tue 23 Apr 2024 06:21:39 PM UTC. 2024-04-23T18:21:42.501 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:21:42.522 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.2 MB/s | 255 kB 00:00 2024-04-23T18:21:42.522 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:21:42.522 INFO:teuthology.orchestra.run.smithi119.stdout:Total 528 kB/s | 255 kB 00:00 2024-04-23T18:21:42.524 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:21:42.525 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-23T18:21:42.525 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:21:42.525 INFO:teuthology.orchestra.run.smithi062.stdout:Reinstalling: 2024-04-23T18:21:42.525 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T18:21:42.525 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:21:42.525 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:21:42.525 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:21:42.525 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:21:42.525 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 255 k 2024-04-23T18:21:42.525 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 0 2024-04-23T18:21:42.525 INFO:teuthology.orchestra.run.smithi062.stderr:Operation aborted. 2024-04-23T18:21:42.539 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:21:42.600 INFO:teuthology.orchestra.run.smithi062.stdout:Is this ok [y/N]: 2024-04-23T18:21:42.600 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum reinstall -y kernel || true 2024-04-23T18:21:42.744 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:21:42.744 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:21:42.749 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:21:42.749 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:21:42.862 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:21:42.964 INFO:teuthology.orchestra.run.smithi119.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T18:21:42.964 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T18:21:43.118 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:04 ago on Tue 23 Apr 2024 06:21:39 PM UTC. 2024-04-23T18:21:43.240 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:21:43.241 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:21:43.241 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-23T18:21:43.241 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:21:43.241 INFO:teuthology.orchestra.run.smithi062.stdout:Reinstalling: 2024-04-23T18:21:43.241 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T18:21:43.241 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:21:43.241 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:21:43.241 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:21:43.241 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:21:43.242 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 255 k 2024-04-23T18:21:43.242 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 0 2024-04-23T18:21:43.242 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:21:43.620 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T18:21:43.620 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T18:21:43.672 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.6 MB/s | 255 kB 00:00 2024-04-23T18:21:43.672 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:21:43.672 INFO:teuthology.orchestra.run.smithi062.stdout:Total 592 kB/s | 255 kB 00:00 2024-04-23T18:21:43.693 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:21:43.890 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:21:43.890 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:21:43.895 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:21:43.895 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:21:44.042 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:21:44.123 INFO:teuthology.orchestra.run.smithi062.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T18:21:44.123 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T18:21:44.343 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T18:21:44.343 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:21:44.343 INFO:teuthology.orchestra.run.smithi119.stdout:Reinstalled: 2024-04-23T18:21:44.343 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-23T18:21:44.343 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:21:44.343 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:21:44.519 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2024-04-23T18:21:44.565 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-23T18:21:44.565 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-23T18:21:44.566 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-23T18:21:44.566 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-23T18:21:44.566 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T18:21:44.597 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2024-04-23T18:21:44.621 DEBUG:teuthology.parallel:result is None 2024-04-23T18:21:44.768 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T18:21:44.769 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T18:21:45.475 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T18:21:45.475 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:21:45.475 INFO:teuthology.orchestra.run.smithi062.stdout:Reinstalled: 2024-04-23T18:21:45.476 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-23T18:21:45.476 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:21:45.476 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:21:45.670 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-04-23T18:21:45.718 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-23T18:21:45.718 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-23T18:21:45.718 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-23T18:21:45.718 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-23T18:21:45.718 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T18:21:45.749 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2024-04-23T18:21:45.778 DEBUG:teuthology.parallel:result is None 2024-04-23T18:21:45.778 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-23T18:21:45.785 INFO:teuthology.task.internal:Creating test directory... 2024-04-23T18:21:45.785 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T18:21:45.820 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T18:21:45.838 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-23T18:21:45.845 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-23T18:21:45.852 INFO:teuthology.task.internal:Creating archive directory... 2024-04-23T18:21:45.852 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T18:21:45.875 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T18:21:45.930 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-23T18:21:45.936 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-23T18:21:45.936 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T18:21:45.940 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T18:21:45.965 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T18:21:45.969 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T18:21:45.975 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T18:21:45.980 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T18:21:45.981 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-23T18:21:45.989 INFO:teuthology.task.internal:Configuring sudo... 2024-04-23T18:21:45.989 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T18:21:46.019 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T18:21:46.050 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-23T18:21:46.058 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-23T18:21:46.059 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T18:21:46.084 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T18:21:46.106 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T18:21:46.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T18:21:46.224 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T18:21:46.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T18:21:46.346 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:21:46.346 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T18:21:46.410 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T18:21:46.453 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T18:21:46.514 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T18:21:46.557 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T18:21:46.598 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:21:46.598 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T18:21:46.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-04-23T18:21:46.665 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-04-23T18:21:46.700 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T18:21:46.739 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T18:21:47.145 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-23T18:21:47.152 INFO:teuthology.task.internal:Starting timer... 2024-04-23T18:21:47.153 INFO:teuthology.run_tasks:Running task pcp... 2024-04-23T18:21:47.164 INFO:teuthology.run_tasks:Running task selinux... 2024-04-23T18:21:47.172 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-23T18:21:47.172 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-04-23T18:21:47.273 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-04-23T18:21:47.275 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2024-04-23T18:21:47.343 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2024-04-23T18:21:47.345 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-23T18:21:47.345 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-04-23T18:21:47.375 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-04-23T18:21:47.375 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2024-04-23T18:21:47.413 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2024-04-23T18:21:47.413 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi119.front.sepia.ceph.com': 'permissive'} 2024-04-23T18:21:47.413 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T18:21:47.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:21:47.440 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T18:21:47.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:21:47.478 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-23T18:21:47.478 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-04-23T18:21:47.505 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2024-04-23T18:21:47.542 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-23T18:21:47.552 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-23T18:21:47.557 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-23T18:21:47.697 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-23T18:21:47.712 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-23T18:21:47.713 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-23T18:25:19.834 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com')] 2024-04-23T18:25:19.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-23T18:25:19.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:25:19.916 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-04-23T18:25:19.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-23T18:25:19.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-23T18:25:19.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T18:25:20.070 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-04-23T18:25:20.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-23T18:25:20.154 INFO:teuthology.run_tasks:Running task clock... 2024-04-23T18:25:20.166 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-23T18:25:20.166 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T18:25:20.167 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T18:25:20.169 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T18:25:20.169 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T18:25:20.197 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T18:25:20.211 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T18:25:20.222 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T18:25:20.236 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-04-23T18:25:20.236 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T18:25:20.247 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-04-23T18:25:20.258 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2024-04-23T18:25:20.261 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T18:25:20.269 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2024-04-23T18:25:20.274 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T18:25:20.282 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T18:25:20.295 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T18:25:20.329 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-04-23T18:25:20.333 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T18:25:20.333 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-04-23T18:25:20.334 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T18:25:20.334 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T18:25:20.334 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T18:25:20.334 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T18:25:20.348 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-04-23T18:25:20.351 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T18:25:20.351 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-04-23T18:25:20.351 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T18:25:20.351 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T18:25:20.351 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T18:25:20.352 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T18:25:20.352 INFO:teuthology.run_tasks:Running task install... 2024-04-23T18:25:20.360 DEBUG:teuthology.task.install:project ceph 2024-04-23T18:25:20.361 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e2b3a3002f404c8e61fd792e773abde1ec60016e'}} 2024-04-23T18:25:20.361 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'e2b3a3002f404c8e61fd792e773abde1ec60016e'} 2024-04-23T18:25:20.361 INFO:teuthology.task.install:Using flavor: default 2024-04-23T18:25:20.366 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-23T18:25:20.366 INFO:teuthology.task.install:extra packages: [] 2024-04-23T18:25:20.366 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b3a3002f404c8e61fd792e773abde1ec60016e', 'tag': None, 'wait_for_package': False} 2024-04-23T18:25:20.367 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b3a3002f404c8e61fd792e773abde1ec60016e 2024-04-23T18:25:20.368 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b3a3002f404c8e61fd792e773abde1ec60016e', 'tag': None, 'wait_for_package': False} 2024-04-23T18:25:20.369 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b3a3002f404c8e61fd792e773abde1ec60016e 2024-04-23T18:25:20.516 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-skoduri-lc-stall/e2b3a3002f404c8e61fd792e773abde1ec60016e/centos/9/flavors/default/ 2024-04-23T18:25:20.516 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3217.ge2b3a300 2024-04-23T18:25:20.526 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-skoduri-lc-stall/e2b3a3002f404c8e61fd792e773abde1ec60016e/centos/9/flavors/default/ 2024-04-23T18:25:20.526 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3217.ge2b3a300 2024-04-23T18:25:20.625 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-skoduri-lc-stall/e2b3a3002f404c8e61fd792e773abde1ec60016e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-skoduri-lc-stall/e2b3a3002f404c8e61fd792e773abde1ec60016e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-skoduri-lc-stall/e2b3a3002f404c8e61fd792e773abde1ec60016e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T18:25:20.626 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:25:20.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T18:25:20.635 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-skoduri-lc-stall/e2b3a3002f404c8e61fd792e773abde1ec60016e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-skoduri-lc-stall/e2b3a3002f404c8e61fd792e773abde1ec60016e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-skoduri-lc-stall/e2b3a3002f404c8e61fd792e773abde1ec60016e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T18:25:20.636 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:25:20.636 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T18:25:20.652 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-23T18:25:20.652 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b3a3002f404c8e61fd792e773abde1ec60016e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T18:25:20.660 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-23T18:25:20.660 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b3a3002f404c8e61fd792e773abde1ec60016e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T18:25:20.718 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T18:25:20.725 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T18:25:20.793 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T18:25:20.797 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T18:25:20.857 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-04-23T18:25:20.859 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-04-23T18:25:20.860 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2024-04-23T18:25:20.860 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2024-04-23T18:25:21.083 INFO:teuthology.orchestra.run.smithi119.stdout:48 files removed 2024-04-23T18:25:21.091 INFO:teuthology.orchestra.run.smithi062.stdout:48 files removed 2024-04-23T18:25:21.109 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw 2024-04-23T18:25:21.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw 2024-04-23T18:25:21.704 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 247 kB/s | 83 kB 00:00 2024-04-23T18:25:21.721 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 254 kB/s | 83 kB 00:00 2024-04-23T18:25:22.139 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-04-23T18:25:22.163 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-04-23T18:25:22.547 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-04-23T18:25:22.606 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-04-23T18:25:23.117 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-04-23T18:25:26.509 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 8.2 MB/s | 19 MB 00:02 2024-04-23T18:25:30.760 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.2 MB 00:00 2024-04-23T18:25:31.639 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 916 kB/s | 8.0 MB 00:08 2024-04-23T18:25:32.385 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-04-23T18:25:33.814 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-23T18:25:38.005 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 3.7 MB/s | 19 MB 00:05 2024-04-23T18:25:38.878 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-23T18:25:41.029 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:25:41.031 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:25:41.031 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-04-23T18:25:41.031 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:25:41.031 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:25:41.031 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 11 M 2024-04-23T18:25:41.031 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 3.4 M 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 3.1 M 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 5.4 M 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 21 M 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 25 k 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 746 k 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T18:25:41.032 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 500 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 5.4 M 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 45 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 135 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 162 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 321 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 298 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 99 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-23T18:25:41.033 INFO:teuthology.orchestra.run.smithi119.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-23T18:25:41.034 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T18:25:41.034 INFO:teuthology.orchestra.run.smithi119.stdout:Installing weak dependencies: 2024-04-23T18:25:41.034 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-23T18:25:41.034 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:25:41.034 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:25:41.034 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:25:41.034 INFO:teuthology.orchestra.run.smithi119.stdout:Install 30 Packages 2024-04-23T18:25:41.034 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 2 Packages 2024-04-23T18:25:41.034 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:25:41.035 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 60 M 2024-04-23T18:25:41.035 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:25:42.739 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.2 MB 00:00 2024-04-23T18:25:42.980 INFO:teuthology.orchestra.run.smithi119.stdout:(1/32): ceph-base-19.0.0-3217.ge2b3a300.el7.x86 3.4 MB/s | 5.4 MB 00:01 2024-04-23T18:25:43.021 INFO:teuthology.orchestra.run.smithi119.stdout:(2/32): ceph-selinux-19.0.0-3217.ge2b3a300.el7. 609 kB/s | 25 kB 00:00 2024-04-23T18:25:43.130 INFO:teuthology.orchestra.run.smithi119.stdout:(3/32): libcephfs2-19.0.0-3217.ge2b3a300.el7.x8 6.7 MB/s | 746 kB 00:00 2024-04-23T18:25:43.222 INFO:teuthology.orchestra.run.smithi119.stdout:(4/32): libradosstriper1-19.0.0-3217.ge2b3a300. 5.3 MB/s | 500 kB 00:00 2024-04-23T18:25:43.806 INFO:teuthology.orchestra.run.smithi119.stdout:(5/32): librgw2-19.0.0-3217.ge2b3a300.el7.x86_6 9.2 MB/s | 5.4 MB 00:00 2024-04-23T18:25:43.864 INFO:teuthology.orchestra.run.smithi119.stdout:(6/32): python3-ceph-argparse-19.0.0-3217.ge2b3 778 kB/s | 45 kB 00:00 2024-04-23T18:25:44.206 INFO:teuthology.orchestra.run.smithi119.stdout:(7/32): ceph-common-19.0.0-3217.ge2b3a300.el7.x 7.6 MB/s | 21 MB 00:02 2024-04-23T18:25:44.231 INFO:teuthology.orchestra.run.smithi119.stdout:(8/32): python3-ceph-common-19.0.0-3217.ge2b3a3 368 kB/s | 135 kB 00:00 2024-04-23T18:25:44.256 INFO:teuthology.orchestra.run.smithi119.stdout:(9/32): python3-cephfs-19.0.0-3217.ge2b3a300.el 3.2 MB/s | 162 kB 00:00 2024-04-23T18:25:44.298 INFO:teuthology.orchestra.run.smithi119.stdout:(10/32): python3-rados-19.0.0-3217.ge2b3a300.el 4.7 MB/s | 321 kB 00:00 2024-04-23T18:25:44.324 INFO:teuthology.orchestra.run.smithi119.stdout:(11/32): python3-rbd-19.0.0-3217.ge2b3a300.el7. 4.3 MB/s | 298 kB 00:00 2024-04-23T18:25:44.365 INFO:teuthology.orchestra.run.smithi119.stdout:(12/32): python3-rgw-19.0.0-3217.ge2b3a300.el7. 1.5 MB/s | 99 kB 00:00 2024-04-23T18:25:44.566 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-23T18:25:44.741 INFO:teuthology.orchestra.run.smithi119.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 256 kB/s | 107 kB 00:00 2024-04-23T18:25:44.841 INFO:teuthology.orchestra.run.smithi119.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-04-23T18:25:44.866 INFO:teuthology.orchestra.run.smithi119.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 320 kB/s | 160 kB 00:00 2024-04-23T18:25:45.100 INFO:teuthology.orchestra.run.smithi119.stdout:(16/32): ceph-radosgw-19.0.0-3217.ge2b3a300.el7 2.9 MB/s | 11 MB 00:03 2024-04-23T18:25:45.125 INFO:teuthology.orchestra.run.smithi119.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.1 MB/s | 292 kB 00:00 2024-04-23T18:25:45.334 INFO:teuthology.orchestra.run.smithi119.stdout:(18/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.0 MB/s | 221 kB 00:00 2024-04-23T18:25:45.359 INFO:teuthology.orchestra.run.smithi119.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.2 MB/s | 662 kB 00:00 2024-04-23T18:25:45.460 INFO:teuthology.orchestra.run.smithi119.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 286 kB/s | 36 kB 00:00 2024-04-23T18:25:45.493 INFO:teuthology.orchestra.run.smithi119.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 355 kB/s | 47 kB 00:00 2024-04-23T18:25:45.518 INFO:teuthology.orchestra.run.smithi119.stdout:(22/32): python3-prettytable-0.7.2-27.el9.noarc 101 kB/s | 42 kB 00:00 2024-04-23T18:25:46.852 INFO:teuthology.orchestra.run.smithi119.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 19 kB/s | 26 kB 00:01 2024-04-23T18:25:46.953 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 21 MB 00:02 2024-04-23T18:25:47.452 INFO:teuthology.orchestra.run.smithi119.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 155 kB/s | 309 kB 00:01 2024-04-23T18:25:47.852 INFO:teuthology.orchestra.run.smithi119.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 49 kB/s | 49 kB 00:00 2024-04-23T18:25:49.228 INFO:teuthology.orchestra.run.smithi119.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 38 kB/s | 67 kB 00:01 2024-04-23T18:25:51.969 INFO:teuthology.orchestra.run.smithi119.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 70 kB/s | 192 kB 00:02 2024-04-23T18:25:52.267 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-23T18:25:53.361 INFO:teuthology.orchestra.run.smithi119.stdout:(28/32): libarrow-9.0.0-10.el9.x86_64.rpm 575 kB/s | 4.4 MB 00:07 2024-04-23T18:25:53.661 INFO:teuthology.orchestra.run.smithi119.stdout:(29/32): librados2-19.0.0-3217.ge2b3a300.el7.x8 11 MB/s | 3.4 MB 00:00 2024-04-23T18:25:53.712 INFO:teuthology.orchestra.run.smithi119.stdout:(30/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 143 kB/s | 838 kB 00:05 2024-04-23T18:25:53.878 INFO:teuthology.orchestra.run.smithi119.stdout:(31/32): librbd1-19.0.0-3217.ge2b3a300.el7.x86_ 15 MB/s | 3.1 MB 00:00 2024-04-23T18:25:54.486 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:25:54.488 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:25:54.488 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-23T18:25:54.488 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:25:54.488 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:25:54.488 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 11 M 2024-04-23T18:25:54.488 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-04-23T18:25:54.488 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 3.4 M 2024-04-23T18:25:54.489 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 3.1 M 2024-04-23T18:25:54.489 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-23T18:25:54.489 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-23T18:25:54.489 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 5.4 M 2024-04-23T18:25:54.489 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 21 M 2024-04-23T18:25:54.489 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 25 k 2024-04-23T18:25:54.489 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T18:25:54.489 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-23T18:25:54.489 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-23T18:25:54.489 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 746 k 2024-04-23T18:25:54.489 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T18:25:54.489 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T18:25:54.489 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 500 k 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 5.4 M 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 45 k 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 135 k 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 162 k 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 321 k 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 298 k 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 99 k 2024-04-23T18:25:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-23T18:25:54.491 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-23T18:25:54.491 INFO:teuthology.orchestra.run.smithi062.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-23T18:25:54.491 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T18:25:54.491 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-04-23T18:25:54.491 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-23T18:25:54.491 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:25:54.491 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:25:54.491 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:25:54.491 INFO:teuthology.orchestra.run.smithi062.stdout:Install 30 Packages 2024-04-23T18:25:54.491 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 2 Packages 2024-04-23T18:25:54.491 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:25:54.492 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 60 M 2024-04-23T18:25:54.492 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:25:56.693 INFO:teuthology.orchestra.run.smithi062.stdout:(1/32): ceph-radosgw-19.0.0-3217.ge2b3a300.el7. 5.5 MB/s | 11 MB 00:01 2024-04-23T18:25:56.735 INFO:teuthology.orchestra.run.smithi062.stdout:(2/32): ceph-selinux-19.0.0-3217.ge2b3a300.el7. 607 kB/s | 25 kB 00:00 2024-04-23T18:25:56.779 INFO:teuthology.orchestra.run.smithi119.stdout:(32/32): thrift-0.15.0-2.el9.x86_64.rpm 337 kB/s | 1.6 MB 00:04 2024-04-23T18:25:56.784 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:25:56.784 INFO:teuthology.orchestra.run.smithi119.stdout:Total 3.8 MB/s | 60 MB 00:15 2024-04-23T18:25:56.851 INFO:teuthology.orchestra.run.smithi062.stdout:(3/32): libcephfs2-19.0.0-3217.ge2b3a300.el7.x8 6.3 MB/s | 746 kB 00:00 2024-04-23T18:25:56.884 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:25:56.921 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:25:56.921 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:25:56.926 INFO:teuthology.orchestra.run.smithi062.stdout:(4/32): libradosstriper1-19.0.0-3217.ge2b3a300. 6.5 MB/s | 500 kB 00:00 2024-04-23T18:25:57.387 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:25:57.389 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:25:57.544 INFO:teuthology.orchestra.run.smithi062.stdout:(5/32): ceph-common-19.0.0-3217.ge2b3a300.el7.x 7.6 MB/s | 21 MB 00:02 2024-04-23T18:25:57.619 INFO:teuthology.orchestra.run.smithi062.stdout:(6/32): librgw2-19.0.0-3217.ge2b3a300.el7.x86_6 7.8 MB/s | 5.4 MB 00:00 2024-04-23T18:25:57.636 INFO:teuthology.orchestra.run.smithi062.stdout:(7/32): python3-ceph-argparse-19.0.0-3217.ge2b3 492 kB/s | 45 kB 00:00 2024-04-23T18:25:57.669 INFO:teuthology.orchestra.run.smithi062.stdout:(8/32): python3-ceph-common-19.0.0-3217.ge2b3a3 2.6 MB/s | 135 kB 00:00 2024-04-23T18:25:57.694 INFO:teuthology.orchestra.run.smithi062.stdout:(9/32): python3-cephfs-19.0.0-3217.ge2b3a300.el 2.7 MB/s | 162 kB 00:00 2024-04-23T18:25:57.720 INFO:teuthology.orchestra.run.smithi062.stdout:(10/32): python3-rados-19.0.0-3217.ge2b3a300.el 6.2 MB/s | 321 kB 00:00 2024-04-23T18:25:57.745 INFO:teuthology.orchestra.run.smithi062.stdout:(11/32): python3-rbd-19.0.0-3217.ge2b3a300.el7. 5.8 MB/s | 298 kB 00:00 2024-04-23T18:25:57.770 INFO:teuthology.orchestra.run.smithi062.stdout:(12/32): python3-rgw-19.0.0-3217.ge2b3a300.el7. 1.9 MB/s | 99 kB 00:00 2024-04-23T18:25:57.837 INFO:teuthology.orchestra.run.smithi062.stdout:(13/32): ceph-base-19.0.0-3217.ge2b3a300.el7.x8 1.7 MB/s | 5.4 MB 00:03 2024-04-23T18:25:57.904 INFO:teuthology.orchestra.run.smithi062.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 674 kB/s | 107 kB 00:00 2024-04-23T18:25:57.946 INFO:teuthology.orchestra.run.smithi062.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-04-23T18:25:57.971 INFO:teuthology.orchestra.run.smithi062.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 798 kB/s | 160 kB 00:00 2024-04-23T18:25:58.022 INFO:teuthology.orchestra.run.smithi062.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-04-23T18:25:58.047 INFO:teuthology.orchestra.run.smithi062.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 563 kB/s | 42 kB 00:00 2024-04-23T18:25:58.072 INFO:teuthology.orchestra.run.smithi062.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-04-23T18:25:58.106 INFO:teuthology.orchestra.run.smithi062.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-04-23T18:25:58.131 INFO:teuthology.orchestra.run.smithi062.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 428 kB/s | 36 kB 00:00 2024-04-23T18:25:58.156 INFO:teuthology.orchestra.run.smithi062.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-04-23T18:25:58.868 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:25:59.021 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-23T18:25:59.058 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-23T18:25:59.092 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-23T18:25:59.115 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-23T18:25:59.134 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-23T18:25:59.331 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-23T18:25:59.386 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-23T18:25:59.708 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-23T18:25:59.819 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:19.0.0-3217.ge2b3a300.el7.x86_64 7/34 2024-04-23T18:25:59.911 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:19.0.0-3217.ge2b3a300.el7.x86_64 7/34 2024-04-23T18:26:00.001 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:19.0.0-3217.ge2b3a300.el7.x86_64 8/34 2024-04-23T18:26:00.029 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:19.0.0-3217.ge2b3a300.el7.x86_64 9/34 2024-04-23T18:26:00.092 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:19.0.0-3217.ge2b3a300.el7.x86_64 9/34 2024-04-23T18:26:00.120 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-23T18:26:00.164 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:19.0.0-3217.ge2b3a300.el7. 11/34 2024-04-23T18:26:00.232 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:19.0.0-3217.ge2b3a300.el7.x86_64 12/34 2024-04-23T18:26:00.256 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:19.0.0-3217.ge2b3a300.el7.x86_6 13/34 2024-04-23T18:26:00.312 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3217.ge2b3a300.el7.x86_6 13/34 2024-04-23T18:26:00.346 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-23T18:26:00.454 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-23T18:26:00.488 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-23T18:26:00.528 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-23T18:26:00.554 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-23T18:26:00.583 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-23T18:26:00.607 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-23T18:26:00.923 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-23T18:26:00.971 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:19.0.0-3217.ge2b3a300.el7.x86_64 22/34 2024-04-23T18:26:01.053 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:19.0.0-3217.ge2b3a300.el7.x86_64 22/34 2024-04-23T18:26:01.083 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 23/34 2024-04-23T18:26:01.119 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-23T18:26:01.597 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-23T18:26:01.623 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:19.0.0-3217.ge2b3a300.el7.x86_64 26/34 2024-04-23T18:26:01.695 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:19.0.0-3217.ge2b3a300.el7.x86_64 26/34 2024-04-23T18:26:01.771 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 27/34 2024-04-23T18:26:01.801 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:19.0.0-3217.ge2b3a300.el7.x8 28/34 2024-04-23T18:26:04.046 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.0.0-3217.ge2b3a300.el7.x86_64 29/34 2024-04-23T18:26:04.081 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:19.0.0-3217.ge2b3a300.el7.x86_64 29/34 2024-04-23T18:26:04.619 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.0.0-3217.ge2b3a300.el7.x86_64 29/34 2024-04-23T18:26:04.659 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:19.0.0-3217.ge2b3a300.el7.x86_64 30/34 2024-04-23T18:26:04.749 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:19.0.0-3217.ge2b3a300.el7.x86_64 30/34 2024-04-23T18:26:04.749 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T18:26:04.749 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T18:26:04.749 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:04.785 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:19.0.0-3217.ge2b3a300.el7.x86_64 31/34 2024-04-23T18:26:05.814 INFO:teuthology.orchestra.run.smithi062.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 40 kB/s | 309 kB 00:07 2024-04-23T18:26:06.381 INFO:teuthology.orchestra.run.smithi062.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 86 kB/s | 49 kB 00:00 2024-04-23T18:26:06.473 INFO:teuthology.orchestra.run.smithi062.stdout:(25/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 3.1 kB/s | 26 kB 00:08 2024-04-23T18:26:06.498 INFO:teuthology.orchestra.run.smithi062.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 576 kB/s | 67 kB 00:00 2024-04-23T18:26:06.582 INFO:teuthology.orchestra.run.smithi062.stdout:(27/32): libarrow-9.0.0-10.el9.x86_64.rpm 535 kB/s | 4.4 MB 00:08 2024-04-23T18:26:06.632 INFO:teuthology.orchestra.run.smithi062.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-04-23T18:26:06.716 INFO:teuthology.orchestra.run.smithi062.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-23T18:26:07.007 INFO:teuthology.orchestra.run.smithi062.stdout:(30/32): librbd1-19.0.0-3217.ge2b3a300.el7.x86_ 11 MB/s | 3.1 MB 00:00 2024-04-23T18:26:07.341 INFO:teuthology.orchestra.run.smithi062.stdout:(31/32): librados2-19.0.0-3217.ge2b3a300.el7.x8 4.8 MB/s | 3.4 MB 00:00 2024-04-23T18:26:10.141 INFO:teuthology.orchestra.run.smithi062.stdout:(32/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 228 kB/s | 838 kB 00:03 2024-04-23T18:26:10.143 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:26:10.144 INFO:teuthology.orchestra.run.smithi062.stdout:Total 3.9 MB/s | 60 MB 00:15 2024-04-23T18:26:10.243 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:26:10.284 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:26:10.285 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:26:10.776 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:26:10.776 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:26:12.295 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:26:12.376 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-23T18:26:12.404 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-23T18:26:12.430 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-23T18:26:12.452 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-23T18:26:12.475 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-23T18:26:12.636 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-23T18:26:12.691 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-23T18:26:13.029 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-23T18:26:13.132 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:19.0.0-3217.ge2b3a300.el7.x86_64 7/34 2024-04-23T18:26:13.233 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:19.0.0-3217.ge2b3a300.el7.x86_64 7/34 2024-04-23T18:26:13.323 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:19.0.0-3217.ge2b3a300.el7.x86_64 8/34 2024-04-23T18:26:13.350 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:19.0.0-3217.ge2b3a300.el7.x86_64 9/34 2024-04-23T18:26:13.412 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:19.0.0-3217.ge2b3a300.el7.x86_64 9/34 2024-04-23T18:26:13.442 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-23T18:26:13.486 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:19.0.0-3217.ge2b3a300.el7. 11/34 2024-04-23T18:26:13.555 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:19.0.0-3217.ge2b3a300.el7.x86_64 12/34 2024-04-23T18:26:13.577 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:19.0.0-3217.ge2b3a300.el7.x86_6 13/34 2024-04-23T18:26:13.641 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3217.ge2b3a300.el7.x86_6 13/34 2024-04-23T18:26:13.675 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-23T18:26:13.778 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-23T18:26:13.817 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-23T18:26:13.858 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-23T18:26:13.885 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-23T18:26:13.914 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-23T18:26:13.946 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-23T18:26:14.072 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3217.ge2b3a300.el7.x86_64 31/34 2024-04-23T18:26:14.072 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2024-04-23T18:26:14.072 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2024-04-23T18:26:14.072 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2024-04-23T18:26:14.072 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2024-04-23T18:26:14.072 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2024-04-23T18:26:14.072 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /root 2024-04-23T18:26:14.072 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2024-04-23T18:26:14.073 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:14.275 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-23T18:26:14.317 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:19.0.0-3217.ge2b3a300.el7.x86_64 22/34 2024-04-23T18:26:14.417 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:19.0.0-3217.ge2b3a300.el7.x86_64 22/34 2024-04-23T18:26:14.447 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 23/34 2024-04-23T18:26:14.483 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-23T18:26:14.988 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-23T18:26:15.011 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:19.0.0-3217.ge2b3a300.el7.x86_64 26/34 2024-04-23T18:26:15.037 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 32/34 2024-04-23T18:26:15.060 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 32/34 2024-04-23T18:26:15.061 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:26:15.061 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T18:26:15.061 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T18:26:15.061 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T18:26:15.061 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:15.063 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-23T18:26:15.066 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:19.0.0-3217.ge2b3a300.el7.x86_64 26/34 2024-04-23T18:26:15.138 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 27/34 2024-04-23T18:26:15.147 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-23T18:26:15.147 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T18:26:15.180 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:19.0.0-3217.ge2b3a300.el7.x8 28/34 2024-04-23T18:26:16.371 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T18:26:16.371 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/34 2024-04-23T18:26:16.371 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:19.0.0-3217.ge2b3a300.el7.x86_64 2/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 3/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:19.0.0-3217.ge2b3a300.el7.x86_64 4/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:19.0.0-3217.ge2b3a300.el7.x86_64 5/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:19.0.0-3217.ge2b3a300.el7.x86_6 6/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:19.0.0-3217.ge2b3a300.el7.x86_64 7/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3217.ge2b3a300.el7. 8/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:19.0.0-3217.ge2b3a300.el7.x8 9/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:19.0.0-3217.ge2b3a300.el7.x86_64 10/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:19.0.0-3217.ge2b3a300.el7.x86_64 11/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 12/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 13/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-23T18:26:16.372 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-23T18:26:16.373 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:19.0.0-3217.ge2b3a300.el7.x86_64 31/34 2024-04-23T18:26:16.374 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-23T18:26:16.374 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:19.0.0-3217.ge2b3a300.el7.x86_64 33/34 2024-04-23T18:26:17.114 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T18:26:17.114 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:17.115 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2024-04-23T18:26:17.115 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.115 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.115 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:26:17.115 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-23T18:26:17.115 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.115 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.115 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.115 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.115 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T18:26:17.115 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-23T18:26:17.115 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-23T18:26:17.115 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.116 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T18:26:17.116 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T18:26:17.116 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T18:26:17.116 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.116 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T18:26:17.116 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.116 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T18:26:17.116 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T18:26:17.116 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-23T18:26:17.116 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.116 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.116 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.116 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T18:26:17.117 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.117 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.117 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:17.117 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-23T18:26:17.117 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-23T18:26:17.117 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-23T18:26:17.117 INFO:teuthology.orchestra.run.smithi119.stdout: re2-1:20211101-3.el9.x86_64 2024-04-23T18:26:17.117 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T18:26:17.117 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:17.117 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:26:17.374 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-test 2024-04-23T18:26:17.784 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-3217.ge2b3a300.el7.x86_64 29/34 2024-04-23T18:26:17.818 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:19.0.0-3217.ge2b3a300.el7.x86_64 29/34 2024-04-23T18:26:17.900 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:39 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:26:18.020 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:26:18.021 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:18.021 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-04-23T18:26:18.021 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:18.021 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:26:18.021 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 49 M 2024-04-23T18:26:18.021 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-04-23T18:26:18.021 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 163 k 2024-04-23T18:26:18.021 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T18:26:18.022 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T18:26:18.022 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:18.022 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:26:18.022 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:18.022 INFO:teuthology.orchestra.run.smithi119.stdout:Install 4 Packages 2024-04-23T18:26:18.022 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:18.023 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 50 M 2024-04-23T18:26:18.023 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 211 M 2024-04-23T18:26:18.023 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:26:18.280 INFO:teuthology.orchestra.run.smithi119.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.6 MB/s | 305 kB 00:00 2024-04-23T18:26:18.363 INFO:teuthology.orchestra.run.smithi119.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 764 kB/s | 64 kB 00:00 2024-04-23T18:26:18.389 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-3217.ge2b3a300.el7.x86_64 29/34 2024-04-23T18:26:18.430 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:19.0.0-3217.ge2b3a300.el7.x86_64 30/34 2024-04-23T18:26:18.506 INFO:teuthology.orchestra.run.smithi119.stdout:(3/4): libcephsqlite-19.0.0-3217.ge2b3a300.el7. 397 kB/s | 163 kB 00:00 2024-04-23T18:26:18.522 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:19.0.0-3217.ge2b3a300.el7.x86_64 30/34 2024-04-23T18:26:18.522 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T18:26:18.522 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T18:26:18.522 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:18.556 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:19.0.0-3217.ge2b3a300.el7.x86_64 31/34 2024-04-23T18:26:25.685 INFO:teuthology.orchestra.run.smithi119.stdout:(4/4): ceph-test-19.0.0-3217.ge2b3a300.el7.x86_ 6.5 MB/s | 49 MB 00:07 2024-04-23T18:26:25.686 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:26:25.687 INFO:teuthology.orchestra.run.smithi119.stdout:Total 6.5 MB/s | 50 MB 00:07 2024-04-23T18:26:25.714 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:26:25.734 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:26:25.734 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:26:26.103 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:26:26.103 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:26:26.630 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:26:26.702 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-23T18:26:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-23T18:26:26.769 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:19.0.0-3217.ge2b3a300.el7.x86_64 3/4 2024-04-23T18:26:28.527 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3217.ge2b3a300.el7.x86_64 31/34 2024-04-23T18:26:28.527 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-04-23T18:26:28.527 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-04-23T18:26:28.527 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-04-23T18:26:28.528 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-04-23T18:26:28.528 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-04-23T18:26:28.528 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2024-04-23T18:26:28.528 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-04-23T18:26:28.528 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:29.522 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 32/34 2024-04-23T18:26:29.547 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 32/34 2024-04-23T18:26:29.547 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:26:29.547 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T18:26:29.547 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T18:26:29.548 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T18:26:29.548 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:29.549 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-23T18:26:29.641 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-23T18:26:29.642 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T18:26:31.052 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T18:26:31.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/34 2024-04-23T18:26:31.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:19.0.0-3217.ge2b3a300.el7.x86_64 2/34 2024-04-23T18:26:31.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 3/34 2024-04-23T18:26:31.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:19.0.0-3217.ge2b3a300.el7.x86_64 4/34 2024-04-23T18:26:31.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:19.0.0-3217.ge2b3a300.el7.x86_64 5/34 2024-04-23T18:26:31.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:19.0.0-3217.ge2b3a300.el7.x86_6 6/34 2024-04-23T18:26:31.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:19.0.0-3217.ge2b3a300.el7.x86_64 7/34 2024-04-23T18:26:31.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3217.ge2b3a300.el7. 8/34 2024-04-23T18:26:31.052 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:19.0.0-3217.ge2b3a300.el7.x8 9/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:19.0.0-3217.ge2b3a300.el7.x86_64 10/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:19.0.0-3217.ge2b3a300.el7.x86_64 11/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 12/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 13/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-23T18:26:31.053 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-23T18:26:31.054 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-23T18:26:31.054 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-23T18:26:31.054 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-23T18:26:31.054 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-23T18:26:31.054 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-23T18:26:31.054 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-23T18:26:31.055 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-23T18:26:31.055 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:19.0.0-3217.ge2b3a300.el7.x86_64 31/34 2024-04-23T18:26:31.055 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-23T18:26:31.055 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:19.0.0-3217.ge2b3a300.el7.x86_64 33/34 2024-04-23T18:26:31.335 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3217.ge2b3a300.el7.x86_64 3/4 2024-04-23T18:26:31.417 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:19.0.0-3217.ge2b3a300.el7.x86_64 4/4 2024-04-23T18:26:31.814 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T18:26:31.814 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:31.814 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-04-23T18:26:31.814 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.814 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.814 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.815 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-23T18:26:31.816 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-23T18:26:31.817 INFO:teuthology.orchestra.run.smithi062.stdout: re2-1:20211101-3.el9.x86_64 2024-04-23T18:26:31.817 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T18:26:31.817 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:31.817 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:26:32.072 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-test 2024-04-23T18:26:32.637 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:40 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:26:32.759 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:26:32.760 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:26:32.760 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-23T18:26:32.760 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:26:32.760 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:26:32.760 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 49 M 2024-04-23T18:26:32.760 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-23T18:26:32.761 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 163 k 2024-04-23T18:26:32.761 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T18:26:32.761 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T18:26:32.761 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:32.761 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:26:32.761 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:26:32.761 INFO:teuthology.orchestra.run.smithi062.stdout:Install 4 Packages 2024-04-23T18:26:32.761 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:32.762 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 50 M 2024-04-23T18:26:32.762 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 211 M 2024-04-23T18:26:32.762 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:26:33.375 INFO:teuthology.orchestra.run.smithi062.stdout:(1/4): libcephsqlite-19.0.0-3217.ge2b3a300.el7. 472 kB/s | 163 kB 00:00 2024-04-23T18:26:33.816 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-test-2:19.0.0-3217.ge2b3a300.el7.x86_64 4/4 2024-04-23T18:26:33.816 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/4 2024-04-23T18:26:33.816 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:19.0.0-3217.ge2b3a300.el7.x86_64 2/4 2024-04-23T18:26:33.816 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-23T18:26:34.046 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-23T18:26:34.046 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:34.046 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:26:34.046 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:34.046 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:34.046 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T18:26:34.047 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T18:26:34.047 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:34.047 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:26:34.056 INFO:teuthology.orchestra.run.smithi062.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 297 kB/s | 305 kB 00:01 2024-04-23T18:26:34.102 INFO:teuthology.orchestra.run.smithi062.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 88 kB/s | 64 kB 00:00 2024-04-23T18:26:34.333 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph 2024-04-23T18:26:34.843 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:00:56 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:26:34.968 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:26:34.971 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:34.971 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-04-23T18:26:34.971 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:34.971 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:26:34.971 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 6.6 k 2024-04-23T18:26:34.971 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-04-23T18:26:34.972 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 2.4 M 2024-04-23T18:26:34.972 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 1.5 M 2024-04-23T18:26:34.972 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 249 k 2024-04-23T18:26:34.972 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 4.7 M 2024-04-23T18:26:34.972 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 17 M 2024-04-23T18:26:34.972 INFO:teuthology.orchestra.run.smithi119.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-23T18:26:34.972 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-23T18:26:34.972 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-23T18:26:34.972 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T18:26:34.972 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T18:26:34.972 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T18:26:34.972 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T18:26:34.972 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T18:26:34.973 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T18:26:34.973 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T18:26:34.973 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections 2024-04-23T18:26:34.973 INFO:teuthology.orchestra.run.smithi119.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-23T18:26:34.973 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T18:26:34.973 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T18:26:34.973 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T18:26:34.973 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T18:26:34.973 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T18:26:34.973 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T18:26:34.973 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T18:26:34.973 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T18:26:34.973 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T18:26:34.974 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T18:26:34.974 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T18:26:34.974 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T18:26:34.974 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T18:26:34.974 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T18:26:34.974 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T18:26:34.974 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T18:26:34.974 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T18:26:34.974 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T18:26:34.974 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T18:26:34.974 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:34.974 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:26:34.974 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:34.975 INFO:teuthology.orchestra.run.smithi119.stdout:Install 36 Packages 2024-04-23T18:26:34.975 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:34.975 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 30 M 2024-04-23T18:26:34.975 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 107 M 2024-04-23T18:26:34.975 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:26:35.459 INFO:teuthology.orchestra.run.smithi062.stdout:(4/4): ceph-test-19.0.0-3217.ge2b3a300.el7.x86_ 20 MB/s | 49 MB 00:02 2024-04-23T18:26:35.461 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:26:35.462 INFO:teuthology.orchestra.run.smithi062.stdout:Total 18 MB/s | 50 MB 00:02 2024-04-23T18:26:35.488 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:26:35.511 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:26:35.511 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:26:35.845 INFO:teuthology.orchestra.run.smithi119.stdout:(1/36): ceph-19.0.0-3217.ge2b3a300.el7.x86_64.r 31 kB/s | 6.6 kB 00:00 2024-04-23T18:26:35.902 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:26:35.902 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:26:35.953 INFO:teuthology.orchestra.run.smithi119.stdout:(2/36): ceph-mgr-19.0.0-3217.ge2b3a300.el7.x86_ 4.7 MB/s | 1.5 MB 00:00 2024-04-23T18:26:36.429 INFO:teuthology.orchestra.run.smithi119.stdout:(3/36): ceph-mds-19.0.0-3217.ge2b3a300.el7.x86_ 3.0 MB/s | 2.4 MB 00:00 2024-04-23T18:26:36.447 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:26:36.529 INFO:teuthology.orchestra.run.smithi119.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3217.ge2b3 2.4 MB/s | 249 kB 00:00 2024-04-23T18:26:36.535 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-23T18:26:36.584 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-23T18:26:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:19.0.0-3217.ge2b3a300.el7.x86_64 3/4 2024-04-23T18:26:36.888 INFO:teuthology.orchestra.run.smithi119.stdout:(5/36): ceph-osd-19.0.0-3217.ge2b3a300.el7.x86_ 18 MB/s | 17 MB 00:00 2024-04-23T18:26:36.912 INFO:teuthology.orchestra.run.smithi119.stdout:(6/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 660 kB/s | 253 kB 00:00 2024-04-23T18:26:36.963 INFO:teuthology.orchestra.run.smithi119.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-23T18:26:37.021 INFO:teuthology.orchestra.run.smithi119.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-04-23T18:26:37.072 INFO:teuthology.orchestra.run.smithi119.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-04-23T18:26:37.130 INFO:teuthology.orchestra.run.smithi119.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-04-23T18:26:37.314 INFO:teuthology.orchestra.run.smithi119.stdout:(11/36): python3-cryptography-36.0.1-4.el9.x86_ 2.9 MB/s | 1.2 MB 00:00 2024-04-23T18:26:37.339 INFO:teuthology.orchestra.run.smithi119.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 904 kB/s | 188 kB 00:00 2024-04-23T18:26:37.406 INFO:teuthology.orchestra.run.smithi119.stdout:(13/36): ceph-mon-19.0.0-3217.ge2b3a300.el7.x86 3.0 MB/s | 4.7 MB 00:01 2024-04-23T18:26:37.431 INFO:teuthology.orchestra.run.smithi119.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 377 kB/s | 35 kB 00:00 2024-04-23T18:26:37.473 INFO:teuthology.orchestra.run.smithi119.stdout:(15/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-04-23T18:26:37.499 INFO:teuthology.orchestra.run.smithi119.stdout:(16/36): python3-mako-1.1.4-6.el9.noarch.rpm 933 kB/s | 172 kB 00:00 2024-04-23T18:26:37.524 INFO:teuthology.orchestra.run.smithi119.stdout:(17/36): python3-pytz-2021.1-5.el9.noarch.rpm 433 kB/s | 51 kB 00:00 2024-04-23T18:26:37.816 INFO:teuthology.orchestra.run.smithi119.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 149 kB/s | 43 kB 00:00 2024-04-23T18:26:37.841 INFO:teuthology.orchestra.run.smithi119.stdout:(19/36): lua-devel-5.4.4-4.el9.x86_64.rpm 61 kB/s | 22 kB 00:00 2024-04-23T18:26:37.883 INFO:teuthology.orchestra.run.smithi119.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 393 kB/s | 151 kB 00:00 2024-04-23T18:26:37.942 INFO:teuthology.orchestra.run.smithi119.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-04-23T18:26:38.001 INFO:teuthology.orchestra.run.smithi119.stdout:(22/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2024-04-23T18:26:38.026 INFO:teuthology.orchestra.run.smithi119.stdout:(23/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 75 kB/s | 11 kB 00:00 2024-04-23T18:26:38.051 INFO:teuthology.orchestra.run.smithi119.stdout:(24/36): python3-jaraco-classes-3.2.1-5.el9.noa 163 kB/s | 18 kB 00:00 2024-04-23T18:26:38.076 INFO:teuthology.orchestra.run.smithi119.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2024-04-23T18:26:38.118 INFO:teuthology.orchestra.run.smithi119.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 291 kB/s | 19 kB 00:00 2024-04-23T18:26:38.135 INFO:teuthology.orchestra.run.smithi119.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 235 kB/s | 20 kB 00:00 2024-04-23T18:26:38.152 INFO:teuthology.orchestra.run.smithi119.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 613 kB/s | 46 kB 00:00 2024-04-23T18:26:38.194 INFO:teuthology.orchestra.run.smithi119.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-04-23T18:26:38.219 INFO:teuthology.orchestra.run.smithi119.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-23T18:26:38.236 INFO:teuthology.orchestra.run.smithi119.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 196 kB/s | 16 kB 00:00 2024-04-23T18:26:38.261 INFO:teuthology.orchestra.run.smithi119.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-04-23T18:26:38.278 INFO:teuthology.orchestra.run.smithi119.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 609 kB/s | 36 kB 00:00 2024-04-23T18:26:38.321 INFO:teuthology.orchestra.run.smithi119.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-23T18:26:38.354 INFO:teuthology.orchestra.run.smithi119.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2024-04-23T18:26:38.371 INFO:teuthology.orchestra.run.smithi119.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 216 kB/s | 20 kB 00:00 2024-04-23T18:26:38.375 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:26:38.375 INFO:teuthology.orchestra.run.smithi119.stdout:Total 8.9 MB/s | 30 MB 00:03 2024-04-23T18:26:38.510 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:26:38.549 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:26:38.550 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:26:38.842 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:26:38.842 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:26:40.091 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:26:40.149 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-23T18:26:40.173 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-23T18:26:40.209 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-23T18:26:40.279 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-23T18:26:40.316 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-23T18:26:40.349 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-23T18:26:40.439 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-23T18:26:40.520 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-23T18:26:40.560 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-23T18:26:40.596 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-23T18:26:40.625 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-23T18:26:40.660 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-23T18:26:40.693 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-23T18:26:40.734 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-23T18:26:40.769 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-23T18:26:40.803 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-23T18:26:40.842 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-23T18:26:40.915 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-23T18:26:41.055 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-23T18:26:41.132 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-23T18:26:41.194 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-23T18:26:41.233 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-23T18:26:41.281 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-23T18:26:41.337 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-23T18:26:41.463 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3217.ge2b3a300.el7.x86_64 3/4 2024-04-23T18:26:41.523 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-23T18:26:41.534 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:19.0.0-3217.ge2b3a300.el7.x86_64 4/4 2024-04-23T18:26:41.570 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-23T18:26:41.639 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-23T18:26:41.727 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-23T18:26:41.770 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-23T18:26:41.884 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-23T18:26:42.042 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3217.ge2b3a300.el7. 31/36 2024-04-23T18:26:42.072 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:19.0.0-3217.ge2b3a300.el7.x86_64 32/36 2024-04-23T18:26:42.097 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3217.ge2b3a300.el7.x86_64 32/36 2024-04-23T18:26:42.097 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:26:42.097 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T18:26:42.097 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T18:26:42.097 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T18:26:42.097 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:43.540 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:19.0.0-3217.ge2b3a300.el7.x86_64 33/36 2024-04-23T18:26:43.566 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:19.0.0-3217.ge2b3a300.el7.x86_64 33/36 2024-04-23T18:26:43.566 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:26:43.566 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T18:26:43.566 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T18:26:43.566 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T18:26:43.566 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:44.016 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:19.0.0-3217.ge2b3a300.el7.x86_64 34/36 2024-04-23T18:26:44.040 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:19.0.0-3217.ge2b3a300.el7.x86_64 34/36 2024-04-23T18:26:44.040 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:26:44.040 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T18:26:44.040 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T18:26:44.040 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T18:26:44.040 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:44.144 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-test-2:19.0.0-3217.ge2b3a300.el7.x86_64 4/4 2024-04-23T18:26:44.144 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/4 2024-04-23T18:26:44.144 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:19.0.0-3217.ge2b3a300.el7.x86_64 2/4 2024-04-23T18:26:44.144 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-23T18:26:44.266 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:19.0.0-3217.ge2b3a300.el7.x86_64 35/36 2024-04-23T18:26:44.289 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:19.0.0-3217.ge2b3a300.el7.x86_64 35/36 2024-04-23T18:26:44.289 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:26:44.289 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T18:26:44.289 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T18:26:44.290 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T18:26:44.290 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:44.353 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:19.0.0-3217.ge2b3a300.el7.x86_64 36/36 2024-04-23T18:26:44.406 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-23T18:26:44.406 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:44.406 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:26:44.406 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:44.406 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:44.406 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T18:26:44.406 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T18:26:44.406 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:44.406 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:26:44.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph 2024-04-23T18:26:45.231 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:00:53 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:26:45.358 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:26:45.361 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:26:45.361 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-23T18:26:45.361 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:26:45.361 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:26:45.361 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 6.6 k 2024-04-23T18:26:45.362 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-23T18:26:45.362 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 2.4 M 2024-04-23T18:26:45.362 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 1.5 M 2024-04-23T18:26:45.362 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 249 k 2024-04-23T18:26:45.362 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 4.7 M 2024-04-23T18:26:45.362 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 17 M 2024-04-23T18:26:45.362 INFO:teuthology.orchestra.run.smithi062.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-23T18:26:45.362 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-23T18:26:45.362 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-23T18:26:45.362 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T18:26:45.362 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T18:26:45.362 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T18:26:45.362 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T18:26:45.363 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:26:45.364 INFO:teuthology.orchestra.run.smithi062.stdout:Install 36 Packages 2024-04-23T18:26:45.365 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:45.365 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 30 M 2024-04-23T18:26:45.365 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 107 M 2024-04-23T18:26:45.365 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:26:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-2:19.0.0-3217.ge2b3a300.el7.x86_64 36/36 2024-04-23T18:26:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/36 2024-04-23T18:26:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:19.0.0-3217.ge2b3a300.el7.x86_64 2/36 2024-04-23T18:26:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:19.0.0-3217.ge2b3a300.el7.x86_64 3/36 2024-04-23T18:26:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:19.0.0-3217.ge2b3a300.el7.x86_64 4/36 2024-04-23T18:26:45.939 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:19.0.0-3217.ge2b3a300.el7.x86_64 5/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3217.ge2b3a300.el7. 6/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-23T18:26:45.940 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-23T18:26:45.941 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-23T18:26:45.942 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-23T18:26:46.526 INFO:teuthology.orchestra.run.smithi062.stdout:(1/36): ceph-19.0.0-3217.ge2b3a300.el7.x86_64.r 40 kB/s | 6.6 kB 00:00 2024-04-23T18:26:46.792 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-23T18:26:46.792 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:46.792 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:26:46.792 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:46.792 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:46.792 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:46.792 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:26:46.792 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:46.792 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:46.792 INFO:teuthology.orchestra.run.smithi119.stdout: lua-5.4.4-4.el9.x86_64 2024-04-23T18:26:46.792 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-23T18:26:46.792 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-23T18:26:46.792 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T18:26:46.793 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T18:26:46.793 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T18:26:46.793 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T18:26:46.793 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T18:26:46.793 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T18:26:46.793 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T18:26:46.793 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T18:26:46.793 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T18:26:46.793 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T18:26:46.793 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T18:26:46.793 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T18:26:46.793 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T18:26:46.794 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T18:26:46.794 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T18:26:46.794 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T18:26:46.794 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T18:26:46.794 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T18:26:46.794 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T18:26:46.794 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T18:26:46.794 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T18:26:46.794 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T18:26:46.794 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T18:26:46.794 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T18:26:46.794 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T18:26:46.795 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T18:26:46.795 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T18:26:46.795 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:46.795 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:26:46.802 INFO:teuthology.orchestra.run.smithi062.stdout:(2/36): ceph-mgr-19.0.0-3217.ge2b3a300.el7.x86_ 3.4 MB/s | 1.5 MB 00:00 2024-04-23T18:26:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:(3/36): ceph-mds-19.0.0-3217.ge2b3a300.el7.x86_ 4.8 MB/s | 2.4 MB 00:00 2024-04-23T18:26:46.927 INFO:teuthology.orchestra.run.smithi062.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3217.ge2b3 3.2 MB/s | 249 kB 00:00 2024-04-23T18:26:47.086 INFO:teuthology.orchestra.run.smithi062.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-04-23T18:26:47.118 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-base 2024-04-23T18:26:47.170 INFO:teuthology.orchestra.run.smithi062.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 15 MB/s | 1.2 MB 00:00 2024-04-23T18:26:47.211 INFO:teuthology.orchestra.run.smithi062.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-04-23T18:26:47.245 INFO:teuthology.orchestra.run.smithi062.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 4.0 MB/s | 135 kB 00:00 2024-04-23T18:26:47.287 INFO:teuthology.orchestra.run.smithi062.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-04-23T18:26:47.337 INFO:teuthology.orchestra.run.smithi062.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-04-23T18:26:47.404 INFO:teuthology.orchestra.run.smithi062.stdout:(11/36): ceph-mon-19.0.0-3217.ge2b3a300.el7.x86 5.4 MB/s | 4.7 MB 00:00 2024-04-23T18:26:47.538 INFO:teuthology.orchestra.run.smithi062.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 942 kB/s | 188 kB 00:00 2024-04-23T18:26:47.554 INFO:teuthology.orchestra.run.smithi062.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-04-23T18:26:47.644 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:09 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:26:47.730 INFO:teuthology.orchestra.run.smithi062.stdout:(14/36): ceph-osd-19.0.0-3217.ge2b3a300.el7.x86 18 MB/s | 17 MB 00:00 2024-04-23T18:26:47.734 INFO:teuthology.orchestra.run.smithi119.stdout:Package ceph-base-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:26:47.763 INFO:teuthology.orchestra.run.smithi062.stdout:(15/36): python3-markupsafe-1.1.1-12.el9.x86_64 154 kB/s | 35 kB 00:00 2024-04-23T18:26:47.776 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:26:47.777 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-04-23T18:26:47.777 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:26:47.789 INFO:teuthology.orchestra.run.smithi062.stdout:(16/36): python3-pytz-2021.1-5.el9.noarch.rpm 218 kB/s | 51 kB 00:00 2024-04-23T18:26:47.847 INFO:teuthology.orchestra.run.smithi062.stdout:(17/36): python3-toml-0.10.2-6.el9.noarch.rpm 355 kB/s | 42 kB 00:00 2024-04-23T18:26:47.848 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install cephadm 2024-04-23T18:26:47.898 INFO:teuthology.orchestra.run.smithi062.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-04-23T18:26:48.356 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:10 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:26:48.476 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:26:48.477 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:48.477 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-04-23T18:26:48.477 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:48.477 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:26:48.477 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 762 k 2024-04-23T18:26:48.478 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:48.478 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:26:48.478 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:48.478 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-04-23T18:26:48.478 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:48.478 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 762 k 2024-04-23T18:26:48.478 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 768 k 2024-04-23T18:26:48.478 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:26:48.606 INFO:teuthology.orchestra.run.smithi062.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 185 kB/s | 151 kB 00:00 2024-04-23T18:26:48.632 INFO:teuthology.orchestra.run.smithi062.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 234 kB/s | 172 kB 00:00 2024-04-23T18:26:48.707 INFO:teuthology.orchestra.run.smithi062.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 143 kB/s | 11 kB 00:00 2024-04-23T18:26:48.757 INFO:teuthology.orchestra.run.smithi119.stdout:cephadm-19.0.0-3217.ge2b3a300.el7.noarch.rpm 2.7 MB/s | 762 kB 00:00 2024-04-23T18:26:48.757 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:26:48.758 INFO:teuthology.orchestra.run.smithi119.stdout:Total 2.7 MB/s | 762 kB 00:00 2024-04-23T18:26:48.758 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:26:48.763 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:26:48.763 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:26:48.765 INFO:teuthology.orchestra.run.smithi062.stdout:(22/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2024-04-23T18:26:48.769 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:26:48.769 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:26:48.790 INFO:teuthology.orchestra.run.smithi062.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 212 kB/s | 18 kB 00:00 2024-04-23T18:26:48.842 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:26:48.982 INFO:teuthology.orchestra.run.smithi062.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 107 kB/s | 23 kB 00:00 2024-04-23T18:26:49.007 INFO:teuthology.orchestra.run.smithi062.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 90 kB/s | 19 kB 00:00 2024-04-23T18:26:49.033 INFO:teuthology.orchestra.run.smithi062.stdout:(26/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 38 kB/s | 43 kB 00:01 2024-04-23T18:26:49.257 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 1/1 2024-04-23T18:26:49.267 INFO:teuthology.orchestra.run.smithi062.stdout:(27/36): python3-more-itertools-8.12.0-2.el9.no 338 kB/s | 79 kB 00:00 2024-04-23T18:26:49.343 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 1/1 2024-04-23T18:26:49.584 INFO:teuthology.orchestra.run.smithi062.stdout:(28/36): python3-pecan-1.4.2-3.el9.noarch.rpm 860 kB/s | 272 kB 00:00 2024-04-23T18:26:49.686 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 1/1 2024-04-23T18:26:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 1/1 2024-04-23T18:26:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:49.926 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:26:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:26:49.926 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:49.926 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:26:50.153 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-immutable-object-cache 2024-04-23T18:26:50.500 INFO:teuthology.orchestra.run.smithi062.stdout:(29/36): python3-jaraco-text-3.2.0-6.el9.noarch 13 kB/s | 20 kB 00:01 2024-04-23T18:26:50.525 INFO:teuthology.orchestra.run.smithi062.stdout:(30/36): python3-logutils-0.3.5-21.el9.noarch.r 30 kB/s | 46 kB 00:01 2024-04-23T18:26:50.663 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:12 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:26:50.785 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:26:50.786 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:50.786 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repo Size 2024-04-23T18:26:50.786 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:50.786 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:26:50.786 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 145 k 2024-04-23T18:26:50.786 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:50.786 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:26:50.786 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:50.786 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-04-23T18:26:50.786 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:50.786 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 145 k 2024-04-23T18:26:50.786 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 435 k 2024-04-23T18:26:50.786 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:26:51.089 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-immutable-object-cache-19.0.0-3217.ge2b3a3 479 kB/s | 145 kB 00:00 2024-04-23T18:26:51.090 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:26:51.090 INFO:teuthology.orchestra.run.smithi119.stdout:Total 476 kB/s | 145 kB 00:00 2024-04-23T18:26:51.090 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:26:51.097 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:26:51.097 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:26:51.154 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:26:51.155 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:26:51.301 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:26:51.390 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3217.ge2b3a300. 1/1 2024-04-23T18:26:51.414 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3217.ge2b3a300. 1/1 2024-04-23T18:26:51.414 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:26:51.414 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T18:26:51.414 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:51.526 INFO:teuthology.orchestra.run.smithi062.stdout:(31/36): python3-tempora-5.0.0-2.el9.noarch.rpm 36 kB/s | 36 kB 00:00 2024-04-23T18:26:51.551 INFO:teuthology.orchestra.run.smithi062.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 86 kB/s | 90 kB 00:01 2024-04-23T18:26:51.718 INFO:teuthology.orchestra.run.smithi062.stdout:(33/36): python3-portend-3.1.0-2.el9.noarch.rpm 7.7 kB/s | 16 kB 00:02 2024-04-23T18:26:52.118 INFO:teuthology.orchestra.run.smithi062.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 50 kB/s | 20 kB 00:00 2024-04-23T18:26:52.168 INFO:teuthology.orchestra.run.smithi062.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 692 kB/s | 427 kB 00:00 2024-04-23T18:26:52.202 INFO:teuthology.orchestra.run.smithi062.stdout:(36/36): python3-webob-1.8.7-6.el9.noarch.rpm 340 kB/s | 230 kB 00:00 2024-04-23T18:26:52.209 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:26:52.209 INFO:teuthology.orchestra.run.smithi062.stdout:Total 4.4 MB/s | 30 MB 00:06 2024-04-23T18:26:52.295 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3217.ge2b3a300. 1/1 2024-04-23T18:26:52.295 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:52.295 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:26:52.295 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:26:52.296 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:52.296 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:26:52.348 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:26:52.392 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:26:52.392 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:26:52.516 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr 2024-04-23T18:26:52.707 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:26:52.707 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:26:53.036 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:15 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:26:53.118 INFO:teuthology.orchestra.run.smithi119.stdout:Package ceph-mgr-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:26:53.159 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:26:53.160 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-04-23T18:26:53.160 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:26:53.235 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr-dashboard 2024-04-23T18:26:53.736 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:15 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:26:53.855 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:26:53.856 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:53.856 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-04-23T18:26:53.856 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:53.856 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:26:53.856 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 3.5 M 2024-04-23T18:26:53.856 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-04-23T18:26:53.856 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-23T18:26:53.856 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 34 k 2024-04-23T18:26:53.856 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 16 k 2024-04-23T18:26:53.856 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-23T18:26:53.857 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-23T18:26:53.857 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-23T18:26:53.857 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-23T18:26:53.857 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-23T18:26:53.857 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-23T18:26:53.857 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T18:26:53.857 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T18:26:53.857 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:53.857 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:26:53.857 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:26:53.857 INFO:teuthology.orchestra.run.smithi119.stdout:Install 12 Packages 2024-04-23T18:26:53.857 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:26:53.858 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 8.6 M 2024-04-23T18:26:53.858 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 104 M 2024-04-23T18:26:53.858 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:26:54.118 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:26:54.171 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-23T18:26:54.213 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-23T18:26:54.240 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-23T18:26:54.317 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-23T18:26:54.490 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-23T18:26:54.522 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-23T18:26:54.543 INFO:teuthology.orchestra.run.smithi119.stdout:(1/12): ceph-grafana-dashboards-19.0.0-3217.ge2 167 kB/s | 34 kB 00:00 2024-04-23T18:26:54.620 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-23T18:26:54.668 INFO:teuthology.orchestra.run.smithi119.stdout:(2/12): ceph-prometheus-alerts-19.0.0-3217.ge2b 50 kB/s | 16 kB 00:00 2024-04-23T18:26:54.705 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-23T18:26:54.751 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-23T18:26:54.760 INFO:teuthology.orchestra.run.smithi119.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-04-23T18:26:54.785 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-23T18:26:54.815 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-23T18:26:54.819 INFO:teuthology.orchestra.run.smithi119.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 14 MB/s | 863 kB 00:00 2024-04-23T18:26:54.844 INFO:teuthology.orchestra.run.smithi119.stdout:(5/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.5 MB/s | 269 kB 00:00 2024-04-23T18:26:54.849 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-23T18:26:54.882 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-23T18:26:54.923 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-23T18:26:54.967 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-23T18:26:55.000 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-23T18:26:55.019 INFO:teuthology.orchestra.run.smithi119.stdout:(6/12): ceph-mgr-dashboard-19.0.0-3217.ge2b3a30 5.2 MB/s | 3.5 MB 00:00 2024-04-23T18:26:55.030 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-23T18:26:55.103 INFO:teuthology.orchestra.run.smithi119.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-04-23T18:26:55.108 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-23T18:26:55.262 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-23T18:26:55.343 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-23T18:26:55.411 INFO:teuthology.orchestra.run.smithi119.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 925 kB/s | 548 kB 00:00 2024-04-23T18:26:55.519 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-23T18:26:55.537 INFO:teuthology.orchestra.run.smithi119.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 333 kB/s | 144 kB 00:00 2024-04-23T18:26:55.564 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-23T18:26:55.623 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-23T18:26:55.686 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-23T18:26:55.687 INFO:teuthology.orchestra.run.smithi119.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 112 kB/s | 31 kB 00:00 2024-04-23T18:26:55.812 INFO:teuthology.orchestra.run.smithi119.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.6 MB/s | 2.0 MB 00:00 2024-04-23T18:26:55.886 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-23T18:26:55.954 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-23T18:26:56.033 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-23T18:26:56.046 INFO:teuthology.orchestra.run.smithi119.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 371 kB/s | 188 kB 00:00 2024-04-23T18:26:56.048 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:26:56.048 INFO:teuthology.orchestra.run.smithi119.stdout:Total 3.9 MB/s | 8.6 MB 00:02 2024-04-23T18:26:56.098 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:26:56.114 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:26:56.114 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:26:56.139 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-23T18:26:56.268 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:26:56.269 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:26:56.317 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-23T18:26:56.441 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-23T18:26:56.613 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3217.ge2b3a300.el7. 31/36 2024-04-23T18:26:56.642 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:19.0.0-3217.ge2b3a300.el7.x86_64 32/36 2024-04-23T18:26:56.669 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3217.ge2b3a300.el7.x86_64 32/36 2024-04-23T18:26:56.669 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:26:56.669 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T18:26:56.669 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T18:26:56.669 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T18:26:56.669 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:56.785 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:26:56.854 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-23T18:26:56.890 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-23T18:26:56.936 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-23T18:26:56.967 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-23T18:26:57.043 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-23T18:26:57.194 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-23T18:26:57.287 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-23T18:26:57.331 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-23T18:26:57.359 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-23T18:26:57.391 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3217.ge2b3a300.el7 10/12 2024-04-23T18:26:58.193 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:19.0.0-3217.ge2b3a300.el7.x86_64 33/36 2024-04-23T18:26:58.221 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:19.0.0-3217.ge2b3a300.el7.x86_64 33/36 2024-04-23T18:26:58.221 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:26:58.221 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T18:26:58.221 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T18:26:58.221 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T18:26:58.221 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:58.437 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3217.ge2b3a300.el 11/12 2024-04-23T18:26:58.475 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3217.ge2b3a300.el7.noa 12/12 2024-04-23T18:26:58.694 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:19.0.0-3217.ge2b3a300.el7.x86_64 34/36 2024-04-23T18:26:58.719 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:19.0.0-3217.ge2b3a300.el7.x86_64 34/36 2024-04-23T18:26:58.719 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:26:58.719 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T18:26:58.719 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T18:26:58.719 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T18:26:58.719 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:58.953 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:19.0.0-3217.ge2b3a300.el7.x86_64 35/36 2024-04-23T18:26:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:19.0.0-3217.ge2b3a300.el7.x86_64 35/36 2024-04-23T18:26:58.977 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:26:58.977 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T18:26:58.977 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T18:26:58.977 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T18:26:58.977 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:26:59.043 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:19.0.0-3217.ge2b3a300.el7.x86_64 36/36 2024-04-23T18:26:59.827 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3217.ge2b3a300.el7.noa 12/12 2024-04-23T18:26:59.827 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3217.ge2b3a300.el 1/12 2024-04-23T18:26:59.827 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3217.ge2b3a300.el7.noa 2/12 2024-04-23T18:26:59.827 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3217.ge2b3a300.el7 3/12 2024-04-23T18:26:59.827 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-23T18:26:59.828 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-23T18:26:59.828 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-23T18:26:59.828 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-23T18:26:59.828 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-23T18:26:59.828 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-23T18:26:59.828 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-23T18:26:59.828 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-23T18:27:00.117 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-23T18:27:00.118 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:00.118 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:27:00.118 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-23T18:27:00.118 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:27:00.118 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:27:00.118 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:27:00.118 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-23T18:27:00.118 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-23T18:27:00.118 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-23T18:27:00.118 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-23T18:27:00.118 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-23T18:27:00.119 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-23T18:27:00.119 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T18:27:00.119 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T18:27:00.119 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:00.119 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:27:00.357 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-23T18:27:00.775 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-2:19.0.0-3217.ge2b3a300.el7.x86_64 36/36 2024-04-23T18:27:00.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/36 2024-04-23T18:27:00.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:19.0.0-3217.ge2b3a300.el7.x86_64 2/36 2024-04-23T18:27:00.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:19.0.0-3217.ge2b3a300.el7.x86_64 3/36 2024-04-23T18:27:00.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:19.0.0-3217.ge2b3a300.el7.x86_64 4/36 2024-04-23T18:27:00.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:19.0.0-3217.ge2b3a300.el7.x86_64 5/36 2024-04-23T18:27:00.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3217.ge2b3a300.el7. 6/36 2024-04-23T18:27:00.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-23T18:27:00.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-23T18:27:00.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-23T18:27:00.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-23T18:27:00.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-23T18:27:00.778 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-23T18:27:00.778 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-23T18:27:00.778 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-23T18:27:00.778 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-23T18:27:00.778 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-23T18:27:00.778 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-23T18:27:00.778 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-23T18:27:00.778 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-23T18:27:00.778 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-23T18:27:00.778 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-23T18:27:00.863 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:01:22 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:27:00.984 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:27:00.985 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-04-23T18:27:00.985 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-04-23T18:27:00.985 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-04-23T18:27:00.985 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:27:00.985 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 7.4 M 2024-04-23T18:27:00.985 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-04-23T18:27:00.985 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T18:27:00.985 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T18:27:00.985 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T18:27:00.986 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T18:27:00.986 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T18:27:00.986 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T18:27:00.986 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T18:27:00.986 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T18:27:00.986 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T18:27:00.986 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T18:27:00.986 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T18:27:00.986 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:00.986 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:27:00.986 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-04-23T18:27:00.986 INFO:teuthology.orchestra.run.smithi119.stdout:Install 12 Packages 2024-04-23T18:27:00.986 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:00.987 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 38 M 2024-04-23T18:27:00.989 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 209 M 2024-04-23T18:27:00.989 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:27:01.486 INFO:teuthology.orchestra.run.smithi119.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-04-23T18:27:01.538 INFO:teuthology.orchestra.run.smithi119.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 803 kB 00:00 2024-04-23T18:27:01.663 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-23T18:27:01.663 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:01.663 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:27:01.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:27:01.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:27:01.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:27:01.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:27:01.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:27:01.664 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:27:01.664 INFO:teuthology.orchestra.run.smithi062.stdout: lua-5.4.4-4.el9.x86_64 2024-04-23T18:27:01.664 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-23T18:27:01.664 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-23T18:27:01.664 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T18:27:01.664 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T18:27:01.664 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T18:27:01.664 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T18:27:01.665 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T18:27:01.666 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T18:27:01.666 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T18:27:01.666 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T18:27:01.666 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T18:27:01.666 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T18:27:01.666 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T18:27:01.666 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T18:27:01.666 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T18:27:01.666 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T18:27:01.666 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:01.666 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:27:01.999 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-base 2024-04-23T18:27:02.071 INFO:teuthology.orchestra.run.smithi119.stdout:(3/12): ceph-mgr-diskprediction-local-19.0.0-32 10 MB/s | 7.4 MB 00:00 2024-04-23T18:27:02.096 INFO:teuthology.orchestra.run.smithi119.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 54 kB/s | 33 kB 00:00 2024-04-23T18:27:02.538 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:10 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:27:02.597 INFO:teuthology.orchestra.run.smithi119.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 35 kB/s | 18 kB 00:00 2024-04-23T18:27:02.620 INFO:teuthology.orchestra.run.smithi062.stdout:Package ceph-base-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:27:02.663 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:27:02.664 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-23T18:27:02.665 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:27:02.697 INFO:teuthology.orchestra.run.smithi119.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 59 kB/s | 35 kB 00:00 2024-04-23T18:27:02.737 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install cephadm 2024-04-23T18:27:03.287 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:11 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:27:03.412 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:27:03.413 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:03.413 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-23T18:27:03.413 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:03.413 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:27:03.413 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 762 k 2024-04-23T18:27:03.413 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:03.413 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:27:03.413 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:03.414 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-23T18:27:03.414 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:03.414 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 762 k 2024-04-23T18:27:03.414 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 768 k 2024-04-23T18:27:03.414 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:27:03.580 INFO:teuthology.orchestra.run.smithi119.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 276 kB/s | 244 kB 00:00 2024-04-23T18:27:03.818 INFO:teuthology.orchestra.run.smithi062.stdout:cephadm-19.0.0-3217.ge2b3a300.el7.noarch.rpm 1.8 MB/s | 762 kB 00:00 2024-04-23T18:27:03.819 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:27:03.819 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.8 MB/s | 762 kB 00:00 2024-04-23T18:27:03.819 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:27:03.824 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:27:03.825 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:27:03.831 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:27:03.831 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:27:03.903 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:27:04.378 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 1/1 2024-04-23T18:27:04.456 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 1/1 2024-04-23T18:27:04.768 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 1/1 2024-04-23T18:27:04.998 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 1/1 2024-04-23T18:27:04.998 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:04.998 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:27:04.998 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:27:04.998 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:04.998 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:27:05.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-immutable-object-cache 2024-04-23T18:27:05.736 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:13 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:27:05.860 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:27:05.861 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:05.861 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-04-23T18:27:05.861 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:05.861 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:27:05.861 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 145 k 2024-04-23T18:27:05.861 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:05.861 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:27:05.861 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:05.861 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-23T18:27:05.861 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:05.861 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 145 k 2024-04-23T18:27:05.862 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 435 k 2024-04-23T18:27:05.862 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:27:05.922 INFO:teuthology.orchestra.run.smithi119.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 698 kB/s | 3.0 MB 00:04 2024-04-23T18:27:06.207 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-immutable-object-cache-19.0.0-3217.ge2b3a3 419 kB/s | 145 kB 00:00 2024-04-23T18:27:06.207 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:27:06.208 INFO:teuthology.orchestra.run.smithi062.stdout:Total 417 kB/s | 145 kB 00:00 2024-04-23T18:27:06.208 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:27:06.216 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:27:06.216 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:27:06.277 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:27:06.277 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:27:06.435 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:27:06.516 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3217.ge2b3a300. 1/1 2024-04-23T18:27:06.541 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3217.ge2b3a300. 1/1 2024-04-23T18:27:06.541 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:27:06.542 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T18:27:06.542 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:06.814 INFO:teuthology.orchestra.run.smithi119.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 281 kB/s | 250 kB 00:00 2024-04-23T18:27:07.397 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3217.ge2b3a300. 1/1 2024-04-23T18:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:07.398 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:27:07.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr 2024-04-23T18:27:08.164 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:16 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:27:08.247 INFO:teuthology.orchestra.run.smithi062.stdout:Package ceph-mgr-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:27:08.290 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:27:08.291 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-23T18:27:08.291 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:27:08.360 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-dashboard 2024-04-23T18:27:08.890 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:16 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:27:09.015 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:27:09.016 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:09.017 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-23T18:27:09.017 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:09.017 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:27:09.017 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 3.5 M 2024-04-23T18:27:09.017 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-23T18:27:09.017 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-23T18:27:09.017 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 34 k 2024-04-23T18:27:09.017 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 16 k 2024-04-23T18:27:09.017 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-23T18:27:09.017 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-23T18:27:09.017 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-23T18:27:09.017 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-23T18:27:09.018 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-23T18:27:09.018 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-23T18:27:09.018 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T18:27:09.018 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T18:27:09.018 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:09.018 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:27:09.018 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:09.018 INFO:teuthology.orchestra.run.smithi062.stdout:Install 12 Packages 2024-04-23T18:27:09.018 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:09.019 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 8.6 M 2024-04-23T18:27:09.019 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 104 M 2024-04-23T18:27:09.019 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:27:09.047 INFO:teuthology.orchestra.run.smithi119.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 752 kB/s | 4.7 MB 00:06 2024-04-23T18:27:09.694 INFO:teuthology.orchestra.run.smithi062.stdout:(1/12): ceph-grafana-dashboards-19.0.0-3217.ge2 134 kB/s | 34 kB 00:00 2024-04-23T18:27:09.718 INFO:teuthology.orchestra.run.smithi062.stdout:(2/12): ceph-prometheus-alerts-19.0.0-3217.ge2b 59 kB/s | 16 kB 00:00 2024-04-23T18:27:10.036 INFO:teuthology.orchestra.run.smithi062.stdout:(3/12): ceph-mgr-dashboard-19.0.0-3217.ge2b3a30 5.9 MB/s | 3.5 MB 00:00 2024-04-23T18:27:10.227 INFO:teuthology.orchestra.run.smithi062.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 529 kB/s | 269 kB 00:00 2024-04-23T18:27:10.252 INFO:teuthology.orchestra.run.smithi062.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.9 MB/s | 863 kB 00:00 2024-04-23T18:27:10.453 INFO:teuthology.orchestra.run.smithi062.stdout:(6/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.3 MB/s | 1.0 MB 00:00 2024-04-23T18:27:10.464 INFO:teuthology.orchestra.run.smithi119.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 758 kB/s | 5.1 MB 00:06 2024-04-23T18:27:11.262 INFO:teuthology.orchestra.run.smithi062.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 530 kB/s | 548 kB 00:01 2024-04-23T18:27:12.303 INFO:teuthology.orchestra.run.smithi062.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 139 kB/s | 144 kB 00:01 2024-04-23T18:27:12.362 INFO:teuthology.orchestra.run.smithi062.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 529 kB/s | 31 kB 00:00 2024-04-23T18:27:12.395 INFO:teuthology.orchestra.run.smithi062.stdout:(10/12): grpc-data-1.46.7-10.el9.noarch.rpm 9.1 kB/s | 19 kB 00:02 2024-04-23T18:27:12.496 INFO:teuthology.orchestra.run.smithi062.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 1.0 MB/s | 2.0 MB 00:02 2024-04-23T18:27:12.529 INFO:teuthology.orchestra.run.smithi062.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.1 MB/s | 188 kB 00:00 2024-04-23T18:27:12.531 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:27:12.531 INFO:teuthology.orchestra.run.smithi062.stdout:Total 2.5 MB/s | 8.6 MB 00:03 2024-04-23T18:27:12.583 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:27:12.604 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:27:12.604 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:27:12.768 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:27:12.769 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:27:13.331 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:27:13.406 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-23T18:27:13.440 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-23T18:27:13.489 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-23T18:27:13.517 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-23T18:27:13.606 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-23T18:27:13.741 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-23T18:27:13.833 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-23T18:27:13.881 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-23T18:27:13.908 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-23T18:27:13.941 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3217.ge2b3a300.el7 10/12 2024-04-23T18:27:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3217.ge2b3a300.el 11/12 2024-04-23T18:27:15.074 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3217.ge2b3a300.el7.noa 12/12 2024-04-23T18:27:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3217.ge2b3a300.el7.noa 12/12 2024-04-23T18:27:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3217.ge2b3a300.el 1/12 2024-04-23T18:27:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3217.ge2b3a300.el7.noa 2/12 2024-04-23T18:27:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3217.ge2b3a300.el7 3/12 2024-04-23T18:27:16.343 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-23T18:27:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-23T18:27:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-23T18:27:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-23T18:27:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-23T18:27:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-23T18:27:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-23T18:27:16.344 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-23T18:27:16.629 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-23T18:27:16.629 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:16.629 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:27:16.629 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-23T18:27:16.629 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:27:16.629 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:27:16.629 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:27:16.629 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-23T18:27:16.629 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-23T18:27:16.630 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-23T18:27:16.630 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-23T18:27:16.630 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-23T18:27:16.630 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-23T18:27:16.630 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T18:27:16.630 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T18:27:16.630 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:16.630 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:27:16.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-23T18:27:17.407 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:25 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:27:17.536 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:27:17.537 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-04-23T18:27:17.537 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-23T18:27:17.537 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-04-23T18:27:17.538 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:27:17.538 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 7.4 M 2024-04-23T18:27:17.538 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-23T18:27:17.538 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T18:27:17.538 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T18:27:17.538 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T18:27:17.538 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T18:27:17.538 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T18:27:17.538 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T18:27:17.538 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T18:27:17.538 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T18:27:17.538 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T18:27:17.539 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T18:27:17.539 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T18:27:17.539 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:17.539 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:27:17.539 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-04-23T18:27:17.539 INFO:teuthology.orchestra.run.smithi062.stdout:Install 12 Packages 2024-04-23T18:27:17.539 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:17.540 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 38 M 2024-04-23T18:27:17.540 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 209 M 2024-04-23T18:27:17.540 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:27:18.746 INFO:teuthology.orchestra.run.smithi062.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 265 kB/s | 195 kB 00:00 2024-04-23T18:27:18.938 INFO:teuthology.orchestra.run.smithi062.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 171 kB/s | 33 kB 00:00 2024-04-23T18:27:19.180 INFO:teuthology.orchestra.run.smithi062.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 686 kB/s | 803 kB 00:01 2024-04-23T18:27:19.389 INFO:teuthology.orchestra.run.smithi062.stdout:(4/12): ceph-mgr-diskprediction-local-19.0.0-32 5.4 MB/s | 7.4 MB 00:01 2024-04-23T18:27:19.413 INFO:teuthology.orchestra.run.smithi062.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 78 kB/s | 18 kB 00:00 2024-04-23T18:27:19.464 INFO:teuthology.orchestra.run.smithi062.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.7 MB/s | 3.0 MB 00:00 2024-04-23T18:27:19.497 INFO:teuthology.orchestra.run.smithi062.stdout:(7/12): openblas-0.3.21-2.el9.x86_64.rpm 325 kB/s | 35 kB 00:00 2024-04-23T18:27:19.531 INFO:teuthology.orchestra.run.smithi062.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-04-23T18:27:19.581 INFO:teuthology.orchestra.run.smithi062.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.9 MB/s | 250 kB 00:00 2024-04-23T18:27:20.123 INFO:teuthology.orchestra.run.smithi062.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.2 MB/s | 5.1 MB 00:00 2024-04-23T18:27:20.274 INFO:teuthology.orchestra.run.smithi062.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-04-23T18:27:20.726 INFO:teuthology.orchestra.run.smithi062.stdout:(12/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 3.6 MB/s | 4.7 MB 00:01 2024-04-23T18:27:20.727 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:27:20.727 INFO:teuthology.orchestra.run.smithi062.stdout:Total 12 MB/s | 38 MB 00:03 2024-04-23T18:27:21.089 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:27:21.116 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:27:21.116 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:27:21.550 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:27:21.551 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:27:22.427 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:27:22.495 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-23T18:27:22.547 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-23T18:27:22.653 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-23T18:27:22.698 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-23T18:27:22.875 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-23T18:27:22.897 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-23T18:27:22.976 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-23T18:27:23.670 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-23T18:27:23.798 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-23T18:27:25.118 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T18:27:26.218 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-23T18:27:26.246 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3217.ge2b3a 12/12 2024-04-23T18:27:28.735 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3217.ge2b3a 12/12 2024-04-23T18:27:28.735 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3217.ge2b3a 1/12 2024-04-23T18:27:28.735 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-23T18:27:28.735 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-23T18:27:28.735 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-23T18:27:28.735 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-23T18:27:28.736 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-23T18:27:28.736 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-23T18:27:28.736 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-23T18:27:28.736 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-23T18:27:28.736 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T18:27:28.736 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-23T18:27:29.171 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-23T18:27:29.172 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:29.172 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:27:29.172 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:27:29.172 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T18:27:29.172 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T18:27:29.172 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T18:27:29.172 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T18:27:29.172 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T18:27:29.172 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T18:27:29.172 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T18:27:29.172 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T18:27:29.173 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T18:27:29.173 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T18:27:29.173 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T18:27:29.173 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:29.173 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:27:29.445 INFO:teuthology.orchestra.run.smithi119.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 735 kB/s | 16 MB 00:22 2024-04-23T18:27:29.446 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:27:29.446 INFO:teuthology.orchestra.run.smithi119.stdout:Total 1.3 MB/s | 38 MB 00:28 2024-04-23T18:27:29.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-rook 2024-04-23T18:27:29.795 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:27:29.821 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:27:29.822 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:27:30.079 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:38 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:27:30.203 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:27:30.205 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:30.205 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-23T18:27:30.205 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:30.205 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:27:30.205 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 49 k 2024-04-23T18:27:30.205 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-23T18:27:30.205 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T18:27:30.205 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T18:27:30.205 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-23T18:27:30.205 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T18:27:30.205 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T18:27:30.205 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T18:27:30.206 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T18:27:30.206 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T18:27:30.206 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T18:27:30.206 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T18:27:30.206 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T18:27:30.206 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T18:27:30.206 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:30.206 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:27:30.206 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:30.206 INFO:teuthology.orchestra.run.smithi062.stdout:Install 13 Packages 2024-04-23T18:27:30.206 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:30.207 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 2.2 M 2024-04-23T18:27:30.207 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 26 M 2024-04-23T18:27:30.207 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:27:30.225 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:27:30.226 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:27:30.612 INFO:teuthology.orchestra.run.smithi062.stdout:(1/13): ceph-mgr-rook-19.0.0-3217.ge2b3a300.el7 265 kB/s | 49 kB 00:00 2024-04-23T18:27:30.687 INFO:teuthology.orchestra.run.smithi062.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 98 kB/s | 26 kB 00:00 2024-04-23T18:27:30.713 INFO:teuthology.orchestra.run.smithi062.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 67 kB/s | 19 kB 00:00 2024-04-23T18:27:31.077 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:27:31.133 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-23T18:27:31.184 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-23T18:27:31.204 INFO:teuthology.orchestra.run.smithi062.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 375 kB/s | 222 kB 00:00 2024-04-23T18:27:31.296 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-23T18:27:31.329 INFO:teuthology.orchestra.run.smithi062.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 247 kB/s | 159 kB 00:00 2024-04-23T18:27:31.336 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-23T18:27:31.512 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-23T18:27:31.543 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-23T18:27:31.555 INFO:teuthology.orchestra.run.smithi062.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 153 kB/s | 54 kB 00:00 2024-04-23T18:27:31.619 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-23T18:27:31.622 INFO:teuthology.orchestra.run.smithi062.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 307 kB/s | 279 kB 00:00 2024-04-23T18:27:31.722 INFO:teuthology.orchestra.run.smithi062.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 90 kB/s | 15 kB 00:00 2024-04-23T18:27:31.747 INFO:teuthology.orchestra.run.smithi062.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 77 kB/s | 32 kB 00:00 2024-04-23T18:27:31.814 INFO:teuthology.orchestra.run.smithi062.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 1.0 MB/s | 206 kB 00:00 2024-04-23T18:27:32.273 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-23T18:27:32.390 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-23T18:27:32.640 INFO:teuthology.orchestra.run.smithi062.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 1.1 MB/s | 1.0 MB 00:00 2024-04-23T18:27:32.815 INFO:teuthology.orchestra.run.smithi062.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 90 kB/s | 90 kB 00:01 2024-04-23T18:27:33.605 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T18:27:34.651 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-23T18:27:34.685 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3217.ge2b3a 12/12 2024-04-23T18:27:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:(13/13): python3-rsa-4.9-2.el9.noarch.rpm 20 kB/s | 59 kB 00:03 2024-04-23T18:27:34.774 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:27:34.774 INFO:teuthology.orchestra.run.smithi062.stdout:Total 493 kB/s | 2.2 MB 00:04 2024-04-23T18:27:34.845 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:27:34.862 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:27:34.862 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:27:34.960 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:27:34.961 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:27:35.478 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:27:35.662 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-23T18:27:35.726 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-23T18:27:35.790 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-23T18:27:35.826 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-23T18:27:35.867 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-23T18:27:35.974 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-23T18:27:36.086 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-23T18:27:36.170 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-23T18:27:36.937 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-23T18:27:36.982 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-23T18:27:37.016 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-23T18:27:37.065 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-23T18:27:37.093 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:19.0.0-3217.ge2b3a300.el7.noarch 13/13 2024-04-23T18:27:37.202 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3217.ge2b3a 12/12 2024-04-23T18:27:37.203 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3217.ge2b3a 1/12 2024-04-23T18:27:37.203 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-23T18:27:37.203 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-23T18:27:37.203 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-23T18:27:37.203 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-23T18:27:37.203 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-23T18:27:37.203 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-23T18:27:37.204 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-23T18:27:37.204 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-23T18:27:37.204 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T18:27:37.204 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-23T18:27:37.586 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-23T18:27:37.586 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T18:27:37.587 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:37.588 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:27:37.820 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3217.ge2b3a300.el7.noarch 13/13 2024-04-23T18:27:37.820 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3217.ge2b3a300.el7.noarch 1/13 2024-04-23T18:27:37.820 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-23T18:27:37.820 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-23T18:27:37.821 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-23T18:27:37.821 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-23T18:27:37.821 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-23T18:27:37.821 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-23T18:27:37.821 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-23T18:27:37.821 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-23T18:27:37.821 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-23T18:27:37.821 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-23T18:27:37.821 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-23T18:27:37.937 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr-rook 2024-04-23T18:27:38.134 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-23T18:27:38.134 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:38.134 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:27:38.134 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:27:38.134 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T18:27:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T18:27:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-23T18:27:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T18:27:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T18:27:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T18:27:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T18:27:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T18:27:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T18:27:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T18:27:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T18:27:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T18:27:38.135 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:38.135 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:27:38.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-mgr-cephadm 2024-04-23T18:27:38.451 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:00 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:27:38.570 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:27:38.572 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:27:38.572 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-04-23T18:27:38.572 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:27:38.572 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:27:38.572 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 49 k 2024-04-23T18:27:38.572 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-04-23T18:27:38.572 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T18:27:38.572 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T18:27:38.572 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout:Install 13 Packages 2024-04-23T18:27:38.573 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:38.574 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 2.2 M 2024-04-23T18:27:38.574 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 26 M 2024-04-23T18:27:38.574 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:27:38.894 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:01:46 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:27:39.018 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:27:39.019 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:39.019 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-23T18:27:39.019 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:39.019 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:27:39.019 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 142 k 2024-04-23T18:27:39.019 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-23T18:27:39.019 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T18:27:39.020 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T18:27:39.020 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T18:27:39.020 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T18:27:39.020 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T18:27:39.020 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:39.020 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:27:39.020 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:27:39.020 INFO:teuthology.orchestra.run.smithi062.stdout:Install 6 Packages 2024-04-23T18:27:39.020 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:27:39.021 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 7.0 M 2024-04-23T18:27:39.021 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 33 M 2024-04-23T18:27:39.021 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:27:39.247 INFO:teuthology.orchestra.run.smithi119.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 152 kB/s | 26 kB 00:00 2024-04-23T18:27:39.272 INFO:teuthology.orchestra.run.smithi119.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 99 kB/s | 19 kB 00:00 2024-04-23T18:27:39.439 INFO:teuthology.orchestra.run.smithi119.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 959 kB/s | 159 kB 00:00 2024-04-23T18:27:39.441 INFO:teuthology.orchestra.run.smithi062.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.6 MB/s | 248 kB 00:00 2024-04-23T18:27:39.481 INFO:teuthology.orchestra.run.smithi119.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.0 MB/s | 222 kB 00:00 2024-04-23T18:27:39.507 INFO:teuthology.orchestra.run.smithi062.stdout:(2/6): ceph-mgr-cephadm-19.0.0-3217.ge2b3a300.e 650 kB/s | 142 kB 00:00 2024-04-23T18:27:39.531 INFO:teuthology.orchestra.run.smithi119.stdout:(5/13): ceph-mgr-rook-19.0.0-3217.ge2b3a300.el7 109 kB/s | 49 kB 00:00 2024-04-23T18:27:39.556 INFO:teuthology.orchestra.run.smithi119.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 712 kB/s | 54 kB 00:00 2024-04-23T18:27:39.633 INFO:teuthology.orchestra.run.smithi062.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-04-23T18:27:39.648 INFO:teuthology.orchestra.run.smithi119.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.3 MB/s | 279 kB 00:00 2024-04-23T18:27:39.749 INFO:teuthology.orchestra.run.smithi119.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 78 kB/s | 15 kB 00:00 2024-04-23T18:27:39.774 INFO:teuthology.orchestra.run.smithi119.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 133 kB/s | 32 kB 00:00 2024-04-23T18:27:40.783 INFO:teuthology.orchestra.run.smithi119.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 59 kB/s | 59 kB 00:01 2024-04-23T18:27:41.375 INFO:teuthology.orchestra.run.smithi119.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 119 kB/s | 206 kB 00:01 2024-04-23T18:27:42.066 INFO:teuthology.orchestra.run.smithi119.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 70 kB/s | 90 kB 00:01 2024-04-23T18:27:42.133 INFO:teuthology.orchestra.run.smithi119.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 438 kB/s | 1.0 MB 00:02 2024-04-23T18:27:42.134 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:27:42.134 INFO:teuthology.orchestra.run.smithi119.stdout:Total 633 kB/s | 2.2 MB 00:03 2024-04-23T18:27:42.203 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:27:42.219 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:27:42.219 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:27:42.304 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:27:42.306 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:27:42.834 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:27:42.988 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-23T18:27:43.051 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-23T18:27:43.114 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-23T18:27:43.152 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-23T18:27:43.194 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-23T18:27:43.287 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-23T18:27:43.389 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-23T18:27:43.437 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-23T18:27:44.155 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-23T18:27:44.209 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-23T18:27:44.243 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-23T18:27:44.291 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-23T18:27:44.314 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:19.0.0-3217.ge2b3a300.el7.noarch 13/13 2024-04-23T18:27:45.106 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3217.ge2b3a300.el7.noarch 13/13 2024-04-23T18:27:45.106 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3217.ge2b3a300.el7.noarch 1/13 2024-04-23T18:27:45.106 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-23T18:27:45.106 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-23T18:27:45.107 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-23T18:27:45.107 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-23T18:27:45.107 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-23T18:27:45.107 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-23T18:27:45.107 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-23T18:27:45.107 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-23T18:27:45.107 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-23T18:27:45.107 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-23T18:27:45.107 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-23T18:27:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-23T18:27:45.419 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:45.420 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:27:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:27:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T18:27:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T18:27:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-23T18:27:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T18:27:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T18:27:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T18:27:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T18:27:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T18:27:45.420 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T18:27:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T18:27:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T18:27:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T18:27:45.421 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:45.421 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:27:45.664 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-mgr-cephadm 2024-04-23T18:27:46.206 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:08 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:27:46.326 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:27:46.327 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:27:46.327 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-04-23T18:27:46.327 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:27:46.327 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:27:46.327 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 142 k 2024-04-23T18:27:46.327 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-04-23T18:27:46.327 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T18:27:46.327 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T18:27:46.327 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T18:27:46.327 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T18:27:46.328 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T18:27:46.328 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:46.328 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:27:46.328 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:27:46.328 INFO:teuthology.orchestra.run.smithi119.stdout:Install 6 Packages 2024-04-23T18:27:46.328 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:46.328 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 7.0 M 2024-04-23T18:27:46.328 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 33 M 2024-04-23T18:27:46.329 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:27:46.736 INFO:teuthology.orchestra.run.smithi119.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-04-23T18:27:46.903 INFO:teuthology.orchestra.run.smithi119.stdout:(2/6): ceph-mgr-cephadm-19.0.0-3217.ge2b3a300.e 411 kB/s | 142 kB 00:00 2024-04-23T18:27:47.779 INFO:teuthology.orchestra.run.smithi119.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-04-23T18:27:50.687 INFO:teuthology.orchestra.run.smithi119.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 15 kB/s | 58 kB 00:03 2024-04-23T18:27:55.231 INFO:teuthology.orchestra.run.smithi062.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 3.3 kB/s | 51 kB 00:15 2024-04-23T18:27:55.403 INFO:teuthology.orchestra.run.smithi119.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 63 kB/s | 548 kB 00:08 2024-04-23T18:27:55.444 INFO:teuthology.orchestra.run.smithi119.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 6.6 kB/s | 51 kB 00:07 2024-04-23T18:27:55.446 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:27:55.446 INFO:teuthology.orchestra.run.smithi119.stdout:Total 784 kB/s | 7.0 MB 00:09 2024-04-23T18:27:55.518 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:27:55.530 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:27:55.530 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:27:55.625 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:27:55.625 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:27:55.926 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:27:56.100 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-23T18:27:56.146 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-23T18:27:56.664 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-23T18:27:56.757 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-23T18:27:56.820 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-23T18:27:56.850 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 6/6 2024-04-23T18:27:57.649 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 6/6 2024-04-23T18:27:57.649 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 1/6 2024-04-23T18:27:57.649 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-23T18:27:57.649 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-23T18:27:57.649 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-23T18:27:57.649 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-23T18:27:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-23T18:27:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:57.884 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:27:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:27:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T18:27:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T18:27:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T18:27:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T18:27:57.884 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T18:27:57.885 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:57.885 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:27:58.100 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-fuse 2024-04-23T18:27:58.609 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:20 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:27:58.728 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:27:58.729 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:27:58.729 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-04-23T18:27:58.729 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:27:58.729 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:27:58.729 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 890 k 2024-04-23T18:27:58.729 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-04-23T18:27:58.730 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T18:27:58.730 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:58.730 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:27:58.730 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:27:58.730 INFO:teuthology.orchestra.run.smithi119.stdout:Install 2 Packages 2024-04-23T18:27:58.730 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:27:58.730 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 971 k 2024-04-23T18:27:58.730 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 2.8 M 2024-04-23T18:27:58.730 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:27:59.322 INFO:teuthology.orchestra.run.smithi119.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 180 kB/s | 80 kB 00:00 2024-04-23T18:27:59.355 INFO:teuthology.orchestra.run.smithi119.stdout:(2/2): ceph-fuse-19.0.0-3217.ge2b3a300.el7.x86_ 1.8 MB/s | 890 kB 00:00 2024-04-23T18:27:59.356 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:27:59.356 INFO:teuthology.orchestra.run.smithi119.stdout:Total 1.5 MB/s | 971 kB 00:00 2024-04-23T18:27:59.368 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:27:59.390 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:27:59.390 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:27:59.469 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:27:59.470 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:27:59.523 INFO:teuthology.orchestra.run.smithi062.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.9 kB/s | 58 kB 00:19 2024-04-23T18:27:59.655 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:27:59.790 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-23T18:27:59.854 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 2/2 2024-04-23T18:28:00.429 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 2/2 2024-04-23T18:28:00.429 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/2 2024-04-23T18:28:00.514 INFO:teuthology.orchestra.run.smithi062.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 26 kB/s | 548 kB 00:21 2024-04-23T18:28:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:00.518 INFO:teuthology.orchestra.run.smithi062.stdout:Total 333 kB/s | 7.0 MB 00:21 2024-04-23T18:28:00.592 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:28:00.606 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:28:00.606 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:28:00.665 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-23T18:28:00.665 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:00.665 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:28:00.665 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-23T18:28:00.665 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:00.666 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:28:00.710 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:28:00.941 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-volume 2024-04-23T18:28:01.024 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:28:01.208 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-23T18:28:01.267 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-23T18:28:01.462 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:23 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:28:01.583 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:28:01.583 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:01.583 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-04-23T18:28:01.583 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:01.584 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:28:01.584 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 273 k 2024-04-23T18:28:01.584 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-04-23T18:28:01.584 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-23T18:28:01.584 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:01.584 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:28:01.584 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:01.584 INFO:teuthology.orchestra.run.smithi119.stdout:Install 2 Packages 2024-04-23T18:28:01.584 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:01.585 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 350 k 2024-04-23T18:28:01.585 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 1.5 M 2024-04-23T18:28:01.585 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:28:01.839 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-23T18:28:01.927 INFO:teuthology.orchestra.run.smithi119.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 379 kB/s | 77 kB 00:00 2024-04-23T18:28:01.930 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-23T18:28:01.960 INFO:teuthology.orchestra.run.smithi119.stdout:(2/2): ceph-volume-19.0.0-3217.ge2b3a300.el7.no 1.1 MB/s | 273 kB 00:00 2024-04-23T18:28:01.961 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:01.961 INFO:teuthology.orchestra.run.smithi119.stdout:Total 929 kB/s | 350 kB 00:00 2024-04-23T18:28:01.972 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:28:01.982 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:28:01.982 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:28:02.001 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-23T18:28:02.007 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:28:02.008 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:28:02.028 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 6/6 2024-04-23T18:28:02.148 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:28:02.333 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-23T18:28:02.363 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-volume-2:19.0.0-3217.ge2b3a300.el7.noarch 2/2 2024-04-23T18:28:02.378 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-volume-2:19.0.0-3217.ge2b3a300.el7.noarch 2/2 2024-04-23T18:28:02.378 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:28:02.378 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-23T18:28:02.378 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:02.848 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 6/6 2024-04-23T18:28:02.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 1/6 2024-04-23T18:28:02.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-23T18:28:02.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-23T18:28:02.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-23T18:28:02.849 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-23T18:28:03.070 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-volume-2:19.0.0-3217.ge2b3a300.el7.noarch 1/2 2024-04-23T18:28:03.098 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-23T18:28:03.098 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:03.098 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:28:03.098 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:28:03.098 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T18:28:03.098 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T18:28:03.098 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T18:28:03.098 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T18:28:03.098 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T18:28:03.098 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:03.099 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:03.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-fuse 2024-04-23T18:28:03.336 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-23T18:28:03.336 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:03.336 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:28:03.336 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:28:03.336 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-23T18:28:03.336 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:03.336 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:03.651 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install librados-devel 2024-04-23T18:28:03.857 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:11 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:03.981 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:03.982 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:03.982 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-23T18:28:03.982 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:03.982 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:28:03.982 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 890 k 2024-04-23T18:28:03.983 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-23T18:28:03.983 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T18:28:03.983 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:03.983 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:28:03.983 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:03.983 INFO:teuthology.orchestra.run.smithi062.stdout:Install 2 Packages 2024-04-23T18:28:03.983 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:03.983 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 971 k 2024-04-23T18:28:03.983 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 2.8 M 2024-04-23T18:28:03.983 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:28:04.170 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:26 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:28:04.293 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:28:04.294 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:04.294 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repo Size 2024-04-23T18:28:04.294 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:04.294 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:28:04.294 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 127 k 2024-04-23T18:28:04.294 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:04.294 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:28:04.294 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:04.294 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-04-23T18:28:04.294 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:04.294 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 127 k 2024-04-23T18:28:04.295 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 456 k 2024-04-23T18:28:04.295 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:28:04.457 INFO:teuthology.orchestra.run.smithi062.stdout:(1/2): ceph-fuse-19.0.0-3217.ge2b3a300.el7.x86_ 2.7 MB/s | 890 kB 00:00 2024-04-23T18:28:04.675 INFO:teuthology.orchestra.run.smithi119.stdout:librados-devel-19.0.0-3217.ge2b3a300.el7.x86_64 334 kB/s | 127 kB 00:00 2024-04-23T18:28:04.676 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:04.676 INFO:teuthology.orchestra.run.smithi119.stdout:Total 332 kB/s | 127 kB 00:00 2024-04-23T18:28:04.676 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:28:04.682 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:28:04.682 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:28:04.748 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:28:04.748 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:28:04.901 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:28:04.924 INFO:teuthology.orchestra.run.smithi062.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 101 kB/s | 80 kB 00:00 2024-04-23T18:28:04.925 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:04.925 INFO:teuthology.orchestra.run.smithi062.stdout:Total 1.0 MB/s | 971 kB 00:00 2024-04-23T18:28:04.938 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:28:04.963 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:28:04.963 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:28:05.015 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:05.048 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:28:05.048 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:28:05.239 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:28:05.374 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-23T18:28:05.443 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 2/2 2024-04-23T18:28:05.453 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:05.705 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:05.705 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:05.706 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:28:05.706 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:28:05.706 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:05.706 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:05.936 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install libcephfs2 2024-04-23T18:28:06.141 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 2/2 2024-04-23T18:28:06.141 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/2 2024-04-23T18:28:06.410 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-23T18:28:06.410 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:06.410 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:28:06.410 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-23T18:28:06.410 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:06.410 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:06.456 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:28 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:28:06.536 INFO:teuthology.orchestra.run.smithi119.stdout:Package libcephfs2-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:06.578 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:28:06.579 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-04-23T18:28:06.580 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:06.665 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-volume 2024-04-23T18:28:06.665 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install libcephfs-devel 2024-04-23T18:28:07.174 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:29 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:28:07.245 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:15 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:07.293 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:28:07.294 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:07.294 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repo Size 2024-04-23T18:28:07.294 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:07.294 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:28:07.294 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 32 k 2024-04-23T18:28:07.294 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:07.294 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:28:07.295 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:07.295 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-04-23T18:28:07.295 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:07.295 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 32 k 2024-04-23T18:28:07.295 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 142 k 2024-04-23T18:28:07.295 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:28:07.370 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:07.371 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-04-23T18:28:07.371 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:07.371 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:28:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume noarch 2:19.0.0-3217.ge2b3a300.el7 ceph-noarch 273 k 2024-04-23T18:28:07.371 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-04-23T18:28:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-23T18:28:07.371 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:07.371 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:28:07.371 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:07.371 INFO:teuthology.orchestra.run.smithi062.stdout:Install 2 Packages 2024-04-23T18:28:07.372 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:07.372 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 350 k 2024-04-23T18:28:07.372 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 1.5 M 2024-04-23T18:28:07.372 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:28:07.464 INFO:teuthology.orchestra.run.smithi119.stdout:libcephfs-devel-19.0.0-3217.ge2b3a300.el7.x86_6 189 kB/s | 32 kB 00:00 2024-04-23T18:28:07.464 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:07.465 INFO:teuthology.orchestra.run.smithi119.stdout:Total 187 kB/s | 32 kB 00:00 2024-04-23T18:28:07.465 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:28:07.468 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:28:07.468 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:28:07.470 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:28:07.470 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:28:07.562 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:28:07.668 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:07.673 INFO:teuthology.orchestra.run.smithi062.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 517 kB/s | 77 kB 00:00 2024-04-23T18:28:07.898 INFO:teuthology.orchestra.run.smithi062.stdout:(2/2): ceph-volume-19.0.0-3217.ge2b3a300.el7.no 730 kB/s | 273 kB 00:00 2024-04-23T18:28:07.899 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:07.899 INFO:teuthology.orchestra.run.smithi062.stdout:Total 664 kB/s | 350 kB 00:00 2024-04-23T18:28:07.910 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:28:07.921 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:28:07.921 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:28:07.949 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:28:07.949 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:28:08.021 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:08.107 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:28:08.215 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:08.215 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:08.215 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:28:08.215 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:28:08.215 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:08.215 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:08.297 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-23T18:28:08.326 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-volume-2:19.0.0-3217.ge2b3a300.el7.noarch 2/2 2024-04-23T18:28:08.341 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-volume-2:19.0.0-3217.ge2b3a300.el7.noarch 2/2 2024-04-23T18:28:08.342 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:28:08.342 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-23T18:28:08.342 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:08.380 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install librados2 2024-04-23T18:28:08.889 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:30 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:28:08.967 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:09.005 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-volume-2:19.0.0-3217.ge2b3a300.el7.noarch 1/2 2024-04-23T18:28:09.007 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:28:09.008 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-04-23T18:28:09.009 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:09.068 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install librbd1 2024-04-23T18:28:09.278 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-23T18:28:09.279 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:09.279 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:28:09.279 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume-2:19.0.0-3217.ge2b3a300.el7.noarch 2024-04-23T18:28:09.279 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-23T18:28:09.279 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:09.279 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:09.577 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:31 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:28:09.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librados-devel 2024-04-23T18:28:09.655 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:09.695 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:28:09.696 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-04-23T18:28:09.696 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:09.760 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install python3-rados 2024-04-23T18:28:10.148 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:18 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:10.273 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:32 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:28:10.274 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:10.275 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:10.275 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-04-23T18:28:10.275 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:10.275 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:28:10.275 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 127 k 2024-04-23T18:28:10.275 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:10.275 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:28:10.276 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:10.276 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-23T18:28:10.276 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:10.276 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 127 k 2024-04-23T18:28:10.276 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 456 k 2024-04-23T18:28:10.276 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:28:10.351 INFO:teuthology.orchestra.run.smithi119.stdout:Package python3-rados-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:10.392 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:28:10.393 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-04-23T18:28:10.393 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:10.457 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install python3-rgw 2024-04-23T18:28:10.488 INFO:teuthology.orchestra.run.smithi062.stdout:librados-devel-19.0.0-3217.ge2b3a300.el7.x86_64 597 kB/s | 127 kB 00:00 2024-04-23T18:28:10.489 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:10.489 INFO:teuthology.orchestra.run.smithi062.stdout:Total 593 kB/s | 127 kB 00:00 2024-04-23T18:28:10.489 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:28:10.495 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:28:10.495 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:28:10.562 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:28:10.563 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:28:10.715 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:28:10.820 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:10.967 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:32 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:28:11.046 INFO:teuthology.orchestra.run.smithi119.stdout:Package python3-rgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:11.086 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:28:11.087 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-04-23T18:28:11.088 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:11.157 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install python3-cephfs 2024-04-23T18:28:11.244 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:11.479 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:11.479 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:11.479 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:28:11.479 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:28:11.479 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:11.480 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:11.659 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:33 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:28:11.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs2 2024-04-23T18:28:11.738 INFO:teuthology.orchestra.run.smithi119.stdout:Package python3-cephfs-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:11.778 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:28:11.779 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-04-23T18:28:11.779 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:11.842 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install python3-rbd 2024-04-23T18:28:12.237 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:20 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:12.321 INFO:teuthology.orchestra.run.smithi062.stdout:Package libcephfs2-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:12.348 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:34 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:28:12.366 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:12.366 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-23T18:28:12.366 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:12.426 INFO:teuthology.orchestra.run.smithi119.stdout:Package python3-rbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:12.433 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install libcephfs-devel 2024-04-23T18:28:12.466 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:28:12.467 INFO:teuthology.orchestra.run.smithi119.stdout:Nothing to do. 2024-04-23T18:28:12.467 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:12.537 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install rbd-fuse 2024-04-23T18:28:12.962 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:20 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:13.056 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:35 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:28:13.088 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:13.088 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:13.089 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-04-23T18:28:13.089 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:13.089 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:28:13.089 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 32 k 2024-04-23T18:28:13.089 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:13.089 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:28:13.089 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:13.089 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-23T18:28:13.089 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:13.090 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 32 k 2024-04-23T18:28:13.090 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 142 k 2024-04-23T18:28:13.090 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:28:13.176 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:28:13.177 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:13.177 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2024-04-23T18:28:13.177 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:13.177 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:28:13.177 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 85 k 2024-04-23T18:28:13.177 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:13.178 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:28:13.178 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:13.178 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-04-23T18:28:13.178 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:13.178 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 85 k 2024-04-23T18:28:13.178 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 231 k 2024-04-23T18:28:13.178 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:28:13.334 INFO:teuthology.orchestra.run.smithi062.stdout:libcephfs-devel-19.0.0-3217.ge2b3a300.el7.x86_6 130 kB/s | 32 kB 00:00 2024-04-23T18:28:13.334 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:13.334 INFO:teuthology.orchestra.run.smithi062.stdout:Total 129 kB/s | 32 kB 00:00 2024-04-23T18:28:13.334 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:28:13.338 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:28:13.338 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:28:13.340 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:28:13.341 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:28:13.391 INFO:teuthology.orchestra.run.smithi119.stdout:rbd-fuse-19.0.0-3217.ge2b3a300.el7.x86_64.rpm 401 kB/s | 85 kB 00:00 2024-04-23T18:28:13.392 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:13.392 INFO:teuthology.orchestra.run.smithi119.stdout:Total 398 kB/s | 85 kB 00:00 2024-04-23T18:28:13.392 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:28:13.399 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:28:13.399 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:28:13.425 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:28:13.462 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:28:13.462 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:28:13.549 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:13.608 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:28:13.706 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:13.880 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:14.049 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:14.103 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:14.104 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:14.104 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:28:14.104 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:28:14.104 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:14.104 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:14.272 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:14.272 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:14.272 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:28:14.272 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:28:14.272 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:14.272 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:14.294 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librados2 2024-04-23T18:28:14.535 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install rbd-mirror 2024-04-23T18:28:14.828 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:22 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:14.910 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:14.953 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:14.954 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-23T18:28:14.954 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:15.025 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install librbd1 2024-04-23T18:28:15.060 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:37 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:28:15.183 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:28:15.184 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:15.184 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repo Size 2024-04-23T18:28:15.184 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:15.184 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:28:15.184 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 3.1 M 2024-04-23T18:28:15.184 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:15.184 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:28:15.184 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:15.185 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-04-23T18:28:15.185 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:15.185 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 3.1 M 2024-04-23T18:28:15.185 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 13 M 2024-04-23T18:28:15.185 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:28:15.561 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:23 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:15.643 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:15.685 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:15.686 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-23T18:28:15.687 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:15.745 INFO:teuthology.orchestra.run.smithi119.stdout:rbd-mirror-19.0.0-3217.ge2b3a300.el7.x86_64.rpm 5.5 MB/s | 3.1 MB 00:00 2024-04-23T18:28:15.746 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:15.746 INFO:teuthology.orchestra.run.smithi119.stdout:Total 5.5 MB/s | 3.1 MB 00:00 2024-04-23T18:28:15.746 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:28:15.755 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:28:15.755 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:28:15.758 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rados 2024-04-23T18:28:15.834 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:28:15.835 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:28:16.274 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:28:16.287 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:24 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:16.346 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:16.369 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rados-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:16.370 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:16.370 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:28:16.371 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T18:28:16.371 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T18:28:16.371 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T18:28:16.371 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:16.412 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:16.413 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-23T18:28:16.413 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:16.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rgw 2024-04-23T18:28:17.016 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:25 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:17.097 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rgw-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:17.140 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:17.141 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-23T18:28:17.141 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:17.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-cephfs 2024-04-23T18:28:17.431 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:17.432 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:17.432 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:28:17.432 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:28:17.432 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:17.432 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:17.664 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install rbd-nbd 2024-04-23T18:28:17.738 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:25 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:17.819 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-cephfs-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:17.862 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:17.864 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-23T18:28:17.864 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:17.933 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install python3-rbd 2024-04-23T18:28:18.179 INFO:teuthology.orchestra.run.smithi119.stdout:Last metadata expiration check: 0:02:40 ago on Tue 23 Apr 2024 06:25:38 PM UTC. 2024-04-23T18:28:18.304 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-04-23T18:28:18.304 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:18.305 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2024-04-23T18:28:18.305 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:18.305 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-04-23T18:28:18.305 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 170 k 2024-04-23T18:28:18.305 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:18.305 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-04-23T18:28:18.305 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-04-23T18:28:18.305 INFO:teuthology.orchestra.run.smithi119.stdout:Install 1 Package 2024-04-23T18:28:18.305 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:18.305 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 170 k 2024-04-23T18:28:18.305 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 494 k 2024-04-23T18:28:18.305 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-04-23T18:28:18.466 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:26 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:18.524 INFO:teuthology.orchestra.run.smithi119.stdout:rbd-nbd-19.0.0-3217.ge2b3a300.el7.x86_64.rpm 778 kB/s | 170 kB 00:00 2024-04-23T18:28:18.525 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:18.525 INFO:teuthology.orchestra.run.smithi119.stdout:Total 774 kB/s | 170 kB 00:00 2024-04-23T18:28:18.525 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-04-23T18:28:18.533 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-04-23T18:28:18.533 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-04-23T18:28:18.546 INFO:teuthology.orchestra.run.smithi062.stdout:Package python3-rbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 is already installed. 2024-04-23T18:28:18.589 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:18.590 INFO:teuthology.orchestra.run.smithi062.stdout:Nothing to do. 2024-04-23T18:28:18.590 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:18.595 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-04-23T18:28:18.596 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-04-23T18:28:18.666 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-fuse 2024-04-23T18:28:18.748 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-04-23T18:28:18.855 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:19.203 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:27 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:19.221 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:19.328 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:19.329 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:19.329 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-23T18:28:19.329 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:19.329 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:28:19.329 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 85 k 2024-04-23T18:28:19.329 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:19.329 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:28:19.329 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:19.330 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-23T18:28:19.330 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:19.330 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 85 k 2024-04-23T18:28:19.330 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 231 k 2024-04-23T18:28:19.330 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:28:19.461 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:19.461 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:19.462 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-04-23T18:28:19.462 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:28:19.462 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:19.462 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-04-23T18:28:19.628 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-fuse-19.0.0-3217.ge2b3a300.el7.x86_64.rpm 286 kB/s | 85 kB 00:00 2024-04-23T18:28:19.629 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:19.629 INFO:teuthology.orchestra.run.smithi062.stdout:Total 285 kB/s | 85 kB 00:00 2024-04-23T18:28:19.629 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:28:19.637 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:28:19.637 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:28:19.692 DEBUG:teuthology.parallel:result is None 2024-04-23T18:28:19.704 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:28:19.704 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:28:19.850 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:28:19.968 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:20.316 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:20.553 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:20.553 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:20.553 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:28:20.554 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:28:20.554 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:20.554 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:20.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-mirror 2024-04-23T18:28:21.322 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:29 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:21.449 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:21.450 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:21.450 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-04-23T18:28:21.450 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:21.450 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:28:21.450 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 3.1 M 2024-04-23T18:28:21.450 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:21.450 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:28:21.450 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:21.450 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-23T18:28:21.450 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:21.451 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 3.1 M 2024-04-23T18:28:21.451 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 13 M 2024-04-23T18:28:21.451 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:28:22.540 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-mirror-19.0.0-3217.ge2b3a300.el7.x86_64.rpm 2.8 MB/s | 3.1 MB 00:01 2024-04-23T18:28:22.541 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:22.542 INFO:teuthology.orchestra.run.smithi062.stdout:Total 2.8 MB/s | 3.1 MB 00:01 2024-04-23T18:28:22.542 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:28:22.552 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:28:22.552 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:28:22.639 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:28:22.639 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:28:23.091 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:28:23.158 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:23.183 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:23.184 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T18:28:23.184 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T18:28:23.184 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T18:28:23.184 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T18:28:23.184 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:24.237 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:24.238 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:24.238 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:28:24.238 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:28:24.238 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:24.238 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:24.451 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install rbd-nbd 2024-04-23T18:28:24.990 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:02:32 ago on Tue 23 Apr 2024 06:25:52 PM UTC. 2024-04-23T18:28:25.115 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-04-23T18:28:25.116 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:25.116 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-04-23T18:28:25.116 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:25.116 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-04-23T18:28:25.116 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:19.0.0-3217.ge2b3a300.el7 ceph 170 k 2024-04-23T18:28:25.117 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:25.117 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-04-23T18:28:25.117 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-04-23T18:28:25.117 INFO:teuthology.orchestra.run.smithi062.stdout:Install 1 Package 2024-04-23T18:28:25.117 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:25.117 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 170 k 2024-04-23T18:28:25.117 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 494 k 2024-04-23T18:28:25.117 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-04-23T18:28:25.469 INFO:teuthology.orchestra.run.smithi062.stdout:rbd-nbd-19.0.0-3217.ge2b3a300.el7.x86_64.rpm 484 kB/s | 170 kB 00:00 2024-04-23T18:28:25.470 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-04-23T18:28:25.470 INFO:teuthology.orchestra.run.smithi062.stdout:Total 482 kB/s | 170 kB 00:00 2024-04-23T18:28:25.470 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-04-23T18:28:25.479 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-04-23T18:28:25.479 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-04-23T18:28:25.546 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-04-23T18:28:25.547 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-04-23T18:28:25.712 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-04-23T18:28:25.820 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:26.214 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:26.460 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 1/1 2024-04-23T18:28:26.460 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:26.460 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-04-23T18:28:26.460 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:19.0.0-3217.ge2b3a300.el7.x86_64 2024-04-23T18:28:26.460 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:26.460 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-04-23T18:28:26.673 DEBUG:teuthology.parallel:result is None 2024-04-23T18:28:26.674 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b3a3002f404c8e61fd792e773abde1ec60016e 2024-04-23T18:28:26.893 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T18:28:26.915 INFO:teuthology.orchestra.run.smithi062.stdout:19.0.0-3217.ge2b3a300.el7 2024-04-23T18:28:26.916 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3217.ge2b3a300.el7 2024-04-23T18:28:26.916 INFO:teuthology.task.install:The correct ceph version 19.0.0-3217.ge2b3a300 is installed. 2024-04-23T18:28:26.918 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b3a3002f404c8e61fd792e773abde1ec60016e 2024-04-23T18:28:27.061 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T18:28:27.086 INFO:teuthology.orchestra.run.smithi119.stdout:19.0.0-3217.ge2b3a300.el7 2024-04-23T18:28:27.086 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3217.ge2b3a300.el7 2024-04-23T18:28:27.086 INFO:teuthology.task.install:The correct ceph version 19.0.0-3217.ge2b3a300 is installed. 2024-04-23T18:28:27.088 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-23T18:28:27.088 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:28:27.088 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T18:28:27.116 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:27.116 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T18:28:27.154 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-23T18:28:27.154 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:28:27.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T18:28:27.182 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T18:28:27.248 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:27.248 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T18:28:27.275 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T18:28:27.341 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-23T18:28:27.341 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:28:27.341 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T18:28:27.366 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T18:28:27.431 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:27.431 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T18:28:27.457 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T18:28:27.522 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-23T18:28:27.523 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:28:27.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T18:28:27.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T18:28:27.611 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:27.611 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T18:28:27.636 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T18:28:27.701 INFO:teuthology.run_tasks:Running task ceph... 2024-04-23T18:28:27.792 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-23T18:28:27.792 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2024-04-23T18:28:27.795 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2024-04-23T18:28:27.818 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-23T18:28:27.819 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T18:28:27.860 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T18:28:27.883 INFO:tasks.ceph:Creating extra log directories... 2024-04-23T18:28:27.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T18:28:27.925 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T18:28:27.957 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-23T18:28:27.957 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-23T18:28:27.957 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi/7670059', 'branch': 'wip-skoduri-lc-stall', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7670059', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-skoduri-lc-stall'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'e2b3a3002f404c8e61fd792e773abde1ec60016e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e2b3a3002f404c8e61fd792e773abde1ec60016e'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-skoduri-lc-stall', 'sha1': 'e2b3a3002f404c8e61fd792e773abde1ec60016e'}}, 'owner': 'scheduled_soumyakoduri@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'sha1': 'e2b3a3002f404c8e61fd792e773abde1ec60016e', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-skoduri-lc-stall', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e2b3a3002f404c8e61fd792e773abde1ec60016e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e2b3a3002f404c8e61fd792e773abde1ec60016e', 'targets': {'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOxStYenuUjaV6lvXp6MLOhsDDMT8b3/vaOmlUJ5OmLJ2wZDCD255ulajnoG8xkKEWU6MH9kO+Vsq+EJd/e+nBg=', 'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5qkN/I9xUsUBeIgiMg2tSVAdt3TWIn5/LjwYtoctqwyMXsvs1jSUPDFNAL6PKKkOzixbJWy8PVlj9shrL0VoY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'e2b3a3002f404c8e61fd792e773abde1ec60016e', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-23_17:18:46', 'tube': 'smithi', 'user': 'soumyakoduri', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-23T18:28:27.958 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T18:28:27.990 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T18:28:28.005 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T18:28:28.045 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T18:28:28.068 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:28:28.068 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T18:28:28.123 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T18:28:28.124 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-04-23T18:28:28.179 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T18:28:28.179 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:28:28.179 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-23T18:28:28.179 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:28:28.179 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T18:28:28.179 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-23 18:28:23.421890031 +0000 2024-04-23T18:28:28.179 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-23 18:25:01.806779832 +0000 2024-04-23T18:28:28.179 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-23 18:25:01.806779832 +0000 2024-04-23T18:28:28.179 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-04-23 18:25:01.806779832 +0000 2024-04-23T18:28:28.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T18:28:28.242 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-23T18:28:28.242 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-23T18:28:28.242 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000259609 s, 2.0 MB/s 2024-04-23T18:28:28.243 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T18:28:28.299 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-04-23T18:28:28.354 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T18:28:28.354 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:28:28.354 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-23T18:28:28.354 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:28:28.354 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T18:28:28.354 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-23 18:28:23.422890016 +0000 2024-04-23T18:28:28.355 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-23 18:25:02.154774393 +0000 2024-04-23T18:28:28.355 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-23 18:25:02.154774393 +0000 2024-04-23T18:28:28.355 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-04-23 18:25:02.154774393 +0000 2024-04-23T18:28:28.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T18:28:28.417 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-23T18:28:28.417 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-23T18:28:28.417 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000185802 s, 2.8 MB/s 2024-04-23T18:28:28.419 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T18:28:28.475 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-04-23T18:28:28.530 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T18:28:28.530 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:28:28.530 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-23T18:28:28.530 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:28:28.530 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T18:28:28.530 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-23 18:28:23.422890016 +0000 2024-04-23T18:28:28.530 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-23 18:25:02.498769017 +0000 2024-04-23T18:28:28.530 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-23 18:25:02.498769017 +0000 2024-04-23T18:28:28.530 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-04-23 18:25:02.498769017 +0000 2024-04-23T18:28:28.531 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T18:28:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-23T18:28:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-23T18:28:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000190992 s, 2.7 MB/s 2024-04-23T18:28:28.594 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T18:28:28.650 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-04-23T18:28:28.706 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T18:28:28.706 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:28:28.706 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-23T18:28:28.706 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:28:28.706 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T18:28:28.706 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-04-23 18:28:23.423890001 +0000 2024-04-23T18:28:28.706 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-04-23 18:25:02.833763781 +0000 2024-04-23T18:28:28.706 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-04-23 18:25:02.833763781 +0000 2024-04-23T18:28:28.706 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-04-23 18:25:02.833763781 +0000 2024-04-23T18:28:28.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T18:28:28.768 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-04-23T18:28:28.768 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-04-23T18:28:28.768 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000190401 s, 2.7 MB/s 2024-04-23T18:28:28.769 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T18:28:28.825 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-23T18:28:28.825 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:28.825 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T18:28:28.842 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T18:28:28.843 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-04-23T18:28:28.898 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T18:28:28.898 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:28:28.899 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-23T18:28:28.899 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:28:28.899 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T18:28:28.899 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-04-23 18:28:16.617389619 +0000 2024-04-23T18:28:28.899 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-04-23 18:24:53.258139031 +0000 2024-04-23T18:28:28.899 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-04-23 18:24:53.258139031 +0000 2024-04-23T18:28:28.899 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-04-23 18:24:53.258139031 +0000 2024-04-23T18:28:28.899 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T18:28:28.961 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-04-23T18:28:28.961 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-04-23T18:28:28.962 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000212235 s, 2.4 MB/s 2024-04-23T18:28:28.963 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T18:28:29.020 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-04-23T18:28:29.076 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T18:28:29.076 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:28:29.076 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-04-23T18:28:29.076 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:28:29.076 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T18:28:29.076 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-04-23 18:28:16.617389619 +0000 2024-04-23T18:28:29.076 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-04-23 18:24:53.594130805 +0000 2024-04-23T18:28:29.076 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-04-23 18:24:53.594130805 +0000 2024-04-23T18:28:29.077 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-04-23 18:24:53.594130805 +0000 2024-04-23T18:28:29.077 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T18:28:29.139 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-04-23T18:28:29.140 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-04-23T18:28:29.140 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000232348 s, 2.2 MB/s 2024-04-23T18:28:29.141 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T18:28:29.198 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-04-23T18:28:29.254 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T18:28:29.254 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:28:29.254 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-23T18:28:29.255 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:28:29.255 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T18:28:29.255 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-04-23 18:28:16.618389595 +0000 2024-04-23T18:28:29.255 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-04-23 18:24:53.932122530 +0000 2024-04-23T18:28:29.255 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-04-23 18:24:53.932122530 +0000 2024-04-23T18:28:29.255 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-04-23 18:24:53.932122530 +0000 2024-04-23T18:28:29.255 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T18:28:29.317 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-04-23T18:28:29.317 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-04-23T18:28:29.317 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000281253 s, 1.8 MB/s 2024-04-23T18:28:29.319 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T18:28:29.374 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-04-23T18:28:29.430 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T18:28:29.430 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T18:28:29.430 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-23T18:28:29.430 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T18:28:29.430 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T18:28:29.430 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-04-23 18:28:16.618389595 +0000 2024-04-23T18:28:29.430 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-04-23 18:24:54.256114598 +0000 2024-04-23T18:28:29.430 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-04-23 18:24:54.256114598 +0000 2024-04-23T18:28:29.431 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-04-23 18:24:54.256114598 +0000 2024-04-23T18:28:29.431 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T18:28:29.492 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-04-23T18:28:29.493 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-04-23T18:28:29.493 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000212896 s, 2.4 MB/s 2024-04-23T18:28:29.494 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T18:28:29.550 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-23T18:28:29.550 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-23T18:28:29.550 INFO:tasks.ceph:Generating config... 2024-04-23T18:28:29.551 INFO:tasks.ceph:[client] debug ms = 1 2024-04-23T18:28:29.551 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-04-23T18:28:29.552 INFO:tasks.ceph:[client] debug rgw = 20 2024-04-23T18:28:29.552 INFO:tasks.ceph:[client] setgroup = ceph 2024-04-23T18:28:29.552 INFO:tasks.ceph:[client] setuser = ceph 2024-04-23T18:28:29.552 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-23T18:28:29.552 INFO:tasks.ceph:[osd] debug objclass = 20 2024-04-23T18:28:29.552 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-23T18:28:29.552 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-23T18:28:29.552 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-23T18:28:29.552 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-23T18:28:29.552 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-23T18:28:29.552 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-23T18:28:29.552 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-23T18:28:29.553 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-23T18:28:29.553 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-23T18:28:29.553 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-23T18:28:29.553 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-23T18:28:29.553 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-23T18:28:29.553 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-23T18:28:29.553 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-23T18:28:29.553 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-23T18:28:29.553 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-23T18:28:29.553 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-23T18:28:29.553 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-23T18:28:29.553 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-23T18:28:29.554 INFO:tasks.ceph:Setting up mon.a... 2024-04-23T18:28:29.554 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-23T18:28:29.608 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.keyring 2024-04-23T18:28:29.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-23T18:28:29.657 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T18:28:29.682 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.62')] 2024-04-23T18:28:29.682 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.62'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-04-23T18:28:29.683 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:28:29.683 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T18:28:29.737 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.62 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:28:29.817 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:28:29.817 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:28:29.818 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:28:29.818 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: generated fsid 7bde1cd1-e3f4-4fcb-8bbb-8f7edde199b6 2024-04-23T18:28:29.818 INFO:teuthology.orchestra.run.smithi062.stdout:setting min_mon_release = quincy 2024-04-23T18:28:29.818 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 0 2024-04-23T18:28:29.818 INFO:teuthology.orchestra.run.smithi062.stdout:fsid 7bde1cd1-e3f4-4fcb-8bbb-8f7edde199b6 2024-04-23T18:28:29.818 INFO:teuthology.orchestra.run.smithi062.stdout:last_changed 2024-04-23T18:28:29.826146+0000 2024-04-23T18:28:29.818 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-04-23T18:28:29.826146+0000 2024-04-23T18:28:29.818 INFO:teuthology.orchestra.run.smithi062.stdout:min_mon_release 17 (quincy) 2024-04-23T18:28:29.818 INFO:teuthology.orchestra.run.smithi062.stdout:election_strategy: 1 2024-04-23T18:28:29.818 INFO:teuthology.orchestra.run.smithi062.stdout:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-04-23T18:28:29.819 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-04-23T18:28:29.820 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T18:28:29.874 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7bde1cd1-e3f4-4fcb-8bbb-8f7edde199b6... 2024-04-23T18:28:29.875 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T18:28:29.917 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T18:28:29.956 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-04-23T18:28:29.956 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2024-04-23T18:28:29.956 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T18:28:29.956 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2024-04-23T18:28:29.956 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.956 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2024-04-23T18:28:29.956 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.956 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2024-04-23T18:28:29.956 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.956 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2024-04-23T18:28:29.956 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2024-04-23T18:28:29.957 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.958 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = 172.21.15.62 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 7bde1cd1-e3f4-4fcb-8bbb-8f7edde199b6 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.959 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug trim objects = true 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2024-04-23T18:28:29.960 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: debug objclass = 20 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: bdev async discard = True 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: bdev enable discard = True 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore allocator = bitmap 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2024-04-23T18:28:29.961 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 1/20 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 1/20 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 4/10 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-04-23T18:28:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-04-23T18:28:29.963 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-04-23T18:28:29.965 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-04-23T18:28:29.965 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2024-04-23T18:28:29.965 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.965 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T18:28:29.966 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2024-04-23T18:28:29.967 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T18:28:29.968 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T18:28:29.968 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-04-23T18:28:29.968 INFO:teuthology.orchestra.run.smithi062.stdout: rgw gc obj min wait = 15 2024-04-23T18:28:29.968 INFO:teuthology.orchestra.run.smithi062.stdout: debug rgw = 20 2024-04-23T18:28:29.968 INFO:teuthology.orchestra.run.smithi062.stdout: setgroup = ceph 2024-04-23T18:28:29.968 INFO:teuthology.orchestra.run.smithi062.stdout: setuser = ceph 2024-04-23T18:28:29.968 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2024-04-23T18:28:29.969 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2024-04-23T18:28:29.970 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2024-04-23T18:28:29.970 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T18:28:29.970 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2024-04-23T18:28:29.970 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.970 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2024-04-23T18:28:29.970 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.970 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2024-04-23T18:28:29.970 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.970 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2024-04-23T18:28:29.970 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2024-04-23T18:28:29.970 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.970 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2024-04-23T18:28:29.970 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2024-04-23T18:28:29.971 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2024-04-23T18:28:29.972 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = 172.21.15.62 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = 7bde1cd1-e3f4-4fcb-8bbb-8f7edde199b6 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.973 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug trim objects = true 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.974 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: debug objclass = 20 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = bitmap 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 1/20 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 1/20 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2024-04-23T18:28:29.975 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 4/10 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-04-23T18:28:29.976 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.977 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2024-04-23T18:28:29.978 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2024-04-23T18:28:29.979 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2024-04-23T18:28:29.979 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2024-04-23T18:28:29.979 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T18:28:29.979 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T18:28:29.979 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2024-04-23T18:28:29.979 INFO:teuthology.orchestra.run.smithi119.stdout: rgw gc obj min wait = 15 2024-04-23T18:28:29.979 INFO:teuthology.orchestra.run.smithi119.stdout: debug rgw = 20 2024-04-23T18:28:29.979 INFO:teuthology.orchestra.run.smithi119.stdout: setgroup = ceph 2024-04-23T18:28:29.979 INFO:teuthology.orchestra.run.smithi119.stdout: setuser = ceph 2024-04-23T18:28:29.979 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2024-04-23T18:28:29.979 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-23T18:28:29.980 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-23T18:28:30.064 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-23T18:28:30.064 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:28:30.064 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-23T18:28:30.079 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:28:30.079 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-23T18:28:30.135 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2024-04-23T18:28:30.135 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:28:30.135 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T18:28:30.135 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T18:28:30.208 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:28:30.208 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:28:30.263 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2024-04-23T18:28:30.263 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:30.263 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T18:28:30.263 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T18:28:30.296 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:30.296 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:28:30.351 INFO:tasks.ceph:Setting up mon nodes... 2024-04-23T18:28:30.351 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-23T18:28:30.351 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T18:28:30.450 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T18:28:30.452 INFO:tasks.ceph:Setting up mds nodes... 2024-04-23T18:28:30.452 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-23T18:28:30.453 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-23T18:28:30.491 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-23T18:28:30.502 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-23T18:28:30.503 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-23T18:28:30.503 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-23T18:28:30.527 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-23T18:28:30.527 INFO:tasks.ceph:role: osd.0 2024-04-23T18:28:30.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-23T18:28:30.527 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T18:28:30.600 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:28:30.600 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:28:30.600 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:28:30.600 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T18:28:30.600 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:28:30.600 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:28:30.600 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:28:30.600 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T18:28:30.600 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:28:30.601 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:28:31.109 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-04-23T18:28:31.111 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-04-23T18:28:31.111 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-23T18:28:31.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-23T18:28:31.274 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:28:31.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:31.375+0000 7f1144c21640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-23T18:28:31.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:31.381+0000 7f1144c21640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-23T18:28:31.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:31.381+0000 7f1144c21640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T18:28:31.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:31.381+0000 7f1144c21640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T18:28:31.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:31.381+0000 7f1144c21640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T18:28:31.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:31.389+0000 7f1144c21640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-23T18:28:34.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-23T18:28:34.274 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-23T18:28:34.302 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-23T18:28:34.302 INFO:tasks.ceph:role: osd.1 2024-04-23T18:28:34.302 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-23T18:28:34.303 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T18:28:34.377 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:28:34.378 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:28:34.378 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:28:34.378 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T18:28:34.378 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:28:34.378 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:28:34.378 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:28:34.378 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T18:28:34.378 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:28:34.378 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:28:34.874 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-04-23T18:28:34.877 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-04-23T18:28:34.877 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-23T18:28:34.989 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-23T18:28:35.019 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-23T18:28:35.082 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-23T18:28:35.082 INFO:tasks.ceph:role: osd.2 2024-04-23T18:28:35.082 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-23T18:28:35.082 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-23T18:28:35.153 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:28:35.153 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:28:35.153 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:28:35.153 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T18:28:35.153 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:28:35.153 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:28:35.153 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:28:35.153 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T18:28:35.154 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:28:35.154 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:28:35.605 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-04-23T18:28:35.607 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-04-23T18:28:35.607 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-04-23T18:28:35.678 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-23T18:28:35.745 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-23T18:28:35.808 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-23T18:28:35.808 INFO:tasks.ceph:role: osd.3 2024-04-23T18:28:35.808 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-23T18:28:35.808 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-23T18:28:35.879 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T18:28:35.879 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T18:28:35.879 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T18:28:35.879 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T18:28:35.879 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T18:28:35.879 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2024-04-23T18:28:35.879 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T18:28:35.879 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T18:28:35.879 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T18:28:35.879 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T18:28:36.359 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2024-04-23T18:28:36.360 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2024-04-23T18:28:36.361 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-04-23T18:28:36.447 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-23T18:28:36.474 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:28:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:36.574+0000 7f45b101d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-23T18:28:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:36.575+0000 7f45b101d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-23T18:28:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:36.575+0000 7f45b101d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T18:28:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:36.575+0000 7f45b101d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T18:28:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:36.575+0000 7f45b101d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T18:28:36.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:36.577+0000 7f45b101d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-23T18:28:39.426 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-23T18:28:39.454 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:28:39.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:39.549+0000 7f3ed9223640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-23T18:28:39.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:39.549+0000 7f3ed9223640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-23T18:28:39.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:39.549+0000 7f3ed9223640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T18:28:39.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:39.549+0000 7f3ed9223640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T18:28:39.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:39.549+0000 7f3ed9223640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T18:28:39.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:39.550+0000 7f3ed9223640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-23T18:28:42.409 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-23T18:28:42.436 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:28:42.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:42.532+0000 7f196401a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-23T18:28:42.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:42.532+0000 7f196401a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-23T18:28:42.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:42.532+0000 7f196401a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T18:28:42.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:42.532+0000 7f196401a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T18:28:42.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:42.532+0000 7f196401a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T18:28:42.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:42.533+0000 7f196401a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-23T18:28:45.384 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-23T18:28:45.412 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-23T18:28:45.412 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:28:45.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-23T18:28:45.442 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:45.442 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-23T18:28:45.479 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:45.479 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-23T18:28:45.545 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:45.545 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-23T18:28:45.610 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:45.610 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-23T18:28:45.675 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:45.675 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-23T18:28:45.731 INFO:tasks.ceph:Adding keys to all mons... 2024-04-23T18:28:45.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-23T18:28:45.759 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2024-04-23T18:28:45.759 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDP/SdmhhtvFhAAyHSwIkrhWmD6ETSYaHPXmA== 2024-04-23T18:28:45.759 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2024-04-23T18:28:45.759 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDO/SdmrLdVGxAAeEMCbxXujl7gxwx0UYi72w== 2024-04-23T18:28:45.759 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2024-04-23T18:28:45.759 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDU/SdmXotQIhAAHjcCJgH4VfOvk2O+zQl5tw== 2024-04-23T18:28:45.759 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2024-04-23T18:28:45.759 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDX/SdmInXHIBAAXCOsCGBk5BbcMkbMsx0IaA== 2024-04-23T18:28:45.759 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2024-04-23T18:28:45.759 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDa/Sdm5OnFHxAAHZCZvGpraq3Vr2kZkgyWPw== 2024-04-23T18:28:45.759 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-04-23T18:28:45.759 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQDO/Sdm67TIHRAA09U94QwaBLyF1LbCmWLFdg== 2024-04-23T18:28:45.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:28:45.857 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T18:28:45.909 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:28:45.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:28:46.010 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T18:28:46.059 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T18:28:46.112 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-23T18:28:46.112 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-23T18:28:46.136 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T18:28:46.234 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-23T18:28:46.258 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-23T18:28:46.313 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-23T18:28:46.314 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-23T18:28:46.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-23T18:28:46.356 INFO:tasks.ceph.mon.a:Started 2024-04-23T18:28:46.356 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-23T18:28:46.356 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-23T18:28:46.356 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-23T18:28:46.359 INFO:tasks.ceph.mgr.x:Started 2024-04-23T18:28:46.359 INFO:tasks.ceph:Setting crush tunables to default 2024-04-23T18:28:46.359 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd crush tunables default 2024-04-23T18:28:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.465+0000 7f24ac255640 1 Processor -- start 2024-04-23T18:28:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.465+0000 7f24ac255640 1 -- start start 2024-04-23T18:28:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.465+0000 7f24ac255640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24a41284f0 0x7f24a41288d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.465+0000 7f24ac255640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24a41282f0 con 0x7f24a4128e10 2024-04-23T18:28:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.465+0000 7f24ac255640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f24a409a710 con 0x7f24a41284f0 2024-04-23T18:28:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.466+0000 7f24a9ff1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24a41284f0 0x7f24a41288d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.466+0000 7f24a9ff1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24a41284f0 0x7f24a41288d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42284/0 (socket says 172.21.15.62:42284) 2024-04-23T18:28:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.466+0000 7f24a9ff1640 1 -- 172.21.15.62:0/1627541196 learned_addr learned my addr 172.21.15.62:0/1627541196 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:28:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.466+0000 7f24a9ff1640 1 -- 172.21.15.62:0/1627541196 >> v1:172.21.15.62:6789/0 conn(0x7f24a4128e10 legacy=0x7f24a4096550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:46.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.466+0000 7f24a8fef640 1 -- 172.21.15.62:0/1627541196 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1705525088 0 0) 0x7f24a41282f0 con 0x7f24a4128e10 2024-04-23T18:28:46.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.466+0000 7f24a9ff1640 1 -- 172.21.15.62:0/1627541196 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a409a3b0 con 0x7f24a41284f0 2024-04-23T18:28:46.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.468+0000 7f24a9ff1640 1 --2- 172.21.15.62:0/1627541196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a41284f0 0x7f24a41288d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f24a00097f0 tx=0x7f24a002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67766ea602dca05b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:46.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.468+0000 7f24a8fef640 1 -- 172.21.15.62:0/1627541196 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24a0034070 con 0x7f24a41284f0 2024-04-23T18:28:46.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.468+0000 7f24a8fef640 1 -- 172.21.15.62:0/1627541196 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a0030790 con 0x7f24a41284f0 2024-04-23T18:28:46.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.468+0000 7f24a8fef640 1 -- 172.21.15.62:0/1627541196 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24a0030a90 con 0x7f24a41284f0 2024-04-23T18:28:46.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.469+0000 7f24ac255640 1 -- 172.21.15.62:0/1627541196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a41284f0 msgr2=0x7f24a41288d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:46.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.469+0000 7f24ac255640 1 --2- 172.21.15.62:0/1627541196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a41284f0 0x7f24a41288d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f24a00097f0 tx=0x7f24a002b9a0 comp rx=0 tx=0).stop 2024-04-23T18:28:46.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.469+0000 7f24ac255640 1 -- 172.21.15.62:0/1627541196 shutdown_connections 2024-04-23T18:28:46.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.469+0000 7f24ac255640 1 --2- 172.21.15.62:0/1627541196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a41284f0 0x7f24a41288d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:46.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.469+0000 7f24ac255640 1 -- 172.21.15.62:0/1627541196 >> 172.21.15.62:0/1627541196 conn(0x7f24a409d560 msgr2=0x7f24a4099a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:46.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.469+0000 7f24ac255640 1 -- 172.21.15.62:0/1627541196 shutdown_connections 2024-04-23T18:28:46.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.469+0000 7f24ac255640 1 -- 172.21.15.62:0/1627541196 wait complete. 2024-04-23T18:28:46.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.470+0000 7f24ac255640 1 Processor -- start 2024-04-23T18:28:46.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.470+0000 7f24ac255640 1 -- start start 2024-04-23T18:28:46.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.470+0000 7f24ac255640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a41284f0 0x7f24a4126400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:46.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.470+0000 7f24ac255640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4096c60 con 0x7f24a41284f0 2024-04-23T18:28:46.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.470+0000 7f24a9ff1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a41284f0 0x7f24a4126400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:46.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.470+0000 7f24a9ff1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a41284f0 0x7f24a4126400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42296/0 (socket says 172.21.15.62:42296) 2024-04-23T18:28:46.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.470+0000 7f24a9ff1640 1 -- 172.21.15.62:0/1507283055 learned_addr learned my addr 172.21.15.62:0/1507283055 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:28:46.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.470+0000 7f24a9ff1640 1 -- 172.21.15.62:0/1507283055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a4072b40 con 0x7f24a41284f0 2024-04-23T18:28:46.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.471+0000 7f24a9ff1640 1 --2- 172.21.15.62:0/1507283055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a41284f0 0x7f24a4126400 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f24a002b9e0 tx=0x7f24a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:46.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.471+0000 7f249a7fc640 1 -- 172.21.15.62:0/1507283055 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24a0034040 con 0x7f24a41284f0 2024-04-23T18:28:46.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.471+0000 7f249a7fc640 1 -- 172.21.15.62:0/1507283055 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a0030a70 con 0x7f24a41284f0 2024-04-23T18:28:46.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.471+0000 7f24ac255640 1 -- 172.21.15.62:0/1507283055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a40734a0 con 0x7f24a41284f0 2024-04-23T18:28:46.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.471+0000 7f249a7fc640 1 -- 172.21.15.62:0/1507283055 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24a0030dd0 con 0x7f24a41284f0 2024-04-23T18:28:46.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.471+0000 7f24ac255640 1 -- 172.21.15.62:0/1507283055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a4129620 con 0x7f24a41284f0 2024-04-23T18:28:46.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.471+0000 7f249a7fc640 1 -- 172.21.15.62:0/1507283055 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f24a004b060 con 0x7f24a41284f0 2024-04-23T18:28:46.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.471+0000 7f249a7fc640 1 -- 172.21.15.62:0/1507283055 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f24a003f030 con 0x7f24a41284f0 2024-04-23T18:28:46.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.472+0000 7f24ac255640 1 -- 172.21.15.62:0/1507283055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a40505b0 con 0x7f24a41284f0 2024-04-23T18:28:46.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.474+0000 7f249a7fc640 1 -- 172.21.15.62:0/1507283055 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f24a0003df0 con 0x7f24a41284f0 2024-04-23T18:28:46.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.540+0000 7f24ac255640 1 -- 172.21.15.62:0/1507283055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f24a406bf50 con 0x7f24a41284f0 2024-04-23T18:28:46.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.541+0000 7f249a7fc640 1 -- 172.21.15.62:0/1507283055 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f24a00306e0 con 0x7f24a41284f0 2024-04-23T18:28:46.534 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2024-04-23T18:28:46.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.542+0000 7f24ac255640 1 -- 172.21.15.62:0/1507283055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a41284f0 msgr2=0x7f24a4126400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:46.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.542+0000 7f24ac255640 1 --2- 172.21.15.62:0/1507283055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a41284f0 0x7f24a4126400 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f24a002b9e0 tx=0x7f24a00046c0 comp rx=0 tx=0).stop 2024-04-23T18:28:46.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.542+0000 7f24ac255640 1 -- 172.21.15.62:0/1507283055 shutdown_connections 2024-04-23T18:28:46.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.542+0000 7f24ac255640 1 --2- 172.21.15.62:0/1507283055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24a41284f0 0x7f24a4126400 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:46.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.542+0000 7f24ac255640 1 -- 172.21.15.62:0/1507283055 >> 172.21.15.62:0/1507283055 conn(0x7f24a409d560 msgr2=0x7f24a4095440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:46.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.542+0000 7f24ac255640 1 -- 172.21.15.62:0/1507283055 shutdown_connections 2024-04-23T18:28:46.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:46.542+0000 7f24ac255640 1 -- 172.21.15.62:0/1507283055 wait complete. 2024-04-23T18:28:46.545 INFO:tasks.ceph:check_enable_crimson: False 2024-04-23T18:28:46.546 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-23T18:28:46.546 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-04-23T18:28:46.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-23T18:28:46.570 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:46.570 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-23T18:28:46.594 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:46.594 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-23T18:28:46.657 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-04-23T18:28:46.657 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-23T18:28:46.720 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 09209063-cd8c-480c-aee7-4c548f693d01 0 2024-04-23T18:28:46.748 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:46.756+0000 7fd80e645040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T18:28:46.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.851+0000 7f1933679640 1 Processor -- start 2024-04-23T18:28:46.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.851+0000 7f1933679640 1 -- start start 2024-04-23T18:28:46.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.852+0000 7f1933679640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f192c11b0f0 0x7f192c11d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:46.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.852+0000 7f1933679640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f192c11dab0 con 0x7f192c118470 2024-04-23T18:28:46.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.852+0000 7f1933679640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f192c11ecb0 con 0x7f192c11b0f0 2024-04-23T18:28:46.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.852+0000 7f1930c14640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f192c11b0f0 0x7f192c11d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:46.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.852+0000 7f1931415640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f192c118470 0x7f192c118850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:37818/0 (socket says 172.21.15.119:37818) 2024-04-23T18:28:46.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.852+0000 7f1930c14640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f192c11b0f0 0x7f192c11d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:40438/0 (socket says 172.21.15.119:40438) 2024-04-23T18:28:46.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.852+0000 7f1931415640 1 -- 172.21.15.119:0/3331835222 learned_addr learned my addr 172.21.15.119:0/3331835222 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:28:46.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.852+0000 7f1930c14640 1 -- 172.21.15.119:0/3331835222 >> v1:172.21.15.62:6789/0 conn(0x7f192c118470 legacy=0x7f192c118850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:46.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.852+0000 7f1930c14640 1 -- 172.21.15.119:0/3331835222 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192c11ee60 con 0x7f192c11b0f0 2024-04-23T18:28:46.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.852+0000 7f1923fff640 1 -- 172.21.15.119:0/3331835222 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3736271111 0 0) 0x7f192c11dab0 con 0x7f192c118470 2024-04-23T18:28:46.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.853+0000 7f1930c14640 1 --2- 172.21.15.119:0/3331835222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f192c11b0f0 0x7f192c11d4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1928009720 tx=0x7f192802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2335d5e6bad2d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:46.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.853+0000 7f1923fff640 1 -- 172.21.15.119:0/3331835222 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19280316d0 con 0x7f192c11b0f0 2024-04-23T18:28:46.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.853+0000 7f1923fff640 1 -- 172.21.15.119:0/3331835222 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1928037070 con 0x7f192c11b0f0 2024-04-23T18:28:46.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.853+0000 7f1923fff640 1 -- 172.21.15.119:0/3331835222 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19280319c0 con 0x7f192c11b0f0 2024-04-23T18:28:46.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.854+0000 7f1933679640 1 -- 172.21.15.119:0/3331835222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f192c11b0f0 msgr2=0x7f192c11d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:46.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.854+0000 7f1933679640 1 --2- 172.21.15.119:0/3331835222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f192c11b0f0 0x7f192c11d4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1928009720 tx=0x7f192802b840 comp rx=0 tx=0).stop 2024-04-23T18:28:46.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.854+0000 7f1933679640 1 -- 172.21.15.119:0/3331835222 shutdown_connections 2024-04-23T18:28:46.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.854+0000 7f1933679640 1 --2- 172.21.15.119:0/3331835222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f192c11b0f0 0x7f192c11d4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:46.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.854+0000 7f1933679640 1 -- 172.21.15.119:0/3331835222 >> 172.21.15.119:0/3331835222 conn(0x7f192c06e750 msgr2=0x7f192c06eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:46.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.854+0000 7f1933679640 1 -- 172.21.15.119:0/3331835222 shutdown_connections 2024-04-23T18:28:46.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.854+0000 7f1933679640 1 -- 172.21.15.119:0/3331835222 wait complete. 2024-04-23T18:28:46.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.855+0000 7f1933679640 1 Processor -- start 2024-04-23T18:28:46.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.855+0000 7f1933679640 1 -- start start 2024-04-23T18:28:46.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.855+0000 7f1933679640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f192c118470 0x7f192c1a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:46.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.855+0000 7f1933679640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f192c11e1a0 con 0x7f192c118470 2024-04-23T18:28:46.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.856+0000 7f1931415640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f192c118470 0x7f192c1a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:46.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.856+0000 7f1931415640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f192c118470 0x7f192c1a6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:40452/0 (socket says 172.21.15.119:40452) 2024-04-23T18:28:46.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.856+0000 7f1931415640 1 -- 172.21.15.119:0/757645537 learned_addr learned my addr 172.21.15.119:0/757645537 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:28:46.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.856+0000 7f1931415640 1 -- 172.21.15.119:0/757645537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192c1a7360 con 0x7f192c118470 2024-04-23T18:28:46.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.856+0000 7f1931415640 1 --2- 172.21.15.119:0/757645537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f192c118470 0x7f192c1a6d90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f191c00c420 tx=0x7f191c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:46.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.856+0000 7f1921ffb640 1 -- 172.21.15.119:0/757645537 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f191c018070 con 0x7f192c118470 2024-04-23T18:28:46.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.856+0000 7f1921ffb640 1 -- 172.21.15.119:0/757645537 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c0074d0 con 0x7f192c118470 2024-04-23T18:28:46.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.856+0000 7f1921ffb640 1 -- 172.21.15.119:0/757645537 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f191c004950 con 0x7f192c118470 2024-04-23T18:28:46.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.856+0000 7f1933679640 1 -- 172.21.15.119:0/757645537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f192c1a7650 con 0x7f192c118470 2024-04-23T18:28:46.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.856+0000 7f1921ffb640 1 -- 172.21.15.119:0/757645537 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f191c01b070 con 0x7f192c118470 2024-04-23T18:28:46.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.857+0000 7f1933679640 1 -- 172.21.15.119:0/757645537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f192c1ab640 con 0x7f192c118470 2024-04-23T18:28:46.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.857+0000 7f1921ffb640 1 -- 172.21.15.119:0/757645537 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f191c004af0 con 0x7f192c118470 2024-04-23T18:28:46.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.857+0000 7f1933679640 1 -- 172.21.15.119:0/757645537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f192c0505b0 con 0x7f192c118470 2024-04-23T18:28:46.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.860+0000 7f1921ffb640 1 -- 172.21.15.119:0/757645537 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f191c023020 con 0x7f192c118470 2024-04-23T18:28:46.903 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:46.910+0000 7fd80e645040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T18:28:46.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.932+0000 7f1933679640 1 -- 172.21.15.119:0/757645537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "09209063-cd8c-480c-aee7-4c548f693d01", "id": 0} v 0) -- 0x7f192c11b0f0 con 0x7f192c118470 2024-04-23T18:28:46.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.933+0000 7f1921ffb640 1 -- 172.21.15.119:0/757645537 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "09209063-cd8c-480c-aee7-4c548f693d01", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f191c004dc0 con 0x7f192c118470 2024-04-23T18:28:46.926 INFO:teuthology.orchestra.run.smithi119.stdout:0 2024-04-23T18:28:46.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.934+0000 7f1933679640 1 -- 172.21.15.119:0/757645537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f192c118470 msgr2=0x7f192c1a6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:46.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.934+0000 7f1933679640 1 --2- 172.21.15.119:0/757645537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f192c118470 0x7f192c1a6d90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f191c00c420 tx=0x7f191c00c8e0 comp rx=0 tx=0).stop 2024-04-23T18:28:46.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.934+0000 7f1933679640 1 -- 172.21.15.119:0/757645537 shutdown_connections 2024-04-23T18:28:46.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.934+0000 7f1933679640 1 --2- 172.21.15.119:0/757645537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f192c118470 0x7f192c1a6d90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:46.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.934+0000 7f1933679640 1 -- 172.21.15.119:0/757645537 >> 172.21.15.119:0/757645537 conn(0x7f192c06e750 msgr2=0x7f192c110d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:46.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.934+0000 7f1933679640 1 -- 172.21.15.119:0/757645537 shutdown_connections 2024-04-23T18:28:46.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:46.934+0000 7f1933679640 1 -- 172.21.15.119:0/757645537 wait complete. 2024-04-23T18:28:46.937 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new cebd6eb1-aa92-4110-8388-1bbcdc3915f3 1 2024-04-23T18:28:46.960 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:46.967+0000 7fd80e645040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T18:28:47.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.041+0000 7f5e71bb5640 1 Processor -- start 2024-04-23T18:28:47.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.041+0000 7f5e71bb5640 1 -- start start 2024-04-23T18:28:47.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.041+0000 7f5e71bb5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5e6c118470 0x7f5e6c118850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:47.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.041+0000 7f5e71bb5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e6c118ee0 con 0x7f5e6c112150 2024-04-23T18:28:47.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.041+0000 7f5e71bb5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f5e6c112d10 con 0x7f5e6c118470 2024-04-23T18:28:47.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.041+0000 7f5e6b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5e6c118470 0x7f5e6c118850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:47.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.041+0000 7f5e6b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5e6c118470 0x7f5e6c118850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:40458/0 (socket says 172.21.15.119:40458) 2024-04-23T18:28:47.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.041+0000 7f5e6b7fe640 1 -- 172.21.15.119:0/1359670007 learned_addr learned my addr 172.21.15.119:0/1359670007 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:28:47.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.041+0000 7f5e6affd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5e6c112150 0x7f5e6c112600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:37834/0 (socket says 172.21.15.119:37834) 2024-04-23T18:28:47.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.042+0000 7f5e6b7fe640 1 -- 172.21.15.119:0/1359670007 >> v1:172.21.15.62:6789/0 conn(0x7f5e6c112150 legacy=0x7f5e6c112600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:47.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.042+0000 7f5e6b7fe640 1 -- 172.21.15.119:0/1359670007 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6c112ec0 con 0x7f5e6c118470 2024-04-23T18:28:47.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.042+0000 7f5e6b7fe640 1 --2- 172.21.15.119:0/1359670007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e6c118470 0x7f5e6c118850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0097f0 tx=0x7f5e5c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4646f7b5a146c9a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:47.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.043+0000 7f5e6a7fc640 1 -- 172.21.15.119:0/1359670007 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e5c035020 con 0x7f5e6c118470 2024-04-23T18:28:47.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.043+0000 7f5e6a7fc640 1 -- 172.21.15.119:0/1359670007 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e5c0317a0 con 0x7f5e6c118470 2024-04-23T18:28:47.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.043+0000 7f5e6a7fc640 1 -- 172.21.15.119:0/1359670007 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e5c031aa0 con 0x7f5e6c118470 2024-04-23T18:28:47.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.043+0000 7f5e71bb5640 1 -- 172.21.15.119:0/1359670007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e6c118470 msgr2=0x7f5e6c118850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:47.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.043+0000 7f5e71bb5640 1 --2- 172.21.15.119:0/1359670007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e6c118470 0x7f5e6c118850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0097f0 tx=0x7f5e5c02b910 comp rx=0 tx=0).stop 2024-04-23T18:28:47.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.043+0000 7f5e71bb5640 1 -- 172.21.15.119:0/1359670007 shutdown_connections 2024-04-23T18:28:47.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.043+0000 7f5e71bb5640 1 --2- 172.21.15.119:0/1359670007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e6c118470 0x7f5e6c118850 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:47.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.043+0000 7f5e71bb5640 1 -- 172.21.15.119:0/1359670007 >> 172.21.15.119:0/1359670007 conn(0x7f5e6c06e750 msgr2=0x7f5e6c06eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:47.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.043+0000 7f5e71bb5640 1 -- 172.21.15.119:0/1359670007 shutdown_connections 2024-04-23T18:28:47.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.043+0000 7f5e71bb5640 1 -- 172.21.15.119:0/1359670007 wait complete. 2024-04-23T18:28:47.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.044+0000 7f5e71bb5640 1 Processor -- start 2024-04-23T18:28:47.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.044+0000 7f5e71bb5640 1 -- start start 2024-04-23T18:28:47.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.044+0000 7f5e71bb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e6c112150 0x7f5e6c1a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:47.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.044+0000 7f5e71bb5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c11e5f0 con 0x7f5e6c112150 2024-04-23T18:28:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.044+0000 7f5e6b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e6c112150 0x7f5e6c1a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.045+0000 7f5e6b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e6c112150 0x7f5e6c1a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:40466/0 (socket says 172.21.15.119:40466) 2024-04-23T18:28:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.045+0000 7f5e6b7fe640 1 -- 172.21.15.119:0/4215152778 learned_addr learned my addr 172.21.15.119:0/4215152778 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:28:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.045+0000 7f5e6b7fe640 1 -- 172.21.15.119:0/4215152778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6c1a7370 con 0x7f5e6c112150 2024-04-23T18:28:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.045+0000 7f5e6b7fe640 1 --2- 172.21.15.119:0/4215152778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e6c112150 0x7f5e6c1a6e30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0097f0 tx=0x7f5e5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.045+0000 7f5e53fff640 1 -- 172.21.15.119:0/4215152778 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e5c03ad00 con 0x7f5e6c112150 2024-04-23T18:28:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.045+0000 7f5e53fff640 1 -- 172.21.15.119:0/4215152778 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e5c0443f0 con 0x7f5e6c112150 2024-04-23T18:28:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.045+0000 7f5e71bb5640 1 -- 172.21.15.119:0/4215152778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e6c1a7600 con 0x7f5e6c112150 2024-04-23T18:28:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.045+0000 7f5e53fff640 1 -- 172.21.15.119:0/4215152778 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e5c0446d0 con 0x7f5e6c112150 2024-04-23T18:28:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.045+0000 7f5e71bb5640 1 -- 172.21.15.119:0/4215152778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e6c1ab5b0 con 0x7f5e6c112150 2024-04-23T18:28:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.045+0000 7f5e53fff640 1 -- 172.21.15.119:0/4215152778 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5e5c04b060 con 0x7f5e6c112150 2024-04-23T18:28:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.045+0000 7f5e53fff640 1 -- 172.21.15.119:0/4215152778 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f5e5c04dcf0 con 0x7f5e6c112150 2024-04-23T18:28:47.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.046+0000 7f5e71bb5640 1 -- 172.21.15.119:0/4215152778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e6c0505b0 con 0x7f5e6c112150 2024-04-23T18:28:47.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.048+0000 7f5e53fff640 1 -- 172.21.15.119:0/4215152778 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5e5c03f070 con 0x7f5e6c112150 2024-04-23T18:28:47.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.120+0000 7f5e71bb5640 1 -- 172.21.15.119:0/4215152778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cebd6eb1-aa92-4110-8388-1bbcdc3915f3", "id": 1} v 0) -- 0x7f5e6c118470 con 0x7f5e6c112150 2024-04-23T18:28:47.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.121+0000 7f5e53fff640 1 -- 172.21.15.119:0/4215152778 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cebd6eb1-aa92-4110-8388-1bbcdc3915f3", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f5e5c04d450 con 0x7f5e6c112150 2024-04-23T18:28:47.114 INFO:teuthology.orchestra.run.smithi119.stdout:1 2024-04-23T18:28:47.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.123+0000 7f5e71bb5640 1 -- 172.21.15.119:0/4215152778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e6c112150 msgr2=0x7f5e6c1a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:47.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.123+0000 7f5e71bb5640 1 --2- 172.21.15.119:0/4215152778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e6c112150 0x7f5e6c1a6e30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c0097f0 tx=0x7f5e5c0046c0 comp rx=0 tx=0).stop 2024-04-23T18:28:47.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.123+0000 7f5e71bb5640 1 -- 172.21.15.119:0/4215152778 shutdown_connections 2024-04-23T18:28:47.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.123+0000 7f5e71bb5640 1 --2- 172.21.15.119:0/4215152778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e6c112150 0x7f5e6c1a6e30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:47.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.123+0000 7f5e71bb5640 1 -- 172.21.15.119:0/4215152778 >> 172.21.15.119:0/4215152778 conn(0x7f5e6c06e750 msgr2=0x7f5e6c1141d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:47.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.123+0000 7f5e71bb5640 1 -- 172.21.15.119:0/4215152778 shutdown_connections 2024-04-23T18:28:47.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.123+0000 7f5e71bb5640 1 -- 172.21.15.119:0/4215152778 wait complete. 2024-04-23T18:28:47.126 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 4970a460-2342-49bc-8c74-902633fa8a4e 2 2024-04-23T18:28:47.231 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:47.238+0000 7fd80e645040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T18:28:47.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.270+0000 7f68ae573640 1 Processor -- start 2024-04-23T18:28:47.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.271+0000 7f68ae573640 1 -- start start 2024-04-23T18:28:47.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.271+0000 7f68ae573640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68a8118470 0x7f68a8118850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:47.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.271+0000 7f68ae573640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a8118ee0 con 0x7f68a8112150 2024-04-23T18:28:47.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.271+0000 7f68ae573640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f68a8112d10 con 0x7f68a8118470 2024-04-23T18:28:47.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.271+0000 7f68a7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68a8118470 0x7f68a8118850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:47.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.271+0000 7f68a77fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f68a8112150 0x7f68a8112600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:37838/0 (socket says 172.21.15.119:37838) 2024-04-23T18:28:47.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.271+0000 7f68a77fe640 1 -- 172.21.15.119:0/3639304072 learned_addr learned my addr 172.21.15.119:0/3639304072 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:28:47.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.271+0000 7f68a7fff640 1 -- 172.21.15.119:0/3639304072 >> v1:172.21.15.62:6789/0 conn(0x7f68a8112150 legacy=0x7f68a8112600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:47.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.271+0000 7f68a7fff640 1 -- 172.21.15.119:0/3639304072 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a8112ec0 con 0x7f68a8118470 2024-04-23T18:28:47.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.272+0000 7f68a7fff640 1 --2- 172.21.15.119:0/3639304072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68a8118470 0x7f68a8118850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f689c009720 tx=0x7f689c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9edec73fec98808 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:47.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.272+0000 7f68a6ffd640 1 -- 172.21.15.119:0/3639304072 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689c0316d0 con 0x7f68a8118470 2024-04-23T18:28:47.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.272+0000 7f68a6ffd640 1 -- 172.21.15.119:0/3639304072 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689c037070 con 0x7f68a8118470 2024-04-23T18:28:47.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.272+0000 7f68a6ffd640 1 -- 172.21.15.119:0/3639304072 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689c0319c0 con 0x7f68a8118470 2024-04-23T18:28:47.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.273+0000 7f68ae573640 1 -- 172.21.15.119:0/3639304072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68a8118470 msgr2=0x7f68a8118850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:47.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.273+0000 7f68ae573640 1 --2- 172.21.15.119:0/3639304072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68a8118470 0x7f68a8118850 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f689c009720 tx=0x7f689c02b840 comp rx=0 tx=0).stop 2024-04-23T18:28:47.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.273+0000 7f68ae573640 1 -- 172.21.15.119:0/3639304072 shutdown_connections 2024-04-23T18:28:47.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.273+0000 7f68ae573640 1 --2- 172.21.15.119:0/3639304072 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68a8118470 0x7f68a8118850 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:47.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.273+0000 7f68ae573640 1 -- 172.21.15.119:0/3639304072 >> 172.21.15.119:0/3639304072 conn(0x7f68a806e750 msgr2=0x7f68a806eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:47.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.273+0000 7f68ae573640 1 -- 172.21.15.119:0/3639304072 shutdown_connections 2024-04-23T18:28:47.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.273+0000 7f68ae573640 1 -- 172.21.15.119:0/3639304072 wait complete. 2024-04-23T18:28:47.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.274+0000 7f68ae573640 1 Processor -- start 2024-04-23T18:28:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.274+0000 7f68ae573640 1 -- start start 2024-04-23T18:28:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.274+0000 7f68ae573640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68a8112150 0x7f68a81a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.274+0000 7f68ae573640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f68a811e5f0 con 0x7f68a8112150 2024-04-23T18:28:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.274+0000 7f68a7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68a8112150 0x7f68a81a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.274+0000 7f68a7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68a8112150 0x7f68a81a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:40480/0 (socket says 172.21.15.119:40480) 2024-04-23T18:28:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.274+0000 7f68a7fff640 1 -- 172.21.15.119:0/3436014967 learned_addr learned my addr 172.21.15.119:0/3436014967 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:28:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.275+0000 7f68a7fff640 1 -- 172.21.15.119:0/3436014967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a81a7370 con 0x7f68a8112150 2024-04-23T18:28:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.275+0000 7f68a7fff640 1 --2- 172.21.15.119:0/3436014967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68a8112150 0x7f68a81a6e30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f689c009720 tx=0x7f689c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.275+0000 7f68a4ff9640 1 -- 172.21.15.119:0/3436014967 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689c032770 con 0x7f68a8112150 2024-04-23T18:28:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.275+0000 7f68a4ff9640 1 -- 172.21.15.119:0/3436014967 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689c032910 con 0x7f68a8112150 2024-04-23T18:28:47.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.275+0000 7f68ae573640 1 -- 172.21.15.119:0/3436014967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a81a7600 con 0x7f68a8112150 2024-04-23T18:28:47.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.275+0000 7f68a4ff9640 1 -- 172.21.15.119:0/3436014967 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689c032bf0 con 0x7f68a8112150 2024-04-23T18:28:47.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.275+0000 7f68ae573640 1 -- 172.21.15.119:0/3436014967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a81ab5b0 con 0x7f68a8112150 2024-04-23T18:28:47.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.275+0000 7f68a4ff9640 1 -- 172.21.15.119:0/3436014967 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f689c04c060 con 0x7f68a8112150 2024-04-23T18:28:47.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.275+0000 7f68a4ff9640 1 -- 172.21.15.119:0/3436014967 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f689c02f050 con 0x7f68a8112150 2024-04-23T18:28:47.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.276+0000 7f68ae573640 1 -- 172.21.15.119:0/3436014967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a80505b0 con 0x7f68a8112150 2024-04-23T18:28:47.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.278+0000 7f68a4ff9640 1 -- 172.21.15.119:0/3436014967 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f689c040070 con 0x7f68a8112150 2024-04-23T18:28:47.279 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:47.287+0000 7fd80e645040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T18:28:47.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.351+0000 7f68ae573640 1 -- 172.21.15.119:0/3436014967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4970a460-2342-49bc-8c74-902633fa8a4e", "id": 2} v 0) -- 0x7f68a8118470 con 0x7f68a8112150 2024-04-23T18:28:47.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.352+0000 7f68a4ff9640 1 -- 172.21.15.119:0/3436014967 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4970a460-2342-49bc-8c74-902633fa8a4e", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f689c045530 con 0x7f68a8112150 2024-04-23T18:28:47.344 INFO:teuthology.orchestra.run.smithi119.stdout:2 2024-04-23T18:28:47.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.353+0000 7f68ae573640 1 -- 172.21.15.119:0/3436014967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68a8112150 msgr2=0x7f68a81a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:47.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.353+0000 7f68ae573640 1 --2- 172.21.15.119:0/3436014967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68a8112150 0x7f68a81a6e30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f689c009720 tx=0x7f689c0046c0 comp rx=0 tx=0).stop 2024-04-23T18:28:47.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.353+0000 7f68ae573640 1 -- 172.21.15.119:0/3436014967 shutdown_connections 2024-04-23T18:28:47.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.353+0000 7f68ae573640 1 --2- 172.21.15.119:0/3436014967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68a8112150 0x7f68a81a6e30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:47.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.353+0000 7f68ae573640 1 -- 172.21.15.119:0/3436014967 >> 172.21.15.119:0/3436014967 conn(0x7f68a806e750 msgr2=0x7f68a81141d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:47.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.353+0000 7f68ae573640 1 -- 172.21.15.119:0/3436014967 shutdown_connections 2024-04-23T18:28:47.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.353+0000 7f68ae573640 1 -- 172.21.15.119:0/3436014967 wait complete. 2024-04-23T18:28:47.356 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new eae08f42-0b0e-4a3c-8720-34a38fbd5de0 3 2024-04-23T18:28:47.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.458+0000 7f3d27421640 1 Processor -- start 2024-04-23T18:28:47.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.458+0000 7f3d27421640 1 -- start start 2024-04-23T18:28:47.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.459+0000 7f3d27421640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3d2006d6c0 0x7f3d2006daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:47.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.459+0000 7f3d27421640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d2011da90 con 0x7f3d2006dfe0 2024-04-23T18:28:47.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.459+0000 7f3d27421640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f3d2011ec90 con 0x7f3d2006d6c0 2024-04-23T18:28:47.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.459+0000 7f3d251bd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3d2006d6c0 0x7f3d2006daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:47.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.459+0000 7f3d249bc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3d2006dfe0 0x7f3d2011c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:37846/0 (socket says 172.21.15.119:37846) 2024-04-23T18:28:47.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.459+0000 7f3d249bc640 1 -- 172.21.15.119:0/2763232905 learned_addr learned my addr 172.21.15.119:0/2763232905 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:28:47.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.459+0000 7f3d251bd640 1 -- 172.21.15.119:0/2763232905 >> v1:172.21.15.62:6789/0 conn(0x7f3d2006dfe0 legacy=0x7f3d2011c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:47.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.459+0000 7f3d251bd640 1 -- 172.21.15.119:0/2763232905 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2011ee40 con 0x7f3d2006d6c0 2024-04-23T18:28:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.460+0000 7f3d251bd640 1 --2- 172.21.15.119:0/2763232905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d2006d6c0 0x7f3d2006daa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009720 tx=0x7f3d1002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed89ce802e9dd6b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.460+0000 7f3d17fff640 1 -- 172.21.15.119:0/2763232905 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d100316d0 con 0x7f3d2006d6c0 2024-04-23T18:28:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.460+0000 7f3d17fff640 1 -- 172.21.15.119:0/2763232905 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d10037070 con 0x7f3d2006d6c0 2024-04-23T18:28:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.460+0000 7f3d17fff640 1 -- 172.21.15.119:0/2763232905 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d100319c0 con 0x7f3d2006d6c0 2024-04-23T18:28:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.461+0000 7f3d27421640 1 -- 172.21.15.119:0/2763232905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d2006d6c0 msgr2=0x7f3d2006daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.461+0000 7f3d27421640 1 --2- 172.21.15.119:0/2763232905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d2006d6c0 0x7f3d2006daa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009720 tx=0x7f3d1002b840 comp rx=0 tx=0).stop 2024-04-23T18:28:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.461+0000 7f3d27421640 1 -- 172.21.15.119:0/2763232905 shutdown_connections 2024-04-23T18:28:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.461+0000 7f3d27421640 1 --2- 172.21.15.119:0/2763232905 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d2006d6c0 0x7f3d2006daa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.461+0000 7f3d27421640 1 -- 172.21.15.119:0/2763232905 >> 172.21.15.119:0/2763232905 conn(0x7f3d20071080 msgr2=0x7f3d200734a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.461+0000 7f3d27421640 1 -- 172.21.15.119:0/2763232905 shutdown_connections 2024-04-23T18:28:47.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.461+0000 7f3d27421640 1 -- 172.21.15.119:0/2763232905 wait complete. 2024-04-23T18:28:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.462+0000 7f3d27421640 1 Processor -- start 2024-04-23T18:28:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.462+0000 7f3d27421640 1 -- start start 2024-04-23T18:28:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.462+0000 7f3d27421640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d2006d6c0 0x7f3d201acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.462+0000 7f3d27421640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2011e180 con 0x7f3d2006d6c0 2024-04-23T18:28:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.462+0000 7f3d251bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d2006d6c0 0x7f3d201acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.462+0000 7f3d251bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d2006d6c0 0x7f3d201acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:40494/0 (socket says 172.21.15.119:40494) 2024-04-23T18:28:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.462+0000 7f3d251bd640 1 -- 172.21.15.119:0/318606706 learned_addr learned my addr 172.21.15.119:0/318606706 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:28:47.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.462+0000 7f3d251bd640 1 -- 172.21.15.119:0/318606706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d201ad0f0 con 0x7f3d2006d6c0 2024-04-23T18:28:47.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.463+0000 7f3d251bd640 1 --2- 172.21.15.119:0/318606706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d2006d6c0 0x7f3d201acb20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3d10034040 tx=0x7f3d100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:47.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.463+0000 7f3d15ffb640 1 -- 172.21.15.119:0/318606706 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d10032770 con 0x7f3d2006d6c0 2024-04-23T18:28:47.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.463+0000 7f3d15ffb640 1 -- 172.21.15.119:0/318606706 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d10032910 con 0x7f3d2006d6c0 2024-04-23T18:28:47.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.463+0000 7f3d27421640 1 -- 172.21.15.119:0/318606706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d201ad320 con 0x7f3d2006d6c0 2024-04-23T18:28:47.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.463+0000 7f3d15ffb640 1 -- 172.21.15.119:0/318606706 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d10032c30 con 0x7f3d2006d6c0 2024-04-23T18:28:47.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.463+0000 7f3d27421640 1 -- 172.21.15.119:0/318606706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d201a6c30 con 0x7f3d2006d6c0 2024-04-23T18:28:47.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.464+0000 7f3d15ffb640 1 -- 172.21.15.119:0/318606706 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3d1004c060 con 0x7f3d2006d6c0 2024-04-23T18:28:47.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.464+0000 7f3d27421640 1 -- 172.21.15.119:0/318606706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d200505b0 con 0x7f3d2006d6c0 2024-04-23T18:28:47.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.464+0000 7f3d15ffb640 1 -- 172.21.15.119:0/318606706 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f3d1002f050 con 0x7f3d2006d6c0 2024-04-23T18:28:47.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.470+0000 7f3d15ffb640 1 -- 172.21.15.119:0/318606706 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3d10064e50 con 0x7f3d2006d6c0 2024-04-23T18:28:47.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.542+0000 7f3d27421640 1 -- 172.21.15.119:0/318606706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eae08f42-0b0e-4a3c-8720-34a38fbd5de0", "id": 3} v 0) -- 0x7f3d2006dfe0 con 0x7f3d2006d6c0 2024-04-23T18:28:47.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.545+0000 7f3d15ffb640 1 -- 172.21.15.119:0/318606706 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eae08f42-0b0e-4a3c-8720-34a38fbd5de0", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f3d10053030 con 0x7f3d2006d6c0 2024-04-23T18:28:47.538 INFO:teuthology.orchestra.run.smithi119.stdout:3 2024-04-23T18:28:47.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.546+0000 7f3d27421640 1 -- 172.21.15.119:0/318606706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d2006d6c0 msgr2=0x7f3d201acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:47.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.546+0000 7f3d27421640 1 --2- 172.21.15.119:0/318606706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d2006d6c0 0x7f3d201acb20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3d10034040 tx=0x7f3d100046c0 comp rx=0 tx=0).stop 2024-04-23T18:28:47.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.546+0000 7f3d27421640 1 -- 172.21.15.119:0/318606706 shutdown_connections 2024-04-23T18:28:47.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.546+0000 7f3d27421640 1 --2- 172.21.15.119:0/318606706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d2006d6c0 0x7f3d201acb20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:47.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.546+0000 7f3d27421640 1 -- 172.21.15.119:0/318606706 >> 172.21.15.119:0/318606706 conn(0x7f3d20071080 msgr2=0x7f3d20116420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:47.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.546+0000 7f3d27421640 1 -- 172.21.15.119:0/318606706 shutdown_connections 2024-04-23T18:28:47.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:28:47.546+0000 7f3d27421640 1 -- 172.21.15.119:0/318606706 wait complete. 2024-04-23T18:28:47.549 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-23T18:28:47.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-23T18:28:47.552 INFO:tasks.ceph.osd.0:Started 2024-04-23T18:28:47.552 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-23T18:28:47.552 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-23T18:28:47.554 INFO:tasks.ceph.osd.1:Started 2024-04-23T18:28:47.555 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-23T18:28:47.555 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-23T18:28:47.557 INFO:tasks.ceph.osd.2:Started 2024-04-23T18:28:47.557 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-23T18:28:47.557 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-23T18:28:47.559 INFO:tasks.ceph.osd.3:Started 2024-04-23T18:28:47.559 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:28:47.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.678+0000 7fb24a7c7640 1 Processor -- start 2024-04-23T18:28:47.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.678+0000 7fb24a7c7640 1 -- start start 2024-04-23T18:28:47.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.679+0000 7fb24a7c7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb244131ce0 0x7fb2441340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:47.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.679+0000 7fb24a7c7640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb244095de0 con 0x7fb24412ee30 2024-04-23T18:28:47.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.679+0000 7fb24a7c7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb24412ea70 con 0x7fb244131ce0 2024-04-23T18:28:47.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.679+0000 7fb2437fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb244131ce0 0x7fb2441340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:47.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.679+0000 7fb243fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb24412ee30 0x7fb24412f210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:43174/0 (socket says 172.21.15.62:43174) 2024-04-23T18:28:47.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.679+0000 7fb2437fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb244131ce0 0x7fb2441340d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42318/0 (socket says 172.21.15.62:42318) 2024-04-23T18:28:47.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.679+0000 7fb243fff640 1 -- 172.21.15.62:0/2030498374 learned_addr learned my addr 172.21.15.62:0/2030498374 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:28:47.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.679+0000 7fb2437fe640 1 -- 172.21.15.62:0/2030498374 >> v1:172.21.15.62:6789/0 conn(0x7fb24412ee30 legacy=0x7fb24412f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:47.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.679+0000 7fb2437fe640 1 -- 172.21.15.62:0/2030498374 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb244072e80 con 0x7fb244131ce0 2024-04-23T18:28:47.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.680+0000 7fb2437fe640 1 --2- 172.21.15.62:0/2030498374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb244131ce0 0x7fb2441340d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009720 tx=0x7fb22c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56f504008414d82 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:47.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.680+0000 7fb242ffd640 1 -- 172.21.15.62:0/2030498374 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb22c0316d0 con 0x7fb244131ce0 2024-04-23T18:28:47.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.680+0000 7fb242ffd640 1 -- 172.21.15.62:0/2030498374 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22c037070 con 0x7fb244131ce0 2024-04-23T18:28:47.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.680+0000 7fb242ffd640 1 -- 172.21.15.62:0/2030498374 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb22c0319c0 con 0x7fb244131ce0 2024-04-23T18:28:47.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.680+0000 7fb24a7c7640 1 -- 172.21.15.62:0/2030498374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb244131ce0 msgr2=0x7fb2441340d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.680+0000 7fb24a7c7640 1 --2- 172.21.15.62:0/2030498374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb244131ce0 0x7fb2441340d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009720 tx=0x7fb22c02b840 comp rx=0 tx=0).stop 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.681+0000 7fb24a7c7640 1 -- 172.21.15.62:0/2030498374 shutdown_connections 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.681+0000 7fb24a7c7640 1 --2- 172.21.15.62:0/2030498374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb244131ce0 0x7fb2441340d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.681+0000 7fb24a7c7640 1 -- 172.21.15.62:0/2030498374 >> 172.21.15.62:0/2030498374 conn(0x7fb24409e110 msgr2=0x7fb24409e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.681+0000 7fb24a7c7640 1 -- 172.21.15.62:0/2030498374 shutdown_connections 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.681+0000 7fb24a7c7640 1 -- 172.21.15.62:0/2030498374 wait complete. 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.681+0000 7fb24a7c7640 1 Processor -- start 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.682+0000 7fb24a7c7640 1 -- start start 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.682+0000 7fb24a7c7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb24412ee30 0x7fb2441c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.682+0000 7fb24a7c7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb244095930 con 0x7fb24412ee30 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.682+0000 7fb243fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb24412ee30 0x7fb2441c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.682+0000 7fb243fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb24412ee30 0x7fb2441c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42328/0 (socket says 172.21.15.62:42328) 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.682+0000 7fb243fff640 1 -- 172.21.15.62:0/1270344899 learned_addr learned my addr 172.21.15.62:0/1270344899 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.682+0000 7fb243fff640 1 -- 172.21.15.62:0/1270344899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb244128320 con 0x7fb24412ee30 2024-04-23T18:28:47.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.683+0000 7fb243fff640 1 --2- 172.21.15.62:0/1270344899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb24412ee30 0x7fb2441c34c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c4a0 tx=0x7fb23400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:47.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.683+0000 7fb240ff9640 1 -- 172.21.15.62:0/1270344899 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb234017070 con 0x7fb24412ee30 2024-04-23T18:28:47.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.683+0000 7fb240ff9640 1 -- 172.21.15.62:0/1270344899 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb234005c10 con 0x7fb24412ee30 2024-04-23T18:28:47.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.683+0000 7fb240ff9640 1 -- 172.21.15.62:0/1270344899 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb234007070 con 0x7fb24412ee30 2024-04-23T18:28:47.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.683+0000 7fb24a7c7640 1 -- 172.21.15.62:0/1270344899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb244125690 con 0x7fb24412ee30 2024-04-23T18:28:47.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.683+0000 7fb24a7c7640 1 -- 172.21.15.62:0/1270344899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb244128760 con 0x7fb24412ee30 2024-04-23T18:28:47.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.683+0000 7fb240ff9640 1 -- 172.21.15.62:0/1270344899 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb23401a070 con 0x7fb24412ee30 2024-04-23T18:28:47.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.683+0000 7fb240ff9640 1 -- 172.21.15.62:0/1270344899 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb23401cb50 con 0x7fb24412ee30 2024-04-23T18:28:47.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.684+0000 7fb24a7c7640 1 -- 172.21.15.62:0/1270344899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2440505b0 con 0x7fb24412ee30 2024-04-23T18:28:47.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.686+0000 7fb240ff9640 1 -- 172.21.15.62:0/1270344899 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb244128320 con 0x7fb24412ee30 2024-04-23T18:28:47.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.748+0000 7fb24a7c7640 1 -- 172.21.15.62:0/1270344899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb244127c70 con 0x7fb24412ee30 2024-04-23T18:28:47.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.748+0000 7fb240ff9640 1 -- 172.21.15.62:0/1270344899 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fb23401c440 con 0x7fb24412ee30 2024-04-23T18:28:47.742 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:28:47.742 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":6,"fsid":"7bde1cd1-e3f4-4fcb-8bbb-8f7edde199b6","created":"2024-04-23T18:28:46.460262+0000","modified":"2024-04-23T18:28:47.543459+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T18:28:47.543459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"09209063-cd8c-480c-aee7-4c548f693d01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cebd6eb1-aa92-4110-8388-1bbcdc3915f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4970a460-2342-49bc-8c74-902633fa8a4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"eae08f42-0b0e-4a3c-8720-34a38fbd5de0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:28:47.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.749+0000 7fb24a7c7640 1 -- 172.21.15.62:0/1270344899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb24412ee30 msgr2=0x7fb2441c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:47.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.749+0000 7fb24a7c7640 1 --2- 172.21.15.62:0/1270344899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb24412ee30 0x7fb2441c34c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c4a0 tx=0x7fb23400c960 comp rx=0 tx=0).stop 2024-04-23T18:28:47.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.749+0000 7fb24a7c7640 1 -- 172.21.15.62:0/1270344899 shutdown_connections 2024-04-23T18:28:47.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.749+0000 7fb24a7c7640 1 --2- 172.21.15.62:0/1270344899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb24412ee30 0x7fb2441c34c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:47.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.749+0000 7fb24a7c7640 1 -- 172.21.15.62:0/1270344899 >> 172.21.15.62:0/1270344899 conn(0x7fb24409e110 msgr2=0x7fb244098680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:47.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.749+0000 7fb24a7c7640 1 -- 172.21.15.62:0/1270344899 shutdown_connections 2024-04-23T18:28:47.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:28:47.749+0000 7fb24a7c7640 1 -- 172.21.15.62:0/1270344899 wait complete. 2024-04-23T18:28:47.753 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-23T18:28:47.753 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-23T18:28:48.002 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:48.010+0000 7fd80e645040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T18:28:48.088 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:48.096+0000 7fd80e645040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T18:28:48.131 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:48.138+0000 7fd80e645040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T18:28:48.149 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-04-23T18:28:48.156+0000 7f6cae40e640 -1 Falling back to public interface 2024-04-23T18:28:48.151 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-23T18:28:48.158+0000 7f47f432d640 -1 Falling back to public interface 2024-04-23T18:28:48.156 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T18:28:48.160 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-04-23T18:28:48.167+0000 7f8575ca6640 -1 Falling back to public interface 2024-04-23T18:28:48.160 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-04-23T18:28:48.167+0000 7f31a2e13640 -1 Falling back to public interface 2024-04-23T18:28:48.253 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.259+0000 7fcf43bed640 1 Processor -- start 2024-04-23T18:28:48.253 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.260+0000 7fcf43bed640 1 -- start start 2024-04-23T18:28:48.253 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.260+0000 7fcf43bed640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf3c06d4a0 0x7fcf3c06d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:48.253 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.260+0000 7fcf43bed640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf3c09e220 con 0x7fcf3c06ddc0 2024-04-23T18:28:48.253 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.260+0000 7fcf43bed640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fcf3c098a90 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.255 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.260+0000 7fcf41989640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf3c06d4a0 0x7fcf3c06d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:48.255 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.260+0000 7fcf41188640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcf3c06ddc0 0x7fcf3c12eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:43184/0 (socket says 172.21.15.62:43184) 2024-04-23T18:28:48.255 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.260+0000 7fcf41188640 1 -- 172.21.15.62:0/1609768644 learned_addr learned my addr 172.21.15.62:0/1609768644 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:28:48.255 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.260+0000 7fcf41989640 1 -- 172.21.15.62:0/1609768644 >> v1:172.21.15.62:6789/0 conn(0x7fcf3c06ddc0 legacy=0x7fcf3c12eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:48.255 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.260+0000 7fcf41989640 1 -- 172.21.15.62:0/1609768644 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3c098d30 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.255 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.261+0000 7fcf41989640 1 --2- 172.21.15.62:0/1609768644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf3c06d4a0 0x7fcf3c06d880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009720 tx=0x7fcf3802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b6352761e0fc1b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:48.255 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.261+0000 7fcf40987640 1 -- 172.21.15.62:0/1609768644 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf380316d0 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.255 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.261+0000 7fcf40987640 1 -- 172.21.15.62:0/1609768644 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf38037070 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.255 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.261+0000 7fcf40987640 1 -- 172.21.15.62:0/1609768644 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf380319c0 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.256 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.262+0000 7fcf43bed640 1 -- 172.21.15.62:0/1609768644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf3c06d4a0 msgr2=0x7fcf3c06d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:48.256 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.262+0000 7fcf43bed640 1 --2- 172.21.15.62:0/1609768644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf3c06d4a0 0x7fcf3c06d880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009720 tx=0x7fcf3802b840 comp rx=0 tx=0).stop 2024-04-23T18:28:48.256 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.262+0000 7fcf43bed640 1 -- 172.21.15.62:0/1609768644 shutdown_connections 2024-04-23T18:28:48.256 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.262+0000 7fcf43bed640 1 --2- 172.21.15.62:0/1609768644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf3c06d4a0 0x7fcf3c06d880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:48.256 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.262+0000 7fcf43bed640 1 -- 172.21.15.62:0/1609768644 >> 172.21.15.62:0/1609768644 conn(0x7fcf3c0a13d0 msgr2=0x7fcf3c09d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:48.256 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.262+0000 7fcf43bed640 1 -- 172.21.15.62:0/1609768644 shutdown_connections 2024-04-23T18:28:48.256 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.262+0000 7fcf43bed640 1 -- 172.21.15.62:0/1609768644 wait complete. 2024-04-23T18:28:48.258 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.263+0000 7fcf43bed640 1 Processor -- start 2024-04-23T18:28:48.258 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.263+0000 7fcf43bed640 1 -- start start 2024-04-23T18:28:48.258 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.263+0000 7fcf43bed640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf3c06d4a0 0x7fcf3c1c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:48.258 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.263+0000 7fcf43bed640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3c0984b0 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.258 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.263+0000 7fcf41989640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf3c06d4a0 0x7fcf3c1c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:48.258 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.263+0000 7fcf41989640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf3c06d4a0 0x7fcf3c1c34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42350/0 (socket says 172.21.15.62:42350) 2024-04-23T18:28:48.259 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.263+0000 7fcf41989640 1 -- 172.21.15.62:0/806272333 learned_addr learned my addr 172.21.15.62:0/806272333 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:28:48.259 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.264+0000 7fcf41989640 1 -- 172.21.15.62:0/806272333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3c12ecd0 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.259 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.264+0000 7fcf41989640 1 --2- 172.21.15.62:0/806272333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf3c06d4a0 0x7fcf3c1c34f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcf38034040 tx=0x7fcf380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:48.259 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.264+0000 7fcf327fc640 1 -- 172.21.15.62:0/806272333 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf38032770 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.259 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.264+0000 7fcf327fc640 1 -- 172.21.15.62:0/806272333 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf38032910 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.259 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.264+0000 7fcf43bed640 1 -- 172.21.15.62:0/806272333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf3c12ca70 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.259 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.264+0000 7fcf327fc640 1 -- 172.21.15.62:0/806272333 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf38032c30 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.259 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.264+0000 7fcf43bed640 1 -- 172.21.15.62:0/806272333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf3c12d350 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.259 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.264+0000 7fcf327fc640 1 -- 172.21.15.62:0/806272333 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcf3804c060 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.260 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.264+0000 7fcf327fc640 1 -- 172.21.15.62:0/806272333 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fcf3802f050 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.260 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.265+0000 7fcf43bed640 1 -- 172.21.15.62:0/806272333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf3c12c320 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.260 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.267+0000 7fcf327fc640 1 -- 172.21.15.62:0/806272333 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fcf38040070 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.296 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:48.304+0000 7fd80e645040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T18:28:48.321 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.329+0000 7fcf43bed640 1 -- 172.21.15.62:0/806272333 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf3c063630 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.322 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.329+0000 7fcf327fc640 1 -- 172.21.15.62:0/806272333 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fcf38052090 con 0x7fcf3c06d4a0 2024-04-23T18:28:48.322 INFO:teuthology.misc.health.smithi062.stdout: 2024-04-23T18:28:48.323 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":6,"fsid":"7bde1cd1-e3f4-4fcb-8bbb-8f7edde199b6","created":"2024-04-23T18:28:46.460262+0000","modified":"2024-04-23T18:28:47.543459+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T18:28:47.543459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"09209063-cd8c-480c-aee7-4c548f693d01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cebd6eb1-aa92-4110-8388-1bbcdc3915f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4970a460-2342-49bc-8c74-902633fa8a4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"eae08f42-0b0e-4a3c-8720-34a38fbd5de0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:28:48.323 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.330+0000 7fcf43bed640 1 -- 172.21.15.62:0/806272333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf3c06d4a0 msgr2=0x7fcf3c1c34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:48.323 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.330+0000 7fcf43bed640 1 --2- 172.21.15.62:0/806272333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf3c06d4a0 0x7fcf3c1c34f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcf38034040 tx=0x7fcf380046c0 comp rx=0 tx=0).stop 2024-04-23T18:28:48.323 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.330+0000 7fcf43bed640 1 -- 172.21.15.62:0/806272333 shutdown_connections 2024-04-23T18:28:48.323 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.330+0000 7fcf43bed640 1 --2- 172.21.15.62:0/806272333 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf3c06d4a0 0x7fcf3c1c34f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:48.324 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.330+0000 7fcf43bed640 1 -- 172.21.15.62:0/806272333 >> 172.21.15.62:0/806272333 conn(0x7fcf3c0a13d0 msgr2=0x7fcf3c099ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:48.324 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.330+0000 7fcf43bed640 1 -- 172.21.15.62:0/806272333 shutdown_connections 2024-04-23T18:28:48.324 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:48.330+0000 7fcf43bed640 1 -- 172.21.15.62:0/806272333 wait complete. 2024-04-23T18:28:48.332 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-23T18:28:48.343 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:48.350+0000 7fd80e645040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T18:28:48.394 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:48.401+0000 7fd80e645040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T18:28:48.507 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:48.514+0000 7fd80e645040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T18:28:48.879 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:48.887+0000 7fd80e645040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T18:28:49.134 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:49.141+0000 7fd80e645040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T18:28:49.185 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:49.192+0000 7fd80e645040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T18:28:49.301 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:49.309+0000 7fd80e645040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T18:28:49.576 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:49.584+0000 7fd80e645040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T18:28:49.623 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:49.631+0000 7fd80e645040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T18:28:49.776 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:49.784+0000 7fd80e645040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T18:28:49.912 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:49.919+0000 7fd80e645040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T18:28:49.961 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:49.968+0000 7fd80e645040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T18:28:50.029 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:50.036+0000 7fd80e645040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T18:28:50.073 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:50.081+0000 7fd80e645040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T18:28:50.549 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:50.556+0000 7fd80e645040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T18:28:50.664 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:50.671+0000 7fd80e645040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T18:28:51.579 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-04-23T18:28:51.586+0000 7f6cae40e640 -1 osd.0 0 log_to_monitors true 2024-04-23T18:28:51.672 INFO:tasks.ceph.mgr.x.smithi119.stderr:2024-04-23T18:28:51.680+0000 7fd7af2fc640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-23T18:28:51.729 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-23T18:28:51.736+0000 7f47f432d640 -1 osd.2 0 log_to_monitors true 2024-04-23T18:28:51.729 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-04-23T18:28:51.736+0000 7f8575ca6640 -1 osd.1 0 log_to_monitors true 2024-04-23T18:28:51.734 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-04-23T18:28:51.741+0000 7f31a2e13640 -1 osd.3 0 log_to_monitors true 2024-04-23T18:28:53.665 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-04-23T18:28:53.673+0000 7f6ca9e51640 -1 osd.0 0 waiting for initial osdmap 2024-04-23T18:28:53.676 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-04-23T18:28:53.683+0000 7f6ca1c71640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T18:28:54.736 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T18:28:54.838 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.845+0000 7f8120bb6640 1 Processor -- start 2024-04-23T18:28:54.839 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.845+0000 7f8120bb6640 1 -- start start 2024-04-23T18:28:54.840 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.846+0000 7f8120bb6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f811c06e890 0x7f811c131c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:54.840 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.846+0000 7f8120bb6640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f811c072110 con 0x7f811c06d7c0 2024-04-23T18:28:54.841 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.846+0000 7f8120bb6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f811c074700 con 0x7f811c06e890 2024-04-23T18:28:54.841 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.846+0000 7f8119d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f811c06e890 0x7f811c131c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:54.841 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.846+0000 7f811a59c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f811c06d7c0 0x7f811c06dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57976/0 (socket says 172.21.15.62:57976) 2024-04-23T18:28:54.841 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.846+0000 7f811a59c640 1 -- 172.21.15.62:0/2235579332 learned_addr learned my addr 172.21.15.62:0/2235579332 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:28:54.841 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.846+0000 7f8119d9b640 1 -- 172.21.15.62:0/2235579332 >> v1:172.21.15.62:6789/0 conn(0x7f811c06d7c0 legacy=0x7f811c06dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:54.841 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.846+0000 7f8119d9b640 1 -- 172.21.15.62:0/2235579332 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c0723d0 con 0x7f811c06e890 2024-04-23T18:28:54.841 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.846+0000 7f811959a640 1 -- 172.21.15.62:0/2235579332 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1696788240 0 0) 0x7f811c072110 con 0x7f811c06d7c0 2024-04-23T18:28:54.841 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.847+0000 7f8119d9b640 1 --2- 172.21.15.62:0/2235579332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c06e890 0x7f811c131c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8110009720 tx=0x7f811002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aac01743a786cc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:54.841 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.847+0000 7f811959a640 1 -- 172.21.15.62:0/2235579332 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81100316d0 con 0x7f811c06e890 2024-04-23T18:28:54.841 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.847+0000 7f811959a640 1 -- 172.21.15.62:0/2235579332 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8110037070 con 0x7f811c06e890 2024-04-23T18:28:54.841 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.847+0000 7f811959a640 1 -- 172.21.15.62:0/2235579332 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81100319c0 con 0x7f811c06e890 2024-04-23T18:28:54.844 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.848+0000 7f8120bb6640 1 -- 172.21.15.62:0/2235579332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c06e890 msgr2=0x7f811c131c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:54.844 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.848+0000 7f8120bb6640 1 --2- 172.21.15.62:0/2235579332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c06e890 0x7f811c131c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8110009720 tx=0x7f811002b840 comp rx=0 tx=0).stop 2024-04-23T18:28:54.845 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.848+0000 7f8120bb6640 1 -- 172.21.15.62:0/2235579332 shutdown_connections 2024-04-23T18:28:54.845 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.848+0000 7f8120bb6640 1 --2- 172.21.15.62:0/2235579332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c06e890 0x7f811c131c10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:54.845 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.848+0000 7f8120bb6640 1 -- 172.21.15.62:0/2235579332 >> 172.21.15.62:0/2235579332 conn(0x7f811c09a970 msgr2=0x7f811c09ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:54.845 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.848+0000 7f8120bb6640 1 -- 172.21.15.62:0/2235579332 shutdown_connections 2024-04-23T18:28:54.845 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.848+0000 7f8120bb6640 1 -- 172.21.15.62:0/2235579332 wait complete. 2024-04-23T18:28:54.845 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.849+0000 7f8120bb6640 1 Processor -- start 2024-04-23T18:28:54.845 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.849+0000 7f8120bb6640 1 -- start start 2024-04-23T18:28:54.845 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.850+0000 7f8120bb6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c06d7c0 0x7f811c130460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:54.845 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.850+0000 7f8120bb6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f811c132150 con 0x7f811c06d7c0 2024-04-23T18:28:54.845 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.850+0000 7f811a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c06d7c0 0x7f811c130460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:54.845 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.850+0000 7f811a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c06d7c0 0x7f811c130460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45128/0 (socket says 172.21.15.62:45128) 2024-04-23T18:28:54.845 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.850+0000 7f811a59c640 1 -- 172.21.15.62:0/2489319894 learned_addr learned my addr 172.21.15.62:0/2489319894 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:28:54.846 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.850+0000 7f811a59c640 1 -- 172.21.15.62:0/2489319894 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c093660 con 0x7f811c06d7c0 2024-04-23T18:28:54.846 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.850+0000 7f811a59c640 1 --2- 172.21.15.62:0/2489319894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c06d7c0 0x7f811c130460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f810c00c420 tx=0x7f810c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:54.846 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.850+0000 7f810affd640 1 -- 172.21.15.62:0/2489319894 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f810c018070 con 0x7f811c06d7c0 2024-04-23T18:28:54.846 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.850+0000 7f810affd640 1 -- 172.21.15.62:0/2489319894 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f810c0074d0 con 0x7f811c06d7c0 2024-04-23T18:28:54.846 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.850+0000 7f810affd640 1 -- 172.21.15.62:0/2489319894 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f810c004950 con 0x7f811c06d7c0 2024-04-23T18:28:54.846 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.850+0000 7f8120bb6640 1 -- 172.21.15.62:0/2489319894 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811c095be0 con 0x7f811c06d7c0 2024-04-23T18:28:54.846 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.850+0000 7f8120bb6640 1 -- 172.21.15.62:0/2489319894 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811c093b90 con 0x7f811c06d7c0 2024-04-23T18:28:54.846 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.851+0000 7f810affd640 1 -- 172.21.15.62:0/2489319894 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (secure 0 0 0) 0x7f810c01b070 con 0x7f811c06d7c0 2024-04-23T18:28:54.846 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.851+0000 7f810affd640 1 --2- 172.21.15.62:0/2489319894 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f80fc038530 0x7f80fc03a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:28:54.846 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.851+0000 7f8120bb6640 1 -- 172.21.15.62:0/2489319894 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f811c0708a0 con 0x7f811c06d7c0 2024-04-23T18:28:54.846 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.851+0000 7f810affd640 1 -- 172.21.15.62:0/2489319894 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1903+0+0 (secure 0 0 0) 0x7f810c04a1f0 con 0x7f811c06d7c0 2024-04-23T18:28:54.846 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.852+0000 7f8119d9b640 1 --2- 172.21.15.62:0/2489319894 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f80fc038530 0x7f80fc03a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:28:54.847 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.852+0000 7f8119d9b640 1 --2- 172.21.15.62:0/2489319894 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f80fc038530 0x7f80fc03a9f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8110036000 tx=0x7f8110008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:28:54.849 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:54.856+0000 7f810affd640 1 -- 172.21.15.62:0/2489319894 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f810c011980 con 0x7f811c06d7c0 2024-04-23T18:28:55.035 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:55.042+0000 7f8120bb6640 1 -- 172.21.15.62:0/2489319894 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f811c073670 con 0x7f811c06d7c0 2024-04-23T18:28:55.035 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:55.042+0000 7f810affd640 1 -- 172.21.15.62:0/2489319894 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+4673 (secure 0 0 0) 0x7f810c023260 con 0x7f811c06d7c0 2024-04-23T18:28:55.036 INFO:teuthology.misc.health.smithi062.stdout: 2024-04-23T18:28:55.036 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"7bde1cd1-e3f4-4fcb-8bbb-8f7edde199b6","created":"2024-04-23T18:28:46.460262+0000","modified":"2024-04-23T18:28:54.737679+0000","last_up_change":"2024-04-23T18:28:53.733768+0000","last_in_change":"2024-04-23T18:28:47.543459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"09209063-cd8c-480c-aee7-4c548f693d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6801","nonce":2641588406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6803","nonce":2641588406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6807","nonce":2641588406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6805","nonce":2641588406}]},"public_addr":"172.21.15.62:6801/2641588406","cluster_addr":"172.21.15.62:6803/2641588406","heartbeat_back_addr":"172.21.15.62:6807/2641588406","heartbeat_front_addr":"172.21.15.62:6805/2641588406","state":["exists","up"]},{"osd":1,"uuid":"cebd6eb1-aa92-4110-8388-1bbcdc3915f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4970a460-2342-49bc-8c74-902633fa8a4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"eae08f42-0b0e-4a3c-8720-34a38fbd5de0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.607829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:28:55.038 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:55.044+0000 7f8120bb6640 1 -- 172.21.15.62:0/2489319894 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f80fc038530 msgr2=0x7f80fc03a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:55.038 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:55.044+0000 7f8120bb6640 1 --2- 172.21.15.62:0/2489319894 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f80fc038530 0x7f80fc03a9f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8110036000 tx=0x7f8110008030 comp rx=0 tx=0).stop 2024-04-23T18:28:55.038 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:55.044+0000 7f8120bb6640 1 -- 172.21.15.62:0/2489319894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c06d7c0 msgr2=0x7f811c130460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:28:55.038 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:55.044+0000 7f8120bb6640 1 --2- 172.21.15.62:0/2489319894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c06d7c0 0x7f811c130460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f810c00c420 tx=0x7f810c00c8e0 comp rx=0 tx=0).stop 2024-04-23T18:28:55.038 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:55.045+0000 7f8120bb6640 1 -- 172.21.15.62:0/2489319894 shutdown_connections 2024-04-23T18:28:55.038 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:55.045+0000 7f8120bb6640 1 --2- 172.21.15.62:0/2489319894 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f80fc038530 0x7f80fc03a9f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:55.038 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:55.045+0000 7f8120bb6640 1 --2- 172.21.15.62:0/2489319894 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f811c06d7c0 0x7f811c130460 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:28:55.039 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:55.045+0000 7f8120bb6640 1 -- 172.21.15.62:0/2489319894 >> 172.21.15.62:0/2489319894 conn(0x7f811c09a970 msgr2=0x7f811c130e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:28:55.039 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:55.045+0000 7f8120bb6640 1 -- 172.21.15.62:0/2489319894 shutdown_connections 2024-04-23T18:28:55.039 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:28:55.045+0000 7f8120bb6640 1 -- 172.21.15.62:0/2489319894 wait complete. 2024-04-23T18:28:55.047 DEBUG:teuthology.misc:1 of 4 OSDs are up 2024-04-23T18:28:55.395 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-23T18:28:55.402+0000 7f47f02c3640 -1 osd.2 0 waiting for initial osdmap 2024-04-23T18:28:55.400 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-04-23T18:28:55.407+0000 7f8571c3c640 -1 osd.1 0 waiting for initial osdmap 2024-04-23T18:28:55.404 INFO:tasks.ceph.osd.2.smithi119.stderr:2024-04-23T18:28:55.412+0000 7f47e80e3640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T18:28:55.412 INFO:tasks.ceph.osd.1.smithi119.stderr:2024-04-23T18:28:55.420+0000 7f8569a5c640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T18:28:55.426 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-04-23T18:28:55.434+0000 7f319e7ff640 -1 osd.3 0 waiting for initial osdmap 2024-04-23T18:28:55.444 INFO:tasks.ceph.osd.3.smithi119.stderr:2024-04-23T18:28:55.452+0000 7f319661f640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T18:29:01.450 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T18:29:01.555 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.561+0000 7f34752ba640 1 Processor -- start 2024-04-23T18:29:01.555 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.561+0000 7f34752ba640 1 -- start start 2024-04-23T18:29:01.555 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.562+0000 7f34752ba640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f347012ed50 0x7f347012f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:01.555 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.562+0000 7f34752ba640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f347009e220 con 0x7f347012f670 2024-04-23T18:29:01.555 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.562+0000 7f34752ba640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f347012e990 con 0x7f347012ed50 2024-04-23T18:29:01.556 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.562+0000 7f346effd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f347012ed50 0x7f347012f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:01.556 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.562+0000 7f346e7fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f347012f670 0x7f347006d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39612/0 (socket says 172.21.15.62:39612) 2024-04-23T18:29:01.556 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.562+0000 7f346e7fc640 1 -- 172.21.15.62:0/1910748818 learned_addr learned my addr 172.21.15.62:0/1910748818 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:01.556 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.562+0000 7f346effd640 1 -- 172.21.15.62:0/1910748818 >> v1:172.21.15.62:6789/0 conn(0x7f347012f670 legacy=0x7f347006d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:01.556 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.562+0000 7f346effd640 1 -- 172.21.15.62:0/1910748818 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347006e560 con 0x7f347012ed50 2024-04-23T18:29:01.556 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.562+0000 7f346dffb640 1 -- 172.21.15.62:0/1910748818 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199197571 0 0) 0x7f347009e220 con 0x7f347012f670 2024-04-23T18:29:01.557 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.563+0000 7f346effd640 1 --2- 172.21.15.62:0/1910748818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f347012ed50 0x7f347012f130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3460009720 tx=0x7f346002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b96ea36d3911a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:01.557 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.563+0000 7f346dffb640 1 -- 172.21.15.62:0/1910748818 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34600316d0 con 0x7f347012ed50 2024-04-23T18:29:01.557 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.563+0000 7f346dffb640 1 -- 172.21.15.62:0/1910748818 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3460037070 con 0x7f347012ed50 2024-04-23T18:29:01.557 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.563+0000 7f346dffb640 1 -- 172.21.15.62:0/1910748818 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34600319c0 con 0x7f347012ed50 2024-04-23T18:29:01.557 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.564+0000 7f34752ba640 1 -- 172.21.15.62:0/1910748818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f347012ed50 msgr2=0x7f347012f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:01.558 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.564+0000 7f34752ba640 1 --2- 172.21.15.62:0/1910748818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f347012ed50 0x7f347012f130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3460009720 tx=0x7f346002b840 comp rx=0 tx=0).stop 2024-04-23T18:29:01.558 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.564+0000 7f34752ba640 1 -- 172.21.15.62:0/1910748818 shutdown_connections 2024-04-23T18:29:01.558 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.564+0000 7f34752ba640 1 --2- 172.21.15.62:0/1910748818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f347012ed50 0x7f347012f130 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:01.558 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.564+0000 7f34752ba640 1 -- 172.21.15.62:0/1910748818 >> 172.21.15.62:0/1910748818 conn(0x7f34700a13d0 msgr2=0x7f347009d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:01.558 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.564+0000 7f34752ba640 1 -- 172.21.15.62:0/1910748818 shutdown_connections 2024-04-23T18:29:01.558 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.564+0000 7f34752ba640 1 -- 172.21.15.62:0/1910748818 wait complete. 2024-04-23T18:29:01.560 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.565+0000 7f34752ba640 1 Processor -- start 2024-04-23T18:29:01.560 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.565+0000 7f34752ba640 1 -- start start 2024-04-23T18:29:01.560 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.565+0000 7f34752ba640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f347012ed50 0x7f34701c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:01.560 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.565+0000 7f34752ba640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3470098490 con 0x7f347012ed50 2024-04-23T18:29:01.560 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.565+0000 7f346effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f347012ed50 0x7f34701c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:01.560 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.565+0000 7f346effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f347012ed50 0x7f34701c39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57592/0 (socket says 172.21.15.62:57592) 2024-04-23T18:29:01.561 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.565+0000 7f346effd640 1 -- 172.21.15.62:0/3704488694 learned_addr learned my addr 172.21.15.62:0/3704488694 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:01.561 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.566+0000 7f346effd640 1 -- 172.21.15.62:0/3704488694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347012a720 con 0x7f347012ed50 2024-04-23T18:29:01.561 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.566+0000 7f346effd640 1 --2- 172.21.15.62:0/3704488694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f347012ed50 0x7f34701c39f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3460009840 tx=0x7f34600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:01.561 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.566+0000 7f34577fe640 1 -- 172.21.15.62:0/3704488694 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3460032770 con 0x7f347012ed50 2024-04-23T18:29:01.561 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.566+0000 7f34577fe640 1 -- 172.21.15.62:0/3704488694 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3460032910 con 0x7f347012ed50 2024-04-23T18:29:01.561 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.566+0000 7f34752ba640 1 -- 172.21.15.62:0/3704488694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347012c2f0 con 0x7f347012ed50 2024-04-23T18:29:01.561 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.566+0000 7f34577fe640 1 -- 172.21.15.62:0/3704488694 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3460032c10 con 0x7f347012ed50 2024-04-23T18:29:01.561 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.566+0000 7f34752ba640 1 -- 172.21.15.62:0/3704488694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347008b4f0 con 0x7f347012ed50 2024-04-23T18:29:01.561 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.567+0000 7f34577fe640 1 -- 172.21.15.62:0/3704488694 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f346004c060 con 0x7f347012ed50 2024-04-23T18:29:01.561 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.567+0000 7f34577fe640 1 --2- 172.21.15.62:0/3704488694 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f345c0385c0 0x7f345c03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:01.561 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.567+0000 7f34577fe640 1 -- 172.21.15.62:0/3704488694 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f346002f050 con 0x7f347012ed50 2024-04-23T18:29:01.561 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.567+0000 7f34752ba640 1 -- 172.21.15.62:0/3704488694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3470063630 con 0x7f347012ed50 2024-04-23T18:29:01.561 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.567+0000 7f346e7fc640 1 --2- 172.21.15.62:0/3704488694 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f345c0385c0 0x7f345c03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:01.562 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.568+0000 7f346e7fc640 1 --2- 172.21.15.62:0/3704488694 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f345c0385c0 0x7f345c03aa80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3464000c00 tx=0x7f3464007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:01.565 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.572+0000 7f34577fe640 1 -- 172.21.15.62:0/3704488694 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3460040070 con 0x7f347012ed50 2024-04-23T18:29:01.750 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.757+0000 7f34752ba640 1 -- 172.21.15.62:0/3704488694 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3470099a30 con 0x7f347012ed50 2024-04-23T18:29:01.751 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.758+0000 7f34577fe640 1 -- 172.21.15.62:0/3704488694 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7990 (secure 0 0 0) 0x7f3460039310 con 0x7f347012ed50 2024-04-23T18:29:01.751 INFO:teuthology.misc.health.smithi062.stdout: 2024-04-23T18:29:01.751 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":14,"fsid":"7bde1cd1-e3f4-4fcb-8bbb-8f7edde199b6","created":"2024-04-23T18:28:46.460262+0000","modified":"2024-04-23T18:28:59.416069+0000","last_up_change":"2024-04-23T18:28:56.409542+0000","last_in_change":"2024-04-23T18:28:47.543459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:28:56.697816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"09209063-cd8c-480c-aee7-4c548f693d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6801","nonce":2641588406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6803","nonce":2641588406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6807","nonce":2641588406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6805","nonce":2641588406}]},"public_addr":"172.21.15.62:6801/2641588406","cluster_addr":"172.21.15.62:6803/2641588406","heartbeat_back_addr":"172.21.15.62:6807/2641588406","heartbeat_front_addr":"172.21.15.62:6805/2641588406","state":["exists","up"]},{"osd":1,"uuid":"cebd6eb1-aa92-4110-8388-1bbcdc3915f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6810","nonce":2736386629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6814","nonce":2736386629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6822","nonce":2736386629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6818","nonce":2736386629}]},"public_addr":"172.21.15.119:6810/2736386629","cluster_addr":"172.21.15.119:6814/2736386629","heartbeat_back_addr":"172.21.15.119:6822/2736386629","heartbeat_front_addr":"172.21.15.119:6818/2736386629","state":["exists","up"]},{"osd":2,"uuid":"4970a460-2342-49bc-8c74-902633fa8a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6801","nonce":2624052101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6803","nonce":2624052101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6807","nonce":2624052101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6805","nonce":2624052101}]},"public_addr":"172.21.15.119:6801/2624052101","cluster_addr":"172.21.15.119:6803/2624052101","heartbeat_back_addr":"172.21.15.119:6807/2624052101","heartbeat_front_addr":"172.21.15.119:6805/2624052101","state":["exists","up"]},{"osd":3,"uuid":"eae08f42-0b0e-4a3c-8720-34a38fbd5de0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6809","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6811","nonce":3910610681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6813","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6815","nonce":3910610681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6823","nonce":3910610681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6819","nonce":3910610681}]},"public_addr":"172.21.15.119:6811/3910610681","cluster_addr":"172.21.15.119:6815/3910610681","heartbeat_back_addr":"172.21.15.119:6823/3910610681","heartbeat_front_addr":"172.21.15.119:6819/3910610681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.607829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.773992+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.768859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.775730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:29:01.753 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.760+0000 7f34752ba640 1 -- 172.21.15.62:0/3704488694 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f345c0385c0 msgr2=0x7f345c03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:01.753 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.760+0000 7f34752ba640 1 --2- 172.21.15.62:0/3704488694 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f345c0385c0 0x7f345c03aa80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3464000c00 tx=0x7f3464007970 comp rx=0 tx=0).stop 2024-04-23T18:29:01.754 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.760+0000 7f34752ba640 1 -- 172.21.15.62:0/3704488694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f347012ed50 msgr2=0x7f34701c39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:01.754 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.760+0000 7f34752ba640 1 --2- 172.21.15.62:0/3704488694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f347012ed50 0x7f34701c39f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3460009840 tx=0x7f34600046c0 comp rx=0 tx=0).stop 2024-04-23T18:29:01.754 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.760+0000 7f34752ba640 1 -- 172.21.15.62:0/3704488694 shutdown_connections 2024-04-23T18:29:01.754 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.760+0000 7f34752ba640 1 --2- 172.21.15.62:0/3704488694 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f345c0385c0 0x7f345c03aa80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:01.754 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.760+0000 7f34752ba640 1 --2- 172.21.15.62:0/3704488694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f347012ed50 0x7f34701c39f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:01.754 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.760+0000 7f34752ba640 1 -- 172.21.15.62:0/3704488694 >> 172.21.15.62:0/3704488694 conn(0x7f34700a13d0 msgr2=0x7f347009c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:01.754 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.760+0000 7f34752ba640 1 -- 172.21.15.62:0/3704488694 shutdown_connections 2024-04-23T18:29:01.754 INFO:teuthology.misc.health.smithi062.stderr:2024-04-23T18:29:01.760+0000 7f34752ba640 1 -- 172.21.15.62:0/3704488694 wait complete. 2024-04-23T18:29:01.763 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-23T18:29:01.763 INFO:tasks.ceph:Creating RBD pool 2024-04-23T18:29:01.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-23T18:29:01.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.871+0000 7f6fba080640 1 Processor -- start 2024-04-23T18:29:01.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.871+0000 7f6fba080640 1 -- start start 2024-04-23T18:29:01.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.871+0000 7f6fba080640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6fb4093380 0x7f6fb4093760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:01.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.871+0000 7f6fba080640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb4098f60 con 0x7f6fb412c6f0 2024-04-23T18:29:01.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.871+0000 7f6fba080640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f6fb4096730 con 0x7f6fb4093380 2024-04-23T18:29:01.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.871+0000 7f6fb37fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6fb4093380 0x7f6fb4093760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:01.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.871+0000 7f6fb2ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6fb412c6f0 0x7f6fb412cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39616/0 (socket says 172.21.15.62:39616) 2024-04-23T18:29:01.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.871+0000 7f6fb2ffd640 1 -- 172.21.15.62:0/1345955736 learned_addr learned my addr 172.21.15.62:0/1345955736 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:01.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.871+0000 7f6fb37fe640 1 -- 172.21.15.62:0/1345955736 >> v1:172.21.15.62:6789/0 conn(0x7f6fb412c6f0 legacy=0x7f6fb412cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:01.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.871+0000 7f6fb27fc640 1 -- 172.21.15.62:0/1345955736 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92195440 0 0) 0x7f6fb4098f60 con 0x7f6fb412c6f0 2024-04-23T18:29:01.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.871+0000 7f6fb37fe640 1 -- 172.21.15.62:0/1345955736 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb4096d30 con 0x7f6fb4093380 2024-04-23T18:29:01.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.872+0000 7f6fb37fe640 1 --2- 172.21.15.62:0/1345955736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb4093380 0x7f6fb4093760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009720 tx=0x7f6fa402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2acad66a2a5d786 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:01.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.872+0000 7f6fb27fc640 1 -- 172.21.15.62:0/1345955736 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fa40316d0 con 0x7f6fb4093380 2024-04-23T18:29:01.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.872+0000 7f6fb27fc640 1 -- 172.21.15.62:0/1345955736 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa4037070 con 0x7f6fb4093380 2024-04-23T18:29:01.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.872+0000 7f6fb27fc640 1 -- 172.21.15.62:0/1345955736 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fa40319c0 con 0x7f6fb4093380 2024-04-23T18:29:01.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.873+0000 7f6fba080640 1 -- 172.21.15.62:0/1345955736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb4093380 msgr2=0x7f6fb4093760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:01.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.873+0000 7f6fba080640 1 --2- 172.21.15.62:0/1345955736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb4093380 0x7f6fb4093760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009720 tx=0x7f6fa402b840 comp rx=0 tx=0).stop 2024-04-23T18:29:01.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.873+0000 7f6fba080640 1 -- 172.21.15.62:0/1345955736 shutdown_connections 2024-04-23T18:29:01.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.873+0000 7f6fba080640 1 --2- 172.21.15.62:0/1345955736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb4093380 0x7f6fb4093760 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:01.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.873+0000 7f6fba080640 1 -- 172.21.15.62:0/1345955736 >> 172.21.15.62:0/1345955736 conn(0x7f6fb4099d00 msgr2=0x7f6fb40975d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:01.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.873+0000 7f6fba080640 1 -- 172.21.15.62:0/1345955736 shutdown_connections 2024-04-23T18:29:01.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.873+0000 7f6fba080640 1 -- 172.21.15.62:0/1345955736 wait complete. 2024-04-23T18:29:01.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.874+0000 7f6fba080640 1 Processor -- start 2024-04-23T18:29:01.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.874+0000 7f6fba080640 1 -- start start 2024-04-23T18:29:01.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.874+0000 7f6fba080640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb4093380 0x7f6fb406d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.874+0000 7f6fba080640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb4093e20 con 0x7f6fb4093380 2024-04-23T18:29:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.874+0000 7f6fb37fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb4093380 0x7f6fb406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.874+0000 7f6fb37fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb4093380 0x7f6fb406d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57610/0 (socket says 172.21.15.62:57610) 2024-04-23T18:29:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.875+0000 7f6fb37fe640 1 -- 172.21.15.62:0/1680419863 learned_addr learned my addr 172.21.15.62:0/1680419863 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.875+0000 7f6fb37fe640 1 -- 172.21.15.62:0/1680419863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb406e650 con 0x7f6fb4093380 2024-04-23T18:29:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.875+0000 7f6fb37fe640 1 --2- 172.21.15.62:0/1680419863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb4093380 0x7f6fb406d590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6fa402b880 tx=0x7f6fa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.875+0000 7f6f9bfff640 1 -- 172.21.15.62:0/1680419863 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fa4004030 con 0x7f6fb4093380 2024-04-23T18:29:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.875+0000 7f6f9bfff640 1 -- 172.21.15.62:0/1680419863 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa40041d0 con 0x7f6fb4093380 2024-04-23T18:29:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.875+0000 7f6f9bfff640 1 -- 172.21.15.62:0/1680419863 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fa4032640 con 0x7f6fb4093380 2024-04-23T18:29:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.875+0000 7f6fba080640 1 -- 172.21.15.62:0/1680419863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb409af00 con 0x7f6fb4093380 2024-04-23T18:29:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.875+0000 7f6fba080640 1 -- 172.21.15.62:0/1680419863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb406ecb0 con 0x7f6fb4093380 2024-04-23T18:29:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.876+0000 7f6f9bfff640 1 -- 172.21.15.62:0/1680419863 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6fa40327e0 con 0x7f6fb4093380 2024-04-23T18:29:01.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.876+0000 7f6fba080640 1 -- 172.21.15.62:0/1680419863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb4071340 con 0x7f6fb4093380 2024-04-23T18:29:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.876+0000 7f6f9bfff640 1 --2- 172.21.15.62:0/1680419863 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fa00385c0 0x7f6fa003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.876+0000 7f6f9bfff640 1 -- 172.21.15.62:0/1680419863 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f6fa402f050 con 0x7f6fb4093380 2024-04-23T18:29:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.877+0000 7f6fb2ffd640 1 --2- 172.21.15.62:0/1680419863 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fa00385c0 0x7f6fa003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.877+0000 7f6fb2ffd640 1 --2- 172.21.15.62:0/1680419863 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fa00385c0 0x7f6fa003aa80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8000c00 tx=0x7f6fa8007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:01.881+0000 7f6f9bfff640 1 -- 172.21.15.62:0/1680419863 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6fa4041070 con 0x7f6fb4093380 2024-04-23T18:29:02.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.071+0000 7f6fba080640 1 -- 172.21.15.62:0/1680419863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f6fb40505b0 con 0x7f6fb4093380 2024-04-23T18:29:02.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.435+0000 7f6f9bfff640 1 -- 172.21.15.62:0/1680419863 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7f6fa404e3a0 con 0x7f6fb4093380 2024-04-23T18:29:02.429 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'rbd' created 2024-04-23T18:29:02.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.438+0000 7f6fba080640 1 -- 172.21.15.62:0/1680419863 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fa00385c0 msgr2=0x7f6fa003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:02.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.438+0000 7f6fba080640 1 --2- 172.21.15.62:0/1680419863 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fa00385c0 0x7f6fa003aa80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8000c00 tx=0x7f6fa8007970 comp rx=0 tx=0).stop 2024-04-23T18:29:02.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.438+0000 7f6fba080640 1 -- 172.21.15.62:0/1680419863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb4093380 msgr2=0x7f6fb406d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:02.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.438+0000 7f6fba080640 1 --2- 172.21.15.62:0/1680419863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb4093380 0x7f6fb406d590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6fa402b880 tx=0x7f6fa40046c0 comp rx=0 tx=0).stop 2024-04-23T18:29:02.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.438+0000 7f6fba080640 1 -- 172.21.15.62:0/1680419863 shutdown_connections 2024-04-23T18:29:02.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.438+0000 7f6fba080640 1 --2- 172.21.15.62:0/1680419863 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fa00385c0 0x7f6fa003aa80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:02.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.438+0000 7f6fba080640 1 --2- 172.21.15.62:0/1680419863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb4093380 0x7f6fb406d590 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:02.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.438+0000 7f6fba080640 1 -- 172.21.15.62:0/1680419863 >> 172.21.15.62:0/1680419863 conn(0x7f6fb4099d00 msgr2=0x7f6fb41b48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:02.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.438+0000 7f6fba080640 1 -- 172.21.15.62:0/1680419863 shutdown_connections 2024-04-23T18:29:02.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.438+0000 7f6fba080640 1 -- 172.21.15.62:0/1680419863 wait complete. 2024-04-23T18:29:02.443 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-23T18:29:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.554+0000 7efca2ee2640 1 Processor -- start 2024-04-23T18:29:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.554+0000 7efca2ee2640 1 -- start start 2024-04-23T18:29:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.555+0000 7efca2ee2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efc9c06def0 0x7efc9c134330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.555+0000 7efca2ee2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc9c098510 con 0x7efc9c06d400 2024-04-23T18:29:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.555+0000 7efca2ee2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7efc9c0734d0 con 0x7efc9c06def0 2024-04-23T18:29:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.555+0000 7efc9bfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efc9c06def0 0x7efc9c134330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.555+0000 7efca0c7e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efc9c06d400 0x7efc9c06d7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39624/0 (socket says 172.21.15.62:39624) 2024-04-23T18:29:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.555+0000 7efca0c7e640 1 -- 172.21.15.62:0/2622484457 learned_addr learned my addr 172.21.15.62:0/2622484457 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:02.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.555+0000 7efc9bfff640 1 -- 172.21.15.62:0/2622484457 >> v1:172.21.15.62:6789/0 conn(0x7efc9c06d400 legacy=0x7efc9c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:02.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.555+0000 7efc9bfff640 1 -- 172.21.15.62:0/2622484457 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c09e210 con 0x7efc9c06def0 2024-04-23T18:29:02.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.555+0000 7efc9b7fe640 1 -- 172.21.15.62:0/2622484457 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 656008494 0 0) 0x7efc9c098510 con 0x7efc9c06d400 2024-04-23T18:29:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.556+0000 7efc9bfff640 1 --2- 172.21.15.62:0/2622484457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c06def0 0x7efc9c134330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc90009720 tx=0x7efc9002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce60bbad280d6d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.556+0000 7efc9b7fe640 1 -- 172.21.15.62:0/2622484457 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc90035020 con 0x7efc9c06def0 2024-04-23T18:29:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.556+0000 7efc9b7fe640 1 -- 172.21.15.62:0/2622484457 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc90031760 con 0x7efc9c06def0 2024-04-23T18:29:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.556+0000 7efc9b7fe640 1 -- 172.21.15.62:0/2622484457 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc90031a60 con 0x7efc9c06def0 2024-04-23T18:29:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.557+0000 7efca2ee2640 1 -- 172.21.15.62:0/2622484457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c06def0 msgr2=0x7efc9c134330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.557+0000 7efca2ee2640 1 --2- 172.21.15.62:0/2622484457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c06def0 0x7efc9c134330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc90009720 tx=0x7efc9002b8d0 comp rx=0 tx=0).stop 2024-04-23T18:29:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.557+0000 7efca2ee2640 1 -- 172.21.15.62:0/2622484457 shutdown_connections 2024-04-23T18:29:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.557+0000 7efca2ee2640 1 --2- 172.21.15.62:0/2622484457 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c06def0 0x7efc9c134330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:02.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.557+0000 7efca2ee2640 1 -- 172.21.15.62:0/2622484457 >> 172.21.15.62:0/2622484457 conn(0x7efc9c0a13c0 msgr2=0x7efc9c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.557+0000 7efca2ee2640 1 -- 172.21.15.62:0/2622484457 shutdown_connections 2024-04-23T18:29:02.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.557+0000 7efca2ee2640 1 -- 172.21.15.62:0/2622484457 wait complete. 2024-04-23T18:29:02.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.557+0000 7efca2ee2640 1 Processor -- start 2024-04-23T18:29:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.558+0000 7efca2ee2640 1 -- start start 2024-04-23T18:29:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.558+0000 7efca2ee2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c06d400 0x7efc9c132dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.558+0000 7efca2ee2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c1349f0 con 0x7efc9c06d400 2024-04-23T18:29:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.558+0000 7efca0c7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c06d400 0x7efc9c132dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.558+0000 7efca0c7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c06d400 0x7efc9c132dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57618/0 (socket says 172.21.15.62:57618) 2024-04-23T18:29:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.558+0000 7efca0c7e640 1 -- 172.21.15.62:0/1656339580 learned_addr learned my addr 172.21.15.62:0/1656339580 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.558+0000 7efca0c7e640 1 -- 172.21.15.62:0/1656339580 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c134690 con 0x7efc9c06d400 2024-04-23T18:29:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.559+0000 7efca0c7e640 1 --2- 172.21.15.62:0/1656339580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c06d400 0x7efc9c132dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc9400c840 tx=0x7efc9400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.559+0000 7efc997fa640 1 -- 172.21.15.62:0/1656339580 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc94018070 con 0x7efc9c06d400 2024-04-23T18:29:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.559+0000 7efc997fa640 1 -- 172.21.15.62:0/1656339580 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc9400a660 con 0x7efc9c06d400 2024-04-23T18:29:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.559+0000 7efca2ee2640 1 -- 172.21.15.62:0/1656339580 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9c095d30 con 0x7efc9c06d400 2024-04-23T18:29:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.559+0000 7efc997fa640 1 -- 172.21.15.62:0/1656339580 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc9400a980 con 0x7efc9c06d400 2024-04-23T18:29:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.559+0000 7efca2ee2640 1 -- 172.21.15.62:0/1656339580 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc9c0969a0 con 0x7efc9c06d400 2024-04-23T18:29:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.560+0000 7efc997fa640 1 -- 172.21.15.62:0/1656339580 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7efc9401b070 con 0x7efc9c06d400 2024-04-23T18:29:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.560+0000 7efc997fa640 1 --2- 172.21.15.62:0/1656339580 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc88038570 0x7efc8803aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.560+0000 7efc997fa640 1 -- 172.21.15.62:0/1656339580 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3471+0+0 (secure 0 0 0) 0x7efc9404ad10 con 0x7efc9c06d400 2024-04-23T18:29:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.560+0000 7efca2ee2640 1 -- 172.21.15.62:0/1656339580 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc9c0505b0 con 0x7efc9c06d400 2024-04-23T18:29:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.560+0000 7efc9bfff640 1 --2- 172.21.15.62:0/1656339580 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc88038570 0x7efc8803aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.561+0000 7efc9bfff640 1 --2- 172.21.15.62:0/1656339580 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc88038570 0x7efc8803aa30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efc90009720 tx=0x7efc90008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.566+0000 7efc997fa640 1 -- 172.21.15.62:0/1656339580 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efc9c134690 con 0x7efc9c06d400 2024-04-23T18:29:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:02.752+0000 7efca2ee2640 1 -- 172.21.15.62:0/1656339580 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7efc9c125e50 con 0x7efc9c06d400 2024-04-23T18:29:03.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.439+0000 7efc997fa640 1 -- 172.21.15.62:0/1656339580 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 173+0+0 (secure 0 0 0) 0x7efc94011360 con 0x7efc9c06d400 2024-04-23T18:29:03.431 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-23T18:29:03.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.442+0000 7efca2ee2640 1 -- 172.21.15.62:0/1656339580 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc88038570 msgr2=0x7efc8803aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:03.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.442+0000 7efca2ee2640 1 --2- 172.21.15.62:0/1656339580 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc88038570 0x7efc8803aa30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efc90009720 tx=0x7efc90008030 comp rx=0 tx=0).stop 2024-04-23T18:29:03.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.442+0000 7efca2ee2640 1 -- 172.21.15.62:0/1656339580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c06d400 msgr2=0x7efc9c132dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:03.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.442+0000 7efca2ee2640 1 --2- 172.21.15.62:0/1656339580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c06d400 0x7efc9c132dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc9400c840 tx=0x7efc9400cd00 comp rx=0 tx=0).stop 2024-04-23T18:29:03.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.442+0000 7efca2ee2640 1 -- 172.21.15.62:0/1656339580 shutdown_connections 2024-04-23T18:29:03.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.442+0000 7efca2ee2640 1 --2- 172.21.15.62:0/1656339580 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc88038570 0x7efc8803aa30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:03.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.442+0000 7efca2ee2640 1 --2- 172.21.15.62:0/1656339580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc9c06d400 0x7efc9c132dc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:03.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.442+0000 7efca2ee2640 1 -- 172.21.15.62:0/1656339580 >> 172.21.15.62:0/1656339580 conn(0x7efc9c0a13c0 msgr2=0x7efc9c08cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:03.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.442+0000 7efca2ee2640 1 -- 172.21.15.62:0/1656339580 shutdown_connections 2024-04-23T18:29:03.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.442+0000 7efca2ee2640 1 -- 172.21.15.62:0/1656339580 wait complete. 2024-04-23T18:29:03.448 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-23T18:29:03.448 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-23T18:29:03.448 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-23T18:29:03.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-23T18:29:03.449 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-23T18:29:03.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.562+0000 7fb99d9e6640 1 Processor -- start 2024-04-23T18:29:03.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.562+0000 7fb99d9e6640 1 -- start start 2024-04-23T18:29:03.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.563+0000 7fb99d9e6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb99812ee30 0x7fb99812f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:03.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.563+0000 7fb99d9e6640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb998095de0 con 0x7fb99806b980 2024-04-23T18:29:03.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.563+0000 7fb99d9e6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb99812ea70 con 0x7fb99812ee30 2024-04-23T18:29:03.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.563+0000 7fb996ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb99812ee30 0x7fb99812f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:03.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.563+0000 7fb9967fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb99806b980 0x7fb99806bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39636/0 (socket says 172.21.15.62:39636) 2024-04-23T18:29:03.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.563+0000 7fb9967fc640 1 -- 172.21.15.62:0/398020109 learned_addr learned my addr 172.21.15.62:0/398020109 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:03.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.563+0000 7fb996ffd640 1 -- 172.21.15.62:0/398020109 >> v1:172.21.15.62:6789/0 conn(0x7fb99806b980 legacy=0x7fb99806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:03.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.563+0000 7fb996ffd640 1 -- 172.21.15.62:0/398020109 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb998072e80 con 0x7fb99812ee30 2024-04-23T18:29:03.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.564+0000 7fb996ffd640 1 --2- 172.21.15.62:0/398020109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb99812ee30 0x7fb99812f210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb990009720 tx=0x7fb99002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3555c3204dd0198 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:03.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.564+0000 7fb995ffb640 1 -- 172.21.15.62:0/398020109 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9900316d0 con 0x7fb99812ee30 2024-04-23T18:29:03.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.564+0000 7fb995ffb640 1 -- 172.21.15.62:0/398020109 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb990037070 con 0x7fb99812ee30 2024-04-23T18:29:03.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.564+0000 7fb995ffb640 1 -- 172.21.15.62:0/398020109 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9900319c0 con 0x7fb99812ee30 2024-04-23T18:29:03.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.565+0000 7fb99d9e6640 1 -- 172.21.15.62:0/398020109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb99812ee30 msgr2=0x7fb99812f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:03.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.565+0000 7fb99d9e6640 1 --2- 172.21.15.62:0/398020109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb99812ee30 0x7fb99812f210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb990009720 tx=0x7fb99002b840 comp rx=0 tx=0).stop 2024-04-23T18:29:03.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.565+0000 7fb99d9e6640 1 -- 172.21.15.62:0/398020109 shutdown_connections 2024-04-23T18:29:03.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.565+0000 7fb99d9e6640 1 --2- 172.21.15.62:0/398020109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb99812ee30 0x7fb99812f210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:03.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.565+0000 7fb99d9e6640 1 -- 172.21.15.62:0/398020109 >> 172.21.15.62:0/398020109 conn(0x7fb99809e110 msgr2=0x7fb99809e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:03.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.565+0000 7fb99d9e6640 1 -- 172.21.15.62:0/398020109 shutdown_connections 2024-04-23T18:29:03.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.565+0000 7fb99d9e6640 1 -- 172.21.15.62:0/398020109 wait complete. 2024-04-23T18:29:03.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.566+0000 7fb99d9e6640 1 Processor -- start 2024-04-23T18:29:03.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.566+0000 7fb99d9e6640 1 -- start start 2024-04-23T18:29:03.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.566+0000 7fb99d9e6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb99806b980 0x7fb9981267a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:03.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.566+0000 7fb99d9e6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb99812f8d0 con 0x7fb99806b980 2024-04-23T18:29:03.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.566+0000 7fb996ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb99806b980 0x7fb9981267a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:03.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.566+0000 7fb996ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb99806b980 0x7fb9981267a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57624/0 (socket says 172.21.15.62:57624) 2024-04-23T18:29:03.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.566+0000 7fb996ffd640 1 -- 172.21.15.62:0/2555154657 learned_addr learned my addr 172.21.15.62:0/2555154657 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:03.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.567+0000 7fb996ffd640 1 -- 172.21.15.62:0/2555154657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb998128a70 con 0x7fb99806b980 2024-04-23T18:29:03.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.567+0000 7fb996ffd640 1 --2- 172.21.15.62:0/2555154657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb99806b980 0x7fb9981267a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb990034040 tx=0x7fb9900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:03.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.567+0000 7fb97ffff640 1 -- 172.21.15.62:0/2555154657 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb990032770 con 0x7fb99806b980 2024-04-23T18:29:03.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.567+0000 7fb97ffff640 1 -- 172.21.15.62:0/2555154657 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb990032910 con 0x7fb99806b980 2024-04-23T18:29:03.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.567+0000 7fb99d9e6640 1 -- 172.21.15.62:0/2555154657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb998129e70 con 0x7fb99806b980 2024-04-23T18:29:03.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.567+0000 7fb97ffff640 1 -- 172.21.15.62:0/2555154657 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb990032c30 con 0x7fb99806b980 2024-04-23T18:29:03.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.567+0000 7fb99d9e6640 1 -- 172.21.15.62:0/2555154657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb998126ec0 con 0x7fb99806b980 2024-04-23T18:29:03.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.568+0000 7fb97ffff640 1 -- 172.21.15.62:0/2555154657 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb99004c060 con 0x7fb99806b980 2024-04-23T18:29:03.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.568+0000 7fb99d9e6640 1 -- 172.21.15.62:0/2555154657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9980505b0 con 0x7fb99806b980 2024-04-23T18:29:03.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.568+0000 7fb97ffff640 1 --2- 172.21.15.62:0/2555154657 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb9840385c0 0x7fb98403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:03.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.568+0000 7fb97ffff640 1 -- 172.21.15.62:0/2555154657 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7fb99002f050 con 0x7fb99806b980 2024-04-23T18:29:03.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.569+0000 7fb9967fc640 1 --2- 172.21.15.62:0/2555154657 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb9840385c0 0x7fb98403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:03.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.569+0000 7fb9967fc640 1 --2- 172.21.15.62:0/2555154657 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb9840385c0 0x7fb98403aa80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb98c007fd0 tx=0x7fb98c007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:03.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.573+0000 7fb97ffff640 1 -- 172.21.15.62:0/2555154657 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb990040070 con 0x7fb99806b980 2024-04-23T18:29:03.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.813+0000 7fb99d9e6640 1 -- 172.21.15.62:0/2555154657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb998097560 con 0x7fb99806b980 2024-04-23T18:29:03.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.815+0000 7fb97ffff640 1 -- 172.21.15.62:0/2555154657 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87806 (secure 0 0 0) 0x7fb99003a380 con 0x7fb99806b980 2024-04-23T18:29:03.808 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:29:03.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.817+0000 7fb99d9e6640 1 -- 172.21.15.62:0/2555154657 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb9840385c0 msgr2=0x7fb98403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:03.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.817+0000 7fb99d9e6640 1 --2- 172.21.15.62:0/2555154657 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb9840385c0 0x7fb98403aa80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb98c007fd0 tx=0x7fb98c007ac0 comp rx=0 tx=0).stop 2024-04-23T18:29:03.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.817+0000 7fb99d9e6640 1 -- 172.21.15.62:0/2555154657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb99806b980 msgr2=0x7fb9981267a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:03.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.817+0000 7fb99d9e6640 1 --2- 172.21.15.62:0/2555154657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb99806b980 0x7fb9981267a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb990034040 tx=0x7fb9900046c0 comp rx=0 tx=0).stop 2024-04-23T18:29:03.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.817+0000 7fb99d9e6640 1 -- 172.21.15.62:0/2555154657 shutdown_connections 2024-04-23T18:29:03.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.817+0000 7fb99d9e6640 1 --2- 172.21.15.62:0/2555154657 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb9840385c0 0x7fb98403aa80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:03.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.817+0000 7fb99d9e6640 1 --2- 172.21.15.62:0/2555154657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb99806b980 0x7fb9981267a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:03.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.817+0000 7fb99d9e6640 1 -- 172.21.15.62:0/2555154657 >> 172.21.15.62:0/2555154657 conn(0x7fb99809e110 msgr2=0x7fb998098680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:03.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.817+0000 7fb99d9e6640 1 -- 172.21.15.62:0/2555154657 shutdown_connections 2024-04-23T18:29:03.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.817+0000 7fb99d9e6640 1 -- 172.21.15.62:0/2555154657 wait complete. 2024-04-23T18:29:03.819 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":3704082436},{"type":"v1","addr":"172.21.15.119:6825","nonce":3704082436}]},"active_addr":"172.21.15.119:6825/3704082436","active_change":"2024-04-23T18:28:50.673672+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":3622740891}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":3739059843}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":2370056925}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":4046743446}]}]} 2024-04-23T18:29:03.821 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-23T18:29:03.821 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-23T18:29:03.822 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:29:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.929+0000 7f3f02831640 1 Processor -- start 2024-04-23T18:29:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.929+0000 7f3f02831640 1 -- start start 2024-04-23T18:29:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.929+0000 7f3f02831640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3efc12fa30 0x7f3efc131e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:03.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.929+0000 7f3f02831640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3efc098fd0 con 0x7f3efc0933f0 2024-04-23T18:29:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.929+0000 7f3f02831640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f3efc0967a0 con 0x7f3efc12fa30 2024-04-23T18:29:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.929+0000 7f3efb7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3efc12fa30 0x7f3efc131e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.929+0000 7f3efbfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3efc0933f0 0x7f3efc0937d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39646/0 (socket says 172.21.15.62:39646) 2024-04-23T18:29:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.929+0000 7f3efbfff640 1 -- 172.21.15.62:0/3204268700 learned_addr learned my addr 172.21.15.62:0/3204268700 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.929+0000 7f3efb7fe640 1 -- 172.21.15.62:0/3204268700 >> v1:172.21.15.62:6789/0 conn(0x7f3efc0933f0 legacy=0x7f3efc0937d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.930+0000 7f3efaffd640 1 -- 172.21.15.62:0/3204268700 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2630791806 0 0) 0x7f3efc098fd0 con 0x7f3efc0933f0 2024-04-23T18:29:03.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.930+0000 7f3efb7fe640 1 -- 172.21.15.62:0/3204268700 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3efc0970e0 con 0x7f3efc12fa30 2024-04-23T18:29:03.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.930+0000 7f3efb7fe640 1 --2- 172.21.15.62:0/3204268700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3efc12fa30 0x7f3efc131e20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009720 tx=0x7f3ef002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e7355f8327b47d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:03.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.930+0000 7f3efaffd640 1 -- 172.21.15.62:0/3204268700 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef00316d0 con 0x7f3efc12fa30 2024-04-23T18:29:03.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.930+0000 7f3efaffd640 1 -- 172.21.15.62:0/3204268700 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef0037070 con 0x7f3efc12fa30 2024-04-23T18:29:03.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.930+0000 7f3efaffd640 1 -- 172.21.15.62:0/3204268700 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef00319c0 con 0x7f3efc12fa30 2024-04-23T18:29:03.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.931+0000 7f3f02831640 1 -- 172.21.15.62:0/3204268700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3efc12fa30 msgr2=0x7f3efc131e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:03.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.931+0000 7f3f02831640 1 --2- 172.21.15.62:0/3204268700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3efc12fa30 0x7f3efc131e20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009720 tx=0x7f3ef002b840 comp rx=0 tx=0).stop 2024-04-23T18:29:03.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.931+0000 7f3f02831640 1 -- 172.21.15.62:0/3204268700 shutdown_connections 2024-04-23T18:29:03.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.931+0000 7f3f02831640 1 --2- 172.21.15.62:0/3204268700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3efc12fa30 0x7f3efc131e20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:03.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.931+0000 7f3f02831640 1 -- 172.21.15.62:0/3204268700 >> 172.21.15.62:0/3204268700 conn(0x7f3efc099d70 msgr2=0x7f3efc097640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:03.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.931+0000 7f3f02831640 1 -- 172.21.15.62:0/3204268700 shutdown_connections 2024-04-23T18:29:03.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.931+0000 7f3f02831640 1 -- 172.21.15.62:0/3204268700 wait complete. 2024-04-23T18:29:03.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.932+0000 7f3f02831640 1 Processor -- start 2024-04-23T18:29:03.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.932+0000 7f3f02831640 1 -- start start 2024-04-23T18:29:03.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.932+0000 7f3f02831640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3efc0933f0 0x7f3efc1c1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:03.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.932+0000 7f3f02831640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc132360 con 0x7f3efc0933f0 2024-04-23T18:29:03.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.933+0000 7f3efbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3efc0933f0 0x7f3efc1c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:03.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.933+0000 7f3efbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3efc0933f0 0x7f3efc1c1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57642/0 (socket says 172.21.15.62:57642) 2024-04-23T18:29:03.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.933+0000 7f3efbfff640 1 -- 172.21.15.62:0/211433793 learned_addr learned my addr 172.21.15.62:0/211433793 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:03.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.933+0000 7f3efbfff640 1 -- 172.21.15.62:0/211433793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3efc12d2b0 con 0x7f3efc0933f0 2024-04-23T18:29:03.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.933+0000 7f3efbfff640 1 --2- 172.21.15.62:0/211433793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3efc0933f0 0x7f3efc1c1680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00c370 tx=0x7f3eec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:03.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.933+0000 7f3ef8ff9640 1 -- 172.21.15.62:0/211433793 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eec007410 con 0x7f3efc0933f0 2024-04-23T18:29:03.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.933+0000 7f3ef8ff9640 1 -- 172.21.15.62:0/211433793 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eec0075d0 con 0x7f3efc0933f0 2024-04-23T18:29:03.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.933+0000 7f3ef8ff9640 1 -- 172.21.15.62:0/211433793 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3eec004950 con 0x7f3efc0933f0 2024-04-23T18:29:03.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.933+0000 7f3f02831640 1 -- 172.21.15.62:0/211433793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3efc12db00 con 0x7f3efc0933f0 2024-04-23T18:29:03.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.933+0000 7f3f02831640 1 -- 172.21.15.62:0/211433793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3efc1c1bc0 con 0x7f3efc0933f0 2024-04-23T18:29:03.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.934+0000 7f3ef8ff9640 1 -- 172.21.15.62:0/211433793 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3eec011070 con 0x7f3efc0933f0 2024-04-23T18:29:03.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.934+0000 7f3f02831640 1 -- 172.21.15.62:0/211433793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3efc0505b0 con 0x7f3efc0933f0 2024-04-23T18:29:03.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.934+0000 7f3ef8ff9640 1 --2- 172.21.15.62:0/211433793 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3ee80385c0 0x7f3ee803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:03.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.934+0000 7f3ef8ff9640 1 -- 172.21.15.62:0/211433793 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f3eec04b140 con 0x7f3efc0933f0 2024-04-23T18:29:03.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.934+0000 7f3efb7fe640 1 --2- 172.21.15.62:0/211433793 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3ee80385c0 0x7f3ee803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:03.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.935+0000 7f3efb7fe640 1 --2- 172.21.15.62:0/211433793 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3ee80385c0 0x7f3ee803aa80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009720 tx=0x7f3ef0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:03.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:03.939+0000 7f3ef8ff9640 1 -- 172.21.15.62:0/211433793 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3eec011c60 con 0x7f3efc0933f0 2024-04-23T18:29:04.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.123+0000 7f3f02831640 1 -- 172.21.15.62:0/211433793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3efc06bae0 con 0x7f3efc0933f0 2024-04-23T18:29:04.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.123+0000 7f3ef8ff9640 1 -- 172.21.15.62:0/211433793 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9771 (secure 0 0 0) 0x7f3eec004d80 con 0x7f3efc0933f0 2024-04-23T18:29:04.115 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:29:04.116 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"fsid":"7bde1cd1-e3f4-4fcb-8bbb-8f7edde199b6","created":"2024-04-23T18:28:46.460262+0000","modified":"2024-04-23T18:29:03.437401+0000","last_up_change":"2024-04-23T18:28:56.409542+0000","last_in_change":"2024-04-23T18:28:47.543459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:28:56.697816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T18:29:02.075590+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"09209063-cd8c-480c-aee7-4c548f693d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6801","nonce":2641588406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6803","nonce":2641588406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6807","nonce":2641588406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6805","nonce":2641588406}]},"public_addr":"172.21.15.62:6801/2641588406","cluster_addr":"172.21.15.62:6803/2641588406","heartbeat_back_addr":"172.21.15.62:6807/2641588406","heartbeat_front_addr":"172.21.15.62:6805/2641588406","state":["exists","up"]},{"osd":1,"uuid":"cebd6eb1-aa92-4110-8388-1bbcdc3915f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6810","nonce":2736386629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6814","nonce":2736386629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6822","nonce":2736386629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6818","nonce":2736386629}]},"public_addr":"172.21.15.119:6810/2736386629","cluster_addr":"172.21.15.119:6814/2736386629","heartbeat_back_addr":"172.21.15.119:6822/2736386629","heartbeat_front_addr":"172.21.15.119:6818/2736386629","state":["exists","up"]},{"osd":2,"uuid":"4970a460-2342-49bc-8c74-902633fa8a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6801","nonce":2624052101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6803","nonce":2624052101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6807","nonce":2624052101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6805","nonce":2624052101}]},"public_addr":"172.21.15.119:6801/2624052101","cluster_addr":"172.21.15.119:6803/2624052101","heartbeat_back_addr":"172.21.15.119:6807/2624052101","heartbeat_front_addr":"172.21.15.119:6805/2624052101","state":["exists","up"]},{"osd":3,"uuid":"eae08f42-0b0e-4a3c-8720-34a38fbd5de0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6809","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6811","nonce":3910610681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6813","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6815","nonce":3910610681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6823","nonce":3910610681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6819","nonce":3910610681}]},"public_addr":"172.21.15.119:6811/3910610681","cluster_addr":"172.21.15.119:6815/3910610681","heartbeat_back_addr":"172.21.15.119:6823/3910610681","heartbeat_front_addr":"172.21.15.119:6819/3910610681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.607829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.773992+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.768859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.775730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:29:04.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.125+0000 7f3f02831640 1 -- 172.21.15.62:0/211433793 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3ee80385c0 msgr2=0x7f3ee803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.125+0000 7f3f02831640 1 --2- 172.21.15.62:0/211433793 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3ee80385c0 0x7f3ee803aa80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009720 tx=0x7f3ef0008030 comp rx=0 tx=0).stop 2024-04-23T18:29:04.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.125+0000 7f3f02831640 1 -- 172.21.15.62:0/211433793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3efc0933f0 msgr2=0x7f3efc1c1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.125+0000 7f3f02831640 1 --2- 172.21.15.62:0/211433793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3efc0933f0 0x7f3efc1c1680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3eec00c370 tx=0x7f3eec00c830 comp rx=0 tx=0).stop 2024-04-23T18:29:04.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.125+0000 7f3f02831640 1 -- 172.21.15.62:0/211433793 shutdown_connections 2024-04-23T18:29:04.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.125+0000 7f3f02831640 1 --2- 172.21.15.62:0/211433793 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3ee80385c0 0x7f3ee803aa80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.125+0000 7f3f02831640 1 --2- 172.21.15.62:0/211433793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3efc0933f0 0x7f3efc1c1680 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.125+0000 7f3f02831640 1 -- 172.21.15.62:0/211433793 >> 172.21.15.62:0/211433793 conn(0x7f3efc099d70 msgr2=0x7f3efc09aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.126+0000 7f3f02831640 1 -- 172.21.15.62:0/211433793 shutdown_connections 2024-04-23T18:29:04.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.126+0000 7f3f02831640 1 -- 172.21.15.62:0/211433793 wait complete. 2024-04-23T18:29:04.128 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-23T18:29:04.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:29:04.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.235+0000 7fba4e1ef640 1 Processor -- start 2024-04-23T18:29:04.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.236+0000 7fba4e1ef640 1 -- start start 2024-04-23T18:29:04.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.236+0000 7fba4e1ef640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fba48072ee0 0x7fba48134040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.236+0000 7fba4e1ef640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba48073df0 con 0x7fba480723f0 2024-04-23T18:29:04.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.236+0000 7fba4e1ef640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fba4809a850 con 0x7fba48072ee0 2024-04-23T18:29:04.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.236+0000 7fba46ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fba48072ee0 0x7fba48134040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.236+0000 7fba477fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fba480723f0 0x7fba480727d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39650/0 (socket says 172.21.15.62:39650) 2024-04-23T18:29:04.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.236+0000 7fba477fe640 1 -- 172.21.15.62:0/1024485994 learned_addr learned my addr 172.21.15.62:0/1024485994 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:04.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.236+0000 7fba46ffd640 1 -- 172.21.15.62:0/1024485994 >> v1:172.21.15.62:6789/0 conn(0x7fba480723f0 legacy=0x7fba480727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.236+0000 7fba46ffd640 1 -- 172.21.15.62:0/1024485994 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba480748a0 con 0x7fba48072ee0 2024-04-23T18:29:04.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.237+0000 7fba46ffd640 1 --2- 172.21.15.62:0/1024485994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba48072ee0 0x7fba48134040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba38009720 tx=0x7fba3802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f5c7846a268b0e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.237+0000 7fba467fc640 1 -- 172.21.15.62:0/1024485994 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba380316d0 con 0x7fba48072ee0 2024-04-23T18:29:04.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.237+0000 7fba467fc640 1 -- 172.21.15.62:0/1024485994 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba38037070 con 0x7fba48072ee0 2024-04-23T18:29:04.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.237+0000 7fba467fc640 1 -- 172.21.15.62:0/1024485994 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba380319c0 con 0x7fba48072ee0 2024-04-23T18:29:04.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.238+0000 7fba4e1ef640 1 -- 172.21.15.62:0/1024485994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba48072ee0 msgr2=0x7fba48134040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.238+0000 7fba4e1ef640 1 --2- 172.21.15.62:0/1024485994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba48072ee0 0x7fba48134040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba38009720 tx=0x7fba3802b840 comp rx=0 tx=0).stop 2024-04-23T18:29:04.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.238+0000 7fba4e1ef640 1 -- 172.21.15.62:0/1024485994 shutdown_connections 2024-04-23T18:29:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.238+0000 7fba4e1ef640 1 --2- 172.21.15.62:0/1024485994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba48072ee0 0x7fba48134040 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.238+0000 7fba4e1ef640 1 -- 172.21.15.62:0/1024485994 >> 172.21.15.62:0/1024485994 conn(0x7fba4809d8e0 msgr2=0x7fba48099db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.238+0000 7fba4e1ef640 1 -- 172.21.15.62:0/1024485994 shutdown_connections 2024-04-23T18:29:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.238+0000 7fba4e1ef640 1 -- 172.21.15.62:0/1024485994 wait complete. 2024-04-23T18:29:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.239+0000 7fba4e1ef640 1 Processor -- start 2024-04-23T18:29:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.239+0000 7fba4e1ef640 1 -- start start 2024-04-23T18:29:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.239+0000 7fba4e1ef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba480723f0 0x7fba4808afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.239+0000 7fba4e1ef640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fba48134580 con 0x7fba480723f0 2024-04-23T18:29:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.239+0000 7fba477fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba480723f0 0x7fba4808afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.239+0000 7fba477fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba480723f0 0x7fba4808afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57664/0 (socket says 172.21.15.62:57664) 2024-04-23T18:29:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.239+0000 7fba477fe640 1 -- 172.21.15.62:0/101011070 learned_addr learned my addr 172.21.15.62:0/101011070 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.240+0000 7fba477fe640 1 -- 172.21.15.62:0/101011070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4808c250 con 0x7fba480723f0 2024-04-23T18:29:04.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.240+0000 7fba477fe640 1 --2- 172.21.15.62:0/101011070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba480723f0 0x7fba4808afb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fba3000c4a0 tx=0x7fba3000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.240+0000 7fba3ffff640 1 -- 172.21.15.62:0/101011070 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba30017070 con 0x7fba480723f0 2024-04-23T18:29:04.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.240+0000 7fba3ffff640 1 -- 172.21.15.62:0/101011070 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba30005c10 con 0x7fba480723f0 2024-04-23T18:29:04.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.240+0000 7fba4e1ef640 1 -- 172.21.15.62:0/101011070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba481336c0 con 0x7fba480723f0 2024-04-23T18:29:04.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.240+0000 7fba3ffff640 1 -- 172.21.15.62:0/101011070 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba30007070 con 0x7fba480723f0 2024-04-23T18:29:04.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.240+0000 7fba4e1ef640 1 -- 172.21.15.62:0/101011070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4808d7e0 con 0x7fba480723f0 2024-04-23T18:29:04.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.241+0000 7fba3ffff640 1 -- 172.21.15.62:0/101011070 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fba3001a070 con 0x7fba480723f0 2024-04-23T18:29:04.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.241+0000 7fba4e1ef640 1 -- 172.21.15.62:0/101011070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba48099e50 con 0x7fba480723f0 2024-04-23T18:29:04.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.241+0000 7fba3ffff640 1 --2- 172.21.15.62:0/101011070 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fba280385c0 0x7fba2803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.241+0000 7fba3ffff640 1 -- 172.21.15.62:0/101011070 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7fba3004a880 con 0x7fba480723f0 2024-04-23T18:29:04.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.241+0000 7fba46ffd640 1 --2- 172.21.15.62:0/101011070 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fba280385c0 0x7fba2803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.242+0000 7fba46ffd640 1 --2- 172.21.15.62:0/101011070 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fba280385c0 0x7fba2803aa80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fba38036000 tx=0x7fba38008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.246+0000 7fba3ffff640 1 -- 172.21.15.62:0/101011070 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fba48099e50 con 0x7fba480723f0 2024-04-23T18:29:04.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.437+0000 7fba4e1ef640 1 -- 172.21.15.62:0/101011070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba480505b0 con 0x7fba480723f0 2024-04-23T18:29:04.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.438+0000 7fba3ffff640 1 -- 172.21.15.62:0/101011070 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9771 (secure 0 0 0) 0x7fba30007210 con 0x7fba480723f0 2024-04-23T18:29:04.430 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:29:04.430 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":16,"fsid":"7bde1cd1-e3f4-4fcb-8bbb-8f7edde199b6","created":"2024-04-23T18:28:46.460262+0000","modified":"2024-04-23T18:29:03.437401+0000","last_up_change":"2024-04-23T18:28:56.409542+0000","last_in_change":"2024-04-23T18:28:47.543459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:28:56.697816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T18:29:02.075590+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"09209063-cd8c-480c-aee7-4c548f693d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6801","nonce":2641588406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6803","nonce":2641588406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6807","nonce":2641588406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6805","nonce":2641588406}]},"public_addr":"172.21.15.62:6801/2641588406","cluster_addr":"172.21.15.62:6803/2641588406","heartbeat_back_addr":"172.21.15.62:6807/2641588406","heartbeat_front_addr":"172.21.15.62:6805/2641588406","state":["exists","up"]},{"osd":1,"uuid":"cebd6eb1-aa92-4110-8388-1bbcdc3915f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6810","nonce":2736386629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6814","nonce":2736386629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6822","nonce":2736386629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6818","nonce":2736386629}]},"public_addr":"172.21.15.119:6810/2736386629","cluster_addr":"172.21.15.119:6814/2736386629","heartbeat_back_addr":"172.21.15.119:6822/2736386629","heartbeat_front_addr":"172.21.15.119:6818/2736386629","state":["exists","up"]},{"osd":2,"uuid":"4970a460-2342-49bc-8c74-902633fa8a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6801","nonce":2624052101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6803","nonce":2624052101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6807","nonce":2624052101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6805","nonce":2624052101}]},"public_addr":"172.21.15.119:6801/2624052101","cluster_addr":"172.21.15.119:6803/2624052101","heartbeat_back_addr":"172.21.15.119:6807/2624052101","heartbeat_front_addr":"172.21.15.119:6805/2624052101","state":["exists","up"]},{"osd":3,"uuid":"eae08f42-0b0e-4a3c-8720-34a38fbd5de0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6809","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6811","nonce":3910610681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6813","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6815","nonce":3910610681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6823","nonce":3910610681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6819","nonce":3910610681}]},"public_addr":"172.21.15.119:6811/3910610681","cluster_addr":"172.21.15.119:6815/3910610681","heartbeat_back_addr":"172.21.15.119:6823/3910610681","heartbeat_front_addr":"172.21.15.119:6819/3910610681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.607829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.773992+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.768859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.775730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:29:04.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.440+0000 7fba4e1ef640 1 -- 172.21.15.62:0/101011070 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fba280385c0 msgr2=0x7fba2803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.440+0000 7fba4e1ef640 1 --2- 172.21.15.62:0/101011070 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fba280385c0 0x7fba2803aa80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fba38036000 tx=0x7fba38008030 comp rx=0 tx=0).stop 2024-04-23T18:29:04.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.440+0000 7fba4e1ef640 1 -- 172.21.15.62:0/101011070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba480723f0 msgr2=0x7fba4808afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.440+0000 7fba4e1ef640 1 --2- 172.21.15.62:0/101011070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba480723f0 0x7fba4808afb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fba3000c4a0 tx=0x7fba3000c960 comp rx=0 tx=0).stop 2024-04-23T18:29:04.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.440+0000 7fba4e1ef640 1 -- 172.21.15.62:0/101011070 shutdown_connections 2024-04-23T18:29:04.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.440+0000 7fba4e1ef640 1 --2- 172.21.15.62:0/101011070 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fba280385c0 0x7fba2803aa80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.440+0000 7fba4e1ef640 1 --2- 172.21.15.62:0/101011070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba480723f0 0x7fba4808afb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.440+0000 7fba4e1ef640 1 -- 172.21.15.62:0/101011070 >> 172.21.15.62:0/101011070 conn(0x7fba4809d8e0 msgr2=0x7fba48091320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.440+0000 7fba4e1ef640 1 -- 172.21.15.62:0/101011070 shutdown_connections 2024-04-23T18:29:04.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.440+0000 7fba4e1ef640 1 -- 172.21.15.62:0/101011070 wait complete. 2024-04-23T18:29:04.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-23T18:29:04.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-23T18:29:04.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-23T18:29:04.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-23T18:29:04.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.558+0000 7f68b76e4640 1 Processor -- start 2024-04-23T18:29:04.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.558+0000 7f003f470640 1 Processor -- start 2024-04-23T18:29:04.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.558+0000 7f215b115640 1 Processor -- start 2024-04-23T18:29:04.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f68b76e4640 1 -- start start 2024-04-23T18:29:04.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f215b115640 1 -- start start 2024-04-23T18:29:04.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f003f470640 1 -- start start 2024-04-23T18:29:04.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f1a85843640 1 Processor -- start 2024-04-23T18:29:04.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f1a85843640 1 -- start start 2024-04-23T18:29:04.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f215b115640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f215412ea10 0x7f215412ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f003f470640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f003812fa60 0x7f0038131e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f003f470640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0038093e70 con 0x7f0038093380 2024-04-23T18:29:04.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f003f470640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0038098f60 con 0x7f003812fa60 2024-04-23T18:29:04.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f68b76e4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68b012b730 0x7f68b0094850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f68b76e4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b0096070 con 0x7f68b012b350 2024-04-23T18:29:04.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f68b76e4640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f68b0072d90 con 0x7f68b012b730 2024-04-23T18:29:04.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f215b115640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215412f890 con 0x7f215412f470 2024-04-23T18:29:04.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f215b115640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2154096ad0 con 0x7f215412ea10 2024-04-23T18:29:04.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f003ca0b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f003812fa60 0x7f0038131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f2158eb1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f215412ea10 0x7f215412ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f003d20c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0038093380 0x7f0038093760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39664/0 (socket says 172.21.15.62:39664) 2024-04-23T18:29:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f003d20c640 1 -- 172.21.15.62:0/3313917159 learned_addr learned my addr 172.21.15.62:0/3313917159 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f68b4c7f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68b012b730 0x7f68b0094850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f1a85843640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1a8006eea0 0x7f1a8006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f68b5480640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f68b012b350 0x7f68b0094140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39680/0 (socket says 172.21.15.62:39680) 2024-04-23T18:29:04.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f68b5480640 1 -- 172.21.15.62:0/1902062625 learned_addr learned my addr 172.21.15.62:0/1902062625 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:04.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f1a85843640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a80070a60 con 0x7f1a8006f7c0 2024-04-23T18:29:04.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f1a85843640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1a80070fd0 con 0x7f1a8006eea0 2024-04-23T18:29:04.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f2158eb1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f215412ea10 0x7f215412ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57690/0 (socket says 172.21.15.62:57690) 2024-04-23T18:29:04.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.559+0000 7f2158eb1640 1 -- 172.21.15.62:0/2144085896 learned_addr learned my addr 172.21.15.62:0/2144085896 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:04.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.560+0000 7f2158eb1640 1 -- 172.21.15.62:0/2144085896 >> v1:172.21.15.62:6789/0 conn(0x7f215412f470 legacy=0x7f215412b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.560+0000 7f2158eb1640 1 -- 172.21.15.62:0/2144085896 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215406e920 con 0x7f215412ea10 2024-04-23T18:29:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.560+0000 7f68b4c7f640 1 -- 172.21.15.62:0/1902062625 >> v1:172.21.15.62:6789/0 conn(0x7f68b012b350 legacy=0x7f68b0094140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.560+0000 7f003ca0b640 1 -- 172.21.15.62:0/3313917159 >> v1:172.21.15.62:6789/0 conn(0x7f0038093380 legacy=0x7f0038093760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.560+0000 7f68b4c7f640 1 -- 172.21.15.62:0/1902062625 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b0096830 con 0x7f68b012b730 2024-04-23T18:29:04.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.560+0000 7f1a7effd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1a8006eea0 0x7f1a8006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.560+0000 7f1a7effd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1a8006eea0 0x7f1a8006f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57704/0 (socket says 172.21.15.62:57704) 2024-04-23T18:29:04.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.560+0000 7f1a7effd640 1 -- 172.21.15.62:0/1184776633 learned_addr learned my addr 172.21.15.62:0/1184776633 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:04.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.560+0000 7f003ca0b640 1 -- 172.21.15.62:0/3313917159 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0038096730 con 0x7f003812fa60 2024-04-23T18:29:04.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.560+0000 7f1a7effd640 1 -- 172.21.15.62:0/1184776633 >> v1:172.21.15.62:6789/0 conn(0x7f1a8006f7c0 legacy=0x7f1a8012fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.560+0000 7f1a7effd640 1 -- 172.21.15.62:0/1184776633 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8006fbd0 con 0x7f1a8006eea0 2024-04-23T18:29:04.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f68b4c7f640 1 --2- 172.21.15.62:0/1902062625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68b012b730 0x7f68b0094850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009720 tx=0x7f68a002cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6eb8e2f4a10f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f2158eb1640 1 --2- 172.21.15.62:0/2144085896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215412ea10 0x7f215412ef30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f21440097f0 tx=0x7f214402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204d712e774de5ba server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f68a7fff640 1 -- 172.21.15.62:0/1902062625 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a003a070 con 0x7f68b012b730 2024-04-23T18:29:04.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f68a7fff640 1 -- 172.21.15.62:0/1902062625 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a002d8f0 con 0x7f68b012b730 2024-04-23T18:29:04.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f68a7fff640 1 -- 172.21.15.62:0/1902062625 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a002dbf0 con 0x7f68b012b730 2024-04-23T18:29:04.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f21537fe640 1 -- 172.21.15.62:0/2144085896 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2144035020 con 0x7f215412ea10 2024-04-23T18:29:04.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f21537fe640 1 -- 172.21.15.62:0/2144085896 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21440317a0 con 0x7f215412ea10 2024-04-23T18:29:04.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f003ca0b640 1 --2- 172.21.15.62:0/3313917159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f003812fa60 0x7f0038131e50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0028009720 tx=0x7f002802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bafb39171ad85448 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f21537fe640 1 -- 172.21.15.62:0/2144085896 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2144031aa0 con 0x7f215412ea10 2024-04-23T18:29:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f1a7effd640 1 --2- 172.21.15.62:0/1184776633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a8006eea0 0x7f1a8006f280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000bac0 tx=0x7f1a7002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6b0d5efec9d943 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f1a7e7fc640 1 -- 172.21.15.62:0/1184776633 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a7003b070 con 0x7f1a8006eea0 2024-04-23T18:29:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f002ffff640 1 -- 172.21.15.62:0/3313917159 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00280316d0 con 0x7f003812fa60 2024-04-23T18:29:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f002ffff640 1 -- 172.21.15.62:0/3313917159 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0028037070 con 0x7f003812fa60 2024-04-23T18:29:04.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f002ffff640 1 -- 172.21.15.62:0/3313917159 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00280319c0 con 0x7f003812fa60 2024-04-23T18:29:04.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f1a7e7fc640 1 -- 172.21.15.62:0/1184776633 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7002edc0 con 0x7f1a8006eea0 2024-04-23T18:29:04.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.561+0000 7f1a7e7fc640 1 -- 172.21.15.62:0/1184776633 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a70036590 con 0x7f1a8006eea0 2024-04-23T18:29:04.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f68b76e4640 1 -- 172.21.15.62:0/1902062625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68b012b730 msgr2=0x7f68b0094850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f68b76e4640 1 --2- 172.21.15.62:0/1902062625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68b012b730 0x7f68b0094850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009720 tx=0x7f68a002cc10 comp rx=0 tx=0).stop 2024-04-23T18:29:04.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f68b76e4640 1 -- 172.21.15.62:0/1902062625 shutdown_connections 2024-04-23T18:29:04.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f68b76e4640 1 --2- 172.21.15.62:0/1902062625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68b012b730 0x7f68b0094850 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f68b76e4640 1 -- 172.21.15.62:0/1902062625 >> 172.21.15.62:0/1902062625 conn(0x7f68b0099d00 msgr2=0x7f68b00975d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f215b115640 1 -- 172.21.15.62:0/2144085896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215412ea10 msgr2=0x7f215412ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f215b115640 1 --2- 172.21.15.62:0/2144085896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215412ea10 0x7f215412ef30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f21440097f0 tx=0x7f214402b910 comp rx=0 tx=0).stop 2024-04-23T18:29:04.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f215b115640 1 -- 172.21.15.62:0/2144085896 shutdown_connections 2024-04-23T18:29:04.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f215b115640 1 --2- 172.21.15.62:0/2144085896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215412ea10 0x7f215412ef30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f215b115640 1 -- 172.21.15.62:0/2144085896 >> 172.21.15.62:0/2144085896 conn(0x7f215409f080 msgr2=0x7f215409f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f215b115640 1 -- 172.21.15.62:0/2144085896 shutdown_connections 2024-04-23T18:29:04.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f68b76e4640 1 -- 172.21.15.62:0/1902062625 shutdown_connections 2024-04-23T18:29:04.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f215b115640 1 -- 172.21.15.62:0/2144085896 wait complete. 2024-04-23T18:29:04.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f68b76e4640 1 -- 172.21.15.62:0/1902062625 wait complete. 2024-04-23T18:29:04.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f1a85843640 1 -- 172.21.15.62:0/1184776633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a8006eea0 msgr2=0x7f1a8006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f1a85843640 1 --2- 172.21.15.62:0/1184776633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a8006eea0 0x7f1a8006f280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000bac0 tx=0x7f1a7002e0e0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f003f470640 1 -- 172.21.15.62:0/3313917159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f003812fa60 msgr2=0x7f0038131e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f003f470640 1 --2- 172.21.15.62:0/3313917159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f003812fa60 0x7f0038131e50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0028009720 tx=0x7f002802b840 comp rx=0 tx=0).stop 2024-04-23T18:29:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f1a85843640 1 -- 172.21.15.62:0/1184776633 shutdown_connections 2024-04-23T18:29:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f1a85843640 1 --2- 172.21.15.62:0/1184776633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a8006eea0 0x7f1a8006f280 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.562+0000 7f1a85843640 1 -- 172.21.15.62:0/1184776633 >> 172.21.15.62:0/1184776633 conn(0x7f1a8009df00 msgr2=0x7f1a8009e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.563+0000 7f003f470640 1 -- 172.21.15.62:0/3313917159 shutdown_connections 2024-04-23T18:29:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.563+0000 7f003f470640 1 --2- 172.21.15.62:0/3313917159 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f003812fa60 0x7f0038131e50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.563+0000 7f003f470640 1 -- 172.21.15.62:0/3313917159 >> 172.21.15.62:0/3313917159 conn(0x7f0038099d00 msgr2=0x7f00380975d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.563+0000 7f1a85843640 1 -- 172.21.15.62:0/1184776633 shutdown_connections 2024-04-23T18:29:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.563+0000 7f003f470640 1 -- 172.21.15.62:0/3313917159 shutdown_connections 2024-04-23T18:29:04.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.563+0000 7f1a85843640 1 -- 172.21.15.62:0/1184776633 wait complete. 2024-04-23T18:29:04.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.563+0000 7f003f470640 1 -- 172.21.15.62:0/3313917159 wait complete. 2024-04-23T18:29:04.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.563+0000 7f215b115640 1 Processor -- start 2024-04-23T18:29:04.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.563+0000 7f215b115640 1 -- start start 2024-04-23T18:29:04.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f003f470640 1 Processor -- start 2024-04-23T18:29:04.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f003f470640 1 -- start start 2024-04-23T18:29:04.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f68b76e4640 1 Processor -- start 2024-04-23T18:29:04.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f215b115640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215412f470 0x7f215408afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f215b115640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f215412bba0 con 0x7f215412f470 2024-04-23T18:29:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f68b76e4640 1 -- start start 2024-04-23T18:29:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f2158eb1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215412f470 0x7f215408afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f003f470640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0038093380 0x7f003806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f003f470640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0038096110 con 0x7f0038093380 2024-04-23T18:29:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f1a85843640 1 Processor -- start 2024-04-23T18:29:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f2158eb1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215412f470 0x7f215408afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57706/0 (socket says 172.21.15.62:57706) 2024-04-23T18:29:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f2158eb1640 1 -- 172.21.15.62:0/1465511547 learned_addr learned my addr 172.21.15.62:0/1465511547 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:04.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f003d20c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0038093380 0x7f003806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f1a85843640 1 -- start start 2024-04-23T18:29:04.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f003d20c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0038093380 0x7f003806fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57712/0 (socket says 172.21.15.62:57712) 2024-04-23T18:29:04.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f003d20c640 1 -- 172.21.15.62:0/782987363 learned_addr learned my addr 172.21.15.62:0/782987363 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:04.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.564+0000 7f2158eb1640 1 -- 172.21.15.62:0/1465511547 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215408cb60 con 0x7f215412f470 2024-04-23T18:29:04.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f003d20c640 1 -- 172.21.15.62:0/782987363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0038071c40 con 0x7f0038093380 2024-04-23T18:29:04.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f2158eb1640 1 --2- 172.21.15.62:0/1465511547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215412f470 0x7f215408afb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f21440090b0 tx=0x7f21440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f003d20c640 1 --2- 172.21.15.62:0/782987363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0038093380 0x7f003806fd60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f003400c380 tx=0x7f003400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f68b76e4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68b012b350 0x7f68b008cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f21517fa640 1 -- 172.21.15.62:0/1465511547 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f214403ab80 con 0x7f215412f470 2024-04-23T18:29:04.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f002dffb640 1 -- 172.21.15.62:0/782987363 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0034005c10 con 0x7f0038093380 2024-04-23T18:29:04.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f68b5480640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68b012b350 0x7f68b008cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f68b5480640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68b012b350 0x7f68b008cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57714/0 (socket says 172.21.15.62:57714) 2024-04-23T18:29:04.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f68b5480640 1 -- 172.21.15.62:0/2714796934 learned_addr learned my addr 172.21.15.62:0/2714796934 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:04.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f1a85843640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a8006f7c0 0x7f1a801aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f68b76e4640 1 -- 172.21.15.62:0/2714796934 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0096e50 con 0x7f68b012b350 2024-04-23T18:29:04.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f21517fa640 1 -- 172.21.15.62:0/1465511547 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f214403ad20 con 0x7f215412f470 2024-04-23T18:29:04.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f215b115640 1 -- 172.21.15.62:0/1465511547 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2154127e10 con 0x7f215412f470 2024-04-23T18:29:04.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f002dffb640 1 -- 172.21.15.62:0/782987363 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0034005db0 con 0x7f0038093380 2024-04-23T18:29:04.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f003f470640 1 -- 172.21.15.62:0/782987363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0038126950 con 0x7f0038093380 2024-04-23T18:29:04.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f1a85843640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8006bd10 con 0x7f1a8006f7c0 2024-04-23T18:29:04.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f002dffb640 1 -- 172.21.15.62:0/782987363 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0034004930 con 0x7f0038093380 2024-04-23T18:29:04.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f1a7effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a8006f7c0 0x7f1a801aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f215b115640 1 -- 172.21.15.62:0/1465511547 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21541286c0 con 0x7f215412f470 2024-04-23T18:29:04.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f21517fa640 1 -- 172.21.15.62:0/1465511547 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21440443f0 con 0x7f215412f470 2024-04-23T18:29:04.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f1a7effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a8006f7c0 0x7f1a801aea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57720/0 (socket says 172.21.15.62:57720) 2024-04-23T18:29:04.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f1a7effd640 1 -- 172.21.15.62:0/1613847526 learned_addr learned my addr 172.21.15.62:0/1613847526 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:04.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f68b5480640 1 -- 172.21.15.62:0/2714796934 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b00903f0 con 0x7f68b012b350 2024-04-23T18:29:04.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.566+0000 7f68b5480640 1 --2- 172.21.15.62:0/2714796934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68b012b350 0x7f68b008cf40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00c380 tx=0x7f68ac00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.566+0000 7f68a5ffb640 1 -- 172.21.15.62:0/2714796934 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68ac005c10 con 0x7f68b012b350 2024-04-23T18:29:04.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.566+0000 7f68a5ffb640 1 -- 172.21.15.62:0/2714796934 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ac005db0 con 0x7f68b012b350 2024-04-23T18:29:04.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.566+0000 7f1a7effd640 1 -- 172.21.15.62:0/1613847526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a801b1500 con 0x7f1a8006f7c0 2024-04-23T18:29:04.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.566+0000 7f68b76e4640 1 -- 172.21.15.62:0/2714796934 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b008ea20 con 0x7f68b012b350 2024-04-23T18:29:04.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.565+0000 7f003f470640 1 -- 172.21.15.62:0/782987363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0038070480 con 0x7f0038093380 2024-04-23T18:29:04.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.566+0000 7f215b115640 1 -- 172.21.15.62:0/1465511547 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f21540505b0 con 0x7f215412f470 2024-04-23T18:29:04.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.566+0000 7f003f470640 1 -- 172.21.15.62:0/782987363 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f003809c690 con 0x7f0038093380 2024-04-23T18:29:04.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.566+0000 7f1a7effd640 1 --2- 172.21.15.62:0/1613847526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a8006f7c0 0x7f1a801aea70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000b2c0 tx=0x7f1a700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.566+0000 7f68a5ffb640 1 -- 172.21.15.62:0/2714796934 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68ac004930 con 0x7f68b012b350 2024-04-23T18:29:04.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.566+0000 7f68b76e4640 1 -- 172.21.15.62:0/2714796934 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b0090700 con 0x7f68b012b350 2024-04-23T18:29:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.567+0000 7f21517fa640 1 -- 172.21.15.62:0/1465511547 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f214404b060 con 0x7f215412f470 2024-04-23T18:29:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.567+0000 7f1a7cff9640 1 -- 172.21.15.62:0/1613847526 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a70045070 con 0x7f1a8006f7c0 2024-04-23T18:29:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.567+0000 7f1a7cff9640 1 -- 172.21.15.62:0/1613847526 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a70040590 con 0x7f1a8006f7c0 2024-04-23T18:29:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.567+0000 7f1a7cff9640 1 -- 172.21.15.62:0/1613847526 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a7003b040 con 0x7f1a8006f7c0 2024-04-23T18:29:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.567+0000 7f1a85843640 1 -- 172.21.15.62:0/1613847526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a801b1c70 con 0x7f1a8006f7c0 2024-04-23T18:29:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.567+0000 7f1a85843640 1 -- 172.21.15.62:0/1613847526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a801aefb0 con 0x7f1a8006f7c0 2024-04-23T18:29:04.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.567+0000 7f68a5ffb640 1 -- 172.21.15.62:0/2714796934 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f68ac01a020 con 0x7f68b012b350 2024-04-23T18:29:04.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.567+0000 7f002dffb640 1 -- 172.21.15.62:0/782987363 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f003401a020 con 0x7f0038093380 2024-04-23T18:29:04.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.567+0000 7f68b76e4640 1 -- 172.21.15.62:0/2714796934 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68b00505b0 con 0x7f68b012b350 2024-04-23T18:29:04.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f002dffb640 1 --2- 172.21.15.62:0/782987363 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f001c0385f0 0x7f001c03aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f68a5ffb640 1 --2- 172.21.15.62:0/2714796934 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6894038610 0x7f689403aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f002dffb640 1 -- 172.21.15.62:0/782987363 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f003404b860 con 0x7f0038093380 2024-04-23T18:29:04.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.567+0000 7f21517fa640 1 --2- 172.21.15.62:0/1465511547 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2140038660 0x7f214003ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.567+0000 7f21517fa640 1 -- 172.21.15.62:0/1465511547 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f214406d700 con 0x7f215412f470 2024-04-23T18:29:04.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f21517fa640 1 --2- 172.21.15.62:0/1465511547 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x7f214003de60 0x7f21400402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f21517fa640 1 -- 172.21.15.62:0/1465511547 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f214404ee50 con 0x7f214003de60 2024-04-23T18:29:04.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f21517fa640 1 -- 172.21.15.62:0/1465511547 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f2144074050 con 0x7f215412f470 2024-04-23T18:29:04.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f002dffb640 1 --2- 172.21.15.62:0/782987363 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x7f001c03dd70 0x7f001c0401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f002dffb640 1 -- 172.21.15.62:0/782987363 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0034018e50 con 0x7f001c03dd70 2024-04-23T18:29:04.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f002dffb640 1 -- 172.21.15.62:0/782987363 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f003404bbe0 con 0x7f0038093380 2024-04-23T18:29:04.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f68a5ffb640 1 -- 172.21.15.62:0/2714796934 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f68ac04ae70 con 0x7f68b012b350 2024-04-23T18:29:04.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f1a85843640 1 -- 172.21.15.62:0/1613847526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a801b17e0 con 0x7f1a8006f7c0 2024-04-23T18:29:04.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f21596b2640 1 --2- 172.21.15.62:0/1465511547 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x7f214003de60 0x7f21400402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f2153fff640 1 --2- 172.21.15.62:0/1465511547 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2140038660 0x7f214003ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f68b4c7f640 1 --2- 172.21.15.62:0/2714796934 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6894038610 0x7f689403aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f68a5ffb640 1 --2- 172.21.15.62:0/2714796934 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f689403dd90 0x7f68940401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f003ca0b640 1 --2- 172.21.15.62:0/782987363 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f001c0385f0 0x7f001c03aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f68a5ffb640 1 -- 172.21.15.62:0/2714796934 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68940408a0 con 0x7f689403dd90 2024-04-23T18:29:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f68a5ffb640 1 -- 172.21.15.62:0/2714796934 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f68ac0503e0 con 0x7f68b012b350 2024-04-23T18:29:04.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f003da0d640 1 --2- 172.21.15.62:0/782987363 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x7f001c03dd70 0x7f001c0401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f68b5c81640 1 --2- 172.21.15.62:0/2714796934 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f689403dd90 0x7f68940401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.568+0000 7f1a7cff9640 1 -- 172.21.15.62:0/1613847526 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1a70048070 con 0x7f1a8006f7c0 2024-04-23T18:29:04.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f21596b2640 1 --2- 172.21.15.62:0/1465511547 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x7f214003de60 0x7f21400402a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f68b4c7f640 1 --2- 172.21.15.62:0/2714796934 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6894038610 0x7f689403aad0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f68a0037000 tx=0x7f68a0031000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f1a7cff9640 1 --2- 172.21.15.62:0/1613847526 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1a60038610 0x7f1a6003aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f1a7cff9640 1 -- 172.21.15.62:0/1613847526 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f1a700700d0 con 0x7f1a8006f7c0 2024-04-23T18:29:04.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f2153fff640 1 --2- 172.21.15.62:0/1465511547 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2140038660 0x7f214003ab20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2148000f60 tx=0x7f2148007a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f003ca0b640 1 --2- 172.21.15.62:0/782987363 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f001c0385f0 0x7f001c03aab0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0028036000 tx=0x7f0028008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f68b5c81640 1 --2- 172.21.15.62:0/2714796934 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f689403dd90 0x7f68940401d0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f1a7cff9640 1 --2- 172.21.15.62:0/1613847526 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x7f1a6003dd90 0x7f1a600401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f1a7cff9640 1 -- 172.21.15.62:0/1613847526 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a7002edc0 con 0x7f1a6003dd90 2024-04-23T18:29:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f1a7cff9640 1 -- 172.21.15.62:0/1613847526 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1a70077050 con 0x7f1a8006f7c0 2024-04-23T18:29:04.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f003da0d640 1 --2- 172.21.15.62:0/782987363 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x7f001c03dd70 0x7f001c0401b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f1a77fff640 1 --2- 172.21.15.62:0/1613847526 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1a60038610 0x7f1a6003aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f1a7f7fe640 1 --2- 172.21.15.62:0/1613847526 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x7f1a6003dd90 0x7f1a600401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f21517fa640 1 -- 172.21.15.62:0/1465511547 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f214404ee50 con 0x7f214003de60 2024-04-23T18:29:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.569+0000 7f1a77fff640 1 --2- 172.21.15.62:0/1613847526 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1a60038610 0x7f1a6003aad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1a68000f60 tx=0x7f1a68007a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.570+0000 7f1a7f7fe640 1 --2- 172.21.15.62:0/1613847526 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x7f1a6003dd90 0x7f1a600401d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.570+0000 7f68a5ffb640 1 -- 172.21.15.62:0/2714796934 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68940408a0 con 0x7f689403dd90 2024-04-23T18:29:04.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.570+0000 7f002dffb640 1 -- 172.21.15.62:0/782987363 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0034018e50 con 0x7f001c03dd70 2024-04-23T18:29:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.570+0000 7f1a7cff9640 1 -- 172.21.15.62:0/1613847526 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a7002edc0 con 0x7f1a6003dd90 2024-04-23T18:29:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.584+0000 7f003f470640 1 -- 172.21.15.62:0/782987363 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00380505b0 con 0x7f001c03dd70 2024-04-23T18:29:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.584+0000 7f68b76e4640 1 -- 172.21.15.62:0/2714796934 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f68b012b730 con 0x7f689403dd90 2024-04-23T18:29:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f68a5ffb640 1 -- 172.21.15.62:0/2714796934 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f68b012b730 con 0x7f689403dd90 2024-04-23T18:29:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f002dffb640 1 -- 172.21.15.62:0/782987363 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f00380505b0 con 0x7f001c03dd70 2024-04-23T18:29:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f68b76e4640 1 -- 172.21.15.62:0/2714796934 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f689403dd90 msgr2=0x7f68940401d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f68b76e4640 1 --2- 172.21.15.62:0/2714796934 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f689403dd90 0x7f68940401d0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f003f470640 1 -- 172.21.15.62:0/782987363 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x7f001c03dd70 msgr2=0x7f001c0401b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f003f470640 1 --2- 172.21.15.62:0/782987363 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x7f001c03dd70 0x7f001c0401b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f68b76e4640 1 -- 172.21.15.62:0/2714796934 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6894038610 msgr2=0x7f689403aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f68b76e4640 1 --2- 172.21.15.62:0/2714796934 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6894038610 0x7f689403aad0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f68a0037000 tx=0x7f68a0031000 comp rx=0 tx=0).stop 2024-04-23T18:29:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f68b76e4640 1 -- 172.21.15.62:0/2714796934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68b012b350 msgr2=0x7f68b008cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f68b76e4640 1 --2- 172.21.15.62:0/2714796934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68b012b350 0x7f68b008cf40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00c380 tx=0x7f68ac00c840 comp rx=0 tx=0).stop 2024-04-23T18:29:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f003f470640 1 -- 172.21.15.62:0/782987363 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f001c0385f0 msgr2=0x7f001c03aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f003f470640 1 --2- 172.21.15.62:0/782987363 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f001c0385f0 0x7f001c03aab0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0028036000 tx=0x7f0028008030 comp rx=0 tx=0).stop 2024-04-23T18:29:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f003f470640 1 -- 172.21.15.62:0/782987363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0038093380 msgr2=0x7f003806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f003f470640 1 --2- 172.21.15.62:0/782987363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0038093380 0x7f003806fd60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f003400c380 tx=0x7f003400c840 comp rx=0 tx=0).stop 2024-04-23T18:29:04.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.585+0000 7f68b76e4640 1 -- 172.21.15.62:0/2714796934 shutdown_connections 2024-04-23T18:29:04.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.586+0000 7f68b76e4640 1 --2- 172.21.15.62:0/2714796934 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f689403dd90 0x7f68940401d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.586+0000 7f68b76e4640 1 --2- 172.21.15.62:0/2714796934 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6894038610 0x7f689403aad0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.586+0000 7f68b76e4640 1 --2- 172.21.15.62:0/2714796934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68b012b350 0x7f68b008cf40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.586+0000 7f68b76e4640 1 -- 172.21.15.62:0/2714796934 >> 172.21.15.62:0/2714796934 conn(0x7f68b0099d00 msgr2=0x7f68b01b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.586+0000 7f003f470640 1 -- 172.21.15.62:0/782987363 shutdown_connections 2024-04-23T18:29:04.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.586+0000 7f003f470640 1 --2- 172.21.15.62:0/782987363 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x7f001c03dd70 0x7f001c0401b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.586+0000 7f68b76e4640 1 -- 172.21.15.62:0/2714796934 shutdown_connections 2024-04-23T18:29:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.586+0000 7f003f470640 1 --2- 172.21.15.62:0/782987363 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f001c0385f0 0x7f001c03aab0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.586+0000 7f003f470640 1 --2- 172.21.15.62:0/782987363 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0038093380 0x7f003806fd60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.586+0000 7f003f470640 1 -- 172.21.15.62:0/782987363 >> 172.21.15.62:0/782987363 conn(0x7f0038099d00 msgr2=0x7f00380979c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.586+0000 7f68b76e4640 1 -- 172.21.15.62:0/2714796934 wait complete. 2024-04-23T18:29:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.586+0000 7f003f470640 1 -- 172.21.15.62:0/782987363 shutdown_connections 2024-04-23T18:29:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.586+0000 7f003f470640 1 -- 172.21.15.62:0/782987363 wait complete. 2024-04-23T18:29:04.604 INFO:teuthology.orchestra.run.smithi062.stdout:38654705668 2024-04-23T18:29:04.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T18:29:04.605 INFO:teuthology.orchestra.run.smithi062.stdout:47244640261 2024-04-23T18:29:04.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T18:29:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.602+0000 7f215b115640 1 -- 172.21.15.62:0/1465511547 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2154097e40 con 0x7f214003de60 2024-04-23T18:29:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.603+0000 7f21517fa640 1 -- 172.21.15.62:0/1465511547 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2154097e40 con 0x7f214003de60 2024-04-23T18:29:04.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.603+0000 7f215b115640 1 -- 172.21.15.62:0/1465511547 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x7f214003de60 msgr2=0x7f21400402a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.603+0000 7f215b115640 1 --2- 172.21.15.62:0/1465511547 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x7f214003de60 0x7f21400402a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.603+0000 7f215b115640 1 -- 172.21.15.62:0/1465511547 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2140038660 msgr2=0x7f214003ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.603+0000 7f215b115640 1 --2- 172.21.15.62:0/1465511547 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2140038660 0x7f214003ab20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2148000f60 tx=0x7f2148007a30 comp rx=0 tx=0).stop 2024-04-23T18:29:04.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.603+0000 7f215b115640 1 -- 172.21.15.62:0/1465511547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215412f470 msgr2=0x7f215408afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.603+0000 7f215b115640 1 --2- 172.21.15.62:0/1465511547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215412f470 0x7f215408afb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f21440090b0 tx=0x7f21440046c0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.603+0000 7f1a85843640 1 -- 172.21.15.62:0/1613847526 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1a800505b0 con 0x7f1a6003dd90 2024-04-23T18:29:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.604+0000 7f215b115640 1 -- 172.21.15.62:0/1465511547 shutdown_connections 2024-04-23T18:29:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.604+0000 7f215b115640 1 --2- 172.21.15.62:0/1465511547 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x7f214003de60 0x7f21400402a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.604+0000 7f215b115640 1 --2- 172.21.15.62:0/1465511547 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2140038660 0x7f214003ab20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.604+0000 7f215b115640 1 --2- 172.21.15.62:0/1465511547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f215412f470 0x7f215408afb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.604+0000 7f215b115640 1 -- 172.21.15.62:0/1465511547 >> 172.21.15.62:0/1465511547 conn(0x7f215409f080 msgr2=0x7f2154097730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.604+0000 7f215b115640 1 -- 172.21.15.62:0/1465511547 shutdown_connections 2024-04-23T18:29:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.604+0000 7f215b115640 1 -- 172.21.15.62:0/1465511547 wait complete. 2024-04-23T18:29:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.604+0000 7f1a7cff9640 1 -- 172.21.15.62:0/1613847526 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1a800505b0 con 0x7f1a6003dd90 2024-04-23T18:29:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.604+0000 7f1a85843640 1 -- 172.21.15.62:0/1613847526 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x7f1a6003dd90 msgr2=0x7f1a600401d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.604+0000 7f1a85843640 1 --2- 172.21.15.62:0/1613847526 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x7f1a6003dd90 0x7f1a600401d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.604+0000 7f1a85843640 1 -- 172.21.15.62:0/1613847526 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1a60038610 msgr2=0x7f1a6003aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.604+0000 7f1a85843640 1 --2- 172.21.15.62:0/1613847526 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1a60038610 0x7f1a6003aad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1a68000f60 tx=0x7f1a68007a30 comp rx=0 tx=0).stop 2024-04-23T18:29:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.605+0000 7f1a85843640 1 -- 172.21.15.62:0/1613847526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a8006f7c0 msgr2=0x7f1a801aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.605+0000 7f1a85843640 1 --2- 172.21.15.62:0/1613847526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a8006f7c0 0x7f1a801aea70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000b2c0 tx=0x7f1a700046c0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.605+0000 7f1a85843640 1 -- 172.21.15.62:0/1613847526 shutdown_connections 2024-04-23T18:29:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.605+0000 7f1a85843640 1 --2- 172.21.15.62:0/1613847526 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x7f1a6003dd90 0x7f1a600401d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.605+0000 7f1a85843640 1 --2- 172.21.15.62:0/1613847526 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1a60038610 0x7f1a6003aad0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.605+0000 7f1a85843640 1 --2- 172.21.15.62:0/1613847526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a8006f7c0 0x7f1a801aea70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.605+0000 7f1a85843640 1 -- 172.21.15.62:0/1613847526 >> 172.21.15.62:0/1613847526 conn(0x7f1a8009df00 msgr2=0x7f1a80072320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.605+0000 7f1a85843640 1 -- 172.21.15.62:0/1613847526 shutdown_connections 2024-04-23T18:29:04.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.605+0000 7f1a85843640 1 -- 172.21.15.62:0/1613847526 wait complete. 2024-04-23T18:29:04.612 INFO:teuthology.orchestra.run.smithi062.stdout:47244640262 2024-04-23T18:29:04.613 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T18:29:04.613 INFO:teuthology.orchestra.run.smithi062.stdout:47244640261 2024-04-23T18:29:04.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T18:29:04.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.723+0000 7fe151fd5640 1 Processor -- start 2024-04-23T18:29:04.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.723+0000 7f58c1996640 1 Processor -- start 2024-04-23T18:29:04.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.723+0000 7f58c1996640 1 -- start start 2024-04-23T18:29:04.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.723+0000 7fe151fd5640 1 -- start start 2024-04-23T18:29:04.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.723+0000 7f58c1996640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f58bc06b980 0x7f58bc06bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.723+0000 7fe151fd5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe14c12b5d0 0x7fe14c12bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.723+0000 7f58c1996640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58bc06fba0 con 0x7f58bc06c2a0 2024-04-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.723+0000 7f58c1996640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f58bc09b300 con 0x7f58bc06b980 2024-04-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.723+0000 7fe151fd5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe14c098e40 con 0x7fe14c12c110 2024-04-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.723+0000 7fe151fd5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe14c12b9b0 con 0x7fe14c12b5d0 2024-04-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.724+0000 7fe14b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe14c12b5d0 0x7fe14c12bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.723+0000 7f58baffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f58bc06b980 0x7f58bc06bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.724+0000 7f58baffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f58bc06b980 0x7f58bc06bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57734/0 (socket says 172.21.15.62:57734) 2024-04-23T18:29:04.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.724+0000 7f58baffd640 1 -- 172.21.15.62:0/3571840881 learned_addr learned my addr 172.21.15.62:0/3571840881 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:04.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.724+0000 7fe14b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe14c12b5d0 0x7fe14c12bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57732/0 (socket says 172.21.15.62:57732) 2024-04-23T18:29:04.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.724+0000 7fe14b7fe640 1 -- 172.21.15.62:0/2901819954 learned_addr learned my addr 172.21.15.62:0/2901819954 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:04.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.724+0000 7f58baffd640 1 -- 172.21.15.62:0/3571840881 >> v1:172.21.15.62:6789/0 conn(0x7f58bc06c2a0 legacy=0x7f58bc12ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.724+0000 7f58baffd640 1 -- 172.21.15.62:0/3571840881 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58bc09e940 con 0x7f58bc06b980 2024-04-23T18:29:04.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.724+0000 7fe14b7fe640 1 -- 172.21.15.62:0/2901819954 >> v1:172.21.15.62:6789/0 conn(0x7fe14c12c110 legacy=0x7fe14c12ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.724+0000 7fe14b7fe640 1 -- 172.21.15.62:0/2901819954 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c06e040 con 0x7fe14c12b5d0 2024-04-23T18:29:04.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.725+0000 7f58baffd640 1 --2- 172.21.15.62:0/3571840881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58bc06b980 0x7f58bc06bd60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0097f0 tx=0x7f58ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40368baa793da59a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.725+0000 7fe14b7fe640 1 --2- 172.21.15.62:0/2901819954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe14c12b5d0 0x7fe14c12bbd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0097f0 tx=0x7fe13c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e40c7774515fb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.725+0000 7f58b9ffb640 1 -- 172.21.15.62:0/3571840881 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ac035020 con 0x7f58bc06b980 2024-04-23T18:29:04.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.725+0000 7f58b9ffb640 1 -- 172.21.15.62:0/3571840881 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ac0317a0 con 0x7f58bc06b980 2024-04-23T18:29:04.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.725+0000 7f58b9ffb640 1 -- 172.21.15.62:0/3571840881 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ac031aa0 con 0x7f58bc06b980 2024-04-23T18:29:04.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7fe14a7fc640 1 -- 172.21.15.62:0/2901819954 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13c034070 con 0x7fe14c12b5d0 2024-04-23T18:29:04.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7fe14a7fc640 1 -- 172.21.15.62:0/2901819954 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe13c030790 con 0x7fe14c12b5d0 2024-04-23T18:29:04.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7fe14a7fc640 1 -- 172.21.15.62:0/2901819954 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13c030a90 con 0x7fe14c12b5d0 2024-04-23T18:29:04.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7f58c1996640 1 -- 172.21.15.62:0/3571840881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58bc06b980 msgr2=0x7f58bc06bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7f58c1996640 1 --2- 172.21.15.62:0/3571840881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58bc06b980 0x7f58bc06bd60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0097f0 tx=0x7f58ac02b910 comp rx=0 tx=0).stop 2024-04-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7f58c1996640 1 -- 172.21.15.62:0/3571840881 shutdown_connections 2024-04-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7f58c1996640 1 --2- 172.21.15.62:0/3571840881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58bc06b980 0x7f58bc06bd60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7f58c1996640 1 -- 172.21.15.62:0/3571840881 >> 172.21.15.62:0/3571840881 conn(0x7f58bc09e110 msgr2=0x7f58bc09a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7f58c1996640 1 -- 172.21.15.62:0/3571840881 shutdown_connections 2024-04-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7fe151fd5640 1 -- 172.21.15.62:0/2901819954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe14c12b5d0 msgr2=0x7fe14c12bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7fe151fd5640 1 --2- 172.21.15.62:0/2901819954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe14c12b5d0 0x7fe14c12bbd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0097f0 tx=0x7fe13c02b9a0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7f58c1996640 1 -- 172.21.15.62:0/3571840881 wait complete. 2024-04-23T18:29:04.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7fe151fd5640 1 -- 172.21.15.62:0/2901819954 shutdown_connections 2024-04-23T18:29:04.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7fe151fd5640 1 --2- 172.21.15.62:0/2901819954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe14c12b5d0 0x7fe14c12bbd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7fe151fd5640 1 -- 172.21.15.62:0/2901819954 >> 172.21.15.62:0/2901819954 conn(0x7fe14c0a11b0 msgr2=0x7fe14c0a15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7fe151fd5640 1 -- 172.21.15.62:0/2901819954 shutdown_connections 2024-04-23T18:29:04.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.726+0000 7fe151fd5640 1 -- 172.21.15.62:0/2901819954 wait complete. 2024-04-23T18:29:04.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.727+0000 7fe151fd5640 1 Processor -- start 2024-04-23T18:29:04.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.727+0000 7fe151fd5640 1 -- start start 2024-04-23T18:29:04.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.728+0000 7f58c1996640 1 Processor -- start 2024-04-23T18:29:04.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.728+0000 7fe151fd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe14c12b5d0 0x7fe14c1c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.728+0000 7fe151fd5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c12f360 con 0x7fe14c12b5d0 2024-04-23T18:29:04.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.728+0000 7fe14b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe14c12b5d0 0x7fe14c1c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.728+0000 7fe14b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe14c12b5d0 0x7fe14c1c3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57752/0 (socket says 172.21.15.62:57752) 2024-04-23T18:29:04.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.728+0000 7fe14b7fe640 1 -- 172.21.15.62:0/2780032460 learned_addr learned my addr 172.21.15.62:0/2780032460 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:04.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.728+0000 7f58c1996640 1 -- start start 2024-04-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.728+0000 7fe14b7fe640 1 -- 172.21.15.62:0/2780032460 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c08d860 con 0x7fe14c12b5d0 2024-04-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.729+0000 7fe14b7fe640 1 --2- 172.21.15.62:0/2780032460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe14c12b5d0 0x7fe14c1c3b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0097f0 tx=0x7fe13c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.729+0000 7fe133fff640 1 -- 172.21.15.62:0/2780032460 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13c048070 con 0x7fe14c12b5d0 2024-04-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.729+0000 7fe133fff640 1 -- 172.21.15.62:0/2780032460 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe13c039ce0 con 0x7fe14c12b5d0 2024-04-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.729+0000 7fe133fff640 1 -- 172.21.15.62:0/2780032460 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13c034040 con 0x7fe14c12b5d0 2024-04-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.729+0000 7fe151fd5640 1 -- 172.21.15.62:0/2780032460 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14c08e030 con 0x7fe14c12b5d0 2024-04-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.729+0000 7f58c1996640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58bc06b980 0x7f58bc1b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.729+0000 7fe151fd5640 1 -- 172.21.15.62:0/2780032460 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14c1c4090 con 0x7fe14c12b5d0 2024-04-23T18:29:04.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.729+0000 7f58c1996640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc09af60 con 0x7f58bc06b980 2024-04-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.729+0000 7f58baffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58bc06b980 0x7f58bc1b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.729+0000 7f58baffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58bc06b980 0x7f58bc1b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57768/0 (socket says 172.21.15.62:57768) 2024-04-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.729+0000 7f58baffd640 1 -- 172.21.15.62:0/346481704 learned_addr learned my addr 172.21.15.62:0/346481704 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.730+0000 7f58baffd640 1 -- 172.21.15.62:0/346481704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58bc1a9600 con 0x7f58bc06b980 2024-04-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.730+0000 7f58baffd640 1 --2- 172.21.15.62:0/346481704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58bc06b980 0x7f58bc1b5670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f58ac02b950 tx=0x7f58ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.730+0000 7fe133fff640 1 -- 172.21.15.62:0/2780032460 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe13c04b070 con 0x7fe14c12b5d0 2024-04-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.730+0000 7fe151fd5640 1 -- 172.21.15.62:0/2780032460 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe14c0505b0 con 0x7fe14c12b5d0 2024-04-23T18:29:04.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.730+0000 7f58a3fff640 1 -- 172.21.15.62:0/346481704 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ac040070 con 0x7f58bc06b980 2024-04-23T18:29:04.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.730+0000 7f58a3fff640 1 -- 172.21.15.62:0/346481704 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ac03a420 con 0x7f58bc06b980 2024-04-23T18:29:04.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.730+0000 7f58a3fff640 1 -- 172.21.15.62:0/346481704 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58ac035040 con 0x7f58bc06b980 2024-04-23T18:29:04.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.730+0000 7f58c1996640 1 -- 172.21.15.62:0/346481704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58bc1b6aa0 con 0x7f58bc06b980 2024-04-23T18:29:04.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.730+0000 7fe133fff640 1 --2- 172.21.15.62:0/2780032460 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe1380385c0 0x7fe13803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.730+0000 7f58c1996640 1 -- 172.21.15.62:0/346481704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58bc096530 con 0x7f58bc06b980 2024-04-23T18:29:04.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.730+0000 7fe133fff640 1 -- 172.21.15.62:0/2780032460 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fe13c040050 con 0x7fe14c12b5d0 2024-04-23T18:29:04.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.731+0000 7fe14affd640 1 --2- 172.21.15.62:0/2780032460 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe1380385c0 0x7fe13803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.731+0000 7fe14affd640 1 --2- 172.21.15.62:0/2780032460 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe1380385c0 0x7fe13803aa80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe140001560 tx=0x7fe140007a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.732+0000 7f58c1996640 1 -- 172.21.15.62:0/346481704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58bc0505b0 con 0x7f58bc06b980 2024-04-23T18:29:04.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.735+0000 7fe133fff640 1 -- 172.21.15.62:0/2780032460 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe13c04b360 con 0x7fe14c12b5d0 2024-04-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.736+0000 7f58a3fff640 1 -- 172.21.15.62:0/346481704 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f58ac04b060 con 0x7f58bc06b980 2024-04-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.736+0000 7f58a3fff640 1 --2- 172.21.15.62:0/346481704 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f58a80385f0 0x7f58a803aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.736+0000 7f58a3fff640 1 -- 172.21.15.62:0/346481704 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f58ac06ddc0 con 0x7f58bc06b980 2024-04-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.737+0000 7f58ba7fc640 1 --2- 172.21.15.62:0/346481704 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f58a80385f0 0x7f58a803aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.737+0000 7f58ba7fc640 1 --2- 172.21.15.62:0/346481704 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f58a80385f0 0x7f58a803aab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f58b0000f60 tx=0x7f58b0007a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.740+0000 7f58a3fff640 1 -- 172.21.15.62:0/346481704 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f58bc1a9600 con 0x7f58bc06b980 2024-04-23T18:29:04.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.769+0000 7faad25a1640 1 Processor -- start 2024-04-23T18:29:04.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.769+0000 7faad25a1640 1 -- start start 2024-04-23T18:29:04.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.770+0000 7faad25a1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faacc12f1d0 0x7faacc12f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.770+0000 7faad25a1640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faacc09e210 con 0x7faacc12eb10 2024-04-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.770+0000 7faad25a1640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7faacc12efb0 con 0x7faacc12f1d0 2024-04-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.770+0000 7faacbfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faacc12f1d0 0x7faacc12f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.770+0000 7faacb7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faacc12eb10 0x7faacc12b5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39716/0 (socket says 172.21.15.62:39716) 2024-04-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.770+0000 7faacbfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faacc12f1d0 0x7faacc12f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57770/0 (socket says 172.21.15.62:57770) 2024-04-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.770+0000 7faacb7fe640 1 -- 172.21.15.62:0/494969501 learned_addr learned my addr 172.21.15.62:0/494969501 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.770+0000 7faacbfff640 1 -- 172.21.15.62:0/494969501 >> v1:172.21.15.62:6789/0 conn(0x7faacc12eb10 legacy=0x7faacc12b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.770+0000 7faacbfff640 1 -- 172.21.15.62:0/494969501 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc098e00 con 0x7faacc12f1d0 2024-04-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.771+0000 7faacbfff640 1 --2- 172.21.15.62:0/494969501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faacc12f1d0 0x7faacc12f5b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faabc009720 tx=0x7faabc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfedb198bc99c55a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.771+0000 7faacaffd640 1 -- 172.21.15.62:0/494969501 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0316d0 con 0x7faacc12f1d0 2024-04-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.771+0000 7faacaffd640 1 -- 172.21.15.62:0/494969501 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc037070 con 0x7faacc12f1d0 2024-04-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.771+0000 7faacaffd640 1 -- 172.21.15.62:0/494969501 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc0319c0 con 0x7faacc12f1d0 2024-04-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.772+0000 7faad25a1640 1 -- 172.21.15.62:0/494969501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faacc12f1d0 msgr2=0x7faacc12f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.772+0000 7faad25a1640 1 --2- 172.21.15.62:0/494969501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faacc12f1d0 0x7faacc12f5b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faabc009720 tx=0x7faabc02b840 comp rx=0 tx=0).stop 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.772+0000 7faad25a1640 1 -- 172.21.15.62:0/494969501 shutdown_connections 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.772+0000 7faad25a1640 1 --2- 172.21.15.62:0/494969501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faacc12f1d0 0x7faacc12f5b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.772+0000 7faad25a1640 1 -- 172.21.15.62:0/494969501 >> 172.21.15.62:0/494969501 conn(0x7faacc0a13c0 msgr2=0x7faacc09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.772+0000 7faad25a1640 1 -- 172.21.15.62:0/494969501 shutdown_connections 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.772+0000 7faad25a1640 1 -- 172.21.15.62:0/494969501 wait complete. 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.773+0000 7faad25a1640 1 Processor -- start 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.773+0000 7faad25a1640 1 -- start start 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.773+0000 7faad25a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faacc12eb10 0x7faacc08bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.773+0000 7faad25a1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7faacc12be60 con 0x7faacc12eb10 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.773+0000 7faacbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faacc12eb10 0x7faacc08bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.773+0000 7faacbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faacc12eb10 0x7faacc08bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57778/0 (socket says 172.21.15.62:57778) 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.773+0000 7faacbfff640 1 -- 172.21.15.62:0/3653611236 learned_addr learned my addr 172.21.15.62:0/3653611236 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.773+0000 7faacbfff640 1 -- 172.21.15.62:0/3653611236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc08f0c0 con 0x7faacc12eb10 2024-04-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.774+0000 7faacbfff640 1 --2- 172.21.15.62:0/3653611236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faacc12eb10 0x7faacc08bf10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faabc034040 tx=0x7faabc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.774+0000 7faac8ff9640 1 -- 172.21.15.62:0/3653611236 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc032770 con 0x7faacc12eb10 2024-04-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.774+0000 7faac8ff9640 1 -- 172.21.15.62:0/3653611236 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faabc032910 con 0x7faacc12eb10 2024-04-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.774+0000 7faad25a1640 1 -- 172.21.15.62:0/3653611236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faacc08e360 con 0x7faacc12eb10 2024-04-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.774+0000 7faac8ff9640 1 -- 172.21.15.62:0/3653611236 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faabc032c30 con 0x7faacc12eb10 2024-04-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.774+0000 7faad25a1640 1 -- 172.21.15.62:0/3653611236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faacc08ea20 con 0x7faacc12eb10 2024-04-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.775+0000 7faac8ff9640 1 -- 172.21.15.62:0/3653611236 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7faabc04c060 con 0x7faacc12eb10 2024-04-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.775+0000 7faad25a1640 1 -- 172.21.15.62:0/3653611236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faacc0505b0 con 0x7faacc12eb10 2024-04-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.775+0000 7faac8ff9640 1 --2- 172.21.15.62:0/3653611236 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7faab80385c0 0x7faab803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.775+0000 7faac8ff9640 1 -- 172.21.15.62:0/3653611236 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7faabc02f050 con 0x7faacc12eb10 2024-04-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.776+0000 7faacb7fe640 1 --2- 172.21.15.62:0/3653611236 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7faab80385c0 0x7faab803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.776+0000 7faacb7fe640 1 --2- 172.21.15.62:0/3653611236 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7faab80385c0 0x7faab803aa80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faac0007fd0 tx=0x7faac0007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.784+0000 7faac8ff9640 1 -- 172.21.15.62:0/3653611236 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faabc040070 con 0x7faacc12eb10 2024-04-23T18:29:04.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.788+0000 7f0a54385640 1 Processor -- start 2024-04-23T18:29:04.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.788+0000 7f0a54385640 1 -- start start 2024-04-23T18:29:04.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.789+0000 7f0a54385640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0a4c097670 0x7f0a4c131ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.789+0000 7f0a54385640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a4c098cf0 con 0x7f0a4c12cf20 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.789+0000 7f0a54385640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0a4c0688d0 con 0x7f0a4c097670 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.789+0000 7f0a52121640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0a4c12cf20 0x7f0a4c12d300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39722/0 (socket says 172.21.15.62:39722) 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.789+0000 7f0a51920640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0a4c097670 0x7f0a4c131ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.789+0000 7f0a52121640 1 -- 172.21.15.62:0/1416875928 learned_addr learned my addr 172.21.15.62:0/1416875928 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.789+0000 7f0a51920640 1 -- 172.21.15.62:0/1416875928 >> v1:172.21.15.62:6789/0 conn(0x7f0a4c12cf20 legacy=0x7f0a4c12d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.789+0000 7f0a51920640 1 -- 172.21.15.62:0/1416875928 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4c098610 con 0x7f0a4c097670 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.790+0000 7f0a51920640 1 --2- 172.21.15.62:0/1416875928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a4c097670 0x7f0a4c131ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009720 tx=0x7f0a3c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d2a5feefd621c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.790+0000 7f0a5111f640 1 -- 172.21.15.62:0/1416875928 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c0316d0 con 0x7f0a4c097670 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.790+0000 7f0a5111f640 1 -- 172.21.15.62:0/1416875928 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3c037070 con 0x7f0a4c097670 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.790+0000 7f0a5111f640 1 -- 172.21.15.62:0/1416875928 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c0319c0 con 0x7f0a4c097670 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.791+0000 7f0a54385640 1 -- 172.21.15.62:0/1416875928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a4c097670 msgr2=0x7f0a4c131ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.791+0000 7f0a54385640 1 --2- 172.21.15.62:0/1416875928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a4c097670 0x7f0a4c131ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009720 tx=0x7f0a3c02b840 comp rx=0 tx=0).stop 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.791+0000 7f0a54385640 1 -- 172.21.15.62:0/1416875928 shutdown_connections 2024-04-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.791+0000 7f0a54385640 1 --2- 172.21.15.62:0/1416875928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a4c097670 0x7f0a4c131ff0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.791+0000 7f0a54385640 1 -- 172.21.15.62:0/1416875928 >> 172.21.15.62:0/1416875928 conn(0x7f0a4c09f010 msgr2=0x7f0a4c09f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.791+0000 7f0a54385640 1 -- 172.21.15.62:0/1416875928 shutdown_connections 2024-04-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.791+0000 7f0a54385640 1 -- 172.21.15.62:0/1416875928 wait complete. 2024-04-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.792+0000 7f0a54385640 1 Processor -- start 2024-04-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.793+0000 7f0a54385640 1 -- start start 2024-04-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.793+0000 7f0a54385640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a4c097670 0x7f0a4c12bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.793+0000 7f0a54385640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4c12da10 con 0x7f0a4c097670 2024-04-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.793+0000 7f0a52121640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a4c097670 0x7f0a4c12bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.793+0000 7f0a52121640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a4c097670 0x7f0a4c12bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57788/0 (socket says 172.21.15.62:57788) 2024-04-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.793+0000 7f0a52121640 1 -- 172.21.15.62:0/1091678025 learned_addr learned my addr 172.21.15.62:0/1091678025 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.794+0000 7f0a52121640 1 -- 172.21.15.62:0/1091678025 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4c06e5a0 con 0x7f0a4c097670 2024-04-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.794+0000 7f0a52121640 1 --2- 172.21.15.62:0/1091678025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a4c097670 0x7f0a4c12bbc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800c4a0 tx=0x7f0a4800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.794+0000 7f0a42ffd640 1 -- 172.21.15.62:0/1091678025 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a48017070 con 0x7f0a4c097670 2024-04-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.794+0000 7f0a42ffd640 1 -- 172.21.15.62:0/1091678025 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a48005c10 con 0x7f0a4c097670 2024-04-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.794+0000 7f0a42ffd640 1 -- 172.21.15.62:0/1091678025 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a48007070 con 0x7f0a4c097670 2024-04-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.794+0000 7f0a54385640 1 -- 172.21.15.62:0/1091678025 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a4c12a240 con 0x7f0a4c097670 2024-04-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.794+0000 7f0a54385640 1 -- 172.21.15.62:0/1091678025 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a4c12b200 con 0x7f0a4c097670 2024-04-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.796+0000 7f0a42ffd640 1 -- 172.21.15.62:0/1091678025 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0a4801a070 con 0x7f0a4c097670 2024-04-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.796+0000 7f0a42ffd640 1 --2- 172.21.15.62:0/1091678025 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0a30038570 0x7f0a3003aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.796+0000 7f0a42ffd640 1 -- 172.21.15.62:0/1091678025 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f0a4804a900 con 0x7f0a4c097670 2024-04-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.796+0000 7f0a54385640 1 -- 172.21.15.62:0/1091678025 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a4c0505b0 con 0x7f0a4c097670 2024-04-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.796+0000 7f0a51920640 1 --2- 172.21.15.62:0/1091678025 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0a30038570 0x7f0a3003aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.797+0000 7f0a51920640 1 --2- 172.21.15.62:0/1091678025 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0a30038570 0x7f0a3003aa30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c036000 tx=0x7f0a3c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.807+0000 7f0a42ffd640 1 -- 172.21.15.62:0/1091678025 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0a4c098cf0 con 0x7f0a4c097670 2024-04-23T18:29:04.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.930+0000 7fe151fd5640 1 -- 172.21.15.62:0/2780032460 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe14c08efb0 con 0x7fe14c12b5d0 2024-04-23T18:29:04.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.930+0000 7fe133fff640 1 -- 172.21.15.62:0/2780032460 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe13c030720 con 0x7fe14c12b5d0 2024-04-23T18:29:04.923 INFO:teuthology.orchestra.run.smithi062.stdout:47244640260 2024-04-23T18:29:04.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.934+0000 7fe151fd5640 1 -- 172.21.15.62:0/2780032460 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe1380385c0 msgr2=0x7fe13803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.934+0000 7fe151fd5640 1 --2- 172.21.15.62:0/2780032460 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe1380385c0 0x7fe13803aa80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe140001560 tx=0x7fe140007a50 comp rx=0 tx=0).stop 2024-04-23T18:29:04.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.934+0000 7fe151fd5640 1 -- 172.21.15.62:0/2780032460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe14c12b5d0 msgr2=0x7fe14c1c3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.934+0000 7fe151fd5640 1 --2- 172.21.15.62:0/2780032460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe14c12b5d0 0x7fe14c1c3b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0097f0 tx=0x7fe13c004730 comp rx=0 tx=0).stop 2024-04-23T18:29:04.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.934+0000 7fe151fd5640 1 -- 172.21.15.62:0/2780032460 shutdown_connections 2024-04-23T18:29:04.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.934+0000 7fe151fd5640 1 --2- 172.21.15.62:0/2780032460 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe1380385c0 0x7fe13803aa80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.934+0000 7fe151fd5640 1 --2- 172.21.15.62:0/2780032460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe14c12b5d0 0x7fe14c1c3b50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.934+0000 7fe151fd5640 1 -- 172.21.15.62:0/2780032460 >> 172.21.15.62:0/2780032460 conn(0x7fe14c0a11b0 msgr2=0x7fe14c099910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.934+0000 7fe151fd5640 1 -- 172.21.15.62:0/2780032460 shutdown_connections 2024-04-23T18:29:04.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.934+0000 7fe151fd5640 1 -- 172.21.15.62:0/2780032460 wait complete. 2024-04-23T18:29:04.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2024-04-23T18:29:04.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.975+0000 7faad25a1640 1 -- 172.21.15.62:0/3653611236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7faacc0730b0 con 0x7faacc12eb10 2024-04-23T18:29:04.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.975+0000 7faac8ff9640 1 -- 172.21.15.62:0/3653611236 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faabc03a380 con 0x7faacc12eb10 2024-04-23T18:29:04.967 INFO:teuthology.orchestra.run.smithi062.stdout:47244640261 2024-04-23T18:29:04.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.976+0000 7f58c1996640 1 -- 172.21.15.62:0/346481704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f58bc0008d0 con 0x7f58bc06b980 2024-04-23T18:29:04.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.976+0000 7f58a3fff640 1 -- 172.21.15.62:0/346481704 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58ac031730 con 0x7f58bc06b980 2024-04-23T18:29:04.968 INFO:teuthology.orchestra.run.smithi062.stdout:38654705667 2024-04-23T18:29:04.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.978+0000 7faad25a1640 1 -- 172.21.15.62:0/3653611236 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7faab80385c0 msgr2=0x7faab803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.978+0000 7faad25a1640 1 --2- 172.21.15.62:0/3653611236 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7faab80385c0 0x7faab803aa80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faac0007fd0 tx=0x7faac0007ac0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.978+0000 7faad25a1640 1 -- 172.21.15.62:0/3653611236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faacc12eb10 msgr2=0x7faacc08bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.978+0000 7faad25a1640 1 --2- 172.21.15.62:0/3653611236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faacc12eb10 0x7faacc08bf10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faabc034040 tx=0x7faabc0046c0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.978+0000 7faad25a1640 1 -- 172.21.15.62:0/3653611236 shutdown_connections 2024-04-23T18:29:04.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.978+0000 7faad25a1640 1 --2- 172.21.15.62:0/3653611236 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7faab80385c0 0x7faab803aa80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.978+0000 7faad25a1640 1 --2- 172.21.15.62:0/3653611236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faacc12eb10 0x7faacc08bf10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.978+0000 7faad25a1640 1 -- 172.21.15.62:0/3653611236 >> 172.21.15.62:0/3653611236 conn(0x7faacc0a13c0 msgr2=0x7faacc12d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.978+0000 7faad25a1640 1 -- 172.21.15.62:0/3653611236 shutdown_connections 2024-04-23T18:29:04.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.978+0000 7faad25a1640 1 -- 172.21.15.62:0/3653611236 wait complete. 2024-04-23T18:29:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.979+0000 7f58c1996640 1 -- 172.21.15.62:0/346481704 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f58a80385f0 msgr2=0x7f58a803aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.979+0000 7f58c1996640 1 --2- 172.21.15.62:0/346481704 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f58a80385f0 0x7f58a803aab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f58b0000f60 tx=0x7f58b0007a30 comp rx=0 tx=0).stop 2024-04-23T18:29:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.979+0000 7f58c1996640 1 -- 172.21.15.62:0/346481704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58bc06b980 msgr2=0x7f58bc1b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.979+0000 7f58c1996640 1 --2- 172.21.15.62:0/346481704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58bc06b980 0x7f58bc1b5670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f58ac02b950 tx=0x7f58ac0046c0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.979+0000 7f58c1996640 1 -- 172.21.15.62:0/346481704 shutdown_connections 2024-04-23T18:29:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.979+0000 7f58c1996640 1 --2- 172.21.15.62:0/346481704 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f58a80385f0 0x7f58a803aab0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.979+0000 7f58c1996640 1 --2- 172.21.15.62:0/346481704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58bc06b980 0x7f58bc1b5670 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.979+0000 7f58c1996640 1 -- 172.21.15.62:0/346481704 >> 172.21.15.62:0/346481704 conn(0x7f58bc09e110 msgr2=0x7f58bc1b6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.979+0000 7f58c1996640 1 -- 172.21.15.62:0/346481704 shutdown_connections 2024-04-23T18:29:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:04.979+0000 7f58c1996640 1 -- 172.21.15.62:0/346481704 wait complete. 2024-04-23T18:29:04.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.1 2024-04-23T18:29:04.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-04-23T18:29:05.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:05.018+0000 7f0a54385640 1 -- 172.21.15.62:0/1091678025 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0a4c06b980 con 0x7f0a4c097670 2024-04-23T18:29:05.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:05.019+0000 7f0a42ffd640 1 -- 172.21.15.62:0/1091678025 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a480124a0 con 0x7f0a4c097670 2024-04-23T18:29:05.011 INFO:teuthology.orchestra.run.smithi062.stdout:47244640260 2024-04-23T18:29:05.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:05.021+0000 7f0a54385640 1 -- 172.21.15.62:0/1091678025 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0a30038570 msgr2=0x7f0a3003aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:05.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:05.021+0000 7f0a54385640 1 --2- 172.21.15.62:0/1091678025 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0a30038570 0x7f0a3003aa30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c036000 tx=0x7f0a3c008030 comp rx=0 tx=0).stop 2024-04-23T18:29:05.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:05.021+0000 7f0a54385640 1 -- 172.21.15.62:0/1091678025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a4c097670 msgr2=0x7f0a4c12bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:05.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:05.021+0000 7f0a54385640 1 --2- 172.21.15.62:0/1091678025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a4c097670 0x7f0a4c12bbc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800c4a0 tx=0x7f0a4800c960 comp rx=0 tx=0).stop 2024-04-23T18:29:05.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:05.021+0000 7f0a54385640 1 -- 172.21.15.62:0/1091678025 shutdown_connections 2024-04-23T18:29:05.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:05.021+0000 7f0a54385640 1 --2- 172.21.15.62:0/1091678025 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0a30038570 0x7f0a3003aa30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:05.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:05.021+0000 7f0a54385640 1 --2- 172.21.15.62:0/1091678025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a4c097670 0x7f0a4c12bbc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:05.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:05.021+0000 7f0a54385640 1 -- 172.21.15.62:0/1091678025 >> 172.21.15.62:0/1091678025 conn(0x7f0a4c09f010 msgr2=0x7f0a4c099940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:05.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:05.021+0000 7f0a54385640 1 -- 172.21.15.62:0/1091678025 shutdown_connections 2024-04-23T18:29:05.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:05.021+0000 7f0a54385640 1 -- 172.21.15.62:0/1091678025 wait complete. 2024-04-23T18:29:05.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.3 2024-04-23T18:29:05.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T18:29:05.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T18:29:05.983 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T18:29:06.024 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T18:29:06.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.063+0000 7fa5c3d7e640 1 Processor -- start 2024-04-23T18:29:06.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.063+0000 7fa5c3d7e640 1 -- start start 2024-04-23T18:29:06.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.063+0000 7fa5c3d7e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa5bc06b980 0x7fa5bc06bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.063+0000 7fa5c3d7e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5bc06fba0 con 0x7fa5bc06c2a0 2024-04-23T18:29:06.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.063+0000 7fa5c3d7e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fa5bc09b300 con 0x7fa5bc06b980 2024-04-23T18:29:06.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.064+0000 7fa5c1319640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa5bc06c2a0 0x7fa5bc12ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39732/0 (socket says 172.21.15.62:39732) 2024-04-23T18:29:06.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.064+0000 7fa5c1319640 1 -- 172.21.15.62:0/2812662625 learned_addr learned my addr 172.21.15.62:0/2812662625 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:06.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.064+0000 7fa5c1b1a640 1 --2- 172.21.15.62:0/2812662625 >> v2:172.21.15.62:3300/0 conn(0x7fa5bc06b980 0x7fa5bc06bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.064+0000 7fa5c1b1a640 1 -- 172.21.15.62:0/2812662625 >> v1:172.21.15.62:6789/0 conn(0x7fa5bc06c2a0 legacy=0x7fa5bc12ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.064+0000 7fa5c1b1a640 1 -- 172.21.15.62:0/2812662625 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5bc09e940 con 0x7fa5bc06b980 2024-04-23T18:29:06.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.065+0000 7fa5c1b1a640 1 --2- 172.21.15.62:0/2812662625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc06b980 0x7fa5bc06bd60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009720 tx=0x7fa5b802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5bb753cb565d6b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.065+0000 7fa5c0b18640 1 -- 172.21.15.62:0/2812662625 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b80316d0 con 0x7fa5bc06b980 2024-04-23T18:29:06.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.065+0000 7fa5c0b18640 1 -- 172.21.15.62:0/2812662625 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b8037070 con 0x7fa5bc06b980 2024-04-23T18:29:06.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.065+0000 7fa5c0b18640 1 -- 172.21.15.62:0/2812662625 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b80319c0 con 0x7fa5bc06b980 2024-04-23T18:29:06.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.066+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/2812662625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc06b980 msgr2=0x7fa5bc06bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.066+0000 7fa5c3d7e640 1 --2- 172.21.15.62:0/2812662625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc06b980 0x7fa5bc06bd60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009720 tx=0x7fa5b802b840 comp rx=0 tx=0).stop 2024-04-23T18:29:06.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.066+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/2812662625 shutdown_connections 2024-04-23T18:29:06.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.066+0000 7fa5c3d7e640 1 --2- 172.21.15.62:0/2812662625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc06b980 0x7fa5bc06bd60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.066+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/2812662625 >> 172.21.15.62:0/2812662625 conn(0x7fa5bc09e110 msgr2=0x7fa5bc09a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:06.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.066+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/2812662625 shutdown_connections 2024-04-23T18:29:06.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.066+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/2812662625 wait complete. 2024-04-23T18:29:06.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.067+0000 7fa5c3d7e640 1 Processor -- start 2024-04-23T18:29:06.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.067+0000 7fa5c3d7e640 1 -- start start 2024-04-23T18:29:06.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.068+0000 7fa5c3d7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc06b980 0x7fa5bc1b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.068+0000 7fa5c3d7e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc09af60 con 0x7fa5bc06b980 2024-04-23T18:29:06.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.068+0000 7fa5c1b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc06b980 0x7fa5bc1b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.068+0000 7fa5c1b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc06b980 0x7fa5bc1b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57810/0 (socket says 172.21.15.62:57810) 2024-04-23T18:29:06.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.068+0000 7fa5c1b1a640 1 -- 172.21.15.62:0/3125492780 learned_addr learned my addr 172.21.15.62:0/3125492780 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:06.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.068+0000 7fa5c1b1a640 1 -- 172.21.15.62:0/3125492780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5bc096780 con 0x7fa5bc06b980 2024-04-23T18:29:06.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.069+0000 7fa5c1b1a640 1 --2- 172.21.15.62:0/3125492780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc06b980 0x7fa5bc1b5700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8034040 tx=0x7fa5b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.069+0000 7fa5b27fc640 1 -- 172.21.15.62:0/3125492780 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b8032770 con 0x7fa5bc06b980 2024-04-23T18:29:06.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.069+0000 7fa5b27fc640 1 -- 172.21.15.62:0/3125492780 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b8032930 con 0x7fa5bc06b980 2024-04-23T18:29:06.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.069+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/3125492780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5bc1b6af0 con 0x7fa5bc06b980 2024-04-23T18:29:06.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.069+0000 7fa5b27fc640 1 -- 172.21.15.62:0/3125492780 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b8032c50 con 0x7fa5bc06b980 2024-04-23T18:29:06.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.069+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/3125492780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5bc1aa1b0 con 0x7fa5bc06b980 2024-04-23T18:29:06.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.070+0000 7fa5b27fc640 1 -- 172.21.15.62:0/3125492780 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa5b804c060 con 0x7fa5bc06b980 2024-04-23T18:29:06.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.070+0000 7fa5b27fc640 1 --2- 172.21.15.62:0/3125492780 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa5a00385c0 0x7fa5a003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.070+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/3125492780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5bc1a9d70 con 0x7fa5bc06b980 2024-04-23T18:29:06.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.071+0000 7fa5b27fc640 1 -- 172.21.15.62:0/3125492780 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fa5b802f050 con 0x7fa5bc06b980 2024-04-23T18:29:06.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.071+0000 7fa5c1319640 1 --2- 172.21.15.62:0/3125492780 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa5a00385c0 0x7fa5a003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.071+0000 7fa5c1319640 1 --2- 172.21.15.62:0/3125492780 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa5a00385c0 0x7fa5a003aa80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac007fd0 tx=0x7fa5ac007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.080+0000 7fa5b27fc640 1 -- 172.21.15.62:0/3125492780 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa5b8040070 con 0x7fa5bc06b980 2024-04-23T18:29:06.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.103+0000 7fe81963f640 1 Processor -- start 2024-04-23T18:29:06.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.104+0000 7fe81963f640 1 -- start start 2024-04-23T18:29:06.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.104+0000 7fe81963f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe81412c2e0 0x7fe814133e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.104+0000 7fe81963f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe814098e40 con 0x7fe81412b5d0 2024-04-23T18:29:06.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.104+0000 7fe81963f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe81412b9b0 con 0x7fe81412c2e0 2024-04-23T18:29:06.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.104+0000 7fe8127fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe81412c2e0 0x7fe814133e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.104+0000 7fe8127fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe81412c2e0 0x7fe814133e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57820/0 (socket says 172.21.15.62:57820) 2024-04-23T18:29:06.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.104+0000 7fe8127fc640 1 -- 172.21.15.62:0/3182130 learned_addr learned my addr 172.21.15.62:0/3182130 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:06.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.104+0000 7fe8127fc640 1 -- 172.21.15.62:0/3182130 >> v1:172.21.15.62:6789/0 conn(0x7fe81412b5d0 legacy=0x7fe81412bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.104+0000 7fe8127fc640 1 -- 172.21.15.62:0/3182130 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81406e040 con 0x7fe81412c2e0 2024-04-23T18:29:06.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.105+0000 7fe8127fc640 1 --2- 172.21.15.62:0/3182130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81412c2e0 0x7fe814133e30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097f0 tx=0x7fe80802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9737552f0781b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.105+0000 7fe811ffb640 1 -- 172.21.15.62:0/3182130 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808034070 con 0x7fe81412c2e0 2024-04-23T18:29:06.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.105+0000 7fe811ffb640 1 -- 172.21.15.62:0/3182130 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe808030790 con 0x7fe81412c2e0 2024-04-23T18:29:06.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.106+0000 7fe811ffb640 1 -- 172.21.15.62:0/3182130 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808030a90 con 0x7fe81412c2e0 2024-04-23T18:29:06.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.106+0000 7fe81963f640 1 -- 172.21.15.62:0/3182130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81412c2e0 msgr2=0x7fe814133e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.106+0000 7fe81963f640 1 --2- 172.21.15.62:0/3182130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81412c2e0 0x7fe814133e30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe8080097f0 tx=0x7fe80802b9a0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.107+0000 7fe81963f640 1 -- 172.21.15.62:0/3182130 shutdown_connections 2024-04-23T18:29:06.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.107+0000 7fe81963f640 1 --2- 172.21.15.62:0/3182130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81412c2e0 0x7fe814133e30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.107+0000 7fe81963f640 1 -- 172.21.15.62:0/3182130 >> 172.21.15.62:0/3182130 conn(0x7fe8140a11b0 msgr2=0x7fe8140a15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:06.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.107+0000 7fe81963f640 1 -- 172.21.15.62:0/3182130 shutdown_connections 2024-04-23T18:29:06.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.107+0000 7fe81963f640 1 -- 172.21.15.62:0/3182130 wait complete. 2024-04-23T18:29:06.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.107+0000 7feb29a47640 1 Processor -- start 2024-04-23T18:29:06.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.107+0000 7feb29a47640 1 -- start start 2024-04-23T18:29:06.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.107+0000 7feb29a47640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feb24128690 0x7feb24128a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.107+0000 7feb29a47640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb24074930 con 0x7feb24095730 2024-04-23T18:29:06.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.107+0000 7feb29a47640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7feb24097170 con 0x7feb24128690 2024-04-23T18:29:06.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.107+0000 7feb22ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feb24128690 0x7feb24128a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.108+0000 7feb227fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7feb24095730 0x7feb24095b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39748/0 (socket says 172.21.15.62:39748) 2024-04-23T18:29:06.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.108+0000 7feb227fc640 1 -- 172.21.15.62:0/3465621886 learned_addr learned my addr 172.21.15.62:0/3465621886 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:06.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.108+0000 7feb22ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feb24128690 0x7feb24128a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57828/0 (socket says 172.21.15.62:57828) 2024-04-23T18:29:06.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.108+0000 7feb22ffd640 1 -- 172.21.15.62:0/3465621886 >> v1:172.21.15.62:6789/0 conn(0x7feb24095730 legacy=0x7feb24095b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.108+0000 7feb22ffd640 1 -- 172.21.15.62:0/3465621886 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2409a430 con 0x7feb24128690 2024-04-23T18:29:06.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.108+0000 7fe81963f640 1 Processor -- start 2024-04-23T18:29:06.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.108+0000 7fe81963f640 1 -- start start 2024-04-23T18:29:06.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.109+0000 7feb22ffd640 1 --2- 172.21.15.62:0/3465621886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb24128690 0x7feb24128a70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feb14009720 tx=0x7feb1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960d204617518bb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.109+0000 7fe81963f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81412b5d0 0x7fe81412fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.109+0000 7feb21ffb640 1 -- 172.21.15.62:0/3465621886 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb140316d0 con 0x7feb24128690 2024-04-23T18:29:06.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.109+0000 7feb21ffb640 1 -- 172.21.15.62:0/3465621886 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb14037070 con 0x7feb24128690 2024-04-23T18:29:06.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.109+0000 7feb21ffb640 1 -- 172.21.15.62:0/3465621886 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb140319c0 con 0x7feb24128690 2024-04-23T18:29:06.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.109+0000 7fe81963f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141344f0 con 0x7fe81412b5d0 2024-04-23T18:29:06.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.109+0000 7fe812ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81412b5d0 0x7fe81412fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.109+0000 7fe812ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81412b5d0 0x7fe81412fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57838/0 (socket says 172.21.15.62:57838) 2024-04-23T18:29:06.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.109+0000 7fe812ffd640 1 -- 172.21.15.62:0/323078324 learned_addr learned my addr 172.21.15.62:0/323078324 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:06.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.109+0000 7fe812ffd640 1 -- 172.21.15.62:0/323078324 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8141312a0 con 0x7fe81412b5d0 2024-04-23T18:29:06.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.110+0000 7fe812ffd640 1 --2- 172.21.15.62:0/323078324 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81412b5d0 0x7fe81412fe30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe80400c340 tx=0x7fe80400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.110+0000 7fe7fb7fe640 1 -- 172.21.15.62:0/323078324 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe804005200 con 0x7fe81412b5d0 2024-04-23T18:29:06.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.110+0000 7fe7fb7fe640 1 -- 172.21.15.62:0/323078324 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8040053c0 con 0x7fe81412b5d0 2024-04-23T18:29:06.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.110+0000 7feb29a47640 1 -- 172.21.15.62:0/3465621886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb24128690 msgr2=0x7feb24128a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.110+0000 7fe7fb7fe640 1 -- 172.21.15.62:0/323078324 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe804007190 con 0x7fe81412b5d0 2024-04-23T18:29:06.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.110+0000 7feb29a47640 1 --2- 172.21.15.62:0/3465621886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb24128690 0x7feb24128a70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feb14009720 tx=0x7feb1402b840 comp rx=0 tx=0).stop 2024-04-23T18:29:06.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.110+0000 7fe81963f640 1 -- 172.21.15.62:0/323078324 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe814131f10 con 0x7fe81412b5d0 2024-04-23T18:29:06.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.110+0000 7feb29a47640 1 -- 172.21.15.62:0/3465621886 shutdown_connections 2024-04-23T18:29:06.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.110+0000 7feb29a47640 1 --2- 172.21.15.62:0/3465621886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb24128690 0x7feb24128a70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.110+0000 7feb29a47640 1 -- 172.21.15.62:0/3465621886 >> 172.21.15.62:0/3465621886 conn(0x7feb2409d850 msgr2=0x7feb24099d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:06.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.110+0000 7feb29a47640 1 -- 172.21.15.62:0/3465621886 shutdown_connections 2024-04-23T18:29:06.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.110+0000 7feb29a47640 1 -- 172.21.15.62:0/3465621886 wait complete. 2024-04-23T18:29:06.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.110+0000 7fe81963f640 1 -- 172.21.15.62:0/323078324 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe814132640 con 0x7fe81412b5d0 2024-04-23T18:29:06.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.111+0000 7feb29a47640 1 Processor -- start 2024-04-23T18:29:06.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.111+0000 7feb29a47640 1 -- start start 2024-04-23T18:29:06.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.111+0000 7fe7fb7fe640 1 -- 172.21.15.62:0/323078324 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe804007330 con 0x7fe81412b5d0 2024-04-23T18:29:06.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.111+0000 7fe7fb7fe640 1 --2- 172.21.15.62:0/323078324 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe800038610 0x7fe80003aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.111+0000 7fe7fb7fe640 1 -- 172.21.15.62:0/323078324 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fe80404aa60 con 0x7fe81412b5d0 2024-04-23T18:29:06.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.112+0000 7feb29a47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb24095730 0x7feb24125220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.112+0000 7feb29a47640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feb24096e60 con 0x7feb24095730 2024-04-23T18:29:06.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.112+0000 7fe8127fc640 1 --2- 172.21.15.62:0/323078324 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe800038610 0x7fe80003aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.112+0000 7feb22ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb24095730 0x7feb24125220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.112+0000 7feb22ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb24095730 0x7feb24125220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57846/0 (socket says 172.21.15.62:57846) 2024-04-23T18:29:06.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.112+0000 7feb22ffd640 1 -- 172.21.15.62:0/2703535975 learned_addr learned my addr 172.21.15.62:0/2703535975 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:06.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.112+0000 7fe81963f640 1 -- 172.21.15.62:0/323078324 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8140505b0 con 0x7fe81412b5d0 2024-04-23T18:29:06.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.112+0000 7feb22ffd640 1 -- 172.21.15.62:0/2703535975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2406dea0 con 0x7feb24095730 2024-04-23T18:29:06.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.112+0000 7feb22ffd640 1 --2- 172.21.15.62:0/2703535975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb24095730 0x7feb24125220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feb14009840 tx=0x7feb140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.113+0000 7fe8127fc640 1 --2- 172.21.15.62:0/323078324 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe800038610 0x7fe80003aad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe808036000 tx=0x7fe808008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.117+0000 7feb0bfff640 1 -- 172.21.15.62:0/2703535975 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb14032640 con 0x7feb24095730 2024-04-23T18:29:06.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.117+0000 7feb0bfff640 1 -- 172.21.15.62:0/2703535975 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb140327e0 con 0x7feb24095730 2024-04-23T18:29:06.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.117+0000 7feb29a47640 1 -- 172.21.15.62:0/2703535975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb24126b30 con 0x7feb24095730 2024-04-23T18:29:06.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.117+0000 7feb0bfff640 1 -- 172.21.15.62:0/2703535975 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb14032b00 con 0x7feb24095730 2024-04-23T18:29:06.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.117+0000 7feb29a47640 1 -- 172.21.15.62:0/2703535975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb24125760 con 0x7feb24095730 2024-04-23T18:29:06.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.117+0000 7fe7fb7fe640 1 -- 172.21.15.62:0/323078324 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe804007620 con 0x7fe81412b5d0 2024-04-23T18:29:06.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.118+0000 7feb0bfff640 1 -- 172.21.15.62:0/2703535975 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7feb1404c060 con 0x7feb24095730 2024-04-23T18:29:06.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.118+0000 7feb0bfff640 1 --2- 172.21.15.62:0/2703535975 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7feb10038610 0x7feb1003aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.118+0000 7feb0bfff640 1 -- 172.21.15.62:0/2703535975 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7feb1402f050 con 0x7feb24095730 2024-04-23T18:29:06.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.118+0000 7feb29a47640 1 -- 172.21.15.62:0/2703535975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb24099d70 con 0x7feb24095730 2024-04-23T18:29:06.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.118+0000 7feb227fc640 1 --2- 172.21.15.62:0/2703535975 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7feb10038610 0x7feb1003aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.119+0000 7feb227fc640 1 --2- 172.21.15.62:0/2703535975 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7feb10038610 0x7feb1003aad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feb18007fd0 tx=0x7feb18007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.123+0000 7feb0bfff640 1 -- 172.21.15.62:0/2703535975 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb24099d70 con 0x7feb24095730 2024-04-23T18:29:06.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.152+0000 7f33016ba640 1 Processor -- start 2024-04-23T18:29:06.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.152+0000 7f33016ba640 1 -- start start 2024-04-23T18:29:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.153+0000 7f33016ba640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f32fc12b5d0 0x7f32fc12bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.153+0000 7f33016ba640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32fc098e40 con 0x7f32fc12c110 2024-04-23T18:29:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.153+0000 7f33016ba640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f32fc12b9b0 con 0x7f32fc12b5d0 2024-04-23T18:29:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.153+0000 7f32faffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f32fc12b5d0 0x7f32fc12bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.153+0000 7f32fa7fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f32fc12c110 0x7f32fc12ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39764/0 (socket says 172.21.15.62:39764) 2024-04-23T18:29:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.153+0000 7f32faffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f32fc12b5d0 0x7f32fc12bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57852/0 (socket says 172.21.15.62:57852) 2024-04-23T18:29:06.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.153+0000 7f32faffd640 1 -- 172.21.15.62:0/3683032448 learned_addr learned my addr 172.21.15.62:0/3683032448 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:06.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.154+0000 7f32f9ffb640 1 -- 172.21.15.62:0/3683032448 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2040635408 0 0) 0x7f32fc098e40 con 0x7f32fc12c110 2024-04-23T18:29:06.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.154+0000 7f32f9ffb640 1 -- 172.21.15.62:0/3683032448 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32e4003520 con 0x7f32fc12c110 2024-04-23T18:29:06.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.154+0000 7f32faffd640 1 -- 172.21.15.62:0/3683032448 >> v1:172.21.15.62:6789/0 conn(0x7f32fc12c110 legacy=0x7f32fc12ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.154+0000 7f32faffd640 1 -- 172.21.15.62:0/3683032448 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32fc06e040 con 0x7f32fc12b5d0 2024-04-23T18:29:06.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.155+0000 7f32faffd640 1 --2- 172.21.15.62:0/3683032448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32fc12b5d0 0x7f32fc12bbd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0097f0 tx=0x7f32ec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9291e557068a3209 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.155+0000 7f32f9ffb640 1 -- 172.21.15.62:0/3683032448 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32ec034070 con 0x7f32fc12b5d0 2024-04-23T18:29:06.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.155+0000 7f32f9ffb640 1 -- 172.21.15.62:0/3683032448 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ec030790 con 0x7f32fc12b5d0 2024-04-23T18:29:06.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.155+0000 7f32f9ffb640 1 -- 172.21.15.62:0/3683032448 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32ec030a90 con 0x7f32fc12b5d0 2024-04-23T18:29:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.155+0000 7f33016ba640 1 -- 172.21.15.62:0/3683032448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32fc12b5d0 msgr2=0x7f32fc12bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.155+0000 7f33016ba640 1 --2- 172.21.15.62:0/3683032448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32fc12b5d0 0x7f32fc12bbd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0097f0 tx=0x7f32ec02b9a0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.155+0000 7f33016ba640 1 -- 172.21.15.62:0/3683032448 shutdown_connections 2024-04-23T18:29:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.155+0000 7f33016ba640 1 --2- 172.21.15.62:0/3683032448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32fc12b5d0 0x7f32fc12bbd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.155+0000 7f33016ba640 1 -- 172.21.15.62:0/3683032448 >> 172.21.15.62:0/3683032448 conn(0x7f32fc0a11b0 msgr2=0x7f32fc0a15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.156+0000 7f33016ba640 1 -- 172.21.15.62:0/3683032448 shutdown_connections 2024-04-23T18:29:06.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.156+0000 7f33016ba640 1 -- 172.21.15.62:0/3683032448 wait complete. 2024-04-23T18:29:06.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.157+0000 7f33016ba640 1 Processor -- start 2024-04-23T18:29:06.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.157+0000 7f33016ba640 1 -- start start 2024-04-23T18:29:06.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.157+0000 7f33016ba640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32fc12b5d0 0x7f32fc08b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.157+0000 7f33016ba640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f32fc12f360 con 0x7f32fc12b5d0 2024-04-23T18:29:06.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.157+0000 7f32faffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32fc12b5d0 0x7f32fc08b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.157+0000 7f32faffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32fc12b5d0 0x7f32fc08b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57866/0 (socket says 172.21.15.62:57866) 2024-04-23T18:29:06.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.157+0000 7f32faffd640 1 -- 172.21.15.62:0/2559203794 learned_addr learned my addr 172.21.15.62:0/2559203794 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:06.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.158+0000 7f32faffd640 1 -- 172.21.15.62:0/2559203794 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32fc08dd30 con 0x7f32fc12b5d0 2024-04-23T18:29:06.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.158+0000 7f32faffd640 1 --2- 172.21.15.62:0/2559203794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32fc12b5d0 0x7f32fc08b800 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0097f0 tx=0x7f32ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.158+0000 7f32e37fe640 1 -- 172.21.15.62:0/2559203794 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32ec048070 con 0x7f32fc12b5d0 2024-04-23T18:29:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.158+0000 7f33016ba640 1 -- 172.21.15.62:0/2559203794 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32fc08d560 con 0x7f32fc12b5d0 2024-04-23T18:29:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.158+0000 7f32e37fe640 1 -- 172.21.15.62:0/2559203794 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ec030e00 con 0x7f32fc12b5d0 2024-04-23T18:29:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.158+0000 7f33016ba640 1 -- 172.21.15.62:0/2559203794 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32fc08bd40 con 0x7f32fc12b5d0 2024-04-23T18:29:06.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.158+0000 7f32e37fe640 1 -- 172.21.15.62:0/2559203794 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32ec048070 con 0x7f32fc12b5d0 2024-04-23T18:29:06.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.159+0000 7f32e37fe640 1 -- 172.21.15.62:0/2559203794 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f32ec04b070 con 0x7f32fc12b5d0 2024-04-23T18:29:06.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.159+0000 7f33016ba640 1 -- 172.21.15.62:0/2559203794 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32dc005080 con 0x7f32fc12b5d0 2024-04-23T18:29:06.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.160+0000 7f32e37fe640 1 --2- 172.21.15.62:0/2559203794 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f32e8038900 0x7f32e803adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.160+0000 7f32e37fe640 1 -- 172.21.15.62:0/2559203794 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f32ec040050 con 0x7f32fc12b5d0 2024-04-23T18:29:06.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.160+0000 7f32fa7fc640 1 --2- 172.21.15.62:0/2559203794 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f32e8038900 0x7f32e803adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.161+0000 7f32fa7fc640 1 --2- 172.21.15.62:0/2559203794 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f32e8038900 0x7f32e803adc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f32f0001610 tx=0x7f32f0007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.165+0000 7f32e37fe640 1 -- 172.21.15.62:0/2559203794 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f32fc08dd30 con 0x7f32fc12b5d0 2024-04-23T18:29:06.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.275+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/3125492780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa5bc0505b0 con 0x7fa5bc06b980 2024-04-23T18:29:06.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.276+0000 7fa5b27fc640 1 -- 172.21.15.62:0/3125492780 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa5b8039310 con 0x7fa5bc06b980 2024-04-23T18:29:06.268 INFO:teuthology.orchestra.run.smithi062.stdout:47244640261 2024-04-23T18:29:06.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.278+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/3125492780 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa5a00385c0 msgr2=0x7fa5a003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.278+0000 7fa5c3d7e640 1 --2- 172.21.15.62:0/3125492780 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa5a00385c0 0x7fa5a003aa80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac007fd0 tx=0x7fa5ac007ac0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.278+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/3125492780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc06b980 msgr2=0x7fa5bc1b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.278+0000 7fa5c3d7e640 1 --2- 172.21.15.62:0/3125492780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc06b980 0x7fa5bc1b5700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8034040 tx=0x7fa5b80046c0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.278+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/3125492780 shutdown_connections 2024-04-23T18:29:06.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.278+0000 7fa5c3d7e640 1 --2- 172.21.15.62:0/3125492780 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa5a00385c0 0x7fa5a003aa80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.278+0000 7fa5c3d7e640 1 --2- 172.21.15.62:0/3125492780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5bc06b980 0x7fa5bc1b5700 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.278+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/3125492780 >> 172.21.15.62:0/3125492780 conn(0x7fa5bc09e110 msgr2=0x7fa5bc1b6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:06.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.278+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/3125492780 shutdown_connections 2024-04-23T18:29:06.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.278+0000 7fa5c3d7e640 1 -- 172.21.15.62:0/3125492780 wait complete. 2024-04-23T18:29:06.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.2 2024-04-23T18:29:06.282 DEBUG:teuthology.parallel:result is None 2024-04-23T18:29:06.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.307+0000 7fe81963f640 1 -- 172.21.15.62:0/323078324 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe8140730b0 con 0x7fe81412b5d0 2024-04-23T18:29:06.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.307+0000 7fe7fb7fe640 1 -- 172.21.15.62:0/323078324 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe804012a70 con 0x7fe81412b5d0 2024-04-23T18:29:06.299 INFO:teuthology.orchestra.run.smithi062.stdout:38654705668 2024-04-23T18:29:06.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.309+0000 7fe81963f640 1 -- 172.21.15.62:0/323078324 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe800038610 msgr2=0x7fe80003aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.309+0000 7fe81963f640 1 --2- 172.21.15.62:0/323078324 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe800038610 0x7fe80003aad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe808036000 tx=0x7fe808008030 comp rx=0 tx=0).stop 2024-04-23T18:29:06.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.309+0000 7fe81963f640 1 -- 172.21.15.62:0/323078324 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81412b5d0 msgr2=0x7fe81412fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.309+0000 7fe81963f640 1 --2- 172.21.15.62:0/323078324 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81412b5d0 0x7fe81412fe30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe80400c340 tx=0x7fe80400c800 comp rx=0 tx=0).stop 2024-04-23T18:29:06.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.309+0000 7fe81963f640 1 -- 172.21.15.62:0/323078324 shutdown_connections 2024-04-23T18:29:06.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.309+0000 7fe81963f640 1 --2- 172.21.15.62:0/323078324 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe800038610 0x7fe80003aad0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.309+0000 7fe81963f640 1 --2- 172.21.15.62:0/323078324 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81412b5d0 0x7fe81412fe30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.309+0000 7fe81963f640 1 -- 172.21.15.62:0/323078324 >> 172.21.15.62:0/323078324 conn(0x7fe8140a11b0 msgr2=0x7fe81409b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:06.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.309+0000 7fe81963f640 1 -- 172.21.15.62:0/323078324 shutdown_connections 2024-04-23T18:29:06.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.309+0000 7fe81963f640 1 -- 172.21.15.62:0/323078324 wait complete. 2024-04-23T18:29:06.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2024-04-23T18:29:06.316 DEBUG:teuthology.parallel:result is None 2024-04-23T18:29:06.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.374+0000 7feb29a47640 1 -- 172.21.15.62:0/2703535975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7feb241263a0 con 0x7feb24095730 2024-04-23T18:29:06.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.375+0000 7feb0bfff640 1 -- 172.21.15.62:0/2703535975 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb14040070 con 0x7feb24095730 2024-04-23T18:29:06.367 INFO:teuthology.orchestra.run.smithi062.stdout:47244640262 2024-04-23T18:29:06.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.378+0000 7feb29a47640 1 -- 172.21.15.62:0/2703535975 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7feb10038610 msgr2=0x7feb1003aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.378+0000 7feb29a47640 1 --2- 172.21.15.62:0/2703535975 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7feb10038610 0x7feb1003aad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feb18007fd0 tx=0x7feb18007ac0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.378+0000 7feb29a47640 1 -- 172.21.15.62:0/2703535975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb24095730 msgr2=0x7feb24125220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.378+0000 7feb29a47640 1 --2- 172.21.15.62:0/2703535975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb24095730 0x7feb24125220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feb14009840 tx=0x7feb140046c0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.378+0000 7feb29a47640 1 -- 172.21.15.62:0/2703535975 shutdown_connections 2024-04-23T18:29:06.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.378+0000 7feb29a47640 1 --2- 172.21.15.62:0/2703535975 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7feb10038610 0x7feb1003aad0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.378+0000 7feb29a47640 1 --2- 172.21.15.62:0/2703535975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feb24095730 0x7feb24125220 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.378+0000 7feb29a47640 1 -- 172.21.15.62:0/2703535975 >> 172.21.15.62:0/2703535975 conn(0x7feb2409d850 msgr2=0x7feb24097c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:06.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.378+0000 7feb29a47640 1 -- 172.21.15.62:0/2703535975 shutdown_connections 2024-04-23T18:29:06.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.378+0000 7feb29a47640 1 -- 172.21.15.62:0/2703535975 wait complete. 2024-04-23T18:29:06.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.1 2024-04-23T18:29:06.384 DEBUG:teuthology.parallel:result is None 2024-04-23T18:29:06.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.416+0000 7f33016ba640 1 -- 172.21.15.62:0/2559203794 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f32dc005370 con 0x7f32fc12b5d0 2024-04-23T18:29:06.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.416+0000 7f32e37fe640 1 -- 172.21.15.62:0/2559203794 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32ec02f570 con 0x7f32fc12b5d0 2024-04-23T18:29:06.408 INFO:teuthology.orchestra.run.smithi062.stdout:47244640261 2024-04-23T18:29:06.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.418+0000 7f33016ba640 1 -- 172.21.15.62:0/2559203794 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f32e8038900 msgr2=0x7f32e803adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.418+0000 7f33016ba640 1 --2- 172.21.15.62:0/2559203794 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f32e8038900 0x7f32e803adc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f32f0001610 tx=0x7f32f0007930 comp rx=0 tx=0).stop 2024-04-23T18:29:06.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.418+0000 7f33016ba640 1 -- 172.21.15.62:0/2559203794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32fc12b5d0 msgr2=0x7f32fc08b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.418+0000 7f33016ba640 1 --2- 172.21.15.62:0/2559203794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32fc12b5d0 0x7f32fc08b800 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0097f0 tx=0x7f32ec004730 comp rx=0 tx=0).stop 2024-04-23T18:29:06.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.418+0000 7f33016ba640 1 -- 172.21.15.62:0/2559203794 shutdown_connections 2024-04-23T18:29:06.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.418+0000 7f33016ba640 1 --2- 172.21.15.62:0/2559203794 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f32e8038900 0x7f32e803adc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.418+0000 7f33016ba640 1 --2- 172.21.15.62:0/2559203794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32fc12b5d0 0x7f32fc08b800 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.418+0000 7f33016ba640 1 -- 172.21.15.62:0/2559203794 >> 172.21.15.62:0/2559203794 conn(0x7f32fc0a11b0 msgr2=0x7f32fc09a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:06.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.418+0000 7f33016ba640 1 -- 172.21.15.62:0/2559203794 shutdown_connections 2024-04-23T18:29:06.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.418+0000 7f33016ba640 1 -- 172.21.15.62:0/2559203794 wait complete. 2024-04-23T18:29:06.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.3 2024-04-23T18:29:06.420 DEBUG:teuthology.parallel:result is None 2024-04-23T18:29:06.420 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T18:29:06.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:29:06.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.568+0000 7f0206f15640 1 Processor -- start 2024-04-23T18:29:06.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.568+0000 7f0206f15640 1 -- start start 2024-04-23T18:29:06.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.569+0000 7f0206f15640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0200131de0 0x7f02001341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.569+0000 7f0206f15640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f020006e5a0 con 0x7f020012ea70 2024-04-23T18:29:06.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.569+0000 7f0206f15640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0200098cc0 con 0x7f0200131de0 2024-04-23T18:29:06.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.569+0000 7f01fffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0200131de0 0x7f02001341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.569+0000 7f0204cb1640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f020012ea70 0x7f020012f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39772/0 (socket says 172.21.15.62:39772) 2024-04-23T18:29:06.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.569+0000 7f0204cb1640 1 -- 172.21.15.62:0/3966042519 learned_addr learned my addr 172.21.15.62:0/3966042519 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:06.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.569+0000 7f01fffff640 1 -- 172.21.15.62:0/3966042519 >> v1:172.21.15.62:6789/0 conn(0x7f020012ea70 legacy=0x7f020012f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.569+0000 7f01ff7fe640 1 -- 172.21.15.62:0/3966042519 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843118726 0 0) 0x7f020006e5a0 con 0x7f020012ea70 2024-04-23T18:29:06.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.569+0000 7f01fffff640 1 -- 172.21.15.62:0/3966042519 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02000989d0 con 0x7f0200131de0 2024-04-23T18:29:06.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.570+0000 7f01fffff640 1 --2- 172.21.15.62:0/3966042519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0200131de0 0x7f02001341d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009720 tx=0x7f01f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119c9b183aa2b24d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.570+0000 7f01ff7fe640 1 -- 172.21.15.62:0/3966042519 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f4035020 con 0x7f0200131de0 2024-04-23T18:29:06.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.570+0000 7f01ff7fe640 1 -- 172.21.15.62:0/3966042519 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f4031760 con 0x7f0200131de0 2024-04-23T18:29:06.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.570+0000 7f01ff7fe640 1 -- 172.21.15.62:0/3966042519 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f4031a60 con 0x7f0200131de0 2024-04-23T18:29:06.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.570+0000 7f0206f15640 1 -- 172.21.15.62:0/3966042519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0200131de0 msgr2=0x7f02001341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.570+0000 7f0206f15640 1 --2- 172.21.15.62:0/3966042519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0200131de0 0x7f02001341d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009720 tx=0x7f01f402b8d0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.571+0000 7f0206f15640 1 -- 172.21.15.62:0/3966042519 shutdown_connections 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.571+0000 7f0206f15640 1 --2- 172.21.15.62:0/3966042519 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0200131de0 0x7f02001341d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.571+0000 7f0206f15640 1 -- 172.21.15.62:0/3966042519 >> 172.21.15.62:0/3966042519 conn(0x7f02000a1000 msgr2=0x7f02000a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.571+0000 7f0206f15640 1 -- 172.21.15.62:0/3966042519 shutdown_connections 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.571+0000 7f0206f15640 1 -- 172.21.15.62:0/3966042519 wait complete. 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.571+0000 7f0206f15640 1 Processor -- start 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.571+0000 7f0206f15640 1 -- start start 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.572+0000 7f0206f15640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020012ea70 0x7f02001291c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.572+0000 7f0206f15640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0200134710 con 0x7f020012ea70 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.572+0000 7f0204cb1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020012ea70 0x7f02001291c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.572+0000 7f0204cb1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020012ea70 0x7f02001291c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57896/0 (socket says 172.21.15.62:57896) 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.572+0000 7f0204cb1640 1 -- 172.21.15.62:0/303611723 learned_addr learned my addr 172.21.15.62:0/303611723 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.572+0000 7f0204cb1640 1 -- 172.21.15.62:0/303611723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020012a260 con 0x7f020012ea70 2024-04-23T18:29:06.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.572+0000 7f0204cb1640 1 --2- 172.21.15.62:0/303611723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020012ea70 0x7f02001291c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f01f000c420 tx=0x7f01f000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.573+0000 7f01fd7fa640 1 -- 172.21.15.62:0/303611723 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0018070 con 0x7f020012ea70 2024-04-23T18:29:06.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.573+0000 7f01fd7fa640 1 -- 172.21.15.62:0/303611723 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f00074d0 con 0x7f020012ea70 2024-04-23T18:29:06.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.573+0000 7f0206f15640 1 -- 172.21.15.62:0/303611723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0200128c10 con 0x7f020012ea70 2024-04-23T18:29:06.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.573+0000 7f01fd7fa640 1 -- 172.21.15.62:0/303611723 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01f0004950 con 0x7f020012ea70 2024-04-23T18:29:06.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.573+0000 7f0206f15640 1 -- 172.21.15.62:0/303611723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f020012a7a0 con 0x7f020012ea70 2024-04-23T18:29:06.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.573+0000 7f01fd7fa640 1 -- 172.21.15.62:0/303611723 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f01f001b070 con 0x7f020012ea70 2024-04-23T18:29:06.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.574+0000 7f0206f15640 1 -- 172.21.15.62:0/303611723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02000505b0 con 0x7f020012ea70 2024-04-23T18:29:06.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.574+0000 7f01fd7fa640 1 --2- 172.21.15.62:0/303611723 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f01ec0385c0 0x7f01ec03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.574+0000 7f01fd7fa640 1 -- 172.21.15.62:0/303611723 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f01f004a9d0 con 0x7f020012ea70 2024-04-23T18:29:06.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.574+0000 7f01fffff640 1 --2- 172.21.15.62:0/303611723 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f01ec0385c0 0x7f01ec03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.574+0000 7f01fffff640 1 --2- 172.21.15.62:0/303611723 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f01ec0385c0 0x7f01ec03aa80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f01f4036000 tx=0x7f01f4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.579+0000 7f01fd7fa640 1 -- 172.21.15.62:0/303611723 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f01f0011960 con 0x7f020012ea70 2024-04-23T18:29:06.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.759+0000 7f0206f15640 1 -- 172.21.15.62:0/303611723 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f020012aa90 con 0x7f01ec0385c0 2024-04-23T18:29:06.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.760+0000 7f01fd7fa640 1 -- 172.21.15.62:0/303611723 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31852 (secure 0 0 0) 0x7f01f4031800 con 0x7f01ec0385c0 2024-04-23T18:29:06.754 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:29:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-04-23T18:29:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.762+0000 7f0206f15640 1 -- 172.21.15.62:0/303611723 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f01ec0385c0 msgr2=0x7f01ec03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.762+0000 7f0206f15640 1 --2- 172.21.15.62:0/303611723 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f01ec0385c0 0x7f01ec03aa80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f01f4036000 tx=0x7f01f4008030 comp rx=0 tx=0).stop 2024-04-23T18:29:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.762+0000 7f0206f15640 1 -- 172.21.15.62:0/303611723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020012ea70 msgr2=0x7f02001291c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.762+0000 7f0206f15640 1 --2- 172.21.15.62:0/303611723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020012ea70 0x7f02001291c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f01f000c420 tx=0x7f01f000c8e0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.762+0000 7f0206f15640 1 -- 172.21.15.62:0/303611723 shutdown_connections 2024-04-23T18:29:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.762+0000 7f0206f15640 1 --2- 172.21.15.62:0/303611723 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f01ec0385c0 0x7f01ec03aa80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.762+0000 7f0206f15640 1 --2- 172.21.15.62:0/303611723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f020012ea70 0x7f02001291c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.762+0000 7f0206f15640 1 -- 172.21.15.62:0/303611723 >> 172.21.15.62:0/303611723 conn(0x7f02000a1000 msgr2=0x7f0200099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:06.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.762+0000 7f0206f15640 1 -- 172.21.15.62:0/303611723 shutdown_connections 2024-04-23T18:29:06.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.762+0000 7f0206f15640 1 -- 172.21.15.62:0/303611723 wait complete. 2024-04-23T18:29:06.765 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-23T18:29:06.681111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":110420,"kb_used_data":1704,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377376940,"statfs":{"total":386547056640,"available":386433986560,"internally_reserved":0,"allocated":1744896,"data_stored":1347032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":110618391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.243617"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-23T18:29:03.598243+0000","last_change":"2024-04-23T18:29:03.594008+0000","last_active":"2024-04-23T18:29:03.598243+0000","last_peered":"2024-04-23T18:29:03.598243+0000","last_clean":"2024-04-23T18:29:03.598243+0000","last_became_active":"2024-04-23T18:29:03.593691+0000","last_became_peered":"2024-04-23T18:29:03.593691+0000","last_unstale":"2024-04-23T18:29:03.598243+0000","last_undegraded":"2024-04-23T18:29:03.598243+0000","last_fullsized":"2024-04-23T18:29:03.598243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:56.462523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-23T18:29:04.492074+0000","last_change":"2024-04-23T18:29:03.446013+0000","last_active":"2024-04-23T18:29:04.492074+0000","last_peered":"2024-04-23T18:29:04.492074+0000","last_clean":"2024-04-23T18:29:04.492074+0000","last_became_active":"2024-04-23T18:29:03.445715+0000","last_became_peered":"2024-04-23T18:29:03.445715+0000","last_unstale":"2024-04-23T18:29:04.492074+0000","last_undegraded":"2024-04-23T18:29:04.492074+0000","last_fullsized":"2024-04-23T18:29:04.492074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:39.084066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-23T18:29:03.452476+0000","last_change":"2024-04-23T18:29:03.447598+0000","last_active":"2024-04-23T18:29:03.452476+0000","last_peered":"2024-04-23T18:29:03.452476+0000","last_clean":"2024-04-23T18:29:03.452476+0000","last_became_active":"2024-04-23T18:29:03.447265+0000","last_became_peered":"2024-04-23T18:29:03.447265+0000","last_unstale":"2024-04-23T18:29:03.452476+0000","last_undegraded":"2024-04-23T18:29:03.452476+0000","last_fullsized":"2024-04-23T18:29:03.452476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:57.409435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-23T18:29:04.492148+0000","last_change":"2024-04-23T18:29:03.446643+0000","last_active":"2024-04-23T18:29:04.492148+0000","last_peered":"2024-04-23T18:29:04.492148+0000","last_clean":"2024-04-23T18:29:04.492148+0000","last_became_active":"2024-04-23T18:29:03.446286+0000","last_became_peered":"2024-04-23T18:29:03.446286+0000","last_unstale":"2024-04-23T18:29:04.492148+0000","last_undegraded":"2024-04-23T18:29:04.492148+0000","last_fullsized":"2024-04-23T18:29:04.492148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:42.594846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-23T18:29:03.447730+0000","last_change":"2024-04-23T18:29:03.446774+0000","last_active":"2024-04-23T18:29:03.447730+0000","last_peered":"2024-04-23T18:29:03.447730+0000","last_clean":"2024-04-23T18:29:03.447730+0000","last_became_active":"2024-04-23T18:29:03.446457+0000","last_became_peered":"2024-04-23T18:29:03.446457+0000","last_unstale":"2024-04-23T18:29:03.447730+0000","last_undegraded":"2024-04-23T18:29:03.447730+0000","last_fullsized":"2024-04-23T18:29:03.447730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:16.921478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-23T18:29:03.449946+0000","last_change":"2024-04-23T18:29:03.447054+0000","last_active":"2024-04-23T18:29:03.449946+0000","last_peered":"2024-04-23T18:29:03.449946+0000","last_clean":"2024-04-23T18:29:03.449946+0000","last_became_active":"2024-04-23T18:29:03.446647+0000","last_became_peered":"2024-04-23T18:29:03.446647+0000","last_unstale":"2024-04-23T18:29:03.449946+0000","last_undegraded":"2024-04-23T18:29:03.449946+0000","last_fullsized":"2024-04-23T18:29:03.449946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:25.495611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-23T18:29:03.452522+0000","last_change":"2024-04-23T18:29:03.447767+0000","last_active":"2024-04-23T18:29:03.452522+0000","last_peered":"2024-04-23T18:29:03.452522+0000","last_clean":"2024-04-23T18:29:03.452522+0000","last_became_active":"2024-04-23T18:29:03.447404+0000","last_became_peered":"2024-04-23T18:29:03.447404+0000","last_unstale":"2024-04-23T18:29:03.452522+0000","last_undegraded":"2024-04-23T18:29:03.452522+0000","last_fullsized":"2024-04-23T18:29:03.452522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:21.727021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-23T18:29:03.447489+0000","last_change":"2024-04-23T18:29:03.446652+0000","last_active":"2024-04-23T18:29:03.447489+0000","last_peered":"2024-04-23T18:29:03.447489+0000","last_clean":"2024-04-23T18:29:03.447489+0000","last_became_active":"2024-04-23T18:29:03.446324+0000","last_became_peered":"2024-04-23T18:29:03.446324+0000","last_unstale":"2024-04-23T18:29:03.447489+0000","last_undegraded":"2024-04-23T18:29:03.447489+0000","last_fullsized":"2024-04-23T18:29:03.447489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:25.495611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":168,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-23T18:29:04.443871+0000","last_change":"2024-04-23T18:28:58.798997+0000","last_active":"2024-04-23T18:29:04.443871+0000","last_peered":"2024-04-23T18:29:04.443871+0000","last_clean":"2024-04-23T18:29:04.443871+0000","last_became_active":"2024-04-23T18:28:58.798001+0000","last_became_peered":"2024-04-23T18:28:58.798001+0000","last_unstale":"2024-04-23T18:29:04.443871+0000","last_undegraded":"2024-04-23T18:29:04.443871+0000","last_fullsized":"2024-04-23T18:29:04.443871+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_clean_scrub_stamp":"2024-04-23T18:28:57.410644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:20.472050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":41580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":631948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28356,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343484,"statfs":{"total":96636764160,"available":96607727616,"internally_reserved":0,"allocated":724992,"data_stored":627904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":147456,"data_stored":45600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:29:06.766 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:29:06.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.873+0000 7f03b94d2640 1 Processor -- start 2024-04-23T18:29:06.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.873+0000 7f03b94d2640 1 -- start start 2024-04-23T18:29:06.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.874+0000 7f03b94d2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f03b4131de0 0x7f03b41341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.874+0000 7f03b94d2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b406e5a0 con 0x7f03b412ea70 2024-04-23T18:29:06.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.874+0000 7f03b94d2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f03b4098cc0 con 0x7f03b4131de0 2024-04-23T18:29:06.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.874+0000 7f03b27fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f03b4131de0 0x7f03b41341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.874+0000 7f03b2ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f03b412ea70 0x7f03b412f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39774/0 (socket says 172.21.15.62:39774) 2024-04-23T18:29:06.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.874+0000 7f03b2ffd640 1 -- 172.21.15.62:0/1718371967 learned_addr learned my addr 172.21.15.62:0/1718371967 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:06.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.874+0000 7f03b27fc640 1 -- 172.21.15.62:0/1718371967 >> v1:172.21.15.62:6789/0 conn(0x7f03b412ea70 legacy=0x7f03b412f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.874+0000 7f03b1ffb640 1 -- 172.21.15.62:0/1718371967 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 52884999 0 0) 0x7f03b406e5a0 con 0x7f03b412ea70 2024-04-23T18:29:06.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.874+0000 7f03b27fc640 1 -- 172.21.15.62:0/1718371967 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b40989d0 con 0x7f03b4131de0 2024-04-23T18:29:06.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.875+0000 7f03b27fc640 1 --2- 172.21.15.62:0/1718371967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b4131de0 0x7f03b41341d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009720 tx=0x7f03a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641b1a3fce45c3c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.875+0000 7f03b1ffb640 1 -- 172.21.15.62:0/1718371967 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a8035020 con 0x7f03b4131de0 2024-04-23T18:29:06.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.875+0000 7f03b1ffb640 1 -- 172.21.15.62:0/1718371967 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a8031760 con 0x7f03b4131de0 2024-04-23T18:29:06.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.875+0000 7f03b1ffb640 1 -- 172.21.15.62:0/1718371967 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a8031a60 con 0x7f03b4131de0 2024-04-23T18:29:06.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.875+0000 7f03b94d2640 1 -- 172.21.15.62:0/1718371967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b4131de0 msgr2=0x7f03b41341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:06.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.875+0000 7f03b94d2640 1 --2- 172.21.15.62:0/1718371967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b4131de0 0x7f03b41341d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009720 tx=0x7f03a802b8d0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.876+0000 7f03b94d2640 1 -- 172.21.15.62:0/1718371967 shutdown_connections 2024-04-23T18:29:06.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.876+0000 7f03b94d2640 1 --2- 172.21.15.62:0/1718371967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b4131de0 0x7f03b41341d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:06.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.876+0000 7f03b94d2640 1 -- 172.21.15.62:0/1718371967 >> 172.21.15.62:0/1718371967 conn(0x7f03b40a1000 msgr2=0x7f03b40a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:06.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.876+0000 7f03b94d2640 1 -- 172.21.15.62:0/1718371967 shutdown_connections 2024-04-23T18:29:06.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.876+0000 7f03b94d2640 1 -- 172.21.15.62:0/1718371967 wait complete. 2024-04-23T18:29:06.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.877+0000 7f03b94d2640 1 Processor -- start 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.877+0000 7f03b94d2640 1 -- start start 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.877+0000 7f03b94d2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b412ea70 0x7f03b41291c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.877+0000 7f03b94d2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f03b4134710 con 0x7f03b412ea70 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.877+0000 7f03b2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b412ea70 0x7f03b41291c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.877+0000 7f03b2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b412ea70 0x7f03b41291c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57912/0 (socket says 172.21.15.62:57912) 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.877+0000 7f03b2ffd640 1 -- 172.21.15.62:0/2571554749 learned_addr learned my addr 172.21.15.62:0/2571554749 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.877+0000 7f03b2ffd640 1 -- 172.21.15.62:0/2571554749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b412a260 con 0x7f03b412ea70 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.878+0000 7f03b2ffd640 1 --2- 172.21.15.62:0/2571554749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b412ea70 0x7f03b41291c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00c420 tx=0x7f03ac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.878+0000 7f039b7fe640 1 -- 172.21.15.62:0/2571554749 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03ac018070 con 0x7f03b412ea70 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.878+0000 7f039b7fe640 1 -- 172.21.15.62:0/2571554749 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ac0074d0 con 0x7f03b412ea70 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.878+0000 7f03b94d2640 1 -- 172.21.15.62:0/2571554749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b4128c10 con 0x7f03b412ea70 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.878+0000 7f039b7fe640 1 -- 172.21.15.62:0/2571554749 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03ac004950 con 0x7f03b412ea70 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.878+0000 7f03b94d2640 1 -- 172.21.15.62:0/2571554749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b412a7a0 con 0x7f03b412ea70 2024-04-23T18:29:06.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.878+0000 7f039b7fe640 1 -- 172.21.15.62:0/2571554749 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f03ac01b070 con 0x7f03b412ea70 2024-04-23T18:29:06.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.879+0000 7f03b94d2640 1 -- 172.21.15.62:0/2571554749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b40505b0 con 0x7f03b412ea70 2024-04-23T18:29:06.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.879+0000 7f039b7fe640 1 --2- 172.21.15.62:0/2571554749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f03a00385c0 0x7f03a003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:06.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.879+0000 7f039b7fe640 1 -- 172.21.15.62:0/2571554749 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f03ac04a950 con 0x7f03b412ea70 2024-04-23T18:29:06.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.879+0000 7f03b27fc640 1 --2- 172.21.15.62:0/2571554749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f03a00385c0 0x7f03a003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:06.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.880+0000 7f03b27fc640 1 --2- 172.21.15.62:0/2571554749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f03a00385c0 0x7f03a003aa80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f03a8036000 tx=0x7f03a8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:06.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:06.883+0000 7f039b7fe640 1 -- 172.21.15.62:0/2571554749 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f03ac017330 con 0x7f03b412ea70 2024-04-23T18:29:07.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.063+0000 7f03b94d2640 1 -- 172.21.15.62:0/2571554749 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03b412aa90 con 0x7f03a00385c0 2024-04-23T18:29:07.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.065+0000 7f039b7fe640 1 -- 172.21.15.62:0/2571554749 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31852 (secure 0 0 0) 0x7f03a8031800 con 0x7f03a00385c0 2024-04-23T18:29:07.057 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:29:07.057 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-04-23T18:29:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.067+0000 7f03b94d2640 1 -- 172.21.15.62:0/2571554749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f03a00385c0 msgr2=0x7f03a003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.067+0000 7f03b94d2640 1 --2- 172.21.15.62:0/2571554749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f03a00385c0 0x7f03a003aa80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f03a8036000 tx=0x7f03a8008030 comp rx=0 tx=0).stop 2024-04-23T18:29:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.067+0000 7f03b94d2640 1 -- 172.21.15.62:0/2571554749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b412ea70 msgr2=0x7f03b41291c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.067+0000 7f03b94d2640 1 --2- 172.21.15.62:0/2571554749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b412ea70 0x7f03b41291c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00c420 tx=0x7f03ac00c8e0 comp rx=0 tx=0).stop 2024-04-23T18:29:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.067+0000 7f03b94d2640 1 -- 172.21.15.62:0/2571554749 shutdown_connections 2024-04-23T18:29:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.067+0000 7f03b94d2640 1 --2- 172.21.15.62:0/2571554749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f03a00385c0 0x7f03a003aa80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.067+0000 7f03b94d2640 1 --2- 172.21.15.62:0/2571554749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b412ea70 0x7f03b41291c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.067+0000 7f03b94d2640 1 -- 172.21.15.62:0/2571554749 >> 172.21.15.62:0/2571554749 conn(0x7f03b40a1000 msgr2=0x7f03b4099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.067+0000 7f03b94d2640 1 -- 172.21.15.62:0/2571554749 shutdown_connections 2024-04-23T18:29:07.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.067+0000 7f03b94d2640 1 -- 172.21.15.62:0/2571554749 wait complete. 2024-04-23T18:29:07.069 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-23T18:29:06.681111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":110420,"kb_used_data":1704,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377376940,"statfs":{"total":386547056640,"available":386433986560,"internally_reserved":0,"allocated":1744896,"data_stored":1347032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":110618391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.243617"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-23T18:29:03.598243+0000","last_change":"2024-04-23T18:29:03.594008+0000","last_active":"2024-04-23T18:29:03.598243+0000","last_peered":"2024-04-23T18:29:03.598243+0000","last_clean":"2024-04-23T18:29:03.598243+0000","last_became_active":"2024-04-23T18:29:03.593691+0000","last_became_peered":"2024-04-23T18:29:03.593691+0000","last_unstale":"2024-04-23T18:29:03.598243+0000","last_undegraded":"2024-04-23T18:29:03.598243+0000","last_fullsized":"2024-04-23T18:29:03.598243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:56.462523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-23T18:29:04.492074+0000","last_change":"2024-04-23T18:29:03.446013+0000","last_active":"2024-04-23T18:29:04.492074+0000","last_peered":"2024-04-23T18:29:04.492074+0000","last_clean":"2024-04-23T18:29:04.492074+0000","last_became_active":"2024-04-23T18:29:03.445715+0000","last_became_peered":"2024-04-23T18:29:03.445715+0000","last_unstale":"2024-04-23T18:29:04.492074+0000","last_undegraded":"2024-04-23T18:29:04.492074+0000","last_fullsized":"2024-04-23T18:29:04.492074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:39.084066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-23T18:29:03.452476+0000","last_change":"2024-04-23T18:29:03.447598+0000","last_active":"2024-04-23T18:29:03.452476+0000","last_peered":"2024-04-23T18:29:03.452476+0000","last_clean":"2024-04-23T18:29:03.452476+0000","last_became_active":"2024-04-23T18:29:03.447265+0000","last_became_peered":"2024-04-23T18:29:03.447265+0000","last_unstale":"2024-04-23T18:29:03.452476+0000","last_undegraded":"2024-04-23T18:29:03.452476+0000","last_fullsized":"2024-04-23T18:29:03.452476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:57.409435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-23T18:29:04.492148+0000","last_change":"2024-04-23T18:29:03.446643+0000","last_active":"2024-04-23T18:29:04.492148+0000","last_peered":"2024-04-23T18:29:04.492148+0000","last_clean":"2024-04-23T18:29:04.492148+0000","last_became_active":"2024-04-23T18:29:03.446286+0000","last_became_peered":"2024-04-23T18:29:03.446286+0000","last_unstale":"2024-04-23T18:29:04.492148+0000","last_undegraded":"2024-04-23T18:29:04.492148+0000","last_fullsized":"2024-04-23T18:29:04.492148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:42.594846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-23T18:29:03.447730+0000","last_change":"2024-04-23T18:29:03.446774+0000","last_active":"2024-04-23T18:29:03.447730+0000","last_peered":"2024-04-23T18:29:03.447730+0000","last_clean":"2024-04-23T18:29:03.447730+0000","last_became_active":"2024-04-23T18:29:03.446457+0000","last_became_peered":"2024-04-23T18:29:03.446457+0000","last_unstale":"2024-04-23T18:29:03.447730+0000","last_undegraded":"2024-04-23T18:29:03.447730+0000","last_fullsized":"2024-04-23T18:29:03.447730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:16.921478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-23T18:29:03.449946+0000","last_change":"2024-04-23T18:29:03.447054+0000","last_active":"2024-04-23T18:29:03.449946+0000","last_peered":"2024-04-23T18:29:03.449946+0000","last_clean":"2024-04-23T18:29:03.449946+0000","last_became_active":"2024-04-23T18:29:03.446647+0000","last_became_peered":"2024-04-23T18:29:03.446647+0000","last_unstale":"2024-04-23T18:29:03.449946+0000","last_undegraded":"2024-04-23T18:29:03.449946+0000","last_fullsized":"2024-04-23T18:29:03.449946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:25.495611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-23T18:29:03.452522+0000","last_change":"2024-04-23T18:29:03.447767+0000","last_active":"2024-04-23T18:29:03.452522+0000","last_peered":"2024-04-23T18:29:03.452522+0000","last_clean":"2024-04-23T18:29:03.452522+0000","last_became_active":"2024-04-23T18:29:03.447404+0000","last_became_peered":"2024-04-23T18:29:03.447404+0000","last_unstale":"2024-04-23T18:29:03.452522+0000","last_undegraded":"2024-04-23T18:29:03.452522+0000","last_fullsized":"2024-04-23T18:29:03.452522+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:21.727021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-23T18:29:03.447489+0000","last_change":"2024-04-23T18:29:03.446652+0000","last_active":"2024-04-23T18:29:03.447489+0000","last_peered":"2024-04-23T18:29:03.447489+0000","last_clean":"2024-04-23T18:29:03.447489+0000","last_became_active":"2024-04-23T18:29:03.446324+0000","last_became_peered":"2024-04-23T18:29:03.446324+0000","last_unstale":"2024-04-23T18:29:03.447489+0000","last_undegraded":"2024-04-23T18:29:03.447489+0000","last_fullsized":"2024-04-23T18:29:03.447489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:25.495611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":168,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-23T18:29:04.443871+0000","last_change":"2024-04-23T18:28:58.798997+0000","last_active":"2024-04-23T18:29:04.443871+0000","last_peered":"2024-04-23T18:29:04.443871+0000","last_clean":"2024-04-23T18:29:04.443871+0000","last_became_active":"2024-04-23T18:28:58.798001+0000","last_became_peered":"2024-04-23T18:28:58.798001+0000","last_unstale":"2024-04-23T18:29:04.443871+0000","last_undegraded":"2024-04-23T18:29:04.443871+0000","last_fullsized":"2024-04-23T18:29:04.443871+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_clean_scrub_stamp":"2024-04-23T18:28:57.410644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:20.472050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":41580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":631948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28356,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343484,"statfs":{"total":96636764160,"available":96607727616,"internally_reserved":0,"allocated":724992,"data_stored":627904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":147456,"data_stored":45600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:29:07.070 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T18:29:07.070 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-23T18:29:07.070 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-23T18:29:07.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T18:29:07.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.177+0000 7ff0dae09640 1 Processor -- start 2024-04-23T18:29:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.177+0000 7ff0dae09640 1 -- start start 2024-04-23T18:29:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.177+0000 7ff0dae09640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff0d412fa60 0x7ff0d4131e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.177+0000 7ff0dae09640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d4093e70 con 0x7ff0d4093380 2024-04-23T18:29:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.177+0000 7ff0dae09640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ff0d4098f60 con 0x7ff0d412fa60 2024-04-23T18:29:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.177+0000 7ff0d3fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff0d412fa60 0x7ff0d4131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.177+0000 7ff0d8ba5640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff0d4093380 0x7ff0d4093760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39784/0 (socket says 172.21.15.62:39784) 2024-04-23T18:29:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.177+0000 7ff0d8ba5640 1 -- 172.21.15.62:0/2554858139 learned_addr learned my addr 172.21.15.62:0/2554858139 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:29:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.178+0000 7ff0d3fff640 1 -- 172.21.15.62:0/2554858139 >> v1:172.21.15.62:6789/0 conn(0x7ff0d4093380 legacy=0x7ff0d4093760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.178+0000 7ff0d3fff640 1 -- 172.21.15.62:0/2554858139 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d4096730 con 0x7ff0d412fa60 2024-04-23T18:29:07.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.178+0000 7ff0d37fe640 1 -- 172.21.15.62:0/2554858139 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96264950 0 0) 0x7ff0d4093e70 con 0x7ff0d4093380 2024-04-23T18:29:07.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.178+0000 7ff0d3fff640 1 --2- 172.21.15.62:0/2554858139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0d412fa60 0x7ff0d4131e50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4009d90 tx=0x7ff0c402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0cdab78da6d679 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:07.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.178+0000 7ff0d37fe640 1 -- 172.21.15.62:0/2554858139 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c4039070 con 0x7ff0d412fa60 2024-04-23T18:29:07.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.178+0000 7ff0d37fe640 1 -- 172.21.15.62:0/2554858139 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c402cb10 con 0x7ff0d412fa60 2024-04-23T18:29:07.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.178+0000 7ff0d37fe640 1 -- 172.21.15.62:0/2554858139 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c402ce10 con 0x7ff0d412fa60 2024-04-23T18:29:07.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.179+0000 7ff0dae09640 1 -- 172.21.15.62:0/2554858139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0d412fa60 msgr2=0x7ff0d4131e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:07.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.179+0000 7ff0dae09640 1 --2- 172.21.15.62:0/2554858139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0d412fa60 0x7ff0d4131e50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4009d90 tx=0x7ff0c402beb0 comp rx=0 tx=0).stop 2024-04-23T18:29:07.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.179+0000 7ff0dae09640 1 -- 172.21.15.62:0/2554858139 shutdown_connections 2024-04-23T18:29:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.179+0000 7ff0dae09640 1 --2- 172.21.15.62:0/2554858139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0d412fa60 0x7ff0d4131e50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.179+0000 7ff0dae09640 1 -- 172.21.15.62:0/2554858139 >> 172.21.15.62:0/2554858139 conn(0x7ff0d4099d00 msgr2=0x7ff0d40975d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.179+0000 7ff0dae09640 1 -- 172.21.15.62:0/2554858139 shutdown_connections 2024-04-23T18:29:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.179+0000 7ff0dae09640 1 -- 172.21.15.62:0/2554858139 wait complete. 2024-04-23T18:29:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.180+0000 7ff0dae09640 1 Processor -- start 2024-04-23T18:29:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.180+0000 7ff0dae09640 1 -- start start 2024-04-23T18:29:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.180+0000 7ff0dae09640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0d4093380 0x7ff0d406d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.180+0000 7ff0dae09640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d4096110 con 0x7ff0d4093380 2024-04-23T18:29:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.180+0000 7ff0d8ba5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0d4093380 0x7ff0d406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.180+0000 7ff0d8ba5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0d4093380 0x7ff0d406d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57928/0 (socket says 172.21.15.62:57928) 2024-04-23T18:29:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.180+0000 7ff0d8ba5640 1 -- 172.21.15.62:0/4230627488 learned_addr learned my addr 172.21.15.62:0/4230627488 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:29:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.181+0000 7ff0d8ba5640 1 -- 172.21.15.62:0/4230627488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d412c560 con 0x7ff0d4093380 2024-04-23T18:29:07.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.181+0000 7ff0d8ba5640 1 --2- 172.21.15.62:0/4230627488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0d4093380 0x7ff0d406d590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00c420 tx=0x7ff0cc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:07.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.181+0000 7ff0d17fa640 1 -- 172.21.15.62:0/4230627488 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0cc018070 con 0x7ff0d4093380 2024-04-23T18:29:07.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.181+0000 7ff0d17fa640 1 -- 172.21.15.62:0/4230627488 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0cc0074d0 con 0x7ff0d4093380 2024-04-23T18:29:07.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.181+0000 7ff0dae09640 1 -- 172.21.15.62:0/4230627488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d406f700 con 0x7ff0d4093380 2024-04-23T18:29:07.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.181+0000 7ff0d17fa640 1 -- 172.21.15.62:0/4230627488 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0cc004950 con 0x7ff0d4093380 2024-04-23T18:29:07.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.181+0000 7ff0dae09640 1 -- 172.21.15.62:0/4230627488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d406e930 con 0x7ff0d4093380 2024-04-23T18:29:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.182+0000 7ff0d17fa640 1 -- 172.21.15.62:0/4230627488 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff0cc01b070 con 0x7ff0d4093380 2024-04-23T18:29:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.182+0000 7ff0dae09640 1 -- 172.21.15.62:0/4230627488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d40505b0 con 0x7ff0d4093380 2024-04-23T18:29:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.182+0000 7ff0d17fa640 1 --2- 172.21.15.62:0/4230627488 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff0b40385c0 0x7ff0b403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.182+0000 7ff0d17fa640 1 -- 172.21.15.62:0/4230627488 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7ff0cc04a930 con 0x7ff0d4093380 2024-04-23T18:29:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.183+0000 7ff0d3fff640 1 --2- 172.21.15.62:0/4230627488 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff0b40385c0 0x7ff0b403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:07.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.183+0000 7ff0d3fff640 1 --2- 172.21.15.62:0/4230627488 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff0b40385c0 0x7ff0b403aa80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4036000 tx=0x7ff0c4030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:07.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.187+0000 7ff0d17fa640 1 -- 172.21.15.62:0/4230627488 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0cc011980 con 0x7ff0d4093380 2024-04-23T18:29:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.409+0000 7ff0dae09640 1 -- 172.21.15.62:0/4230627488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff0d406ba30 con 0x7ff0d4093380 2024-04-23T18:29:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.410+0000 7ff0d17fa640 1 -- 172.21.15.62:0/4230627488 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff0cc011be0 con 0x7ff0d4093380 2024-04-23T18:29:07.402 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:29:07.402 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-23T18:29:07.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.412+0000 7ff0dae09640 1 -- 172.21.15.62:0/4230627488 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff0b40385c0 msgr2=0x7ff0b403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:07.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.412+0000 7ff0dae09640 1 --2- 172.21.15.62:0/4230627488 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff0b40385c0 0x7ff0b403aa80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4036000 tx=0x7ff0c4030000 comp rx=0 tx=0).stop 2024-04-23T18:29:07.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.412+0000 7ff0dae09640 1 -- 172.21.15.62:0/4230627488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0d4093380 msgr2=0x7ff0d406d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:07.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.412+0000 7ff0dae09640 1 --2- 172.21.15.62:0/4230627488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0d4093380 0x7ff0d406d590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00c420 tx=0x7ff0cc00c8e0 comp rx=0 tx=0).stop 2024-04-23T18:29:07.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.412+0000 7ff0dae09640 1 -- 172.21.15.62:0/4230627488 shutdown_connections 2024-04-23T18:29:07.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.412+0000 7ff0dae09640 1 --2- 172.21.15.62:0/4230627488 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff0b40385c0 0x7ff0b403aa80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:07.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.412+0000 7ff0dae09640 1 --2- 172.21.15.62:0/4230627488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff0d4093380 0x7ff0d406d590 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:07.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.412+0000 7ff0dae09640 1 -- 172.21.15.62:0/4230627488 >> 172.21.15.62:0/4230627488 conn(0x7ff0d4099d00 msgr2=0x7ff0d40975d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:07.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.412+0000 7ff0dae09640 1 -- 172.21.15.62:0/4230627488 shutdown_connections 2024-04-23T18:29:07.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:29:07.412+0000 7ff0dae09640 1 -- 172.21.15.62:0/4230627488 wait complete. 2024-04-23T18:29:07.415 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-23T18:29:07.415 INFO:teuthology.run_tasks:Running task rgw... 2024-04-23T18:29:07.429 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-23T18:29:07.429 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-23T18:29:07.429 INFO:tasks.rgw:Creating data pools 2024-04-23T18:29:07.429 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-23T18:29:07.429 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-04-23T18:29:07.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.547+0000 7f3c5763a640 1 Processor -- start 2024-04-23T18:29:07.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.547+0000 7f3c5763a640 1 -- start start 2024-04-23T18:29:07.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.547+0000 7f3c5763a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c5010efe0 0x7f3c5010f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:07.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.547+0000 7f3c5763a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c5011dc00 con 0x7f3c5010f900 2024-04-23T18:29:07.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.547+0000 7f3c5763a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f3c5011ede0 con 0x7f3c5010efe0 2024-04-23T18:29:07.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.547+0000 7f3c553d6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c5010efe0 0x7f3c5010f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:07.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.547+0000 7f3c553d6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3c5010efe0 0x7f3c5010f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54518/0 (socket says 172.21.15.119:54518) 2024-04-23T18:29:07.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.547+0000 7f3c553d6640 1 -- 172.21.15.119:0/1924470073 learned_addr learned my addr 172.21.15.119:0/1924470073 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:07.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.547+0000 7f3c54bd5640 1 --1- 172.21.15.119:0/1924470073 >> v1:172.21.15.62:6789/0 conn(0x7f3c5010f900 0x7f3c5011c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:36020/0 (socket says 172.21.15.119:36020) 2024-04-23T18:29:07.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.548+0000 7f3c553d6640 1 -- 172.21.15.119:0/1924470073 >> v1:172.21.15.62:6789/0 conn(0x7f3c5010f900 legacy=0x7f3c5011c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:07.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.548+0000 7f3c553d6640 1 -- 172.21.15.119:0/1924470073 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5011ef60 con 0x7f3c5010efe0 2024-04-23T18:29:07.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.548+0000 7f3c4ffff640 1 -- 172.21.15.119:0/1924470073 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 772532427 0 0) 0x7f3c5011dc00 con 0x7f3c5010f900 2024-04-23T18:29:07.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.548+0000 7f3c553d6640 1 --2- 172.21.15.119:0/1924470073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5010efe0 0x7f3c5010f3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009e50 tx=0x7f3c4802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74931232f50cc15 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:07.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.548+0000 7f3c4ffff640 1 -- 172.21.15.119:0/1924470073 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4802c8a0 con 0x7f3c5010efe0 2024-04-23T18:29:07.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.549+0000 7f3c4ffff640 1 -- 172.21.15.119:0/1924470073 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4802ca40 con 0x7f3c5010efe0 2024-04-23T18:29:07.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.549+0000 7f3c4ffff640 1 -- 172.21.15.119:0/1924470073 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4802cd40 con 0x7f3c5010efe0 2024-04-23T18:29:07.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.549+0000 7f3c5763a640 1 -- 172.21.15.119:0/1924470073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5010efe0 msgr2=0x7f3c5010f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:07.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.549+0000 7f3c5763a640 1 --2- 172.21.15.119:0/1924470073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5010efe0 0x7f3c5010f3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009e50 tx=0x7f3c4802bf80 comp rx=0 tx=0).stop 2024-04-23T18:29:07.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.549+0000 7f3c5763a640 1 -- 172.21.15.119:0/1924470073 shutdown_connections 2024-04-23T18:29:07.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.549+0000 7f3c5763a640 1 --2- 172.21.15.119:0/1924470073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5010efe0 0x7f3c5010f3c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:07.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.549+0000 7f3c5763a640 1 -- 172.21.15.119:0/1924470073 >> 172.21.15.119:0/1924470073 conn(0x7f3c5006f420 msgr2=0x7f3c50071840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:07.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.549+0000 7f3c5763a640 1 -- 172.21.15.119:0/1924470073 shutdown_connections 2024-04-23T18:29:07.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.549+0000 7f3c5763a640 1 -- 172.21.15.119:0/1924470073 wait complete. 2024-04-23T18:29:07.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.550+0000 7f3c5763a640 1 Processor -- start 2024-04-23T18:29:07.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.550+0000 7f3c5763a640 1 -- start start 2024-04-23T18:29:07.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.550+0000 7f3c5763a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5010efe0 0x7f3c501a6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:07.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.550+0000 7f3c5763a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5011e250 con 0x7f3c5010efe0 2024-04-23T18:29:07.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.550+0000 7f3c553d6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5010efe0 0x7f3c501a6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:07.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.550+0000 7f3c553d6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5010efe0 0x7f3c501a6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54534/0 (socket says 172.21.15.119:54534) 2024-04-23T18:29:07.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.550+0000 7f3c553d6640 1 -- 172.21.15.119:0/589756703 learned_addr learned my addr 172.21.15.119:0/589756703 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:07.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.551+0000 7f3c553d6640 1 -- 172.21.15.119:0/589756703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c501a7390 con 0x7f3c5010efe0 2024-04-23T18:29:07.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.551+0000 7f3c553d6640 1 --2- 172.21.15.119:0/589756703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5010efe0 0x7f3c501a6e50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3c48000f80 tx=0x7f3c48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:07.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.551+0000 7f3c4dffb640 1 -- 172.21.15.119:0/589756703 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c48043020 con 0x7f3c5010efe0 2024-04-23T18:29:07.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.551+0000 7f3c4dffb640 1 -- 172.21.15.119:0/589756703 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4803e660 con 0x7f3c5010efe0 2024-04-23T18:29:07.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.551+0000 7f3c5763a640 1 -- 172.21.15.119:0/589756703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c501a7620 con 0x7f3c5010efe0 2024-04-23T18:29:07.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.551+0000 7f3c4dffb640 1 -- 172.21.15.119:0/589756703 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4803e960 con 0x7f3c5010efe0 2024-04-23T18:29:07.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.551+0000 7f3c5763a640 1 -- 172.21.15.119:0/589756703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c501ab5d0 con 0x7f3c5010efe0 2024-04-23T18:29:07.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.552+0000 7f3c4dffb640 1 -- 172.21.15.119:0/589756703 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3c48046020 con 0x7f3c5010efe0 2024-04-23T18:29:07.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.552+0000 7f3c5763a640 1 -- 172.21.15.119:0/589756703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c500505b0 con 0x7f3c5010efe0 2024-04-23T18:29:07.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.552+0000 7f3c4dffb640 1 --2- 172.21.15.119:0/589756703 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3c3c0385c0 0x7f3c3c03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:07.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.552+0000 7f3c4dffb640 1 -- 172.21.15.119:0/589756703 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f3c4803a040 con 0x7f3c5010efe0 2024-04-23T18:29:07.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.552+0000 7f3c54bd5640 1 --2- 172.21.15.119:0/589756703 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3c3c0385c0 0x7f3c3c03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:07.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.553+0000 7f3c54bd5640 1 --2- 172.21.15.119:0/589756703 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3c3c0385c0 0x7f3c3c03aa80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3c44000c00 tx=0x7f3c44007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:07.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.557+0000 7f3c4dffb640 1 -- 172.21.15.119:0/589756703 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3c4804d030 con 0x7f3c5010efe0 2024-04-23T18:29:07.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:07.740+0000 7f3c5763a640 1 -- 172.21.15.119:0/589756703 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) -- 0x7f3c5010f900 con 0x7f3c5010efe0 2024-04-23T18:29:08.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.453+0000 7f3c4dffb640 1 -- 172.21.15.119:0/589756703 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v18) ==== 151+0+0 (secure 0 0 0) 0x7f3c4803ce10 con 0x7f3c5010efe0 2024-04-23T18:29:08.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.455+0000 7f3c5763a640 1 -- 172.21.15.119:0/589756703 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3c3c0385c0 msgr2=0x7f3c3c03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:08.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.455+0000 7f3c5763a640 1 --2- 172.21.15.119:0/589756703 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3c3c0385c0 0x7f3c3c03aa80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3c44000c00 tx=0x7f3c44007930 comp rx=0 tx=0).stop 2024-04-23T18:29:08.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.455+0000 7f3c5763a640 1 -- 172.21.15.119:0/589756703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5010efe0 msgr2=0x7f3c501a6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:08.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.455+0000 7f3c5763a640 1 --2- 172.21.15.119:0/589756703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5010efe0 0x7f3c501a6e50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3c48000f80 tx=0x7f3c48004a40 comp rx=0 tx=0).stop 2024-04-23T18:29:08.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.455+0000 7f3c5763a640 1 -- 172.21.15.119:0/589756703 shutdown_connections 2024-04-23T18:29:08.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.455+0000 7f3c5763a640 1 --2- 172.21.15.119:0/589756703 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3c3c0385c0 0x7f3c3c03aa80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:08.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.455+0000 7f3c5763a640 1 --2- 172.21.15.119:0/589756703 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3c5010efe0 0x7f3c501a6e50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:08.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.455+0000 7f3c5763a640 1 -- 172.21.15.119:0/589756703 >> 172.21.15.119:0/589756703 conn(0x7f3c5006f420 msgr2=0x7f3c50070680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:08.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.455+0000 7f3c5763a640 1 -- 172.21.15.119:0/589756703 shutdown_connections 2024-04-23T18:29:08.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.455+0000 7f3c5763a640 1 -- 172.21.15.119:0/589756703 wait complete. 2024-04-23T18:29:08.460 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-04-23T18:29:08.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.569+0000 7f0e3059a640 1 Processor -- start 2024-04-23T18:29:08.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.569+0000 7f0e3059a640 1 -- start start 2024-04-23T18:29:08.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.570+0000 7f0e3059a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e281183b0 0x7f0e28118790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:08.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.570+0000 7f0e3059a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e28118e20 con 0x7f0e28112150 2024-04-23T18:29:08.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.570+0000 7f0e3059a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0e28112d10 con 0x7f0e281183b0 2024-04-23T18:29:08.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.570+0000 7f0e2e336640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e281183b0 0x7f0e28118790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:08.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.570+0000 7f0e2e336640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e281183b0 0x7f0e28118790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54550/0 (socket says 172.21.15.119:54550) 2024-04-23T18:29:08.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.570+0000 7f0e2e336640 1 -- 172.21.15.119:0/4090698613 learned_addr learned my addr 172.21.15.119:0/4090698613 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:08.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.570+0000 7f0e2db35640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0e28112150 0x7f0e28112600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:36034/0 (socket says 172.21.15.119:36034) 2024-04-23T18:29:08.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.570+0000 7f0e2e336640 1 -- 172.21.15.119:0/4090698613 >> v1:172.21.15.62:6789/0 conn(0x7f0e28112150 legacy=0x7f0e28112600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:08.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.570+0000 7f0e2e336640 1 -- 172.21.15.119:0/4090698613 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e28112ec0 con 0x7f0e281183b0 2024-04-23T18:29:08.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.571+0000 7f0e2e336640 1 --2- 172.21.15.119:0/4090698613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e281183b0 0x7f0e28118790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0e240097f0 tx=0x7f0e2402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1fda7441ff8633 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:08.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.571+0000 7f0e2d334640 1 -- 172.21.15.119:0/4090698613 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e24035020 con 0x7f0e281183b0 2024-04-23T18:29:08.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.571+0000 7f0e2d334640 1 -- 172.21.15.119:0/4090698613 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e240317a0 con 0x7f0e281183b0 2024-04-23T18:29:08.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.571+0000 7f0e2d334640 1 -- 172.21.15.119:0/4090698613 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e24031aa0 con 0x7f0e281183b0 2024-04-23T18:29:08.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.572+0000 7f0e3059a640 1 -- 172.21.15.119:0/4090698613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e281183b0 msgr2=0x7f0e28118790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:08.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.572+0000 7f0e3059a640 1 --2- 172.21.15.119:0/4090698613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e281183b0 0x7f0e28118790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0e240097f0 tx=0x7f0e2402b910 comp rx=0 tx=0).stop 2024-04-23T18:29:08.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.572+0000 7f0e3059a640 1 -- 172.21.15.119:0/4090698613 shutdown_connections 2024-04-23T18:29:08.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.572+0000 7f0e3059a640 1 --2- 172.21.15.119:0/4090698613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e281183b0 0x7f0e28118790 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:08.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.572+0000 7f0e3059a640 1 -- 172.21.15.119:0/4090698613 >> 172.21.15.119:0/4090698613 conn(0x7f0e2806e6f0 msgr2=0x7f0e2806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:08.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.572+0000 7f0e3059a640 1 -- 172.21.15.119:0/4090698613 shutdown_connections 2024-04-23T18:29:08.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.572+0000 7f0e3059a640 1 -- 172.21.15.119:0/4090698613 wait complete. 2024-04-23T18:29:08.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.573+0000 7f0e3059a640 1 Processor -- start 2024-04-23T18:29:08.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.573+0000 7f0e3059a640 1 -- start start 2024-04-23T18:29:08.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.573+0000 7f0e3059a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e28112150 0x7f0e281acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:08.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.573+0000 7f0e3059a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2811e5f0 con 0x7f0e28112150 2024-04-23T18:29:08.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.573+0000 7f0e2e336640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e28112150 0x7f0e281acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:08.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.573+0000 7f0e2e336640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e28112150 0x7f0e281acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54562/0 (socket says 172.21.15.119:54562) 2024-04-23T18:29:08.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.573+0000 7f0e2e336640 1 -- 172.21.15.119:0/835275339 learned_addr learned my addr 172.21.15.119:0/835275339 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:08.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.573+0000 7f0e2e336640 1 -- 172.21.15.119:0/835275339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e281ad110 con 0x7f0e28112150 2024-04-23T18:29:08.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.573+0000 7f0e2e336640 1 --2- 172.21.15.119:0/835275339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e28112150 0x7f0e281acb40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0e240097f0 tx=0x7f0e240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:08.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.574+0000 7f0e1effd640 1 -- 172.21.15.119:0/835275339 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e2403ad00 con 0x7f0e28112150 2024-04-23T18:29:08.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.574+0000 7f0e1effd640 1 -- 172.21.15.119:0/835275339 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e240443f0 con 0x7f0e28112150 2024-04-23T18:29:08.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.574+0000 7f0e3059a640 1 -- 172.21.15.119:0/835275339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e281ad340 con 0x7f0e28112150 2024-04-23T18:29:08.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.574+0000 7f0e1effd640 1 -- 172.21.15.119:0/835275339 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e240446d0 con 0x7f0e28112150 2024-04-23T18:29:08.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.574+0000 7f0e3059a640 1 -- 172.21.15.119:0/835275339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e281a6bd0 con 0x7f0e28112150 2024-04-23T18:29:08.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.574+0000 7f0e3059a640 1 -- 172.21.15.119:0/835275339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e280505b0 con 0x7f0e28112150 2024-04-23T18:29:08.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.575+0000 7f0e1effd640 1 -- 172.21.15.119:0/835275339 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0e2404b060 con 0x7f0e28112150 2024-04-23T18:29:08.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.575+0000 7f0e1effd640 1 --2- 172.21.15.119:0/835275339 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0e0c0385c0 0x7f0e0c03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:08.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.575+0000 7f0e1effd640 1 -- 172.21.15.119:0/835275339 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3774+0+0 (secure 0 0 0) 0x7f0e2406d930 con 0x7f0e28112150 2024-04-23T18:29:08.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.575+0000 7f0e2db35640 1 --2- 172.21.15.119:0/835275339 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0e0c0385c0 0x7f0e0c03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:08.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.575+0000 7f0e2db35640 1 --2- 172.21.15.119:0/835275339 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0e0c0385c0 0x7f0e0c03aa80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0e180015f0 tx=0x7f0e18007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:08.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.580+0000 7f0e1effd640 1 -- 172.21.15.119:0/835275339 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0e2403f070 con 0x7f0e28112150 2024-04-23T18:29:08.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:08.756+0000 7f0e3059a640 1 -- 172.21.15.119:0/835275339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f0e281183b0 con 0x7f0e28112150 2024-04-23T18:29:10.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.463+0000 7f0e1effd640 1 -- 172.21.15.119:0/835275339 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v20) ==== 227+0+0 (secure 0 0 0) 0x7f0e2404dca0 con 0x7f0e28112150 2024-04-23T18:29:10.455 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'default.rgw.buckets.data' created 2024-04-23T18:29:10.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.466+0000 7f0e3059a640 1 -- 172.21.15.119:0/835275339 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0e0c0385c0 msgr2=0x7f0e0c03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:10.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.466+0000 7f0e3059a640 1 --2- 172.21.15.119:0/835275339 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0e0c0385c0 0x7f0e0c03aa80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0e180015f0 tx=0x7f0e18007a40 comp rx=0 tx=0).stop 2024-04-23T18:29:10.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.466+0000 7f0e3059a640 1 -- 172.21.15.119:0/835275339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e28112150 msgr2=0x7f0e281acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:10.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.466+0000 7f0e3059a640 1 --2- 172.21.15.119:0/835275339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e28112150 0x7f0e281acb40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0e240097f0 tx=0x7f0e240046c0 comp rx=0 tx=0).stop 2024-04-23T18:29:10.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.466+0000 7f0e3059a640 1 -- 172.21.15.119:0/835275339 shutdown_connections 2024-04-23T18:29:10.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.466+0000 7f0e3059a640 1 --2- 172.21.15.119:0/835275339 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0e0c0385c0 0x7f0e0c03aa80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:10.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.466+0000 7f0e3059a640 1 --2- 172.21.15.119:0/835275339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e28112150 0x7f0e281acb40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:10.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.466+0000 7f0e3059a640 1 -- 172.21.15.119:0/835275339 >> 172.21.15.119:0/835275339 conn(0x7f0e2806e6f0 msgr2=0x7f0e28114480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:10.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.466+0000 7f0e3059a640 1 -- 172.21.15.119:0/835275339 shutdown_connections 2024-04-23T18:29:10.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.466+0000 7f0e3059a640 1 -- 172.21.15.119:0/835275339 wait complete. 2024-04-23T18:29:10.478 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-23T18:29:10.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.587+0000 7f009fd75640 1 Processor -- start 2024-04-23T18:29:10.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.587+0000 7f009fd75640 1 -- start start 2024-04-23T18:29:10.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.587+0000 7f009fd75640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f009811b160 0x7f009811d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.587+0000 7f009fd75640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f009811db20 con 0x7f00981183d0 2024-04-23T18:29:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.587+0000 7f009fd75640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f009811ed00 con 0x7f009811b160 2024-04-23T18:29:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.588+0000 7f009d310640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f009811b160 0x7f009811d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.588+0000 7f009d310640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f009811b160 0x7f009811d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54568/0 (socket says 172.21.15.119:54568) 2024-04-23T18:29:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.588+0000 7f009d310640 1 -- 172.21.15.119:0/1861476518 learned_addr learned my addr 172.21.15.119:0/1861476518 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.588+0000 7f009db11640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f00981183d0 0x7f00981187b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:36050/0 (socket says 172.21.15.119:36050) 2024-04-23T18:29:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.588+0000 7f009d310640 1 -- 172.21.15.119:0/1861476518 >> v1:172.21.15.62:6789/0 conn(0x7f00981183d0 legacy=0x7f00981187b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:10.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.588+0000 7f009d310640 1 -- 172.21.15.119:0/1861476518 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009811ee80 con 0x7f009811b160 2024-04-23T18:29:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.589+0000 7f009d310640 1 --2- 172.21.15.119:0/1861476518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f009811b160 0x7f009811d550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f00880097f0 tx=0x7f008802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6278ca2a465f9b64 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.589+0000 7f009cb0f640 1 -- 172.21.15.119:0/1861476518 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0088035020 con 0x7f009811b160 2024-04-23T18:29:10.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.589+0000 7f009cb0f640 1 -- 172.21.15.119:0/1861476518 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00880317a0 con 0x7f009811b160 2024-04-23T18:29:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.589+0000 7f009cb0f640 1 -- 172.21.15.119:0/1861476518 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0088031aa0 con 0x7f009811b160 2024-04-23T18:29:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.589+0000 7f009fd75640 1 -- 172.21.15.119:0/1861476518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f009811b160 msgr2=0x7f009811d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.589+0000 7f009fd75640 1 --2- 172.21.15.119:0/1861476518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f009811b160 0x7f009811d550 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f00880097f0 tx=0x7f008802b910 comp rx=0 tx=0).stop 2024-04-23T18:29:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.590+0000 7f009fd75640 1 -- 172.21.15.119:0/1861476518 shutdown_connections 2024-04-23T18:29:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.590+0000 7f009fd75640 1 --2- 172.21.15.119:0/1861476518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f009811b160 0x7f009811d550 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.590+0000 7f009fd75640 1 -- 172.21.15.119:0/1861476518 >> 172.21.15.119:0/1861476518 conn(0x7f009806d860 msgr2=0x7f009806dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.590+0000 7f009fd75640 1 -- 172.21.15.119:0/1861476518 shutdown_connections 2024-04-23T18:29:10.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.590+0000 7f009fd75640 1 -- 172.21.15.119:0/1861476518 wait complete. 2024-04-23T18:29:10.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.590+0000 7f009fd75640 1 Processor -- start 2024-04-23T18:29:10.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.590+0000 7f009fd75640 1 -- start start 2024-04-23T18:29:10.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.590+0000 7f009fd75640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00981183d0 0x7f00981acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:10.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.590+0000 7f009fd75640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f009811e210 con 0x7f00981183d0 2024-04-23T18:29:10.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.591+0000 7f009db11640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00981183d0 0x7f00981acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:10.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.591+0000 7f009db11640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00981183d0 0x7f00981acba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54572/0 (socket says 172.21.15.119:54572) 2024-04-23T18:29:10.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.591+0000 7f009db11640 1 -- 172.21.15.119:0/1354349067 learned_addr learned my addr 172.21.15.119:0/1354349067 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.591+0000 7f009db11640 1 -- 172.21.15.119:0/1354349067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00981ad170 con 0x7f00981183d0 2024-04-23T18:29:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.591+0000 7f009db11640 1 --2- 172.21.15.119:0/1354349067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00981183d0 0x7f00981acba0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f009400c380 tx=0x7f009400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.591+0000 7f008e7fc640 1 -- 172.21.15.119:0/1354349067 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0094007410 con 0x7f00981183d0 2024-04-23T18:29:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.591+0000 7f008e7fc640 1 -- 172.21.15.119:0/1354349067 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00940075b0 con 0x7f00981183d0 2024-04-23T18:29:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.591+0000 7f009fd75640 1 -- 172.21.15.119:0/1354349067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00981ad3a0 con 0x7f00981183d0 2024-04-23T18:29:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.591+0000 7f008e7fc640 1 -- 172.21.15.119:0/1354349067 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00940047e0 con 0x7f00981183d0 2024-04-23T18:29:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.591+0000 7f009fd75640 1 -- 172.21.15.119:0/1354349067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00981a6c30 con 0x7f00981183d0 2024-04-23T18:29:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.592+0000 7f009fd75640 1 -- 172.21.15.119:0/1354349067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00980505b0 con 0x7f00981183d0 2024-04-23T18:29:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.592+0000 7f008e7fc640 1 -- 172.21.15.119:0/1354349067 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f009401a020 con 0x7f00981183d0 2024-04-23T18:29:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.593+0000 7f008e7fc640 1 --2- 172.21.15.119:0/1354349067 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f007c038570 0x7f007c03aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.593+0000 7f008e7fc640 1 -- 172.21.15.119:0/1354349067 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4249+0+0 (secure 0 0 0) 0x7f009404b180 con 0x7f00981183d0 2024-04-23T18:29:10.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.593+0000 7f009d310640 1 --2- 172.21.15.119:0/1354349067 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f007c038570 0x7f007c03aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:10.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.593+0000 7f009d310640 1 --2- 172.21.15.119:0/1354349067 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f007c038570 0x7f007c03aa30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0088036000 tx=0x7f0088008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:10.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.598+0000 7f008e7fc640 1 -- 172.21.15.119:0/1354349067 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f009401bc30 con 0x7f00981183d0 2024-04-23T18:29:10.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:10.774+0000 7f009fd75640 1 -- 172.21.15.119:0/1354349067 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f009811b160 con 0x7f00981183d0 2024-04-23T18:29:11.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.466+0000 7f008e7fc640 1 -- 172.21.15.119:0/1354349067 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v21) ==== 185+0+0 (secure 0 0 0) 0x7f00940138d0 con 0x7f00981183d0 2024-04-23T18:29:11.459 INFO:teuthology.orchestra.run.smithi119.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-23T18:29:11.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.470+0000 7f009fd75640 1 -- 172.21.15.119:0/1354349067 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f007c038570 msgr2=0x7f007c03aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:11.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.470+0000 7f009fd75640 1 --2- 172.21.15.119:0/1354349067 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f007c038570 0x7f007c03aa30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0088036000 tx=0x7f0088008030 comp rx=0 tx=0).stop 2024-04-23T18:29:11.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.470+0000 7f009fd75640 1 -- 172.21.15.119:0/1354349067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00981183d0 msgr2=0x7f00981acba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:11.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.470+0000 7f009fd75640 1 --2- 172.21.15.119:0/1354349067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00981183d0 0x7f00981acba0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f009400c380 tx=0x7f009400c840 comp rx=0 tx=0).stop 2024-04-23T18:29:11.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.470+0000 7f009fd75640 1 -- 172.21.15.119:0/1354349067 shutdown_connections 2024-04-23T18:29:11.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.470+0000 7f009fd75640 1 --2- 172.21.15.119:0/1354349067 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f007c038570 0x7f007c03aa30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:11.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.470+0000 7f009fd75640 1 --2- 172.21.15.119:0/1354349067 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00981183d0 0x7f00981acba0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:11.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.470+0000 7f009fd75640 1 -- 172.21.15.119:0/1354349067 >> 172.21.15.119:0/1354349067 conn(0x7f009806d860 msgr2=0x7f0098110d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:11.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.470+0000 7f009fd75640 1 -- 172.21.15.119:0/1354349067 shutdown_connections 2024-04-23T18:29:11.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.472+0000 7f009fd75640 1 -- 172.21.15.119:0/1354349067 wait complete. 2024-04-23T18:29:11.489 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-23T18:29:11.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.599+0000 7fdb7dc81640 1 Processor -- start 2024-04-23T18:29:11.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.599+0000 7fdb7dc81640 1 -- start start 2024-04-23T18:29:11.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.599+0000 7fdb7dc81640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdb7811b160 0x7fdb7811d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:11.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.599+0000 7fdb7dc81640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb7811db20 con 0x7fdb781183d0 2024-04-23T18:29:11.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.599+0000 7fdb7dc81640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fdb7811ed00 con 0x7fdb7811b160 2024-04-23T18:29:11.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.600+0000 7fdb76ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdb7811b160 0x7fdb7811d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:11.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.600+0000 7fdb76ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdb7811b160 0x7fdb7811d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54582/0 (socket says 172.21.15.119:54582) 2024-04-23T18:29:11.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.600+0000 7fdb76ffd640 1 -- 172.21.15.119:0/1917242297 learned_addr learned my addr 172.21.15.119:0/1917242297 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:11.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.600+0000 7fdb777fe640 1 --1- 172.21.15.119:0/1917242297 >> v1:172.21.15.62:6789/0 conn(0x7fdb781183d0 0x7fdb781187b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:36054/0 (socket says 172.21.15.119:36054) 2024-04-23T18:29:11.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.600+0000 7fdb76ffd640 1 -- 172.21.15.119:0/1917242297 >> v1:172.21.15.62:6789/0 conn(0x7fdb781183d0 legacy=0x7fdb781187b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:11.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.600+0000 7fdb76ffd640 1 -- 172.21.15.119:0/1917242297 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7811ee80 con 0x7fdb7811b160 2024-04-23T18:29:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.601+0000 7fdb76ffd640 1 --2- 172.21.15.119:0/1917242297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7811b160 0x7fdb7811d550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0097f0 tx=0x7fdb6c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d174753b23bae4f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.601+0000 7fdb767fc640 1 -- 172.21.15.119:0/1917242297 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb6c035020 con 0x7fdb7811b160 2024-04-23T18:29:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.601+0000 7fdb767fc640 1 -- 172.21.15.119:0/1917242297 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb6c0317a0 con 0x7fdb7811b160 2024-04-23T18:29:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.601+0000 7fdb767fc640 1 -- 172.21.15.119:0/1917242297 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb6c031aa0 con 0x7fdb7811b160 2024-04-23T18:29:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.601+0000 7fdb7dc81640 1 -- 172.21.15.119:0/1917242297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7811b160 msgr2=0x7fdb7811d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:11.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.601+0000 7fdb7dc81640 1 --2- 172.21.15.119:0/1917242297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7811b160 0x7fdb7811d550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0097f0 tx=0x7fdb6c02b910 comp rx=0 tx=0).stop 2024-04-23T18:29:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.602+0000 7fdb7dc81640 1 -- 172.21.15.119:0/1917242297 shutdown_connections 2024-04-23T18:29:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.602+0000 7fdb7dc81640 1 --2- 172.21.15.119:0/1917242297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb7811b160 0x7fdb7811d550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.602+0000 7fdb7dc81640 1 -- 172.21.15.119:0/1917242297 >> 172.21.15.119:0/1917242297 conn(0x7fdb7806d860 msgr2=0x7fdb7806dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.602+0000 7fdb7dc81640 1 -- 172.21.15.119:0/1917242297 shutdown_connections 2024-04-23T18:29:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.602+0000 7fdb7dc81640 1 -- 172.21.15.119:0/1917242297 wait complete. 2024-04-23T18:29:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.602+0000 7fdb7dc81640 1 Processor -- start 2024-04-23T18:29:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.602+0000 7fdb7dc81640 1 -- start start 2024-04-23T18:29:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.603+0000 7fdb7dc81640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb781183d0 0x7fdb781acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.603+0000 7fdb7dc81640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7811e210 con 0x7fdb781183d0 2024-04-23T18:29:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.603+0000 7fdb777fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb781183d0 0x7fdb781acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.603+0000 7fdb777fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb781183d0 0x7fdb781acba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54586/0 (socket says 172.21.15.119:54586) 2024-04-23T18:29:11.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.603+0000 7fdb777fe640 1 -- 172.21.15.119:0/3801641197 learned_addr learned my addr 172.21.15.119:0/3801641197 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:11.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.603+0000 7fdb777fe640 1 -- 172.21.15.119:0/3801641197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb781ad170 con 0x7fdb781183d0 2024-04-23T18:29:11.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.603+0000 7fdb777fe640 1 --2- 172.21.15.119:0/3801641197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb781183d0 0x7fdb781acba0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800c450 tx=0x7fdb6800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:11.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.603+0000 7fdb5ffff640 1 -- 172.21.15.119:0/3801641197 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb68007410 con 0x7fdb781183d0 2024-04-23T18:29:11.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.603+0000 7fdb5ffff640 1 -- 172.21.15.119:0/3801641197 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb680075b0 con 0x7fdb781183d0 2024-04-23T18:29:11.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.603+0000 7fdb7dc81640 1 -- 172.21.15.119:0/3801641197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb781ad400 con 0x7fdb781183d0 2024-04-23T18:29:11.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.603+0000 7fdb5ffff640 1 -- 172.21.15.119:0/3801641197 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb68004910 con 0x7fdb781183d0 2024-04-23T18:29:11.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.604+0000 7fdb7dc81640 1 -- 172.21.15.119:0/3801641197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb781a6e10 con 0x7fdb781183d0 2024-04-23T18:29:11.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.604+0000 7fdb5ffff640 1 -- 172.21.15.119:0/3801641197 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fdb6801a020 con 0x7fdb781183d0 2024-04-23T18:29:11.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.604+0000 7fdb7dc81640 1 -- 172.21.15.119:0/3801641197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb780505b0 con 0x7fdb781183d0 2024-04-23T18:29:11.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.605+0000 7fdb5ffff640 1 --2- 172.21.15.119:0/3801641197 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fdb64038570 0x7fdb6403aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:11.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.605+0000 7fdb5ffff640 1 -- 172.21.15.119:0/3801641197 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4260+0+0 (secure 0 0 0) 0x7fdb6804b210 con 0x7fdb781183d0 2024-04-23T18:29:11.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.605+0000 7fdb76ffd640 1 --2- 172.21.15.119:0/3801641197 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fdb64038570 0x7fdb6403aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:11.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.605+0000 7fdb76ffd640 1 --2- 172.21.15.119:0/3801641197 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fdb64038570 0x7fdb6403aa30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c036000 tx=0x7fdb6c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:11.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.610+0000 7fdb5ffff640 1 -- 172.21.15.119:0/3801641197 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdb6801b9f0 con 0x7fdb781183d0 2024-04-23T18:29:11.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:11.787+0000 7fdb7dc81640 1 -- 172.21.15.119:0/3801641197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fdb781ad630 con 0x7fdb781183d0 2024-04-23T18:29:12.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.468+0000 7fdb5ffff640 1 -- 172.21.15.119:0/3801641197 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v22) ==== 169+0+0 (secure 0 0 0) 0x7fdb6801bc50 con 0x7fdb781183d0 2024-04-23T18:29:12.461 INFO:teuthology.orchestra.run.smithi119.stderr:pool 'default.rgw.buckets.index' created 2024-04-23T18:29:12.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.471+0000 7fdb7dc81640 1 -- 172.21.15.119:0/3801641197 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fdb64038570 msgr2=0x7fdb6403aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:12.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.471+0000 7fdb7dc81640 1 --2- 172.21.15.119:0/3801641197 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fdb64038570 0x7fdb6403aa30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c036000 tx=0x7fdb6c008030 comp rx=0 tx=0).stop 2024-04-23T18:29:12.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.471+0000 7fdb7dc81640 1 -- 172.21.15.119:0/3801641197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb781183d0 msgr2=0x7fdb781acba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:12.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.471+0000 7fdb7dc81640 1 --2- 172.21.15.119:0/3801641197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb781183d0 0x7fdb781acba0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800c450 tx=0x7fdb6800c910 comp rx=0 tx=0).stop 2024-04-23T18:29:12.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.472+0000 7fdb7dc81640 1 -- 172.21.15.119:0/3801641197 shutdown_connections 2024-04-23T18:29:12.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.472+0000 7fdb7dc81640 1 --2- 172.21.15.119:0/3801641197 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fdb64038570 0x7fdb6403aa30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:12.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.472+0000 7fdb7dc81640 1 --2- 172.21.15.119:0/3801641197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdb781183d0 0x7fdb781acba0 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800c450 tx=0x7fdb6800c910 comp rx=0 tx=0).stop 2024-04-23T18:29:12.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.472+0000 7fdb7dc81640 1 -- 172.21.15.119:0/3801641197 >> 172.21.15.119:0/3801641197 conn(0x7fdb7806d860 msgr2=0x7fdb78110d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:12.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.472+0000 7fdb7dc81640 1 -- 172.21.15.119:0/3801641197 shutdown_connections 2024-04-23T18:29:12.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.472+0000 7fdb7dc81640 1 -- 172.21.15.119:0/3801641197 wait complete. 2024-04-23T18:29:12.483 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-23T18:29:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.591+0000 7f2e315b6640 1 Processor -- start 2024-04-23T18:29:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.591+0000 7f2e315b6640 1 -- start start 2024-04-23T18:29:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.591+0000 7f2e315b6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2e2c10efe0 0x7f2e2c10f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.591+0000 7f2e315b6640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2c10fb10 con 0x7f2e2c1180e0 2024-04-23T18:29:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.591+0000 7f2e315b6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2e2c11cc00 con 0x7f2e2c10efe0 2024-04-23T18:29:12.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.591+0000 7f2e2affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2e2c10efe0 0x7f2e2c10f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:12.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.591+0000 7f2e2a7fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2e2c1180e0 0x7f2e2c11a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:36062/0 (socket says 172.21.15.119:36062) 2024-04-23T18:29:12.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.591+0000 7f2e2affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2e2c10efe0 0x7f2e2c10f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54596/0 (socket says 172.21.15.119:54596) 2024-04-23T18:29:12.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.591+0000 7f2e2a7fc640 1 -- 172.21.15.119:0/4180731898 learned_addr learned my addr 172.21.15.119:0/4180731898 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:12.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.592+0000 7f2e2affd640 1 -- 172.21.15.119:0/4180731898 >> v1:172.21.15.62:6789/0 conn(0x7f2e2c1180e0 legacy=0x7f2e2c11a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:12.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.592+0000 7f2e2affd640 1 -- 172.21.15.119:0/4180731898 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c11cd80 con 0x7f2e2c10efe0 2024-04-23T18:29:12.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.592+0000 7f2e2affd640 1 --2- 172.21.15.119:0/4180731898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e2c10efe0 0x7f2e2c10f3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009720 tx=0x7f2e1c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f077c830ce20c77 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:12.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.593+0000 7f2e29ffb640 1 -- 172.21.15.119:0/4180731898 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c0316d0 con 0x7f2e2c10efe0 2024-04-23T18:29:12.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.593+0000 7f2e29ffb640 1 -- 172.21.15.119:0/4180731898 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c037070 con 0x7f2e2c10efe0 2024-04-23T18:29:12.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.593+0000 7f2e29ffb640 1 -- 172.21.15.119:0/4180731898 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c0319c0 con 0x7f2e2c10efe0 2024-04-23T18:29:12.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.593+0000 7f2e315b6640 1 -- 172.21.15.119:0/4180731898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e2c10efe0 msgr2=0x7f2e2c10f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.593+0000 7f2e315b6640 1 --2- 172.21.15.119:0/4180731898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e2c10efe0 0x7f2e2c10f3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009720 tx=0x7f2e1c02b840 comp rx=0 tx=0).stop 2024-04-23T18:29:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.593+0000 7f2e315b6640 1 -- 172.21.15.119:0/4180731898 shutdown_connections 2024-04-23T18:29:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.593+0000 7f2e315b6640 1 --2- 172.21.15.119:0/4180731898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e2c10efe0 0x7f2e2c10f3c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.593+0000 7f2e315b6640 1 -- 172.21.15.119:0/4180731898 >> 172.21.15.119:0/4180731898 conn(0x7f2e2c06f420 msgr2=0x7f2e2c071840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.593+0000 7f2e315b6640 1 -- 172.21.15.119:0/4180731898 shutdown_connections 2024-04-23T18:29:12.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.593+0000 7f2e315b6640 1 -- 172.21.15.119:0/4180731898 wait complete. 2024-04-23T18:29:12.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.594+0000 7f2e315b6640 1 Processor -- start 2024-04-23T18:29:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.594+0000 7f2e315b6640 1 -- start start 2024-04-23T18:29:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.594+0000 7f2e315b6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e2c10efe0 0x7f2e2c1aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.594+0000 7f2e315b6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c11c110 con 0x7f2e2c10efe0 2024-04-23T18:29:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.595+0000 7f2e2affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e2c10efe0 0x7f2e2c1aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.595+0000 7f2e2affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e2c10efe0 0x7f2e2c1aaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54606/0 (socket says 172.21.15.119:54606) 2024-04-23T18:29:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.595+0000 7f2e2affd640 1 -- 172.21.15.119:0/1572127531 learned_addr learned my addr 172.21.15.119:0/1572127531 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.595+0000 7f2e2affd640 1 -- 172.21.15.119:0/1572127531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c1ab090 con 0x7f2e2c10efe0 2024-04-23T18:29:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.595+0000 7f2e2affd640 1 --2- 172.21.15.119:0/1572127531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e2c10efe0 0x7f2e2c1aaac0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c034040 tx=0x7f2e1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.595+0000 7f2e137fe640 1 -- 172.21.15.119:0/1572127531 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c032770 con 0x7f2e2c10efe0 2024-04-23T18:29:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.596+0000 7f2e137fe640 1 -- 172.21.15.119:0/1572127531 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1c032910 con 0x7f2e2c10efe0 2024-04-23T18:29:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.596+0000 7f2e315b6640 1 -- 172.21.15.119:0/1572127531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2c1ab2c0 con 0x7f2e2c10efe0 2024-04-23T18:29:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.596+0000 7f2e137fe640 1 -- 172.21.15.119:0/1572127531 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e1c032c10 con 0x7f2e2c10efe0 2024-04-23T18:29:12.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.596+0000 7f2e315b6640 1 -- 172.21.15.119:0/1572127531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e2c1a4b50 con 0x7f2e2c10efe0 2024-04-23T18:29:12.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.596+0000 7f2e137fe640 1 -- 172.21.15.119:0/1572127531 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2e1c04c060 con 0x7f2e2c10efe0 2024-04-23T18:29:12.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.597+0000 7f2e315b6640 1 -- 172.21.15.119:0/1572127531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e2c0505b0 con 0x7f2e2c10efe0 2024-04-23T18:29:12.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.597+0000 7f2e137fe640 1 --2- 172.21.15.119:0/1572127531 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e180385c0 0x7f2e1803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:12.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.597+0000 7f2e137fe640 1 -- 172.21.15.119:0/1572127531 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4624+0+0 (secure 0 0 0) 0x7f2e1c02f050 con 0x7f2e2c10efe0 2024-04-23T18:29:12.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.597+0000 7f2e2a7fc640 1 --2- 172.21.15.119:0/1572127531 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e180385c0 0x7f2e1803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:12.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.597+0000 7f2e2a7fc640 1 --2- 172.21.15.119:0/1572127531 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e180385c0 0x7f2e1803aa80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0741f0 tx=0x7f2e20007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:12.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.602+0000 7f2e137fe640 1 -- 172.21.15.119:0/1572127531 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e1c040070 con 0x7f2e2c10efe0 2024-04-23T18:29:12.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:12.777+0000 7f2e315b6640 1 -- 172.21.15.119:0/1572127531 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f2e2c1180e0 con 0x7f2e2c10efe0 2024-04-23T18:29:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:13.474+0000 7f2e137fe640 1 -- 172.21.15.119:0/1572127531 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v23) ==== 187+0+0 (secure 0 0 0) 0x7f2e1c044df0 con 0x7f2e2c10efe0 2024-04-23T18:29:13.467 INFO:teuthology.orchestra.run.smithi119.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-23T18:29:13.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:13.476+0000 7f2e315b6640 1 -- 172.21.15.119:0/1572127531 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e180385c0 msgr2=0x7f2e1803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:13.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:13.477+0000 7f2e315b6640 1 --2- 172.21.15.119:0/1572127531 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e180385c0 0x7f2e1803aa80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0741f0 tx=0x7f2e20007a80 comp rx=0 tx=0).stop 2024-04-23T18:29:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:13.477+0000 7f2e315b6640 1 -- 172.21.15.119:0/1572127531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e2c10efe0 msgr2=0x7f2e2c1aaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:13.477+0000 7f2e315b6640 1 --2- 172.21.15.119:0/1572127531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e2c10efe0 0x7f2e2c1aaac0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c034040 tx=0x7f2e1c0046c0 comp rx=0 tx=0).stop 2024-04-23T18:29:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:13.477+0000 7f2e315b6640 1 -- 172.21.15.119:0/1572127531 shutdown_connections 2024-04-23T18:29:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:13.477+0000 7f2e315b6640 1 --2- 172.21.15.119:0/1572127531 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e180385c0 0x7f2e1803aa80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:13.477+0000 7f2e315b6640 1 --2- 172.21.15.119:0/1572127531 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2e2c10efe0 0x7f2e2c1aaac0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:13.477+0000 7f2e315b6640 1 -- 172.21.15.119:0/1572127531 >> 172.21.15.119:0/1572127531 conn(0x7f2e2c06f420 msgr2=0x7f2e2c06f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:13.477+0000 7f2e315b6640 1 -- 172.21.15.119:0/1572127531 shutdown_connections 2024-04-23T18:29:13.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:13.477+0000 7f2e315b6640 1 -- 172.21.15.119:0/1572127531 wait complete. 2024-04-23T18:29:13.488 DEBUG:tasks.rgw:Pools created 2024-04-23T18:29:13.488 INFO:tasks.rgw:Starting rgw... 2024-04-23T18:29:13.488 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-23T18:29:13.488 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-23T18:29:13.488 DEBUG:teuthology.orchestra.run.smithi119:> sudo echo -n http://smithi119.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-23T18:29:13.518 INFO:teuthology.orchestra.run.smithi119.stdout:http://smithi119.front.sepia.ceph.com:80 2024-04-23T18:29:13.518 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-23T18:29:13.582 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-23T18:29:13.582 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-23T18:29:13.625 INFO:tasks.rgw.client.0:Started 2024-04-23T18:29:13.625 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi119.front.sepia.ceph.com:80/ 2024-04-23T18:29:13.625 DEBUG:teuthology.orchestra.run.smithi119:> curl http://smithi119.front.sepia.ceph.com:80/ 2024-04-23T18:29:13.654 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-23T18:29:13.654 INFO:teuthology.orchestra.run.smithi119.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-23T18:29:13.654 INFO:teuthology.orchestra.run.smithi119.stderr: Dload Upload Total Spent Left Speed 2024-04-23T18:29:13.655 INFO:teuthology.orchestra.run.smithi119.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-23T18:29:13.655 INFO:teuthology.orchestra.run.smithi119.stderr:curl: (7) Failed to connect to smithi119.front.sepia.ceph.com port 80: Connection refused 2024-04-23T18:29:14.655 DEBUG:teuthology.orchestra.run.smithi119:> curl http://smithi119.front.sepia.ceph.com:80/ 2024-04-23T18:29:14.677 INFO:teuthology.orchestra.run.smithi119.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-23T18:29:14.677 INFO:teuthology.orchestra.run.smithi119.stderr: Dload Upload Total Spent Left Speed 2024-04-23T18:29:14.679 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-23T18:29:14.679 INFO:teuthology.orchestra.run.smithi119.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-23T18:29:14.679 INFO:teuthology.orchestra.run.smithi119.stderr:curl: (7) Failed to connect to smithi119.front.sepia.ceph.com port 80: Connection refused 2024-04-23T18:29:16.680 DEBUG:teuthology.orchestra.run.smithi119:> curl http://smithi119.front.sepia.ceph.com:80/ 2024-04-23T18:29:16.703 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-23T18:29:16.703 INFO:teuthology.orchestra.run.smithi119.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-23T18:29:16.703 INFO:teuthology.orchestra.run.smithi119.stderr: Dload Upload Total Spent Left Speed 2024-04-23T18:29:16.703 INFO:teuthology.orchestra.run.smithi119.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-23T18:29:16.703 INFO:teuthology.orchestra.run.smithi119.stderr:curl: (7) Failed to connect to smithi119.front.sepia.ceph.com port 80: Connection refused 2024-04-23T18:29:20.704 DEBUG:teuthology.orchestra.run.smithi119:> curl http://smithi119.front.sepia.ceph.com:80/ 2024-04-23T18:29:20.726 INFO:teuthology.orchestra.run.smithi119.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-23T18:29:20.726 INFO:teuthology.orchestra.run.smithi119.stderr: Dload Upload Total Spent Left Speed 2024-04-23T18:29:20.727 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-23T18:29:20.727 INFO:teuthology.orchestra.run.smithi119.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-23T18:29:20.728 INFO:teuthology.orchestra.run.smithi119.stderr:curl: (7) Failed to connect to smithi119.front.sepia.ceph.com port 80: Connection refused 2024-04-23T18:29:22.574 INFO:tasks.rgw.client.0.smithi119.stdout:2024-04-23T18:29:22.582+0000 7fbad4d21880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-23T18:29:28.729 DEBUG:teuthology.orchestra.run.smithi119:> curl http://smithi119.front.sepia.ceph.com:80/ 2024-04-23T18:29:28.751 INFO:teuthology.orchestra.run.smithi119.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-23T18:29:28.751 INFO:teuthology.orchestra.run.smithi119.stderr: Dload Upload Total Spent Left Speed 2024-04-23T18:29:28.755 INFO:teuthology.orchestra.run.smithi119.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 62333 0 --:--:-- --:--:-- --:--:-- 93500 2024-04-23T18:29:28.755 INFO:teuthology.orchestra.run.smithi119.stdout:anonymous 2024-04-23T18:29:28.755 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-04-23T18:29:28.882 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-04-23T18:29:28.882 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-23T18:29:28.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-23T18:29:28.883 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-23T18:29:28.930 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:28.930 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:28.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.939+0000 7fe34ba10800 1 Processor -- start 2024-04-23T18:29:28.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.939+0000 7fe34ba10800 1 -- start start 2024-04-23T18:29:28.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.939+0000 7fe34ba10800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e024c86a50 0x55e024c88e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.939+0000 7fe34ba10800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e024b36560 con 0x55e024c89380 2024-04-23T18:29:28.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.939+0000 7fe34ba10800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55e024b27e20 con 0x55e024c86a50 2024-04-23T18:29:28.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.939+0000 7fe3470fd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e024c86a50 0x55e024c88e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.939+0000 7fe3470fd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e024c86a50 0x55e024c88e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:59944/0 (socket says 172.21.15.119:59944) 2024-04-23T18:29:28.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.939+0000 7fe3470fd640 1 -- 172.21.15.119:0/41044702 learned_addr learned my addr 172.21.15.119:0/41044702 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:28.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.939+0000 7fe33ffff640 1 --1- 172.21.15.119:0/41044702 >> v1:172.21.15.62:6789/0 conn(0x55e024c89380 0x55e024c8b770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40400/0 (socket says 172.21.15.119:40400) 2024-04-23T18:29:28.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.940+0000 7fe3470fd640 1 -- 172.21.15.119:0/41044702 >> v1:172.21.15.62:6789/0 conn(0x55e024c89380 legacy=0x55e024c8b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:28.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.940+0000 7fe3470fd640 1 -- 172.21.15.119:0/41044702 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e024b35e60 con 0x55e024c86a50 2024-04-23T18:29:28.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.942+0000 7fe3470fd640 1 --2- 172.21.15.119:0/41044702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024c88e40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe33800a520 tx=0x7fe33801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce34a8218d452230 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.942+0000 7fe3468fc640 1 -- 172.21.15.119:0/41044702 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe338057070 con 0x55e024c86a50 2024-04-23T18:29:28.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.942+0000 7fe3468fc640 1 -- 172.21.15.119:0/41044702 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe338052570 con 0x55e024c86a50 2024-04-23T18:29:28.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.942+0000 7fe3468fc640 1 -- 172.21.15.119:0/41044702 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe33804ae60 con 0x55e024c86a50 2024-04-23T18:29:28.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.942+0000 7fe34ba10800 1 -- 172.21.15.119:0/41044702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 msgr2=0x55e024c88e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:28.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.942+0000 7fe34ba10800 1 --2- 172.21.15.119:0/41044702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024c88e40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe33800a520 tx=0x7fe33801d010 comp rx=0 tx=0).stop 2024-04-23T18:29:28.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.942+0000 7fe34ba10800 1 -- 172.21.15.119:0/41044702 shutdown_connections 2024-04-23T18:29:28.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.942+0000 7fe34ba10800 1 --2- 172.21.15.119:0/41044702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024c88e40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:28.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.942+0000 7fe34ba10800 1 -- 172.21.15.119:0/41044702 >> 172.21.15.119:0/41044702 conn(0x55e024c80400 msgr2=0x55e024c82820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:28.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.943+0000 7fe34ba10800 1 -- 172.21.15.119:0/41044702 shutdown_connections 2024-04-23T18:29:28.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.943+0000 7fe34ba10800 1 -- 172.21.15.119:0/41044702 wait complete. 2024-04-23T18:29:28.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.956+0000 7fe34ba10800 1 Processor -- start 2024-04-23T18:29:28.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.957+0000 7fe34ba10800 1 -- start start 2024-04-23T18:29:28.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.957+0000 7fe34ba10800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024d771b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.957+0000 7fe34ba10800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e024bd15a0 con 0x55e024c86a50 2024-04-23T18:29:28.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.957+0000 7fe3470fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024d771b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.957+0000 7fe3470fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024d771b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:59952/0 (socket says 172.21.15.119:59952) 2024-04-23T18:29:28.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.957+0000 7fe3470fd640 1 -- 172.21.15.119:0/3700234386 learned_addr learned my addr 172.21.15.119:0/3700234386 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:28.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.957+0000 7fe3470fd640 1 -- 172.21.15.119:0/3700234386 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e024b47860 con 0x55e024c86a50 2024-04-23T18:29:28.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.958+0000 7fe3470fd640 1 --2- 172.21.15.119:0/3700234386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024d771b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe338055040 tx=0x7fe33804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c461b6c244c77401 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.958+0000 7fe23560a640 1 -- 172.21.15.119:0/3700234386 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe338057040 con 0x55e024c86a50 2024-04-23T18:29:28.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.958+0000 7fe23560a640 1 -- 172.21.15.119:0/3700234386 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe338052720 con 0x55e024c86a50 2024-04-23T18:29:28.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.958+0000 7fe23560a640 1 -- 172.21.15.119:0/3700234386 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe338052a40 con 0x55e024c86a50 2024-04-23T18:29:28.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.958+0000 7fe34ba10800 1 -- 172.21.15.119:0/3700234386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 msgr2=0x55e024d771b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:28.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.958+0000 7fe34ba10800 1 --2- 172.21.15.119:0/3700234386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024d771b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe338055040 tx=0x7fe33804c000 comp rx=0 tx=0).stop 2024-04-23T18:29:28.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.959+0000 7fe34ba10800 1 -- 172.21.15.119:0/3700234386 shutdown_connections 2024-04-23T18:29:28.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.959+0000 7fe34ba10800 1 --2- 172.21.15.119:0/3700234386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024d771b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:28.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.959+0000 7fe34ba10800 1 -- 172.21.15.119:0/3700234386 >> 172.21.15.119:0/3700234386 conn(0x55e024c80400 msgr2=0x55e024d72ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:28.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.959+0000 7fe34ba10800 1 -- 172.21.15.119:0/3700234386 shutdown_connections 2024-04-23T18:29:28.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.959+0000 7fe34ba10800 1 -- 172.21.15.119:0/3700234386 wait complete. 2024-04-23T18:29:28.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.959+0000 7fe34ba10800 1 Processor -- start 2024-04-23T18:29:28.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.959+0000 7fe34ba10800 1 -- start start 2024-04-23T18:29:28.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.959+0000 7fe34ba10800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024d7ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.959+0000 7fe34ba10800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e024c8f1a0 con 0x55e024c86a50 2024-04-23T18:29:28.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.959+0000 7fe3470fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024d7ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.959+0000 7fe3470fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024d7ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:59962/0 (socket says 172.21.15.119:59962) 2024-04-23T18:29:28.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.959+0000 7fe3470fd640 1 -- 172.21.15.119:0/780410774 learned_addr learned my addr 172.21.15.119:0/780410774 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:28.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.960+0000 7fe3470fd640 1 -- 172.21.15.119:0/780410774 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e024b45eb0 con 0x55e024c86a50 2024-04-23T18:29:28.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.960+0000 7fe3470fd640 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024d7ead0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe338052540 tx=0x7fe338003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.960+0000 7fe233e07640 1 -- 172.21.15.119:0/780410774 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe338073070 con 0x55e024c86a50 2024-04-23T18:29:28.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.960+0000 7fe233e07640 1 -- 172.21.15.119:0/780410774 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33805d440 con 0x55e024c86a50 2024-04-23T18:29:28.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.960+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e024d7f010 con 0x55e024c86a50 2024-04-23T18:29:28.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.960+0000 7fe233e07640 1 -- 172.21.15.119:0/780410774 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe338057070 con 0x55e024c86a50 2024-04-23T18:29:28.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.960+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e024d7f530 con 0x55e024c86a50 2024-04-23T18:29:28.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.961+0000 7fe233e07640 1 -- 172.21.15.119:0/780410774 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe338076070 con 0x55e024c86a50 2024-04-23T18:29:28.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.961+0000 7fe233e07640 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe22c036e60 0x7fe22c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.961+0000 7fe233e07640 1 -- 172.21.15.119:0/780410774 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe33808e300 con 0x55e024c86a50 2024-04-23T18:29:28.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.961+0000 7fe33ffff640 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe22c036e60 0x7fe22c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.961+0000 7fe34ba10800 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e024c89380 0x55e024d85af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.961+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024d86030 con 0x55e024c89380 2024-04-23T18:29:28.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.961+0000 7fe3478fe640 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e024c89380 0x55e024d85af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.962+0000 7fe33ffff640 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe22c036e60 0x7fe22c039320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe330000f60 tx=0x7fe330001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.962+0000 7fe3478fe640 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e024c89380 0x55e024d85af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.962+0000 7fe3478fe640 1 -- 172.21.15.119:0/780410774 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024c89380 2024-04-23T18:29:28.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.962+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024d830c0 con 0x55e024c89380 2024-04-23T18:29:28.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.962+0000 7fe3478fe640 1 -- 172.21.15.119:0/780410774 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024c89380 2024-04-23T18:29:28.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.962+0000 7fe34ba10800 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e024d88360 0x55e024d8a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.962+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024d8ae40 con 0x55e024d88360 2024-04-23T18:29:28.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.963+0000 7fe3470fd640 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e024d88360 0x55e024d8a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.963+0000 7fe3470fd640 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e024d88360 0x55e024d8a750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.963+0000 7fe3470fd640 1 -- 172.21.15.119:0/780410774 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe338075030 con 0x55e024d88360 2024-04-23T18:29:28.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.963+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024d87310 con 0x55e024c89380 2024-04-23T18:29:28.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.964+0000 7fe3478fe640 1 -- 172.21.15.119:0/780410774 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024c89380 2024-04-23T18:29:28.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.964+0000 7fe34ba10800 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e024d8c2f0 0x55e024d8e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.964+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024d8eea0 con 0x55e024d8c2f0 2024-04-23T18:29:28.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.964+0000 7fe33ffff640 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e024d8c2f0 0x55e024d8e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.964+0000 7fe33ffff640 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e024d8c2f0 0x55e024d8e740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.965+0000 7fe33ffff640 1 -- 172.21.15.119:0/780410774 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe33000f690 con 0x55e024d8c2f0 2024-04-23T18:29:28.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.965+0000 7fe34ba10800 1 Processor -- start 2024-04-23T18:29:28.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.965+0000 7fe34ba10800 1 -- start start 2024-04-23T18:29:28.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.965+0000 7fe34ba10800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024d9d300 0x55e024d9d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.965+0000 7fe34ba10800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e024b77df0 con 0x55e024d9d300 2024-04-23T18:29:28.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.965+0000 7fe3470fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024d9d300 0x55e024d9d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.965+0000 7fe3470fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024d9d300 0x55e024d9d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:59968/0 (socket says 172.21.15.119:59968) 2024-04-23T18:29:28.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.965+0000 7fe3470fd640 1 -- 172.21.15.119:0/3767267749 learned_addr learned my addr 172.21.15.119:0/3767267749 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:28.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.966+0000 7fe3470fd640 1 -- 172.21.15.119:0/3767267749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e024d9dc60 con 0x55e024d9d300 2024-04-23T18:29:28.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.966+0000 7fe3470fd640 1 --2- 172.21.15.119:0/3767267749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024d9d300 0x55e024d9d720 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe338006900 tx=0x7fe338076420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.966+0000 7fe231602640 1 -- 172.21.15.119:0/3767267749 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe33808b2e0 con 0x55e024d9d300 2024-04-23T18:29:28.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.966+0000 7fe231602640 1 -- 172.21.15.119:0/3767267749 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3380766f0 con 0x55e024d9d300 2024-04-23T18:29:28.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.966+0000 7fe34ba10800 1 -- 172.21.15.119:0/3767267749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e024d9e6d0 con 0x55e024d9d300 2024-04-23T18:29:28.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.966+0000 7fe231602640 1 -- 172.21.15.119:0/3767267749 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3380769d0 con 0x55e024d9d300 2024-04-23T18:29:28.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.966+0000 7fe34ba10800 1 -- 172.21.15.119:0/3767267749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e024d9ebd0 con 0x55e024d9d300 2024-04-23T18:29:28.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.967+0000 7fe231602640 1 -- 172.21.15.119:0/3767267749 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe33808ca80 con 0x55e024d9d300 2024-04-23T18:29:28.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.967+0000 7fe231602640 1 --2- 172.21.15.119:0/3767267749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe220036e60 0x7fe220039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.967+0000 7fe231602640 1 -- 172.21.15.119:0/3767267749 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe33809c9e0 con 0x55e024d9d300 2024-04-23T18:29:28.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.967+0000 7fe33ffff640 1 --2- 172.21.15.119:0/3767267749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe220036e60 0x7fe220039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.967+0000 7fe34ba10800 1 Processor -- start 2024-04-23T18:29:28.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.968+0000 7fe34ba10800 1 -- start start 2024-04-23T18:29:28.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.968+0000 7fe33ffff640 1 --2- 172.21.15.119:0/3767267749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe220036e60 0x7fe220039320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55e024d86910 tx=0x7fe33000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.968+0000 7fe34ba10800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 0x55e024daa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.968+0000 7fe34ba10800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e024d77870 con 0x55e024daa500 2024-04-23T18:29:28.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.968+0000 7fe3470fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 0x55e024daa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.968+0000 7fe3470fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 0x55e024daa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:59980/0 (socket says 172.21.15.119:59980) 2024-04-23T18:29:28.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.968+0000 7fe3470fd640 1 -- 172.21.15.119:0/24237787 learned_addr learned my addr 172.21.15.119:0/24237787 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:28.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.968+0000 7fe3470fd640 1 -- 172.21.15.119:0/24237787 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e024daaed0 con 0x55e024daa500 2024-04-23T18:29:28.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.968+0000 7fe3470fd640 1 --2- 172.21.15.119:0/24237787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 0x55e024daa900 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe33805e7d0 tx=0x7fe33806ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbf712504400948 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.969+0000 7fe22affd640 1 -- 172.21.15.119:0/24237787 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3380aa020 con 0x55e024daa500 2024-04-23T18:29:28.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.969+0000 7fe22affd640 1 -- 172.21.15.119:0/24237787 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe338002d80 con 0x55e024daa500 2024-04-23T18:29:28.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.969+0000 7fe22affd640 1 -- 172.21.15.119:0/24237787 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe33808cd70 con 0x55e024daa500 2024-04-23T18:29:28.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.969+0000 7fe34ba10800 1 -- 172.21.15.119:0/24237787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 msgr2=0x55e024daa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:28.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.969+0000 7fe34ba10800 1 --2- 172.21.15.119:0/24237787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 0x55e024daa900 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe33805e7d0 tx=0x7fe33806ec90 comp rx=0 tx=0).stop 2024-04-23T18:29:28.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.969+0000 7fe34ba10800 1 -- 172.21.15.119:0/24237787 shutdown_connections 2024-04-23T18:29:28.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.969+0000 7fe34ba10800 1 --2- 172.21.15.119:0/24237787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 0x55e024daa900 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:28.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.969+0000 7fe34ba10800 1 -- 172.21.15.119:0/24237787 >> 172.21.15.119:0/24237787 conn(0x55e024da6780 msgr2=0x55e024da47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:28.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.969+0000 7fe34ba10800 1 -- 172.21.15.119:0/24237787 shutdown_connections 2024-04-23T18:29:28.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.969+0000 7fe34ba10800 1 -- 172.21.15.119:0/24237787 wait complete. 2024-04-23T18:29:28.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.969+0000 7fe34ba10800 1 Processor -- start 2024-04-23T18:29:28.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.969+0000 7fe34ba10800 1 -- start start 2024-04-23T18:29:28.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.970+0000 7fe34ba10800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 0x55e024db1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.970+0000 7fe34ba10800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e024dab3e0 con 0x55e024daa500 2024-04-23T18:29:28.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.970+0000 7fe3470fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 0x55e024db1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.970+0000 7fe3470fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 0x55e024db1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:59988/0 (socket says 172.21.15.119:59988) 2024-04-23T18:29:28.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.970+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 learned_addr learned my addr 172.21.15.119:0/1622295298 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:28.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.970+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e024db1ba0 con 0x55e024daa500 2024-04-23T18:29:28.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.970+0000 7fe3470fd640 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 0x55e024db1660 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe33809cc80 tx=0x7fe33806df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.971+0000 7fe2297fa640 1 -- 172.21.15.119:0/1622295298 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3380bf070 con 0x55e024daa500 2024-04-23T18:29:28.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.971+0000 7fe2297fa640 1 -- 172.21.15.119:0/1622295298 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe338082e50 con 0x55e024daa500 2024-04-23T18:29:28.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.971+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e024db1ba0 con 0x55e024daa500 2024-04-23T18:29:28.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.971+0000 7fe2297fa640 1 -- 172.21.15.119:0/1622295298 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe33805dbd0 con 0x55e024daa500 2024-04-23T18:29:28.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.971+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e024db1ba0 con 0x55e024daa500 2024-04-23T18:29:28.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.972+0000 7fe2297fa640 1 -- 172.21.15.119:0/1622295298 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe3380c2070 con 0x55e024daa500 2024-04-23T18:29:28.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.972+0000 7fe34ba10800 20 rados->read ofs=0 len=0 2024-04-23T18:29:28.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.972+0000 7fe2297fa640 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe210036e60 0x7fe210039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.972+0000 7fe2297fa640 1 -- 172.21.15.119:0/1622295298 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe3380b6030 con 0x55e024daa500 2024-04-23T18:29:28.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.972+0000 7fe33ffff640 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe210036e60 0x7fe210039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.972+0000 7fe34ba10800 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e024dbcc20 0x55e024dbf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.972+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024dbf7e0 con 0x55e024dbcc20 2024-04-23T18:29:28.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.972+0000 7fe3478fe640 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e024dbcc20 0x55e024dbf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.972+0000 7fe33ffff640 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe210036e60 0x7fe210039320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55e024d8f2a0 tx=0x7fe330010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.972+0000 7fe3478fe640 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e024dbcc20 0x55e024dbf090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024dbcc20 2024-04-23T18:29:28.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:28.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 20 realm 2024-04-23T18:29:28.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 20 rados->read ofs=0 len=0 2024-04-23T18:29:28.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024dbfc40 con 0x55e024dbcc20 2024-04-23T18:29:28.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024dbcc20 2024-04-23T18:29:28.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:28.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:28.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 20 rados->read ofs=0 len=0 2024-04-23T18:29:28.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc04e0 con 0x55e024dbcc20 2024-04-23T18:29:28.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024dbcc20 2024-04-23T18:29:28.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:28.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 20 rados->read ofs=0 len=0 2024-04-23T18:29:28.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dbcc20 2024-04-23T18:29:28.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024dbcc20 2024-04-23T18:29:28.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:28.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 20 rados->read ofs=0 len=0 2024-04-23T18:29:28.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.973+0000 7fe34ba10800 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e024dc15e0 0x55e024dc39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.974+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc3f50 con 0x55e024dc15e0 2024-04-23T18:29:28.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.974+0000 7fe3470fd640 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e024dc15e0 0x55e024dc39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.974+0000 7fe3470fd640 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e024dc15e0 0x55e024dc39d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.974+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:28.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.974+0000 7fe34ba10800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:28.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.974+0000 7fe34ba10800 20 searching for the correct realm 2024-04-23T18:29:28.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.974+0000 7fe34ba10800 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e024dc5fa0 0x55e024dc8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.974+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc8b30 con 0x55e024dc5fa0 2024-04-23T18:29:28.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.974+0000 7fe33ffff640 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e024dc5fa0 0x55e024dc8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.975+0000 7fe33ffff640 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e024dc5fa0 0x55e024dc8460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.975+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:28.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.975+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc8b30 con 0x55e024dc15e0 2024-04-23T18:29:28.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.975+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:28.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.975+0000 7fe3470fd640 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe3380c4060 0x7fe33809a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:28.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.975+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc8b30 con 0x7fe3380c4060 2024-04-23T18:29:28.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.976+0000 7fe3478fe640 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe3380c4060 0x7fe33809a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:28.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.976+0000 7fe3478fe640 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe3380c4060 0x7fe33809a150 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:28.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.976+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34000a4a0 con 0x7fe3380c4060 2024-04-23T18:29:28.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.976+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dbcc20 2024-04-23T18:29:28.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.977+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024dbcc20 2024-04-23T18:29:28.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.977+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dbcc20 2024-04-23T18:29:28.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.977+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024dbcc20 2024-04-23T18:29:28.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.977+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x7fe3380c4060 2024-04-23T18:29:28.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.977+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34000a4a0 con 0x7fe3380c4060 2024-04-23T18:29:28.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.977+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x7fe3380c4060 2024-04-23T18:29:28.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.977+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe34000a4a0 con 0x7fe3380c4060 2024-04-23T18:29:28.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.978+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dc15e0 2024-04-23T18:29:28.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.978+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:28.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.978+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dc5fa0 2024-04-23T18:29:28.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.978+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:28.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.978+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dbcc20 2024-04-23T18:29:28.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.978+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024dbcc20 2024-04-23T18:29:28.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.978+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x7fe3380c4060 2024-04-23T18:29:28.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.979+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34000a4a0 con 0x7fe3380c4060 2024-04-23T18:29:28.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.979+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dbcc20 2024-04-23T18:29:28.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.979+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024dbcc20 2024-04-23T18:29:28.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.979+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dc15e0 2024-04-23T18:29:28.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.979+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:28.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.979+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dc5fa0 2024-04-23T18:29:28.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.979+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:28.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.979+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dc5fa0 2024-04-23T18:29:28.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.980+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:28.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.980+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x7fe3380c4060 2024-04-23T18:29:28.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.980+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34000a4a0 con 0x7fe3380c4060 2024-04-23T18:29:28.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.980+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dc5fa0 2024-04-23T18:29:28.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.980+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:28.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.980+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dc5fa0 2024-04-23T18:29:28.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.981+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:28.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.981+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dbcc20 2024-04-23T18:29:28.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.981+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024dbcc20 2024-04-23T18:29:28.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.981+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dbcc20 2024-04-23T18:29:28.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.981+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024dbcc20 2024-04-23T18:29:28.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.981+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x7fe3380c4060 2024-04-23T18:29:28.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.981+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34000a4a0 con 0x7fe3380c4060 2024-04-23T18:29:28.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.982+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dc5fa0 2024-04-23T18:29:28.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.982+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:28.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.982+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dc15e0 2024-04-23T18:29:28.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.982+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:28.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.982+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dbcc20 2024-04-23T18:29:28.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.982+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34000a4a0 con 0x55e024dbcc20 2024-04-23T18:29:28.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.982+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x7fe3380c4060 2024-04-23T18:29:28.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.983+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34000a4a0 con 0x7fe3380c4060 2024-04-23T18:29:28.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.983+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dc5fa0 2024-04-23T18:29:28.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.983+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:28.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.983+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x7fe3380c4060 2024-04-23T18:29:28.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.983+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34000a4a0 con 0x7fe3380c4060 2024-04-23T18:29:28.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.983+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dc15e0 2024-04-23T18:29:28.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.984+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:28.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.984+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dc5fa0 2024-04-23T18:29:28.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.984+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:28.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.984+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x7fe3380c4060 2024-04-23T18:29:28.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.984+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:28.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.984+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dbcc20 2024-04-23T18:29:28.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:28.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc0880 con 0x55e024dc15e0 2024-04-23T18:29:28.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:28.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:28.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:28.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:28.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:28.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:28.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:28.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 20 rados->read ofs=0 len=0 2024-04-23T18:29:28.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc48a0 con 0x55e024dbcc20 2024-04-23T18:29:28.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:28.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:28.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 20 rados->read ofs=0 len=0 2024-04-23T18:29:28.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc48a0 con 0x55e024dbcc20 2024-04-23T18:29:28.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:28.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:28.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 20 rados->read ofs=0 len=0 2024-04-23T18:29:28.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.985+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc48a0 con 0x7fe3380c4060 2024-04-23T18:29:28.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:28.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:28.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 20 zone default found 2024-04-23T18:29:28.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 4 Realm: () 2024-04-23T18:29:28.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:28.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:28.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:28.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 20 zonegroup default 2024-04-23T18:29:28.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 20 rados->read ofs=0 len=0 2024-04-23T18:29:28.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc4c90 con 0x7fe3380c4060 2024-04-23T18:29:28.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:28.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:28.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 20 rados->read ofs=0 len=0 2024-04-23T18:29:28.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc50d0 con 0x55e024dc5fa0 2024-04-23T18:29:28.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:28.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:28.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 20 rados->read ofs=0 len=0 2024-04-23T18:29:28.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.986+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024dca990 con 0x55e024dc5fa0 2024-04-23T18:29:28.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.987+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.987+0000 7fe34ba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.987+0000 7fe34ba10800 20 started sync module instance, tier type = 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.987+0000 7fe34ba10800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.987+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dc9e30 con 0x55e024dc15e0 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.988+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.988+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94421179472256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcad30 con 0x55e024dc15e0 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.988+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcb5c0 con 0x55e024dbcc20 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.989+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94421179472256] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.989+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.989+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94421179474512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcb9b0 con 0x55e024dbcc20 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.989+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcc3d0 con 0x55e024dc5fa0 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.991+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.991+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94421179481792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dccca0 con 0x55e024dc5fa0 2024-04-23T18:29:28.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.991+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcd760 con 0x55e024dc15e0 2024-04-23T18:29:28.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.994+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94421179474512] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:28.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.994+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94421179481792] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:28.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.994+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:28.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.994+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94421179486864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcdb80 con 0x55e024dc15e0 2024-04-23T18:29:28.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.995+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dce3d0 con 0x55e024dbcc20 2024-04-23T18:29:28.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.998+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:28.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.998+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94421179489664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dce840 con 0x55e024dbcc20 2024-04-23T18:29:28.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.998+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcf340 con 0x7fe3380c4060 2024-04-23T18:29:29.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.998+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94421179486864] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:29.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:28.999+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94421179489664] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:29.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.002+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:29.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.002+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94421179493936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcf300 con 0x7fe3380c4060 2024-04-23T18:29:29.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.002+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcfc10 con 0x7fe3380c4060 2024-04-23T18:29:29.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.003+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94421179493936] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:29.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.005+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:29.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.005+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94421179478224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcf300 con 0x7fe3380c4060 2024-04-23T18:29:29.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.005+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dd0230 con 0x7fe3380c4060 2024-04-23T18:29:29.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.006+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:29.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.006+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94421179497856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dd0650 con 0x7fe3380c4060 2024-04-23T18:29:29.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.007+0000 7fe34ba10800 20 add_watcher() i=0 2024-04-23T18:29:29.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.007+0000 7fe34ba10800 20 add_watcher() i=1 2024-04-23T18:29:29.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.007+0000 7fe34ba10800 20 add_watcher() i=2 2024-04-23T18:29:29.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.007+0000 7fe34ba10800 20 add_watcher() i=3 2024-04-23T18:29:29.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.007+0000 7fe34ba10800 20 add_watcher() i=4 2024-04-23T18:29:29.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.007+0000 7fe34ba10800 20 add_watcher() i=5 2024-04-23T18:29:29.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.008+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94421179478224] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:29.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.008+0000 7fe34ba10800 20 add_watcher() i=6 2024-04-23T18:29:29.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.010+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94421179497856] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:29.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.010+0000 7fe34ba10800 20 add_watcher() i=7 2024-04-23T18:29:29.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.010+0000 7fe34ba10800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:29.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.010+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e024dd0650 con 0x55e024dbcc20 2024-04-23T18:29:29.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.011+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:29.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.011+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94421179498912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dd0f90 con 0x55e024dbcc20 2024-04-23T18:29:29.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.014+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94421179498912] v32'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:29.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.014+0000 7fe1fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:29.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.014+0000 7fe34ba10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:29.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.014+0000 7fe34ba10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:29.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.014+0000 7fe34ba10800 5 note: GC not initialized 2024-04-23T18:29:29.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.014+0000 7fe1fcfe1640 20 reqs_thread_entry: start 2024-04-23T18:29:29.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.014+0000 7fe34ba10800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:29.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.014+0000 7fe34ba10800 20 Filter name: none 2024-04-23T18:29:29.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.014+0000 7fe1767fc640 20 reqs_thread_entry: start 2024-04-23T18:29:29.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.015+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024e063a0 con 0x55e024dc5fa0 2024-04-23T18:29:29.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.015+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:29.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.015+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024e063a0 con 0x55e024dc5fa0 2024-04-23T18:29:29.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.015+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:29.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.015+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024e063a0 con 0x55e024dbcc20 2024-04-23T18:29:29.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.015+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:29.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.015+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dbcc20 2024-04-23T18:29:29.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.016+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:29.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.016+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dc15e0 2024-04-23T18:29:29.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.016+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:29.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.016+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcd760 con 0x55e024dc5fa0 2024-04-23T18:29:29.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.016+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:29.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.016+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcd760 con 0x55e024dbcc20 2024-04-23T18:29:29.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.016+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:29.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.016+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dc5fa0 2024-04-23T18:29:29.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.017+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:29.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.017+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dc15e0 2024-04-23T18:29:29.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.017+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:29.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.017+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dc5fa0 2024-04-23T18:29:29.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.017+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:29.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.017+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dbcc20 2024-04-23T18:29:29.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.017+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:29.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.017+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x7fe3380c4060 2024-04-23T18:29:29.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.018+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:29.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.018+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x7fe3380c4060 2024-04-23T18:29:29.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.018+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:29.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.018+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dc5fa0 2024-04-23T18:29:29.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.018+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:29.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.018+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x7fe3380c4060 2024-04-23T18:29:29.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.019+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:29.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.019+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x7fe3380c4060 2024-04-23T18:29:29.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.019+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:29.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.019+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x7fe3380c4060 2024-04-23T18:29:29.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.019+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340040040 con 0x7fe3380c4060 2024-04-23T18:29:29.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.019+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dc5fa0 2024-04-23T18:29:29.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.019+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:29.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.019+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dc15e0 2024-04-23T18:29:29.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.020+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(80 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:29.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.020+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dbcc20 2024-04-23T18:29:29.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.020+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340040040 con 0x55e024dbcc20 2024-04-23T18:29:29.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.020+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dbcc20 2024-04-23T18:29:29.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.020+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340059040 con 0x55e024dbcc20 2024-04-23T18:29:29.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.020+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dc5fa0 2024-04-23T18:29:29.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.020+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:29.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.020+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dc15e0 2024-04-23T18:29:29.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.020+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:29.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.020+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x7fe3380c4060 2024-04-23T18:29:29.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.021+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340059040 con 0x7fe3380c4060 2024-04-23T18:29:29.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.021+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dbcc20 2024-04-23T18:29:29.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.021+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340059040 con 0x55e024dbcc20 2024-04-23T18:29:29.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.021+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x7fe3380c4060 2024-04-23T18:29:29.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.021+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340059040 con 0x7fe3380c4060 2024-04-23T18:29:29.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.021+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dc5fa0 2024-04-23T18:29:29.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.022+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:29.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.022+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dc15e0 2024-04-23T18:29:29.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.022+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:29.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.022+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x7fe3380c4060 2024-04-23T18:29:29.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.022+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340059040 con 0x7fe3380c4060 2024-04-23T18:29:29.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.022+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dbcc20 2024-04-23T18:29:29.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.022+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340059040 con 0x55e024dbcc20 2024-04-23T18:29:29.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.022+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dc5fa0 2024-04-23T18:29:29.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.023+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:29.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.023+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe340045040 con 0x55e024dc15e0 2024-04-23T18:29:29.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.023+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:29.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.024+0000 7fe1fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:29.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.024+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94421179498912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcd760 con 0x55e024dbcc20 2024-04-23T18:29:29.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.025+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94421179498912] v32'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe340059040 con 0x55e024dbcc20 2024-04-23T18:29:29.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.025+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94421179472256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dd01a0 con 0x55e024dc15e0 2024-04-23T18:29:29.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.029+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94421179472256] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:29.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.029+0000 7fe34ba10800 20 remove_watcher() i=0 2024-04-23T18:29:29.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.029+0000 7fe34ba10800 2 removed watcher, disabling cache 2024-04-23T18:29:29.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.029+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94421179474512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dd01a0 con 0x55e024dbcc20 2024-04-23T18:29:29.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.030+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94421179474512] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340059040 con 0x55e024dbcc20 2024-04-23T18:29:29.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.030+0000 7fe34ba10800 20 remove_watcher() i=1 2024-04-23T18:29:29.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.030+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94421179481792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dca250 con 0x55e024dc5fa0 2024-04-23T18:29:29.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.032+0000 7fe33ffff640 1 -- 172.21.15.119:0/1622295298 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94421179481792] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe330037040 con 0x55e024dc5fa0 2024-04-23T18:29:29.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.032+0000 7fe34ba10800 20 remove_watcher() i=2 2024-04-23T18:29:29.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.032+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94421179486864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dd01a0 con 0x55e024dc15e0 2024-04-23T18:29:29.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.033+0000 7fe3470fd640 1 -- 172.21.15.119:0/1622295298 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94421179486864] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3380c1030 con 0x55e024dc15e0 2024-04-23T18:29:29.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.033+0000 7fe34ba10800 20 remove_watcher() i=3 2024-04-23T18:29:29.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.033+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94421179489664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcd290 con 0x55e024dbcc20 2024-04-23T18:29:29.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.034+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94421179489664] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340059040 con 0x55e024dbcc20 2024-04-23T18:29:29.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.034+0000 7fe34ba10800 20 remove_watcher() i=4 2024-04-23T18:29:29.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.034+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94421179493936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dd01a0 con 0x7fe3380c4060 2024-04-23T18:29:29.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.035+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94421179493936] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340059040 con 0x7fe3380c4060 2024-04-23T18:29:29.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.035+0000 7fe34ba10800 20 remove_watcher() i=5 2024-04-23T18:29:29.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.035+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94421179478224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dcdd80 con 0x7fe3380c4060 2024-04-23T18:29:29.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.036+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94421179478224] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340059040 con 0x7fe3380c4060 2024-04-23T18:29:29.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.036+0000 7fe34ba10800 20 remove_watcher() i=6 2024-04-23T18:29:29.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.036+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94421179497856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e024dd01a0 con 0x7fe3380c4060 2024-04-23T18:29:29.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.037+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94421179497856] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340059040 con 0x7fe3380c4060 2024-04-23T18:29:29.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.037+0000 7fe34ba10800 20 remove_watcher() i=7 2024-04-23T18:29:29.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe3380c4060 msgr2=0x7fe33809a150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe3380c4060 0x7fe33809a150 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e024dbcc20 msgr2=0x55e024dbf090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e024dbcc20 0x55e024dbf090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e024dc15e0 msgr2=0x55e024dc39d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e024dc15e0 0x55e024dc39d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e024dc5fa0 msgr2=0x55e024dc8460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e024dc5fa0 0x55e024dc8460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe210036e60 msgr2=0x7fe210039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe210036e60 0x7fe210039320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55e024d8f2a0 tx=0x7fe330010000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 msgr2=0x55e024db1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe3478fe640 1 -- 172.21.15.119:0/1622295298 reap_dead start 2024-04-23T18:29:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 0x55e024db1660 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe33809cc80 tx=0x7fe33806df20 comp rx=0 tx=0).stop 2024-04-23T18:29:29.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 shutdown_connections 2024-04-23T18:29:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 --2- 172.21.15.119:0/1622295298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024daa500 0x55e024db1660 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 >> 172.21.15.119:0/1622295298 conn(0x55e024da6780 msgr2=0x55e024da3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 shutdown_connections 2024-04-23T18:29:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/1622295298 wait complete. 2024-04-23T18:29:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/3767267749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe220036e60 msgr2=0x7fe220039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 --2- 172.21.15.119:0/3767267749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe220036e60 0x7fe220039320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55e024d86910 tx=0x7fe33000f000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/3767267749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024d9d300 msgr2=0x55e024d9d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 --2- 172.21.15.119:0/3767267749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024d9d300 0x55e024d9d720 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe338006900 tx=0x7fe338076420 comp rx=0 tx=0).stop 2024-04-23T18:29:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/3767267749 shutdown_connections 2024-04-23T18:29:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 --2- 172.21.15.119:0/3767267749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe220036e60 0x7fe220039320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 --2- 172.21.15.119:0/3767267749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024d9d300 0x55e024d9d720 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/3767267749 >> 172.21.15.119:0/3767267749 conn(0x55e024d913a0 msgr2=0x55e024d917a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/3767267749 shutdown_connections 2024-04-23T18:29:29.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.038+0000 7fe34ba10800 1 -- 172.21.15.119:0/3767267749 wait complete. 2024-04-23T18:29:29.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e024d8c2f0 msgr2=0x55e024d8e740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e024d8c2f0 0x55e024d8e740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e024c89380 msgr2=0x55e024d85af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e024c89380 0x55e024d85af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e024d88360 msgr2=0x55e024d8a750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e024d88360 0x55e024d8a750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe22c036e60 msgr2=0x7fe22c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe22c036e60 0x7fe22c039320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe330000f60 tx=0x7fe330001370 comp rx=0 tx=0).stop 2024-04-23T18:29:29.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 msgr2=0x55e024d7ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 --2- 172.21.15.119:0/780410774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e024c86a50 0x55e024d7ead0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe338052540 tx=0x7fe338003020 comp rx=0 tx=0).stop 2024-04-23T18:29:29.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe3478fe640 1 -- 172.21.15.119:0/780410774 reap_dead start 2024-04-23T18:29:29.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 shutdown_connections 2024-04-23T18:29:29.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 >> 172.21.15.119:0/780410774 conn(0x55e024c80400 msgr2=0x55e024d75ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 shutdown_connections 2024-04-23T18:29:29.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.039+0000 7fe34ba10800 1 -- 172.21.15.119:0/780410774 wait complete. 2024-04-23T18:29:29.054 INFO:teuthology.orchestra.run.smithi119.stdout:[] 2024-04-23T18:29:29.055 DEBUG:tasks.util.rgw: json result: [] 2024-04-23T18:29:29.055 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-04-23T18:29:29.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-04-23T18:29:29.055 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-04-23T18:29:29.098 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:29.098 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:29.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.106+0000 7f4190b33800 1 Processor -- start 2024-04-23T18:29:29.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.106+0000 7f4190b33800 1 -- start start 2024-04-23T18:29:29.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.106+0000 7f4190b33800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56005a321f60 0x56005a322380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.106+0000 7f4190b33800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56005a1d2560 con 0x56005a323170 2024-04-23T18:29:29.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.106+0000 7f4190b33800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x56005a1c3e20 con 0x56005a321f60 2024-04-23T18:29:29.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.106+0000 7f418c7d1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56005a321f60 0x56005a322380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.106+0000 7f418c7d1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56005a321f60 0x56005a322380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:59994/0 (socket says 172.21.15.119:59994) 2024-04-23T18:29:29.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.106+0000 7f418bfd0640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x56005a323170 0x56005a3235f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40414/0 (socket says 172.21.15.119:40414) 2024-04-23T18:29:29.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.106+0000 7f418c7d1640 1 -- 172.21.15.119:0/4180828600 learned_addr learned my addr 172.21.15.119:0/4180828600 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.107+0000 7f418c7d1640 1 -- 172.21.15.119:0/4180828600 >> v1:172.21.15.62:6789/0 conn(0x56005a323170 legacy=0x56005a3235f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.107+0000 7f418c7d1640 1 -- 172.21.15.119:0/4180828600 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56005a1d1e60 con 0x56005a321f60 2024-04-23T18:29:29.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.107+0000 7f418b7cf640 1 -- 172.21.15.119:0/4180828600 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 887282595 0 0) 0x56005a1d2560 con 0x56005a323170 2024-04-23T18:29:29.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.108+0000 7f418c7d1640 1 --2- 172.21.15.119:0/4180828600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a322380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f417c00a520 tx=0x7f417c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851a8d2f0fee30a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.108+0000 7f418b7cf640 1 -- 172.21.15.119:0/4180828600 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c057070 con 0x56005a321f60 2024-04-23T18:29:29.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.109+0000 7f418b7cf640 1 -- 172.21.15.119:0/4180828600 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c052570 con 0x56005a321f60 2024-04-23T18:29:29.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.109+0000 7f418b7cf640 1 -- 172.21.15.119:0/4180828600 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c04ae60 con 0x56005a321f60 2024-04-23T18:29:29.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.109+0000 7f4190b33800 1 -- 172.21.15.119:0/4180828600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 msgr2=0x56005a322380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.109+0000 7f4190b33800 1 --2- 172.21.15.119:0/4180828600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a322380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f417c00a520 tx=0x7f417c01d010 comp rx=0 tx=0).stop 2024-04-23T18:29:29.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.109+0000 7f4190b33800 1 -- 172.21.15.119:0/4180828600 shutdown_connections 2024-04-23T18:29:29.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.109+0000 7f4190b33800 1 --2- 172.21.15.119:0/4180828600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a322380 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.109+0000 7f4190b33800 1 -- 172.21.15.119:0/4180828600 >> 172.21.15.119:0/4180828600 conn(0x56005a31d540 msgr2=0x56005a31f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.109+0000 7f4190b33800 1 -- 172.21.15.119:0/4180828600 shutdown_connections 2024-04-23T18:29:29.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.109+0000 7f4190b33800 1 -- 172.21.15.119:0/4180828600 wait complete. 2024-04-23T18:29:29.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.121+0000 7f4190b33800 1 Processor -- start 2024-04-23T18:29:29.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.121+0000 7f4190b33800 1 -- start start 2024-04-23T18:29:29.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.121+0000 7f4190b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a413390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.121+0000 7f4190b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56005a26d5b0 con 0x56005a321f60 2024-04-23T18:29:29.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.121+0000 7f418c7d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a413390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.121+0000 7f418c7d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a413390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60004/0 (socket says 172.21.15.119:60004) 2024-04-23T18:29:29.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.121+0000 7f418c7d1640 1 -- 172.21.15.119:0/2561590382 learned_addr learned my addr 172.21.15.119:0/2561590382 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.121+0000 7f418c7d1640 1 -- 172.21.15.119:0/2561590382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56005a1e3860 con 0x56005a321f60 2024-04-23T18:29:29.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.122+0000 7f418c7d1640 1 --2- 172.21.15.119:0/2561590382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a413390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f417c055040 tx=0x7f417c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f4016d2b45741 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.122+0000 7f407a60c640 1 -- 172.21.15.119:0/2561590382 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c062070 con 0x56005a321f60 2024-04-23T18:29:29.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.122+0000 7f407a60c640 1 -- 172.21.15.119:0/2561590382 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c052720 con 0x56005a321f60 2024-04-23T18:29:29.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.122+0000 7f407a60c640 1 -- 172.21.15.119:0/2561590382 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c057040 con 0x56005a321f60 2024-04-23T18:29:29.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.122+0000 7f4190b33800 1 -- 172.21.15.119:0/2561590382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 msgr2=0x56005a413390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.122+0000 7f4190b33800 1 --2- 172.21.15.119:0/2561590382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a413390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f417c055040 tx=0x7f417c04c000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.122+0000 7f4190b33800 1 -- 172.21.15.119:0/2561590382 shutdown_connections 2024-04-23T18:29:29.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.122+0000 7f4190b33800 1 --2- 172.21.15.119:0/2561590382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a413390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.122+0000 7f4190b33800 1 -- 172.21.15.119:0/2561590382 >> 172.21.15.119:0/2561590382 conn(0x56005a31d540 msgr2=0x56005a40ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.123+0000 7f4190b33800 1 -- 172.21.15.119:0/2561590382 shutdown_connections 2024-04-23T18:29:29.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.123+0000 7f4190b33800 1 -- 172.21.15.119:0/2561590382 wait complete. 2024-04-23T18:29:29.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.123+0000 7f4190b33800 1 Processor -- start 2024-04-23T18:29:29.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.123+0000 7f4190b33800 1 -- start start 2024-04-23T18:29:29.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.123+0000 7f4190b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a41ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.123+0000 7f4190b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56005a32b610 con 0x56005a321f60 2024-04-23T18:29:29.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.123+0000 7f418c7d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a41ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.123+0000 7f418c7d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a41ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60008/0 (socket says 172.21.15.119:60008) 2024-04-23T18:29:29.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.123+0000 7f418c7d1640 1 -- 172.21.15.119:0/1312433999 learned_addr learned my addr 172.21.15.119:0/1312433999 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.123+0000 7f418c7d1640 1 -- 172.21.15.119:0/1312433999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56005a1e1eb0 con 0x56005a321f60 2024-04-23T18:29:29.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.124+0000 7f418c7d1640 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a41ab90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f417c005400 tx=0x7f417c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.124+0000 7f4078e09640 1 -- 172.21.15.119:0/1312433999 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c057050 con 0x56005a321f60 2024-04-23T18:29:29.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.124+0000 7f4078e09640 1 -- 172.21.15.119:0/1312433999 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c052e40 con 0x56005a321f60 2024-04-23T18:29:29.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.124+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56005a41b0d0 con 0x56005a321f60 2024-04-23T18:29:29.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.124+0000 7f4078e09640 1 -- 172.21.15.119:0/1312433999 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c062040 con 0x56005a321f60 2024-04-23T18:29:29.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.124+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56005a41b650 con 0x56005a321f60 2024-04-23T18:29:29.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.125+0000 7f4078e09640 1 -- 172.21.15.119:0/1312433999 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f417c067580 con 0x56005a321f60 2024-04-23T18:29:29.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.125+0000 7f4078e09640 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4074036e60 0x7f4074039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.125+0000 7f4078e09640 1 -- 172.21.15.119:0/1312433999 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f417c08e440 con 0x56005a321f60 2024-04-23T18:29:29.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.125+0000 7f418bfd0640 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4074036e60 0x7f4074039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.125+0000 7f4190b33800 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56005a323170 0x56005a421c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.125+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a4221d0 con 0x56005a323170 2024-04-23T18:29:29.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.125+0000 7f418cfd2640 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56005a323170 0x56005a421c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.125+0000 7f418bfd0640 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4074036e60 0x7f4074039320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4180000c00 tx=0x7f41800013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.126+0000 7f418cfd2640 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56005a323170 0x56005a421c00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.126+0000 7f418cfd2640 1 -- 172.21.15.119:0/1312433999 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a323170 2024-04-23T18:29:29.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.126+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a41f1b0 con 0x56005a323170 2024-04-23T18:29:29.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.126+0000 7f418cfd2640 1 -- 172.21.15.119:0/1312433999 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a323170 2024-04-23T18:29:29.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.126+0000 7f4190b33800 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56005a4244c0 0x56005a4268b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.126+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a426f50 con 0x56005a4244c0 2024-04-23T18:29:29.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.126+0000 7f418c7d1640 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56005a4244c0 0x56005a4268b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.127+0000 7f418c7d1640 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56005a4244c0 0x56005a4268b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.127+0000 7f418c7d1640 1 -- 172.21.15.119:0/1312433999 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f417c076070 con 0x56005a4244c0 2024-04-23T18:29:29.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.127+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a423440 con 0x56005a323170 2024-04-23T18:29:29.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.127+0000 7f418cfd2640 1 -- 172.21.15.119:0/1312433999 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a323170 2024-04-23T18:29:29.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.127+0000 7f4190b33800 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56005a4283b0 0x56005a42a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.127+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a42af80 con 0x56005a4283b0 2024-04-23T18:29:29.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.127+0000 7f418bfd0640 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56005a4283b0 0x56005a42a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.128+0000 7f418bfd0640 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56005a4283b0 0x56005a42a820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.128+0000 7f418bfd0640 1 -- 172.21.15.119:0/1312433999 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f418000f670 con 0x56005a4283b0 2024-04-23T18:29:29.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.128+0000 7f4190b33800 1 Processor -- start 2024-04-23T18:29:29.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.128+0000 7f4190b33800 1 -- start start 2024-04-23T18:29:29.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.129+0000 7f4190b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a439370 0x56005a439790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.129+0000 7f4190b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56005a213df0 con 0x56005a439370 2024-04-23T18:29:29.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.129+0000 7f418c7d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a439370 0x56005a439790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.129+0000 7f418c7d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a439370 0x56005a439790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60022/0 (socket says 172.21.15.119:60022) 2024-04-23T18:29:29.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.129+0000 7f418c7d1640 1 -- 172.21.15.119:0/2877694841 learned_addr learned my addr 172.21.15.119:0/2877694841 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.129+0000 7f418c7d1640 1 -- 172.21.15.119:0/2877694841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56005a439cd0 con 0x56005a439370 2024-04-23T18:29:29.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.129+0000 7f418c7d1640 1 --2- 172.21.15.119:0/2877694841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a439370 0x56005a439790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f417c0057e0 tx=0x7f417c067a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.129+0000 7f4071ffb640 1 -- 172.21.15.119:0/2877694841 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c08b260 con 0x56005a439370 2024-04-23T18:29:29.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.129+0000 7f4071ffb640 1 -- 172.21.15.119:0/2877694841 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c077b70 con 0x56005a439370 2024-04-23T18:29:29.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.129+0000 7f4190b33800 1 -- 172.21.15.119:0/2877694841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56005a43a740 con 0x56005a439370 2024-04-23T18:29:29.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.129+0000 7f4071ffb640 1 -- 172.21.15.119:0/2877694841 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c08b400 con 0x56005a439370 2024-04-23T18:29:29.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.130+0000 7f4190b33800 1 -- 172.21.15.119:0/2877694841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56005a43ac40 con 0x56005a439370 2024-04-23T18:29:29.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.130+0000 7f4071ffb640 1 -- 172.21.15.119:0/2877694841 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f417c05caa0 con 0x56005a439370 2024-04-23T18:29:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.130+0000 7f4071ffb640 1 --2- 172.21.15.119:0/2877694841 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4064036e60 0x7f4064039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.130+0000 7f4071ffb640 1 -- 172.21.15.119:0/2877694841 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f417c07f070 con 0x56005a439370 2024-04-23T18:29:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.131+0000 7f418bfd0640 1 --2- 172.21.15.119:0/2877694841 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4064036e60 0x7f4064039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.131+0000 7f4190b33800 1 Processor -- start 2024-04-23T18:29:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.131+0000 7f4190b33800 1 -- start start 2024-04-23T18:29:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.131+0000 7f418bfd0640 1 --2- 172.21.15.119:0/2877694841 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4064036e60 0x7f4064039320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x56005a41f0f0 tx=0x7f4180006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.131+0000 7f4190b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 0x56005a4469a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.131+0000 7f4190b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56005a413a50 con 0x56005a446580 2024-04-23T18:29:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.131+0000 7f418c7d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 0x56005a4469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.131+0000 7f418c7d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 0x56005a4469a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60030/0 (socket says 172.21.15.119:60030) 2024-04-23T18:29:29.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.131+0000 7f418c7d1640 1 -- 172.21.15.119:0/528225035 learned_addr learned my addr 172.21.15.119:0/528225035 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.131+0000 7f418c7d1640 1 -- 172.21.15.119:0/528225035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56005a446f70 con 0x56005a446580 2024-04-23T18:29:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.132+0000 7f418c7d1640 1 --2- 172.21.15.119:0/528225035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 0x56005a4469a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f417c067f00 tx=0x7f417c086f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35982c2e5ccfea6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.132+0000 7f406b7fe640 1 -- 172.21.15.119:0/528225035 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c06d8a0 con 0x56005a446580 2024-04-23T18:29:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.132+0000 7f406b7fe640 1 -- 172.21.15.119:0/528225035 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c06ddc0 con 0x56005a446580 2024-04-23T18:29:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.132+0000 7f406b7fe640 1 -- 172.21.15.119:0/528225035 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c05ed60 con 0x56005a446580 2024-04-23T18:29:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.132+0000 7f4190b33800 1 -- 172.21.15.119:0/528225035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 msgr2=0x56005a4469a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.132+0000 7f4190b33800 1 --2- 172.21.15.119:0/528225035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 0x56005a4469a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f417c067f00 tx=0x7f417c086f80 comp rx=0 tx=0).stop 2024-04-23T18:29:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.132+0000 7f4190b33800 1 -- 172.21.15.119:0/528225035 shutdown_connections 2024-04-23T18:29:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.132+0000 7f4190b33800 1 --2- 172.21.15.119:0/528225035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 0x56005a4469a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.132+0000 7f4190b33800 1 -- 172.21.15.119:0/528225035 >> 172.21.15.119:0/528225035 conn(0x56005a442890 msgr2=0x56005a4408f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.132+0000 7f4190b33800 1 -- 172.21.15.119:0/528225035 shutdown_connections 2024-04-23T18:29:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.132+0000 7f4190b33800 1 -- 172.21.15.119:0/528225035 wait complete. 2024-04-23T18:29:29.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.132+0000 7f4190b33800 1 Processor -- start 2024-04-23T18:29:29.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.133+0000 7f4190b33800 1 -- start start 2024-04-23T18:29:29.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.133+0000 7f4190b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 0x56005a44d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.133+0000 7f4190b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56005a447600 con 0x56005a446580 2024-04-23T18:29:29.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.133+0000 7f418c7d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 0x56005a44d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.133+0000 7f418c7d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 0x56005a44d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60046/0 (socket says 172.21.15.119:60046) 2024-04-23T18:29:29.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.133+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 learned_addr learned my addr 172.21.15.119:0/491829110 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.133+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56005a44de90 con 0x56005a446580 2024-04-23T18:29:29.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.133+0000 7f418c7d1640 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 0x56005a44d950 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f417c067f00 tx=0x7f417c06af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.134+0000 7f4069ffb640 1 -- 172.21.15.119:0/491829110 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c085e40 con 0x56005a446580 2024-04-23T18:29:29.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.134+0000 7f4069ffb640 1 -- 172.21.15.119:0/491829110 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c0b1070 con 0x56005a446580 2024-04-23T18:29:29.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.134+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56005a44de90 con 0x56005a446580 2024-04-23T18:29:29.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.134+0000 7f4069ffb640 1 -- 172.21.15.119:0/491829110 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f417c05e020 con 0x56005a446580 2024-04-23T18:29:29.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.134+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56005a44de90 con 0x56005a446580 2024-04-23T18:29:29.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.134+0000 7f4069ffb640 1 -- 172.21.15.119:0/491829110 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f417c0865a0 con 0x56005a446580 2024-04-23T18:29:29.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.135+0000 7f4069ffb640 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f405c036e60 0x7f405c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.135+0000 7f4069ffb640 1 -- 172.21.15.119:0/491829110 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f417c09c150 con 0x56005a446580 2024-04-23T18:29:29.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.135+0000 7f418bfd0640 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f405c036e60 0x7f405c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.135+0000 7f4190b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.135+0000 7f4190b33800 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56005a459060 0x56005a45b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.135+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a45bc70 con 0x56005a459060 2024-04-23T18:29:29.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.135+0000 7f418bfd0640 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f405c036e60 0x7f405c039320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f418000ffd0 tx=0x7f4180023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.135+0000 7f418cfd2640 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56005a459060 0x56005a45b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.135+0000 7f418cfd2640 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56005a459060 0x56005a45b520 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a459060 2024-04-23T18:29:29.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 20 realm 2024-04-23T18:29:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a45c080 con 0x56005a459060 2024-04-23T18:29:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a459060 2024-04-23T18:29:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a45c950 con 0x56005a459060 2024-04-23T18:29:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a459060 2024-04-23T18:29:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a459060 2024-04-23T18:29:29.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a459060 2024-04-23T18:29:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56005a45da50 0x56005a45fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.136+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a460450 con 0x56005a45da50 2024-04-23T18:29:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.137+0000 7f418c7d1640 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56005a45da50 0x56005a45fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.137+0000 7f418c7d1640 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56005a45da50 0x56005a45fe40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.137+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f417c076070 con 0x56005a45da50 2024-04-23T18:29:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.137+0000 7f4190b33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.137+0000 7f4190b33800 20 searching for the correct realm 2024-04-23T18:29:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.137+0000 7f4190b33800 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56005a462400 0x56005a4648c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.137+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a464f90 con 0x56005a462400 2024-04-23T18:29:29.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.137+0000 7f418bfd0640 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56005a462400 0x56005a4648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.137+0000 7f418bfd0640 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56005a462400 0x56005a4648c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.138+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.138+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a464f90 con 0x56005a45da50 2024-04-23T18:29:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.138+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f417c076070 con 0x56005a45da50 2024-04-23T18:29:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.138+0000 7f418c7d1640 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f417c083460 0x7f417c0a2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.138+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a464f90 con 0x7f417c083460 2024-04-23T18:29:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.138+0000 7f418cfd2640 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f417c083460 0x7f417c0a2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.139+0000 7f418cfd2640 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f417c083460 0x7f417c0a2480 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.139+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400a4a0 con 0x7f417c083460 2024-04-23T18:29:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.139+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a459060 2024-04-23T18:29:29.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.139+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a459060 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.139+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a459060 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.139+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a459060 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.139+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x7f417c083460 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.140+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400a4a0 con 0x7f417c083460 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.140+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x7f417c083460 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.140+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f418400a4a0 con 0x7f417c083460 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.140+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a45da50 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.140+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f417c076070 con 0x56005a45da50 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.140+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a462400 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.140+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.141+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a459060 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.141+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a459060 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.141+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x7f417c083460 2024-04-23T18:29:29.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.141+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400a4a0 con 0x7f417c083460 2024-04-23T18:29:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.141+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a459060 2024-04-23T18:29:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.141+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a459060 2024-04-23T18:29:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.141+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a45da50 2024-04-23T18:29:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.141+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f417c076070 con 0x56005a45da50 2024-04-23T18:29:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.141+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a462400 2024-04-23T18:29:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.142+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.142+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a462400 2024-04-23T18:29:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.142+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.142+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x7f417c083460 2024-04-23T18:29:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.142+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400a4a0 con 0x7f417c083460 2024-04-23T18:29:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.142+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a462400 2024-04-23T18:29:29.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.142+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.142+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a462400 2024-04-23T18:29:29.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.143+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.143+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a459060 2024-04-23T18:29:29.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.143+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a459060 2024-04-23T18:29:29.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.143+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a459060 2024-04-23T18:29:29.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.143+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a459060 2024-04-23T18:29:29.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.143+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x7f417c083460 2024-04-23T18:29:29.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.143+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400a4a0 con 0x7f417c083460 2024-04-23T18:29:29.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.143+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a462400 2024-04-23T18:29:29.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.144+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.144+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a45da50 2024-04-23T18:29:29.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.144+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f417c076070 con 0x56005a45da50 2024-04-23T18:29:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.144+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a459060 2024-04-23T18:29:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.144+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400a4a0 con 0x56005a459060 2024-04-23T18:29:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.144+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x7f417c083460 2024-04-23T18:29:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.144+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400a4a0 con 0x7f417c083460 2024-04-23T18:29:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.144+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a462400 2024-04-23T18:29:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.145+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.145+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x7f417c083460 2024-04-23T18:29:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.145+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418400a4a0 con 0x7f417c083460 2024-04-23T18:29:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.145+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a45da50 2024-04-23T18:29:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.145+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f417c076070 con 0x56005a45da50 2024-04-23T18:29:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.145+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a462400 2024-04-23T18:29:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.145+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.145+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x7f417c083460 2024-04-23T18:29:29.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a459060 2024-04-23T18:29:29.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56005a45ccf0 con 0x56005a45da50 2024-04-23T18:29:29.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f4190b33800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:29.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f4190b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:29.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f4190b33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:29.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f4190b33800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:29.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f4190b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:29.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f4190b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:29.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f4190b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a460d10 con 0x56005a459060 2024-04-23T18:29:29.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f4190b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f4190b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.146+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a460d10 con 0x56005a459060 2024-04-23T18:29:29.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:29.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a460d10 con 0x7f417c083460 2024-04-23T18:29:29.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:29.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 20 zone default found 2024-04-23T18:29:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 4 Realm: () 2024-04-23T18:29:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 20 zonegroup default 2024-04-23T18:29:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a461640 con 0x7f417c083460 2024-04-23T18:29:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.147+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a461640 con 0x56005a462400 2024-04-23T18:29:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.148+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.148+0000 7f4190b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.148+0000 7f4190b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.148+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a466df0 con 0x56005a462400 2024-04-23T18:29:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.148+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.148+0000 7f4190b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.148+0000 7f4190b33800 20 started sync module instance, tier type = 2024-04-23T18:29:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.148+0000 7f4190b33800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.148+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a466290 con 0x56005a45da50 2024-04-23T18:29:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.149+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.149+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94559514551984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a465ef0 con 0x56005a45da50 2024-04-23T18:29:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.149+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a467b30 con 0x56005a459060 2024-04-23T18:29:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.151+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.151+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94559514551984] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.151+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94559514555968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a468400 con 0x56005a459060 2024-04-23T18:29:29.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.151+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a467190 con 0x56005a462400 2024-04-23T18:29:29.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.154+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.154+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94559514555968] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.154+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94559514558592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a468e70 con 0x56005a462400 2024-04-23T18:29:29.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.154+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a469830 con 0x56005a45da50 2024-04-23T18:29:29.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.157+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94559514558592] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.157+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.157+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94559514560960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a46a0d0 con 0x56005a45da50 2024-04-23T18:29:29.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.157+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a46aa90 con 0x56005a459060 2024-04-23T18:29:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.159+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.159+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94559514568160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a46aeb0 con 0x56005a459060 2024-04-23T18:29:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.159+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a46b950 con 0x7f417c083460 2024-04-23T18:29:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.162+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94559514560960] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.162+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.162+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94559514571840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a46b910 con 0x7f417c083460 2024-04-23T18:29:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.162+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a46c390 con 0x7f417c083460 2024-04-23T18:29:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.162+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94559514568160] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.163+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94559514571840] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.165+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.165+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94559514565664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a46bee0 con 0x7f417c083460 2024-04-23T18:29:29.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.165+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a46c8a0 con 0x7f417c083460 2024-04-23T18:29:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.166+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.166+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94559514575856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a46ccc0 con 0x7f417c083460 2024-04-23T18:29:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.166+0000 7f4190b33800 20 add_watcher() i=0 2024-04-23T18:29:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.166+0000 7f4190b33800 20 add_watcher() i=1 2024-04-23T18:29:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.166+0000 7f4190b33800 20 add_watcher() i=2 2024-04-23T18:29:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.166+0000 7f4190b33800 20 add_watcher() i=3 2024-04-23T18:29:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.166+0000 7f4190b33800 20 add_watcher() i=4 2024-04-23T18:29:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.166+0000 7f4190b33800 20 add_watcher() i=5 2024-04-23T18:29:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.168+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94559514565664] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.168+0000 7f4190b33800 20 add_watcher() i=6 2024-04-23T18:29:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.168+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94559514575856] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.168+0000 7f4190b33800 20 add_watcher() i=7 2024-04-23T18:29:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.168+0000 7f4190b33800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.168+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a46aa00 con 0x56005a459060 2024-04-23T18:29:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.169+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.169+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94559514576912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a46aa00 con 0x56005a459060 2024-04-23T18:29:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.170+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94559514576912] v32'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.170+0000 7f40427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.170+0000 7f4190b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.170+0000 7f4190b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.170+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a478880 con 0x56005a459060 2024-04-23T18:29:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.171+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.171+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a478f50 con 0x7f417c083460 2024-04-23T18:29:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.172+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'10 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.172+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a479390 con 0x56005a462400 2024-04-23T18:29:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.173+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.173+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a479db0 con 0x56005a459060 2024-04-23T18:29:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.174+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.174+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a474540 con 0x56005a45da50 2024-04-23T18:29:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.175+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.175+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a474510 con 0x56005a462400 2024-04-23T18:29:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.176+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.176+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47a910 con 0x56005a459060 2024-04-23T18:29:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.178+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.178+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47adc0 con 0x7f417c083460 2024-04-23T18:29:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.179+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.179+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47adc0 con 0x56005a45da50 2024-04-23T18:29:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.180+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.180+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47adc0 con 0x56005a462400 2024-04-23T18:29:29.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.181+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.181+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b330 con 0x56005a45da50 2024-04-23T18:29:29.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.183+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.183+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b330 con 0x7f417c083460 2024-04-23T18:29:29.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.184+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.184+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b330 con 0x56005a45da50 2024-04-23T18:29:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.185+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.185+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b330 con 0x7f417c083460 2024-04-23T18:29:29.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.186+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.186+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b330 con 0x56005a459060 2024-04-23T18:29:29.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.187+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.187+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b330 con 0x56005a462400 2024-04-23T18:29:29.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.189+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.189+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x56005a45da50 2024-04-23T18:29:29.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.190+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.190+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x56005a462400 2024-04-23T18:29:29.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.190+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.191+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x56005a459060 2024-04-23T18:29:29.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.192+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.192+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x56005a459060 2024-04-23T18:29:29.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.193+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.193+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x56005a462400 2024-04-23T18:29:29.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.194+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.194+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x56005a45da50 2024-04-23T18:29:29.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.195+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.195+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x56005a462400 2024-04-23T18:29:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.196+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.196+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x56005a462400 2024-04-23T18:29:29.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.197+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.197+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x56005a462400 2024-04-23T18:29:29.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.198+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.198+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x56005a462400 2024-04-23T18:29:29.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.200+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'14 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.200+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x7f417c083460 2024-04-23T18:29:29.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.202+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.202+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x56005a462400 2024-04-23T18:29:29.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.203+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.203+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x7f417c083460 2024-04-23T18:29:29.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.204+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'14 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.204+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x56005a462400 2024-04-23T18:29:29.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.205+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.205+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x7f417c083460 2024-04-23T18:29:29.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.207+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.207+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a47b610 con 0x56005a45da50 2024-04-23T18:29:29.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.208+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.208+0000 7f40417e2640 20 reqs_thread_entry: start 2024-04-23T18:29:29.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.208+0000 7f4190b33800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:29.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.208+0000 7f4190b33800 20 Filter name: none 2024-04-23T18:29:29.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.208+0000 7f3fb2ffd640 20 reqs_thread_entry: start 2024-04-23T18:29:29.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.208+0000 7f4190b33800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-23T18:29:29.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.208+0000 7f4190b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.208+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56005a4a65c0 con 0x56005a45da50 2024-04-23T18:29:29.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.209+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.209+0000 7f4190b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.209+0000 7f4190b33800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-04-23T18:29:29.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.209+0000 7f4190b33800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-23T18:29:29.203 INFO:teuthology.orchestra.run.smithi119.stderr:could not remove user: unable to remove user, user does not exist 2024-04-23T18:29:29.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.209+0000 7f40427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:29.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.209+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94559514576912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a4771f0 con 0x56005a459060 2024-04-23T18:29:29.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.210+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94559514576912] v32'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.210+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94559514551984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a46c810 con 0x56005a45da50 2024-04-23T18:29:29.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.211+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94559514551984] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.211+0000 7f4190b33800 20 remove_watcher() i=0 2024-04-23T18:29:29.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.211+0000 7f4190b33800 2 removed watcher, disabling cache 2024-04-23T18:29:29.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.211+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94559514555968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a4666b0 con 0x56005a459060 2024-04-23T18:29:29.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.213+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94559514555968] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.213+0000 7f4190b33800 20 remove_watcher() i=1 2024-04-23T18:29:29.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.213+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94559514558592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a4666b0 con 0x56005a462400 2024-04-23T18:29:29.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.214+0000 7f418bfd0640 1 -- 172.21.15.119:0/491829110 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94559514558592] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4180037040 con 0x56005a462400 2024-04-23T18:29:29.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.214+0000 7f4190b33800 20 remove_watcher() i=2 2024-04-23T18:29:29.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.214+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94559514560960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a4666b0 con 0x56005a45da50 2024-04-23T18:29:29.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.215+0000 7f418c7d1640 1 -- 172.21.15.119:0/491829110 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94559514560960] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f417c0d0040 con 0x56005a45da50 2024-04-23T18:29:29.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.215+0000 7f4190b33800 20 remove_watcher() i=3 2024-04-23T18:29:29.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.215+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94559514568160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a4666b0 con 0x56005a459060 2024-04-23T18:29:29.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.216+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94559514568160] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x56005a459060 2024-04-23T18:29:29.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.216+0000 7f4190b33800 20 remove_watcher() i=4 2024-04-23T18:29:29.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.216+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94559514571840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a4666b0 con 0x7f417c083460 2024-04-23T18:29:29.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.217+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94559514571840] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.217+0000 7f4190b33800 20 remove_watcher() i=5 2024-04-23T18:29:29.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.217+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94559514565664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a46b440 con 0x7f417c083460 2024-04-23T18:29:29.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.218+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94559514565664] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.218+0000 7f4190b33800 20 remove_watcher() i=6 2024-04-23T18:29:29.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.218+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94559514575856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56005a4666b0 con 0x7f417c083460 2024-04-23T18:29:29.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94559514575856] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184040040 con 0x7f417c083460 2024-04-23T18:29:29.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 20 remove_watcher() i=7 2024-04-23T18:29:29.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f417c083460 msgr2=0x7f417c0a2480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f417c083460 0x7f417c0a2480 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56005a459060 msgr2=0x56005a45b520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56005a459060 0x56005a45b520 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56005a45da50 msgr2=0x56005a45fe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56005a45da50 0x56005a45fe40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56005a462400 msgr2=0x56005a4648c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56005a462400 0x56005a4648c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f405c036e60 msgr2=0x7f405c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f405c036e60 0x7f405c039320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f418000ffd0 tx=0x7f4180023040 comp rx=0 tx=0).stop 2024-04-23T18:29:29.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 msgr2=0x56005a44d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f418cfd2640 1 -- 172.21.15.119:0/491829110 reap_dead start 2024-04-23T18:29:29.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 0x56005a44d950 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f417c067f00 tx=0x7f417c06af40 comp rx=0 tx=0).stop 2024-04-23T18:29:29.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 shutdown_connections 2024-04-23T18:29:29.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 --2- 172.21.15.119:0/491829110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a446580 0x56005a44d950 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 >> 172.21.15.119:0/491829110 conn(0x56005a442890 msgr2=0x56005a43fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 shutdown_connections 2024-04-23T18:29:29.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.219+0000 7f4190b33800 1 -- 172.21.15.119:0/491829110 wait complete. 2024-04-23T18:29:29.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/2877694841 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4064036e60 msgr2=0x7f4064039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 --2- 172.21.15.119:0/2877694841 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4064036e60 0x7f4064039320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x56005a41f0f0 tx=0x7f4180006000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/2877694841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a439370 msgr2=0x56005a439790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 --2- 172.21.15.119:0/2877694841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a439370 0x56005a439790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f417c0057e0 tx=0x7f417c067a80 comp rx=0 tx=0).stop 2024-04-23T18:29:29.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/2877694841 shutdown_connections 2024-04-23T18:29:29.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 --2- 172.21.15.119:0/2877694841 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4064036e60 0x7f4064039320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 --2- 172.21.15.119:0/2877694841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a439370 0x56005a439790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/2877694841 >> 172.21.15.119:0/2877694841 conn(0x56005a42d410 msgr2=0x56005a42d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/2877694841 shutdown_connections 2024-04-23T18:29:29.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/2877694841 wait complete. 2024-04-23T18:29:29.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56005a4283b0 msgr2=0x56005a42a820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56005a4283b0 0x56005a42a820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56005a323170 msgr2=0x56005a421c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56005a323170 0x56005a421c00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56005a4244c0 msgr2=0x56005a4268b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56005a4244c0 0x56005a4268b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4074036e60 msgr2=0x7f4074039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4074036e60 0x7f4074039320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4180000c00 tx=0x7f41800013b0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 msgr2=0x56005a41ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 --2- 172.21.15.119:0/1312433999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56005a321f60 0x56005a41ab90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f417c005400 tx=0x7f417c002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f418cfd2640 1 -- 172.21.15.119:0/1312433999 reap_dead start 2024-04-23T18:29:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 shutdown_connections 2024-04-23T18:29:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 >> 172.21.15.119:0/1312433999 conn(0x56005a31d540 msgr2=0x56005a411d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 shutdown_connections 2024-04-23T18:29:29.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.220+0000 7f4190b33800 1 -- 172.21.15.119:0/1312433999 wait complete. 2024-04-23T18:29:29.220 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-23T18:29:29.221 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-04-23T18:29:29.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-04-23T18:29:29.221 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-04-23T18:29:29.304 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:29.304 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:29.305 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.312+0000 7fd44d92d800 1 Processor -- start 2024-04-23T18:29:29.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.312+0000 7fd44d92d800 1 -- start start 2024-04-23T18:29:29.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.312+0000 7fd44d92d800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f9e8f24f60 0x55f9e8f25380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.312+0000 7fd44d92d800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f9e8dd5560 con 0x55f9e8f26170 2024-04-23T18:29:29.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.312+0000 7fd44d92d800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55f9e8dc6e20 con 0x55f9e8f24f60 2024-04-23T18:29:29.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.313+0000 7fd44957f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f9e8f24f60 0x55f9e8f25380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.313+0000 7fd44957f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f9e8f24f60 0x55f9e8f25380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60056/0 (socket says 172.21.15.119:60056) 2024-04-23T18:29:29.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.313+0000 7fd448d7e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55f9e8f26170 0x55f9e8f265f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40418/0 (socket says 172.21.15.119:40418) 2024-04-23T18:29:29.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.313+0000 7fd44957f640 1 -- 172.21.15.119:0/899398594 learned_addr learned my addr 172.21.15.119:0/899398594 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.313+0000 7fd44957f640 1 -- 172.21.15.119:0/899398594 >> v1:172.21.15.62:6789/0 conn(0x55f9e8f26170 legacy=0x55f9e8f265f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.306 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.313+0000 7fd44957f640 1 -- 172.21.15.119:0/899398594 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e8dd4e60 con 0x55f9e8f24f60 2024-04-23T18:29:29.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.315+0000 7fd44957f640 1 --2- 172.21.15.119:0/899398594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e8f25380 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd43c005fd0 tx=0x7fd43c01cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66a4bc67f8332c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.315+0000 7fd43bfff640 1 -- 172.21.15.119:0/899398594 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43c052540 con 0x55f9e8f24f60 2024-04-23T18:29:29.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.315+0000 7fd43bfff640 1 -- 172.21.15.119:0/899398594 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43c04e070 con 0x55f9e8f24f60 2024-04-23T18:29:29.308 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.315+0000 7fd43bfff640 1 -- 172.21.15.119:0/899398594 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43c052890 con 0x55f9e8f24f60 2024-04-23T18:29:29.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.316+0000 7fd44d92d800 1 -- 172.21.15.119:0/899398594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 msgr2=0x55f9e8f25380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.316+0000 7fd44d92d800 1 --2- 172.21.15.119:0/899398594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e8f25380 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd43c005fd0 tx=0x7fd43c01cd80 comp rx=0 tx=0).stop 2024-04-23T18:29:29.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.316+0000 7fd44d92d800 1 -- 172.21.15.119:0/899398594 shutdown_connections 2024-04-23T18:29:29.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.316+0000 7fd44d92d800 1 --2- 172.21.15.119:0/899398594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e8f25380 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.316+0000 7fd44d92d800 1 -- 172.21.15.119:0/899398594 >> 172.21.15.119:0/899398594 conn(0x55f9e8f20540 msgr2=0x55f9e8f22960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.316+0000 7fd44d92d800 1 -- 172.21.15.119:0/899398594 shutdown_connections 2024-04-23T18:29:29.309 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.316+0000 7fd44d92d800 1 -- 172.21.15.119:0/899398594 wait complete. 2024-04-23T18:29:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.327+0000 7fd44d92d800 1 Processor -- start 2024-04-23T18:29:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.327+0000 7fd44d92d800 1 -- start start 2024-04-23T18:29:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.327+0000 7fd44d92d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e90165b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.327+0000 7fd44d92d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f9e8e705b0 con 0x55f9e8f24f60 2024-04-23T18:29:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.328+0000 7fd44957f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e90165b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.328+0000 7fd44957f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e90165b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60070/0 (socket says 172.21.15.119:60070) 2024-04-23T18:29:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.328+0000 7fd44957f640 1 -- 172.21.15.119:0/4058570665 learned_addr learned my addr 172.21.15.119:0/4058570665 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.328+0000 7fd44957f640 1 -- 172.21.15.119:0/4058570665 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e8de6860 con 0x55f9e8f24f60 2024-04-23T18:29:29.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.328+0000 7fd44957f640 1 --2- 172.21.15.119:0/4058570665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e90165b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd43c007000 tx=0x7fd43c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c4d1305ff2b1c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.328+0000 7fd337606640 1 -- 172.21.15.119:0/4058570665 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43c052860 con 0x55f9e8f24f60 2024-04-23T18:29:29.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.328+0000 7fd337606640 1 -- 172.21.15.119:0/4058570665 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43c058040 con 0x55f9e8f24f60 2024-04-23T18:29:29.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.328+0000 7fd337606640 1 -- 172.21.15.119:0/4058570665 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43c052b50 con 0x55f9e8f24f60 2024-04-23T18:29:29.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.329+0000 7fd44d92d800 1 -- 172.21.15.119:0/4058570665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 msgr2=0x55f9e90165b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.329+0000 7fd44d92d800 1 --2- 172.21.15.119:0/4058570665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e90165b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd43c007000 tx=0x7fd43c04c000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.329+0000 7fd44d92d800 1 -- 172.21.15.119:0/4058570665 shutdown_connections 2024-04-23T18:29:29.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.329+0000 7fd44d92d800 1 --2- 172.21.15.119:0/4058570665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e90165b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.329+0000 7fd44d92d800 1 -- 172.21.15.119:0/4058570665 >> 172.21.15.119:0/4058570665 conn(0x55f9e8f20540 msgr2=0x55f9e9011ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.329+0000 7fd44d92d800 1 -- 172.21.15.119:0/4058570665 shutdown_connections 2024-04-23T18:29:29.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.329+0000 7fd44d92d800 1 -- 172.21.15.119:0/4058570665 wait complete. 2024-04-23T18:29:29.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.330+0000 7fd44d92d800 1 Processor -- start 2024-04-23T18:29:29.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.330+0000 7fd44d92d800 1 -- start start 2024-04-23T18:29:29.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.330+0000 7fd44d92d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e901de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.330+0000 7fd44d92d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f9e8f2e5e0 con 0x55f9e8f24f60 2024-04-23T18:29:29.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.330+0000 7fd44957f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e901de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.330+0000 7fd44957f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e901de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60084/0 (socket says 172.21.15.119:60084) 2024-04-23T18:29:29.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.330+0000 7fd44957f640 1 -- 172.21.15.119:0/1909005833 learned_addr learned my addr 172.21.15.119:0/1909005833 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.330+0000 7fd44957f640 1 -- 172.21.15.119:0/1909005833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e8de4eb0 con 0x55f9e8f24f60 2024-04-23T18:29:29.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.331+0000 7fd44957f640 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e901de60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd43c007000 tx=0x7fd43c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.331+0000 7fd335e03640 1 -- 172.21.15.119:0/1909005833 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43c05d420 con 0x55f9e8f24f60 2024-04-23T18:29:29.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.331+0000 7fd335e03640 1 -- 172.21.15.119:0/1909005833 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43c05d5c0 con 0x55f9e8f24f60 2024-04-23T18:29:29.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.331+0000 7fd335e03640 1 -- 172.21.15.119:0/1909005833 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43c05d8c0 con 0x55f9e8f24f60 2024-04-23T18:29:29.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.331+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9e901e3a0 con 0x55f9e8f24f60 2024-04-23T18:29:29.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.331+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e901e8c0 con 0x55f9e8f24f60 2024-04-23T18:29:29.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.332+0000 7fd335e03640 1 -- 172.21.15.119:0/1909005833 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd43c050070 con 0x55f9e8f24f60 2024-04-23T18:29:29.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.332+0000 7fd335e03640 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd330036e60 0x7fd330039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.332+0000 7fd335e03640 1 -- 172.21.15.119:0/1909005833 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd43c062070 con 0x55f9e8f24f60 2024-04-23T18:29:29.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.332+0000 7fd448d7e640 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd330036e60 0x7fd330039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.332+0000 7fd44d92d800 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9e8f26170 0x55f9e9024ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.332+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9025410 con 0x55f9e8f26170 2024-04-23T18:29:29.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.332+0000 7fd449d80640 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9e8f26170 0x55f9e9024ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.332+0000 7fd448d7e640 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd330036e60 0x7fd330039320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd440001e40 tx=0x7fd4400013a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.332+0000 7fd449d80640 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9e8f26170 0x55f9e9024ed0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.333+0000 7fd449d80640 1 -- 172.21.15.119:0/1909005833 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4440083e0 con 0x55f9e8f26170 2024-04-23T18:29:29.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.333+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e90224a0 con 0x55f9e8f26170 2024-04-23T18:29:29.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.333+0000 7fd449d80640 1 -- 172.21.15.119:0/1909005833 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4440083e0 con 0x55f9e8f26170 2024-04-23T18:29:29.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.333+0000 7fd44d92d800 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9e9027720 0x55f9e9029b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.333+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e902a1e0 con 0x55f9e9027720 2024-04-23T18:29:29.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.333+0000 7fd44957f640 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9e9027720 0x55f9e9029b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.333+0000 7fd44957f640 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9e9027720 0x55f9e9029b10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.334+0000 7fd44957f640 1 -- 172.21.15.119:0/1909005833 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd43c078070 con 0x55f9e9027720 2024-04-23T18:29:29.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.334+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e90266d0 con 0x55f9e8f26170 2024-04-23T18:29:29.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.334+0000 7fd449d80640 1 -- 172.21.15.119:0/1909005833 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4440083e0 con 0x55f9e8f26170 2024-04-23T18:29:29.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.334+0000 7fd44d92d800 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f9e902b690 0x55f9e902db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.334+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e902e290 con 0x55f9e902b690 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.334+0000 7fd448d7e640 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f9e902b690 0x55f9e902db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.335+0000 7fd448d7e640 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f9e902b690 0x55f9e902db00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.335+0000 7fd448d7e640 1 -- 172.21.15.119:0/1909005833 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd44000f6d0 con 0x55f9e902b690 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.335+0000 7fd44d92d800 1 Processor -- start 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.335+0000 7fd44d92d800 1 -- start start 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.335+0000 7fd44d92d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8e9aa90 0x55f9e8e98f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.335+0000 7fd44d92d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f9e8e16df0 con 0x55f9e8e9aa90 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.336+0000 7fd44957f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8e9aa90 0x55f9e8e98f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.336+0000 7fd44957f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8e9aa90 0x55f9e8e98f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60100/0 (socket says 172.21.15.119:60100) 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.336+0000 7fd44957f640 1 -- 172.21.15.119:0/2061819611 learned_addr learned my addr 172.21.15.119:0/2061819611 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.336+0000 7fd44957f640 1 -- 172.21.15.119:0/2061819611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e8e99440 con 0x55f9e8e9aa90 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.336+0000 7fd44957f640 1 --2- 172.21.15.119:0/2061819611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8e9aa90 0x55f9e8e98f00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd43c064f90 tx=0x7fd43c068b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.336+0000 7fd32effd640 1 -- 172.21.15.119:0/2061819611 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43c08ec80 con 0x55f9e8e9aa90 2024-04-23T18:29:29.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.336+0000 7fd32effd640 1 -- 172.21.15.119:0/2061819611 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43c08ee20 con 0x55f9e8e9aa90 2024-04-23T18:29:29.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.336+0000 7fd32effd640 1 -- 172.21.15.119:0/2061819611 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43c064830 con 0x55f9e8e9aa90 2024-04-23T18:29:29.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.336+0000 7fd44d92d800 1 -- 172.21.15.119:0/2061819611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9e8e996d0 con 0x55f9e8e9aa90 2024-04-23T18:29:29.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.336+0000 7fd44d92d800 1 -- 172.21.15.119:0/2061819611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e8e99bd0 con 0x55f9e8e9aa90 2024-04-23T18:29:29.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.337+0000 7fd32effd640 1 -- 172.21.15.119:0/2061819611 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd43c069a60 con 0x55f9e8e9aa90 2024-04-23T18:29:29.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.337+0000 7fd32effd640 1 --2- 172.21.15.119:0/2061819611 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd324036e60 0x7fd324039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.337+0000 7fd32effd640 1 -- 172.21.15.119:0/2061819611 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd43c098c30 con 0x55f9e8e9aa90 2024-04-23T18:29:29.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.337+0000 7fd448d7e640 1 --2- 172.21.15.119:0/2061819611 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd324036e60 0x7fd324039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.337+0000 7fd44d92d800 1 Processor -- start 2024-04-23T18:29:29.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.338+0000 7fd44d92d800 1 -- start start 2024-04-23T18:29:29.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.338+0000 7fd448d7e640 1 --2- 172.21.15.119:0/2061819611 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd324036e60 0x7fd324039320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55f9e9026a70 tx=0x7fd44000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.338+0000 7fd44d92d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 0x55f9e904be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.338+0000 7fd44d92d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f9e9016c70 con 0x55f9e904ba40 2024-04-23T18:29:29.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.338+0000 7fd44957f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 0x55f9e904be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.338+0000 7fd44957f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 0x55f9e904be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60114/0 (socket says 172.21.15.119:60114) 2024-04-23T18:29:29.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.338+0000 7fd44957f640 1 -- 172.21.15.119:0/3650005947 learned_addr learned my addr 172.21.15.119:0/3650005947 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.338+0000 7fd44957f640 1 -- 172.21.15.119:0/3650005947 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e904c430 con 0x55f9e904ba40 2024-04-23T18:29:29.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.339+0000 7fd44957f640 1 --2- 172.21.15.119:0/3650005947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 0x55f9e904be60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd43c05db00 tx=0x7fd43c07bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f03ee9b3a75787 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.339+0000 7fd32cff9640 1 -- 172.21.15.119:0/3650005947 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43c08b0c0 con 0x55f9e904ba40 2024-04-23T18:29:29.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.339+0000 7fd32cff9640 1 -- 172.21.15.119:0/3650005947 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43c05cb80 con 0x55f9e904ba40 2024-04-23T18:29:29.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.339+0000 7fd32cff9640 1 -- 172.21.15.119:0/3650005947 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43c060130 con 0x55f9e904ba40 2024-04-23T18:29:29.349 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.339+0000 7fd44d92d800 1 -- 172.21.15.119:0/3650005947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 msgr2=0x55f9e904be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.339+0000 7fd44d92d800 1 --2- 172.21.15.119:0/3650005947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 0x55f9e904be60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd43c05db00 tx=0x7fd43c07bb40 comp rx=0 tx=0).stop 2024-04-23T18:29:29.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.339+0000 7fd44d92d800 1 -- 172.21.15.119:0/3650005947 shutdown_connections 2024-04-23T18:29:29.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.339+0000 7fd44d92d800 1 --2- 172.21.15.119:0/3650005947 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 0x55f9e904be60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.339+0000 7fd44d92d800 1 -- 172.21.15.119:0/3650005947 >> 172.21.15.119:0/3650005947 conn(0x55f9e9047d60 msgr2=0x55f9e9045dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.339+0000 7fd44d92d800 1 -- 172.21.15.119:0/3650005947 shutdown_connections 2024-04-23T18:29:29.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.339+0000 7fd44d92d800 1 -- 172.21.15.119:0/3650005947 wait complete. 2024-04-23T18:29:29.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.340+0000 7fd44d92d800 1 Processor -- start 2024-04-23T18:29:29.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.340+0000 7fd44d92d800 1 -- start start 2024-04-23T18:29:29.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.340+0000 7fd44d92d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 0x55f9e9052d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.340+0000 7fd44d92d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f9e904c9d0 con 0x55f9e904ba40 2024-04-23T18:29:29.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.340+0000 7fd44957f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 0x55f9e9052d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.340+0000 7fd44957f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 0x55f9e9052d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60124/0 (socket says 172.21.15.119:60124) 2024-04-23T18:29:29.350 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.340+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 learned_addr learned my addr 172.21.15.119:0/2277919529 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.340+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9e9053250 con 0x55f9e904ba40 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.340+0000 7fd44957f640 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 0x55f9e9052d10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd43c068c20 tx=0x7fd43c066f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.341+0000 7fd31affd640 1 -- 172.21.15.119:0/2277919529 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43c08b0c0 con 0x55f9e904ba40 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.341+0000 7fd31affd640 1 -- 172.21.15.119:0/2277919529 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43c069530 con 0x55f9e904ba40 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.341+0000 7fd31affd640 1 -- 172.21.15.119:0/2277919529 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43c060c10 con 0x55f9e904ba40 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.341+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9e9053250 con 0x55f9e904ba40 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.341+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9e9053250 con 0x55f9e904ba40 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.342+0000 7fd31affd640 1 -- 172.21.15.119:0/2277919529 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd43c0675d0 con 0x55f9e904ba40 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.342+0000 7fd31affd640 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd314036eb0 0x7fd314039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.342+0000 7fd31affd640 1 -- 172.21.15.119:0/2277919529 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd43c0a2070 con 0x55f9e904ba40 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.342+0000 7fd448d7e640 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd314036eb0 0x7fd314039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.342+0000 7fd44d92d800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.342+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9e905e2e0 0x55f9e90607a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.342+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9060ef0 con 0x55f9e905e2e0 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.342+0000 7fd449d80640 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9e905e2e0 0x55f9e90607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.342+0000 7fd448d7e640 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd314036eb0 0x7fd314039370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55f9e902e690 tx=0x7fd440010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd449d80640 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9e905e2e0 0x55f9e90607a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4440083e0 con 0x55f9e905e2e0 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 20 realm 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061300 con 0x55f9e905e2e0 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4440083e0 con 0x55f9e905e2e0 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e905e2e0 2024-04-23T18:29:29.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4440083e0 con 0x55f9e905e2e0 2024-04-23T18:29:29.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061f70 con 0x55f9e905e2e0 2024-04-23T18:29:29.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4440083e0 con 0x55f9e905e2e0 2024-04-23T18:29:29.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:29.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9e9062930 0x55f9e9064d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.343+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e90652f0 con 0x55f9e9062930 2024-04-23T18:29:29.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.344+0000 7fd44957f640 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9e9062930 0x55f9e9064d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.344+0000 7fd44957f640 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9e9062930 0x55f9e9064d20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.344+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.344+0000 7fd44d92d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:29.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.344+0000 7fd44d92d800 20 searching for the correct realm 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.344+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9e90672c0 0x55f9e9069780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.344+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9069e50 con 0x55f9e90672c0 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.344+0000 7fd448d7e640 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9e90672c0 0x55f9e9069780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.344+0000 7fd448d7e640 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9e90672c0 0x55f9e9069780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.345+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.345+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9069e50 con 0x55f9e9062930 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.345+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.345+0000 7fd44957f640 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fd43c0b0040 0x7fd43c0af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.345+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9069e50 con 0x7fd43c0b0040 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.345+0000 7fd449d80640 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fd43c0b0040 0x7fd43c0af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.345+0000 7fd449d80640 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fd43c0b0040 0x7fd43c0af6b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.346+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4440083e0 con 0x7fd43c0b0040 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.346+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e905e2e0 2024-04-23T18:29:29.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.346+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4440083e0 con 0x55f9e905e2e0 2024-04-23T18:29:29.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.346+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e905e2e0 2024-04-23T18:29:29.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.346+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.346+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x7fd43c0b0040 2024-04-23T18:29:29.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.347+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.347+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x7fd43c0b0040 2024-04-23T18:29:29.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.347+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.347+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e9062930 2024-04-23T18:29:29.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.347+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.347+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e90672c0 2024-04-23T18:29:29.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.347+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.347+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e905e2e0 2024-04-23T18:29:29.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.348+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.348+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x7fd43c0b0040 2024-04-23T18:29:29.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.348+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.348+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e905e2e0 2024-04-23T18:29:29.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.348+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.348+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e9062930 2024-04-23T18:29:29.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.348+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.348+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e90672c0 2024-04-23T18:29:29.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.349+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.349+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e90672c0 2024-04-23T18:29:29.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.349+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.349+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x7fd43c0b0040 2024-04-23T18:29:29.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.349+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.349+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e90672c0 2024-04-23T18:29:29.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.349+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.349+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e90672c0 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.349+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.349+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e905e2e0 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.350+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.350+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e905e2e0 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.350+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.350+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x7fd43c0b0040 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.350+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.350+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e90672c0 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.350+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.350+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e9062930 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.351+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.351+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e905e2e0 2024-04-23T18:29:29.357 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.351+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.351+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x7fd43c0b0040 2024-04-23T18:29:29.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.351+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.351+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e90672c0 2024-04-23T18:29:29.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.351+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.351+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x7fd43c0b0040 2024-04-23T18:29:29.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.352+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.352+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e9062930 2024-04-23T18:29:29.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.352+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.352+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e90672c0 2024-04-23T18:29:29.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.352+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.352+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x7fd43c0b0040 2024-04-23T18:29:29.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.352+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e905e2e0 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9061bd0 con 0x55f9e9062930 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9065bb0 con 0x55f9e905e2e0 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9065fa0 con 0x55f9e905e2e0 2024-04-23T18:29:29.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:29.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.353+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9065fa0 con 0x7fd43c0b0040 2024-04-23T18:29:29.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd44d92d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:29.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd44d92d800 20 zone default found 2024-04-23T18:29:29.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd44d92d800 4 Realm: () 2024-04-23T18:29:29.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd44d92d800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:29.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd44d92d800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:29.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd44d92d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:29.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd44d92d800 20 zonegroup default 2024-04-23T18:29:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd44d92d800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906a2d0 con 0x7fd43c0b0040 2024-04-23T18:29:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd44d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd44d92d800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906bcb0 con 0x55f9e90672c0 2024-04-23T18:29:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.354+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.355+0000 7fd44d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.355+0000 7fd44d92d800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.355+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906c050 con 0x55f9e90672c0 2024-04-23T18:29:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.355+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.355+0000 7fd44d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.355+0000 7fd44d92d800 20 started sync module instance, tier type = 2024-04-23T18:29:29.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.355+0000 7fd44d92d800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:29.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.355+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906b150 con 0x55f9e9062930 2024-04-23T18:29:29.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.356+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.356+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94531844748656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906adb0 con 0x55f9e9062930 2024-04-23T18:29:29.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.356+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906cf10 con 0x55f9e905e2e0 2024-04-23T18:29:29.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.357+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.357+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94531844754496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906d710 con 0x55f9e905e2e0 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.357+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906e230 con 0x55f9e90672c0 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.358+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94531844748656] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.359+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94531844754496] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.359+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.359+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94531844758784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906d160 con 0x55f9e90672c0 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.359+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906ec40 con 0x55f9e9062930 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.361+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94531844758784] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.361+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.361+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94531844752448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906f490 con 0x55f9e9062930 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.361+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906fce0 con 0x55f9e905e2e0 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.363+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.363+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94531844765328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9070110 con 0x55f9e905e2e0 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.363+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9070c30 con 0x7fd43c0b0040 2024-04-23T18:29:29.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.363+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94531844752448] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.364+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.364+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94531844769536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9070bf0 con 0x7fd43c0b0040 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.364+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9071640 con 0x7fd43c0b0040 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.364+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94531844765328] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.365+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94531844769536] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.365+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.365+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94531844763616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9071190 con 0x7fd43c0b0040 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.365+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9071ee0 con 0x7fd43c0b0040 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.366+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.366+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94531844774448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9071190 con 0x7fd43c0b0040 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.366+0000 7fd44d92d800 20 add_watcher() i=0 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.366+0000 7fd44d92d800 20 add_watcher() i=1 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.366+0000 7fd44d92d800 20 add_watcher() i=2 2024-04-23T18:29:29.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.366+0000 7fd44d92d800 20 add_watcher() i=3 2024-04-23T18:29:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.366+0000 7fd44d92d800 20 add_watcher() i=4 2024-04-23T18:29:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.366+0000 7fd44d92d800 20 add_watcher() i=5 2024-04-23T18:29:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.367+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94531844763616] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.367+0000 7fd44d92d800 20 add_watcher() i=6 2024-04-23T18:29:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.368+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94531844774448] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.368+0000 7fd44d92d800 20 add_watcher() i=7 2024-04-23T18:29:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.368+0000 7fd44d92d800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.368+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906fb30 con 0x55f9e905e2e0 2024-04-23T18:29:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.368+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.368+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94531844775504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906fb30 con 0x55f9e905e2e0 2024-04-23T18:29:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.369+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94531844775504] v32'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.369+0000 7fd2ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:29.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.369+0000 7fd44d92d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:29.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.369+0000 7fd44d92d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:29.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.369+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907db20 con 0x55f9e905e2e0 2024-04-23T18:29:29.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.371+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.371+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907e1f0 con 0x7fd43c0b0040 2024-04-23T18:29:29.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.373+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'11 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.373+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907e610 con 0x55f9e90672c0 2024-04-23T18:29:29.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.376+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.376+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907ef20 con 0x55f9e905e2e0 2024-04-23T18:29:29.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.380+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.380+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9079840 con 0x55f9e9062930 2024-04-23T18:29:29.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.384+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.384+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9079840 con 0x55f9e90672c0 2024-04-23T18:29:29.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.388+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.388+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907ff10 con 0x55f9e905e2e0 2024-04-23T18:29:29.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.391+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.391+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907ff10 con 0x7fd43c0b0040 2024-04-23T18:29:29.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.393+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.393+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907ff10 con 0x55f9e9062930 2024-04-23T18:29:29.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.394+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.394+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907ff10 con 0x55f9e90672c0 2024-04-23T18:29:29.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.395+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.395+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907ffa0 con 0x55f9e9062930 2024-04-23T18:29:29.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.396+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.396+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907ffa0 con 0x7fd43c0b0040 2024-04-23T18:29:29.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.397+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.397+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907ffa0 con 0x55f9e9062930 2024-04-23T18:29:29.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.399+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.400+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907ffa0 con 0x7fd43c0b0040 2024-04-23T18:29:29.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.404+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.404+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907ffa0 con 0x55f9e905e2e0 2024-04-23T18:29:29.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.405+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.405+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e907ffa0 con 0x55f9e90672c0 2024-04-23T18:29:29.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.407+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.407+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x55f9e9062930 2024-04-23T18:29:29.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.409+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.409+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x55f9e90672c0 2024-04-23T18:29:29.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.410+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.410+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x55f9e905e2e0 2024-04-23T18:29:29.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.411+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.411+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x55f9e905e2e0 2024-04-23T18:29:29.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.412+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.412+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x55f9e90672c0 2024-04-23T18:29:29.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.413+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.413+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x55f9e9062930 2024-04-23T18:29:29.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.414+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.414+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x55f9e90672c0 2024-04-23T18:29:29.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.415+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.415+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x55f9e90672c0 2024-04-23T18:29:29.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.416+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.416+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x55f9e90672c0 2024-04-23T18:29:29.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.418+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.418+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x55f9e90672c0 2024-04-23T18:29:29.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.420+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.420+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x7fd43c0b0040 2024-04-23T18:29:29.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.423+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.423+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x55f9e90672c0 2024-04-23T18:29:29.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.424+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.424+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x7fd43c0b0040 2024-04-23T18:29:29.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.426+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.426+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x55f9e90672c0 2024-04-23T18:29:29.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.427+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.427+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x7fd43c0b0040 2024-04-23T18:29:29.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.429+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.429+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9080530 con 0x55f9e9062930 2024-04-23T18:29:29.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.431+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.431+0000 7fd2fe7e4640 20 reqs_thread_entry: start 2024-04-23T18:29:29.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.431+0000 7fd44d92d800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:29.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.431+0000 7fd44d92d800 20 Filter name: none 2024-04-23T18:29:29.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.431+0000 7fd26ffff640 20 reqs_thread_entry: start 2024-04-23T18:29:29.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.431+0000 7fd44d92d800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-23T18:29:29.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.431+0000 7fd44d92d800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.431+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9e90ab220 con 0x7fd43c0b0040 2024-04-23T18:29:29.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.432+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.432+0000 7fd44d92d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.432+0000 7fd44d92d800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-23T18:29:29.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.432+0000 7fd44d92d800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-23T18:29:29.425 INFO:teuthology.orchestra.run.smithi119.stderr:could not remove user: unable to remove user, user does not exist 2024-04-23T18:29:29.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.432+0000 7fd2ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:29.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.432+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94531844775504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9078500 con 0x55f9e905e2e0 2024-04-23T18:29:29.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.433+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94531844775504] v32'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.433+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94531844748656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9071e50 con 0x55f9e9062930 2024-04-23T18:29:29.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.434+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94531844748656] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.434+0000 7fd44d92d800 20 remove_watcher() i=0 2024-04-23T18:29:29.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.434+0000 7fd44d92d800 2 removed watcher, disabling cache 2024-04-23T18:29:29.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.434+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94531844754496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9071e50 con 0x55f9e905e2e0 2024-04-23T18:29:29.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.436+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94531844754496] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.436+0000 7fd44d92d800 20 remove_watcher() i=1 2024-04-23T18:29:29.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.436+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94531844758784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9071e50 con 0x55f9e90672c0 2024-04-23T18:29:29.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.437+0000 7fd448d7e640 1 -- 172.21.15.119:0/2277919529 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94531844758784] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd440037040 con 0x55f9e90672c0 2024-04-23T18:29:29.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.437+0000 7fd44d92d800 20 remove_watcher() i=2 2024-04-23T18:29:29.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.437+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94531844752448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906dd00 con 0x55f9e9062930 2024-04-23T18:29:29.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.438+0000 7fd44957f640 1 -- 172.21.15.119:0/2277919529 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94531844752448] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd43c0bf020 con 0x55f9e9062930 2024-04-23T18:29:29.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.438+0000 7fd44d92d800 20 remove_watcher() i=3 2024-04-23T18:29:29.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.438+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94531844765328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e9071e50 con 0x55f9e905e2e0 2024-04-23T18:29:29.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.439+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94531844765328] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x55f9e905e2e0 2024-04-23T18:29:29.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.439+0000 7fd44d92d800 20 remove_watcher() i=4 2024-04-23T18:29:29.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.439+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94531844769536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906c440 con 0x7fd43c0b0040 2024-04-23T18:29:29.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.440+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94531844769536] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.440+0000 7fd44d92d800 20 remove_watcher() i=5 2024-04-23T18:29:29.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.440+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94531844763616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906dd00 con 0x7fd43c0b0040 2024-04-23T18:29:29.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.441+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94531844763616] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.441+0000 7fd44d92d800 20 remove_watcher() i=6 2024-04-23T18:29:29.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.441+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94531844774448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9e906f690 con 0x7fd43c0b0040 2024-04-23T18:29:29.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94531844774448] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd444026040 con 0x7fd43c0b0040 2024-04-23T18:29:29.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd44d92d800 20 remove_watcher() i=7 2024-04-23T18:29:29.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fd43c0b0040 msgr2=0x7fd43c0af6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fd43c0b0040 0x7fd43c0af6b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9e905e2e0 msgr2=0x55f9e90607a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9e905e2e0 0x55f9e90607a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9e9062930 msgr2=0x55f9e9064d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9e9062930 0x55f9e9064d20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9e90672c0 msgr2=0x55f9e9069780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9e90672c0 0x55f9e9069780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd314036eb0 msgr2=0x7fd314039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd314036eb0 0x7fd314039370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55f9e902e690 tx=0x7fd440010000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 msgr2=0x55f9e9052d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 0x55f9e9052d10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd43c068c20 tx=0x7fd43c066f20 comp rx=0 tx=0).stop 2024-04-23T18:29:29.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.442+0000 7fd449d80640 1 -- 172.21.15.119:0/2277919529 reap_dead start 2024-04-23T18:29:29.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 shutdown_connections 2024-04-23T18:29:29.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2277919529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e904ba40 0x55f9e9052d10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 >> 172.21.15.119:0/2277919529 conn(0x55f9e9047d60 msgr2=0x55f9e90453c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 shutdown_connections 2024-04-23T18:29:29.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/2277919529 wait complete. 2024-04-23T18:29:29.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/2061819611 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd324036e60 msgr2=0x7fd324039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2061819611 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd324036e60 0x7fd324039320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x55f9e9026a70 tx=0x7fd44000f000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/2061819611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8e9aa90 msgr2=0x55f9e8e98f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2061819611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8e9aa90 0x55f9e8e98f00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd43c064f90 tx=0x7fd43c068b50 comp rx=0 tx=0).stop 2024-04-23T18:29:29.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/2061819611 shutdown_connections 2024-04-23T18:29:29.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2061819611 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd324036e60 0x7fd324039320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 --2- 172.21.15.119:0/2061819611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8e9aa90 0x55f9e8e98f00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/2061819611 >> 172.21.15.119:0/2061819611 conn(0x55f9e9030790 msgr2=0x55f9e9030b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/2061819611 shutdown_connections 2024-04-23T18:29:29.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/2061819611 wait complete. 2024-04-23T18:29:29.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f9e902b690 msgr2=0x55f9e902db00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f9e902b690 0x55f9e902db00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9e8f26170 msgr2=0x55f9e9024ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9e8f26170 0x55f9e9024ed0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9e9027720 msgr2=0x55f9e9029b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9e9027720 0x55f9e9029b10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd330036e60 msgr2=0x7fd330039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd330036e60 0x7fd330039320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd440001e40 tx=0x7fd4400013a0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 msgr2=0x55f9e901de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 --2- 172.21.15.119:0/1909005833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9e8f24f60 0x55f9e901de60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd43c007000 tx=0x7fd43c003330 comp rx=0 tx=0).stop 2024-04-23T18:29:29.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd449d80640 1 -- 172.21.15.119:0/1909005833 reap_dead start 2024-04-23T18:29:29.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 shutdown_connections 2024-04-23T18:29:29.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 >> 172.21.15.119:0/1909005833 conn(0x55f9e8f20540 msgr2=0x55f9e9014fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 shutdown_connections 2024-04-23T18:29:29.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.443+0000 7fd44d92d800 1 -- 172.21.15.119:0/1909005833 wait complete. 2024-04-23T18:29:29.443 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-23T18:29:29.444 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-23T18:29:29.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-23T18:29:29.444 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-23T18:29:29.528 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:29.529 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:29.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.536+0000 7ffb14c0e800 1 Processor -- start 2024-04-23T18:29:29.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.537+0000 7ffb14c0e800 1 -- start start 2024-04-23T18:29:29.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.537+0000 7ffb14c0e800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55cf140fa3f0 0x55cf14102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.537+0000 7ffb14c0e800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cf13faa560 con 0x55cf140f88b0 2024-04-23T18:29:29.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.537+0000 7ffb14c0e800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55cf13f9be20 con 0x55cf140fa3f0 2024-04-23T18:29:29.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.537+0000 7ffb09f13640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55cf140fa3f0 0x55cf14102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.537+0000 7ffb12714640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55cf140f88b0 0x55cf140f8cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40422/0 (socket says 172.21.15.119:40422) 2024-04-23T18:29:29.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.537+0000 7ffb12714640 1 -- 172.21.15.119:0/2503152960 learned_addr learned my addr 172.21.15.119:0/2503152960 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:29.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.537+0000 7ffb09f13640 1 -- 172.21.15.119:0/2503152960 >> v1:172.21.15.62:6789/0 conn(0x55cf140f88b0 legacy=0x55cf140f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.537+0000 7ffb09f13640 1 -- 172.21.15.119:0/2503152960 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf13fa9e60 con 0x55cf140fa3f0 2024-04-23T18:29:29.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.539+0000 7ffb09f13640 1 --2- 172.21.15.119:0/2503152960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140fa3f0 0x55cf14102ef0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00a470 tx=0x7ffafc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac33cabc47bfb3c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.539+0000 7ffb11f13640 1 -- 172.21.15.119:0/2503152960 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffafc057070 con 0x55cf140fa3f0 2024-04-23T18:29:29.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.539+0000 7ffb11f13640 1 -- 172.21.15.119:0/2503152960 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffafc052570 con 0x55cf140fa3f0 2024-04-23T18:29:29.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.539+0000 7ffb11f13640 1 -- 172.21.15.119:0/2503152960 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffafc052870 con 0x55cf140fa3f0 2024-04-23T18:29:29.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.540+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2503152960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140fa3f0 msgr2=0x55cf14102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.540+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2503152960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140fa3f0 0x55cf14102ef0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffafc00a470 tx=0x7ffafc01ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:29.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.540+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2503152960 shutdown_connections 2024-04-23T18:29:29.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.540+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2503152960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140fa3f0 0x55cf14102ef0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.540+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2503152960 >> 172.21.15.119:0/2503152960 conn(0x55cf140f4410 msgr2=0x55cf140f6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.540+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2503152960 shutdown_connections 2024-04-23T18:29:29.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.540+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2503152960 wait complete. 2024-04-23T18:29:29.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.551+0000 7ffb14c0e800 1 Processor -- start 2024-04-23T18:29:29.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.552+0000 7ffb14c0e800 1 -- start start 2024-04-23T18:29:29.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.552+0000 7ffb14c0e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140f88b0 0x55cf141ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.552+0000 7ffb14c0e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55cf140455b0 con 0x55cf140f88b0 2024-04-23T18:29:29.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.552+0000 7ffb12714640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140f88b0 0x55cf141ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.552+0000 7ffb12714640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140f88b0 0x55cf141ed6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60144/0 (socket says 172.21.15.119:60144) 2024-04-23T18:29:29.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.552+0000 7ffb12714640 1 -- 172.21.15.119:0/3995506721 learned_addr learned my addr 172.21.15.119:0/3995506721 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.552+0000 7ffb12714640 1 -- 172.21.15.119:0/3995506721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf13fbb860 con 0x55cf140f88b0 2024-04-23T18:29:29.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.553+0000 7ffb12714640 1 --2- 172.21.15.119:0/3995506721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140f88b0 0x55cf141ed6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffb04001d50 tx=0x7ffb0400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5a3c3ed2ed0b5e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.553+0000 7ffa00608640 1 -- 172.21.15.119:0/3995506721 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb04013030 con 0x55cf140f88b0 2024-04-23T18:29:29.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.553+0000 7ffa00608640 1 -- 172.21.15.119:0/3995506721 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0400e470 con 0x55cf140f88b0 2024-04-23T18:29:29.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.553+0000 7ffa00608640 1 -- 172.21.15.119:0/3995506721 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb0400e810 con 0x55cf140f88b0 2024-04-23T18:29:29.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.553+0000 7ffb14c0e800 1 -- 172.21.15.119:0/3995506721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140f88b0 msgr2=0x55cf141ed6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.553+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/3995506721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140f88b0 0x55cf141ed6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffb04001d50 tx=0x7ffb0400b6c0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.553+0000 7ffb14c0e800 1 -- 172.21.15.119:0/3995506721 shutdown_connections 2024-04-23T18:29:29.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.553+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/3995506721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140f88b0 0x55cf141ed6d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.553+0000 7ffb14c0e800 1 -- 172.21.15.119:0/3995506721 >> 172.21.15.119:0/3995506721 conn(0x55cf140f4410 msgr2=0x55cf141e8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.553+0000 7ffb14c0e800 1 -- 172.21.15.119:0/3995506721 shutdown_connections 2024-04-23T18:29:29.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.553+0000 7ffb14c0e800 1 -- 172.21.15.119:0/3995506721 wait complete. 2024-04-23T18:29:29.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.554+0000 7ffb14c0e800 1 Processor -- start 2024-04-23T18:29:29.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.554+0000 7ffb14c0e800 1 -- start start 2024-04-23T18:29:29.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.554+0000 7ffb14c0e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140f88b0 0x55cf141f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.554+0000 7ffb14c0e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55cf14105710 con 0x55cf140f88b0 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.554+0000 7ffb12714640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140f88b0 0x55cf141f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.554+0000 7ffb12714640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140f88b0 0x55cf141f50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60152/0 (socket says 172.21.15.119:60152) 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.554+0000 7ffb12714640 1 -- 172.21.15.119:0/2071008489 learned_addr learned my addr 172.21.15.119:0/2071008489 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.554+0000 7ffb12714640 1 -- 172.21.15.119:0/2071008489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf13fb9eb0 con 0x55cf140f88b0 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.555+0000 7ffb12714640 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140f88b0 0x55cf141f50a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffb04004000 tx=0x7ffb04000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.555+0000 7ff9fee05640 1 -- 172.21.15.119:0/2071008489 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb04027070 con 0x55cf140f88b0 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.555+0000 7ff9fee05640 1 -- 172.21.15.119:0/2071008489 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb040013d0 con 0x55cf140f88b0 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.555+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf141f55e0 con 0x55cf140f88b0 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.555+0000 7ff9fee05640 1 -- 172.21.15.119:0/2071008489 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb04019ac0 con 0x55cf140f88b0 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.555+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf141f5b00 con 0x55cf140f88b0 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.556+0000 7ff9fee05640 1 -- 172.21.15.119:0/2071008489 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ffb0402a070 con 0x55cf140f88b0 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.556+0000 7ff9fee05640 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9f8036eb0 0x7ff9f8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.556+0000 7ff9fee05640 1 -- 172.21.15.119:0/2071008489 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7ffb0401f070 con 0x55cf140f88b0 2024-04-23T18:29:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.556+0000 7ffb09f13640 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9f8036eb0 0x7ff9f8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.556+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cf140fa3f0 0x55cf141fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.556+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf141fc640 con 0x55cf140fa3f0 2024-04-23T18:29:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.556+0000 7ffb12f15640 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cf140fa3f0 0x55cf141fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.556+0000 7ffb09f13640 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9f8036eb0 0x7ff9f8039370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffafc054000 tx=0x7ffafc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.556+0000 7ffb12f15640 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cf140fa3f0 0x55cf141fc0c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.557+0000 7ffb12f15640 1 -- 172.21.15.119:0/2071008489 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf140fa3f0 2024-04-23T18:29:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.557+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf141f9670 con 0x55cf140fa3f0 2024-04-23T18:29:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.557+0000 7ffb12f15640 1 -- 172.21.15.119:0/2071008489 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf140fa3f0 2024-04-23T18:29:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.557+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cf141fe950 0x55cf14200d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.557+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf142013e0 con 0x55cf141fe950 2024-04-23T18:29:29.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.557+0000 7ffb12714640 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cf141fe950 0x55cf14200d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.557+0000 7ffb12714640 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cf141fe950 0x55cf14200d40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.558+0000 7ffb12714640 1 -- 172.21.15.119:0/2071008489 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffb04029030 con 0x55cf141fe950 2024-04-23T18:29:29.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.558+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf141fd900 con 0x55cf140fa3f0 2024-04-23T18:29:29.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.558+0000 7ffb12f15640 1 -- 172.21.15.119:0/2071008489 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf140fa3f0 2024-04-23T18:29:29.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.558+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55cf14202890 0x55cf14204ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.558+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf14205440 con 0x55cf14202890 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.558+0000 7ffb09f13640 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55cf14202890 0x55cf14204ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.559+0000 7ffb09f13640 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55cf14202890 0x55cf14204ce0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.559+0000 7ffb09f13640 1 -- 172.21.15.119:0/2071008489 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffafc052a60 con 0x55cf14202890 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.559+0000 7ffb14c0e800 1 Processor -- start 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.559+0000 7ffb14c0e800 1 -- start start 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.559+0000 7ffb14c0e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf142138a0 0x55cf14213cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.559+0000 7ffb14c0e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55cf13febdf0 con 0x55cf142138a0 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.560+0000 7ffb12714640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf142138a0 0x55cf14213cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.560+0000 7ffb12714640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf142138a0 0x55cf14213cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60154/0 (socket says 172.21.15.119:60154) 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.560+0000 7ffb12714640 1 -- 172.21.15.119:0/2288921204 learned_addr learned my addr 172.21.15.119:0/2288921204 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.560+0000 7ffb12714640 1 -- 172.21.15.119:0/2288921204 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf14214200 con 0x55cf142138a0 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.560+0000 7ffb12714640 1 --2- 172.21.15.119:0/2288921204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf142138a0 0x55cf14213cc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffb0404b100 tx=0x7ffb04044b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.560+0000 7ff9f7fff640 1 -- 172.21.15.119:0/2288921204 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb04016730 con 0x55cf142138a0 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.560+0000 7ff9f7fff640 1 -- 172.21.15.119:0/2288921204 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb040168d0 con 0x55cf142138a0 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.560+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2288921204 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf14214c70 con 0x55cf142138a0 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.560+0000 7ff9f7fff640 1 -- 172.21.15.119:0/2288921204 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb0402a580 con 0x55cf142138a0 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.560+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2288921204 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf14215170 con 0x55cf142138a0 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.561+0000 7ff9f7fff640 1 -- 172.21.15.119:0/2288921204 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ffb04033070 con 0x55cf142138a0 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.561+0000 7ff9f7fff640 1 --2- 172.21.15.119:0/2288921204 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9ec036e60 0x7ff9ec039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.561+0000 7ff9f7fff640 1 -- 172.21.15.119:0/2288921204 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7ffb04014070 con 0x55cf142138a0 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.561+0000 7ffb09f13640 1 --2- 172.21.15.119:0/2288921204 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9ec036e60 0x7ff9ec039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.561+0000 7ffb14c0e800 1 Processor -- start 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.561+0000 7ffb14c0e800 1 -- start start 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.562+0000 7ffb14c0e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf14220a30 0x55cf14220e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.562+0000 7ffb09f13640 1 --2- 172.21.15.119:0/2288921204 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9ec036e60 0x7ff9ec039320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55cf141f95b0 tx=0x7ffafc005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.562+0000 7ffb14c0e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55cf141ede50 con 0x55cf14220a30 2024-04-23T18:29:29.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.562+0000 7ffb12714640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf14220a30 0x55cf14220e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.562+0000 7ffb12714640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf14220a30 0x55cf14220e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60168/0 (socket says 172.21.15.119:60168) 2024-04-23T18:29:29.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.562+0000 7ffb12714640 1 -- 172.21.15.119:0/3206816450 learned_addr learned my addr 172.21.15.119:0/3206816450 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.562+0000 7ffb12714640 1 -- 172.21.15.119:0/3206816450 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf142213e0 con 0x55cf14220a30 2024-04-23T18:29:29.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.562+0000 7ffb12714640 1 --2- 172.21.15.119:0/3206816450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf14220a30 0x55cf14220e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffb04021700 tx=0x7ffb04037fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e109b08082227f9d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.562+0000 7ff9f5ffb640 1 -- 172.21.15.119:0/3206816450 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb0400ce20 con 0x55cf14220a30 2024-04-23T18:29:29.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.562+0000 7ff9f5ffb640 1 -- 172.21.15.119:0/3206816450 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0405b070 con 0x55cf14220a30 2024-04-23T18:29:29.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.562+0000 7ff9f5ffb640 1 -- 172.21.15.119:0/3206816450 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb0402a720 con 0x55cf14220a30 2024-04-23T18:29:29.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.563+0000 7ffb14c0e800 1 -- 172.21.15.119:0/3206816450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf14220a30 msgr2=0x55cf14220e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.563+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/3206816450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf14220a30 0x55cf14220e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffb04021700 tx=0x7ffb04037fc0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.563+0000 7ffb14c0e800 1 -- 172.21.15.119:0/3206816450 shutdown_connections 2024-04-23T18:29:29.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.563+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/3206816450 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf14220a30 0x55cf14220e10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.563+0000 7ffb14c0e800 1 -- 172.21.15.119:0/3206816450 >> 172.21.15.119:0/3206816450 conn(0x55cf1421cd00 msgr2=0x55cf1421ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.563+0000 7ffb14c0e800 1 -- 172.21.15.119:0/3206816450 shutdown_connections 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.563+0000 7ffb14c0e800 1 -- 172.21.15.119:0/3206816450 wait complete. 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.563+0000 7ffb14c0e800 1 Processor -- start 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.563+0000 7ffb14c0e800 1 -- start start 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.563+0000 7ffb14c0e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf14220a30 0x55cf14227cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.563+0000 7ffb14c0e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55cf14221af0 con 0x55cf14220a30 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.564+0000 7ffb12714640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf14220a30 0x55cf14227cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.564+0000 7ffb12714640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf14220a30 0x55cf14227cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60176/0 (socket says 172.21.15.119:60176) 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.564+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 learned_addr learned my addr 172.21.15.119:0/4032416138 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.564+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf14228230 con 0x55cf14220a30 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.564+0000 7ffb12714640 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf14220a30 0x55cf14227cf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffb0402de90 tx=0x7ffb0401cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.564+0000 7ff9e3fff640 1 -- 172.21.15.119:0/4032416138 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb04048950 con 0x55cf14220a30 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.564+0000 7ff9e3fff640 1 -- 172.21.15.119:0/4032416138 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb04048af0 con 0x55cf14220a30 2024-04-23T18:29:29.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.564+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf14228230 con 0x55cf14220a30 2024-04-23T18:29:29.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.564+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf14228230 con 0x55cf14220a30 2024-04-23T18:29:29.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.564+0000 7ff9e3fff640 1 -- 172.21.15.119:0/4032416138 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb0403f1d0 con 0x55cf14220a30 2024-04-23T18:29:29.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.565+0000 7ff9e3fff640 1 -- 172.21.15.119:0/4032416138 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ffb04055070 con 0x55cf14220a30 2024-04-23T18:29:29.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.566+0000 7ff9e3fff640 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9dc036eb0 0x7ff9dc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.566+0000 7ff9e3fff640 1 -- 172.21.15.119:0/4032416138 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7ffb04052070 con 0x55cf14220a30 2024-04-23T18:29:29.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.566+0000 7ffb09f13640 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9dc036eb0 0x7ff9dc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.566+0000 7ffb14c0e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.566+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cf142334d0 0x55cf14235990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.566+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf142360e0 con 0x55cf142334d0 2024-04-23T18:29:29.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.566+0000 7ffb12f15640 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cf142334d0 0x55cf14235990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.566+0000 7ffb09f13640 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9dc036eb0 0x7ff9dc039370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffafc055040 tx=0x7ffafc04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.566+0000 7ffb12f15640 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cf142334d0 0x55cf14235990 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf142334d0 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 20 realm 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf142364f0 con 0x55cf142334d0 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf142334d0 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf14236dc0 con 0x55cf142334d0 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf142334d0 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf142334d0 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf142334d0 2024-04-23T18:29:29.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:29.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cf14237ec0 0x55cf1423a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf1423a8c0 con 0x55cf14237ec0 2024-04-23T18:29:29.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.567+0000 7ffb12714640 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cf14237ec0 0x55cf1423a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.568+0000 7ffb12714640 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cf14237ec0 0x55cf1423a2b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.568+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.568+0000 7ffb14c0e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:29.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.568+0000 7ffb14c0e800 20 searching for the correct realm 2024-04-23T18:29:29.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.568+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55cf1423c870 0x55cf1423ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.568+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf1423f400 con 0x55cf1423c870 2024-04-23T18:29:29.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.568+0000 7ffb09f13640 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55cf1423c870 0x55cf1423ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.568+0000 7ffb09f13640 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55cf1423c870 0x55cf1423ed30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.569+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.569+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf1423f400 con 0x55cf14237ec0 2024-04-23T18:29:29.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.569+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.569+0000 7ffb12714640 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ffb0402c060 0x7ffb04023790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.569+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf1423f400 con 0x7ffb0402c060 2024-04-23T18:29:29.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.569+0000 7ffb12f15640 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ffb0402c060 0x7ffb04023790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.569+0000 7ffb12f15640 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ffb0402c060 0x7ffb04023790 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.570+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x7ffb0402c060 2024-04-23T18:29:29.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.570+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf142334d0 2024-04-23T18:29:29.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.570+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf142334d0 2024-04-23T18:29:29.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.570+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf142334d0 2024-04-23T18:29:29.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.570+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf142334d0 2024-04-23T18:29:29.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.570+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x7ffb0402c060 2024-04-23T18:29:29.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.570+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x7ffb0402c060 2024-04-23T18:29:29.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.571+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x7ffb0402c060 2024-04-23T18:29:29.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.571+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x7ffb0402c060 2024-04-23T18:29:29.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.571+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf14237ec0 2024-04-23T18:29:29.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.571+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.571+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf1423c870 2024-04-23T18:29:29.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.571+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.571+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf142334d0 2024-04-23T18:29:29.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.571+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf142334d0 2024-04-23T18:29:29.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.571+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x7ffb0402c060 2024-04-23T18:29:29.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.572+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x7ffb0402c060 2024-04-23T18:29:29.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.572+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf142334d0 2024-04-23T18:29:29.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.572+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf142334d0 2024-04-23T18:29:29.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.572+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf14237ec0 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.572+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.572+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf1423c870 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.573+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.573+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf1423c870 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.573+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.573+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x7ffb0402c060 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.573+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x7ffb0402c060 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.573+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf1423c870 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.573+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.573+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf1423c870 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.573+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.574+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf142334d0 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.574+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf142334d0 2024-04-23T18:29:29.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.574+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf142334d0 2024-04-23T18:29:29.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.574+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf142334d0 2024-04-23T18:29:29.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.574+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x7ffb0402c060 2024-04-23T18:29:29.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.574+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x7ffb0402c060 2024-04-23T18:29:29.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.574+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf1423c870 2024-04-23T18:29:29.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.574+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.574+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf14237ec0 2024-04-23T18:29:29.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.575+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.575+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf142334d0 2024-04-23T18:29:29.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.575+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x55cf142334d0 2024-04-23T18:29:29.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.575+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x7ffb0402c060 2024-04-23T18:29:29.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.575+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x7ffb0402c060 2024-04-23T18:29:29.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.575+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf1423c870 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.575+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.575+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x7ffb0402c060 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.576+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c00a4a0 con 0x7ffb0402c060 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.576+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf14237ec0 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.576+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.576+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf1423c870 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.576+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.576+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x7ffb0402c060 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf142334d0 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cf14237160 con 0x55cf14237ec0 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb14c0e800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb14c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb14c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb14c0e800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb14c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb14c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb14c0e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf1423b180 con 0x55cf142334d0 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb14c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb14c0e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.577+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf1423b180 con 0x55cf142334d0 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:29.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf1423b180 con 0x7ffb0402c060 2024-04-23T18:29:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 20 zone default found 2024-04-23T18:29:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 4 Realm: () 2024-04-23T18:29:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 20 zonegroup default 2024-04-23T18:29:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf1423ba70 con 0x7ffb0402c060 2024-04-23T18:29:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf1423ba70 con 0x55cf1423c870 2024-04-23T18:29:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.578+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf14241260 con 0x55cf1423c870 2024-04-23T18:29:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.579+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.579+0000 7ffb14c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.579+0000 7ffb14c0e800 20 started sync module instance, tier type = 2024-04-23T18:29:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.579+0000 7ffb14c0e800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.579+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14240700 con 0x55cf14237ec0 2024-04-23T18:29:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.580+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.580+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94347884495440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14241600 con 0x55cf14237ec0 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.580+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14241fc0 con 0x55cf142334d0 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.581+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94347884495440] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.582+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.582+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94347884501776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf142423e0 con 0x55cf142334d0 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.582+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14242da0 con 0x55cf1423c870 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.583+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.583+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94347884505328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf142435f0 con 0x55cf1423c870 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.583+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14244090 con 0x55cf14237ec0 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.583+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94347884501776] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.584+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.584+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94347884502832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14244930 con 0x55cf14237ec0 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.584+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf142452f0 con 0x55cf142334d0 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.586+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94347884505328] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.587+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.587+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94347884507456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf142452f0 con 0x55cf142334d0 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.587+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14245cb0 con 0x7ffb0402c060 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.587+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94347884502832] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.588+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94347884507456] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.588+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.588+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94347884517376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf142452f0 con 0x7ffb0402c060 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.588+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14245c20 con 0x7ffb0402c060 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.589+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94347884517376] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.589+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.589+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94347884514880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf142462b0 con 0x7ffb0402c060 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.589+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14246b00 con 0x7ffb0402c060 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.590+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94347884514880] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.590+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.590+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94347884519392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14246970 con 0x7ffb0402c060 2024-04-23T18:29:29.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.590+0000 7ffb14c0e800 20 add_watcher() i=0 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.590+0000 7ffb14c0e800 20 add_watcher() i=1 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.590+0000 7ffb14c0e800 20 add_watcher() i=2 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.590+0000 7ffb14c0e800 20 add_watcher() i=3 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.590+0000 7ffb14c0e800 20 add_watcher() i=4 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.590+0000 7ffb14c0e800 20 add_watcher() i=5 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.590+0000 7ffb14c0e800 20 add_watcher() i=6 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.591+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94347884519392] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.591+0000 7ffb14c0e800 20 add_watcher() i=7 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.591+0000 7ffb14c0e800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.591+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf14249ee0 con 0x55cf142334d0 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.591+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.591+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94347884520448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14247360 con 0x55cf142334d0 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.592+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94347884520448] v32'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.592+0000 7ff9c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:29.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.592+0000 7ffb14c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:29.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.592+0000 7ffb14c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:29.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.593+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14249d00 con 0x55cf142334d0 2024-04-23T18:29:29.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.594+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.594+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14253210 con 0x7ffb0402c060 2024-04-23T18:29:29.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.595+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'12 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.595+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14253630 con 0x55cf1423c870 2024-04-23T18:29:29.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.596+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.596+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14254050 con 0x55cf142334d0 2024-04-23T18:29:29.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.597+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.597+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14252780 con 0x55cf14237ec0 2024-04-23T18:29:29.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.598+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.598+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14252720 con 0x55cf1423c870 2024-04-23T18:29:29.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.599+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.599+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14254bb0 con 0x55cf142334d0 2024-04-23T18:29:29.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.602+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.602+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255240 con 0x7ffb0402c060 2024-04-23T18:29:29.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.603+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.603+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255240 con 0x55cf14237ec0 2024-04-23T18:29:29.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.604+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.604+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255240 con 0x55cf1423c870 2024-04-23T18:29:29.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.605+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.605+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf142556f0 con 0x55cf14237ec0 2024-04-23T18:29:29.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.606+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.606+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf142556f0 con 0x7ffb0402c060 2024-04-23T18:29:29.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.607+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.607+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf142556a0 con 0x55cf14237ec0 2024-04-23T18:29:29.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.609+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.609+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x7ffb0402c060 2024-04-23T18:29:29.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.610+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.610+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf142334d0 2024-04-23T18:29:29.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.611+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.611+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf1423c870 2024-04-23T18:29:29.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.612+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.612+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf14237ec0 2024-04-23T18:29:29.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.613+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.613+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf1423c870 2024-04-23T18:29:29.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.614+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.615+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf142334d0 2024-04-23T18:29:29.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.616+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.616+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf142334d0 2024-04-23T18:29:29.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.618+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.618+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf1423c870 2024-04-23T18:29:29.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.621+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.621+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf14237ec0 2024-04-23T18:29:29.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.622+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.622+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf1423c870 2024-04-23T18:29:29.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.623+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.623+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf1423c870 2024-04-23T18:29:29.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.626+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.626+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf1423c870 2024-04-23T18:29:29.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.628+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.628+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf1423c870 2024-04-23T18:29:29.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.629+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.629+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x7ffb0402c060 2024-04-23T18:29:29.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.630+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.630+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf1423c870 2024-04-23T18:29:29.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.631+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.631+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x7ffb0402c060 2024-04-23T18:29:29.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.637+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.637+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf1423c870 2024-04-23T18:29:29.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.638+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.638+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x7ffb0402c060 2024-04-23T18:29:29.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.639+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.639+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14255670 con 0x55cf14237ec0 2024-04-23T18:29:29.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.640+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.641+0000 7ff9437fe640 20 reqs_thread_entry: start 2024-04-23T18:29:29.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.641+0000 7ffb14c0e800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:29.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.641+0000 7ffb14c0e800 20 Filter name: none 2024-04-23T18:29:29.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.641+0000 7ff9417fa640 20 reqs_thread_entry: start 2024-04-23T18:29:29.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.641+0000 7ffb14c0e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-23T18:29:29.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.641+0000 7ffb14c0e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.641+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cf14280630 con 0x7ffb0402c060 2024-04-23T18:29:29.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.641+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.641+0000 7ffb14c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.641+0000 7ffb14c0e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-23T18:29:29.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.641+0000 7ffb14c0e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-23T18:29:29.635 INFO:teuthology.orchestra.run.smithi119.stderr:could not remove user: unable to remove user, user does not exist 2024-04-23T18:29:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.642+0000 7ff9c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.642+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94347884520448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14251350 con 0x55cf142334d0 2024-04-23T18:29:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.643+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94347884520448] v32'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.636 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.643+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94347884495440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14246400 con 0x55cf14237ec0 2024-04-23T18:29:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.644+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94347884495440] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.644+0000 7ffb14c0e800 20 remove_watcher() i=0 2024-04-23T18:29:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.644+0000 7ffb14c0e800 2 removed watcher, disabling cache 2024-04-23T18:29:29.637 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.644+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94347884501776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14246400 con 0x55cf142334d0 2024-04-23T18:29:29.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.645+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94347884501776] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.645+0000 7ffb14c0e800 20 remove_watcher() i=1 2024-04-23T18:29:29.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.645+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94347884505328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14241b10 con 0x55cf1423c870 2024-04-23T18:29:29.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.646+0000 7ffb09f13640 1 -- 172.21.15.119:0/4032416138 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94347884505328] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffafc081070 con 0x55cf1423c870 2024-04-23T18:29:29.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.646+0000 7ffb14c0e800 20 remove_watcher() i=2 2024-04-23T18:29:29.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.647+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94347884502832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf142428f0 con 0x55cf14237ec0 2024-04-23T18:29:29.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.647+0000 7ffb12714640 1 -- 172.21.15.119:0/4032416138 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94347884502832] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0407d040 con 0x55cf14237ec0 2024-04-23T18:29:29.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.647+0000 7ffb14c0e800 20 remove_watcher() i=3 2024-04-23T18:29:29.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.647+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94347884507456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf142428f0 con 0x55cf142334d0 2024-04-23T18:29:29.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.649+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94347884507456] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x55cf142334d0 2024-04-23T18:29:29.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.649+0000 7ffb14c0e800 20 remove_watcher() i=4 2024-04-23T18:29:29.642 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.649+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94347884517376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14241fc0 con 0x7ffb0402c060 2024-04-23T18:29:29.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.650+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94347884517376] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.650+0000 7ffb14c0e800 20 remove_watcher() i=5 2024-04-23T18:29:29.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.650+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94347884514880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14241fc0 con 0x7ffb0402c060 2024-04-23T18:29:29.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.652+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94347884514880] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.652+0000 7ffb14c0e800 20 remove_watcher() i=6 2024-04-23T18:29:29.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.652+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94347884519392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cf14241fc0 con 0x7ffb0402c060 2024-04-23T18:29:29.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94347884519392] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb0c040040 con 0x7ffb0402c060 2024-04-23T18:29:29.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 20 remove_watcher() i=7 2024-04-23T18:29:29.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ffb0402c060 msgr2=0x7ffb04023790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ffb0402c060 0x7ffb04023790 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cf142334d0 msgr2=0x55cf14235990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cf142334d0 0x55cf14235990 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cf14237ec0 msgr2=0x55cf1423a2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cf14237ec0 0x55cf1423a2b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55cf1423c870 msgr2=0x55cf1423ed30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55cf1423c870 0x55cf1423ed30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9dc036eb0 msgr2=0x7ff9dc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9dc036eb0 0x7ff9dc039370 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffafc055040 tx=0x7ffafc04f000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf14220a30 msgr2=0x55cf14227cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/4032416138 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf14220a30 0x55cf14227cf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffb0402de90 tx=0x7ffb0401cf40 comp rx=0 tx=0).stop 2024-04-23T18:29:29.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 reap_dead start 2024-04-23T18:29:29.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb12f15640 1 -- 172.21.15.119:0/4032416138 reap_dead start 2024-04-23T18:29:29.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 shutdown_connections 2024-04-23T18:29:29.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 >> 172.21.15.119:0/4032416138 conn(0x55cf1421cd00 msgr2=0x55cf1421a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 shutdown_connections 2024-04-23T18:29:29.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/4032416138 wait complete. 2024-04-23T18:29:29.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2288921204 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9ec036e60 msgr2=0x7ff9ec039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2288921204 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9ec036e60 0x7ff9ec039320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55cf141f95b0 tx=0x7ffafc005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:29.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2288921204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf142138a0 msgr2=0x55cf14213cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2288921204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf142138a0 0x55cf14213cc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffb0404b100 tx=0x7ffb04044b30 comp rx=0 tx=0).stop 2024-04-23T18:29:29.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2288921204 shutdown_connections 2024-04-23T18:29:29.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2288921204 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9ec036e60 0x7ff9ec039320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2288921204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf142138a0 0x55cf14213cc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2288921204 >> 172.21.15.119:0/2288921204 conn(0x55cf14207940 msgr2=0x55cf14207d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2288921204 shutdown_connections 2024-04-23T18:29:29.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.653+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2288921204 wait complete. 2024-04-23T18:29:29.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55cf14202890 msgr2=0x55cf14204ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55cf14202890 0x55cf14204ce0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cf140fa3f0 msgr2=0x55cf141fc0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cf140fa3f0 0x55cf141fc0c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cf141fe950 msgr2=0x55cf14200d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cf141fe950 0x55cf14200d40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9f8036eb0 msgr2=0x7ff9f8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff9f8036eb0 0x7ff9f8039370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffafc054000 tx=0x7ffafc04e000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140f88b0 msgr2=0x55cf141f50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 --2- 172.21.15.119:0/2071008489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cf140f88b0 0x55cf141f50a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffb04004000 tx=0x7ffb04000bc0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb12f15640 1 -- 172.21.15.119:0/2071008489 reap_dead start 2024-04-23T18:29:29.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 shutdown_connections 2024-04-23T18:29:29.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 >> 172.21.15.119:0/2071008489 conn(0x55cf140f4410 msgr2=0x55cf141ec0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 shutdown_connections 2024-04-23T18:29:29.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.654+0000 7ffb14c0e800 1 -- 172.21.15.119:0/2071008489 wait complete. 2024-04-23T18:29:29.654 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-23T18:29:29.655 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-23T18:29:29.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-23T18:29:29.655 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-23T18:29:29.738 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:29.738 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:29.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.746+0000 7fc81263f800 1 Processor -- start 2024-04-23T18:29:29.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.746+0000 7fc81263f800 1 -- start start 2024-04-23T18:29:29.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.747+0000 7fc81263f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c3b98c8030 0x55c3b9957b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.747+0000 7fc81263f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c3b9805560 con 0x55c3b9958090 2024-04-23T18:29:29.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.747+0000 7fc81263f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55c3b97f6e20 con 0x55c3b98c8030 2024-04-23T18:29:29.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.747+0000 7fc81013e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c3b98c8030 0x55c3b9957b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.747+0000 7fc80793d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55c3b9958090 0x55c3b995a550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40438/0 (socket says 172.21.15.119:40438) 2024-04-23T18:29:29.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.747+0000 7fc80793d640 1 -- 172.21.15.119:0/2974509175 learned_addr learned my addr 172.21.15.119:0/2974509175 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:29.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.747+0000 7fc81013e640 1 -- 172.21.15.119:0/2974509175 >> v1:172.21.15.62:6789/0 conn(0x55c3b9958090 legacy=0x55c3b995a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.747+0000 7fc81013e640 1 -- 172.21.15.119:0/2974509175 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b9804e60 con 0x55c3b98c8030 2024-04-23T18:29:29.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.749+0000 7fc81013e640 1 --2- 172.21.15.119:0/2974509175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9957b20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc80000a470 tx=0x7fc80001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf2961b96f2d823 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.749+0000 7fc80f93d640 1 -- 172.21.15.119:0/2974509175 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc800057070 con 0x55c3b98c8030 2024-04-23T18:29:29.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.749+0000 7fc80f93d640 1 -- 172.21.15.119:0/2974509175 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc800052570 con 0x55c3b98c8030 2024-04-23T18:29:29.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.749+0000 7fc80f93d640 1 -- 172.21.15.119:0/2974509175 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc800052870 con 0x55c3b98c8030 2024-04-23T18:29:29.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.750+0000 7fc81263f800 1 -- 172.21.15.119:0/2974509175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 msgr2=0x55c3b9957b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.750+0000 7fc81263f800 1 --2- 172.21.15.119:0/2974509175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9957b20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc80000a470 tx=0x7fc80001ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:29.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.750+0000 7fc81263f800 1 -- 172.21.15.119:0/2974509175 shutdown_connections 2024-04-23T18:29:29.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.750+0000 7fc81263f800 1 --2- 172.21.15.119:0/2974509175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9957b20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.750+0000 7fc81263f800 1 -- 172.21.15.119:0/2974509175 >> 172.21.15.119:0/2974509175 conn(0x55c3b994f420 msgr2=0x55c3b9951840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.750+0000 7fc81263f800 1 -- 172.21.15.119:0/2974509175 shutdown_connections 2024-04-23T18:29:29.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.750+0000 7fc81263f800 1 -- 172.21.15.119:0/2974509175 wait complete. 2024-04-23T18:29:29.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.761+0000 7fc81263f800 1 Processor -- start 2024-04-23T18:29:29.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.762+0000 7fc81263f800 1 -- start start 2024-04-23T18:29:29.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.762+0000 7fc81263f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9955450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.762+0000 7fc81263f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c3b98a05b0 con 0x55c3b98c8030 2024-04-23T18:29:29.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.762+0000 7fc81013e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9955450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.762+0000 7fc81013e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9955450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60182/0 (socket says 172.21.15.119:60182) 2024-04-23T18:29:29.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.762+0000 7fc81013e640 1 -- 172.21.15.119:0/480174968 learned_addr learned my addr 172.21.15.119:0/480174968 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.762+0000 7fc81013e640 1 -- 172.21.15.119:0/480174968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b9816860 con 0x55c3b98c8030 2024-04-23T18:29:29.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.762+0000 7fc81013e640 1 --2- 172.21.15.119:0/480174968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9955450 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc800055040 tx=0x7fc80004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c7f3311b3f0c4b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.762+0000 7fc6fe60c640 1 -- 172.21.15.119:0/480174968 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc800057070 con 0x55c3b98c8030 2024-04-23T18:29:29.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.763+0000 7fc6fe60c640 1 -- 172.21.15.119:0/480174968 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc800063070 con 0x55c3b98c8030 2024-04-23T18:29:29.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.763+0000 7fc6fe60c640 1 -- 172.21.15.119:0/480174968 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc800052720 con 0x55c3b98c8030 2024-04-23T18:29:29.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.763+0000 7fc81263f800 1 -- 172.21.15.119:0/480174968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 msgr2=0x55c3b9955450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.763+0000 7fc81263f800 1 --2- 172.21.15.119:0/480174968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9955450 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc800055040 tx=0x7fc80004c000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.763+0000 7fc81263f800 1 -- 172.21.15.119:0/480174968 shutdown_connections 2024-04-23T18:29:29.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.763+0000 7fc81263f800 1 --2- 172.21.15.119:0/480174968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9955450 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.763+0000 7fc81263f800 1 -- 172.21.15.119:0/480174968 >> 172.21.15.119:0/480174968 conn(0x55c3b994f420 msgr2=0x55c3b9a41b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.763+0000 7fc81263f800 1 -- 172.21.15.119:0/480174968 shutdown_connections 2024-04-23T18:29:29.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.763+0000 7fc81263f800 1 -- 172.21.15.119:0/480174968 wait complete. 2024-04-23T18:29:29.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.764+0000 7fc81263f800 1 Processor -- start 2024-04-23T18:29:29.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.764+0000 7fc81263f800 1 -- start start 2024-04-23T18:29:29.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.764+0000 7fc81263f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9a4fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.764+0000 7fc81263f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c3b995c080 con 0x55c3b98c8030 2024-04-23T18:29:29.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.764+0000 7fc81013e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9a4fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.764+0000 7fc81013e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9a4fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60188/0 (socket says 172.21.15.119:60188) 2024-04-23T18:29:29.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.764+0000 7fc81013e640 1 -- 172.21.15.119:0/1872601109 learned_addr learned my addr 172.21.15.119:0/1872601109 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.764+0000 7fc81013e640 1 -- 172.21.15.119:0/1872601109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b9814eb0 con 0x55c3b98c8030 2024-04-23T18:29:29.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.764+0000 7fc81013e640 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9a4fcb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc800060040 tx=0x7fc800002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.764+0000 7fc6fce09640 1 -- 172.21.15.119:0/1872601109 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc800052e30 con 0x55c3b98c8030 2024-04-23T18:29:29.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.765+0000 7fc6fce09640 1 -- 172.21.15.119:0/1872601109 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80006c070 con 0x55c3b98c8030 2024-04-23T18:29:29.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.765+0000 7fc6fce09640 1 -- 172.21.15.119:0/1872601109 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc80005e5f0 con 0x55c3b98c8030 2024-04-23T18:29:29.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.765+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3b9a501f0 con 0x55c3b98c8030 2024-04-23T18:29:29.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.765+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b9a50770 con 0x55c3b98c8030 2024-04-23T18:29:29.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.765+0000 7fc6fce09640 1 -- 172.21.15.119:0/1872601109 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc80005e790 con 0x55c3b98c8030 2024-04-23T18:29:29.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.765+0000 7fc6fce09640 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6f8036e60 0x7fc6f8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.766+0000 7fc6fce09640 1 -- 172.21.15.119:0/1872601109 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fc80008efb0 con 0x55c3b98c8030 2024-04-23T18:29:29.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.766+0000 7fc80793d640 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6f8036e60 0x7fc6f8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.766+0000 7fc81263f800 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c3b9958090 0x55c3b9a56d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.766+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a572f0 con 0x55c3b9958090 2024-04-23T18:29:29.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.766+0000 7fc81093f640 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c3b9958090 0x55c3b9a56d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.766+0000 7fc80793d640 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6f8036e60 0x7fc6f8039320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8000f60 tx=0x7fc7f80012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.766+0000 7fc81093f640 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c3b9958090 0x55c3b9a56d20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.766+0000 7fc81093f640 1 -- 172.21.15.119:0/1872601109 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9958090 2024-04-23T18:29:29.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.766+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a542d0 con 0x55c3b9958090 2024-04-23T18:29:29.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.767+0000 7fc81093f640 1 -- 172.21.15.119:0/1872601109 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9958090 2024-04-23T18:29:29.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.767+0000 7fc81263f800 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c3b9a59620 0x55c3b9a5ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.767+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a5c0b0 con 0x55c3b9a59620 2024-04-23T18:29:29.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.767+0000 7fc81013e640 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c3b9a59620 0x55c3b9a5ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.767+0000 7fc81013e640 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c3b9a59620 0x55c3b9a5ba10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.767+0000 7fc81013e640 1 -- 172.21.15.119:0/1872601109 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc800071990 con 0x55c3b9a59620 2024-04-23T18:29:29.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.767+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a585d0 con 0x55c3b9958090 2024-04-23T18:29:29.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.768+0000 7fc81093f640 1 -- 172.21.15.119:0/1872601109 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9958090 2024-04-23T18:29:29.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.768+0000 7fc81263f800 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c3b9a5d560 0x55c3b9a5f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.768+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a60110 con 0x55c3b9a5d560 2024-04-23T18:29:29.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.768+0000 7fc80793d640 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c3b9a5d560 0x55c3b9a5f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.768+0000 7fc80793d640 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c3b9a5d560 0x55c3b9a5f9b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.769+0000 7fc80793d640 1 -- 172.21.15.119:0/1872601109 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a5d560 2024-04-23T18:29:29.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.769+0000 7fc81263f800 1 Processor -- start 2024-04-23T18:29:29.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.769+0000 7fc81263f800 1 -- start start 2024-04-23T18:29:29.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.769+0000 7fc81263f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a6e570 0x55c3b9a6e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.769+0000 7fc81263f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c3b9846df0 con 0x55c3b9a6e570 2024-04-23T18:29:29.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.769+0000 7fc81013e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a6e570 0x55c3b9a6e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.769+0000 7fc81013e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a6e570 0x55c3b9a6e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60198/0 (socket says 172.21.15.119:60198) 2024-04-23T18:29:29.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.769+0000 7fc81013e640 1 -- 172.21.15.119:0/3490489461 learned_addr learned my addr 172.21.15.119:0/3490489461 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.769+0000 7fc81013e640 1 -- 172.21.15.119:0/3490489461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b9a6eed0 con 0x55c3b9a6e570 2024-04-23T18:29:29.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.770+0000 7fc81013e640 1 --2- 172.21.15.119:0/3490489461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a6e570 0x55c3b9a6e990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc8000529c0 tx=0x7fc800066e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.770+0000 7fc6f5ffb640 1 -- 172.21.15.119:0/3490489461 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc800073c60 con 0x55c3b9a6e570 2024-04-23T18:29:29.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.770+0000 7fc6f5ffb640 1 -- 172.21.15.119:0/3490489461 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc800058040 con 0x55c3b9a6e570 2024-04-23T18:29:29.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.770+0000 7fc81263f800 1 -- 172.21.15.119:0/3490489461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3b9a6f940 con 0x55c3b9a6e570 2024-04-23T18:29:29.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.770+0000 7fc6f5ffb640 1 -- 172.21.15.119:0/3490489461 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc80007a3f0 con 0x55c3b9a6e570 2024-04-23T18:29:29.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.770+0000 7fc81263f800 1 -- 172.21.15.119:0/3490489461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b9a6fe40 con 0x55c3b9a6e570 2024-04-23T18:29:29.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.770+0000 7fc6f5ffb640 1 -- 172.21.15.119:0/3490489461 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc800098060 con 0x55c3b9a6e570 2024-04-23T18:29:29.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.771+0000 7fc6f5ffb640 1 --2- 172.21.15.119:0/3490489461 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6e8036eb0 0x7fc6e8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.771+0000 7fc6f5ffb640 1 -- 172.21.15.119:0/3490489461 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fc80008a070 con 0x55c3b9a6e570 2024-04-23T18:29:29.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.771+0000 7fc80793d640 1 --2- 172.21.15.119:0/3490489461 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6e8036eb0 0x7fc6e8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.771+0000 7fc81263f800 1 Processor -- start 2024-04-23T18:29:29.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.771+0000 7fc81263f800 1 -- start start 2024-04-23T18:29:29.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.771+0000 7fc80793d640 1 --2- 172.21.15.119:0/3490489461 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6e8036eb0 0x7fc6e8039370 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800bf50 tx=0x7fc7f800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.771+0000 7fc81263f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 0x55c3b9a7ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.771+0000 7fc81263f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c3b9953a10 con 0x55c3b9a7b630 2024-04-23T18:29:29.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.771+0000 7fc81013e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 0x55c3b9a7ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.771+0000 7fc81013e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 0x55c3b9a7ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60200/0 (socket says 172.21.15.119:60200) 2024-04-23T18:29:29.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.771+0000 7fc81013e640 1 -- 172.21.15.119:0/3205810767 learned_addr learned my addr 172.21.15.119:0/3205810767 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.772+0000 7fc81013e640 1 -- 172.21.15.119:0/3205810767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b9a7c020 con 0x55c3b9a7b630 2024-04-23T18:29:29.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.772+0000 7fc81013e640 1 --2- 172.21.15.119:0/3205810767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 0x55c3b9a7ba50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc800052970 tx=0x7fc800087f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3011667f4c7b93f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.772+0000 7fc6ef7fe640 1 -- 172.21.15.119:0/3205810767 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc800067af0 con 0x55c3b9a7b630 2024-04-23T18:29:29.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.772+0000 7fc6ef7fe640 1 -- 172.21.15.119:0/3205810767 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8000a9070 con 0x55c3b9a7b630 2024-04-23T18:29:29.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.772+0000 7fc6ef7fe640 1 -- 172.21.15.119:0/3205810767 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc800066b40 con 0x55c3b9a7b630 2024-04-23T18:29:29.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81263f800 1 -- 172.21.15.119:0/3205810767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 msgr2=0x55c3b9a7ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81263f800 1 --2- 172.21.15.119:0/3205810767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 0x55c3b9a7ba50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc800052970 tx=0x7fc800087f30 comp rx=0 tx=0).stop 2024-04-23T18:29:29.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81263f800 1 -- 172.21.15.119:0/3205810767 shutdown_connections 2024-04-23T18:29:29.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81263f800 1 --2- 172.21.15.119:0/3205810767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 0x55c3b9a7ba50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81263f800 1 -- 172.21.15.119:0/3205810767 >> 172.21.15.119:0/3205810767 conn(0x55c3b9a77990 msgr2=0x55c3b9a759f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81263f800 1 -- 172.21.15.119:0/3205810767 shutdown_connections 2024-04-23T18:29:29.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81263f800 1 -- 172.21.15.119:0/3205810767 wait complete. 2024-04-23T18:29:29.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81263f800 1 Processor -- start 2024-04-23T18:29:29.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81263f800 1 -- start start 2024-04-23T18:29:29.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81263f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 0x55c3b9a82a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81263f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c3b9a7c6d0 con 0x55c3b9a7b630 2024-04-23T18:29:29.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81013e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 0x55c3b9a82a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81013e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 0x55c3b9a82a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60204/0 (socket says 172.21.15.119:60204) 2024-04-23T18:29:29.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.773+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 learned_addr learned my addr 172.21.15.119:0/442605701 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.774+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b9a82f60 con 0x55c3b9a7b630 2024-04-23T18:29:29.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.774+0000 7fc81013e640 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 0x55c3b9a82a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc800052970 tx=0x7fc80006df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.774+0000 7fc6edffb640 1 -- 172.21.15.119:0/442605701 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc80008dc10 con 0x55c3b9a7b630 2024-04-23T18:29:29.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.774+0000 7fc6edffb640 1 -- 172.21.15.119:0/442605701 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80008ddb0 con 0x55c3b9a7b630 2024-04-23T18:29:29.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.774+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3b9a82f60 con 0x55c3b9a7b630 2024-04-23T18:29:29.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.774+0000 7fc6edffb640 1 -- 172.21.15.119:0/442605701 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc80009a580 con 0x55c3b9a7b630 2024-04-23T18:29:29.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.774+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b9a82f60 con 0x55c3b9a7b630 2024-04-23T18:29:29.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.775+0000 7fc6edffb640 1 -- 172.21.15.119:0/442605701 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc8000a3070 con 0x55c3b9a7b630 2024-04-23T18:29:29.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.775+0000 7fc6edffb640 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6e0036eb0 0x7fc6e0039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.775+0000 7fc6edffb640 1 -- 172.21.15.119:0/442605701 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fc8000b9c80 con 0x55c3b9a7b630 2024-04-23T18:29:29.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.775+0000 7fc80793d640 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6e0036eb0 0x7fc6e0039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.775+0000 7fc80793d640 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6e0036eb0 0x7fc6e0039370 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8001b60 tx=0x7fc7f8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.775+0000 7fc81263f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.775+0000 7fc81263f800 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c3b9a8e000 0x55c3b9a904c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.775+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a90c10 con 0x55c3b9a8e000 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.776+0000 7fc81093f640 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c3b9a8e000 0x55c3b9a904c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.776+0000 7fc81093f640 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c3b9a8e000 0x55c3b9a904c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.776+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9a8e000 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.776+0000 7fc81263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.776+0000 7fc81263f800 20 realm 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.776+0000 7fc81263f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.776+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91020 con 0x55c3b9a8e000 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.776+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9a8e000 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.776+0000 7fc81263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.776+0000 7fc81263f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:29.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.776+0000 7fc81263f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.776+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a918f0 con 0x55c3b9a8e000 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9a8e000 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81263f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a8e000 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9a8e000 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81263f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81263f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81263f800 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c3b9a929f0 0x55c3b9a94de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a953f0 con 0x55c3b9a929f0 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81013e640 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c3b9a929f0 0x55c3b9a94de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81013e640 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c3b9a929f0 0x55c3b9a94de0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8000be020 con 0x55c3b9a929f0 2024-04-23T18:29:29.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81263f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.777+0000 7fc81263f800 20 searching for the correct realm 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.778+0000 7fc81263f800 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c3b9a973a0 0x55c3b9a99860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.778+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a99f30 con 0x55c3b9a973a0 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.778+0000 7fc80793d640 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c3b9a973a0 0x55c3b9a99860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.778+0000 7fc80793d640 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c3b9a973a0 0x55c3b9a99860 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.778+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.778+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a99f30 con 0x55c3b9a929f0 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.778+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8000be020 con 0x55c3b9a929f0 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.778+0000 7fc81013e640 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc80009a070 0x7fc8000c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.778+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a99f30 con 0x7fc80009a070 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.779+0000 7fc81093f640 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc80009a070 0x7fc8000c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.779+0000 7fc81093f640 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc80009a070 0x7fc8000c16d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.780+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80800a4a0 con 0x7fc80009a070 2024-04-23T18:29:29.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.780+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a8e000 2024-04-23T18:29:29.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.780+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9a8e000 2024-04-23T18:29:29.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.780+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a8e000 2024-04-23T18:29:29.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.780+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9a8e000 2024-04-23T18:29:29.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.780+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x7fc80009a070 2024-04-23T18:29:29.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.780+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80800a4a0 con 0x7fc80009a070 2024-04-23T18:29:29.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.780+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x7fc80009a070 2024-04-23T18:29:29.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.781+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc80800a4a0 con 0x7fc80009a070 2024-04-23T18:29:29.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.781+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a929f0 2024-04-23T18:29:29.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.781+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8000be020 con 0x55c3b9a929f0 2024-04-23T18:29:29.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.781+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a973a0 2024-04-23T18:29:29.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.781+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.781+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a8e000 2024-04-23T18:29:29.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.781+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9a8e000 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.781+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x7fc80009a070 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.782+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80800a4a0 con 0x7fc80009a070 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.782+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a8e000 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.782+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9a8e000 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.782+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a929f0 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.782+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc8000be020 con 0x55c3b9a929f0 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.782+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a973a0 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.782+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.782+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a973a0 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.783+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.783+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x7fc80009a070 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.783+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80800a4a0 con 0x7fc80009a070 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.783+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a973a0 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.783+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.783+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a973a0 2024-04-23T18:29:29.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.783+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.783+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a8e000 2024-04-23T18:29:29.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.783+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9a8e000 2024-04-23T18:29:29.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.783+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a8e000 2024-04-23T18:29:29.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.784+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9a8e000 2024-04-23T18:29:29.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.784+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x7fc80009a070 2024-04-23T18:29:29.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.784+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80800a4a0 con 0x7fc80009a070 2024-04-23T18:29:29.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.784+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a973a0 2024-04-23T18:29:29.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.784+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.784+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a929f0 2024-04-23T18:29:29.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.784+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc8000be020 con 0x55c3b9a929f0 2024-04-23T18:29:29.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.785+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a8e000 2024-04-23T18:29:29.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.785+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80800a4a0 con 0x55c3b9a8e000 2024-04-23T18:29:29.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.785+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x7fc80009a070 2024-04-23T18:29:29.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.785+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80800a4a0 con 0x7fc80009a070 2024-04-23T18:29:29.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.785+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a973a0 2024-04-23T18:29:29.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.785+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.785+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x7fc80009a070 2024-04-23T18:29:29.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.786+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc80800a4a0 con 0x7fc80009a070 2024-04-23T18:29:29.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.786+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a929f0 2024-04-23T18:29:29.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.786+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8000be020 con 0x55c3b9a929f0 2024-04-23T18:29:29.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.786+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a973a0 2024-04-23T18:29:29.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.786+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.786+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x7fc80009a070 2024-04-23T18:29:29.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.786+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.786+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a8e000 2024-04-23T18:29:29.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a91c90 con 0x55c3b9a929f0 2024-04-23T18:29:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81263f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81263f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81263f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81263f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81263f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81263f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81263f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a95cb0 con 0x55c3b9a8e000 2024-04-23T18:29:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81263f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a95cb0 con 0x55c3b9a8e000 2024-04-23T18:29:29.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.787+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:29.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a95cb0 con 0x7fc80009a070 2024-04-23T18:29:29.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:29.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 20 zone default found 2024-04-23T18:29:29.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 4 Realm: () 2024-04-23T18:29:29.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:29.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:29.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:29.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 20 zonegroup default 2024-04-23T18:29:29.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a965a0 con 0x7fc80009a070 2024-04-23T18:29:29.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a965a0 con 0x55c3b9a973a0 2024-04-23T18:29:29.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.788+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.789+0000 7fc81263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.789+0000 7fc81263f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.789+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9bd90 con 0x55c3b9a973a0 2024-04-23T18:29:29.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.789+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.789+0000 7fc81263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.789+0000 7fc81263f800 20 started sync module instance, tier type = 2024-04-23T18:29:29.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.789+0000 7fc81263f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:29.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.789+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9b230 con 0x55c3b9a929f0 2024-04-23T18:29:29.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.790+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.790+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94299121888640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9c130 con 0x55c3b9a929f0 2024-04-23T18:29:29.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.790+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9c9e0 con 0x55c3b9a8e000 2024-04-23T18:29:29.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.791+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.791+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94299121894608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9d280 con 0x55c3b9a8e000 2024-04-23T18:29:29.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.791+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9dd80 con 0x55c3b9a973a0 2024-04-23T18:29:29.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.792+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94299121894608] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.792+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94299121888640] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.793+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.793+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94299121890848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9d280 con 0x55c3b9a973a0 2024-04-23T18:29:29.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.793+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9e620 con 0x55c3b9a929f0 2024-04-23T18:29:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.795+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94299121890848] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.795+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.795+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94299121896912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9eec0 con 0x55c3b9a929f0 2024-04-23T18:29:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.795+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9f880 con 0x55c3b9a8e000 2024-04-23T18:29:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.796+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.796+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94299121906640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9fca0 con 0x55c3b9a8e000 2024-04-23T18:29:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.796+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa07a0 con 0x7fc80009a070 2024-04-23T18:29:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.798+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.798+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94299121910416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa0760 con 0x7fc80009a070 2024-04-23T18:29:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.798+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa1710 con 0x7fc80009a070 2024-04-23T18:29:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.800+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94299121896912] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.801+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94299121906640] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.801+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94299121910416] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.801+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.801+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94299121907696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9ea10 con 0x7fc80009a070 2024-04-23T18:29:29.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.801+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa1710 con 0x7fc80009a070 2024-04-23T18:29:29.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.804+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94299121907696] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.804+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.804+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94299121914432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa1710 con 0x7fc80009a070 2024-04-23T18:29:29.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.804+0000 7fc81263f800 20 add_watcher() i=0 2024-04-23T18:29:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.804+0000 7fc81263f800 20 add_watcher() i=1 2024-04-23T18:29:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.804+0000 7fc81263f800 20 add_watcher() i=2 2024-04-23T18:29:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.804+0000 7fc81263f800 20 add_watcher() i=3 2024-04-23T18:29:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.804+0000 7fc81263f800 20 add_watcher() i=4 2024-04-23T18:29:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.804+0000 7fc81263f800 20 add_watcher() i=5 2024-04-23T18:29:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.804+0000 7fc81263f800 20 add_watcher() i=6 2024-04-23T18:29:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.806+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94299121914432] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.806+0000 7fc81263f800 20 add_watcher() i=7 2024-04-23T18:29:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.806+0000 7fc81263f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.806+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa4bf0 con 0x55c3b9a8e000 2024-04-23T18:29:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.806+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.806+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94299121915664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa2050 con 0x55c3b9a8e000 2024-04-23T18:29:29.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.808+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94299121915664] v32'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.808+0000 7fc6c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.809+0000 7fc81263f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.809+0000 7fc81263f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.809+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aad630 con 0x55c3b9a8e000 2024-04-23T18:29:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.810+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.810+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aadc80 con 0x7fc80009a070 2024-04-23T18:29:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.811+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'13 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.811+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aae0e0 con 0x55c3b9a973a0 2024-04-23T18:29:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.812+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.812+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa43d0 con 0x55c3b9a8e000 2024-04-23T18:29:29.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.814+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.814+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa3f20 con 0x55c3b9a929f0 2024-04-23T18:29:29.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.817+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.817+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa3f20 con 0x55c3b9a973a0 2024-04-23T18:29:29.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.818+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.818+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aaf9e0 con 0x55c3b9a8e000 2024-04-23T18:29:29.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.819+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.819+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aaf9e0 con 0x7fc80009a070 2024-04-23T18:29:29.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.820+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.820+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aaf9e0 con 0x55c3b9a929f0 2024-04-23T18:29:29.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.821+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.821+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aafa70 con 0x55c3b9a973a0 2024-04-23T18:29:29.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.822+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.822+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab0000 con 0x55c3b9a929f0 2024-04-23T18:29:29.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.823+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.823+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aaff70 con 0x7fc80009a070 2024-04-23T18:29:29.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.824+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.824+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aaff70 con 0x55c3b9a929f0 2024-04-23T18:29:29.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.825+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.825+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aaff70 con 0x7fc80009a070 2024-04-23T18:29:29.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.826+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.826+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aaff70 con 0x55c3b9a8e000 2024-04-23T18:29:29.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.827+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.827+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aaff70 con 0x55c3b9a973a0 2024-04-23T18:29:29.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.829+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.829+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab0000 con 0x55c3b9a929f0 2024-04-23T18:29:29.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.830+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.830+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab0000 con 0x55c3b9a973a0 2024-04-23T18:29:29.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.831+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.831+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x55c3b9a8e000 2024-04-23T18:29:29.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.832+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.832+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x55c3b9a8e000 2024-04-23T18:29:29.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.833+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.833+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x55c3b9a973a0 2024-04-23T18:29:29.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.834+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.834+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x55c3b9a929f0 2024-04-23T18:29:29.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.835+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.835+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x55c3b9a973a0 2024-04-23T18:29:29.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.836+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.836+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x55c3b9a973a0 2024-04-23T18:29:29.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.837+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.837+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x55c3b9a973a0 2024-04-23T18:29:29.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.838+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.838+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x55c3b9a973a0 2024-04-23T18:29:29.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.839+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.839+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x7fc80009a070 2024-04-23T18:29:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.840+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.840+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x55c3b9a973a0 2024-04-23T18:29:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.841+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.841+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x7fc80009a070 2024-04-23T18:29:29.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.842+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.842+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x55c3b9a973a0 2024-04-23T18:29:29.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.843+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.843+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x7fc80009a070 2024-04-23T18:29:29.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.844+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.844+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9ab00b0 con 0x55c3b9a929f0 2024-04-23T18:29:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.845+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.846+0000 7fc6c57e2640 20 reqs_thread_entry: start 2024-04-23T18:29:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.846+0000 7fc81263f800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.846+0000 7fc81263f800 20 Filter name: none 2024-04-23T18:29:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.846+0000 7fc636ffd640 20 reqs_thread_entry: start 2024-04-23T18:29:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.846+0000 7fc81263f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.846+0000 7fc81263f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.846+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9adb1b0 con 0x55c3b9a8e000 2024-04-23T18:29:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.846+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.846+0000 7fc81263f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.846+0000 7fc81263f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-23T18:29:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.846+0000 7fc81263f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:could not remove user: unable to remove user, user does not exist 2024-04-23T18:29:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.847+0000 7fc6c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:29.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.847+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94299121915664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a3d8c0 con 0x55c3b9a8e000 2024-04-23T18:29:29.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.848+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94299121915664] v32'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.848+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94299121888640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa1710 con 0x55c3b9a929f0 2024-04-23T18:29:29.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.849+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94299121888640] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.849+0000 7fc81263f800 20 remove_watcher() i=0 2024-04-23T18:29:29.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.849+0000 7fc81263f800 2 removed watcher, disabling cache 2024-04-23T18:29:29.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.849+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94299121894608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa1710 con 0x55c3b9a8e000 2024-04-23T18:29:29.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.850+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94299121894608] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.850+0000 7fc81263f800 20 remove_watcher() i=1 2024-04-23T18:29:29.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.850+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94299121890848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa1710 con 0x55c3b9a973a0 2024-04-23T18:29:29.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.851+0000 7fc80793d640 1 -- 172.21.15.119:0/442605701 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94299121890848] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7f8009050 con 0x55c3b9a973a0 2024-04-23T18:29:29.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.851+0000 7fc81263f800 20 remove_watcher() i=2 2024-04-23T18:29:29.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.851+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94299121896912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9b620 con 0x55c3b9a929f0 2024-04-23T18:29:29.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.853+0000 7fc81013e640 1 -- 172.21.15.119:0/442605701 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94299121896912] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8000d4040 con 0x55c3b9a929f0 2024-04-23T18:29:29.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.853+0000 7fc81263f800 20 remove_watcher() i=3 2024-04-23T18:29:29.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.853+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94299121906640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa1710 con 0x55c3b9a8e000 2024-04-23T18:29:29.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.855+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94299121906640] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x55c3b9a8e000 2024-04-23T18:29:29.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.856+0000 7fc81263f800 20 remove_watcher() i=4 2024-04-23T18:29:29.848 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.856+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94299121910416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9a9f3d0 con 0x7fc80009a070 2024-04-23T18:29:29.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.857+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94299121910416] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.857+0000 7fc81263f800 20 remove_watcher() i=5 2024-04-23T18:29:29.849 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.857+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94299121907696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa1710 con 0x7fc80009a070 2024-04-23T18:29:29.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.858+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94299121907696] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.858+0000 7fc81263f800 20 remove_watcher() i=6 2024-04-23T18:29:29.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.858+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94299121914432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c3b9aa1710 con 0x7fc80009a070 2024-04-23T18:29:29.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.859+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94299121914432] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc808040040 con 0x7fc80009a070 2024-04-23T18:29:29.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.859+0000 7fc81263f800 20 remove_watcher() i=7 2024-04-23T18:29:29.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.859+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc80009a070 msgr2=0x7fc8000c16d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.859+0000 7fc81263f800 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc80009a070 0x7fc8000c16d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.859+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c3b9a8e000 msgr2=0x55c3b9a904c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.859+0000 7fc81263f800 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c3b9a8e000 0x55c3b9a904c0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.859+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c3b9a929f0 msgr2=0x55c3b9a94de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.859+0000 7fc81263f800 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c3b9a929f0 0x55c3b9a94de0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.859+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c3b9a973a0 msgr2=0x55c3b9a99860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.859+0000 7fc81263f800 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c3b9a973a0 0x55c3b9a99860 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.859+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6e0036eb0 msgr2=0x7fc6e0039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6e0036eb0 0x7fc6e0039370 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8001b60 tx=0x7fc7f8010000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 msgr2=0x55c3b9a82a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81093f640 1 -- 172.21.15.119:0/442605701 reap_dead start 2024-04-23T18:29:29.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 0x55c3b9a82a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc800052970 tx=0x7fc80006df90 comp rx=0 tx=0).stop 2024-04-23T18:29:29.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 shutdown_connections 2024-04-23T18:29:29.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 --2- 172.21.15.119:0/442605701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a7b630 0x55c3b9a82a20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 >> 172.21.15.119:0/442605701 conn(0x55c3b9a77990 msgr2=0x55c3b9a74ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 shutdown_connections 2024-04-23T18:29:29.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/442605701 wait complete. 2024-04-23T18:29:29.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/3490489461 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6e8036eb0 msgr2=0x7fc6e8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 --2- 172.21.15.119:0/3490489461 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6e8036eb0 0x7fc6e8039370 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc7f800bf50 tx=0x7fc7f800f000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/3490489461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a6e570 msgr2=0x55c3b9a6e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 --2- 172.21.15.119:0/3490489461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a6e570 0x55c3b9a6e990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc8000529c0 tx=0x7fc800066e70 comp rx=0 tx=0).stop 2024-04-23T18:29:29.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/3490489461 shutdown_connections 2024-04-23T18:29:29.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 --2- 172.21.15.119:0/3490489461 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6e8036eb0 0x7fc6e8039370 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 --2- 172.21.15.119:0/3490489461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b9a6e570 0x55c3b9a6e990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/3490489461 >> 172.21.15.119:0/3490489461 conn(0x55c3b9a62610 msgr2=0x55c3b9a62a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/3490489461 shutdown_connections 2024-04-23T18:29:29.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/3490489461 wait complete. 2024-04-23T18:29:29.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c3b9a5d560 msgr2=0x55c3b9a5f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c3b9a5d560 0x55c3b9a5f9b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c3b9958090 msgr2=0x55c3b9a56d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c3b9958090 0x55c3b9a56d20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c3b9a59620 msgr2=0x55c3b9a5ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c3b9a59620 0x55c3b9a5ba10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6f8036e60 msgr2=0x7fc6f8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.860+0000 7fc81263f800 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc6f8036e60 0x7fc6f8039320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8000f60 tx=0x7fc7f80012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.861+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 msgr2=0x55c3b9a4fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.861+0000 7fc81263f800 1 --2- 172.21.15.119:0/1872601109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3b98c8030 0x55c3b9a4fcb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc800060040 tx=0x7fc800002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.861+0000 7fc81093f640 1 -- 172.21.15.119:0/1872601109 reap_dead start 2024-04-23T18:29:29.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.861+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 shutdown_connections 2024-04-23T18:29:29.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.861+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 >> 172.21.15.119:0/1872601109 conn(0x55c3b994f420 msgr2=0x55c3b9953f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.861+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 shutdown_connections 2024-04-23T18:29:29.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.861+0000 7fc81263f800 1 -- 172.21.15.119:0/1872601109 wait complete. 2024-04-23T18:29:29.860 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-23T18:29:29.861 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-23T18:29:29.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-23T18:29:29.861 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-23T18:29:29.946 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:29.946 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:29.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.954+0000 7f499352f800 1 Processor -- start 2024-04-23T18:29:29.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.954+0000 7f499352f800 1 -- start start 2024-04-23T18:29:29.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.954+0000 7f499352f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ecfefa7f50 0x55ecfefa8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.954+0000 7f499352f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ecfee59560 con 0x55ecfefa91b0 2024-04-23T18:29:29.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.954+0000 7f499352f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55ecfee4ae20 con 0x55ecfefa7f50 2024-04-23T18:29:29.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.955+0000 7f498f1f5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ecfefa7f50 0x55ecfefa8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.955+0000 7f498e9f4640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55ecfefa91b0 0x55ecfefa9630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40448/0 (socket says 172.21.15.119:40448) 2024-04-23T18:29:29.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.955+0000 7f498e9f4640 1 -- 172.21.15.119:0/2022004125 learned_addr learned my addr 172.21.15.119:0/2022004125 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:29.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.955+0000 7f498f1f5640 1 -- 172.21.15.119:0/2022004125 >> v1:172.21.15.62:6789/0 conn(0x55ecfefa91b0 legacy=0x55ecfefa9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.955+0000 7f498f1f5640 1 -- 172.21.15.119:0/2022004125 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfee58e60 con 0x55ecfefa7f50 2024-04-23T18:29:29.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.957+0000 7f498f1f5640 1 --2- 172.21.15.119:0/2022004125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecfefa8370 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f498000a470 tx=0x7f498001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2aa58b170a38e54 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.957+0000 7f498e1f3640 1 -- 172.21.15.119:0/2022004125 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4980057070 con 0x55ecfefa7f50 2024-04-23T18:29:29.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.957+0000 7f498e1f3640 1 -- 172.21.15.119:0/2022004125 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4980052570 con 0x55ecfefa7f50 2024-04-23T18:29:29.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.957+0000 7f498e1f3640 1 -- 172.21.15.119:0/2022004125 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4980052870 con 0x55ecfefa7f50 2024-04-23T18:29:29.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.958+0000 7f499352f800 1 -- 172.21.15.119:0/2022004125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 msgr2=0x55ecfefa8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.958+0000 7f499352f800 1 --2- 172.21.15.119:0/2022004125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecfefa8370 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f498000a470 tx=0x7f498001ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:29.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.958+0000 7f499352f800 1 -- 172.21.15.119:0/2022004125 shutdown_connections 2024-04-23T18:29:29.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.958+0000 7f499352f800 1 --2- 172.21.15.119:0/2022004125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecfefa8370 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.958+0000 7f499352f800 1 -- 172.21.15.119:0/2022004125 >> 172.21.15.119:0/2022004125 conn(0x55ecfefa3530 msgr2=0x55ecfefa5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.958+0000 7f499352f800 1 -- 172.21.15.119:0/2022004125 shutdown_connections 2024-04-23T18:29:29.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.958+0000 7f499352f800 1 -- 172.21.15.119:0/2022004125 wait complete. 2024-04-23T18:29:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.969+0000 7f499352f800 1 Processor -- start 2024-04-23T18:29:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.969+0000 7f499352f800 1 -- start start 2024-04-23T18:29:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.969+0000 7f499352f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecff099640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.969+0000 7f499352f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ecfeef45d0 con 0x55ecfefa7f50 2024-04-23T18:29:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.970+0000 7f498f1f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecff099640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.970+0000 7f498f1f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecff099640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60222/0 (socket says 172.21.15.119:60222) 2024-04-23T18:29:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.970+0000 7f498f1f5640 1 -- 172.21.15.119:0/385458829 learned_addr learned my addr 172.21.15.119:0/385458829 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.970+0000 7f498f1f5640 1 -- 172.21.15.119:0/385458829 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfee6a860 con 0x55ecfefa7f50 2024-04-23T18:29:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.970+0000 7f498f1f5640 1 --2- 172.21.15.119:0/385458829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecff099640 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4980055040 tx=0x7f498004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2b5602078b46b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.970+0000 7f487d60a640 1 -- 172.21.15.119:0/385458829 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4980057070 con 0x55ecfefa7f50 2024-04-23T18:29:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.970+0000 7f487d60a640 1 -- 172.21.15.119:0/385458829 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4980063070 con 0x55ecfefa7f50 2024-04-23T18:29:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.970+0000 7f487d60a640 1 -- 172.21.15.119:0/385458829 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4980052720 con 0x55ecfefa7f50 2024-04-23T18:29:29.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.971+0000 7f499352f800 1 -- 172.21.15.119:0/385458829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 msgr2=0x55ecff099640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.971+0000 7f499352f800 1 --2- 172.21.15.119:0/385458829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecff099640 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4980055040 tx=0x7f498004c000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.971+0000 7f499352f800 1 -- 172.21.15.119:0/385458829 shutdown_connections 2024-04-23T18:29:29.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.971+0000 7f499352f800 1 --2- 172.21.15.119:0/385458829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecff099640 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.971+0000 7f499352f800 1 -- 172.21.15.119:0/385458829 >> 172.21.15.119:0/385458829 conn(0x55ecfefa3530 msgr2=0x55ecff094f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.971+0000 7f499352f800 1 -- 172.21.15.119:0/385458829 shutdown_connections 2024-04-23T18:29:29.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.971+0000 7f499352f800 1 -- 172.21.15.119:0/385458829 wait complete. 2024-04-23T18:29:29.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.971+0000 7f499352f800 1 Processor -- start 2024-04-23T18:29:29.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.972+0000 7f499352f800 1 -- start start 2024-04-23T18:29:29.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.972+0000 7f499352f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecfef1bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.972+0000 7f499352f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ecfefb1620 con 0x55ecfefa7f50 2024-04-23T18:29:29.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.972+0000 7f498f1f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecfef1bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.972+0000 7f498f1f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecfef1bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60226/0 (socket says 172.21.15.119:60226) 2024-04-23T18:29:29.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.972+0000 7f498f1f5640 1 -- 172.21.15.119:0/2460658242 learned_addr learned my addr 172.21.15.119:0/2460658242 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.972+0000 7f498f1f5640 1 -- 172.21.15.119:0/2460658242 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecfee68eb0 con 0x55ecfefa7f50 2024-04-23T18:29:29.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.972+0000 7f498f1f5640 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecfef1bf60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4980060040 tx=0x7f4980002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.972+0000 7f487be07640 1 -- 172.21.15.119:0/2460658242 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4980052c70 con 0x55ecfefa7f50 2024-04-23T18:29:29.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.973+0000 7f487be07640 1 -- 172.21.15.119:0/2460658242 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f498006c070 con 0x55ecfefa7f50 2024-04-23T18:29:29.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.973+0000 7f487be07640 1 -- 172.21.15.119:0/2460658242 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f498005e480 con 0x55ecfefa7f50 2024-04-23T18:29:29.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.973+0000 7f499352f800 1 -- 172.21.15.119:0/2460658242 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecff0a4c50 con 0x55ecfefa7f50 2024-04-23T18:29:29.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.973+0000 7f499352f800 1 -- 172.21.15.119:0/2460658242 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecff0a5170 con 0x55ecfefa7f50 2024-04-23T18:29:29.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.973+0000 7f499352f800 1 Processor -- start 2024-04-23T18:29:29.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.973+0000 7f499352f800 1 -- start start 2024-04-23T18:29:29.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.973+0000 7f499352f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 0x55ecff0afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.973+0000 7f499352f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ecfee9adf0 con 0x55ecff0af710 2024-04-23T18:29:29.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.973+0000 7f487be07640 1 -- 172.21.15.119:0/2460658242 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f498005e620 con 0x55ecfefa7f50 2024-04-23T18:29:29.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.974+0000 7f498f9f6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 0x55ecff0afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.974+0000 7f487be07640 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4874036eb0 0x7f4874039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.974+0000 7f498f9f6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 0x55ecff0afb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60238/0 (socket says 172.21.15.119:60238) 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.974+0000 7f498f9f6640 1 -- 172.21.15.119:0/530564611 learned_addr learned my addr 172.21.15.119:0/530564611 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.974+0000 7f487be07640 1 -- 172.21.15.119:0/2460658242 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f498008eef0 con 0x55ecfefa7f50 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.974+0000 7f498f1f5640 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4874036eb0 0x7f4874039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.974+0000 7f498f9f6640 1 -- 172.21.15.119:0/530564611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecff0b0070 con 0x55ecff0af710 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.974+0000 7f498f9f6640 1 --2- 172.21.15.119:0/530564611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 0x55ecff0afb30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f498800a430 tx=0x7f498800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb4e65bde2e16e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.974+0000 7f498f1f5640 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4874036eb0 0x7f4874039370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4980068010 tx=0x7f4980005370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.974+0000 7f4879e03640 1 -- 172.21.15.119:0/530564611 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4988015070 con 0x55ecff0af710 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.974+0000 7f4879e03640 1 -- 172.21.15.119:0/530564611 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4988001670 con 0x55ecff0af710 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.974+0000 7f4879e03640 1 -- 172.21.15.119:0/530564611 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4988001990 con 0x55ecff0af710 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f499352f800 1 -- 172.21.15.119:0/530564611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 msgr2=0x55ecff0afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f499352f800 1 --2- 172.21.15.119:0/530564611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 0x55ecff0afb30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f498800a430 tx=0x7f498800a8f0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f499352f800 1 -- 172.21.15.119:0/530564611 shutdown_connections 2024-04-23T18:29:29.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f499352f800 1 --2- 172.21.15.119:0/530564611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 0x55ecff0afb30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f499352f800 1 -- 172.21.15.119:0/530564611 >> 172.21.15.119:0/530564611 conn(0x55ecfefa91b0 msgr2=0x55ecff0ac1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f499352f800 1 -- 172.21.15.119:0/530564611 shutdown_connections 2024-04-23T18:29:29.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f499352f800 1 -- 172.21.15.119:0/530564611 wait complete. 2024-04-23T18:29:29.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f499352f800 1 Processor -- start 2024-04-23T18:29:29.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f499352f800 1 -- start start 2024-04-23T18:29:29.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f499352f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 0x55ecff0a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f499352f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ecff0b0a00 con 0x55ecff0af710 2024-04-23T18:29:29.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f498f9f6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 0x55ecff0a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f498f9f6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 0x55ecff0a2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60246/0 (socket says 172.21.15.119:60246) 2024-04-23T18:29:29.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f498f9f6640 1 -- 172.21.15.119:0/874661552 learned_addr learned my addr 172.21.15.119:0/874661552 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.975+0000 7f498f9f6640 1 -- 172.21.15.119:0/874661552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecff0a0c70 con 0x55ecff0af710 2024-04-23T18:29:29.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.976+0000 7f498f9f6640 1 --2- 172.21.15.119:0/874661552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 0x55ecff0a2580 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f498800a930 tx=0x7f4988003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.976+0000 7f486bfff640 1 -- 172.21.15.119:0/874661552 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4988020020 con 0x55ecff0af710 2024-04-23T18:29:29.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.976+0000 7f486bfff640 1 -- 172.21.15.119:0/874661552 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49880108b0 con 0x55ecff0af710 2024-04-23T18:29:29.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.976+0000 7f499352f800 1 -- 172.21.15.119:0/874661552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecff0a0f00 con 0x55ecff0af710 2024-04-23T18:29:29.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.976+0000 7f486bfff640 1 -- 172.21.15.119:0/874661552 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4988015040 con 0x55ecff0af710 2024-04-23T18:29:29.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.976+0000 7f499352f800 1 -- 172.21.15.119:0/874661552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecff0a13a0 con 0x55ecff0af710 2024-04-23T18:29:29.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.977+0000 7f486bfff640 1 -- 172.21.15.119:0/874661552 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4988023020 con 0x55ecff0af710 2024-04-23T18:29:29.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.977+0000 7f486bfff640 1 --2- 172.21.15.119:0/874661552 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4870036e60 0x7f4870039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.977+0000 7f499352f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:29.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.977+0000 7f499352f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:29.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.977+0000 7f486bfff640 1 -- 172.21.15.119:0/874661552 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f498804c630 con 0x55ecff0af710 2024-04-23T18:29:29.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.977+0000 7f498e9f4640 1 --2- 172.21.15.119:0/874661552 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4870036e60 0x7f4870039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.977+0000 7f499352f800 1 Processor -- start 2024-04-23T18:29:29.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.977+0000 7f499352f800 1 -- start start 2024-04-23T18:29:29.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.978+0000 7f498e9f4640 1 --2- 172.21.15.119:0/874661552 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4870036e60 0x7f4870039320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55ecff0ab630 tx=0x7f4984001270 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.978+0000 7f499352f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0d34d0 0x55ecff0d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.978+0000 7f499352f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ecff099d00 con 0x55ecff0d34d0 2024-04-23T18:29:29.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.978+0000 7f498f1f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0d34d0 0x55ecff0d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.978+0000 7f498f1f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0d34d0 0x55ecff0d38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60252/0 (socket says 172.21.15.119:60252) 2024-04-23T18:29:29.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.978+0000 7f498f1f5640 1 -- 172.21.15.119:0/69881697 learned_addr learned my addr 172.21.15.119:0/69881697 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:29.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.978+0000 7f498f1f5640 1 -- 172.21.15.119:0/69881697 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecff0d3e30 con 0x55ecff0d34d0 2024-04-23T18:29:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.978+0000 7f498f1f5640 1 --2- 172.21.15.119:0/69881697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0d34d0 0x55ecff0d38f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4980079ff0 tx=0x7f4980079af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.979+0000 7f47d7fff640 1 -- 172.21.15.119:0/69881697 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f498007ae40 con 0x55ecff0d34d0 2024-04-23T18:29:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.979+0000 7f47d7fff640 1 -- 172.21.15.119:0/69881697 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4980058040 con 0x55ecff0d34d0 2024-04-23T18:29:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.979+0000 7f499352f800 1 -- 172.21.15.119:0/69881697 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ecff0d48a0 con 0x55ecff0d34d0 2024-04-23T18:29:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.979+0000 7f47d7fff640 1 -- 172.21.15.119:0/69881697 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49800559e0 con 0x55ecff0d34d0 2024-04-23T18:29:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.979+0000 7f499352f800 1 -- 172.21.15.119:0/69881697 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecff0d4da0 con 0x55ecff0d34d0 2024-04-23T18:29:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.979+0000 7f47d7fff640 1 -- 172.21.15.119:0/69881697 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4980082070 con 0x55ecff0d34d0 2024-04-23T18:29:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.980+0000 7f47d7fff640 1 --2- 172.21.15.119:0/69881697 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f47cc036eb0 0x7f47cc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.980+0000 7f47d7fff640 1 -- 172.21.15.119:0/69881697 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4980097cc0 con 0x55ecff0d34d0 2024-04-23T18:29:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.980+0000 7f498e9f4640 1 --2- 172.21.15.119:0/69881697 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f47cc036eb0 0x7f47cc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.980+0000 7f47d5ffb640 20 reqs_thread_entry: start 2024-04-23T18:29:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.980+0000 7f498e9f4640 1 --2- 172.21.15.119:0/69881697 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f47cc036eb0 0x7f47cc039370 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4984004170 tx=0x7f498400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.980+0000 7f499352f800 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ecff0e0ed0 0x55ecff0e3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.980+0000 7f499352f800 1 -- 172.21.15.119:0/2460658242 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecff0e3a30 con 0x55ecff0e0ed0 2024-04-23T18:29:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.980+0000 7f498f9f6640 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ecff0e0ed0 0x55ecff0e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.980+0000 7f498f9f6640 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ecff0e0ed0 0x55ecff0e3360 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.981+0000 7f498f9f6640 1 -- 172.21.15.119:0/2460658242 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f498800e070 con 0x55ecff0e0ed0 2024-04-23T18:29:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.981+0000 7f499352f800 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ecff0e5850 0x55ecff0e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.981+0000 7f499352f800 1 -- 172.21.15.119:0/2460658242 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:2 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ecff0e8330 con 0x55ecff0e5850 2024-04-23T18:29:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.981+0000 7f498f1f5640 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ecff0e5850 0x55ecff0e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.981+0000 7f498f1f5640 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ecff0e5850 0x55ecff0e7c40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.981+0000 7f498f1f5640 1 -- 172.21.15.119:0/2460658242 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(2 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4980081030 con 0x55ecff0e5850 2024-04-23T18:29:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.981+0000 7f499352f800 1 -- 172.21.15.119:0/2460658242 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ecff0e4d50 con 0x55ecff0e5850 2024-04-23T18:29:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.983+0000 7f498f1f5640 1 -- 172.21.15.119:0/2460658242 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [stat,call,call,writefull 0~993] v32'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f4980081030 con 0x55ecff0e5850 2024-04-23T18:29:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.983+0000 7f499352f800 1 -- 172.21.15.119:0/874661552 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4870036e60 msgr2=0x7f4870039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.983+0000 7f499352f800 1 --2- 172.21.15.119:0/874661552 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4870036e60 0x7f4870039320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55ecff0ab630 tx=0x7f4984001270 comp rx=0 tx=0).stop 2024-04-23T18:29:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.983+0000 7f499352f800 1 -- 172.21.15.119:0/874661552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 msgr2=0x55ecff0a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.983+0000 7f499352f800 1 --2- 172.21.15.119:0/874661552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 0x55ecff0a2580 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f498800a930 tx=0x7f4988003370 comp rx=0 tx=0).stop 2024-04-23T18:29:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.983+0000 7f499352f800 1 -- 172.21.15.119:0/874661552 shutdown_connections 2024-04-23T18:29:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.983+0000 7f499352f800 1 --2- 172.21.15.119:0/874661552 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4870036e60 0x7f4870039320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.983+0000 7f499352f800 1 --2- 172.21.15.119:0/874661552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0af710 0x55ecff0a2580 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.983+0000 7f499352f800 1 -- 172.21.15.119:0/874661552 >> 172.21.15.119:0/874661552 conn(0x55ecfefa91b0 msgr2=0x55ecff0a97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.983+0000 7f499352f800 1 -- 172.21.15.119:0/874661552 shutdown_connections 2024-04-23T18:29:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.983+0000 7f499352f800 1 -- 172.21.15.119:0/874661552 wait complete. 2024-04-23T18:29:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/69881697 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f47cc036eb0 msgr2=0x7f47cc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 --2- 172.21.15.119:0/69881697 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f47cc036eb0 0x7f47cc039370 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4984004170 tx=0x7f498400f000 comp rx=0 tx=0).stop 2024-04-23T18:29:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/69881697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0d34d0 msgr2=0x55ecff0d38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 --2- 172.21.15.119:0/69881697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0d34d0 0x55ecff0d38f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4980079ff0 tx=0x7f4980079af0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/69881697 shutdown_connections 2024-04-23T18:29:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 --2- 172.21.15.119:0/69881697 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f47cc036eb0 0x7f47cc039370 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 --2- 172.21.15.119:0/69881697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecff0d34d0 0x55ecff0d38f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/69881697 >> 172.21.15.119:0/69881697 conn(0x55ecff0c7fa0 msgr2=0x55ecff0c89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/69881697 shutdown_connections 2024-04-23T18:29:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/69881697 wait complete. 2024-04-23T18:29:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ecff0e0ed0 msgr2=0x55ecff0e3360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ecff0e0ed0 0x55ecff0e3360 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ecff0e5850 msgr2=0x55ecff0e7c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ecff0e5850 0x55ecff0e7c40 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4874036eb0 msgr2=0x7f4874039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4874036eb0 0x7f4874039370 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4980068010 tx=0x7f4980005370 comp rx=0 tx=0).stop 2024-04-23T18:29:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/2460658242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 msgr2=0x55ecfef1bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecfef1bf60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4980060040 tx=0x7f4980002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/2460658242 shutdown_connections 2024-04-23T18:29:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ecff0e5850 0x55ecff0e7c40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ecff0e0ed0 0x55ecff0e3360 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4874036eb0 0x7f4874039370 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 --2- 172.21.15.119:0/2460658242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ecfefa7f50 0x55ecfef1bf60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/2460658242 >> 172.21.15.119:0/2460658242 conn(0x55ecfefa3530 msgr2=0x55ecff098030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/2460658242 shutdown_connections 2024-04-23T18:29:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:29.984+0000 7f499352f800 1 -- 172.21.15.119:0/2460658242 wait complete. 2024-04-23T18:29:29.986 INFO:teuthology.orchestra.run.smithi119.stdout:{"id":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-23T18:29:29.987 DEBUG:tasks.util.rgw: json result: {'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-23T18:29:29.988 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-23T18:29:29.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-23T18:29:29.989 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-23T18:29:30.029 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:30.029 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:30.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.037+0000 7f4fd9b33800 1 Processor -- start 2024-04-23T18:29:30.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.037+0000 7f4fd9b33800 1 -- start start 2024-04-23T18:29:30.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.037+0000 7f4fd9b33800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55cd0ec0f3d0 0x55cd0ec17ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.037+0000 7f4fd9b33800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cd0eabf560 con 0x55cd0ec0d890 2024-04-23T18:29:30.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.037+0000 7f4fd9b33800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55cd0eab0e20 con 0x55cd0ec0f3d0 2024-04-23T18:29:30.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.038+0000 7f4fccff4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55cd0ec0f3d0 0x55cd0ec17ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.038+0000 7f4fd57f5640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55cd0ec0d890 0x55cd0ec0dcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40462/0 (socket says 172.21.15.119:40462) 2024-04-23T18:29:30.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.038+0000 7f4fd57f5640 1 -- 172.21.15.119:0/1556835269 learned_addr learned my addr 172.21.15.119:0/1556835269 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:30.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.038+0000 7f4fd4ff4640 1 -- 172.21.15.119:0/1556835269 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 863252515 0 0) 0x55cd0eabf560 con 0x55cd0ec0d890 2024-04-23T18:29:30.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.038+0000 7f4fd4ff4640 1 -- 172.21.15.119:0/1556835269 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc4001e10 con 0x55cd0ec0d890 2024-04-23T18:29:30.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.038+0000 7f4fccff4640 1 -- 172.21.15.119:0/1556835269 >> v1:172.21.15.62:6789/0 conn(0x55cd0ec0d890 legacy=0x55cd0ec0dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.038+0000 7f4fccff4640 1 -- 172.21.15.119:0/1556835269 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0eabee60 con 0x55cd0ec0f3d0 2024-04-23T18:29:30.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.040+0000 7f4fccff4640 1 --2- 172.21.15.119:0/1556835269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0f3d0 0x55cd0ec17ed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000a470 tx=0x7f4fc001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3696eea403bfa2b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.040+0000 7f4fd4ff4640 1 -- 172.21.15.119:0/1556835269 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc0057070 con 0x55cd0ec0f3d0 2024-04-23T18:29:30.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.040+0000 7f4fd4ff4640 1 -- 172.21.15.119:0/1556835269 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc0052440 con 0x55cd0ec0f3d0 2024-04-23T18:29:30.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.040+0000 7f4fd4ff4640 1 -- 172.21.15.119:0/1556835269 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc0052740 con 0x55cd0ec0f3d0 2024-04-23T18:29:30.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.041+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1556835269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0f3d0 msgr2=0x55cd0ec17ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.041+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/1556835269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0f3d0 0x55cd0ec17ed0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000a470 tx=0x7f4fc001cdb0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.041+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1556835269 shutdown_connections 2024-04-23T18:29:30.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.041+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/1556835269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0f3d0 0x55cd0ec17ed0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.041+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1556835269 >> 172.21.15.119:0/1556835269 conn(0x55cd0ec09410 msgr2=0x55cd0ec0b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.041+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1556835269 shutdown_connections 2024-04-23T18:29:30.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.041+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1556835269 wait complete. 2024-04-23T18:29:30.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.052+0000 7f4fd9b33800 1 Processor -- start 2024-04-23T18:29:30.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.052+0000 7f4fd9b33800 1 -- start start 2024-04-23T18:29:30.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.052+0000 7f4fd9b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0d890 0x55cd0ed023c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.052+0000 7f4fd9b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55cd0eb5a5a0 con 0x55cd0ec0d890 2024-04-23T18:29:30.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.053+0000 7f4fd57f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0d890 0x55cd0ed023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.053+0000 7f4fd57f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0d890 0x55cd0ed023c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60260/0 (socket says 172.21.15.119:60260) 2024-04-23T18:29:30.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.053+0000 7f4fd57f5640 1 -- 172.21.15.119:0/1081696735 learned_addr learned my addr 172.21.15.119:0/1081696735 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.053+0000 7f4fd57f5640 1 -- 172.21.15.119:0/1081696735 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0ead0860 con 0x55cd0ec0d890 2024-04-23T18:29:30.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.053+0000 7f4fd57f5640 1 --2- 172.21.15.119:0/1081696735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0d890 0x55cd0ed023c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8001de0 tx=0x7f4fc800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9c1b5d05222a33 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.053+0000 7f4ec3606640 1 -- 172.21.15.119:0/1081696735 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc8012020 con 0x55cd0ec0d890 2024-04-23T18:29:30.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.053+0000 7f4ec3606640 1 -- 172.21.15.119:0/1081696735 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc800e5a0 con 0x55cd0ec0d890 2024-04-23T18:29:30.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.053+0000 7f4ec3606640 1 -- 172.21.15.119:0/1081696735 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc800e900 con 0x55cd0ec0d890 2024-04-23T18:29:30.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.054+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1081696735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0d890 msgr2=0x55cd0ed023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.054+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/1081696735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0d890 0x55cd0ed023c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8001de0 tx=0x7f4fc800b6c0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.054+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1081696735 shutdown_connections 2024-04-23T18:29:30.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.054+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/1081696735 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0d890 0x55cd0ed023c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.054+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1081696735 >> 172.21.15.119:0/1081696735 conn(0x55cd0ec09410 msgr2=0x55cd0ecfdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.054+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1081696735 shutdown_connections 2024-04-23T18:29:30.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.054+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1081696735 wait complete. 2024-04-23T18:29:30.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.054+0000 7f4fd9b33800 1 Processor -- start 2024-04-23T18:29:30.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.054+0000 7f4fd9b33800 1 -- start start 2024-04-23T18:29:30.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.055+0000 7f4fd9b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0d890 0x55cd0ed09d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.055+0000 7f4fd9b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55cd0ec1a6f0 con 0x55cd0ec0d890 2024-04-23T18:29:30.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.055+0000 7f4fd57f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0d890 0x55cd0ed09d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.055+0000 7f4fd57f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0d890 0x55cd0ed09d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60262/0 (socket says 172.21.15.119:60262) 2024-04-23T18:29:30.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.055+0000 7f4fd57f5640 1 -- 172.21.15.119:0/930630384 learned_addr learned my addr 172.21.15.119:0/930630384 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.055+0000 7f4fd57f5640 1 -- 172.21.15.119:0/930630384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0eaceeb0 con 0x55cd0ec0d890 2024-04-23T18:29:30.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.055+0000 7f4fd57f5640 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0d890 0x55cd0ed09d70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800c010 tx=0x7f4fc8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.055+0000 7f4ec1e03640 1 -- 172.21.15.119:0/930630384 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc8012030 con 0x55cd0ec0d890 2024-04-23T18:29:30.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.055+0000 7f4ec1e03640 1 -- 172.21.15.119:0/930630384 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc801a7a0 con 0x55cd0ec0d890 2024-04-23T18:29:30.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.055+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd0ed0a2b0 con 0x55cd0ec0d890 2024-04-23T18:29:30.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.055+0000 7f4ec1e03640 1 -- 172.21.15.119:0/930630384 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc801a950 con 0x55cd0ec0d890 2024-04-23T18:29:30.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.055+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0ed0a7d0 con 0x55cd0ec0d890 2024-04-23T18:29:30.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.056+0000 7f4ec1e03640 1 -- 172.21.15.119:0/930630384 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4fc8015020 con 0x55cd0ec0d890 2024-04-23T18:29:30.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.056+0000 7f4ec1e03640 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ebc036e60 0x7f4ebc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.056+0000 7f4ec1e03640 1 -- 172.21.15.119:0/930630384 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4fc8020030 con 0x55cd0ec0d890 2024-04-23T18:29:30.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.056+0000 7f4fccff4640 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ebc036e60 0x7f4ebc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.056+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cd0ec0f3d0 0x55cd0ed10de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.057+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed113b0 con 0x55cd0ec0f3d0 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.057+0000 7f4fd5ff6640 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cd0ec0f3d0 0x55cd0ed10de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.057+0000 7f4fccff4640 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ebc036e60 0x7f4ebc039320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0054000 tx=0x7f4fc004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.057+0000 7f4fd5ff6640 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cd0ec0f3d0 0x55cd0ed10de0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.057+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/930630384 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ec0f3d0 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.057+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed0e3b0 con 0x55cd0ec0f3d0 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.058+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/930630384 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ec0f3d0 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.058+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cd0ed136c0 0x55cd0ed15ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.058+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed16150 con 0x55cd0ed136c0 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.058+0000 7f4fd57f5640 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cd0ed136c0 0x55cd0ed15ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.058+0000 7f4fd57f5640 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cd0ed136c0 0x55cd0ed15ab0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.058+0000 7f4fd57f5640 1 -- 172.21.15.119:0/930630384 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4fc800dcd0 con 0x55cd0ed136c0 2024-04-23T18:29:30.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.058+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed12670 con 0x55cd0ec0f3d0 2024-04-23T18:29:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.059+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/930630384 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ec0f3d0 2024-04-23T18:29:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.059+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55cd0ed17600 0x55cd0ed19a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.059+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed1a1b0 con 0x55cd0ed17600 2024-04-23T18:29:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.059+0000 7f4fccff4640 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55cd0ed17600 0x55cd0ed19a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.059+0000 7f4fccff4640 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55cd0ed17600 0x55cd0ed19a50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.060+0000 7f4fccff4640 1 -- 172.21.15.119:0/930630384 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4fc0052910 con 0x55cd0ed17600 2024-04-23T18:29:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.060+0000 7f4fd9b33800 1 Processor -- start 2024-04-23T18:29:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.060+0000 7f4fd9b33800 1 -- start start 2024-04-23T18:29:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.060+0000 7f4fd9b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed285a0 0x55cd0ed289c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.060+0000 7f4fd9b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55cd0eb00df0 con 0x55cd0ed285a0 2024-04-23T18:29:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.061+0000 7f4fd57f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed285a0 0x55cd0ed289c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.061+0000 7f4fd57f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed285a0 0x55cd0ed289c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60278/0 (socket says 172.21.15.119:60278) 2024-04-23T18:29:30.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.061+0000 7f4fd57f5640 1 -- 172.21.15.119:0/1364933849 learned_addr learned my addr 172.21.15.119:0/1364933849 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.061+0000 7f4fd57f5640 1 -- 172.21.15.119:0/1364933849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0ed28f00 con 0x55cd0ed285a0 2024-04-23T18:29:30.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.061+0000 7f4fd57f5640 1 --2- 172.21.15.119:0/1364933849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed285a0 0x55cd0ed289c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4fc802d040 tx=0x7f4fc8016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.061+0000 7f4ebaffd640 1 -- 172.21.15.119:0/1364933849 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc803a070 con 0x55cd0ed285a0 2024-04-23T18:29:30.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.061+0000 7f4ebaffd640 1 -- 172.21.15.119:0/1364933849 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc8046040 con 0x55cd0ed285a0 2024-04-23T18:29:30.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.061+0000 7f4ebaffd640 1 -- 172.21.15.119:0/1364933849 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc802d3f0 con 0x55cd0ed285a0 2024-04-23T18:29:30.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.061+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1364933849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd0ed29970 con 0x55cd0ed285a0 2024-04-23T18:29:30.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.061+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1364933849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0ed29e70 con 0x55cd0ed285a0 2024-04-23T18:29:30.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.062+0000 7f4ebaffd640 1 -- 172.21.15.119:0/1364933849 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4fc803d070 con 0x55cd0ed285a0 2024-04-23T18:29:30.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.062+0000 7f4ebaffd640 1 --2- 172.21.15.119:0/1364933849 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4eac036e10 0x7f4eac0392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.062+0000 7f4ebaffd640 1 -- 172.21.15.119:0/1364933849 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4fc801b040 con 0x55cd0ed285a0 2024-04-23T18:29:30.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.062+0000 7f4fccff4640 1 --2- 172.21.15.119:0/1364933849 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4eac036e10 0x7f4eac0392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.062+0000 7f4fd9b33800 1 Processor -- start 2024-04-23T18:29:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.062+0000 7f4fd9b33800 1 -- start start 2024-04-23T18:29:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.063+0000 7f4fccff4640 1 --2- 172.21.15.119:0/1364933849 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4eac036e10 0x7f4eac0392d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55cd0ed0e2d0 tx=0x7f4fc0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.063+0000 7f4fd9b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 0x55cd0ed35bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.063+0000 7f4fd9b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55cd0ed02b40 con 0x55cd0ed357a0 2024-04-23T18:29:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.063+0000 7f4fd57f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 0x55cd0ed35bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.063+0000 7f4fd57f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 0x55cd0ed35bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60282/0 (socket says 172.21.15.119:60282) 2024-04-23T18:29:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.063+0000 7f4fd57f5640 1 -- 172.21.15.119:0/461536977 learned_addr learned my addr 172.21.15.119:0/461536977 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.063+0000 7f4fd57f5640 1 -- 172.21.15.119:0/461536977 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0ed36190 con 0x55cd0ed357a0 2024-04-23T18:29:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.063+0000 7f4fd57f5640 1 --2- 172.21.15.119:0/461536977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 0x55cd0ed35bc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8010fd0 tx=0x7f4fc8041730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d30d9cbcfa4dd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.063+0000 7f4eb8ff9640 1 -- 172.21.15.119:0/461536977 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc8044b10 con 0x55cd0ed357a0 2024-04-23T18:29:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.063+0000 7f4eb8ff9640 1 -- 172.21.15.119:0/461536977 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc802d590 con 0x55cd0ed357a0 2024-04-23T18:29:30.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.063+0000 7f4eb8ff9640 1 -- 172.21.15.119:0/461536977 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc8044cb0 con 0x55cd0ed357a0 2024-04-23T18:29:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd9b33800 1 -- 172.21.15.119:0/461536977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 msgr2=0x55cd0ed35bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/461536977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 0x55cd0ed35bc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8010fd0 tx=0x7f4fc8041730 comp rx=0 tx=0).stop 2024-04-23T18:29:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd9b33800 1 -- 172.21.15.119:0/461536977 shutdown_connections 2024-04-23T18:29:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/461536977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 0x55cd0ed35bc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd9b33800 1 -- 172.21.15.119:0/461536977 >> 172.21.15.119:0/461536977 conn(0x55cd0ed31a20 msgr2=0x55cd0ed2fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd9b33800 1 -- 172.21.15.119:0/461536977 shutdown_connections 2024-04-23T18:29:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd9b33800 1 -- 172.21.15.119:0/461536977 wait complete. 2024-04-23T18:29:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd9b33800 1 Processor -- start 2024-04-23T18:29:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd9b33800 1 -- start start 2024-04-23T18:29:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd9b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 0x55cd0ed3cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd9b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55cd0ed36800 con 0x55cd0ed357a0 2024-04-23T18:29:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd57f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 0x55cd0ed3cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd57f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 0x55cd0ed3cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60288/0 (socket says 172.21.15.119:60288) 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.064+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 learned_addr learned my addr 172.21.15.119:0/3553985406 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.065+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0ed3d070 con 0x55cd0ed357a0 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.065+0000 7f4fd57f5640 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 0x55cd0ed3cb30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800d010 tx=0x7f4fc8039f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.065+0000 7f4eaaffd640 1 -- 172.21.15.119:0/3553985406 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc806d020 con 0x55cd0ed357a0 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.065+0000 7f4eaaffd640 1 -- 172.21.15.119:0/3553985406 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc804b7c0 con 0x55cd0ed357a0 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.065+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd0ed3d070 con 0x55cd0ed357a0 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.065+0000 7f4eaaffd640 1 -- 172.21.15.119:0/3553985406 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fc8063040 con 0x55cd0ed357a0 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.065+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0ed3d070 con 0x55cd0ed357a0 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.066+0000 7f4eaaffd640 1 -- 172.21.15.119:0/3553985406 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4fc8070020 con 0x55cd0ed357a0 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.066+0000 7f4fd9b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.066+0000 7f4eaaffd640 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ea0036eb0 0x7f4ea0039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.066+0000 7f4eaaffd640 1 -- 172.21.15.119:0/3553985406 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4fc805a070 con 0x55cd0ed357a0 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.066+0000 7f4fccff4640 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ea0036eb0 0x7f4ea0039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.066+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cd0ed482b0 0x55cd0ed4a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.066+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4aec0 con 0x55cd0ed482b0 2024-04-23T18:29:30.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.067+0000 7f4fd5ff6640 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cd0ed482b0 0x55cd0ed4a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.067+0000 7f4fccff4640 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ea0036eb0 0x7f4ea0039370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4fc001cdf0 tx=0x7f4fc004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.067+0000 7f4fd5ff6640 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cd0ed482b0 0x55cd0ed4a770 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.067+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ed482b0 2024-04-23T18:29:30.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.067+0000 7f4fd9b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.067+0000 7f4fd9b33800 20 realm 2024-04-23T18:29:30.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.067+0000 7f4fd9b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.067+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4b2d0 con 0x55cd0ed482b0 2024-04-23T18:29:30.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.067+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ed482b0 2024-04-23T18:29:30.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.067+0000 7f4fd9b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.067+0000 7f4fd9b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:30.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.067+0000 7f4fd9b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.067+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bb70 con 0x55cd0ed482b0 2024-04-23T18:29:30.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.068+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ed482b0 2024-04-23T18:29:30.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.068+0000 7f4fd9b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.068+0000 7f4fd9b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.068+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed482b0 2024-04-23T18:29:30.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.068+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ed482b0 2024-04-23T18:29:30.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.068+0000 7f4fd9b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:30.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.068+0000 7f4fd9b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.068+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cd0ed4cc70 0x55cd0ed4f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.068+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4f5a0 con 0x55cd0ed4cc70 2024-04-23T18:29:30.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.068+0000 7f4fd57f5640 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cd0ed4cc70 0x55cd0ed4f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.068+0000 7f4fd57f5640 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cd0ed4cc70 0x55cd0ed4f060 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.069+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4fc8066040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.069+0000 7f4fd9b33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:30.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.069+0000 7f4fd9b33800 20 searching for the correct realm 2024-04-23T18:29:30.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.069+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55cd0ed51610 0x55cd0ed53ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.069+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed541a0 con 0x55cd0ed51610 2024-04-23T18:29:30.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.069+0000 7f4fccff4640 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55cd0ed51610 0x55cd0ed53ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.069+0000 7f4fccff4640 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55cd0ed51610 0x55cd0ed53ad0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.069+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.069+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed541a0 con 0x55cd0ed4cc70 2024-04-23T18:29:30.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.070+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fc8066040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.070+0000 7f4fd57f5640 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4fc8072020 0x7f4fc8005240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.070+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed541a0 con 0x7f4fc8072020 2024-04-23T18:29:30.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.070+0000 7f4fd5ff6640 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4fc8072020 0x7f4fc8005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.070+0000 7f4fd5ff6640 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4fc8072020 0x7f4fc8005240 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.071+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd000a4a0 con 0x7f4fc8072020 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.071+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed482b0 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.071+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ed482b0 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.071+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed482b0 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.071+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ed482b0 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.071+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x7f4fc8072020 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.071+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd000a4a0 con 0x7f4fc8072020 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.071+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x7f4fc8072020 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.072+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4fd000a4a0 con 0x7f4fc8072020 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.072+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed4cc70 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.072+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fc8066040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.072+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed51610 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.072+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.072+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed482b0 2024-04-23T18:29:30.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.072+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ed482b0 2024-04-23T18:29:30.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.072+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x7f4fc8072020 2024-04-23T18:29:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.073+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd000a4a0 con 0x7f4fc8072020 2024-04-23T18:29:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.073+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed482b0 2024-04-23T18:29:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.073+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ed482b0 2024-04-23T18:29:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.073+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed4cc70 2024-04-23T18:29:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.073+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4fc8066040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.073+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed51610 2024-04-23T18:29:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.074+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.074+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed51610 2024-04-23T18:29:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.074+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.074+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x7f4fc8072020 2024-04-23T18:29:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.074+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd000a4a0 con 0x7f4fc8072020 2024-04-23T18:29:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.074+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed51610 2024-04-23T18:29:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.074+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.074+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed51610 2024-04-23T18:29:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.075+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.075+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed482b0 2024-04-23T18:29:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.075+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ed482b0 2024-04-23T18:29:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.075+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed482b0 2024-04-23T18:29:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.075+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ed482b0 2024-04-23T18:29:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.075+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x7f4fc8072020 2024-04-23T18:29:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.075+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd000a4a0 con 0x7f4fc8072020 2024-04-23T18:29:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.075+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed51610 2024-04-23T18:29:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.076+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.076+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed4cc70 2024-04-23T18:29:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.076+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4fc8066040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.076+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed482b0 2024-04-23T18:29:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.076+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd000a4a0 con 0x55cd0ed482b0 2024-04-23T18:29:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.076+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x7f4fc8072020 2024-04-23T18:29:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.077+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd000a4a0 con 0x7f4fc8072020 2024-04-23T18:29:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.077+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed51610 2024-04-23T18:29:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.077+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.077+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x7f4fc8072020 2024-04-23T18:29:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.077+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd000a4a0 con 0x7f4fc8072020 2024-04-23T18:29:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.077+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed4cc70 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.077+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fc8066040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.077+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed51610 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.078+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.078+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x7f4fc8072020 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.078+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.078+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed482b0 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.078+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.078+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4bf10 con 0x55cd0ed4cc70 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fc8089040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:30.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4ff10 con 0x55cd0ed482b0 2024-04-23T18:29:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4ff10 con 0x55cd0ed482b0 2024-04-23T18:29:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.079+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed4fec0 con 0x7f4fc8072020 2024-04-23T18:29:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd9b33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd9b33800 20 zone default found 2024-04-23T18:29:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd9b33800 4 Realm: () 2024-04-23T18:29:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd9b33800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd9b33800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd9b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd9b33800 20 zonegroup default 2024-04-23T18:29:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd9b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed50300 con 0x7f4fc8072020 2024-04-23T18:29:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd9b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd9b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.080+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed50740 con 0x55cd0ed51610 2024-04-23T18:29:30.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.081+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.081+0000 7f4fd9b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.081+0000 7f4fd9b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.081+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed56000 con 0x55cd0ed51610 2024-04-23T18:29:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.081+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.081+0000 7f4fd9b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.081+0000 7f4fd9b33800 20 started sync module instance, tier type = 2024-04-23T18:29:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.081+0000 7f4fd9b33800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.081+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed554a0 con 0x55cd0ed4cc70 2024-04-23T18:29:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.082+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fc8089040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.082+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94339205517296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed563a0 con 0x55cd0ed4cc70 2024-04-23T18:29:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.082+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed56bf0 con 0x55cd0ed482b0 2024-04-23T18:29:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.083+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94339205517296] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fc8089040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.083+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.083+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94339205519504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed568b0 con 0x55cd0ed482b0 2024-04-23T18:29:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.083+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed573c0 con 0x55cd0ed51610 2024-04-23T18:29:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.084+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.084+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94339205525104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed57c60 con 0x55cd0ed51610 2024-04-23T18:29:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.084+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed58760 con 0x55cd0ed4cc70 2024-04-23T18:29:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.085+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94339205519504] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.085+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94339205525104] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.086+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fc8089040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.086+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94339205527472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed563a0 con 0x55cd0ed4cc70 2024-04-23T18:29:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.086+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed59000 con 0x55cd0ed482b0 2024-04-23T18:29:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.087+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.087+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94339205532496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed58f70 con 0x55cd0ed482b0 2024-04-23T18:29:30.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.087+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed59fd0 con 0x7f4fc8072020 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.087+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94339205527472] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fc8089040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.088+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94339205532496] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.088+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.088+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94339205536448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed59f90 con 0x7f4fc8072020 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.088+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed5a870 con 0x7f4fc8072020 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.090+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94339205536448] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.090+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.090+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94339205530192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed59f90 con 0x7f4fc8072020 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.090+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed5ae90 con 0x7f4fc8072020 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.091+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.091+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94339205530192] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.091+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94339205540320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed5b2b0 con 0x7f4fc8072020 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.091+0000 7f4fd9b33800 20 add_watcher() i=0 2024-04-23T18:29:30.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.091+0000 7f4fd9b33800 20 add_watcher() i=1 2024-04-23T18:29:30.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.091+0000 7f4fd9b33800 20 add_watcher() i=2 2024-04-23T18:29:30.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.091+0000 7f4fd9b33800 20 add_watcher() i=3 2024-04-23T18:29:30.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.091+0000 7f4fd9b33800 20 add_watcher() i=4 2024-04-23T18:29:30.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.091+0000 7f4fd9b33800 20 add_watcher() i=5 2024-04-23T18:29:30.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.091+0000 7f4fd9b33800 20 add_watcher() i=6 2024-04-23T18:29:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.092+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94339205540320] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.092+0000 7f4fd9b33800 20 add_watcher() i=7 2024-04-23T18:29:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.092+0000 7f4fd9b33800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.092+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed5b2b0 con 0x55cd0ed482b0 2024-04-23T18:29:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.092+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.092+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94339205541376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed5b290 con 0x55cd0ed482b0 2024-04-23T18:29:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.093+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94339205541376] v32'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.094+0000 7f4e8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.094+0000 7f4fd9b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.094+0000 7f4fd9b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.094+0000 7f4fd9b33800 5 note: GC not initialized 2024-04-23T18:29:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.094+0000 7f4e8a7e4640 20 reqs_thread_entry: start 2024-04-23T18:29:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.094+0000 7f4fd9b33800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.094+0000 7f4fd9b33800 20 Filter name: none 2024-04-23T18:29:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.094+0000 7f4dfbfff640 20 reqs_thread_entry: start 2024-04-23T18:29:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.094+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed91f10 con 0x55cd0ed482b0 2024-04-23T18:29:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.095+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.095+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed91f10 con 0x55cd0ed4cc70 2024-04-23T18:29:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.095+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4fc8089040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.095+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed91f10 con 0x55cd0ed482b0 2024-04-23T18:29:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.095+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.095+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed91ed0 con 0x55cd0ed51610 2024-04-23T18:29:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.095+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.095+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92400 con 0x55cd0ed51610 2024-04-23T18:29:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.096+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.096+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed51610 2024-04-23T18:29:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.096+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.096+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed482b0 2024-04-23T18:29:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.096+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.096+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed482b0 2024-04-23T18:29:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.096+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.096+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed51610 2024-04-23T18:29:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.096+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.097+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed51610 2024-04-23T18:29:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.097+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.097+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x7f4fc8072020 2024-04-23T18:29:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.097+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.097+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed482b0 2024-04-23T18:29:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.098+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.098+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed4cc70 2024-04-23T18:29:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.098+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fc8089040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.098+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed51610 2024-04-23T18:29:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.098+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.098+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x7f4fc8072020 2024-04-23T18:29:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.098+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.098+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x7f4fc8072020 2024-04-23T18:29:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.099+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.099+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed51610 2024-04-23T18:29:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.099+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.099+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x7f4fc8072020 2024-04-23T18:29:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.099+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.099+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed482b0 2024-04-23T18:29:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.099+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.099+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed51610 2024-04-23T18:29:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.100+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.100+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x7f4fc8072020 2024-04-23T18:29:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.100+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.100+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed4cc70 2024-04-23T18:29:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.100+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fc8089040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.100+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x7f4fc8072020 2024-04-23T18:29:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.100+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.100+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed482b0 2024-04-23T18:29:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.100+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.101+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed482b0 2024-04-23T18:29:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.101+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.101+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed51610 2024-04-23T18:29:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.101+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.101+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed482b0 2024-04-23T18:29:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.101+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.101+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed482b0 2024-04-23T18:29:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.101+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.102+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed51610 2024-04-23T18:29:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.102+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.102+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed51610 2024-04-23T18:29:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.102+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.102+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed51610 2024-04-23T18:29:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.102+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.102+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x7f4fc8072020 2024-04-23T18:29:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.103+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.103+0000 7f4e8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.103+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94339205541376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed482b0 2024-04-23T18:29:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.104+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94339205541376] v32'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.104+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94339205517296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed4cc70 2024-04-23T18:29:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.105+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94339205517296] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fc8089040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.105+0000 7f4fd9b33800 20 remove_watcher() i=0 2024-04-23T18:29:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.105+0000 7f4fd9b33800 2 removed watcher, disabling cache 2024-04-23T18:29:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.105+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94339205519504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed482b0 2024-04-23T18:29:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.107+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94339205519504] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.107+0000 7f4fd9b33800 20 remove_watcher() i=1 2024-04-23T18:29:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.107+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94339205525104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed51610 2024-04-23T18:29:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.108+0000 7f4fccff4640 1 -- 172.21.15.119:0/3553985406 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94339205525104] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fc0081070 con 0x55cd0ed51610 2024-04-23T18:29:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.108+0000 7f4fd9b33800 20 remove_watcher() i=2 2024-04-23T18:29:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.108+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94339205527472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed4cc70 2024-04-23T18:29:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.109+0000 7f4fd57f5640 1 -- 172.21.15.119:0/3553985406 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94339205527472] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fc8089040 con 0x55cd0ed4cc70 2024-04-23T18:29:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.109+0000 7f4fd9b33800 20 remove_watcher() i=3 2024-04-23T18:29:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.109+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94339205532496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x55cd0ed482b0 2024-04-23T18:29:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.110+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94339205532496] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x55cd0ed482b0 2024-04-23T18:29:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.110+0000 7f4fd9b33800 20 remove_watcher() i=4 2024-04-23T18:29:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.110+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94339205536448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x7f4fc8072020 2024-04-23T18:29:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.111+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94339205536448] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.111+0000 7f4fd9b33800 20 remove_watcher() i=5 2024-04-23T18:29:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.111+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94339205530192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x7f4fc8072020 2024-04-23T18:29:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.112+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94339205530192] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.112+0000 7f4fd9b33800 20 remove_watcher() i=6 2024-04-23T18:29:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.112+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94339205540320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cd0ed92810 con 0x7f4fc8072020 2024-04-23T18:29:30.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94339205540320] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fd0040040 con 0x7f4fc8072020 2024-04-23T18:29:30.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 20 remove_watcher() i=7 2024-04-23T18:29:30.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4fc8072020 msgr2=0x7f4fc8005240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4fc8072020 0x7f4fc8005240 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cd0ed482b0 msgr2=0x55cd0ed4a770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cd0ed482b0 0x55cd0ed4a770 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cd0ed4cc70 msgr2=0x55cd0ed4f060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cd0ed4cc70 0x55cd0ed4f060 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55cd0ed51610 msgr2=0x55cd0ed53ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55cd0ed51610 0x55cd0ed53ad0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ea0036eb0 msgr2=0x7f4ea0039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ea0036eb0 0x7f4ea0039370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4fc001cdf0 tx=0x7f4fc004f000 comp rx=0 tx=0).stop 2024-04-23T18:29:30.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 msgr2=0x55cd0ed3cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/3553985406 reap_dead start 2024-04-23T18:29:30.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 0x55cd0ed3cb30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800d010 tx=0x7f4fc8039f10 comp rx=0 tx=0).stop 2024-04-23T18:29:30.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 shutdown_connections 2024-04-23T18:29:30.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/3553985406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed357a0 0x55cd0ed3cb30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 >> 172.21.15.119:0/3553985406 conn(0x55cd0ed31a20 msgr2=0x55cd0ed2f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 shutdown_connections 2024-04-23T18:29:30.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/3553985406 wait complete. 2024-04-23T18:29:30.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1364933849 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4eac036e10 msgr2=0x7f4eac0392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/1364933849 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4eac036e10 0x7f4eac0392d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55cd0ed0e2d0 tx=0x7f4fc0005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1364933849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed285a0 msgr2=0x55cd0ed289c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/1364933849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed285a0 0x55cd0ed289c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4fc802d040 tx=0x7f4fc8016b00 comp rx=0 tx=0).stop 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1364933849 shutdown_connections 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/1364933849 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4eac036e10 0x7f4eac0392d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/1364933849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ed285a0 0x55cd0ed289c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1364933849 >> 172.21.15.119:0/1364933849 conn(0x55cd0ed1c640 msgr2=0x55cd0ed1ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1364933849 shutdown_connections 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.113+0000 7f4fd9b33800 1 -- 172.21.15.119:0/1364933849 wait complete. 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55cd0ed17600 msgr2=0x55cd0ed19a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55cd0ed17600 0x55cd0ed19a50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cd0ec0f3d0 msgr2=0x55cd0ed10de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55cd0ec0f3d0 0x55cd0ed10de0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cd0ed136c0 msgr2=0x55cd0ed15ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55cd0ed136c0 0x55cd0ed15ab0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ebc036e60 msgr2=0x7f4ebc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ebc036e60 0x7f4ebc039320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0054000 tx=0x7f4fc004e000 comp rx=0 tx=0).stop 2024-04-23T18:29:30.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0d890 msgr2=0x55cd0ed09d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 --2- 172.21.15.119:0/930630384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55cd0ec0d890 0x55cd0ed09d70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800c010 tx=0x7f4fc8000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd5ff6640 1 -- 172.21.15.119:0/930630384 reap_dead start 2024-04-23T18:29:30.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 shutdown_connections 2024-04-23T18:29:30.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 >> 172.21.15.119:0/930630384 conn(0x55cd0ec09410 msgr2=0x55cd0ed00db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 shutdown_connections 2024-04-23T18:29:30.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.114+0000 7f4fd9b33800 1 -- 172.21.15.119:0/930630384 wait complete. 2024-04-23T18:29:30.120 INFO:teuthology.orchestra.run.smithi119.stdout:{"entries":[],"summary":[]} 2024-04-23T18:29:30.120 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-23T18:29:30.120 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-23T18:29:30.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-23T18:29:30.121 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-23T18:29:30.203 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:30.203 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:30.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.211+0000 7f831660f800 1 Processor -- start 2024-04-23T18:29:30.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.211+0000 7f831660f800 1 -- start start 2024-04-23T18:29:30.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.211+0000 7f831660f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x563e2e97c2f0 0x563e2e97e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.211+0000 7f831660f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563e2e829560 con 0x563e2e977e60 2024-04-23T18:29:30.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.211+0000 7f831660f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x563e2e81ae20 con 0x563e2e97c2f0 2024-04-23T18:29:30.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.212+0000 7f830bfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x563e2e97c2f0 0x563e2e97e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.212+0000 7f8311c14640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x563e2e977e60 0x563e2e978280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40478/0 (socket says 172.21.15.119:40478) 2024-04-23T18:29:30.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.212+0000 7f8311c14640 1 -- 172.21.15.119:0/3549901889 learned_addr learned my addr 172.21.15.119:0/3549901889 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:30.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.212+0000 7f8311413640 1 -- 172.21.15.119:0/3549901889 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317411385 0 0) 0x563e2e829560 con 0x563e2e977e60 2024-04-23T18:29:30.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.212+0000 7f8311413640 1 -- 172.21.15.119:0/3549901889 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8300001e10 con 0x563e2e977e60 2024-04-23T18:29:30.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.212+0000 7f830bfff640 1 -- 172.21.15.119:0/3549901889 >> v1:172.21.15.62:6789/0 conn(0x563e2e977e60 legacy=0x563e2e978280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.212+0000 7f830bfff640 1 -- 172.21.15.119:0/3549901889 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2e828e60 con 0x563e2e97c2f0 2024-04-23T18:29:30.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.214+0000 7f830bfff640 1 --2- 172.21.15.119:0/3549901889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e97c2f0 0x563e2e97e6e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00a470 tx=0x7f82fc01cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4c72d32cde8c0a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.214+0000 7f8311413640 1 -- 172.21.15.119:0/3549901889 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82fc057070 con 0x563e2e97c2f0 2024-04-23T18:29:30.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.214+0000 7f8311413640 1 -- 172.21.15.119:0/3549901889 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82fc052570 con 0x563e2e97c2f0 2024-04-23T18:29:30.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.214+0000 7f8311413640 1 -- 172.21.15.119:0/3549901889 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82fc052870 con 0x563e2e97c2f0 2024-04-23T18:29:30.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.215+0000 7f831660f800 1 -- 172.21.15.119:0/3549901889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e97c2f0 msgr2=0x563e2e97e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.215+0000 7f831660f800 1 --2- 172.21.15.119:0/3549901889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e97c2f0 0x563e2e97e6e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00a470 tx=0x7f82fc01cdb0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.215+0000 7f831660f800 1 -- 172.21.15.119:0/3549901889 shutdown_connections 2024-04-23T18:29:30.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.215+0000 7f831660f800 1 --2- 172.21.15.119:0/3549901889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e97c2f0 0x563e2e97e6e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.215+0000 7f831660f800 1 -- 172.21.15.119:0/3549901889 >> 172.21.15.119:0/3549901889 conn(0x563e2e973420 msgr2=0x563e2e975840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.215+0000 7f831660f800 1 -- 172.21.15.119:0/3549901889 shutdown_connections 2024-04-23T18:29:30.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.215+0000 7f831660f800 1 -- 172.21.15.119:0/3549901889 wait complete. 2024-04-23T18:29:30.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.226+0000 7f831660f800 1 Processor -- start 2024-04-23T18:29:30.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.226+0000 7f831660f800 1 -- start start 2024-04-23T18:29:30.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.226+0000 7f831660f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e977e60 0x563e2e8ebe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.226+0000 7f831660f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563e2e8c45b0 con 0x563e2e977e60 2024-04-23T18:29:30.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.227+0000 7f8311c14640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e977e60 0x563e2e8ebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.227+0000 7f8311c14640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e977e60 0x563e2e8ebe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60308/0 (socket says 172.21.15.119:60308) 2024-04-23T18:29:30.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.227+0000 7f8311c14640 1 -- 172.21.15.119:0/1237338833 learned_addr learned my addr 172.21.15.119:0/1237338833 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.227+0000 7f8311c14640 1 -- 172.21.15.119:0/1237338833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2e83a860 con 0x563e2e977e60 2024-04-23T18:29:30.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.227+0000 7f8311c14640 1 --2- 172.21.15.119:0/1237338833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e977e60 0x563e2e8ebe60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8304001e30 tx=0x7f830400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6347dac8f7bbc72f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.227+0000 7f81ffe07640 1 -- 172.21.15.119:0/1237338833 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8304012020 con 0x563e2e977e60 2024-04-23T18:29:30.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.227+0000 7f81ffe07640 1 -- 172.21.15.119:0/1237338833 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830400e5a0 con 0x563e2e977e60 2024-04-23T18:29:30.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.227+0000 7f81ffe07640 1 -- 172.21.15.119:0/1237338833 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f830400e8e0 con 0x563e2e977e60 2024-04-23T18:29:30.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.228+0000 7f831660f800 1 -- 172.21.15.119:0/1237338833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e977e60 msgr2=0x563e2e8ebe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.228+0000 7f831660f800 1 --2- 172.21.15.119:0/1237338833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e977e60 0x563e2e8ebe60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8304001e30 tx=0x7f830400b780 comp rx=0 tx=0).stop 2024-04-23T18:29:30.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.228+0000 7f831660f800 1 -- 172.21.15.119:0/1237338833 shutdown_connections 2024-04-23T18:29:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.228+0000 7f831660f800 1 --2- 172.21.15.119:0/1237338833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e977e60 0x563e2e8ebe60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.228+0000 7f831660f800 1 -- 172.21.15.119:0/1237338833 >> 172.21.15.119:0/1237338833 conn(0x563e2e973420 msgr2=0x563e2ea647d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.228+0000 7f831660f800 1 -- 172.21.15.119:0/1237338833 shutdown_connections 2024-04-23T18:29:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.228+0000 7f831660f800 1 -- 172.21.15.119:0/1237338833 wait complete. 2024-04-23T18:29:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.229+0000 7f831660f800 1 Processor -- start 2024-04-23T18:29:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.229+0000 7f831660f800 1 -- start start 2024-04-23T18:29:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.229+0000 7f831660f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e97c2f0 0x563e2ea71b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.229+0000 7f831660f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563e2e97efb0 con 0x563e2e97c2f0 2024-04-23T18:29:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.229+0000 7f8311c14640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e97c2f0 0x563e2ea71b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.229+0000 7f8311c14640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e97c2f0 0x563e2ea71b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60324/0 (socket says 172.21.15.119:60324) 2024-04-23T18:29:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.229+0000 7f8311c14640 1 -- 172.21.15.119:0/152120754 learned_addr learned my addr 172.21.15.119:0/152120754 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.229+0000 7f8311c14640 1 -- 172.21.15.119:0/152120754 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2e838eb0 con 0x563e2e97c2f0 2024-04-23T18:29:30.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.229+0000 7f8311c14640 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e97c2f0 0x563e2ea71b40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8304001e30 tx=0x7f8304000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.229+0000 7f81fe604640 1 -- 172.21.15.119:0/152120754 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8304012030 con 0x563e2e97c2f0 2024-04-23T18:29:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.230+0000 7f81fe604640 1 -- 172.21.15.119:0/152120754 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8304001490 con 0x563e2e97c2f0 2024-04-23T18:29:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.230+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e2ea72080 con 0x563e2e97c2f0 2024-04-23T18:29:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.230+0000 7f81fe604640 1 -- 172.21.15.119:0/152120754 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f830401a700 con 0x563e2e97c2f0 2024-04-23T18:29:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.230+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e2ea725a0 con 0x563e2e97c2f0 2024-04-23T18:29:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.230+0000 7f81fe604640 1 -- 172.21.15.119:0/152120754 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8304015020 con 0x563e2e97c2f0 2024-04-23T18:29:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.230+0000 7f81fe604640 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81f8036eb0 0x7f81f8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.231+0000 7f81fe604640 1 -- 172.21.15.119:0/152120754 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8304020030 con 0x563e2e97c2f0 2024-04-23T18:29:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.231+0000 7f830bfff640 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81f8036eb0 0x7f81f8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.231+0000 7f831660f800 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563e2ea76ba0 0x563e2ea78f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.231+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2ea79510 con 0x563e2ea76ba0 2024-04-23T18:29:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.231+0000 7f8312415640 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563e2ea76ba0 0x563e2ea78f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.231+0000 7f830bfff640 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81f8036eb0 0x7f81f8039370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f82fc054000 tx=0x7f82fc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.231+0000 7f8312415640 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563e2ea76ba0 0x563e2ea78f90 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.231+0000 7f8312415640 1 -- 172.21.15.119:0/152120754 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2ea76ba0 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.231+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2ea76160 con 0x563e2ea76ba0 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.232+0000 7f8312415640 1 -- 172.21.15.119:0/152120754 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2ea76ba0 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.232+0000 7f831660f800 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563e2ea7b820 0x563e2ea7dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.232+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2ea7e2b0 con 0x563e2ea7b820 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.232+0000 7f8311c14640 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563e2ea7b820 0x563e2ea7dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.232+0000 7f8311c14640 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563e2ea7b820 0x563e2ea7dc10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.232+0000 7f8311c14640 1 -- 172.21.15.119:0/152120754 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f830400cdb0 con 0x563e2ea7b820 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.232+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2ea7a7a0 con 0x563e2ea76ba0 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.233+0000 7f8312415640 1 -- 172.21.15.119:0/152120754 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2ea76ba0 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.233+0000 7f831660f800 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x563e2ea7f710 0x563e2ea81b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.233+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2ea82310 con 0x563e2ea7f710 2024-04-23T18:29:30.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.233+0000 7f830bfff640 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x563e2ea7f710 0x563e2ea81b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.233+0000 7f830bfff640 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x563e2ea7f710 0x563e2ea81b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.234+0000 7f830bfff640 1 -- 172.21.15.119:0/152120754 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f82fc052a40 con 0x563e2ea7f710 2024-04-23T18:29:30.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.234+0000 7f831660f800 1 Processor -- start 2024-04-23T18:29:30.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.234+0000 7f831660f800 1 -- start start 2024-04-23T18:29:30.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.234+0000 7f831660f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea90770 0x563e2ea90b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.234+0000 7f831660f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563e2e86adf0 con 0x563e2ea90770 2024-04-23T18:29:30.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.235+0000 7f8311c14640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea90770 0x563e2ea90b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.235+0000 7f8311c14640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea90770 0x563e2ea90b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60332/0 (socket says 172.21.15.119:60332) 2024-04-23T18:29:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.235+0000 7f8311c14640 1 -- 172.21.15.119:0/1680767093 learned_addr learned my addr 172.21.15.119:0/1680767093 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.235+0000 7f8311c14640 1 -- 172.21.15.119:0/1680767093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2ea910d0 con 0x563e2ea90770 2024-04-23T18:29:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.235+0000 7f8311c14640 1 --2- 172.21.15.119:0/1680767093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea90770 0x563e2ea90b90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f830404b0c0 tx=0x7f8304017e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.235+0000 7f81f77fe640 1 -- 172.21.15.119:0/1680767093 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83040444e0 con 0x563e2ea90770 2024-04-23T18:29:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.235+0000 7f81f77fe640 1 -- 172.21.15.119:0/1680767093 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830400f980 con 0x563e2ea90770 2024-04-23T18:29:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.235+0000 7f831660f800 1 -- 172.21.15.119:0/1680767093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e2ea91b40 con 0x563e2ea90770 2024-04-23T18:29:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.235+0000 7f81f77fe640 1 -- 172.21.15.119:0/1680767093 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f830400fca0 con 0x563e2ea90770 2024-04-23T18:29:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.235+0000 7f831660f800 1 -- 172.21.15.119:0/1680767093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e2ea92040 con 0x563e2ea90770 2024-04-23T18:29:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.236+0000 7f81f77fe640 1 -- 172.21.15.119:0/1680767093 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f830402d3f0 con 0x563e2ea90770 2024-04-23T18:29:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.236+0000 7f81f77fe640 1 --2- 172.21.15.119:0/1680767093 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81ec036dc0 0x7f81ec039280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.236+0000 7f81f77fe640 1 -- 172.21.15.119:0/1680767093 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8304040040 con 0x563e2ea90770 2024-04-23T18:29:30.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.236+0000 7f830bfff640 1 --2- 172.21.15.119:0/1680767093 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81ec036dc0 0x7f81ec039280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.236+0000 7f831660f800 1 Processor -- start 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.236+0000 7f831660f800 1 -- start start 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.236+0000 7f830bfff640 1 --2- 172.21.15.119:0/1680767093 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81ec036dc0 0x7f81ec039280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x563e2ea760a0 tx=0x7f82fc005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.236+0000 7f831660f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea9d900 0x563e2ea9dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.236+0000 7f831660f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563e2ea6ce60 con 0x563e2ea9d900 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.237+0000 7f8311c14640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea9d900 0x563e2ea9dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.237+0000 7f8311c14640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea9d900 0x563e2ea9dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60348/0 (socket says 172.21.15.119:60348) 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.237+0000 7f8311c14640 1 -- 172.21.15.119:0/2855860632 learned_addr learned my addr 172.21.15.119:0/2855860632 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.237+0000 7f8311c14640 1 -- 172.21.15.119:0/2855860632 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2ea9e2f0 con 0x563e2ea9d900 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.237+0000 7f8311c14640 1 --2- 172.21.15.119:0/2855860632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea9d900 0x563e2ea9dd20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f830404b960 tx=0x7f830404b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3346c0c9071b4cff server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.237+0000 7f81f57fa640 1 -- 172.21.15.119:0/2855860632 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f830400da50 con 0x563e2ea9d900 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.237+0000 7f81f57fa640 1 -- 172.21.15.119:0/2855860632 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830405d070 con 0x563e2ea9d900 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.237+0000 7f81f57fa640 1 -- 172.21.15.119:0/2855860632 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8304048cf0 con 0x563e2ea9d900 2024-04-23T18:29:30.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f831660f800 1 -- 172.21.15.119:0/2855860632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea9d900 msgr2=0x563e2ea9dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f831660f800 1 --2- 172.21.15.119:0/2855860632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea9d900 0x563e2ea9dd20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f830404b960 tx=0x7f830404b700 comp rx=0 tx=0).stop 2024-04-23T18:29:30.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f831660f800 1 -- 172.21.15.119:0/2855860632 shutdown_connections 2024-04-23T18:29:30.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f831660f800 1 --2- 172.21.15.119:0/2855860632 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea9d900 0x563e2ea9dd20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f831660f800 1 -- 172.21.15.119:0/2855860632 >> 172.21.15.119:0/2855860632 conn(0x563e2ea99b80 msgr2=0x563e2ea97be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f831660f800 1 -- 172.21.15.119:0/2855860632 shutdown_connections 2024-04-23T18:29:30.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f831660f800 1 -- 172.21.15.119:0/2855860632 wait complete. 2024-04-23T18:29:30.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f831660f800 1 Processor -- start 2024-04-23T18:29:30.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f831660f800 1 -- start start 2024-04-23T18:29:30.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f831660f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea9d900 0x563e2eaa4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f831660f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563e2ea9e960 con 0x563e2ea9d900 2024-04-23T18:29:30.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f8311c14640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea9d900 0x563e2eaa4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f8311c14640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea9d900 0x563e2eaa4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60364/0 (socket says 172.21.15.119:60364) 2024-04-23T18:29:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.238+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 learned_addr learned my addr 172.21.15.119:0/3548483496 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.239+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e2eaa51e0 con 0x563e2ea9d900 2024-04-23T18:29:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.239+0000 7f8311c14640 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea9d900 0x563e2eaa4ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8304017fd0 tx=0x7f8304038f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.239+0000 7f81e37fe640 1 -- 172.21.15.119:0/3548483496 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8304044b30 con 0x563e2ea9d900 2024-04-23T18:29:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.239+0000 7f81e37fe640 1 -- 172.21.15.119:0/3548483496 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8304051070 con 0x563e2ea9d900 2024-04-23T18:29:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.239+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e2eaa51e0 con 0x563e2ea9d900 2024-04-23T18:29:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.239+0000 7f81e37fe640 1 -- 172.21.15.119:0/3548483496 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83040365b0 con 0x563e2ea9d900 2024-04-23T18:29:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.239+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e2eaa51e0 con 0x563e2ea9d900 2024-04-23T18:29:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.240+0000 7f81e37fe640 1 -- 172.21.15.119:0/3548483496 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8304036810 con 0x563e2ea9d900 2024-04-23T18:29:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.240+0000 7f81e37fe640 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81dc036eb0 0x7f81dc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.240+0000 7f831660f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.240+0000 7f81e37fe640 1 -- 172.21.15.119:0/3548483496 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f83040502a0 con 0x563e2ea9d900 2024-04-23T18:29:30.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.240+0000 7f830bfff640 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81dc036eb0 0x7f81dc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.240+0000 7f831660f800 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563e2eab0430 0x563e2eab28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.240+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab3040 con 0x563e2eab0430 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.240+0000 7f8312415640 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563e2eab0430 0x563e2eab28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f830bfff640 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81dc036eb0 0x7f81dc039370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x563e2ea82710 tx=0x7f82fc04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f8312415640 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563e2eab0430 0x563e2eab28f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2eab0430 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f831660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f831660f800 20 realm 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f831660f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab3450 con 0x563e2eab0430 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2eab0430 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f831660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f831660f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f831660f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab3cf0 con 0x563e2eab0430 2024-04-23T18:29:30.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2eab0430 2024-04-23T18:29:30.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f831660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f831660f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.241+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab0430 2024-04-23T18:29:30.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.242+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2eab0430 2024-04-23T18:29:30.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.242+0000 7f831660f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:30.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.242+0000 7f831660f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.242+0000 7f831660f800 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563e2eab4bc0 0x563e2eab6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.242+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab76f0 con 0x563e2eab4bc0 2024-04-23T18:29:30.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.242+0000 7f8311c14640 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563e2eab4bc0 0x563e2eab6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.242+0000 7f8311c14640 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563e2eab4bc0 0x563e2eab6fb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.242+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8304073020 con 0x563e2eab4bc0 2024-04-23T18:29:30.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.242+0000 7f831660f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:30.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.242+0000 7f831660f800 20 searching for the correct realm 2024-04-23T18:29:30.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.242+0000 7f831660f800 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563e2eab9790 0x563e2eabbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.242+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eabc320 con 0x563e2eab9790 2024-04-23T18:29:30.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.242+0000 7f830bfff640 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563e2eab9790 0x563e2eabbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.243+0000 7f830bfff640 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563e2eab9790 0x563e2eabbc50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.243+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.243+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eabc320 con 0x563e2eab4bc0 2024-04-23T18:29:30.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.243+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8304073020 con 0x563e2eab4bc0 2024-04-23T18:29:30.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.243+0000 7f8311c14640 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8304017050 0x7f83040246b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.243+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eabc320 con 0x7f8304017050 2024-04-23T18:29:30.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.244+0000 7f8312415640 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8304017050 0x7f83040246b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.244+0000 7f8312415640 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8304017050 0x7f83040246b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.244+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c00a4a0 con 0x7f8304017050 2024-04-23T18:29:30.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.244+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab0430 2024-04-23T18:29:30.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.244+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2eab0430 2024-04-23T18:29:30.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.244+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab0430 2024-04-23T18:29:30.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.245+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2eab0430 2024-04-23T18:29:30.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.245+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x7f8304017050 2024-04-23T18:29:30.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.245+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c00a4a0 con 0x7f8304017050 2024-04-23T18:29:30.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.245+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x7f8304017050 2024-04-23T18:29:30.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.245+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f830c00a4a0 con 0x7f8304017050 2024-04-23T18:29:30.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.245+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab4bc0 2024-04-23T18:29:30.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.245+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8304073020 con 0x563e2eab4bc0 2024-04-23T18:29:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.245+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab9790 2024-04-23T18:29:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.246+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.246+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab0430 2024-04-23T18:29:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.246+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2eab0430 2024-04-23T18:29:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.246+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x7f8304017050 2024-04-23T18:29:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.246+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c00a4a0 con 0x7f8304017050 2024-04-23T18:29:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.246+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab0430 2024-04-23T18:29:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.246+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2eab0430 2024-04-23T18:29:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.246+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab4bc0 2024-04-23T18:29:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.246+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8304073020 con 0x563e2eab4bc0 2024-04-23T18:29:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.247+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab9790 2024-04-23T18:29:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.247+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.247+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab9790 2024-04-23T18:29:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.247+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.247+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x7f8304017050 2024-04-23T18:29:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.247+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c00a4a0 con 0x7f8304017050 2024-04-23T18:29:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.247+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab9790 2024-04-23T18:29:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.247+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.247+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab9790 2024-04-23T18:29:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.248+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.248+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab0430 2024-04-23T18:29:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.248+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2eab0430 2024-04-23T18:29:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.248+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab0430 2024-04-23T18:29:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.248+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2eab0430 2024-04-23T18:29:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.248+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x7f8304017050 2024-04-23T18:29:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.249+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c00a4a0 con 0x7f8304017050 2024-04-23T18:29:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.249+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab9790 2024-04-23T18:29:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.249+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.249+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab4bc0 2024-04-23T18:29:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.249+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8304073020 con 0x563e2eab4bc0 2024-04-23T18:29:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.249+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab0430 2024-04-23T18:29:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.249+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c00a4a0 con 0x563e2eab0430 2024-04-23T18:29:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.249+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x7f8304017050 2024-04-23T18:29:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.250+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c00a4a0 con 0x7f8304017050 2024-04-23T18:29:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.250+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab9790 2024-04-23T18:29:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.250+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.250+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x7f8304017050 2024-04-23T18:29:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.250+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c00a4a0 con 0x7f8304017050 2024-04-23T18:29:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.250+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab4bc0 2024-04-23T18:29:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.250+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8304073020 con 0x563e2eab4bc0 2024-04-23T18:29:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.250+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab9790 2024-04-23T18:29:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.251+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.251+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x7f8304017050 2024-04-23T18:29:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.251+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830c040040 con 0x7f8304017050 2024-04-23T18:29:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.251+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab0430 2024-04-23T18:29:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.251+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f830c040040 con 0x563e2eab0430 2024-04-23T18:29:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.251+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab4090 con 0x563e2eab4bc0 2024-04-23T18:29:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8304073020 con 0x563e2eab4bc0 2024-04-23T18:29:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:30.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:30.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab8090 con 0x563e2eab0430 2024-04-23T18:29:30.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f830c040040 con 0x563e2eab0430 2024-04-23T18:29:30.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab8090 con 0x563e2eab0430 2024-04-23T18:29:30.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f830c040040 con 0x563e2eab0430 2024-04-23T18:29:30.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:30.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.252+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab8040 con 0x7f8304017050 2024-04-23T18:29:30.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f830c040040 con 0x7f8304017050 2024-04-23T18:29:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 20 zone default found 2024-04-23T18:29:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 4 Realm: () 2024-04-23T18:29:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 20 zonegroup default 2024-04-23T18:29:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab8480 con 0x7f8304017050 2024-04-23T18:29:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f830c040040 con 0x7f8304017050 2024-04-23T18:29:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2eab88c0 con 0x563e2eab9790 2024-04-23T18:29:30.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.253+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2eabe180 con 0x563e2eab9790 2024-04-23T18:29:30.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.254+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.254+0000 7f831660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.254+0000 7f831660f800 20 started sync module instance, tier type = 2024-04-23T18:29:30.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.254+0000 7f831660f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:30.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.254+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eabd620 con 0x563e2eab4bc0 2024-04-23T18:29:30.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.255+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8304073020 con 0x563e2eab4bc0 2024-04-23T18:29:30.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.255+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94825070973296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eabe520 con 0x563e2eab4bc0 2024-04-23T18:29:30.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.255+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eabed70 con 0x563e2eab0430 2024-04-23T18:29:30.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.256+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94825070973296] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8304073020 con 0x563e2eab4bc0 2024-04-23T18:29:30.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.256+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x563e2eab0430 2024-04-23T18:29:30.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.256+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94825070979264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eabf190 con 0x563e2eab0430 2024-04-23T18:29:30.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.256+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eabfa20 con 0x563e2eab9790 2024-04-23T18:29:30.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.257+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.257+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94825070982000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac02f0 con 0x563e2eab9790 2024-04-23T18:29:30.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.257+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac0dc0 con 0x563e2eab4bc0 2024-04-23T18:29:30.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.257+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94825070979264] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x563e2eab0430 2024-04-23T18:29:30.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.258+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94825070982000] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.258+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8304073020 con 0x563e2eab4bc0 2024-04-23T18:29:30.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.258+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94825070987440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac11b0 con 0x563e2eab4bc0 2024-04-23T18:29:30.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.258+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac1a00 con 0x563e2eab0430 2024-04-23T18:29:30.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.259+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x563e2eab0430 2024-04-23T18:29:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.259+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94825070990224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac1e70 con 0x563e2eab0430 2024-04-23T18:29:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.259+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac2990 con 0x7f8304017050 2024-04-23T18:29:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.259+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94825070987440] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8304073020 con 0x563e2eab4bc0 2024-04-23T18:29:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.260+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94825070990224] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x563e2eab0430 2024-04-23T18:29:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.261+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x7f8304017050 2024-04-23T18:29:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.261+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94825070994528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac2950 con 0x7f8304017050 2024-04-23T18:29:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.261+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac3230 con 0x7f8304017050 2024-04-23T18:29:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.262+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(56 notify.6 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x7f8304017050 2024-04-23T18:29:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.262+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94825070996864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac2950 con 0x7f8304017050 2024-04-23T18:29:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.262+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac3d50 con 0x7f8304017050 2024-04-23T18:29:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.262+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94825070994528] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x7f8304017050 2024-04-23T18:29:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.263+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94825070996864] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x7f8304017050 2024-04-23T18:29:30.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.263+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x7f8304017050 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.263+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94825070999584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac31a0 con 0x7f8304017050 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.263+0000 7f831660f800 20 add_watcher() i=0 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.263+0000 7f831660f800 20 add_watcher() i=1 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.263+0000 7f831660f800 20 add_watcher() i=2 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.263+0000 7f831660f800 20 add_watcher() i=3 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.263+0000 7f831660f800 20 add_watcher() i=4 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.263+0000 7f831660f800 20 add_watcher() i=5 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.263+0000 7f831660f800 20 add_watcher() i=6 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.264+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94825070999584] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x7f8304017050 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.264+0000 7f831660f800 20 add_watcher() i=7 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.264+0000 7f831660f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.264+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac6d40 con 0x563e2eab0430 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.264+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f830c040040 con 0x563e2eab0430 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.264+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94825070980320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac4260 con 0x563e2eab0430 2024-04-23T18:29:30.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.265+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94825070980320] v32'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f830c040040 con 0x563e2eab0430 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.265+0000 7f81c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.265+0000 7f831660f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.265+0000 7f831660f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.265+0000 7f831660f800 5 note: GC not initialized 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.265+0000 7f81c27fc640 20 reqs_thread_entry: start 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.265+0000 7f831660f800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.265+0000 7f831660f800 20 Filter name: none 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.266+0000 7f8133fff640 20 reqs_thread_entry: start 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.266+0000 7f831660f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.266+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e2eaf9eb0 con 0x563e2eab0430 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.266+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f830c040040 con 0x563e2eab0430 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.266+0000 7f831660f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:could not fetch user info: no user info saved 2024-04-23T18:29:30.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.267+0000 7f81c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:30.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.267+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94825070980320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eaf9e70 con 0x563e2eab0430 2024-04-23T18:29:30.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.267+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94825070980320] v32'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f830c040040 con 0x563e2eab0430 2024-04-23T18:29:30.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.267+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94825070973296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eaf9e70 con 0x563e2eab4bc0 2024-04-23T18:29:30.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.268+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94825070973296] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8304073020 con 0x563e2eab4bc0 2024-04-23T18:29:30.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.268+0000 7f831660f800 20 remove_watcher() i=0 2024-04-23T18:29:30.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.268+0000 7f831660f800 2 removed watcher, disabling cache 2024-04-23T18:29:30.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.268+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94825070979264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eaf9e70 con 0x563e2eab0430 2024-04-23T18:29:30.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.269+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94825070979264] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x563e2eab0430 2024-04-23T18:29:30.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.269+0000 7f831660f800 20 remove_watcher() i=1 2024-04-23T18:29:30.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.269+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94825070982000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eaf9e70 con 0x563e2eab9790 2024-04-23T18:29:30.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.270+0000 7f830bfff640 1 -- 172.21.15.119:0/3548483496 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94825070982000] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82fc081070 con 0x563e2eab9790 2024-04-23T18:29:30.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.270+0000 7f831660f800 20 remove_watcher() i=2 2024-04-23T18:29:30.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.270+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94825070987440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eabd170 con 0x563e2eab4bc0 2024-04-23T18:29:30.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.271+0000 7f8311c14640 1 -- 172.21.15.119:0/3548483496 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94825070987440] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8304073020 con 0x563e2eab4bc0 2024-04-23T18:29:30.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.271+0000 7f831660f800 20 remove_watcher() i=3 2024-04-23T18:29:30.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.271+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94825070990224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eabd170 con 0x563e2eab0430 2024-04-23T18:29:30.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.272+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94825070990224] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x563e2eab0430 2024-04-23T18:29:30.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.272+0000 7f831660f800 20 remove_watcher() i=4 2024-04-23T18:29:30.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.272+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94825070994528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac1390 con 0x7f8304017050 2024-04-23T18:29:30.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.273+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94825070994528] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x7f8304017050 2024-04-23T18:29:30.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.273+0000 7f831660f800 20 remove_watcher() i=5 2024-04-23T18:29:30.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.273+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94825070996864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eabd170 con 0x7f8304017050 2024-04-23T18:29:30.279 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T18:29:30.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.274+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94825070996864] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x7f8304017050 2024-04-23T18:29:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.274+0000 7f831660f800 20 remove_watcher() i=6 2024-04-23T18:29:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.274+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94825070999584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e2eac2460 con 0x7f8304017050 2024-04-23T18:29:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.275+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94825070999584] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830c040040 con 0x7f8304017050 2024-04-23T18:29:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.275+0000 7f831660f800 20 remove_watcher() i=7 2024-04-23T18:29:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.275+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8304017050 msgr2=0x7f83040246b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.275+0000 7f831660f800 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8304017050 0x7f83040246b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.275+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563e2eab0430 msgr2=0x563e2eab28f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.275+0000 7f831660f800 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563e2eab0430 0x563e2eab28f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.275+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563e2eab4bc0 msgr2=0x563e2eab6fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.275+0000 7f831660f800 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563e2eab4bc0 0x563e2eab6fb0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.275+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563e2eab9790 msgr2=0x563e2eabbc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.275+0000 7f831660f800 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563e2eab9790 0x563e2eabbc50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81dc036eb0 msgr2=0x7f81dc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81dc036eb0 0x7f81dc039370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x563e2ea82710 tx=0x7f82fc04f000 comp rx=0 tx=0).stop 2024-04-23T18:29:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea9d900 msgr2=0x563e2eaa4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 --2- 172.21.15.119:0/3548483496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea9d900 0x563e2eaa4ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8304017fd0 tx=0x7f8304038f60 comp rx=0 tx=0).stop 2024-04-23T18:29:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 reap_dead start 2024-04-23T18:29:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f8312415640 1 -- 172.21.15.119:0/3548483496 reap_dead start 2024-04-23T18:29:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 shutdown_connections 2024-04-23T18:29:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 >> 172.21.15.119:0/3548483496 conn(0x563e2ea99b80 msgr2=0x563e2ea971e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 shutdown_connections 2024-04-23T18:29:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/3548483496 wait complete. 2024-04-23T18:29:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/1680767093 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81ec036dc0 msgr2=0x7f81ec039280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 --2- 172.21.15.119:0/1680767093 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81ec036dc0 0x7f81ec039280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x563e2ea760a0 tx=0x7f82fc005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/1680767093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea90770 msgr2=0x563e2ea90b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 --2- 172.21.15.119:0/1680767093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea90770 0x563e2ea90b90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f830404b0c0 tx=0x7f8304017e80 comp rx=0 tx=0).stop 2024-04-23T18:29:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/1680767093 shutdown_connections 2024-04-23T18:29:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 --2- 172.21.15.119:0/1680767093 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81ec036dc0 0x7f81ec039280 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 --2- 172.21.15.119:0/1680767093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2ea90770 0x563e2ea90b90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/1680767093 >> 172.21.15.119:0/1680767093 conn(0x563e2ea84810 msgr2=0x563e2ea84c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/1680767093 shutdown_connections 2024-04-23T18:29:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/1680767093 wait complete. 2024-04-23T18:29:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x563e2ea7f710 msgr2=0x563e2ea81b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x563e2ea7f710 0x563e2ea81b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563e2ea76ba0 msgr2=0x563e2ea78f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563e2ea76ba0 0x563e2ea78f90 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563e2ea7b820 msgr2=0x563e2ea7dc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563e2ea7b820 0x563e2ea7dc10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81f8036eb0 msgr2=0x7f81f8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81f8036eb0 0x7f81f8039370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f82fc054000 tx=0x7f82fc04e000 comp rx=0 tx=0).stop 2024-04-23T18:29:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e97c2f0 msgr2=0x563e2ea71b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.276+0000 7f831660f800 1 --2- 172.21.15.119:0/152120754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563e2e97c2f0 0x563e2ea71b40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8304001e30 tx=0x7f8304000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.277+0000 7f8312415640 1 -- 172.21.15.119:0/152120754 reap_dead start 2024-04-23T18:29:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.277+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 shutdown_connections 2024-04-23T18:29:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.277+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 >> 172.21.15.119:0/152120754 conn(0x563e2e973420 msgr2=0x563e2ea63030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.277+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 shutdown_connections 2024-04-23T18:29:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.277+0000 7f831660f800 1 -- 172.21.15.119:0/152120754 wait complete. 2024-04-23T18:29:30.283 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-23T18:29:30.284 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-23T18:29:30.284 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-04-23T18:29:30.376 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:30.377 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:30.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.384+0000 7f8c85725800 1 Processor -- start 2024-04-23T18:29:30.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.384+0000 7f8c85725800 1 -- start start 2024-04-23T18:29:30.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.384+0000 7f8c85725800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c09b028290 0x55c09b02a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.384+0000 7f8c85725800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c09aed5560 con 0x55c09b023e00 2024-04-23T18:29:30.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.384+0000 7f8c85725800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55c09aec6e20 con 0x55c09b028290 2024-04-23T18:29:30.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.385+0000 7f8c80cb6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c09b028290 0x55c09b02a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.385+0000 7f8c814b7640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55c09b023e00 0x55c09b024220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40490/0 (socket says 172.21.15.119:40490) 2024-04-23T18:29:30.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.385+0000 7f8c814b7640 1 -- 172.21.15.119:0/3929528547 learned_addr learned my addr 172.21.15.119:0/3929528547 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:30.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.385+0000 7f8c73fff640 1 -- 172.21.15.119:0/3929528547 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364713755 0 0) 0x55c09aed5560 con 0x55c09b023e00 2024-04-23T18:29:30.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.385+0000 7f8c73fff640 1 -- 172.21.15.119:0/3929528547 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c6c001e10 con 0x55c09b023e00 2024-04-23T18:29:30.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.385+0000 7f8c80cb6640 1 -- 172.21.15.119:0/3929528547 >> v1:172.21.15.62:6789/0 conn(0x55c09b023e00 legacy=0x55c09b024220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.385+0000 7f8c80cb6640 1 -- 172.21.15.119:0/3929528547 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c09aed4e60 con 0x55c09b028290 2024-04-23T18:29:30.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.387+0000 7f8c80cb6640 1 --2- 172.21.15.119:0/3929528547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b028290 0x55c09b02a680 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800a470 tx=0x7f8c7801cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8454ea2fb499272 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.387+0000 7f8c73fff640 1 -- 172.21.15.119:0/3929528547 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c78057070 con 0x55c09b028290 2024-04-23T18:29:30.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.387+0000 7f8c73fff640 1 -- 172.21.15.119:0/3929528547 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c78052570 con 0x55c09b028290 2024-04-23T18:29:30.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.387+0000 7f8c73fff640 1 -- 172.21.15.119:0/3929528547 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c78052850 con 0x55c09b028290 2024-04-23T18:29:30.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.387+0000 7f8c85725800 1 -- 172.21.15.119:0/3929528547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b028290 msgr2=0x55c09b02a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.387+0000 7f8c85725800 1 --2- 172.21.15.119:0/3929528547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b028290 0x55c09b02a680 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800a470 tx=0x7f8c7801cdb0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.387+0000 7f8c85725800 1 -- 172.21.15.119:0/3929528547 shutdown_connections 2024-04-23T18:29:30.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.387+0000 7f8c85725800 1 --2- 172.21.15.119:0/3929528547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b028290 0x55c09b02a680 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.387+0000 7f8c85725800 1 -- 172.21.15.119:0/3929528547 >> 172.21.15.119:0/3929528547 conn(0x55c09b01f3c0 msgr2=0x55c09b0217e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.387+0000 7f8c85725800 1 -- 172.21.15.119:0/3929528547 shutdown_connections 2024-04-23T18:29:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.387+0000 7f8c85725800 1 -- 172.21.15.119:0/3929528547 wait complete. 2024-04-23T18:29:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.399+0000 7f8c85725800 1 Processor -- start 2024-04-23T18:29:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.399+0000 7f8c85725800 1 -- start start 2024-04-23T18:29:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.399+0000 7f8c85725800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b023e00 0x55c09b114ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.399+0000 7f8c85725800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c09af70550 con 0x55c09b023e00 2024-04-23T18:29:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.399+0000 7f8c814b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b023e00 0x55c09b114ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.399+0000 7f8c814b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b023e00 0x55c09b114ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60374/0 (socket says 172.21.15.119:60374) 2024-04-23T18:29:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.400+0000 7f8c814b7640 1 -- 172.21.15.119:0/3834703981 learned_addr learned my addr 172.21.15.119:0/3834703981 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.400+0000 7f8c814b7640 1 -- 172.21.15.119:0/3834703981 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c09aee6860 con 0x55c09b023e00 2024-04-23T18:29:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.400+0000 7f8c814b7640 1 --2- 172.21.15.119:0/3834703981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b023e00 0x55c09b114ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8c74001db0 tx=0x7f8c7400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7406290ab0ca3d70 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.400+0000 7f8b6f606640 1 -- 172.21.15.119:0/3834703981 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c74012020 con 0x55c09b023e00 2024-04-23T18:29:30.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.400+0000 7f8b6f606640 1 -- 172.21.15.119:0/3834703981 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7400e5a0 con 0x55c09b023e00 2024-04-23T18:29:30.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.400+0000 7f8b6f606640 1 -- 172.21.15.119:0/3834703981 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7400e940 con 0x55c09b023e00 2024-04-23T18:29:30.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.401+0000 7f8c85725800 1 -- 172.21.15.119:0/3834703981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b023e00 msgr2=0x55c09b114ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.401+0000 7f8c85725800 1 --2- 172.21.15.119:0/3834703981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b023e00 0x55c09b114ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8c74001db0 tx=0x7f8c7400b6c0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.401+0000 7f8c85725800 1 -- 172.21.15.119:0/3834703981 shutdown_connections 2024-04-23T18:29:30.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.401+0000 7f8c85725800 1 --2- 172.21.15.119:0/3834703981 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b023e00 0x55c09b114ed0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.401+0000 7f8c85725800 1 -- 172.21.15.119:0/3834703981 >> 172.21.15.119:0/3834703981 conn(0x55c09b01f3c0 msgr2=0x55c09b1107f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.401+0000 7f8c85725800 1 -- 172.21.15.119:0/3834703981 shutdown_connections 2024-04-23T18:29:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.401+0000 7f8c85725800 1 -- 172.21.15.119:0/3834703981 wait complete. 2024-04-23T18:29:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.401+0000 7f8c85725800 1 Processor -- start 2024-04-23T18:29:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.401+0000 7f8c85725800 1 -- start start 2024-04-23T18:29:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.401+0000 7f8c85725800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b023e00 0x55c09b119ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.401+0000 7f8c85725800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c09b02af50 con 0x55c09b023e00 2024-04-23T18:29:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.401+0000 7f8c814b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b023e00 0x55c09b119ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.402+0000 7f8c814b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b023e00 0x55c09b119ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60390/0 (socket says 172.21.15.119:60390) 2024-04-23T18:29:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.402+0000 7f8c814b7640 1 -- 172.21.15.119:0/3333860233 learned_addr learned my addr 172.21.15.119:0/3333860233 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.402+0000 7f8c814b7640 1 -- 172.21.15.119:0/3333860233 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c09aee4eb0 con 0x55c09b023e00 2024-04-23T18:29:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.402+0000 7f8c814b7640 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b023e00 0x55c09b119ed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55c09b115c60 tx=0x7f8c74000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.402+0000 7f8b6de03640 1 -- 172.21.15.119:0/3333860233 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c74012030 con 0x55c09b023e00 2024-04-23T18:29:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.402+0000 7f8b6de03640 1 -- 172.21.15.119:0/3333860233 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c74001430 con 0x55c09b023e00 2024-04-23T18:29:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.402+0000 7f8b6de03640 1 -- 172.21.15.119:0/3333860233 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7401a8a0 con 0x55c09b023e00 2024-04-23T18:29:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.402+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c09b1185c0 con 0x55c09b023e00 2024-04-23T18:29:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.402+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c09b118ae0 con 0x55c09b023e00 2024-04-23T18:29:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.403+0000 7f8b6de03640 1 -- 172.21.15.119:0/3333860233 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8c74015020 con 0x55c09b023e00 2024-04-23T18:29:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.403+0000 7f8b6de03640 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b68036e60 0x7f8b68039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.403+0000 7f8b6de03640 1 -- 172.21.15.119:0/3333860233 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8c74020030 con 0x55c09b023e00 2024-04-23T18:29:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.403+0000 7f8c80cb6640 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b68036e60 0x7f8b68039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.403+0000 7f8c85725800 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c09b028290 0x55c09b126d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.403+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b127270 con 0x55c09b028290 2024-04-23T18:29:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.403+0000 7f8c81cb8640 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c09b028290 0x55c09b126d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.404+0000 7f8c80cb6640 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b68036e60 0x7f8b68039320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8c78054000 tx=0x7f8c7804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.404+0000 7f8c81cb8640 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c09b028290 0x55c09b126d30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.404+0000 7f8c81cb8640 1 -- 172.21.15.119:0/3333860233 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b028290 2024-04-23T18:29:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.404+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b127670 con 0x55c09b028290 2024-04-23T18:29:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.404+0000 7f8c81cb8640 1 -- 172.21.15.119:0/3333860233 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b028290 2024-04-23T18:29:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.404+0000 7f8c85725800 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c09b129480 0x55c09b12b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.404+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b12bf10 con 0x55c09b129480 2024-04-23T18:29:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.404+0000 7f8c814b7640 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c09b129480 0x55c09b12b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.405+0000 7f8c814b7640 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c09b129480 0x55c09b12b870 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.405+0000 7f8c814b7640 1 -- 172.21.15.119:0/3333860233 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8c7402dcf0 con 0x55c09b129480 2024-04-23T18:29:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.405+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b128400 con 0x55c09b028290 2024-04-23T18:29:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.405+0000 7f8c81cb8640 1 -- 172.21.15.119:0/3333860233 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b028290 2024-04-23T18:29:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.405+0000 7f8c85725800 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c09b12d370 0x55c09b12f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.405+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b12ff40 con 0x55c09b12d370 2024-04-23T18:29:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.406+0000 7f8c80cb6640 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c09b12d370 0x55c09b12f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.406+0000 7f8c80cb6640 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c09b12d370 0x55c09b12f7e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.406+0000 7f8c80cb6640 1 -- 172.21.15.119:0/3333860233 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8c78052a60 con 0x55c09b12d370 2024-04-23T18:29:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.407+0000 7f8c85725800 1 Processor -- start 2024-04-23T18:29:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.407+0000 7f8c85725800 1 -- start start 2024-04-23T18:29:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.407+0000 7f8c85725800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b13e3a0 0x55c09b13e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.407+0000 7f8c85725800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c09af16df0 con 0x55c09b13e3a0 2024-04-23T18:29:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.407+0000 7f8c814b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b13e3a0 0x55c09b13e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.407+0000 7f8c814b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b13e3a0 0x55c09b13e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60398/0 (socket says 172.21.15.119:60398) 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.407+0000 7f8c814b7640 1 -- 172.21.15.119:0/2523494543 learned_addr learned my addr 172.21.15.119:0/2523494543 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.407+0000 7f8c814b7640 1 -- 172.21.15.119:0/2523494543 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c09b13ed00 con 0x55c09b13e3a0 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.407+0000 7f8c814b7640 1 --2- 172.21.15.119:0/2523494543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b13e3a0 0x55c09b13e7c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c7404b2b0 tx=0x7f8c7400db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.408+0000 7f8b66ffd640 1 -- 172.21.15.119:0/2523494543 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7403c070 con 0x55c09b13e3a0 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.408+0000 7f8b66ffd640 1 -- 172.21.15.119:0/2523494543 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c74044af0 con 0x55c09b13e3a0 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.408+0000 7f8b66ffd640 1 -- 172.21.15.119:0/2523494543 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c74044dd0 con 0x55c09b13e3a0 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.408+0000 7f8c85725800 1 -- 172.21.15.119:0/2523494543 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c09b13f770 con 0x55c09b13e3a0 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.408+0000 7f8c85725800 1 -- 172.21.15.119:0/2523494543 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c09b13f770 con 0x55c09b13e3a0 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.408+0000 7f8b66ffd640 1 -- 172.21.15.119:0/2523494543 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8c7403f070 con 0x55c09b13e3a0 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.408+0000 7f8b66ffd640 1 --2- 172.21.15.119:0/2523494543 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b5c036e60 0x7f8b5c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.409+0000 7f8b66ffd640 1 -- 172.21.15.119:0/2523494543 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8c7401b040 con 0x55c09b13e3a0 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.409+0000 7f8c80cb6640 1 --2- 172.21.15.119:0/2523494543 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b5c036e60 0x7f8b5c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.409+0000 7f8c85725800 1 Processor -- start 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.409+0000 7f8c85725800 1 -- start start 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.409+0000 7f8c80cb6640 1 --2- 172.21.15.119:0/2523494543 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b5c036e60 0x7f8b5c039320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55c09b11a4f0 tx=0x7f8c78005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.409+0000 7f8c85725800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 0x55c09b14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.409+0000 7f8c85725800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c09b115650 con 0x55c09b14b290 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.409+0000 7f8c814b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 0x55c09b14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.409+0000 7f8c814b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 0x55c09b14b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60400/0 (socket says 172.21.15.119:60400) 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.409+0000 7f8c814b7640 1 -- 172.21.15.119:0/4232952471 learned_addr learned my addr 172.21.15.119:0/4232952471 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.410+0000 7f8c814b7640 1 -- 172.21.15.119:0/4232952471 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c09b14bc80 con 0x55c09b14b290 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.410+0000 7f8c814b7640 1 --2- 172.21.15.119:0/4232952471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 0x55c09b14b6b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8c7401a6a0 tx=0x7f8c74024550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5178954bc1426623 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.410+0000 7f8b64ff9640 1 -- 172.21.15.119:0/4232952471 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7402d3f0 con 0x55c09b14b290 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.410+0000 7f8b64ff9640 1 -- 172.21.15.119:0/4232952471 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c74044650 con 0x55c09b14b290 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.410+0000 7f8b64ff9640 1 -- 172.21.15.119:0/4232952471 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c740410b0 con 0x55c09b14b290 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.410+0000 7f8c85725800 1 -- 172.21.15.119:0/4232952471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 msgr2=0x55c09b14b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.410+0000 7f8c85725800 1 --2- 172.21.15.119:0/4232952471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 0x55c09b14b6b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8c7401a6a0 tx=0x7f8c74024550 comp rx=0 tx=0).stop 2024-04-23T18:29:30.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.410+0000 7f8c85725800 1 -- 172.21.15.119:0/4232952471 shutdown_connections 2024-04-23T18:29:30.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.410+0000 7f8c85725800 1 --2- 172.21.15.119:0/4232952471 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 0x55c09b14b6b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.410+0000 7f8c85725800 1 -- 172.21.15.119:0/4232952471 >> 172.21.15.119:0/4232952471 conn(0x55c09b1475b0 msgr2=0x55c09b145610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.410+0000 7f8c85725800 1 -- 172.21.15.119:0/4232952471 shutdown_connections 2024-04-23T18:29:30.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.410+0000 7f8c85725800 1 -- 172.21.15.119:0/4232952471 wait complete. 2024-04-23T18:29:30.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.411+0000 7f8c85725800 1 Processor -- start 2024-04-23T18:29:30.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.411+0000 7f8c85725800 1 -- start start 2024-04-23T18:29:30.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.411+0000 7f8c85725800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 0x55c09b152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.411+0000 7f8c85725800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c09b14c3a0 con 0x55c09b14b290 2024-04-23T18:29:30.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.411+0000 7f8c814b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 0x55c09b152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.411+0000 7f8c814b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 0x55c09b152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60412/0 (socket says 172.21.15.119:60412) 2024-04-23T18:29:30.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.411+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 learned_addr learned my addr 172.21.15.119:0/1425490533 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.411+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c09b152b90 con 0x55c09b14b290 2024-04-23T18:29:30.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.412+0000 7f8c814b7640 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 0x55c09b152650 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8c7401a6a0 tx=0x7f8c74030f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.412+0000 7f8b52ffd640 1 -- 172.21.15.119:0/1425490533 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c7406e020 con 0x55c09b14b290 2024-04-23T18:29:30.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.412+0000 7f8b52ffd640 1 -- 172.21.15.119:0/1425490533 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7404cb10 con 0x55c09b14b290 2024-04-23T18:29:30.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.412+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c09b152b90 con 0x55c09b14b290 2024-04-23T18:29:30.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.412+0000 7f8b52ffd640 1 -- 172.21.15.119:0/1425490533 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c74066040 con 0x55c09b14b290 2024-04-23T18:29:30.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.412+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c09b152b90 con 0x55c09b14b290 2024-04-23T18:29:30.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.412+0000 7f8b52ffd640 1 -- 172.21.15.119:0/1425490533 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8c74071020 con 0x55c09b14b290 2024-04-23T18:29:30.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.413+0000 7f8b52ffd640 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b4c036e60 0x7f8b4c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.413+0000 7f8b52ffd640 1 -- 172.21.15.119:0/1425490533 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8c74074c40 con 0x55c09b14b290 2024-04-23T18:29:30.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.413+0000 7f8c80cb6640 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b4c036e60 0x7f8b4c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.413+0000 7f8c80cb6640 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b4c036e60 0x7f8b4c039320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8c78055040 tx=0x7f8c7804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.413+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.413+0000 7f8c85725800 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c09b15ddd0 0x55c09b160290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.413+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1609e0 con 0x55c09b15ddd0 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.413+0000 7f8c81cb8640 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c09b15ddd0 0x55c09b160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c81cb8640 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c09b15ddd0 0x55c09b160290 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b15ddd0 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c85725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c85725800 20 realm 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b160df0 con 0x55c09b15ddd0 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b15ddd0 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c85725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c85725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1616c0 con 0x55c09b15ddd0 2024-04-23T18:29:30.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b15ddd0 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c85725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b15ddd0 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b15ddd0 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.414+0000 7f8c85725800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.415+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.415+0000 7f8c85725800 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c09b1627c0 0x55c09b164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.415+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1651c0 con 0x55c09b1627c0 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.415+0000 7f8c814b7640 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c09b1627c0 0x55c09b164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.415+0000 7f8c814b7640 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c09b1627c0 0x55c09b164bb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.415+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8c7403e030 con 0x55c09b1627c0 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.415+0000 7f8c85725800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.415+0000 7f8c85725800 20 searching for the correct realm 2024-04-23T18:29:30.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.415+0000 7f8c85725800 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c09b167170 0x55c09b169630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.415+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b169d00 con 0x55c09b167170 2024-04-23T18:29:30.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.415+0000 7f8c80cb6640 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c09b167170 0x55c09b169630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.415+0000 7f8c80cb6640 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c09b167170 0x55c09b169630 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.416+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.416+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b169d00 con 0x55c09b1627c0 2024-04-23T18:29:30.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.416+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7403e030 con 0x55c09b1627c0 2024-04-23T18:29:30.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.416+0000 7f8c814b7640 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8c74073020 0x7f8c7403d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.416+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b169d00 con 0x7f8c74073020 2024-04-23T18:29:30.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.416+0000 7f8c81cb8640 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8c74073020 0x7f8c7403d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.417+0000 7f8c81cb8640 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8c74073020 0x7f8c7403d260 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.417+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x7f8c74073020 2024-04-23T18:29:30.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.417+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b15ddd0 2024-04-23T18:29:30.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.417+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b15ddd0 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.417+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b15ddd0 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.417+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b15ddd0 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.417+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x7f8c74073020 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.418+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x7f8c74073020 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.418+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x7f8c74073020 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.418+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x7f8c74073020 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.418+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b1627c0 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.418+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7403e030 con 0x55c09b1627c0 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.418+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b167170 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.418+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.418+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b15ddd0 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.419+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b15ddd0 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.419+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x7f8c74073020 2024-04-23T18:29:30.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.419+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x7f8c74073020 2024-04-23T18:29:30.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.419+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b15ddd0 2024-04-23T18:29:30.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.419+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b15ddd0 2024-04-23T18:29:30.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.419+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b1627c0 2024-04-23T18:29:30.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.420+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8c7403e030 con 0x55c09b1627c0 2024-04-23T18:29:30.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.420+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b167170 2024-04-23T18:29:30.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.420+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.420+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b167170 2024-04-23T18:29:30.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.420+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.420+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x7f8c74073020 2024-04-23T18:29:30.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.421+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x7f8c74073020 2024-04-23T18:29:30.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.421+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b167170 2024-04-23T18:29:30.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.421+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.421+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b167170 2024-04-23T18:29:30.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.421+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.421+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b15ddd0 2024-04-23T18:29:30.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.421+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b15ddd0 2024-04-23T18:29:30.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.421+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b15ddd0 2024-04-23T18:29:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.421+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b15ddd0 2024-04-23T18:29:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.421+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x7f8c74073020 2024-04-23T18:29:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.422+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x7f8c74073020 2024-04-23T18:29:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.422+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b167170 2024-04-23T18:29:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.422+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.422+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b1627c0 2024-04-23T18:29:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.422+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8c7403e030 con 0x55c09b1627c0 2024-04-23T18:29:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.422+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b15ddd0 2024-04-23T18:29:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.422+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x55c09b15ddd0 2024-04-23T18:29:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.422+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x7f8c74073020 2024-04-23T18:29:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.423+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x7f8c74073020 2024-04-23T18:29:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.423+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b167170 2024-04-23T18:29:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.423+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.423+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x7f8c74073020 2024-04-23T18:29:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.424+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c00a4a0 con 0x7f8c74073020 2024-04-23T18:29:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.424+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b1627c0 2024-04-23T18:29:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.424+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7403e030 con 0x55c09b1627c0 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.424+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b167170 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.424+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.424+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x7f8c74073020 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.424+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.424+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b15ddd0 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c09b161a60 con 0x55c09b1627c0 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c7408a040 con 0x55c09b1627c0 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b165a80 con 0x55c09b15ddd0 2024-04-23T18:29:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b165a80 con 0x55c09b15ddd0 2024-04-23T18:29:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.425+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b165a80 con 0x7f8c74073020 2024-04-23T18:29:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c85725800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c85725800 20 zone default found 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c85725800 4 Realm: () 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c85725800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c85725800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c85725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c85725800 20 zonegroup default 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1663b0 con 0x7f8c74073020 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c85725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1663b0 con 0x55c09b167170 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.426+0000 7f8c85725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.427+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.427+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16bb60 con 0x55c09b167170 2024-04-23T18:29:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.427+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.427+0000 7f8c85725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.427+0000 7f8c85725800 20 started sync module instance, tier type = 2024-04-23T18:29:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.427+0000 7f8c85725800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.427+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16b000 con 0x55c09b1627c0 2024-04-23T18:29:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.428+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7408a040 con 0x55c09b1627c0 2024-04-23T18:29:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.428+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94285724038128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16c3b0 con 0x55c09b1627c0 2024-04-23T18:29:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.428+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16cc00 con 0x55c09b15ddd0 2024-04-23T18:29:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.429+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94285724038128] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7408a040 con 0x55c09b1627c0 2024-04-23T18:29:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.429+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.429+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94285724040960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16cc00 con 0x55c09b15ddd0 2024-04-23T18:29:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.429+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16d630 con 0x55c09b167170 2024-04-23T18:29:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.430+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94285724040960] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.430+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.430+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94285724043088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16cb70 con 0x55c09b167170 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.430+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16e520 con 0x55c09b1627c0 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.431+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94285724043088] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.431+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7408a040 con 0x55c09b1627c0 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.431+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94285724047952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16edc0 con 0x55c09b1627c0 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.431+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16f670 con 0x55c09b15ddd0 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.432+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94285724047952] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7408a040 con 0x55c09b1627c0 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.433+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.433+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94285724053856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16fa60 con 0x55c09b15ddd0 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.433+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b170460 con 0x7f8c74073020 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.434+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94285724053856] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.434+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.434+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94285724051728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b170420 con 0x7f8c74073020 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.434+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b170e70 con 0x7f8c74073020 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.435+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94285724051728] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.435+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.435+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94285724057936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b170e70 con 0x7f8c74073020 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.435+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b171830 con 0x7f8c74073020 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.438+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.438+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94285724062592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b171c50 con 0x7f8c74073020 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.438+0000 7f8c85725800 20 add_watcher() i=0 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.438+0000 7f8c85725800 20 add_watcher() i=1 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.438+0000 7f8c85725800 20 add_watcher() i=2 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.438+0000 7f8c85725800 20 add_watcher() i=3 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.438+0000 7f8c85725800 20 add_watcher() i=4 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.438+0000 7f8c85725800 20 add_watcher() i=5 2024-04-23T18:29:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.438+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94285724057936] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.438+0000 7f8c85725800 20 add_watcher() i=6 2024-04-23T18:29:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.439+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94285724062592] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.439+0000 7f8c85725800 20 add_watcher() i=7 2024-04-23T18:29:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.439+0000 7f8c85725800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.439+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1709c0 con 0x55c09b15ddd0 2024-04-23T18:29:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.440+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.440+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94285724063648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1709c0 con 0x55c09b15ddd0 2024-04-23T18:29:30.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.441+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94285724063648] v32'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.441+0000 7f8b377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:30.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.441+0000 7f8c85725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:30.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.441+0000 7f8c85725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:30.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.441+0000 7f8c85725800 5 note: GC not initialized 2024-04-23T18:29:30.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.441+0000 7f8b367e4640 20 reqs_thread_entry: start 2024-04-23T18:29:30.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.441+0000 7f8c85725800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.441+0000 7f8c85725800 20 Filter name: none 2024-04-23T18:29:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.441+0000 7f8aa7fff640 20 reqs_thread_entry: start 2024-04-23T18:29:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.441+0000 7f8c85725800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.441+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.441+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1a84d0 con 0x55c09b15ddd0 2024-04-23T18:29:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-23T18:29:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-23T18:29:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1a6b10 con 0x55c09b15ddd0 2024-04-23T18:29:30.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1a6f00 con 0x7f8c74073020 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.442+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1a7fb0 con 0x55c09b15ddd0 2024-04-23T18:29:30.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.443+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.443+0000 7f8c85725800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.443+0000 7f8c85725800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.443+0000 7f8c85725800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.443+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94285724283712 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1ac010 con 0x55c09b15ddd0 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.444+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== watch-notify(notify (1) cookie 94285724053856 notify 137438953472 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55c09b1a7950 con 0x55c09b15ddd0 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.444+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 notify.4 [notify cookie 94285724283712 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.444+0000 7f8b64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94285724053856 notifier 4287 bl.length()=567 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.444+0000 7f8b64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.444+0000 7f8b64ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.444+0000 7f8b64ff9640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8b44003ea0 con 0x55c09b15ddd0 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.444+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify_complete (2) cookie 94285724283712 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c09b1a70f0 con 0x55c09b15ddd0 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.444+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.444+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1abf90 con 0x55c09b15ddd0 2024-04-23T18:29:30.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.446+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.446+0000 7f8c85725800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.446+0000 7f8c85725800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.446+0000 7f8c85725800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.446+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94285724297824 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1ac440 con 0x55c09b1627c0 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.446+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== watch-notify(notify (1) cookie 94285724047952 notify 137438953472 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55c09b13ed00 con 0x55c09b1627c0 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.446+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(69 notify.3 [notify cookie 94285724297824 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c7408a040 con 0x55c09b1627c0 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.446+0000 7f8b64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94285724047952 notifier 4287 bl.length()=169 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.446+0000 7f8b64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.446+0000 7f8b64ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.446+0000 7f8b64ff9640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8b44003ea0 con 0x55c09b1627c0 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.447+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== watch-notify(notify_complete (2) cookie 94285724297824 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8c74033070 con 0x55c09b1627c0 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.447+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7408a040 con 0x55c09b1627c0 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.447+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1a9f00 con 0x7f8c74073020 2024-04-23T18:29:30.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.448+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.448+0000 7f8c85725800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-23T18:29:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.448+0000 7f8c85725800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-23T18:29:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.448+0000 7f8c85725800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-23T18:29:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.448+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94285724297824 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1ac440 con 0x55c09b1627c0 2024-04-23T18:29:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.448+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== watch-notify(notify (1) cookie 94285724047952 notify 137438953473 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f8c74033070 con 0x55c09b1627c0 2024-04-23T18:29:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.448+0000 7f8b64ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94285724047952 notifier 4287 bl.length()=177 2024-04-23T18:29:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.448+0000 7f8b64ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-23T18:29:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.448+0000 7f8b64ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-23T18:29:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.448+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(72 notify.3 [notify cookie 94285724297824 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c7408a040 con 0x55c09b1627c0 2024-04-23T18:29:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.448+0000 7f8b64ff9640 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8b44003ea0 con 0x55c09b1627c0 2024-04-23T18:29:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.449+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== watch-notify(notify_complete (2) cookie 94285724297824 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c09b118ae0 con 0x55c09b1627c0 2024-04-23T18:29:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.449+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7408a040 con 0x55c09b1627c0 2024-04-23T18:29:30.451 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.449+0000 7f8b377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.449+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94285724063648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b159fd0 con 0x55c09b15ddd0 2024-04-23T18:29:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.450+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94285724063648] v32'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.450+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94285724038128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1717a0 con 0x55c09b1627c0 2024-04-23T18:29:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.452+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94285724038128] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7408a040 con 0x55c09b1627c0 2024-04-23T18:29:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.452+0000 7f8c85725800 20 remove_watcher() i=0 2024-04-23T18:29:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.452+0000 7f8c85725800 2 removed watcher, disabling cache 2024-04-23T18:29:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.452+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94285724040960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1717a0 con 0x55c09b15ddd0 2024-04-23T18:29:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.453+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94285724040960] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.453+0000 7f8c85725800 20 remove_watcher() i=1 2024-04-23T18:29:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.453+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94285724043088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b1717a0 con 0x55c09b167170 2024-04-23T18:29:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.454+0000 7f8c80cb6640 1 -- 172.21.15.119:0/1425490533 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94285724043088] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c78081070 con 0x55c09b167170 2024-04-23T18:29:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.454+0000 7f8c85725800 20 remove_watcher() i=2 2024-04-23T18:29:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.454+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94285724047952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16c750 con 0x55c09b1627c0 2024-04-23T18:29:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.456+0000 7f8c814b7640 1 -- 172.21.15.119:0/1425490533 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94285724047952] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7408a040 con 0x55c09b1627c0 2024-04-23T18:29:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.456+0000 7f8c85725800 20 remove_watcher() i=3 2024-04-23T18:29:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.456+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94285724053856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16c750 con 0x55c09b15ddd0 2024-04-23T18:29:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.459+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94285724053856] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x55c09b15ddd0 2024-04-23T18:29:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.459+0000 7f8c85725800 20 remove_watcher() i=4 2024-04-23T18:29:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.459+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94285724051728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16f160 con 0x7f8c74073020 2024-04-23T18:29:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.460+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94285724051728] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.460+0000 7f8c85725800 20 remove_watcher() i=5 2024-04-23T18:29:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.460+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94285724057936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b16c750 con 0x7f8c74073020 2024-04-23T18:29:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.463+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94285724057936] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.463+0000 7f8c85725800 20 remove_watcher() i=6 2024-04-23T18:29:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.463+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94285724062592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c09b170150 con 0x7f8c74073020 2024-04-23T18:29:30.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.463+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94285724062592] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c7c040040 con 0x7f8c74073020 2024-04-23T18:29:30.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 20 remove_watcher() i=7 2024-04-23T18:29:30.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8c74073020 msgr2=0x7f8c7403d260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8c74073020 0x7f8c7403d260 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c09b15ddd0 msgr2=0x55c09b160290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c09b15ddd0 0x55c09b160290 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c09b1627c0 msgr2=0x55c09b164bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c09b1627c0 0x55c09b164bb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c09b167170 msgr2=0x55c09b169630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c09b167170 0x55c09b169630 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b4c036e60 msgr2=0x7f8b4c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b4c036e60 0x7f8b4c039320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8c78055040 tx=0x7f8c7804f000 comp rx=0 tx=0).stop 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 msgr2=0x55c09b152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c81cb8640 1 -- 172.21.15.119:0/1425490533 reap_dead start 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 0x55c09b152650 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8c7401a6a0 tx=0x7f8c74030f80 comp rx=0 tx=0).stop 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 shutdown_connections 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 --2- 172.21.15.119:0/1425490533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b14b290 0x55c09b152650 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 >> 172.21.15.119:0/1425490533 conn(0x55c09b1475b0 msgr2=0x55c09b144c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 shutdown_connections 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/1425490533 wait complete. 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/2523494543 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b5c036e60 msgr2=0x7f8b5c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 --2- 172.21.15.119:0/2523494543 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b5c036e60 0x7f8b5c039320 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55c09b11a4f0 tx=0x7f8c78005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/2523494543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b13e3a0 msgr2=0x55c09b13e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 --2- 172.21.15.119:0/2523494543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b13e3a0 0x55c09b13e7c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c7404b2b0 tx=0x7f8c7400db20 comp rx=0 tx=0).stop 2024-04-23T18:29:30.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/2523494543 shutdown_connections 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 --2- 172.21.15.119:0/2523494543 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b5c036e60 0x7f8b5c039320 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 --2- 172.21.15.119:0/2523494543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b13e3a0 0x55c09b13e7c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/2523494543 >> 172.21.15.119:0/2523494543 conn(0x55c09b132440 msgr2=0x55c09b132840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/2523494543 shutdown_connections 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.464+0000 7f8c85725800 1 -- 172.21.15.119:0/2523494543 wait complete. 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c09b12d370 msgr2=0x55c09b12f7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c09b12d370 0x55c09b12f7e0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c09b028290 msgr2=0x55c09b126d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c09b028290 0x55c09b126d30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c09b129480 msgr2=0x55c09b12b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c09b129480 0x55c09b12b870 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b68036e60 msgr2=0x7f8b68039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8b68036e60 0x7f8b68039320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8c78054000 tx=0x7f8c7804e000 comp rx=0 tx=0).stop 2024-04-23T18:29:30.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b023e00 msgr2=0x55c09b119ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 --2- 172.21.15.119:0/3333860233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c09b023e00 0x55c09b119ed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55c09b115c60 tx=0x7f8c74000bc0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c81cb8640 1 -- 172.21.15.119:0/3333860233 reap_dead start 2024-04-23T18:29:30.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 shutdown_connections 2024-04-23T18:29:30.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 >> 172.21.15.119:0/3333860233 conn(0x55c09b01f3c0 msgr2=0x55c09b10f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 shutdown_connections 2024-04-23T18:29:30.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.465+0000 7f8c85725800 1 -- 172.21.15.119:0/3333860233 wait complete. 2024-04-23T18:29:30.465 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:30.465 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-23T18:29:30.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-23T18:29:30.466 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-04-23T18:29:30.513 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:30.514 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:30.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.521+0000 7f5780c13800 1 Processor -- start 2024-04-23T18:29:30.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.521+0000 7f5780c13800 1 -- start start 2024-04-23T18:29:30.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.521+0000 7f5780c13800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56104a513890 0x56104a513cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.521+0000 7f5780c13800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56104a3c5560 con 0x56104a5141f0 2024-04-23T18:29:30.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.521+0000 7f5780c13800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x56104a3b6e20 con 0x56104a513890 2024-04-23T18:29:30.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.522+0000 7f577c26e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56104a513890 0x56104a513cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.522+0000 7f5773a6d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x56104a5141f0 0x56104a5146a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40492/0 (socket says 172.21.15.119:40492) 2024-04-23T18:29:30.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.522+0000 7f5773a6d640 1 -- 172.21.15.119:0/2749465532 learned_addr learned my addr 172.21.15.119:0/2749465532 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:30.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.522+0000 7f577ba6d640 1 -- 172.21.15.119:0/2749465532 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084147076 0 0) 0x56104a3c5560 con 0x56104a5141f0 2024-04-23T18:29:30.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.522+0000 7f577ba6d640 1 -- 172.21.15.119:0/2749465532 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5768001e10 con 0x56104a5141f0 2024-04-23T18:29:30.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.522+0000 7f577c26e640 1 -- 172.21.15.119:0/2749465532 >> v1:172.21.15.62:6789/0 conn(0x56104a5141f0 legacy=0x56104a5146a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.522+0000 7f577c26e640 1 -- 172.21.15.119:0/2749465532 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56104a3c4e60 con 0x56104a513890 2024-04-23T18:29:30.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.524+0000 7f577c26e640 1 --2- 172.21.15.119:0/2749465532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a513cb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f576c00a470 tx=0x7f576c01cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db939f3c032aa9d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.527+0000 7f577ba6d640 1 -- 172.21.15.119:0/2749465532 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c057070 con 0x56104a513890 2024-04-23T18:29:30.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.527+0000 7f577ba6d640 1 -- 172.21.15.119:0/2749465532 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c04acd0 con 0x56104a513890 2024-04-23T18:29:30.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.527+0000 7f577ba6d640 1 -- 172.21.15.119:0/2749465532 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c052440 con 0x56104a513890 2024-04-23T18:29:30.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.527+0000 7f5780c13800 1 -- 172.21.15.119:0/2749465532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 msgr2=0x56104a513cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.527+0000 7f5780c13800 1 --2- 172.21.15.119:0/2749465532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a513cb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f576c00a470 tx=0x7f576c01cdb0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.527+0000 7f5780c13800 1 -- 172.21.15.119:0/2749465532 shutdown_connections 2024-04-23T18:29:30.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.527+0000 7f5780c13800 1 --2- 172.21.15.119:0/2749465532 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a513cb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.527+0000 7f5780c13800 1 -- 172.21.15.119:0/2749465532 >> 172.21.15.119:0/2749465532 conn(0x56104a50f430 msgr2=0x56104a511850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.527+0000 7f5780c13800 1 -- 172.21.15.119:0/2749465532 shutdown_connections 2024-04-23T18:29:30.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.527+0000 7f5780c13800 1 -- 172.21.15.119:0/2749465532 wait complete. 2024-04-23T18:29:30.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.539+0000 7f5780c13800 1 Processor -- start 2024-04-23T18:29:30.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.539+0000 7f5780c13800 1 -- start start 2024-04-23T18:29:30.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.539+0000 7f5780c13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a6082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.539+0000 7f5780c13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56104a4605d0 con 0x56104a513890 2024-04-23T18:29:30.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.540+0000 7f577c26e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a6082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.540+0000 7f577c26e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a6082c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60436/0 (socket says 172.21.15.119:60436) 2024-04-23T18:29:30.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.540+0000 7f577c26e640 1 -- 172.21.15.119:0/3516217799 learned_addr learned my addr 172.21.15.119:0/3516217799 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.540+0000 7f577c26e640 1 -- 172.21.15.119:0/3516217799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56104a3d6860 con 0x56104a513890 2024-04-23T18:29:30.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.540+0000 7f577c26e640 1 --2- 172.21.15.119:0/3516217799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a6082c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f576c01baa0 tx=0x7f576c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c84f6ece8dcc8a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.540+0000 7f566a60c640 1 -- 172.21.15.119:0/3516217799 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c057030 con 0x56104a513890 2024-04-23T18:29:30.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.540+0000 7f566a60c640 1 -- 172.21.15.119:0/3516217799 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c062070 con 0x56104a513890 2024-04-23T18:29:30.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.540+0000 7f566a60c640 1 -- 172.21.15.119:0/3516217799 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c052440 con 0x56104a513890 2024-04-23T18:29:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.541+0000 7f5780c13800 1 -- 172.21.15.119:0/3516217799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 msgr2=0x56104a6082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.541+0000 7f5780c13800 1 --2- 172.21.15.119:0/3516217799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a6082c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f576c01baa0 tx=0x7f576c04c000 comp rx=0 tx=0).stop 2024-04-23T18:29:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.541+0000 7f5780c13800 1 -- 172.21.15.119:0/3516217799 shutdown_connections 2024-04-23T18:29:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.541+0000 7f5780c13800 1 --2- 172.21.15.119:0/3516217799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a6082c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.541+0000 7f5780c13800 1 -- 172.21.15.119:0/3516217799 >> 172.21.15.119:0/3516217799 conn(0x56104a50f430 msgr2=0x56104a603be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.541+0000 7f5780c13800 1 -- 172.21.15.119:0/3516217799 shutdown_connections 2024-04-23T18:29:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.541+0000 7f5780c13800 1 -- 172.21.15.119:0/3516217799 wait complete. 2024-04-23T18:29:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.541+0000 7f5780c13800 1 Processor -- start 2024-04-23T18:29:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.542+0000 7f5780c13800 1 -- start start 2024-04-23T18:29:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.542+0000 7f5780c13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a60fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.542+0000 7f5780c13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56104a515050 con 0x56104a513890 2024-04-23T18:29:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.542+0000 7f577c26e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a60fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.542+0000 7f577c26e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a60fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60450/0 (socket says 172.21.15.119:60450) 2024-04-23T18:29:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.542+0000 7f577c26e640 1 -- 172.21.15.119:0/3966818134 learned_addr learned my addr 172.21.15.119:0/3966818134 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.542+0000 7f577c26e640 1 -- 172.21.15.119:0/3966818134 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56104a3d4eb0 con 0x56104a513890 2024-04-23T18:29:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.542+0000 7f577c26e640 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a60fae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f576c01baa0 tx=0x7f576c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.543+0000 7f5668e09640 1 -- 172.21.15.119:0/3966818134 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c052820 con 0x56104a513890 2024-04-23T18:29:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.543+0000 7f5668e09640 1 -- 172.21.15.119:0/3966818134 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c058040 con 0x56104a513890 2024-04-23T18:29:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.543+0000 7f5668e09640 1 -- 172.21.15.119:0/3966818134 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c052af0 con 0x56104a513890 2024-04-23T18:29:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.543+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56104a610020 con 0x56104a513890 2024-04-23T18:29:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.543+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56104a6104e0 con 0x56104a513890 2024-04-23T18:29:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.543+0000 7f5668e09640 1 -- 172.21.15.119:0/3966818134 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f576c052c90 con 0x56104a513890 2024-04-23T18:29:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.544+0000 7f5668e09640 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5664036eb0 0x7f5664039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.544+0000 7f5668e09640 1 -- 172.21.15.119:0/3966818134 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f576c08e320 con 0x56104a513890 2024-04-23T18:29:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.544+0000 7f5773a6d640 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5664036eb0 0x7f5664039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.544+0000 7f5780c13800 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56104a5141f0 0x56104a616b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.544+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a6170d0 con 0x56104a5141f0 2024-04-23T18:29:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.544+0000 7f577ca6f640 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56104a5141f0 0x56104a616b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.544+0000 7f5773a6d640 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5664036eb0 0x7f5664039370 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5764000f60 tx=0x7f57640010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.544+0000 7f577ca6f640 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56104a5141f0 0x56104a616b00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.544+0000 7f577ca6f640 1 -- 172.21.15.119:0/3966818134 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a5141f0 2024-04-23T18:29:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.545+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a6140b0 con 0x56104a5141f0 2024-04-23T18:29:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.545+0000 7f577ca6f640 1 -- 172.21.15.119:0/3966818134 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a5141f0 2024-04-23T18:29:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.545+0000 7f5780c13800 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56104a6193e0 0x56104a61b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.545+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a61be70 con 0x56104a6193e0 2024-04-23T18:29:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.545+0000 7f577c26e640 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56104a6193e0 0x56104a61b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.545+0000 7f577c26e640 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56104a6193e0 0x56104a61b7d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.545+0000 7f577c26e640 1 -- 172.21.15.119:0/3966818134 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f576c05dcc0 con 0x56104a6193e0 2024-04-23T18:29:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.545+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a618390 con 0x56104a5141f0 2024-04-23T18:29:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.546+0000 7f577ca6f640 1 -- 172.21.15.119:0/3966818134 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a5141f0 2024-04-23T18:29:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.546+0000 7f5780c13800 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56104a61d320 0x56104a61f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.546+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a61fef0 con 0x56104a61d320 2024-04-23T18:29:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.546+0000 7f5773a6d640 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56104a61d320 0x56104a61f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.546+0000 7f5773a6d640 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56104a61d320 0x56104a61f790 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.547+0000 7f5773a6d640 1 -- 172.21.15.119:0/3966818134 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5764009050 con 0x56104a61d320 2024-04-23T18:29:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.547+0000 7f5780c13800 1 Processor -- start 2024-04-23T18:29:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.547+0000 7f5780c13800 1 -- start start 2024-04-23T18:29:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.547+0000 7f5780c13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a62e320 0x56104a62e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.547+0000 7f5780c13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56104a406df0 con 0x56104a62e320 2024-04-23T18:29:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.547+0000 7f577c26e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a62e320 0x56104a62e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.547+0000 7f577c26e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a62e320 0x56104a62e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60466/0 (socket says 172.21.15.119:60466) 2024-04-23T18:29:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.547+0000 7f577c26e640 1 -- 172.21.15.119:0/2593621671 learned_addr learned my addr 172.21.15.119:0/2593621671 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.548+0000 7f577c26e640 1 -- 172.21.15.119:0/2593621671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56104a62ec80 con 0x56104a62e320 2024-04-23T18:29:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.548+0000 7f577c26e640 1 --2- 172.21.15.119:0/2593621671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a62e320 0x56104a62e740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f576c08c790 tx=0x7f576c06f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.548+0000 7f5661ffb640 1 -- 172.21.15.119:0/2593621671 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c08b1c0 con 0x56104a62e320 2024-04-23T18:29:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.548+0000 7f5661ffb640 1 -- 172.21.15.119:0/2593621671 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c08b360 con 0x56104a62e320 2024-04-23T18:29:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.548+0000 7f5661ffb640 1 -- 172.21.15.119:0/2593621671 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c068ca0 con 0x56104a62e320 2024-04-23T18:29:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.548+0000 7f5780c13800 1 -- 172.21.15.119:0/2593621671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56104a62f6f0 con 0x56104a62e320 2024-04-23T18:29:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.548+0000 7f5780c13800 1 -- 172.21.15.119:0/2593621671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56104a62fbf0 con 0x56104a62e320 2024-04-23T18:29:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.549+0000 7f5661ffb640 1 -- 172.21.15.119:0/2593621671 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f576c05d420 con 0x56104a62e320 2024-04-23T18:29:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.549+0000 7f5661ffb640 1 --2- 172.21.15.119:0/2593621671 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5654036eb0 0x7f5654039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.549+0000 7f5661ffb640 1 -- 172.21.15.119:0/2593621671 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f576c07a050 con 0x56104a62e320 2024-04-23T18:29:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.549+0000 7f5773a6d640 1 --2- 172.21.15.119:0/2593621671 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5654036eb0 0x7f5654039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.549+0000 7f5780c13800 1 Processor -- start 2024-04-23T18:29:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.549+0000 7f5780c13800 1 -- start start 2024-04-23T18:29:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.549+0000 7f5773a6d640 1 --2- 172.21.15.119:0/2593621671 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5654036eb0 0x7f5654039370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f576400bf90 tx=0x7f576400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.549+0000 7f5780c13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 0x56104a63b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.549+0000 7f5780c13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56104a608980 con 0x56104a63b4d0 2024-04-23T18:29:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.550+0000 7f577c26e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 0x56104a63b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.550+0000 7f577c26e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 0x56104a63b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60478/0 (socket says 172.21.15.119:60478) 2024-04-23T18:29:30.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.550+0000 7f577c26e640 1 -- 172.21.15.119:0/120939676 learned_addr learned my addr 172.21.15.119:0/120939676 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.550+0000 7f577c26e640 1 -- 172.21.15.119:0/120939676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56104a63bec0 con 0x56104a63b4d0 2024-04-23T18:29:30.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.550+0000 7f577c26e640 1 --2- 172.21.15.119:0/120939676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 0x56104a63b8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f576c068f90 tx=0x7f576c087730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18906d07818ab584 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.550+0000 7f56537fe640 1 -- 172.21.15.119:0/120939676 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c067dc0 con 0x56104a63b4d0 2024-04-23T18:29:30.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.550+0000 7f56537fe640 1 -- 172.21.15.119:0/120939676 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c071030 con 0x56104a63b4d0 2024-04-23T18:29:30.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.550+0000 7f56537fe640 1 -- 172.21.15.119:0/120939676 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c097440 con 0x56104a63b4d0 2024-04-23T18:29:30.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f5780c13800 1 -- 172.21.15.119:0/120939676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 msgr2=0x56104a63b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f5780c13800 1 --2- 172.21.15.119:0/120939676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 0x56104a63b8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f576c068f90 tx=0x7f576c087730 comp rx=0 tx=0).stop 2024-04-23T18:29:30.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f5780c13800 1 -- 172.21.15.119:0/120939676 shutdown_connections 2024-04-23T18:29:30.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f5780c13800 1 --2- 172.21.15.119:0/120939676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 0x56104a63b8f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f5780c13800 1 -- 172.21.15.119:0/120939676 >> 172.21.15.119:0/120939676 conn(0x56104a6377f0 msgr2=0x56104a635850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f5780c13800 1 -- 172.21.15.119:0/120939676 shutdown_connections 2024-04-23T18:29:30.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f5780c13800 1 -- 172.21.15.119:0/120939676 wait complete. 2024-04-23T18:29:30.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f5780c13800 1 Processor -- start 2024-04-23T18:29:30.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f5780c13800 1 -- start start 2024-04-23T18:29:30.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f5780c13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 0x56104a6428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f5780c13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56104a63c5e0 con 0x56104a63b4d0 2024-04-23T18:29:30.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f577c26e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 0x56104a6428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f577c26e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 0x56104a6428c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60490/0 (socket says 172.21.15.119:60490) 2024-04-23T18:29:30.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 learned_addr learned my addr 172.21.15.119:0/679702189 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.551+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56104a642e00 con 0x56104a63b4d0 2024-04-23T18:29:30.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.552+0000 7f577c26e640 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 0x56104a6428c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f576c068f90 tx=0x7f576c064f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.552+0000 7f5651ffb640 1 -- 172.21.15.119:0/679702189 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c071550 con 0x56104a63b4d0 2024-04-23T18:29:30.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.552+0000 7f5651ffb640 1 -- 172.21.15.119:0/679702189 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c0ab070 con 0x56104a63b4d0 2024-04-23T18:29:30.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.552+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56104a642e00 con 0x56104a63b4d0 2024-04-23T18:29:30.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.552+0000 7f5651ffb640 1 -- 172.21.15.119:0/679702189 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c05d840 con 0x56104a63b4d0 2024-04-23T18:29:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.552+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56104a642e00 con 0x56104a63b4d0 2024-04-23T18:29:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.553+0000 7f5651ffb640 1 -- 172.21.15.119:0/679702189 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f576c0b8060 con 0x56104a63b4d0 2024-04-23T18:29:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.553+0000 7f5651ffb640 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5644036eb0 0x7f5644039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.553+0000 7f5651ffb640 1 -- 172.21.15.119:0/679702189 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f576c071e00 con 0x56104a63b4d0 2024-04-23T18:29:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.553+0000 7f5773a6d640 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5644036eb0 0x7f5644039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.553+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.553+0000 7f5780c13800 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56104a64ded0 0x56104a650390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.553+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a650ae0 con 0x56104a64ded0 2024-04-23T18:29:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.553+0000 7f5773a6d640 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5644036eb0 0x7f5644039370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x56104a613ff0 tx=0x7f5764010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.553+0000 7f577ca6f640 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56104a64ded0 0x56104a650390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.554+0000 7f577ca6f640 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56104a64ded0 0x56104a650390 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.554+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a64ded0 2024-04-23T18:29:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.554+0000 7f5780c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.554+0000 7f5780c13800 20 realm 2024-04-23T18:29:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.554+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.554+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a650ef0 con 0x56104a64ded0 2024-04-23T18:29:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a64ded0 2024-04-23T18:29:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f5780c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f5780c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a6517c0 con 0x56104a64ded0 2024-04-23T18:29:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a64ded0 2024-04-23T18:29:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f5780c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a64ded0 2024-04-23T18:29:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a64ded0 2024-04-23T18:29:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f5780c13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f5780c13800 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56104a6528c0 0x56104a654cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a6552c0 con 0x56104a6528c0 2024-04-23T18:29:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f577c26e640 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56104a6528c0 0x56104a654cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.555+0000 7f577c26e640 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56104a6528c0 0x56104a654cb0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.556+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f576c094020 con 0x56104a6528c0 2024-04-23T18:29:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.556+0000 7f5780c13800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.556+0000 7f5780c13800 20 searching for the correct realm 2024-04-23T18:29:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.556+0000 7f5780c13800 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56104a6571e0 0x56104a6596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.556+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a659d20 con 0x56104a6571e0 2024-04-23T18:29:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.556+0000 7f5773a6d640 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56104a6571e0 0x56104a6596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.556+0000 7f5773a6d640 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56104a6571e0 0x56104a6596a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.556+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.556+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a659d20 con 0x56104a6528c0 2024-04-23T18:29:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.557+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576c094020 con 0x56104a6528c0 2024-04-23T18:29:30.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.557+0000 7f577c26e640 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f576c060900 0x7f576c0663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.557+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a659d20 con 0x7f576c060900 2024-04-23T18:29:30.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.557+0000 7f577ca6f640 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f576c060900 0x7f576c0663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.557+0000 7f577ca6f640 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f576c060900 0x7f576c0663f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.558+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577400a4a0 con 0x7f576c060900 2024-04-23T18:29:30.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.558+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a64ded0 2024-04-23T18:29:30.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.558+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a64ded0 2024-04-23T18:29:30.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.558+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a64ded0 2024-04-23T18:29:30.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.558+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a64ded0 2024-04-23T18:29:30.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.558+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x7f576c060900 2024-04-23T18:29:30.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.558+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577400a4a0 con 0x7f576c060900 2024-04-23T18:29:30.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.558+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x7f576c060900 2024-04-23T18:29:30.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.559+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f577400a4a0 con 0x7f576c060900 2024-04-23T18:29:30.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.559+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a6528c0 2024-04-23T18:29:30.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.559+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576c094020 con 0x56104a6528c0 2024-04-23T18:29:30.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.559+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a6571e0 2024-04-23T18:29:30.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.559+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.559+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a64ded0 2024-04-23T18:29:30.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.560+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a64ded0 2024-04-23T18:29:30.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.560+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x7f576c060900 2024-04-23T18:29:30.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.560+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577400a4a0 con 0x7f576c060900 2024-04-23T18:29:30.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.560+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a64ded0 2024-04-23T18:29:30.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.560+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a64ded0 2024-04-23T18:29:30.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.560+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a6528c0 2024-04-23T18:29:30.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.560+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f576c094020 con 0x56104a6528c0 2024-04-23T18:29:30.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.560+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a6571e0 2024-04-23T18:29:30.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.560+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.560+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a6571e0 2024-04-23T18:29:30.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.561+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.561+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x7f576c060900 2024-04-23T18:29:30.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.561+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577400a4a0 con 0x7f576c060900 2024-04-23T18:29:30.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.561+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a6571e0 2024-04-23T18:29:30.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.561+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.561+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a6571e0 2024-04-23T18:29:30.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.561+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.561+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a64ded0 2024-04-23T18:29:30.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.562+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a64ded0 2024-04-23T18:29:30.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.562+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a64ded0 2024-04-23T18:29:30.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.562+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a64ded0 2024-04-23T18:29:30.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.562+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x7f576c060900 2024-04-23T18:29:30.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.562+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577400a4a0 con 0x7f576c060900 2024-04-23T18:29:30.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.562+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a6571e0 2024-04-23T18:29:30.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.562+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.562+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a6528c0 2024-04-23T18:29:30.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.563+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f576c094020 con 0x56104a6528c0 2024-04-23T18:29:30.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.563+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a64ded0 2024-04-23T18:29:30.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.563+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577400a4a0 con 0x56104a64ded0 2024-04-23T18:29:30.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.563+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x7f576c060900 2024-04-23T18:29:30.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.563+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577400a4a0 con 0x7f576c060900 2024-04-23T18:29:30.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.563+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a6571e0 2024-04-23T18:29:30.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.563+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.563+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x7f576c060900 2024-04-23T18:29:30.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.564+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f577400a4a0 con 0x7f576c060900 2024-04-23T18:29:30.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.564+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a6528c0 2024-04-23T18:29:30.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.564+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576c094020 con 0x56104a6528c0 2024-04-23T18:29:30.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.564+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a6571e0 2024-04-23T18:29:30.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.564+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.564+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x7f576c060900 2024-04-23T18:29:30.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5774040040 con 0x7f576c060900 2024-04-23T18:29:30.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a64ded0 2024-04-23T18:29:30.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56104a651b60 con 0x56104a6528c0 2024-04-23T18:29:30.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f576c0c9040 con 0x56104a6528c0 2024-04-23T18:29:30.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f5780c13800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:30.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f5780c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:30.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f5780c13800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:30.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f5780c13800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:30.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f5780c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:30.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f5780c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:30.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a655b10 con 0x56104a64ded0 2024-04-23T18:29:30.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f5780c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.565+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a655b10 con 0x56104a64ded0 2024-04-23T18:29:30.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:30.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a655b10 con 0x7f576c060900 2024-04-23T18:29:30.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5774040040 con 0x7f576c060900 2024-04-23T18:29:30.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:30.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 20 zone default found 2024-04-23T18:29:30.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 4 Realm: () 2024-04-23T18:29:30.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:30.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:30.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:30.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 20 zonegroup default 2024-04-23T18:29:30.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a656440 con 0x7f576c060900 2024-04-23T18:29:30.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5774040040 con 0x7f576c060900 2024-04-23T18:29:30.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.566+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a656440 con 0x56104a6571e0 2024-04-23T18:29:30.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.567+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.567+0000 7f5780c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.567+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.567+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a65bb80 con 0x56104a6571e0 2024-04-23T18:29:30.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.567+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.567+0000 7f5780c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.567+0000 7f5780c13800 20 started sync module instance, tier type = 2024-04-23T18:29:30.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.567+0000 7f5780c13800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:30.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.567+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a65b020 con 0x56104a6528c0 2024-04-23T18:29:30.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.568+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576c0c9040 con 0x56104a6528c0 2024-04-23T18:29:30.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.568+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94627967644688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a65ac80 con 0x56104a6528c0 2024-04-23T18:29:30.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.568+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a65c9f0 con 0x56104a64ded0 2024-04-23T18:29:30.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.571+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.571+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94627967644688] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576c0c9040 con 0x56104a6528c0 2024-04-23T18:29:30.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.571+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94627967649568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a65d1b0 con 0x56104a64ded0 2024-04-23T18:29:30.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.571+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a65bf60 con 0x56104a6571e0 2024-04-23T18:29:30.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.573+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.573+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94627967653792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a65e070 con 0x56104a6571e0 2024-04-23T18:29:30.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.573+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94627967649568] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.573+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a65eae0 con 0x56104a6528c0 2024-04-23T18:29:30.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.574+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576c0c9040 con 0x56104a6528c0 2024-04-23T18:29:30.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.574+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94627967650816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a65f380 con 0x56104a6528c0 2024-04-23T18:29:30.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.574+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a65fd40 con 0x56104a64ded0 2024-04-23T18:29:30.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.575+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94627967653792] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.612 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-04-23T18:29:30.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.577+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.577+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94627967654848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a65fd40 con 0x56104a64ded0 2024-04-23T18:29:30.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.577+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a660700 con 0x7f576c060900 2024-04-23T18:29:30.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.581+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94627967650816] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576c0c9040 con 0x56104a6528c0 2024-04-23T18:29:30.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.581+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x7f576c060900 2024-04-23T18:29:30.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.581+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94627967659728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a660700 con 0x7f576c060900 2024-04-23T18:29:30.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.581+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a661110 con 0x7f576c060900 2024-04-23T18:29:30.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.584+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94627967654848] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.584+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94627967659728] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x7f576c060900 2024-04-23T18:29:30.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.587+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x7f576c060900 2024-04-23T18:29:30.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.588+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94627967664720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a660c60 con 0x7f576c060900 2024-04-23T18:29:30.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.588+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a661620 con 0x7f576c060900 2024-04-23T18:29:30.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.589+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94627967664720] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x7f576c060900 2024-04-23T18:29:30.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.589+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x7f576c060900 2024-04-23T18:29:30.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.589+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94627967662224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a661620 con 0x7f576c060900 2024-04-23T18:29:30.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.589+0000 7f5780c13800 20 add_watcher() i=0 2024-04-23T18:29:30.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.589+0000 7f5780c13800 20 add_watcher() i=1 2024-04-23T18:29:30.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.589+0000 7f5780c13800 20 add_watcher() i=2 2024-04-23T18:29:30.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.589+0000 7f5780c13800 20 add_watcher() i=3 2024-04-23T18:29:30.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.589+0000 7f5780c13800 20 add_watcher() i=4 2024-04-23T18:29:30.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.589+0000 7f5780c13800 20 add_watcher() i=5 2024-04-23T18:29:30.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.589+0000 7f5780c13800 20 add_watcher() i=6 2024-04-23T18:29:30.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.591+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94627967662224] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x7f576c060900 2024-04-23T18:29:30.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.591+0000 7f5780c13800 20 add_watcher() i=7 2024-04-23T18:29:30.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.591+0000 7f5780c13800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:30.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.591+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a664980 con 0x56104a64ded0 2024-04-23T18:29:30.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.592+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.592+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94627967681408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a661790 con 0x56104a64ded0 2024-04-23T18:29:30.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.593+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94627967681408] v32'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.593+0000 7f56327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:30.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.593+0000 7f5780c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:30.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.593+0000 7f5780c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:30.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.593+0000 7f5780c13800 5 note: GC not initialized 2024-04-23T18:29:30.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.593+0000 7f56317e2640 20 reqs_thread_entry: start 2024-04-23T18:29:30.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.593+0000 7f5780c13800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:30.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.593+0000 7f5780c13800 20 Filter name: none 2024-04-23T18:29:30.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.593+0000 7f55a2ffd640 20 reqs_thread_entry: start 2024-04-23T18:29:30.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.593+0000 7f5780c13800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-23T18:29:30.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.593+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.593+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a698080 con 0x7f576c060900 2024-04-23T18:29:30.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5774040040 con 0x7f576c060900 2024-04-23T18:29:30.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f5780c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f5780c13800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-23T18:29:30.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f5780c13800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-23T18:29:30.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f5780c13800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-23T18:29:30.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a6966c0 con 0x56104a64ded0 2024-04-23T18:29:30.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f5780c13800 20 rados_obj.operate() r=0 bl.length=7 2024-04-23T18:29:30.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f5780c13800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-04-23T18:29:30.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f5780c13800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-23T18:29:30.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f5780c13800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:30.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f5780c13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.594+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56104a696ab0 con 0x56104a64ded0 2024-04-23T18:29:30.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.595+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.595+0000 7f5780c13800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:30.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.595+0000 7f5780c13800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:30.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.595+0000 7f5780c13800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:30.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.595+0000 7f5780c13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:30.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.595+0000 7f5780c13800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-04-23T18:29:30.618 INFO:teuthology.orchestra.run.smithi119.stderr:could not create user: 2024-04-23T18:29:30.595+0000 7f5780c13800 20 get_user_info_from_index found 0 xattrs 2024-04-23T18:29:30.618 INFO:teuthology.orchestra.run.smithi119.stderr:unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-04-23T18:29:30.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.595+0000 7f56327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:30.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.595+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94627967681408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a64afd0 con 0x56104a64ded0 2024-04-23T18:29:30.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.596+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94627967681408] v32'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.596+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94627967644688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a664380 con 0x56104a6528c0 2024-04-23T18:29:30.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.597+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94627967644688] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576c0c9040 con 0x56104a6528c0 2024-04-23T18:29:30.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.597+0000 7f5780c13800 20 remove_watcher() i=0 2024-04-23T18:29:30.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.597+0000 7f5780c13800 2 removed watcher, disabling cache 2024-04-23T18:29:30.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.597+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94627967649568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a664380 con 0x56104a64ded0 2024-04-23T18:29:30.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.599+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94627967649568] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.599+0000 7f5780c13800 20 remove_watcher() i=1 2024-04-23T18:29:30.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.599+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94627967653792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a65c720 con 0x56104a6571e0 2024-04-23T18:29:30.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.600+0000 7f5773a6d640 1 -- 172.21.15.119:0/679702189 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94627967653792] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5764009050 con 0x56104a6571e0 2024-04-23T18:29:30.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.600+0000 7f5780c13800 20 remove_watcher() i=2 2024-04-23T18:29:30.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.600+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94627967650816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a664380 con 0x56104a6528c0 2024-04-23T18:29:30.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.602+0000 7f577c26e640 1 -- 172.21.15.119:0/679702189 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94627967650816] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f576c0c9040 con 0x56104a6528c0 2024-04-23T18:29:30.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.602+0000 7f5780c13800 20 remove_watcher() i=3 2024-04-23T18:29:30.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.602+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94627967654848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a65d7a0 con 0x56104a64ded0 2024-04-23T18:29:30.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.604+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94627967654848] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x56104a64ded0 2024-04-23T18:29:30.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.604+0000 7f5780c13800 20 remove_watcher() i=4 2024-04-23T18:29:30.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.604+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94627967659728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a664380 con 0x7f576c060900 2024-04-23T18:29:30.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.606+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94627967659728] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x7f576c060900 2024-04-23T18:29:30.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.606+0000 7f5780c13800 20 remove_watcher() i=5 2024-04-23T18:29:30.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.606+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94627967664720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a65eed0 con 0x7f576c060900 2024-04-23T18:29:30.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.608+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94627967664720] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x7f576c060900 2024-04-23T18:29:30.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.608+0000 7f5780c13800 20 remove_watcher() i=6 2024-04-23T18:29:30.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.608+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94627967662224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56104a664380 con 0x7f576c060900 2024-04-23T18:29:30.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94627967662224] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5774040040 con 0x7f576c060900 2024-04-23T18:29:30.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 20 remove_watcher() i=7 2024-04-23T18:29:30.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f576c060900 msgr2=0x7f576c0663f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f576c060900 0x7f576c0663f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56104a64ded0 msgr2=0x56104a650390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56104a64ded0 0x56104a650390 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56104a6528c0 msgr2=0x56104a654cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56104a6528c0 0x56104a654cb0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56104a6571e0 msgr2=0x56104a6596a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56104a6571e0 0x56104a6596a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5644036eb0 msgr2=0x7f5644039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5644036eb0 0x7f5644039370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x56104a613ff0 tx=0x7f5764010000 comp rx=0 tx=0).stop 2024-04-23T18:29:30.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 msgr2=0x56104a6428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f577ca6f640 1 -- 172.21.15.119:0/679702189 reap_dead start 2024-04-23T18:29:30.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 0x56104a6428c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f576c068f90 tx=0x7f576c064f70 comp rx=0 tx=0).stop 2024-04-23T18:29:30.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 shutdown_connections 2024-04-23T18:29:30.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 --2- 172.21.15.119:0/679702189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a63b4d0 0x56104a6428c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.609+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 >> 172.21.15.119:0/679702189 conn(0x56104a6377f0 msgr2=0x56104a634e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 shutdown_connections 2024-04-23T18:29:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/679702189 wait complete. 2024-04-23T18:29:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/2593621671 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5654036eb0 msgr2=0x7f5654039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 --2- 172.21.15.119:0/2593621671 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5654036eb0 0x7f5654039370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f576400bf90 tx=0x7f576400f000 comp rx=0 tx=0).stop 2024-04-23T18:29:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/2593621671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a62e320 msgr2=0x56104a62e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 --2- 172.21.15.119:0/2593621671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a62e320 0x56104a62e740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f576c08c790 tx=0x7f576c06f870 comp rx=0 tx=0).stop 2024-04-23T18:29:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/2593621671 shutdown_connections 2024-04-23T18:29:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 --2- 172.21.15.119:0/2593621671 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5654036eb0 0x7f5654039370 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 --2- 172.21.15.119:0/2593621671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a62e320 0x56104a62e740 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/2593621671 >> 172.21.15.119:0/2593621671 conn(0x56104a6223c0 msgr2=0x56104a6227c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/2593621671 shutdown_connections 2024-04-23T18:29:30.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/2593621671 wait complete. 2024-04-23T18:29:30.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56104a61d320 msgr2=0x56104a61f790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56104a61d320 0x56104a61f790 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56104a5141f0 msgr2=0x56104a616b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56104a5141f0 0x56104a616b00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56104a6193e0 msgr2=0x56104a61b7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56104a6193e0 0x56104a61b7d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5664036eb0 msgr2=0x7f5664039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5664036eb0 0x7f5664039370 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5764000f60 tx=0x7f57640010a0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 msgr2=0x56104a60fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 --2- 172.21.15.119:0/3966818134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56104a513890 0x56104a60fae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f576c01baa0 tx=0x7f576c002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f577ca6f640 1 -- 172.21.15.119:0/3966818134 reap_dead start 2024-04-23T18:29:30.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 shutdown_connections 2024-04-23T18:29:30.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 >> 172.21.15.119:0/3966818134 conn(0x56104a50f430 msgr2=0x56104a6024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 shutdown_connections 2024-04-23T18:29:30.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.610+0000 7f5780c13800 1 -- 172.21.15.119:0/3966818134 wait complete. 2024-04-23T18:29:30.625 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-23T18:29:30.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-23T18:29:30.626 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-23T18:29:30.669 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:30.669 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:30.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.677+0000 7f37e6342800 1 Processor -- start 2024-04-23T18:29:30.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.677+0000 7f37e6342800 1 -- start start 2024-04-23T18:29:30.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.677+0000 7f37e6342800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564b203f1a60 0x564b203f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.677+0000 7f37e6342800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b202a1560 con 0x564b203f4390 2024-04-23T18:29:30.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.677+0000 7f37e6342800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x564b20292e20 con 0x564b203f1a60 2024-04-23T18:29:30.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.678+0000 7f37e3e41640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564b203f1a60 0x564b203f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.678+0000 7f37e3640640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x564b203f4390 0x564b203f6780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40494/0 (socket says 172.21.15.119:40494) 2024-04-23T18:29:30.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.678+0000 7f37e3640640 1 -- 172.21.15.119:0/1149067700 learned_addr learned my addr 172.21.15.119:0/1149067700 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:30.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.678+0000 7f37e3e41640 1 -- 172.21.15.119:0/1149067700 >> v1:172.21.15.62:6789/0 conn(0x564b203f4390 legacy=0x564b203f6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.678+0000 7f37e3e41640 1 -- 172.21.15.119:0/1149067700 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b202a0e60 con 0x564b203f1a60 2024-04-23T18:29:30.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.680+0000 7f37e3e41640 1 --2- 172.21.15.119:0/1149067700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b203f3e50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f37d800a470 tx=0x7f37d801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b251624d315a65 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.680+0000 7f37e2e3f640 1 -- 172.21.15.119:0/1149067700 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8057070 con 0x564b203f1a60 2024-04-23T18:29:30.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.680+0000 7f37e2e3f640 1 -- 172.21.15.119:0/1149067700 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8052570 con 0x564b203f1a60 2024-04-23T18:29:30.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.680+0000 7f37e2e3f640 1 -- 172.21.15.119:0/1149067700 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8052870 con 0x564b203f1a60 2024-04-23T18:29:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.680+0000 7f37e6342800 1 -- 172.21.15.119:0/1149067700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 msgr2=0x564b203f3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.680+0000 7f37e6342800 1 --2- 172.21.15.119:0/1149067700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b203f3e50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f37d800a470 tx=0x7f37d801ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.681+0000 7f37e6342800 1 -- 172.21.15.119:0/1149067700 shutdown_connections 2024-04-23T18:29:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.681+0000 7f37e6342800 1 --2- 172.21.15.119:0/1149067700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b203f3e50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.681+0000 7f37e6342800 1 -- 172.21.15.119:0/1149067700 >> 172.21.15.119:0/1149067700 conn(0x564b203eb410 msgr2=0x564b203ed830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.681+0000 7f37e6342800 1 -- 172.21.15.119:0/1149067700 shutdown_connections 2024-04-23T18:29:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.681+0000 7f37e6342800 1 -- 172.21.15.119:0/1149067700 wait complete. 2024-04-23T18:29:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.692+0000 7f37e6342800 1 Processor -- start 2024-04-23T18:29:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.692+0000 7f37e6342800 1 -- start start 2024-04-23T18:29:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.692+0000 7f37e6342800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b204e21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.692+0000 7f37e6342800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b2033c5b0 con 0x564b203f1a60 2024-04-23T18:29:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.693+0000 7f37e3e41640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b204e21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.693+0000 7f37e3e41640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b204e21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60512/0 (socket says 172.21.15.119:60512) 2024-04-23T18:29:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.693+0000 7f37e3e41640 1 -- 172.21.15.119:0/4089623139 learned_addr learned my addr 172.21.15.119:0/4089623139 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.693+0000 7f37e3e41640 1 -- 172.21.15.119:0/4089623139 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b202b2860 con 0x564b203f1a60 2024-04-23T18:29:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.693+0000 7f37e3e41640 1 --2- 172.21.15.119:0/4089623139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b204e21c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37d8055040 tx=0x7f37d804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21120c0bcb8fea2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.693+0000 7f36d1e0b640 1 -- 172.21.15.119:0/4089623139 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8057070 con 0x564b203f1a60 2024-04-23T18:29:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.693+0000 7f36d1e0b640 1 -- 172.21.15.119:0/4089623139 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8063070 con 0x564b203f1a60 2024-04-23T18:29:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.693+0000 7f36d1e0b640 1 -- 172.21.15.119:0/4089623139 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8052720 con 0x564b203f1a60 2024-04-23T18:29:30.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.694+0000 7f37e6342800 1 -- 172.21.15.119:0/4089623139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 msgr2=0x564b204e21c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.694+0000 7f37e6342800 1 --2- 172.21.15.119:0/4089623139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b204e21c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37d8055040 tx=0x7f37d804c000 comp rx=0 tx=0).stop 2024-04-23T18:29:30.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.694+0000 7f37e6342800 1 -- 172.21.15.119:0/4089623139 shutdown_connections 2024-04-23T18:29:30.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.694+0000 7f37e6342800 1 --2- 172.21.15.119:0/4089623139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b204e21c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.694+0000 7f37e6342800 1 -- 172.21.15.119:0/4089623139 >> 172.21.15.119:0/4089623139 conn(0x564b203eb410 msgr2=0x564b204ddae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.694+0000 7f37e6342800 1 -- 172.21.15.119:0/4089623139 shutdown_connections 2024-04-23T18:29:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.694+0000 7f37e6342800 1 -- 172.21.15.119:0/4089623139 wait complete. 2024-04-23T18:29:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.694+0000 7f37e6342800 1 Processor -- start 2024-04-23T18:29:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.694+0000 7f37e6342800 1 -- start start 2024-04-23T18:29:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.695+0000 7f37e6342800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b204e9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.695+0000 7f37e6342800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b203fa1b0 con 0x564b203f1a60 2024-04-23T18:29:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.695+0000 7f37e3e41640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b204e9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.695+0000 7f37e3e41640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b204e9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60526/0 (socket says 172.21.15.119:60526) 2024-04-23T18:29:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.695+0000 7f37e3e41640 1 -- 172.21.15.119:0/1144811281 learned_addr learned my addr 172.21.15.119:0/1144811281 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.695+0000 7f37e3e41640 1 -- 172.21.15.119:0/1144811281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b202b0eb0 con 0x564b203f1a60 2024-04-23T18:29:30.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.695+0000 7f37e3e41640 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b204e9990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f37d8060040 tx=0x7f37d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.695+0000 7f36cbfff640 1 -- 172.21.15.119:0/1144811281 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d800a2d0 con 0x564b203f1a60 2024-04-23T18:29:30.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.695+0000 7f36cbfff640 1 -- 172.21.15.119:0/1144811281 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d806c070 con 0x564b203f1a60 2024-04-23T18:29:30.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.695+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b204e9ed0 con 0x564b203f1a60 2024-04-23T18:29:30.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.695+0000 7f36cbfff640 1 -- 172.21.15.119:0/1144811281 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d805e5d0 con 0x564b203f1a60 2024-04-23T18:29:30.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.695+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b204ea450 con 0x564b203f1a60 2024-04-23T18:29:30.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.696+0000 7f36cbfff640 1 -- 172.21.15.119:0/1144811281 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f37d805e770 con 0x564b203f1a60 2024-04-23T18:29:30.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.696+0000 7f36cbfff640 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36cc036eb0 0x7f36cc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.696+0000 7f36cbfff640 1 -- 172.21.15.119:0/1144811281 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f37d808f140 con 0x564b203f1a60 2024-04-23T18:29:30.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.696+0000 7f37e3640640 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36cc036eb0 0x7f36cc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.696+0000 7f37e6342800 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b203f4390 0x564b204f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.697+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b204f0f80 con 0x564b203f4390 2024-04-23T18:29:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.697+0000 7f37e4642640 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b203f4390 0x564b204f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.697+0000 7f37e3640640 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36cc036eb0 0x7f36cc039370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37d4000f60 tx=0x7f37d40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.697+0000 7f37e4642640 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b203f4390 0x564b204f0a00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.697+0000 7f37e4642640 1 -- 172.21.15.119:0/1144811281 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b203f4390 2024-04-23T18:29:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.697+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b204edfd0 con 0x564b203f4390 2024-04-23T18:29:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.697+0000 7f37e4642640 1 -- 172.21.15.119:0/1144811281 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b203f4390 2024-04-23T18:29:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.697+0000 7f37e6342800 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b204f3290 0x564b204f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.697+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b204f5d20 con 0x564b204f3290 2024-04-23T18:29:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.698+0000 7f37e3e41640 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b204f3290 0x564b204f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.698+0000 7f37e3e41640 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b204f3290 0x564b204f5680 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.698+0000 7f37e3e41640 1 -- 172.21.15.119:0/1144811281 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37d8071990 con 0x564b204f3290 2024-04-23T18:29:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.698+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b204f2240 con 0x564b203f4390 2024-04-23T18:29:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.698+0000 7f37e4642640 1 -- 172.21.15.119:0/1144811281 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b203f4390 2024-04-23T18:29:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.698+0000 7f37e6342800 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564b204f71d0 0x564b204f9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.698+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b204f9d80 con 0x564b204f71d0 2024-04-23T18:29:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.699+0000 7f37e3640640 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564b204f71d0 0x564b204f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.699+0000 7f37e3640640 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564b204f71d0 0x564b204f9620 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.699+0000 7f37e3640640 1 -- 172.21.15.119:0/1144811281 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37d4009050 con 0x564b204f71d0 2024-04-23T18:29:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.700+0000 7f37e6342800 1 Processor -- start 2024-04-23T18:29:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.700+0000 7f37e6342800 1 -- start start 2024-04-23T18:29:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.700+0000 7f37e6342800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205081e0 0x564b20508600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.700+0000 7f37e6342800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b202e2df0 con 0x564b205081e0 2024-04-23T18:29:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.700+0000 7f37e3e41640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205081e0 0x564b20508600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.700+0000 7f37e3e41640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205081e0 0x564b20508600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60528/0 (socket says 172.21.15.119:60528) 2024-04-23T18:29:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.700+0000 7f37e3e41640 1 -- 172.21.15.119:0/593694414 learned_addr learned my addr 172.21.15.119:0/593694414 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.700+0000 7f37e3e41640 1 -- 172.21.15.119:0/593694414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b20508b40 con 0x564b205081e0 2024-04-23T18:29:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.701+0000 7f37e3e41640 1 --2- 172.21.15.119:0/593694414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205081e0 0x564b20508600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f37d8052540 tx=0x7f37d80716a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.701+0000 7f36c97fa640 1 -- 172.21.15.119:0/593694414 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8096070 con 0x564b205081e0 2024-04-23T18:29:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.701+0000 7f36c97fa640 1 -- 172.21.15.119:0/593694414 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8058040 con 0x564b205081e0 2024-04-23T18:29:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.701+0000 7f37e6342800 1 -- 172.21.15.119:0/593694414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b205095b0 con 0x564b205081e0 2024-04-23T18:29:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.701+0000 7f36c97fa640 1 -- 172.21.15.119:0/593694414 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d805ed70 con 0x564b205081e0 2024-04-23T18:29:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.701+0000 7f37e6342800 1 -- 172.21.15.119:0/593694414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b20509ab0 con 0x564b205081e0 2024-04-23T18:29:30.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.701+0000 7f36c97fa640 1 -- 172.21.15.119:0/593694414 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f37d8073b10 con 0x564b205081e0 2024-04-23T18:29:30.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.702+0000 7f36c97fa640 1 --2- 172.21.15.119:0/593694414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36bc036e60 0x7f36bc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.702+0000 7f36c97fa640 1 -- 172.21.15.119:0/593694414 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f37d8083040 con 0x564b205081e0 2024-04-23T18:29:30.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.702+0000 7f37e3640640 1 --2- 172.21.15.119:0/593694414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36bc036e60 0x7f36bc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.702+0000 7f37e6342800 1 Processor -- start 2024-04-23T18:29:30.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.702+0000 7f37e6342800 1 -- start start 2024-04-23T18:29:30.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.702+0000 7f37e3640640 1 --2- 172.21.15.119:0/593694414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36bc036e60 0x7f36bc039320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f37d400bf50 tx=0x7f37d400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.702+0000 7f37e6342800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 0x564b20515700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.702+0000 7f37e6342800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b204e2880 con 0x564b205152e0 2024-04-23T18:29:30.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.702+0000 7f37e3e41640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 0x564b20515700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.702+0000 7f37e3e41640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 0x564b20515700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60540/0 (socket says 172.21.15.119:60540) 2024-04-23T18:29:30.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.702+0000 7f37e3e41640 1 -- 172.21.15.119:0/2910002176 learned_addr learned my addr 172.21.15.119:0/2910002176 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.703+0000 7f37e3e41640 1 -- 172.21.15.119:0/2910002176 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b20515cd0 con 0x564b205152e0 2024-04-23T18:29:30.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.703+0000 7f37e3e41640 1 --2- 172.21.15.119:0/2910002176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 0x564b20515700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f37d8087620 tx=0x7f37d8066d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876b6e431e7c7ed1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.703+0000 7f36c2ffd640 1 -- 172.21.15.119:0/2910002176 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d80a5040 con 0x564b205152e0 2024-04-23T18:29:30.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.703+0000 7f36c2ffd640 1 -- 172.21.15.119:0/2910002176 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8073e00 con 0x564b205152e0 2024-04-23T18:29:30.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.703+0000 7f36c2ffd640 1 -- 172.21.15.119:0/2910002176 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d8069050 con 0x564b205152e0 2024-04-23T18:29:30.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.703+0000 7f37e6342800 1 -- 172.21.15.119:0/2910002176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 msgr2=0x564b20515700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.703+0000 7f37e6342800 1 --2- 172.21.15.119:0/2910002176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 0x564b20515700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f37d8087620 tx=0x7f37d8066d40 comp rx=0 tx=0).stop 2024-04-23T18:29:30.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.703+0000 7f37e6342800 1 -- 172.21.15.119:0/2910002176 shutdown_connections 2024-04-23T18:29:30.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.703+0000 7f37e6342800 1 --2- 172.21.15.119:0/2910002176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 0x564b20515700 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.703+0000 7f37e6342800 1 -- 172.21.15.119:0/2910002176 >> 172.21.15.119:0/2910002176 conn(0x564b205115b0 msgr2=0x564b2050f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.703+0000 7f37e6342800 1 -- 172.21.15.119:0/2910002176 shutdown_connections 2024-04-23T18:29:30.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.703+0000 7f37e6342800 1 -- 172.21.15.119:0/2910002176 wait complete. 2024-04-23T18:29:30.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.704+0000 7f37e6342800 1 Processor -- start 2024-04-23T18:29:30.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.704+0000 7f37e6342800 1 -- start start 2024-04-23T18:29:30.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.704+0000 7f37e6342800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 0x564b203f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.704+0000 7f37e6342800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b20516330 con 0x564b205152e0 2024-04-23T18:29:30.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.704+0000 7f37e3e41640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 0x564b203f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.704+0000 7f37e3e41640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 0x564b203f1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60542/0 (socket says 172.21.15.119:60542) 2024-04-23T18:29:30.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.704+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 learned_addr learned my addr 172.21.15.119:0/1637040747 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.704+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b203f1840 con 0x564b205152e0 2024-04-23T18:29:30.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.705+0000 7f37e3e41640 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 0x564b203f1300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f37d805efd0 tx=0x7f37d8065f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.705+0000 7f36c17fa640 1 -- 172.21.15.119:0/1637040747 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d80734e0 con 0x564b205152e0 2024-04-23T18:29:30.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.705+0000 7f36c17fa640 1 -- 172.21.15.119:0/1637040747 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d80b9030 con 0x564b205152e0 2024-04-23T18:29:30.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.705+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b203ef9f0 con 0x564b205152e0 2024-04-23T18:29:30.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.705+0000 7f36c17fa640 1 -- 172.21.15.119:0/1637040747 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37d808d9d0 con 0x564b205152e0 2024-04-23T18:29:30.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.705+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b203ef9f0 con 0x564b205152e0 2024-04-23T18:29:30.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.706+0000 7f36c17fa640 1 -- 172.21.15.119:0/1637040747 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f37d808a610 con 0x564b205152e0 2024-04-23T18:29:30.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.706+0000 7f36c17fa640 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36ac036e60 0x7f36ac039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.706+0000 7f36c17fa640 1 -- 172.21.15.119:0/1637040747 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f37d80bfc60 con 0x564b205152e0 2024-04-23T18:29:30.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.706+0000 7f37e6342800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.706+0000 7f37e3640640 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36ac036e60 0x7f36ac039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.706+0000 7f37e6342800 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b2052a030 0x564b2052c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.706+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b2052cc40 con 0x564b2052a030 2024-04-23T18:29:30.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.706+0000 7f37e4642640 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b2052a030 0x564b2052c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.706+0000 7f37e3640640 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36ac036e60 0x7f36ac039320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f37d4001b60 tx=0x7f37d4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.706+0000 7f37e4642640 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b2052a030 0x564b2052c4f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b2052a030 2024-04-23T18:29:30.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 20 realm 2024-04-23T18:29:30.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b2052d050 con 0x564b2052a030 2024-04-23T18:29:30.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b2052a030 2024-04-23T18:29:30.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:30.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b2052d8f0 con 0x564b2052a030 2024-04-23T18:29:30.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b2052a030 2024-04-23T18:29:30.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052a030 2024-04-23T18:29:30.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b2052a030 2024-04-23T18:29:30.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:30.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b2052e9f0 0x564b20530de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.707+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b20531320 con 0x564b2052e9f0 2024-04-23T18:29:30.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.708+0000 7f37e3e41640 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b2052e9f0 0x564b20530de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.708+0000 7f37e3e41640 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b2052e9f0 0x564b20530de0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.708+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37d8071990 con 0x564b2052e9f0 2024-04-23T18:29:30.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.708+0000 7f37e6342800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:30.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.708+0000 7f37e6342800 20 searching for the correct realm 2024-04-23T18:29:30.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.708+0000 7f37e6342800 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564b205333a0 0x564b20535860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.708+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b20535f30 con 0x564b205333a0 2024-04-23T18:29:30.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.708+0000 7f37e3640640 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564b205333a0 0x564b20535860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.708+0000 7f37e3640640 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564b205333a0 0x564b20535860 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.709+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.709+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b20535f30 con 0x564b2052e9f0 2024-04-23T18:29:30.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.709+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d8071990 con 0x564b2052e9f0 2024-04-23T18:29:30.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.709+0000 7f37e3e41640 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f37d80b4050 0x7f37d8062a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.709+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b20535f30 con 0x7f37d80b4050 2024-04-23T18:29:30.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.709+0000 7f37e4642640 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f37d80b4050 0x7f37d8062a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.710+0000 7f37e4642640 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f37d80b4050 0x7f37d8062a50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.710+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc00a4a0 con 0x7f37d80b4050 2024-04-23T18:29:30.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.710+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052a030 2024-04-23T18:29:30.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.710+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b2052a030 2024-04-23T18:29:30.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.710+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052a030 2024-04-23T18:29:30.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.710+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b2052a030 2024-04-23T18:29:30.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.710+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x7f37d80b4050 2024-04-23T18:29:30.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.711+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc00a4a0 con 0x7f37d80b4050 2024-04-23T18:29:30.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.711+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x7f37d80b4050 2024-04-23T18:29:30.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.711+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f37dc00a4a0 con 0x7f37d80b4050 2024-04-23T18:29:30.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.711+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052e9f0 2024-04-23T18:29:30.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.711+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d8071990 con 0x564b2052e9f0 2024-04-23T18:29:30.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.711+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b205333a0 2024-04-23T18:29:30.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.711+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.711+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052a030 2024-04-23T18:29:30.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.712+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b2052a030 2024-04-23T18:29:30.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.712+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x7f37d80b4050 2024-04-23T18:29:30.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.712+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc00a4a0 con 0x7f37d80b4050 2024-04-23T18:29:30.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.712+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052a030 2024-04-23T18:29:30.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.712+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b2052a030 2024-04-23T18:29:30.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.712+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052e9f0 2024-04-23T18:29:30.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.712+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f37d8071990 con 0x564b2052e9f0 2024-04-23T18:29:30.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.713+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b205333a0 2024-04-23T18:29:30.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.713+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.713+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b205333a0 2024-04-23T18:29:30.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.713+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.713+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x7f37d80b4050 2024-04-23T18:29:30.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.713+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc00a4a0 con 0x7f37d80b4050 2024-04-23T18:29:30.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.713+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b205333a0 2024-04-23T18:29:30.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.713+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.713+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b205333a0 2024-04-23T18:29:30.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.714+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.714+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052a030 2024-04-23T18:29:30.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.714+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b2052a030 2024-04-23T18:29:30.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.714+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052a030 2024-04-23T18:29:30.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.714+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b2052a030 2024-04-23T18:29:30.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.714+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x7f37d80b4050 2024-04-23T18:29:30.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.714+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc00a4a0 con 0x7f37d80b4050 2024-04-23T18:29:30.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.714+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b205333a0 2024-04-23T18:29:30.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.714+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.715+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052e9f0 2024-04-23T18:29:30.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.715+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f37d8071990 con 0x564b2052e9f0 2024-04-23T18:29:30.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.715+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052a030 2024-04-23T18:29:30.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.715+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc00a4a0 con 0x564b2052a030 2024-04-23T18:29:30.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.715+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x7f37d80b4050 2024-04-23T18:29:30.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.715+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc00a4a0 con 0x7f37d80b4050 2024-04-23T18:29:30.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.715+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b205333a0 2024-04-23T18:29:30.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.715+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.716+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x7f37d80b4050 2024-04-23T18:29:30.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.716+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc00a4a0 con 0x7f37d80b4050 2024-04-23T18:29:30.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.716+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052e9f0 2024-04-23T18:29:30.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.716+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d8071990 con 0x564b2052e9f0 2024-04-23T18:29:30.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.716+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b205333a0 2024-04-23T18:29:30.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.716+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.716+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x7f37d80b4050 2024-04-23T18:29:30.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.717+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37dc040040 con 0x7f37d80b4050 2024-04-23T18:29:30.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.717+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052a030 2024-04-23T18:29:30.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.717+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f37dc040040 con 0x564b2052a030 2024-04-23T18:29:30.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.717+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b2052dc90 con 0x564b2052e9f0 2024-04-23T18:29:30.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.717+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37d80da040 con 0x564b2052e9f0 2024-04-23T18:29:30.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:30.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:30.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:30.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:30.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:30.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:30.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b20531ca0 con 0x564b2052a030 2024-04-23T18:29:30.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x564b2052a030 2024-04-23T18:29:30.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b20531ca0 con 0x564b2052a030 2024-04-23T18:29:30.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37dc040040 con 0x564b2052a030 2024-04-23T18:29:30.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:30.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b20531ca0 con 0x7f37d80b4050 2024-04-23T18:29:30.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f37dc040040 con 0x7f37d80b4050 2024-04-23T18:29:30.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:30.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 zone default found 2024-04-23T18:29:30.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 4 Realm: () 2024-04-23T18:29:30.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:30.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:30.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:30.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 zonegroup default 2024-04-23T18:29:30.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.718+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b20532090 con 0x7f37d80b4050 2024-04-23T18:29:30.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.719+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37d80b4050 2024-04-23T18:29:30.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.719+0000 7f37e6342800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.719+0000 7f37e6342800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.719+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b205324d0 con 0x564b205333a0 2024-04-23T18:29:30.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.719+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.719+0000 7f37e6342800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.719+0000 7f37e6342800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.719+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b20537d90 con 0x564b205333a0 2024-04-23T18:29:30.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.719+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.719+0000 7f37e6342800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.719+0000 7f37e6342800 20 started sync module instance, tier type = 2024-04-23T18:29:30.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.719+0000 7f37e6342800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:30.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.719+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b20537230 con 0x564b2052e9f0 2024-04-23T18:29:30.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.720+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d80da040 con 0x564b2052e9f0 2024-04-23T18:29:30.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.720+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94880664874368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b20538130 con 0x564b2052e9f0 2024-04-23T18:29:30.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.720+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b20538980 con 0x564b2052a030 2024-04-23T18:29:30.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.723+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x564b2052a030 2024-04-23T18:29:30.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.723+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94880664880608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b20539050 con 0x564b2052a030 2024-04-23T18:29:30.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.723+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b20539b70 con 0x564b205333a0 2024-04-23T18:29:30.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.723+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94880664874368] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d80da040 con 0x564b2052e9f0 2024-04-23T18:29:30.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.725+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94880664880608] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x564b2052a030 2024-04-23T18:29:30.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.725+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.725+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94880664884800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b20538aa0 con 0x564b205333a0 2024-04-23T18:29:30.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.725+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053a580 con 0x564b2052e9f0 2024-04-23T18:29:30.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.726+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d80da040 con 0x564b2052e9f0 2024-04-23T18:29:30.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.726+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94880664889632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053b1f0 con 0x564b2052e9f0 2024-04-23T18:29:30.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.726+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053bbb0 con 0x564b2052a030 2024-04-23T18:29:30.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.726+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94880664884800] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.728+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x564b2052a030 2024-04-23T18:29:30.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.728+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94880664876576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053bbb0 con 0x564b2052a030 2024-04-23T18:29:30.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.728+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053c5b0 con 0x7f37d80b4050 2024-04-23T18:29:30.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.728+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94880664889632] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d80da040 con 0x564b2052e9f0 2024-04-23T18:29:30.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.729+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94880664876576] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x564b2052a030 2024-04-23T18:29:30.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.731+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37d80b4050 2024-04-23T18:29:30.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.731+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94880664890688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053b700 con 0x7f37d80b4050 2024-04-23T18:29:30.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.731+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053ce80 con 0x7f37d80b4050 2024-04-23T18:29:30.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.732+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94880664890688] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37d80b4050 2024-04-23T18:29:30.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.732+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37d80b4050 2024-04-23T18:29:30.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.732+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94880664895680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053b700 con 0x7f37d80b4050 2024-04-23T18:29:30.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.732+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053d3f0 con 0x7f37d80b4050 2024-04-23T18:29:30.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.735+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37d80b4050 2024-04-23T18:29:30.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.735+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94880664895680] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37d80b4050 2024-04-23T18:29:30.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.735+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94880664899328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053d850 con 0x7f37d80b4050 2024-04-23T18:29:30.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.735+0000 7f37e6342800 20 add_watcher() i=0 2024-04-23T18:29:30.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.735+0000 7f37e6342800 20 add_watcher() i=1 2024-04-23T18:29:30.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.735+0000 7f37e6342800 20 add_watcher() i=2 2024-04-23T18:29:30.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.735+0000 7f37e6342800 20 add_watcher() i=3 2024-04-23T18:29:30.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.735+0000 7f37e6342800 20 add_watcher() i=4 2024-04-23T18:29:30.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.735+0000 7f37e6342800 20 add_watcher() i=5 2024-04-23T18:29:30.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.735+0000 7f37e6342800 20 add_watcher() i=6 2024-04-23T18:29:30.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.738+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94880664899328] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37d80b4050 2024-04-23T18:29:30.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.738+0000 7f37e6342800 20 add_watcher() i=7 2024-04-23T18:29:30.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.738+0000 7f37e6342800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:30.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.738+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b2053c9d0 con 0x564b2052a030 2024-04-23T18:29:30.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.738+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f37dc040040 con 0x564b2052a030 2024-04-23T18:29:30.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.738+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94880664900384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053c9d0 con 0x564b2052a030 2024-04-23T18:29:30.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.739+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94880664900384] v32'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x564b2052a030 2024-04-23T18:29:30.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.739+0000 7f3699fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:30.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.739+0000 7f37e6342800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:30.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.739+0000 7f37e6342800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:30.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.739+0000 7f37e6342800 5 note: GC not initialized 2024-04-23T18:29:30.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.739+0000 7f3698fe1640 20 reqs_thread_entry: start 2024-04-23T18:29:30.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.739+0000 7f37e6342800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:30.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.740+0000 7f37e6342800 20 Filter name: none 2024-04-23T18:29:30.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.740+0000 7f36127fc640 20 reqs_thread_entry: start 2024-04-23T18:29:30.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.740+0000 7f37e6342800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.740+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b20573b60 con 0x564b2052a030 2024-04-23T18:29:30.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.740+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f37dc040040 con 0x564b2052a030 2024-04-23T18:29:30.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.740+0000 7f37e6342800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:30.743 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:30.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.741+0000 7f3699fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:30.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.741+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94880664900384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053fd90 con 0x564b2052a030 2024-04-23T18:29:30.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.742+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94880664900384] v32'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x564b2052a030 2024-04-23T18:29:30.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.742+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94880664874368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053d320 con 0x564b2052e9f0 2024-04-23T18:29:30.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.743+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94880664874368] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d80da040 con 0x564b2052e9f0 2024-04-23T18:29:30.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.743+0000 7f37e6342800 20 remove_watcher() i=0 2024-04-23T18:29:30.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.743+0000 7f37e6342800 2 removed watcher, disabling cache 2024-04-23T18:29:30.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.743+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94880664880608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b20536d80 con 0x564b2052a030 2024-04-23T18:29:30.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.744+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94880664880608] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x564b2052a030 2024-04-23T18:29:30.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.744+0000 7f37e6342800 20 remove_watcher() i=1 2024-04-23T18:29:30.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.744+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94880664884800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b205385e0 con 0x564b205333a0 2024-04-23T18:29:30.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.745+0000 7f37e3640640 1 -- 172.21.15.119:0/1637040747 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94880664884800] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d4009050 con 0x564b205333a0 2024-04-23T18:29:30.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.745+0000 7f37e6342800 20 remove_watcher() i=2 2024-04-23T18:29:30.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.745+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94880664889632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b20539640 con 0x564b2052e9f0 2024-04-23T18:29:30.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.746+0000 7f37e3e41640 1 -- 172.21.15.119:0/1637040747 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94880664889632] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37d80da040 con 0x564b2052e9f0 2024-04-23T18:29:30.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.746+0000 7f37e6342800 20 remove_watcher() i=3 2024-04-23T18:29:30.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.746+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94880664876576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053a920 con 0x564b2052a030 2024-04-23T18:29:30.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.747+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94880664876576] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x564b2052a030 2024-04-23T18:29:30.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.747+0000 7f37e6342800 20 remove_watcher() i=4 2024-04-23T18:29:30.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.747+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94880664890688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053a920 con 0x7f37d80b4050 2024-04-23T18:29:30.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.748+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94880664890688] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37d80b4050 2024-04-23T18:29:30.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.748+0000 7f37e6342800 20 remove_watcher() i=5 2024-04-23T18:29:30.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.748+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94880664895680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b20539640 con 0x7f37d80b4050 2024-04-23T18:29:30.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.749+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94880664895680] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37d80b4050 2024-04-23T18:29:30.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.749+0000 7f37e6342800 20 remove_watcher() i=6 2024-04-23T18:29:30.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.749+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94880664899328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b2053c0c0 con 0x7f37d80b4050 2024-04-23T18:29:30.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.749+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94880664899328] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37dc040040 con 0x7f37d80b4050 2024-04-23T18:29:30.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.749+0000 7f37e6342800 20 remove_watcher() i=7 2024-04-23T18:29:30.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f37d80b4050 msgr2=0x7f37d8062a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f37d80b4050 0x7f37d8062a50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b2052a030 msgr2=0x564b2052c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b2052a030 0x564b2052c4f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b2052e9f0 msgr2=0x564b20530de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b2052e9f0 0x564b20530de0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564b205333a0 msgr2=0x564b20535860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564b205333a0 0x564b20535860 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36ac036e60 msgr2=0x7f36ac039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36ac036e60 0x7f36ac039320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f37d4001b60 tx=0x7f37d4010000 comp rx=0 tx=0).stop 2024-04-23T18:29:30.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 msgr2=0x564b203f1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e4642640 1 -- 172.21.15.119:0/1637040747 reap_dead start 2024-04-23T18:29:30.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 0x564b203f1300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f37d805efd0 tx=0x7f37d8065f80 comp rx=0 tx=0).stop 2024-04-23T18:29:30.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 shutdown_connections 2024-04-23T18:29:30.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 --2- 172.21.15.119:0/1637040747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205152e0 0x564b203f1300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 >> 172.21.15.119:0/1637040747 conn(0x564b205115b0 msgr2=0x564b2050ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 shutdown_connections 2024-04-23T18:29:30.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/1637040747 wait complete. 2024-04-23T18:29:30.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/593694414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36bc036e60 msgr2=0x7f36bc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 --2- 172.21.15.119:0/593694414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36bc036e60 0x7f36bc039320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f37d400bf50 tx=0x7f37d400f000 comp rx=0 tx=0).stop 2024-04-23T18:29:30.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/593694414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205081e0 msgr2=0x564b20508600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 --2- 172.21.15.119:0/593694414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205081e0 0x564b20508600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f37d8052540 tx=0x7f37d80716a0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/593694414 shutdown_connections 2024-04-23T18:29:30.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 --2- 172.21.15.119:0/593694414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36bc036e60 0x7f36bc039320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 --2- 172.21.15.119:0/593694414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b205081e0 0x564b20508600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/593694414 >> 172.21.15.119:0/593694414 conn(0x564b204fc280 msgr2=0x564b204fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/593694414 shutdown_connections 2024-04-23T18:29:30.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.750+0000 7f37e6342800 1 -- 172.21.15.119:0/593694414 wait complete. 2024-04-23T18:29:30.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564b204f71d0 msgr2=0x564b204f9620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564b204f71d0 0x564b204f9620 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b203f4390 msgr2=0x564b204f0a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b203f4390 0x564b204f0a00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b204f3290 msgr2=0x564b204f5680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b204f3290 0x564b204f5680 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36cc036eb0 msgr2=0x7f36cc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36cc036eb0 0x7f36cc039370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37d4000f60 tx=0x7f37d40012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 msgr2=0x564b204e9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 --2- 172.21.15.119:0/1144811281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b203f1a60 0x564b204e9990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f37d8060040 tx=0x7f37d8002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e4642640 1 -- 172.21.15.119:0/1144811281 reap_dead start 2024-04-23T18:29:30.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 shutdown_connections 2024-04-23T18:29:30.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 >> 172.21.15.119:0/1144811281 conn(0x564b203eb410 msgr2=0x564b204e0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 shutdown_connections 2024-04-23T18:29:30.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.751+0000 7f37e6342800 1 -- 172.21.15.119:0/1144811281 wait complete. 2024-04-23T18:29:30.756 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:30.756 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-23T18:29:30.756 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-23T18:29:30.757 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-23T18:29:30.840 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:30.840 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:30.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.848+0000 7f831743f800 1 Processor -- start 2024-04-23T18:29:30.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.848+0000 7f831743f800 1 -- start start 2024-04-23T18:29:30.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.848+0000 7f831743f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56389e895350 0x56389e897740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.848+0000 7f831743f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56389e742560 con 0x56389e8913a0 2024-04-23T18:29:30.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.848+0000 7f831743f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x56389e733e20 con 0x56389e895350 2024-04-23T18:29:30.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.848+0000 7f830ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56389e895350 0x56389e897740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.848+0000 7f8314f3e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x56389e8913a0 0x56389e8917c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40508/0 (socket says 172.21.15.119:40508) 2024-04-23T18:29:30.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.848+0000 7f8314f3e640 1 -- 172.21.15.119:0/398961014 learned_addr learned my addr 172.21.15.119:0/398961014 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:30.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.849+0000 7f830f7fe640 1 -- 172.21.15.119:0/398961014 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4219948854 0 0) 0x56389e742560 con 0x56389e8913a0 2024-04-23T18:29:30.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.849+0000 7f830f7fe640 1 -- 172.21.15.119:0/398961014 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8304001e10 con 0x56389e8913a0 2024-04-23T18:29:30.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.849+0000 7f830ffff640 1 -- 172.21.15.119:0/398961014 >> v1:172.21.15.62:6789/0 conn(0x56389e8913a0 legacy=0x56389e8917c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.849+0000 7f830ffff640 1 -- 172.21.15.119:0/398961014 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56389e741e60 con 0x56389e895350 2024-04-23T18:29:30.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.851+0000 7f830ffff640 1 --2- 172.21.15.119:0/398961014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e895350 0x56389e897740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f830000a470 tx=0x7f830001ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c918316b85686d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.851+0000 7f830f7fe640 1 -- 172.21.15.119:0/398961014 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8300057070 con 0x56389e895350 2024-04-23T18:29:30.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.851+0000 7f830f7fe640 1 -- 172.21.15.119:0/398961014 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830004add0 con 0x56389e895350 2024-04-23T18:29:30.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.851+0000 7f830f7fe640 1 -- 172.21.15.119:0/398961014 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8300052570 con 0x56389e895350 2024-04-23T18:29:30.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.851+0000 7f831743f800 1 -- 172.21.15.119:0/398961014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e895350 msgr2=0x56389e897740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.851+0000 7f831743f800 1 --2- 172.21.15.119:0/398961014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e895350 0x56389e897740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f830000a470 tx=0x7f830001ce40 comp rx=0 tx=0).stop 2024-04-23T18:29:30.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.851+0000 7f831743f800 1 -- 172.21.15.119:0/398961014 shutdown_connections 2024-04-23T18:29:30.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.851+0000 7f831743f800 1 --2- 172.21.15.119:0/398961014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e895350 0x56389e897740 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.851+0000 7f831743f800 1 -- 172.21.15.119:0/398961014 >> 172.21.15.119:0/398961014 conn(0x56389e88bba0 msgr2=0x56389e88dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.851+0000 7f831743f800 1 -- 172.21.15.119:0/398961014 shutdown_connections 2024-04-23T18:29:30.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.851+0000 7f831743f800 1 -- 172.21.15.119:0/398961014 wait complete. 2024-04-23T18:29:30.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.863+0000 7f831743f800 1 Processor -- start 2024-04-23T18:29:30.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.863+0000 7f831743f800 1 -- start start 2024-04-23T18:29:30.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.863+0000 7f831743f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e8913a0 0x56389e890aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.863+0000 7f831743f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56389e7dd5b0 con 0x56389e8913a0 2024-04-23T18:29:30.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.863+0000 7f8314f3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e8913a0 0x56389e890aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.863+0000 7f8314f3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e8913a0 0x56389e890aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60566/0 (socket says 172.21.15.119:60566) 2024-04-23T18:29:30.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.863+0000 7f8314f3e640 1 -- 172.21.15.119:0/3803455203 learned_addr learned my addr 172.21.15.119:0/3803455203 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.864+0000 7f8314f3e640 1 -- 172.21.15.119:0/3803455203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56389e753860 con 0x56389e8913a0 2024-04-23T18:29:30.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.864+0000 7f8314f3e640 1 --2- 172.21.15.119:0/3803455203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e8913a0 0x56389e890aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8308001db0 tx=0x7f830800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77b1efe0a76bf69 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.864+0000 7f8202e05640 1 -- 172.21.15.119:0/3803455203 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8308012020 con 0x56389e8913a0 2024-04-23T18:29:30.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.864+0000 7f8202e05640 1 -- 172.21.15.119:0/3803455203 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830800e5a0 con 0x56389e8913a0 2024-04-23T18:29:30.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.864+0000 7f8202e05640 1 -- 172.21.15.119:0/3803455203 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f830800e940 con 0x56389e8913a0 2024-04-23T18:29:30.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f831743f800 1 -- 172.21.15.119:0/3803455203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e8913a0 msgr2=0x56389e890aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f831743f800 1 --2- 172.21.15.119:0/3803455203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e8913a0 0x56389e890aa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8308001db0 tx=0x7f830800b6c0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f831743f800 1 -- 172.21.15.119:0/3803455203 shutdown_connections 2024-04-23T18:29:30.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f831743f800 1 --2- 172.21.15.119:0/3803455203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e8913a0 0x56389e890aa0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f831743f800 1 -- 172.21.15.119:0/3803455203 >> 172.21.15.119:0/3803455203 conn(0x56389e88bba0 msgr2=0x56389e97d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f831743f800 1 -- 172.21.15.119:0/3803455203 shutdown_connections 2024-04-23T18:29:30.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f831743f800 1 -- 172.21.15.119:0/3803455203 wait complete. 2024-04-23T18:29:30.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f831743f800 1 Processor -- start 2024-04-23T18:29:30.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f831743f800 1 -- start start 2024-04-23T18:29:30.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f831743f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e8913a0 0x56389e98a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f831743f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56389e897f80 con 0x56389e8913a0 2024-04-23T18:29:30.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f8314f3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e8913a0 0x56389e98a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f8314f3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e8913a0 0x56389e98a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60576/0 (socket says 172.21.15.119:60576) 2024-04-23T18:29:30.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.865+0000 7f8314f3e640 1 -- 172.21.15.119:0/3829201021 learned_addr learned my addr 172.21.15.119:0/3829201021 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.866+0000 7f8314f3e640 1 -- 172.21.15.119:0/3829201021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56389e751eb0 con 0x56389e8913a0 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.866+0000 7f8314f3e640 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e8913a0 0x56389e98a9c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f830800c010 tx=0x7f8308000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.866+0000 7f8201602640 1 -- 172.21.15.119:0/3829201021 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8308012030 con 0x56389e8913a0 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.866+0000 7f8201602640 1 -- 172.21.15.119:0/3829201021 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830801a750 con 0x56389e8913a0 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.866+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56389e98af00 con 0x56389e8913a0 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.866+0000 7f8201602640 1 -- 172.21.15.119:0/3829201021 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f830801aa30 con 0x56389e8913a0 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.866+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56389e98b420 con 0x56389e8913a0 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.867+0000 7f8201602640 1 -- 172.21.15.119:0/3829201021 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8308015020 con 0x56389e8913a0 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.867+0000 7f8201602640 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81fc036eb0 0x7f81fc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.867+0000 7f8201602640 1 -- 172.21.15.119:0/3829201021 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8308020030 con 0x56389e8913a0 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.867+0000 7f830ffff640 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81fc036eb0 0x7f81fc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.867+0000 7f831743f800 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56389e895350 0x56389e991a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.867+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e991f70 con 0x56389e895350 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.867+0000 7f831573f640 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56389e895350 0x56389e991a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.867+0000 7f830ffff640 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81fc036eb0 0x7f81fc039370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8300054000 tx=0x7f830004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.867+0000 7f831573f640 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56389e895350 0x56389e991a30 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.868+0000 7f831573f640 1 -- 172.21.15.119:0/3829201021 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e895350 2024-04-23T18:29:30.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.868+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e98ef50 con 0x56389e895350 2024-04-23T18:29:30.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.868+0000 7f831573f640 1 -- 172.21.15.119:0/3829201021 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e895350 2024-04-23T18:29:30.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.868+0000 7f831743f800 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56389e993fc0 0x56389e996480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.868+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e996c10 con 0x56389e993fc0 2024-04-23T18:29:30.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.868+0000 7f8314f3e640 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56389e993fc0 0x56389e996480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.868+0000 7f8314f3e640 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56389e993fc0 0x56389e996480 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.869+0000 7f8314f3e640 1 -- 172.21.15.119:0/3829201021 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8308018950 con 0x56389e993fc0 2024-04-23T18:29:30.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.869+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e992820 con 0x56389e895350 2024-04-23T18:29:30.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.869+0000 7f831573f640 1 -- 172.21.15.119:0/3829201021 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e895350 2024-04-23T18:29:30.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.869+0000 7f831743f800 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56389e998070 0x56389e99a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.869+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e99acc0 con 0x56389e998070 2024-04-23T18:29:30.865 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.869+0000 7f830ffff640 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56389e998070 0x56389e99a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.869+0000 7f830ffff640 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56389e998070 0x56389e99a530 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.870+0000 7f830ffff640 1 -- 172.21.15.119:0/3829201021 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f830005a040 con 0x56389e998070 2024-04-23T18:29:30.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.870+0000 7f831743f800 1 Processor -- start 2024-04-23T18:29:30.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.870+0000 7f831743f800 1 -- start start 2024-04-23T18:29:30.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.870+0000 7f831743f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e983810 0x56389e981c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.870+0000 7f831743f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56389e783df0 con 0x56389e983810 2024-04-23T18:29:30.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.870+0000 7f8314f3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e983810 0x56389e981c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.870+0000 7f8314f3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e983810 0x56389e981c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60590/0 (socket says 172.21.15.119:60590) 2024-04-23T18:29:30.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.870+0000 7f8314f3e640 1 -- 172.21.15.119:0/2576623699 learned_addr learned my addr 172.21.15.119:0/2576623699 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.871+0000 7f8314f3e640 1 -- 172.21.15.119:0/2576623699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56389e9821c0 con 0x56389e983810 2024-04-23T18:29:30.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.871+0000 7f8314f3e640 1 --2- 172.21.15.119:0/2576623699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e983810 0x56389e981c80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f830804b2c0 tx=0x7f8308024e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.871+0000 7f81fa7fc640 1 -- 172.21.15.119:0/2576623699 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83080185b0 con 0x56389e983810 2024-04-23T18:29:30.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.871+0000 7f81fa7fc640 1 -- 172.21.15.119:0/2576623699 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830803d070 con 0x56389e983810 2024-04-23T18:29:30.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.871+0000 7f831743f800 1 -- 172.21.15.119:0/2576623699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56389e982450 con 0x56389e983810 2024-04-23T18:29:30.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.871+0000 7f81fa7fc640 1 -- 172.21.15.119:0/2576623699 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8308017d80 con 0x56389e983810 2024-04-23T18:29:30.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.871+0000 7f831743f800 1 -- 172.21.15.119:0/2576623699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56389e982950 con 0x56389e983810 2024-04-23T18:29:30.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.872+0000 7f81fa7fc640 1 -- 172.21.15.119:0/2576623699 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f830803f310 con 0x56389e983810 2024-04-23T18:29:30.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.872+0000 7f81fa7fc640 1 --2- 172.21.15.119:0/2576623699 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81ec036e60 0x7f81ec039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.872+0000 7f81fa7fc640 1 -- 172.21.15.119:0/2576623699 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8308019070 con 0x56389e983810 2024-04-23T18:29:30.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.872+0000 7f830ffff640 1 --2- 172.21.15.119:0/2576623699 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81ec036e60 0x7f81ec039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.872+0000 7f831743f800 1 Processor -- start 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.872+0000 7f831743f800 1 -- start start 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.872+0000 7f830ffff640 1 --2- 172.21.15.119:0/2576623699 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81ec036e60 0x7f81ec039320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x56389e98ef20 tx=0x7f8300005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.872+0000 7f831743f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9b8410 0x56389e9b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.872+0000 7f831743f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56389e985e00 con 0x56389e9b8410 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.873+0000 7f8314f3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9b8410 0x56389e9b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.873+0000 7f8314f3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9b8410 0x56389e9b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60604/0 (socket says 172.21.15.119:60604) 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.873+0000 7f8314f3e640 1 -- 172.21.15.119:0/4228429801 learned_addr learned my addr 172.21.15.119:0/4228429801 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.873+0000 7f8314f3e640 1 -- 172.21.15.119:0/4228429801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56389e9b8e00 con 0x56389e9b8410 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.873+0000 7f8314f3e640 1 --2- 172.21.15.119:0/4228429801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9b8410 0x56389e9b8830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8308049530 tx=0x7f8308049620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a41b19174db879d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.873+0000 7f81ebfff640 1 -- 172.21.15.119:0/4228429801 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8308051070 con 0x56389e9b8410 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.873+0000 7f81ebfff640 1 -- 172.21.15.119:0/4228429801 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8308049e80 con 0x56389e9b8410 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.873+0000 7f81ebfff640 1 -- 172.21.15.119:0/4228429801 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8308010200 con 0x56389e9b8410 2024-04-23T18:29:30.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f831743f800 1 -- 172.21.15.119:0/4228429801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9b8410 msgr2=0x56389e9b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f831743f800 1 --2- 172.21.15.119:0/4228429801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9b8410 0x56389e9b8830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8308049530 tx=0x7f8308049620 comp rx=0 tx=0).stop 2024-04-23T18:29:30.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f831743f800 1 -- 172.21.15.119:0/4228429801 shutdown_connections 2024-04-23T18:29:30.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f831743f800 1 --2- 172.21.15.119:0/4228429801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9b8410 0x56389e9b8830 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f831743f800 1 -- 172.21.15.119:0/4228429801 >> 172.21.15.119:0/4228429801 conn(0x56389e9b4770 msgr2=0x56389e9b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f831743f800 1 -- 172.21.15.119:0/4228429801 shutdown_connections 2024-04-23T18:29:30.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f831743f800 1 -- 172.21.15.119:0/4228429801 wait complete. 2024-04-23T18:29:30.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f831743f800 1 Processor -- start 2024-04-23T18:29:30.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f831743f800 1 -- start start 2024-04-23T18:29:30.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f831743f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9bf9d0 0x56389e9bfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f831743f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56389e9b94b0 con 0x56389e9bf9d0 2024-04-23T18:29:30.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f8314f3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9bf9d0 0x56389e9bfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f8314f3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9bf9d0 0x56389e9bfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60616/0 (socket says 172.21.15.119:60616) 2024-04-23T18:29:30.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.874+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 learned_addr learned my addr 172.21.15.119:0/2306397617 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.875+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56389e9c0330 con 0x56389e9bf9d0 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.875+0000 7f8314f3e640 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9bf9d0 0x56389e9bfdf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x56389e9b4e70 tx=0x7f830801ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.875+0000 7f81ea7fc640 1 -- 172.21.15.119:0/2306397617 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83080165e0 con 0x56389e9bf9d0 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.875+0000 7f81ea7fc640 1 -- 172.21.15.119:0/2306397617 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830806e070 con 0x56389e9bf9d0 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.875+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56389e9c0330 con 0x56389e9bf9d0 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.875+0000 7f81ea7fc640 1 -- 172.21.15.119:0/2306397617 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8308016910 con 0x56389e9bf9d0 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.875+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56389e9c2e90 con 0x56389e9bf9d0 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.876+0000 7f81ea7fc640 1 -- 172.21.15.119:0/2306397617 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f830804c630 con 0x56389e9bf9d0 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.876+0000 7f81ea7fc640 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81e0036e60 0x7f81e0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.876+0000 7f81ea7fc640 1 -- 172.21.15.119:0/2306397617 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8308065040 con 0x56389e9bf9d0 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.876+0000 7f830ffff640 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81e0036e60 0x7f81e0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.876+0000 7f831743f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.876+0000 7f831743f800 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56389e9cb5e0 0x56389e9cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.876+0000 7f830ffff640 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81e0036e60 0x7f81e0039320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8300005810 tx=0x7f8300060040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.876+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e9ce1f0 con 0x56389e9cb5e0 2024-04-23T18:29:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831573f640 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56389e9cb5e0 0x56389e9cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831573f640 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56389e9cb5e0 0x56389e9cdaa0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9cb5e0 2024-04-23T18:29:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831743f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831743f800 20 realm 2024-04-23T18:29:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831743f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e9ce600 con 0x56389e9cb5e0 2024-04-23T18:29:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9cb5e0 2024-04-23T18:29:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831743f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831743f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831743f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e9ceed0 con 0x56389e9cb5e0 2024-04-23T18:29:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9cb5e0 2024-04-23T18:29:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831743f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831743f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.877+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cb5e0 2024-04-23T18:29:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.878+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9cb5e0 2024-04-23T18:29:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.878+0000 7f831743f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.878+0000 7f831743f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.878+0000 7f831743f800 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56389e9cffd0 0x56389e9d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.878+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d29d0 con 0x56389e9cffd0 2024-04-23T18:29:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.878+0000 7f8314f3e640 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56389e9cffd0 0x56389e9d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.878+0000 7f8314f3e640 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56389e9cffd0 0x56389e9d23c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.878+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8308018950 con 0x56389e9cffd0 2024-04-23T18:29:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.878+0000 7f831743f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.878+0000 7f831743f800 20 searching for the correct realm 2024-04-23T18:29:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.878+0000 7f831743f800 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56389e9d4910 0x56389e9d6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.878+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d7450 con 0x56389e9d4910 2024-04-23T18:29:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.878+0000 7f830ffff640 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56389e9d4910 0x56389e9d6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.879+0000 7f830ffff640 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56389e9d4910 0x56389e9d6dd0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.879+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.879+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d7450 con 0x56389e9cffd0 2024-04-23T18:29:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.879+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8308018950 con 0x56389e9cffd0 2024-04-23T18:29:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.879+0000 7f8314f3e640 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56389e9b8410 0x7f8308060870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.879+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d7450 con 0x56389e9b8410 2024-04-23T18:29:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.880+0000 7f831573f640 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56389e9b8410 0x7f8308060870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.880+0000 7f831573f640 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56389e9b8410 0x7f8308060870 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.880+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9b8410 2024-04-23T18:29:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.880+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cb5e0 2024-04-23T18:29:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.880+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9cb5e0 2024-04-23T18:29:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.880+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cb5e0 2024-04-23T18:29:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.881+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9cb5e0 2024-04-23T18:29:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.881+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9b8410 2024-04-23T18:29:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.881+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9b8410 2024-04-23T18:29:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.881+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9b8410 2024-04-23T18:29:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.881+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9b8410 2024-04-23T18:29:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.881+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cffd0 2024-04-23T18:29:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.881+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8308018950 con 0x56389e9cffd0 2024-04-23T18:29:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.881+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9d4910 2024-04-23T18:29:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.881+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.881+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cb5e0 2024-04-23T18:29:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.882+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9cb5e0 2024-04-23T18:29:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.882+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9b8410 2024-04-23T18:29:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.882+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9b8410 2024-04-23T18:29:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.882+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cb5e0 2024-04-23T18:29:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.882+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9cb5e0 2024-04-23T18:29:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.882+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cffd0 2024-04-23T18:29:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.882+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8308018950 con 0x56389e9cffd0 2024-04-23T18:29:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.882+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9d4910 2024-04-23T18:29:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.883+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.883+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9d4910 2024-04-23T18:29:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.883+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.883+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9b8410 2024-04-23T18:29:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.883+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9b8410 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.883+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9d4910 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.883+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.883+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9d4910 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.883+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.883+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cb5e0 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.884+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9cb5e0 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.884+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cb5e0 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.884+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9cb5e0 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.884+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9b8410 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.884+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9b8410 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.884+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9d4910 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.884+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.884+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cffd0 2024-04-23T18:29:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.885+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8308018950 con 0x56389e9cffd0 2024-04-23T18:29:30.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.885+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cb5e0 2024-04-23T18:29:30.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.885+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9cb5e0 2024-04-23T18:29:30.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.885+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9b8410 2024-04-23T18:29:30.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.885+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9b8410 2024-04-23T18:29:30.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.885+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9d4910 2024-04-23T18:29:30.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.885+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.885+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9b8410 2024-04-23T18:29:30.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.886+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f831000a4a0 con 0x56389e9b8410 2024-04-23T18:29:30.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.886+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cffd0 2024-04-23T18:29:30.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.886+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8308018950 con 0x56389e9cffd0 2024-04-23T18:29:30.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.886+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9d4910 2024-04-23T18:29:30.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.886+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.886+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9b8410 2024-04-23T18:29:30.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.887+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8310040040 con 0x56389e9b8410 2024-04-23T18:29:30.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.887+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cb5e0 2024-04-23T18:29:30.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.887+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.887+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56389e9cf270 con 0x56389e9cffd0 2024-04-23T18:29:30.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f830808c040 con 0x56389e9cffd0 2024-04-23T18:29:30.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d3220 con 0x56389e9cb5e0 2024-04-23T18:29:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d3220 con 0x56389e9cb5e0 2024-04-23T18:29:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:30.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d3610 con 0x56389e9b8410 2024-04-23T18:29:30.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8310040040 con 0x56389e9b8410 2024-04-23T18:29:30.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:30.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 zone default found 2024-04-23T18:29:30.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 4 Realm: () 2024-04-23T18:29:30.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:30.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:30.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:30.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 zonegroup default 2024-04-23T18:29:30.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.888+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d3a40 con 0x56389e9b8410 2024-04-23T18:29:30.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.889+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9b8410 2024-04-23T18:29:30.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.889+0000 7f831743f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.889+0000 7f831743f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.889+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d3a40 con 0x56389e9d4910 2024-04-23T18:29:30.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.889+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.889+0000 7f831743f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.889+0000 7f831743f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.889+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d92b0 con 0x56389e9d4910 2024-04-23T18:29:30.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.889+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.889+0000 7f831743f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:30.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.889+0000 7f831743f800 20 started sync module instance, tier type = 2024-04-23T18:29:30.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.889+0000 7f831743f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:30.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.889+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d8750 con 0x56389e9cffd0 2024-04-23T18:29:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.890+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830808c040 con 0x56389e9cffd0 2024-04-23T18:29:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.890+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94801179282240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d83b0 con 0x56389e9cffd0 2024-04-23T18:29:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.890+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d9ff0 con 0x56389e9cb5e0 2024-04-23T18:29:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.891+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94801179282240] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830808c040 con 0x56389e9cffd0 2024-04-23T18:29:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.891+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.891+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94801179285072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d9f20 con 0x56389e9cb5e0 2024-04-23T18:29:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.891+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9daa70 con 0x56389e9d4910 2024-04-23T18:29:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.892+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.892+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94801179288960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9db340 con 0x56389e9d4910 2024-04-23T18:29:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.892+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9dbe00 con 0x56389e9cffd0 2024-04-23T18:29:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.893+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94801179285072] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.893+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830808c040 con 0x56389e9cffd0 2024-04-23T18:29:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.893+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94801179294000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9dc220 con 0x56389e9cffd0 2024-04-23T18:29:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.893+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9dcc20 con 0x56389e9cb5e0 2024-04-23T18:29:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.893+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94801179288960] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.894+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94801179294000] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830808c040 con 0x56389e9cffd0 2024-04-23T18:29:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.895+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.895+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94801179286128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9dc730 con 0x56389e9cb5e0 2024-04-23T18:29:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.895+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9dd4c0 con 0x56389e9b8410 2024-04-23T18:29:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.896+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9b8410 2024-04-23T18:29:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.896+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94801179299472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9dd760 con 0x56389e9b8410 2024-04-23T18:29:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.896+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94801179286128] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.896+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9dae90 con 0x56389e9b8410 2024-04-23T18:29:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.897+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94801179299472] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9b8410 2024-04-23T18:29:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.897+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9b8410 2024-04-23T18:29:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.897+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94801179300528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9ddb80 con 0x56389e9b8410 2024-04-23T18:29:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.897+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9de540 con 0x56389e9b8410 2024-04-23T18:29:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.898+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94801179300528] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9b8410 2024-04-23T18:29:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.898+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9b8410 2024-04-23T18:29:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.898+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94801179302096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9de540 con 0x56389e9b8410 2024-04-23T18:29:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.898+0000 7f831743f800 20 add_watcher() i=0 2024-04-23T18:29:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.898+0000 7f831743f800 20 add_watcher() i=1 2024-04-23T18:29:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.898+0000 7f831743f800 20 add_watcher() i=2 2024-04-23T18:29:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.898+0000 7f831743f800 20 add_watcher() i=3 2024-04-23T18:29:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.898+0000 7f831743f800 20 add_watcher() i=4 2024-04-23T18:29:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.898+0000 7f831743f800 20 add_watcher() i=5 2024-04-23T18:29:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.898+0000 7f831743f800 20 add_watcher() i=6 2024-04-23T18:29:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.899+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94801179302096] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9b8410 2024-04-23T18:29:30.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.899+0000 7f831743f800 20 add_watcher() i=7 2024-04-23T18:29:30.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.899+0000 7f831743f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:30.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.899+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389e9e1810 con 0x56389e9cb5e0 2024-04-23T18:29:30.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.899+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.899+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94801179304448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9dead0 con 0x56389e9cb5e0 2024-04-23T18:29:30.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.900+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94801179304448] v32'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.900+0000 7f81cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:30.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.900+0000 7f831743f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:30.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.900+0000 7f831743f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:30.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.900+0000 7f831743f800 5 note: GC not initialized 2024-04-23T18:29:30.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f81ca7e4640 20 reqs_thread_entry: start 2024-04-23T18:29:30.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f831743f800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:30.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f831743f800 20 Filter name: none 2024-04-23T18:29:30.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f81c87e0640 20 reqs_thread_entry: start 2024-04-23T18:29:30.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f831743f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:30.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f831743f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:30.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389ea15030 con 0x56389e9cb5e0 2024-04-23T18:29:30.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f831743f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:30.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f831743f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:30.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f831743f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:30.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f831743f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:30.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389ea17ac0 con 0x56389e9cffd0 2024-04-23T18:29:30.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.901+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f830808c040 con 0x56389e9cffd0 2024-04-23T18:29:30.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.902+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389ea1b290 con 0x56389e9cb5e0 2024-04-23T18:29:30.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.903+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.903+0000 7f831743f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:30.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.903+0000 7f831743f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:30.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.903+0000 7f831743f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:30.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.903+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94801179552992 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56389ea16ab0 con 0x56389e9cb5e0 2024-04-23T18:29:30.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.903+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify (1) cookie 94801179286128 notify 137438953473 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f8310046450 con 0x56389e9cb5e0 2024-04-23T18:29:30.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.903+0000 7f81ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94801179286128 notifier 4308 bl.length()=567 2024-04-23T18:29:30.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.903+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(65 notify.4 [notify cookie 94801179552992 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.903+0000 7f81ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:30.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.903+0000 7f81ebfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:30.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.903+0000 7f81ebfff640 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f81d8003ea0 con 0x56389e9cb5e0 2024-04-23T18:29:30.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.903+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.903+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify_complete (2) cookie 94801179552992 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8310046620 con 0x56389e9cb5e0 2024-04-23T18:29:30.910 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.904+0000 7f81cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.904+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94801179304448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9e0ee0 con 0x56389e9cb5e0 2024-04-23T18:29:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.905+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94801179304448] v32'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.905+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94801179282240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9de200 con 0x56389e9cffd0 2024-04-23T18:29:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.906+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94801179282240] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830808c040 con 0x56389e9cffd0 2024-04-23T18:29:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.906+0000 7f831743f800 20 remove_watcher() i=0 2024-04-23T18:29:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.906+0000 7f831743f800 2 removed watcher, disabling cache 2024-04-23T18:29:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.906+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94801179285072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9de200 con 0x56389e9cb5e0 2024-04-23T18:29:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.907+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94801179285072] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.907+0000 7f831743f800 20 remove_watcher() i=1 2024-04-23T18:29:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.907+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94801179288960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9de200 con 0x56389e9d4910 2024-04-23T18:29:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.908+0000 7f830ffff640 1 -- 172.21.15.119:0/2306397617 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94801179288960] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8300070070 con 0x56389e9d4910 2024-04-23T18:29:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.908+0000 7f831743f800 20 remove_watcher() i=2 2024-04-23T18:29:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.908+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94801179294000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d9650 con 0x56389e9cffd0 2024-04-23T18:29:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.909+0000 7f8314f3e640 1 -- 172.21.15.119:0/2306397617 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94801179294000] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f830808c040 con 0x56389e9cffd0 2024-04-23T18:29:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.909+0000 7f831743f800 20 remove_watcher() i=3 2024-04-23T18:29:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.909+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94801179286128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9d9650 con 0x56389e9cb5e0 2024-04-23T18:29:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.910+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94801179286128] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9cb5e0 2024-04-23T18:29:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.910+0000 7f831743f800 20 remove_watcher() i=4 2024-04-23T18:29:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.910+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94801179299472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9da580 con 0x56389e9b8410 2024-04-23T18:29:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.911+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94801179299472] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9b8410 2024-04-23T18:29:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.911+0000 7f831743f800 20 remove_watcher() i=5 2024-04-23T18:29:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.911+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94801179300528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9dce90 con 0x56389e9b8410 2024-04-23T18:29:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.912+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94801179300528] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9b8410 2024-04-23T18:29:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.912+0000 7f831743f800 20 remove_watcher() i=6 2024-04-23T18:29:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.912+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94801179302096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56389e9db930 con 0x56389e9b8410 2024-04-23T18:29:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94801179302096] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8310040040 con 0x56389e9b8410 2024-04-23T18:29:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 20 remove_watcher() i=7 2024-04-23T18:29:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56389e9b8410 msgr2=0x7f8308060870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56389e9b8410 0x7f8308060870 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56389e9cb5e0 msgr2=0x56389e9cdaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56389e9cb5e0 0x56389e9cdaa0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56389e9cffd0 msgr2=0x56389e9d23c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56389e9cffd0 0x56389e9d23c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56389e9d4910 msgr2=0x56389e9d6dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56389e9d4910 0x56389e9d6dd0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81e0036e60 msgr2=0x7f81e0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81e0036e60 0x7f81e0039320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8300005810 tx=0x7f8300060040 comp rx=0 tx=0).stop 2024-04-23T18:29:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9bf9d0 msgr2=0x56389e9bfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831573f640 1 -- 172.21.15.119:0/2306397617 reap_dead start 2024-04-23T18:29:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9bf9d0 0x56389e9bfdf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x56389e9b4e70 tx=0x7f830801ef30 comp rx=0 tx=0).stop 2024-04-23T18:29:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 shutdown_connections 2024-04-23T18:29:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 --2- 172.21.15.119:0/2306397617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e9bf9d0 0x56389e9bfdf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 >> 172.21.15.119:0/2306397617 conn(0x56389e9b4770 msgr2=0x56389e9b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 shutdown_connections 2024-04-23T18:29:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2306397617 wait complete. 2024-04-23T18:29:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2576623699 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81ec036e60 msgr2=0x7f81ec039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 --2- 172.21.15.119:0/2576623699 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81ec036e60 0x7f81ec039320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x56389e98ef20 tx=0x7f8300005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2576623699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e983810 msgr2=0x56389e981c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 --2- 172.21.15.119:0/2576623699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e983810 0x56389e981c80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f830804b2c0 tx=0x7f8308024e50 comp rx=0 tx=0).stop 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2576623699 shutdown_connections 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 --2- 172.21.15.119:0/2576623699 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81ec036e60 0x7f81ec039320 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 --2- 172.21.15.119:0/2576623699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e983810 0x56389e981c80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.913+0000 7f831743f800 1 -- 172.21.15.119:0/2576623699 >> 172.21.15.119:0/2576623699 conn(0x56389e99d1a0 msgr2=0x56389e99d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 -- 172.21.15.119:0/2576623699 shutdown_connections 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 -- 172.21.15.119:0/2576623699 wait complete. 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56389e998070 msgr2=0x56389e99a530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56389e998070 0x56389e99a530 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56389e895350 msgr2=0x56389e991a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56389e895350 0x56389e991a30 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56389e993fc0 msgr2=0x56389e996480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56389e993fc0 0x56389e996480 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81fc036eb0 msgr2=0x7f81fc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f81fc036eb0 0x7f81fc039370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8300054000 tx=0x7f830004e000 comp rx=0 tx=0).stop 2024-04-23T18:29:30.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e8913a0 msgr2=0x56389e98a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:30.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 --2- 172.21.15.119:0/3829201021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56389e8913a0 0x56389e98a9c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f830800c010 tx=0x7f8308000bc0 comp rx=0 tx=0).stop 2024-04-23T18:29:30.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831573f640 1 -- 172.21.15.119:0/3829201021 reap_dead start 2024-04-23T18:29:30.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 shutdown_connections 2024-04-23T18:29:30.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 >> 172.21.15.119:0/3829201021 conn(0x56389e88bba0 msgr2=0x56389e97bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:30.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 shutdown_connections 2024-04-23T18:29:30.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:30.914+0000 7f831743f800 1 -- 172.21.15.119:0/3829201021 wait complete. 2024-04-23T18:29:30.922 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:30.922 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-23T18:29:30.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-23T18:29:30.922 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-23T18:29:30.999 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:30.999 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:31.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.007+0000 7f2fc09a2800 1 Processor -- start 2024-04-23T18:29:31.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.007+0000 7f2fc09a2800 1 -- start start 2024-04-23T18:29:31.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.007+0000 7f2fc09a2800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5592faa283d0 0x5592faa30ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.007+0000 7f2fc09a2800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5592fa8d8560 con 0x5592faa26890 2024-04-23T18:29:31.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.007+0000 7f2fc09a2800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5592fa8c9e20 con 0x5592faa283d0 2024-04-23T18:29:31.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.008+0000 7f2fbdca0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5592faa283d0 0x5592faa30ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.008+0000 7f2fbe4a1640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5592faa26890 0x5592faa26cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40516/0 (socket says 172.21.15.119:40516) 2024-04-23T18:29:31.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.008+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/1405054234 learned_addr learned my addr 172.21.15.119:0/1405054234 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:31.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.008+0000 7f2fbdca0640 1 -- 172.21.15.119:0/1405054234 >> v1:172.21.15.62:6789/0 conn(0x5592faa26890 legacy=0x5592faa26cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.008+0000 7f2fbdca0640 1 -- 172.21.15.119:0/1405054234 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592fa8d7e60 con 0x5592faa283d0 2024-04-23T18:29:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.010+0000 7f2fbdca0640 1 --2- 172.21.15.119:0/1405054234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa283d0 0x5592faa30ed0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400a470 tx=0x7f2fb401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cac34dec8db9a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.010+0000 7f2fbd49f640 1 -- 172.21.15.119:0/1405054234 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb4057070 con 0x5592faa283d0 2024-04-23T18:29:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.010+0000 7f2fbd49f640 1 -- 172.21.15.119:0/1405054234 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb4052440 con 0x5592faa283d0 2024-04-23T18:29:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.010+0000 7f2fbd49f640 1 -- 172.21.15.119:0/1405054234 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb4052740 con 0x5592faa283d0 2024-04-23T18:29:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.010+0000 7f2fc09a2800 1 -- 172.21.15.119:0/1405054234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa283d0 msgr2=0x5592faa30ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.010+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/1405054234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa283d0 0x5592faa30ed0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400a470 tx=0x7f2fb401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.011+0000 7f2fc09a2800 1 -- 172.21.15.119:0/1405054234 shutdown_connections 2024-04-23T18:29:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.011+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/1405054234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa283d0 0x5592faa30ed0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.011+0000 7f2fc09a2800 1 -- 172.21.15.119:0/1405054234 >> 172.21.15.119:0/1405054234 conn(0x5592faa22410 msgr2=0x5592faa24830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.011+0000 7f2fc09a2800 1 -- 172.21.15.119:0/1405054234 shutdown_connections 2024-04-23T18:29:31.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.011+0000 7f2fc09a2800 1 -- 172.21.15.119:0/1405054234 wait complete. 2024-04-23T18:29:31.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.022+0000 7f2fc09a2800 1 Processor -- start 2024-04-23T18:29:31.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.022+0000 7f2fc09a2800 1 -- start start 2024-04-23T18:29:31.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.022+0000 7f2fc09a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa26890 0x5592fab1b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.022+0000 7f2fc09a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5592fa9735b0 con 0x5592faa26890 2024-04-23T18:29:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.023+0000 7f2fbe4a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa26890 0x5592fab1b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.023+0000 7f2fbe4a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa26890 0x5592fab1b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60632/0 (socket says 172.21.15.119:60632) 2024-04-23T18:29:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.023+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/3429353344 learned_addr learned my addr 172.21.15.119:0/3429353344 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.023+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/3429353344 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592fa8e9860 con 0x5592faa26890 2024-04-23T18:29:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.023+0000 7f2fbe4a1640 1 --2- 172.21.15.119:0/3429353344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa26890 0x5592fab1b5b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0001de0 tx=0x7f2fb000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8484d20c460f8c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.023+0000 7f2eac608640 1 -- 172.21.15.119:0/3429353344 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb0012020 con 0x5592faa26890 2024-04-23T18:29:31.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.023+0000 7f2eac608640 1 -- 172.21.15.119:0/3429353344 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb000e5a0 con 0x5592faa26890 2024-04-23T18:29:31.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.023+0000 7f2eac608640 1 -- 172.21.15.119:0/3429353344 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb000e8c0 con 0x5592faa26890 2024-04-23T18:29:31.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.024+0000 7f2fc09a2800 1 -- 172.21.15.119:0/3429353344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa26890 msgr2=0x5592fab1b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.024+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/3429353344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa26890 0x5592fab1b5b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0001de0 tx=0x7f2fb000b6c0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.024+0000 7f2fc09a2800 1 -- 172.21.15.119:0/3429353344 shutdown_connections 2024-04-23T18:29:31.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.024+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/3429353344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa26890 0x5592fab1b5b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.024+0000 7f2fc09a2800 1 -- 172.21.15.119:0/3429353344 >> 172.21.15.119:0/3429353344 conn(0x5592faa22410 msgr2=0x5592fab16ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.024+0000 7f2fc09a2800 1 -- 172.21.15.119:0/3429353344 shutdown_connections 2024-04-23T18:29:31.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.024+0000 7f2fc09a2800 1 -- 172.21.15.119:0/3429353344 wait complete. 2024-04-23T18:29:31.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.024+0000 7f2fc09a2800 1 Processor -- start 2024-04-23T18:29:31.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.025+0000 7f2fc09a2800 1 -- start start 2024-04-23T18:29:31.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.025+0000 7f2fc09a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa26890 0x5592fab22f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.025+0000 7f2fc09a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5592faa336f0 con 0x5592faa26890 2024-04-23T18:29:31.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.025+0000 7f2fbe4a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa26890 0x5592fab22f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.025+0000 7f2fbe4a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa26890 0x5592fab22f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60634/0 (socket says 172.21.15.119:60634) 2024-04-23T18:29:31.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.025+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/2987822629 learned_addr learned my addr 172.21.15.119:0/2987822629 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.025+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/2987822629 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592fa8e7eb0 con 0x5592faa26890 2024-04-23T18:29:31.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.025+0000 7f2fbe4a1640 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa26890 0x5592fab22f10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000c010 tx=0x7f2fb0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.026+0000 7f2eaae05640 1 -- 172.21.15.119:0/2987822629 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb0012070 con 0x5592faa26890 2024-04-23T18:29:31.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.026+0000 7f2eaae05640 1 -- 172.21.15.119:0/2987822629 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb001a7a0 con 0x5592faa26890 2024-04-23T18:29:31.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.026+0000 7f2eaae05640 1 -- 172.21.15.119:0/2987822629 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb001aa80 con 0x5592faa26890 2024-04-23T18:29:31.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.026+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592fab23450 con 0x5592faa26890 2024-04-23T18:29:31.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.026+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592fab23970 con 0x5592faa26890 2024-04-23T18:29:31.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.026+0000 7f2eaae05640 1 -- 172.21.15.119:0/2987822629 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2fb0015020 con 0x5592faa26890 2024-04-23T18:29:31.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.027+0000 7f2eaae05640 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2ea4036eb0 0x7f2ea4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.027+0000 7f2eaae05640 1 -- 172.21.15.119:0/2987822629 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f2fb0020070 con 0x5592faa26890 2024-04-23T18:29:31.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.027+0000 7f2fbdca0640 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2ea4036eb0 0x7f2ea4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.027+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5592faa283d0 0x5592fab29f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.027+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab2a500 con 0x5592faa283d0 2024-04-23T18:29:31.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.027+0000 7f2fbeca2640 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5592faa283d0 0x5592fab29f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.027+0000 7f2fbdca0640 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2ea4036eb0 0x7f2ea4039370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4054000 tx=0x7f2fb404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.027+0000 7f2fbeca2640 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5592faa283d0 0x5592fab29f80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.027+0000 7f2fbeca2640 1 -- 172.21.15.119:0/2987822629 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592faa283d0 2024-04-23T18:29:31.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.027+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab27550 con 0x5592faa283d0 2024-04-23T18:29:31.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.028+0000 7f2fbeca2640 1 -- 172.21.15.119:0/2987822629 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592faa283d0 2024-04-23T18:29:31.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.028+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5592fab2c810 0x5592fab2ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.028+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab2f2a0 con 0x5592fab2c810 2024-04-23T18:29:31.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.028+0000 7f2fbe4a1640 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5592fab2c810 0x5592fab2ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.028+0000 7f2fbe4a1640 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5592fab2c810 0x5592fab2ec00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.028+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/2987822629 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2fb002b070 con 0x5592fab2c810 2024-04-23T18:29:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.028+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab2b7c0 con 0x5592faa283d0 2024-04-23T18:29:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.029+0000 7f2fbeca2640 1 -- 172.21.15.119:0/2987822629 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592faa283d0 2024-04-23T18:29:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.029+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5592fab30750 0x5592fab32bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.029+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab33320 con 0x5592fab30750 2024-04-23T18:29:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.029+0000 7f2fbdca0640 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5592fab30750 0x5592fab32bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.029+0000 7f2fbdca0640 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5592fab30750 0x5592fab32bc0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.030+0000 7f2fbdca0640 1 -- 172.21.15.119:0/2987822629 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2fb4052910 con 0x5592fab30750 2024-04-23T18:29:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.030+0000 7f2fc09a2800 1 Processor -- start 2024-04-23T18:29:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.030+0000 7f2fc09a2800 1 -- start start 2024-04-23T18:29:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.030+0000 7f2fc09a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab41750 0x5592fab41b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.030+0000 7f2fc09a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5592fa919df0 con 0x5592fab41750 2024-04-23T18:29:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.030+0000 7f2fbe4a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab41750 0x5592fab41b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.030+0000 7f2fbe4a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab41750 0x5592fab41b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60650/0 (socket says 172.21.15.119:60650) 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.030+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/2057115342 learned_addr learned my addr 172.21.15.119:0/2057115342 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.031+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/2057115342 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592fab420b0 con 0x5592fab41750 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.031+0000 7f2fbe4a1640 1 --2- 172.21.15.119:0/2057115342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab41750 0x5592fab41b70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0022530 tx=0x7f2fb0016ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.031+0000 7f2ea3fff640 1 -- 172.21.15.119:0/2057115342 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb0034070 con 0x5592fab41750 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.031+0000 7f2ea3fff640 1 -- 172.21.15.119:0/2057115342 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb0044130 con 0x5592fab41750 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.031+0000 7f2ea3fff640 1 -- 172.21.15.119:0/2057115342 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb0044410 con 0x5592fab41750 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.031+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2057115342 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592fab42b20 con 0x5592fab41750 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.031+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2057115342 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592fab43020 con 0x5592fab41750 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.032+0000 7f2ea3fff640 1 -- 172.21.15.119:0/2057115342 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2fb0044680 con 0x5592fab41750 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.032+0000 7f2ea3fff640 1 --2- 172.21.15.119:0/2057115342 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e98036e60 0x7f2e98039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.032+0000 7f2ea3fff640 1 -- 172.21.15.119:0/2057115342 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f2fb002fcc0 con 0x5592fab41750 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.032+0000 7f2fbdca0640 1 --2- 172.21.15.119:0/2057115342 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e98036e60 0x7f2e98039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.032+0000 7f2fc09a2800 1 Processor -- start 2024-04-23T18:29:31.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.032+0000 7f2fc09a2800 1 -- start start 2024-04-23T18:29:31.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.032+0000 7f2fbdca0640 1 --2- 172.21.15.119:0/2057115342 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e98036e60 0x7f2e98039320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5592fab27470 tx=0x7f2fb4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.032+0000 7f2fc09a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 0x5592fab4ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.032+0000 7f2fc09a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5592fab1bd30 con 0x5592fab4e8f0 2024-04-23T18:29:31.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.032+0000 7f2fbe4a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 0x5592fab4ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.032+0000 7f2fbe4a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 0x5592fab4ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60656/0 (socket says 172.21.15.119:60656) 2024-04-23T18:29:31.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.032+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/441912320 learned_addr learned my addr 172.21.15.119:0/441912320 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.033+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/441912320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592fab4f2e0 con 0x5592fab4e8f0 2024-04-23T18:29:31.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.033+0000 7f2fbe4a1640 1 --2- 172.21.15.119:0/441912320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 0x5592fab4ed10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0018740 tx=0x7f2fb0049f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcdbda2198471c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.033+0000 7f2ea1ffb640 1 -- 172.21.15.119:0/441912320 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb00198c0 con 0x5592fab4e8f0 2024-04-23T18:29:31.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.033+0000 7f2ea1ffb640 1 -- 172.21.15.119:0/441912320 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb000d8e0 con 0x5592fab4e8f0 2024-04-23T18:29:31.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.033+0000 7f2ea1ffb640 1 -- 172.21.15.119:0/441912320 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb0019a60 con 0x5592fab4e8f0 2024-04-23T18:29:31.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.033+0000 7f2fc09a2800 1 -- 172.21.15.119:0/441912320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 msgr2=0x5592fab4ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.033+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/441912320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 0x5592fab4ed10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0018740 tx=0x7f2fb0049f90 comp rx=0 tx=0).stop 2024-04-23T18:29:31.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.033+0000 7f2fc09a2800 1 -- 172.21.15.119:0/441912320 shutdown_connections 2024-04-23T18:29:31.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.033+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/441912320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 0x5592fab4ed10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.033+0000 7f2fc09a2800 1 -- 172.21.15.119:0/441912320 >> 172.21.15.119:0/441912320 conn(0x5592fab4ab70 msgr2=0x5592fab48bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.034+0000 7f2fc09a2800 1 -- 172.21.15.119:0/441912320 shutdown_connections 2024-04-23T18:29:31.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.034+0000 7f2fc09a2800 1 -- 172.21.15.119:0/441912320 wait complete. 2024-04-23T18:29:31.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.034+0000 7f2fc09a2800 1 Processor -- start 2024-04-23T18:29:31.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.034+0000 7f2fc09a2800 1 -- start start 2024-04-23T18:29:31.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.034+0000 7f2fc09a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 0x5592fab55c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.034+0000 7f2fc09a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5592fab4f950 con 0x5592fab4e8f0 2024-04-23T18:29:31.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.034+0000 7f2fbe4a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 0x5592fab55c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.034+0000 7f2fbe4a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 0x5592fab55c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60668/0 (socket says 172.21.15.119:60668) 2024-04-23T18:29:31.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.034+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 learned_addr learned my addr 172.21.15.119:0/863122412 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.034+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592fab56140 con 0x5592fab4e8f0 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.035+0000 7f2fbe4a1640 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 0x5592fab55c00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0018740 tx=0x7f2fb0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.035+0000 7f2e8ffff640 1 -- 172.21.15.119:0/863122412 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb006c070 con 0x5592fab4e8f0 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.035+0000 7f2e8ffff640 1 -- 172.21.15.119:0/863122412 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb0060040 con 0x5592fab4e8f0 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.035+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592fab56140 con 0x5592fab4e8f0 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.035+0000 7f2e8ffff640 1 -- 172.21.15.119:0/863122412 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fb003f700 con 0x5592fab4e8f0 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.035+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592fab56140 con 0x5592fab4e8f0 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.035+0000 7f2e8ffff640 1 -- 172.21.15.119:0/863122412 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2fb006f070 con 0x5592fab4e8f0 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.036+0000 7f2fc09a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.036+0000 7f2e8ffff640 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e88036eb0 0x7f2e88039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.036+0000 7f2e8ffff640 1 -- 172.21.15.119:0/863122412 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f2fb0067cc0 con 0x5592fab4e8f0 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.036+0000 7f2fbdca0640 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e88036eb0 0x7f2e88039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.036+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5592fab61380 0x5592fab637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.036+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab63f40 con 0x5592fab61380 2024-04-23T18:29:31.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.036+0000 7f2fbeca2640 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5592fab61380 0x5592fab637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.036+0000 7f2fbdca0640 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e88036eb0 0x7f2e88039370 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2fb401ced0 tx=0x7f2fb404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.036+0000 7f2fbeca2640 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5592fab61380 0x5592fab637f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.036+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592fab61380 2024-04-23T18:29:31.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 20 realm 2024-04-23T18:29:31.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab643a0 con 0x5592fab61380 2024-04-23T18:29:31.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592fab61380 2024-04-23T18:29:31.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:31.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64c40 con 0x5592fab61380 2024-04-23T18:29:31.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592fab61380 2024-04-23T18:29:31.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab61380 2024-04-23T18:29:31.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592fab61380 2024-04-23T18:29:31.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5592fab65b10 0x5592fab67f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab68640 con 0x5592fab65b10 2024-04-23T18:29:31.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.037+0000 7f2fbe4a1640 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5592fab65b10 0x5592fab67f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.038+0000 7f2fbe4a1640 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5592fab65b10 0x5592fab67f00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.038+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2fb006e030 con 0x5592fab65b10 2024-04-23T18:29:31.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.038+0000 7f2fc09a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:31.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.038+0000 7f2fc09a2800 20 searching for the correct realm 2024-04-23T18:29:31.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.038+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5592fab6a6e0 0x5592fab6cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.038+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab6d270 con 0x5592fab6a6e0 2024-04-23T18:29:31.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.038+0000 7f2fbdca0640 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5592fab6a6e0 0x5592fab6cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.038+0000 7f2fbdca0640 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5592fab6a6e0 0x5592fab6cba0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.039+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.039+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab6d270 con 0x5592fab65b10 2024-04-23T18:29:31.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.039+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb006e030 con 0x5592fab65b10 2024-04-23T18:29:31.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.039+0000 7f2fbe4a1640 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f2fb0071060 0x7f2fb0030020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.039+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab6d270 con 0x7f2fb0071060 2024-04-23T18:29:31.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.039+0000 7f2fbeca2640 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f2fb0071060 0x7f2fb0030020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.039+0000 7f2fbeca2640 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f2fb0071060 0x7f2fb0030020 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.040+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb800a4a0 con 0x7f2fb0071060 2024-04-23T18:29:31.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.040+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab61380 2024-04-23T18:29:31.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.040+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592fab61380 2024-04-23T18:29:31.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.040+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab61380 2024-04-23T18:29:31.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.040+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592fab61380 2024-04-23T18:29:31.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.040+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x7f2fb0071060 2024-04-23T18:29:31.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.040+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb800a4a0 con 0x7f2fb0071060 2024-04-23T18:29:31.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.040+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x7f2fb0071060 2024-04-23T18:29:31.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.040+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2fb800a4a0 con 0x7f2fb0071060 2024-04-23T18:29:31.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.040+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab65b10 2024-04-23T18:29:31.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.041+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb0080040 con 0x5592fab65b10 2024-04-23T18:29:31.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.041+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab6a6e0 2024-04-23T18:29:31.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.041+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.041+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab61380 2024-04-23T18:29:31.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.041+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592fab61380 2024-04-23T18:29:31.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.041+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x7f2fb0071060 2024-04-23T18:29:31.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.041+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb800a4a0 con 0x7f2fb0071060 2024-04-23T18:29:31.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.041+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab61380 2024-04-23T18:29:31.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.042+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592fab61380 2024-04-23T18:29:31.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.042+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab65b10 2024-04-23T18:29:31.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.042+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2fb0080040 con 0x5592fab65b10 2024-04-23T18:29:31.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.042+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab6a6e0 2024-04-23T18:29:31.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.042+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.042+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab6a6e0 2024-04-23T18:29:31.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.042+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.042+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x7f2fb0071060 2024-04-23T18:29:31.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.043+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb800a4a0 con 0x7f2fb0071060 2024-04-23T18:29:31.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.043+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab6a6e0 2024-04-23T18:29:31.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.043+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.043+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab6a6e0 2024-04-23T18:29:31.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.043+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.043+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab61380 2024-04-23T18:29:31.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.043+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592fab61380 2024-04-23T18:29:31.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.043+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab61380 2024-04-23T18:29:31.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.044+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592fab61380 2024-04-23T18:29:31.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.044+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x7f2fb0071060 2024-04-23T18:29:31.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.044+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb800a4a0 con 0x7f2fb0071060 2024-04-23T18:29:31.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.044+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab6a6e0 2024-04-23T18:29:31.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.044+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.044+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab65b10 2024-04-23T18:29:31.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.045+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2fb0080040 con 0x5592fab65b10 2024-04-23T18:29:31.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.045+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab61380 2024-04-23T18:29:31.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.045+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb800a4a0 con 0x5592fab61380 2024-04-23T18:29:31.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.045+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x7f2fb0071060 2024-04-23T18:29:31.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.045+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb800a4a0 con 0x7f2fb0071060 2024-04-23T18:29:31.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.045+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab6a6e0 2024-04-23T18:29:31.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.045+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.045+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x7f2fb0071060 2024-04-23T18:29:31.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.046+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb800a4a0 con 0x7f2fb0071060 2024-04-23T18:29:31.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.046+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab65b10 2024-04-23T18:29:31.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.046+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb0080040 con 0x5592fab65b10 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.046+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab6a6e0 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.046+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.046+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x7f2fb0071060 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.046+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb8040040 con 0x7f2fb0071060 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.046+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab61380 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.046+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2fb8040040 con 0x5592fab61380 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5592fab64fe0 con 0x5592fab65b10 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2fb0080040 con 0x5592fab65b10 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:31.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:31.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab68fe0 con 0x5592fab61380 2024-04-23T18:29:31.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x5592fab61380 2024-04-23T18:29:31.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab68fe0 con 0x5592fab61380 2024-04-23T18:29:31.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2fb8040040 con 0x5592fab61380 2024-04-23T18:29:31.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.047+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab68f90 con 0x7f2fb0071060 2024-04-23T18:29:31.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2fb8040040 con 0x7f2fb0071060 2024-04-23T18:29:31.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 20 zone default found 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 4 Realm: () 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 20 zonegroup default 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab693d0 con 0x7f2fb0071060 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x7f2fb0071060 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab69810 con 0x5592fab6a6e0 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab6f0d0 con 0x5592fab6a6e0 2024-04-23T18:29:31.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 20 started sync module instance, tier type = 2024-04-23T18:29:31.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:31.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.048+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab6e570 con 0x5592fab65b10 2024-04-23T18:29:31.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.049+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0080040 con 0x5592fab65b10 2024-04-23T18:29:31.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.049+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94089759875264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab6f470 con 0x5592fab65b10 2024-04-23T18:29:31.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.049+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab6fcc0 con 0x5592fab61380 2024-04-23T18:29:31.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.050+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94089759875264] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0080040 con 0x5592fab65b10 2024-04-23T18:29:31.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.051+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x5592fab61380 2024-04-23T18:29:31.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.051+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94089759881232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab700e0 con 0x5592fab61380 2024-04-23T18:29:31.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.051+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab70990 con 0x5592fab6a6e0 2024-04-23T18:29:31.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.052+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.052+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94089759884000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab71230 con 0x5592fab6a6e0 2024-04-23T18:29:31.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.052+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab71d00 con 0x5592fab65b10 2024-04-23T18:29:31.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.052+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94089759881232] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x5592fab61380 2024-04-23T18:29:31.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.053+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94089759884000] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.053+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0080040 con 0x5592fab65b10 2024-04-23T18:29:31.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.053+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94089759889392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab720f0 con 0x5592fab65b10 2024-04-23T18:29:31.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.053+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab72980 con 0x5592fab61380 2024-04-23T18:29:31.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.054+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x5592fab61380 2024-04-23T18:29:31.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.054+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94089759889392] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0080040 con 0x5592fab65b10 2024-04-23T18:29:31.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.054+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94089759891696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab72550 con 0x5592fab61380 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.054+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab6fc70 con 0x7f2fb0071060 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.055+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x7f2fb0071060 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.055+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94089759882352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab738f0 con 0x7f2fb0071060 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.055+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab74310 con 0x7f2fb0071060 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.056+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94089759891696] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x5592fab61380 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.056+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94089759882352] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x7f2fb0071060 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.056+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x7f2fb0071060 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.056+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94089759899136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab73440 con 0x7f2fb0071060 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.056+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab748f0 con 0x7f2fb0071060 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.057+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94089759899136] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x7f2fb0071060 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.058+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x7f2fb0071060 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.058+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94089759894896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab748f0 con 0x7f2fb0071060 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.058+0000 7f2fc09a2800 20 add_watcher() i=0 2024-04-23T18:29:31.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.058+0000 7f2fc09a2800 20 add_watcher() i=1 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.058+0000 7f2fc09a2800 20 add_watcher() i=2 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.058+0000 7f2fc09a2800 20 add_watcher() i=3 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.058+0000 7f2fc09a2800 20 add_watcher() i=4 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.058+0000 7f2fc09a2800 20 add_watcher() i=5 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.058+0000 7f2fc09a2800 20 add_watcher() i=6 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.059+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94089759894896] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x7f2fb0071060 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.059+0000 7f2fc09a2800 20 add_watcher() i=7 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.059+0000 7f2fc09a2800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.059+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fab77ba0 con 0x5592fab61380 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.059+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2fb8040040 con 0x5592fab61380 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.059+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94089759901104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab74e80 con 0x5592fab61380 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.060+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94089759901104] v32'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x5592fab61380 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.060+0000 7f2e74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.060+0000 7f2fc09a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:31.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.060+0000 7f2fc09a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:31.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.060+0000 7f2fc09a2800 5 note: GC not initialized 2024-04-23T18:29:31.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.061+0000 7f2def7fe640 20 reqs_thread_entry: start 2024-04-23T18:29:31.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.061+0000 7f2fc09a2800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:31.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.061+0000 7f2fc09a2800 20 Filter name: none 2024-04-23T18:29:31.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.061+0000 7f2ded7fa640 20 reqs_thread_entry: start 2024-04-23T18:29:31.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.061+0000 7f2fc09a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.061+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5592fabaae90 con 0x5592fab61380 2024-04-23T18:29:31.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.061+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2fb8040040 con 0x5592fab61380 2024-04-23T18:29:31.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.061+0000 7f2fc09a2800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:31.067 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:31.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.062+0000 7f2e74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.062+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94089759901104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab77000 con 0x5592fab61380 2024-04-23T18:29:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.063+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94089759901104] v32'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x5592fab61380 2024-04-23T18:29:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.063+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94089759875264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab745b0 con 0x5592fab65b10 2024-04-23T18:29:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.064+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94089759875264] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0080040 con 0x5592fab65b10 2024-04-23T18:29:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.064+0000 7f2fc09a2800 20 remove_watcher() i=0 2024-04-23T18:29:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.064+0000 7f2fc09a2800 2 removed watcher, disabling cache 2024-04-23T18:29:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.064+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94089759881232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab745b0 con 0x5592fab61380 2024-04-23T18:29:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.065+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94089759881232] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x5592fab61380 2024-04-23T18:29:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.065+0000 7f2fc09a2800 20 remove_watcher() i=1 2024-04-23T18:29:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.065+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94089759884000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab6f810 con 0x5592fab6a6e0 2024-04-23T18:29:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.066+0000 7f2fbdca0640 1 -- 172.21.15.119:0/863122412 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94089759884000] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb4081070 con 0x5592fab6a6e0 2024-04-23T18:29:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.066+0000 7f2fc09a2800 20 remove_watcher() i=2 2024-04-23T18:29:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.066+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94089759889392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab745b0 con 0x5592fab65b10 2024-04-23T18:29:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.067+0000 7f2fbe4a1640 1 -- 172.21.15.119:0/863122412 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94089759889392] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb0080040 con 0x5592fab65b10 2024-04-23T18:29:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.067+0000 7f2fc09a2800 20 remove_watcher() i=3 2024-04-23T18:29:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.067+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94089759891696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab717f0 con 0x5592fab61380 2024-04-23T18:29:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.068+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94089759891696] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x5592fab61380 2024-04-23T18:29:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.068+0000 7f2fc09a2800 20 remove_watcher() i=4 2024-04-23T18:29:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.068+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94089759882352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab745b0 con 0x7f2fb0071060 2024-04-23T18:29:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.069+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94089759882352] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x7f2fb0071060 2024-04-23T18:29:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.069+0000 7f2fc09a2800 20 remove_watcher() i=5 2024-04-23T18:29:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.069+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94089759899136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab720f0 con 0x7f2fb0071060 2024-04-23T18:29:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.070+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94089759899136] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x7f2fb0071060 2024-04-23T18:29:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.070+0000 7f2fc09a2800 20 remove_watcher() i=6 2024-04-23T18:29:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.070+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94089759894896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5592fab717f0 con 0x7f2fb0071060 2024-04-23T18:29:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94089759894896] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2fb8040040 con 0x7f2fb0071060 2024-04-23T18:29:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 20 remove_watcher() i=7 2024-04-23T18:29:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f2fb0071060 msgr2=0x7f2fb0030020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f2fb0071060 0x7f2fb0030020 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5592fab61380 msgr2=0x5592fab637f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5592fab61380 0x5592fab637f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5592fab65b10 msgr2=0x5592fab67f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5592fab65b10 0x5592fab67f00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5592fab6a6e0 msgr2=0x5592fab6cba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5592fab6a6e0 0x5592fab6cba0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e88036eb0 msgr2=0x7f2e88039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e88036eb0 0x7f2e88039370 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2fb401ced0 tx=0x7f2fb404f000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fbeca2640 1 -- 172.21.15.119:0/863122412 reap_dead start 2024-04-23T18:29:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 msgr2=0x5592fab55c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 0x5592fab55c00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0018740 tx=0x7f2fb0007ea0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 shutdown_connections 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/863122412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab4e8f0 0x5592fab55c00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 >> 172.21.15.119:0/863122412 conn(0x5592fab4ab70 msgr2=0x5592fab481d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 shutdown_connections 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/863122412 wait complete. 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2057115342 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e98036e60 msgr2=0x7f2e98039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/2057115342 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e98036e60 0x7f2e98039320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5592fab27470 tx=0x7f2fb4005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2057115342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab41750 msgr2=0x5592fab41b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/2057115342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab41750 0x5592fab41b70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0022530 tx=0x7f2fb0016ea0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2057115342 shutdown_connections 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/2057115342 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2e98036e60 0x7f2e98039320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/2057115342 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592fab41750 0x5592fab41b70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2057115342 >> 172.21.15.119:0/2057115342 conn(0x5592fab357f0 msgr2=0x5592fab35bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2057115342 shutdown_connections 2024-04-23T18:29:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.071+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2057115342 wait complete. 2024-04-23T18:29:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5592fab30750 msgr2=0x5592fab32bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5592fab30750 0x5592fab32bc0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5592faa283d0 msgr2=0x5592fab29f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5592faa283d0 0x5592fab29f80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5592fab2c810 msgr2=0x5592fab2ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5592fab2c810 0x5592fab2ec00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2ea4036eb0 msgr2=0x7f2ea4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2ea4036eb0 0x7f2ea4039370 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4054000 tx=0x7f2fb404e000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa26890 msgr2=0x5592fab22f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 --2- 172.21.15.119:0/2987822629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5592faa26890 0x5592fab22f10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000c010 tx=0x7f2fb0000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fbeca2640 1 -- 172.21.15.119:0/2987822629 reap_dead start 2024-04-23T18:29:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 shutdown_connections 2024-04-23T18:29:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 >> 172.21.15.119:0/2987822629 conn(0x5592faa22410 msgr2=0x5592fab19fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 shutdown_connections 2024-04-23T18:29:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.072+0000 7f2fc09a2800 1 -- 172.21.15.119:0/2987822629 wait complete. 2024-04-23T18:29:31.078 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:31.078 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-23T18:29:31.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-23T18:29:31.078 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-23T18:29:31.156 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:31.156 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:31.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.164+0000 7f4c0992f800 1 Processor -- start 2024-04-23T18:29:31.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.164+0000 7f4c0992f800 1 -- start start 2024-04-23T18:29:31.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.164+0000 7f4c0992f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559de47932f0 0x559de47956e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.164+0000 7f4c0992f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559de4640560 con 0x559de478ee60 2024-04-23T18:29:31.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.164+0000 7f4c0992f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x559de4631e20 con 0x559de47932f0 2024-04-23T18:29:31.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.164+0000 7f4c04dd0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559de47932f0 0x559de47956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.164+0000 7f4c055d1640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x559de478ee60 0x559de478f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40530/0 (socket says 172.21.15.119:40530) 2024-04-23T18:29:31.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.164+0000 7f4c055d1640 1 -- 172.21.15.119:0/1311465761 learned_addr learned my addr 172.21.15.119:0/1311465761 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:31.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.164+0000 7f4c04dd0640 1 -- 172.21.15.119:0/1311465761 >> v1:172.21.15.62:6789/0 conn(0x559de478ee60 legacy=0x559de478f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.165+0000 7f4c04dd0640 1 -- 172.21.15.119:0/1311465761 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de463fe60 con 0x559de47932f0 2024-04-23T18:29:31.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.166+0000 7f4c04dd0640 1 --2- 172.21.15.119:0/1311465761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de47932f0 0x559de47956e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000a470 tx=0x7f4bf001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76da66101d5d72c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.166+0000 7f4bfffff640 1 -- 172.21.15.119:0/1311465761 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf0057070 con 0x559de47932f0 2024-04-23T18:29:31.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.166+0000 7f4bfffff640 1 -- 172.21.15.119:0/1311465761 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf0052570 con 0x559de47932f0 2024-04-23T18:29:31.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.167+0000 7f4bfffff640 1 -- 172.21.15.119:0/1311465761 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf0052870 con 0x559de47932f0 2024-04-23T18:29:31.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.167+0000 7f4c0992f800 1 -- 172.21.15.119:0/1311465761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de47932f0 msgr2=0x559de47956e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.167+0000 7f4c0992f800 1 --2- 172.21.15.119:0/1311465761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de47932f0 0x559de47956e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000a470 tx=0x7f4bf001ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:31.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.167+0000 7f4c0992f800 1 -- 172.21.15.119:0/1311465761 shutdown_connections 2024-04-23T18:29:31.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.167+0000 7f4c0992f800 1 --2- 172.21.15.119:0/1311465761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de47932f0 0x559de47956e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.167+0000 7f4c0992f800 1 -- 172.21.15.119:0/1311465761 >> 172.21.15.119:0/1311465761 conn(0x559de478a420 msgr2=0x559de478c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.167+0000 7f4c0992f800 1 -- 172.21.15.119:0/1311465761 shutdown_connections 2024-04-23T18:29:31.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.167+0000 7f4c0992f800 1 -- 172.21.15.119:0/1311465761 wait complete. 2024-04-23T18:29:31.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.179+0000 7f4c0992f800 1 Processor -- start 2024-04-23T18:29:31.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.179+0000 7f4c0992f800 1 -- start start 2024-04-23T18:29:31.172 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.179+0000 7f4c0992f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de478ee60 0x559de4702e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.179+0000 7f4c0992f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559de46db5b0 con 0x559de478ee60 2024-04-23T18:29:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.179+0000 7f4c055d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de478ee60 0x559de4702e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.179+0000 7f4c055d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de478ee60 0x559de4702e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60694/0 (socket says 172.21.15.119:60694) 2024-04-23T18:29:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.179+0000 7f4c055d1640 1 -- 172.21.15.119:0/3973524354 learned_addr learned my addr 172.21.15.119:0/3973524354 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.179+0000 7f4c055d1640 1 -- 172.21.15.119:0/3973524354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de4651860 con 0x559de478ee60 2024-04-23T18:29:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.179+0000 7f4c055d1640 1 --2- 172.21.15.119:0/3973524354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de478ee60 0x559de4702e60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80017a0 tx=0x7f4bf8001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf740e51baf97c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.180+0000 7f4af3606640 1 -- 172.21.15.119:0/3973524354 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf8016070 con 0x559de478ee60 2024-04-23T18:29:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.180+0000 7f4af3606640 1 -- 172.21.15.119:0/3973524354 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf8004520 con 0x559de478ee60 2024-04-23T18:29:31.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.180+0000 7f4af3606640 1 -- 172.21.15.119:0/3973524354 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf8004820 con 0x559de478ee60 2024-04-23T18:29:31.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.180+0000 7f4c0992f800 1 -- 172.21.15.119:0/3973524354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de478ee60 msgr2=0x559de4702e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.180+0000 7f4c0992f800 1 --2- 172.21.15.119:0/3973524354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de478ee60 0x559de4702e60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80017a0 tx=0x7f4bf8001c60 comp rx=0 tx=0).stop 2024-04-23T18:29:31.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.180+0000 7f4c0992f800 1 -- 172.21.15.119:0/3973524354 shutdown_connections 2024-04-23T18:29:31.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.180+0000 7f4c0992f800 1 --2- 172.21.15.119:0/3973524354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de478ee60 0x559de4702e60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.180+0000 7f4c0992f800 1 -- 172.21.15.119:0/3973524354 >> 172.21.15.119:0/3973524354 conn(0x559de478a420 msgr2=0x559de487b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.180+0000 7f4c0992f800 1 -- 172.21.15.119:0/3973524354 shutdown_connections 2024-04-23T18:29:31.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.180+0000 7f4c0992f800 1 -- 172.21.15.119:0/3973524354 wait complete. 2024-04-23T18:29:31.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.181+0000 7f4c0992f800 1 Processor -- start 2024-04-23T18:29:31.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.181+0000 7f4c0992f800 1 -- start start 2024-04-23T18:29:31.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.181+0000 7f4c0992f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de478ee60 0x559de4888ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.181+0000 7f4c0992f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559de4795fb0 con 0x559de478ee60 2024-04-23T18:29:31.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.181+0000 7f4c055d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de478ee60 0x559de4888ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.181+0000 7f4c055d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de478ee60 0x559de4888ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60706/0 (socket says 172.21.15.119:60706) 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.181+0000 7f4c055d1640 1 -- 172.21.15.119:0/3193663164 learned_addr learned my addr 172.21.15.119:0/3193663164 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.181+0000 7f4c055d1640 1 -- 172.21.15.119:0/3193663164 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de464feb0 con 0x559de478ee60 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.182+0000 7f4c055d1640 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de478ee60 0x559de4888ba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8000f80 tx=0x7f4bf8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.182+0000 7f4af1e03640 1 -- 172.21.15.119:0/3193663164 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf8016040 con 0x559de478ee60 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.182+0000 7f4af1e03640 1 -- 172.21.15.119:0/3193663164 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf8011530 con 0x559de478ee60 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.182+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559de48890e0 con 0x559de478ee60 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.182+0000 7f4af1e03640 1 -- 172.21.15.119:0/3193663164 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf8011890 con 0x559de478ee60 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.182+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559de4889660 con 0x559de478ee60 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.182+0000 7f4af1e03640 1 -- 172.21.15.119:0/3193663164 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4bf801c3f0 con 0x559de478ee60 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.183+0000 7f4af1e03640 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4aec036e60 0x7f4aec039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.183+0000 7f4af1e03640 1 -- 172.21.15.119:0/3193663164 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4bf804bff0 con 0x559de478ee60 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.183+0000 7f4c04dd0640 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4aec036e60 0x7f4aec039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.183+0000 7f4c0992f800 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559de47932f0 0x559de488fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.183+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de4890130 con 0x559de47932f0 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.183+0000 7f4c05dd2640 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559de47932f0 0x559de488fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.183+0000 7f4c04dd0640 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4aec036e60 0x7f4aec039320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0054000 tx=0x7f4bf004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.183+0000 7f4c05dd2640 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559de47932f0 0x559de488fac0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.184+0000 7f4c05dd2640 1 -- 172.21.15.119:0/3193663164 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c000083e0 con 0x559de47932f0 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.184+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de488d1c0 con 0x559de47932f0 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.184+0000 7f4c05dd2640 1 -- 172.21.15.119:0/3193663164 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c000083e0 con 0x559de47932f0 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.184+0000 7f4c0992f800 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559de4892460 0x559de4894850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.184+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de4894f40 con 0x559de4892460 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.184+0000 7f4c055d1640 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559de4892460 0x559de4894850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.184+0000 7f4c055d1640 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559de4892460 0x559de4894850 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.185+0000 7f4c055d1640 1 -- 172.21.15.119:0/3193663164 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4bf8019050 con 0x559de4892460 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.185+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de4891410 con 0x559de47932f0 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.185+0000 7f4c05dd2640 1 -- 172.21.15.119:0/3193663164 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c000083e0 con 0x559de47932f0 2024-04-23T18:29:31.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.185+0000 7f4c0992f800 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559de48963f0 0x559de4898820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.185+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de4898fb0 con 0x559de48963f0 2024-04-23T18:29:31.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.185+0000 7f4c04dd0640 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559de48963f0 0x559de4898820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.186+0000 7f4c04dd0640 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559de48963f0 0x559de4898820 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.186+0000 7f4c04dd0640 1 -- 172.21.15.119:0/3193663164 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4bf0052a40 con 0x559de48963f0 2024-04-23T18:29:31.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.186+0000 7f4c0992f800 1 Processor -- start 2024-04-23T18:29:31.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.186+0000 7f4c0992f800 1 -- start start 2024-04-23T18:29:31.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.186+0000 7f4c0992f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48a73d0 0x559de48a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.186+0000 7f4c0992f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559de4681df0 con 0x559de48a73d0 2024-04-23T18:29:31.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.187+0000 7f4c055d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48a73d0 0x559de48a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.187+0000 7f4c055d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48a73d0 0x559de48a77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60708/0 (socket says 172.21.15.119:60708) 2024-04-23T18:29:31.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.187+0000 7f4c055d1640 1 -- 172.21.15.119:0/1610211753 learned_addr learned my addr 172.21.15.119:0/1610211753 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.187+0000 7f4c055d1640 1 -- 172.21.15.119:0/1610211753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de48a7d30 con 0x559de48a73d0 2024-04-23T18:29:31.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.187+0000 7f4c055d1640 1 --2- 172.21.15.119:0/1610211753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48a73d0 0x559de48a77f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4bf804a6a0 tx=0x7f4bf8010f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.187+0000 7f4aeaffd640 1 -- 172.21.15.119:0/1610211753 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf8043070 con 0x559de48a73d0 2024-04-23T18:29:31.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.187+0000 7f4aeaffd640 1 -- 172.21.15.119:0/1610211753 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf8011ce0 con 0x559de48a73d0 2024-04-23T18:29:31.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.187+0000 7f4aeaffd640 1 -- 172.21.15.119:0/1610211753 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf8045040 con 0x559de48a73d0 2024-04-23T18:29:31.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.187+0000 7f4c0992f800 1 -- 172.21.15.119:0/1610211753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559de48a87a0 con 0x559de48a73d0 2024-04-23T18:29:31.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.187+0000 7f4c0992f800 1 -- 172.21.15.119:0/1610211753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559de48a8ca0 con 0x559de48a73d0 2024-04-23T18:29:31.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.188+0000 7f4aeaffd640 1 -- 172.21.15.119:0/1610211753 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4bf803e1f0 con 0x559de48a73d0 2024-04-23T18:29:31.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.188+0000 7f4aeaffd640 1 --2- 172.21.15.119:0/1610211753 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4adc036e30 0x7f4adc0392f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.188+0000 7f4aeaffd640 1 -- 172.21.15.119:0/1610211753 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4bf8036b20 con 0x559de48a73d0 2024-04-23T18:29:31.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.188+0000 7f4c04dd0640 1 --2- 172.21.15.119:0/1610211753 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4adc036e30 0x7f4adc0392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.188+0000 7f4c0992f800 1 Processor -- start 2024-04-23T18:29:31.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.188+0000 7f4c0992f800 1 -- start start 2024-04-23T18:29:31.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.188+0000 7f4c04dd0640 1 --2- 172.21.15.119:0/1610211753 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4adc036e30 0x7f4adc0392f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x559de4890600 tx=0x7f4bf0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.189+0000 7f4c0992f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 0x559de487fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.189+0000 7f4c0992f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559de4884070 con 0x559de48815e0 2024-04-23T18:29:31.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.189+0000 7f4c055d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 0x559de487fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.189+0000 7f4c055d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 0x559de487fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60724/0 (socket says 172.21.15.119:60724) 2024-04-23T18:29:31.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.189+0000 7f4c055d1640 1 -- 172.21.15.119:0/297548913 learned_addr learned my addr 172.21.15.119:0/297548913 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.189+0000 7f4c055d1640 1 -- 172.21.15.119:0/297548913 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de4881a90 con 0x559de48815e0 2024-04-23T18:29:31.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.189+0000 7f4c055d1640 1 --2- 172.21.15.119:0/297548913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 0x559de487fcd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4bf804af10 tx=0x7f4bf801a820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb358f2ea5c38fdf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.189+0000 7f4ae8ff9640 1 -- 172.21.15.119:0/297548913 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf803e4e0 con 0x559de48815e0 2024-04-23T18:29:31.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.189+0000 7f4ae8ff9640 1 -- 172.21.15.119:0/297548913 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf8051070 con 0x559de48815e0 2024-04-23T18:29:31.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.189+0000 7f4ae8ff9640 1 -- 172.21.15.119:0/297548913 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf8040080 con 0x559de48815e0 2024-04-23T18:29:31.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c0992f800 1 -- 172.21.15.119:0/297548913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 msgr2=0x559de487fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c0992f800 1 --2- 172.21.15.119:0/297548913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 0x559de487fcd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4bf804af10 tx=0x7f4bf801a820 comp rx=0 tx=0).stop 2024-04-23T18:29:31.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c0992f800 1 -- 172.21.15.119:0/297548913 shutdown_connections 2024-04-23T18:29:31.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c0992f800 1 --2- 172.21.15.119:0/297548913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 0x559de487fcd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c0992f800 1 -- 172.21.15.119:0/297548913 >> 172.21.15.119:0/297548913 conn(0x559de48b0830 msgr2=0x559de48ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c0992f800 1 -- 172.21.15.119:0/297548913 shutdown_connections 2024-04-23T18:29:31.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c0992f800 1 -- 172.21.15.119:0/297548913 wait complete. 2024-04-23T18:29:31.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c0992f800 1 Processor -- start 2024-04-23T18:29:31.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c0992f800 1 -- start start 2024-04-23T18:29:31.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c0992f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 0x559de48bdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c0992f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559de4880210 con 0x559de48815e0 2024-04-23T18:29:31.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c055d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 0x559de48bdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c055d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 0x559de48bdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60740/0 (socket says 172.21.15.119:60740) 2024-04-23T18:29:31.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.190+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 learned_addr learned my addr 172.21.15.119:0/2246979814 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.191+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559de48be010 con 0x559de48815e0 2024-04-23T18:29:31.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.191+0000 7f4c055d1640 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 0x559de48bdad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4bf801a860 tx=0x7f4bf8044090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.191+0000 7f4adaffd640 1 -- 172.21.15.119:0/2246979814 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf8064070 con 0x559de48815e0 2024-04-23T18:29:31.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.191+0000 7f4adaffd640 1 -- 172.21.15.119:0/2246979814 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf803ebc0 con 0x559de48815e0 2024-04-23T18:29:31.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.191+0000 7f4adaffd640 1 -- 172.21.15.119:0/2246979814 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf80106f0 con 0x559de48815e0 2024-04-23T18:29:31.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.191+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559de48be010 con 0x559de48815e0 2024-04-23T18:29:31.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.191+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559de48be010 con 0x559de48815e0 2024-04-23T18:29:31.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.192+0000 7f4adaffd640 1 -- 172.21.15.119:0/2246979814 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4bf8067070 con 0x559de48815e0 2024-04-23T18:29:31.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.192+0000 7f4adaffd640 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ad0036eb0 0x7f4ad0039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.192+0000 7f4adaffd640 1 -- 172.21.15.119:0/2246979814 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4bf805c070 con 0x559de48815e0 2024-04-23T18:29:31.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.192+0000 7f4c04dd0640 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ad0036eb0 0x7f4ad0039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.193+0000 7f4c04dd0640 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ad0036eb0 0x7f4ad0039370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0052fd0 tx=0x7f4bf004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.193+0000 7f4c0992f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.193+0000 7f4c0992f800 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559de48c9230 0x559de48cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.193+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de48cbe40 con 0x559de48c9230 2024-04-23T18:29:31.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.193+0000 7f4c05dd2640 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559de48c9230 0x559de48cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.193+0000 7f4c05dd2640 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559de48c9230 0x559de48cb6f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.193+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c000083e0 con 0x559de48c9230 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.193+0000 7f4c0992f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.193+0000 7f4c0992f800 20 realm 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.193+0000 7f4c0992f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.193+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de48cc250 con 0x559de48c9230 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c000083e0 con 0x559de48c9230 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c0992f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c0992f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c0992f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48c9230 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c000083e0 con 0x559de48c9230 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c0992f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c0992f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccec0 con 0x559de48c9230 2024-04-23T18:29:31.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c000083e0 con 0x559de48c9230 2024-04-23T18:29:31.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c0992f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c0992f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c0992f800 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559de48cd880 0x559de48cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de48d02c0 con 0x559de48cd880 2024-04-23T18:29:31.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c055d1640 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559de48cd880 0x559de48cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.194+0000 7f4c055d1640 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559de48cd880 0x559de48cfc70 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.195+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.195+0000 7f4c0992f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:31.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.195+0000 7f4c0992f800 20 searching for the correct realm 2024-04-23T18:29:31.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.195+0000 7f4c0992f800 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559de48d2230 0x559de48d46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.195+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48d4dc0 con 0x559de48d2230 2024-04-23T18:29:31.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.195+0000 7f4c04dd0640 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559de48d2230 0x559de48d46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.195+0000 7f4c04dd0640 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559de48d2230 0x559de48d46f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.195+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.195+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48d4dc0 con 0x559de48cd880 2024-04-23T18:29:31.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.196+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.196+0000 7f4c055d1640 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4bf8069060 0x7f4bf8050180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.196+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48d4dc0 con 0x7f4bf8069060 2024-04-23T18:29:31.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.196+0000 7f4c05dd2640 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4bf8069060 0x7f4bf8050180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.196+0000 7f4c05dd2640 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4bf8069060 0x7f4bf8050180 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.197+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c000083e0 con 0x7f4bf8069060 2024-04-23T18:29:31.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.197+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48c9230 2024-04-23T18:29:31.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.197+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c000083e0 con 0x559de48c9230 2024-04-23T18:29:31.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.197+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48c9230 2024-04-23T18:29:31.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.197+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.197+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x7f4bf8069060 2024-04-23T18:29:31.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.197+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.197+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x7f4bf8069060 2024-04-23T18:29:31.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.198+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.198+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48cd880 2024-04-23T18:29:31.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.198+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.198+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48d2230 2024-04-23T18:29:31.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.198+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.198+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48c9230 2024-04-23T18:29:31.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.198+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.198+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x7f4bf8069060 2024-04-23T18:29:31.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.199+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.199+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48c9230 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.199+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.199+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48cd880 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.199+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.199+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48d2230 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.199+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.199+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48d2230 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.199+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.200+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x7f4bf8069060 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.200+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.200+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48d2230 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.200+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.200+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48d2230 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.200+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.200+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48c9230 2024-04-23T18:29:31.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.200+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.201+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48c9230 2024-04-23T18:29:31.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.201+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.201+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x7f4bf8069060 2024-04-23T18:29:31.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.201+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.201+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48d2230 2024-04-23T18:29:31.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.201+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.201+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48cd880 2024-04-23T18:29:31.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.202+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.202+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48c9230 2024-04-23T18:29:31.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.202+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.202+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x7f4bf8069060 2024-04-23T18:29:31.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.202+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.202+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48d2230 2024-04-23T18:29:31.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.202+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.202+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x7f4bf8069060 2024-04-23T18:29:31.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.203+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.203+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48cd880 2024-04-23T18:29:31.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.203+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.203+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48d2230 2024-04-23T18:29:31.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.203+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.203+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x7f4bf8069060 2024-04-23T18:29:31.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.203+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.203+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48c9230 2024-04-23T18:29:31.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559de48ccb20 con 0x559de48cd880 2024-04-23T18:29:31.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:31.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:31.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:31.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:31.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:31.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:31.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de48d0660 con 0x559de48c9230 2024-04-23T18:29:31.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de48d0a50 con 0x559de48c9230 2024-04-23T18:29:31.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.204+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de48d0a50 con 0x7f4bf8069060 2024-04-23T18:29:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 20 zone default found 2024-04-23T18:29:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 4 Realm: () 2024-04-23T18:29:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 20 zonegroup default 2024-04-23T18:29:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de48d1510 con 0x7f4bf8069060 2024-04-23T18:29:31.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de48d6c20 con 0x559de48d2230 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.205+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de48d6fc0 con 0x559de48d2230 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.206+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.206+0000 7f4c0992f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.206+0000 7f4c0992f800 20 started sync module instance, tier type = 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.206+0000 7f4c0992f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.206+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48d60c0 con 0x559de48cd880 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.206+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.207+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94136632695824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48d7360 con 0x559de48cd880 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.207+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48d7c10 con 0x559de48c9230 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.208+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94136632695824] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.208+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.208+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94136632702720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48d8030 con 0x559de48c9230 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.208+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48d8a70 con 0x559de48d2230 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.209+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94136632702720] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.209+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.209+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94136632706368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48d8e60 con 0x559de48d2230 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.209+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48d98e0 con 0x559de48cd880 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.210+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.210+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94136632710096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48da180 con 0x559de48cd880 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.210+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94136632706368] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.210+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48d6500 con 0x559de48c9230 2024-04-23T18:29:31.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.211+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.211+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94136632715072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48d6500 con 0x559de48c9230 2024-04-23T18:29:31.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.211+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48db690 con 0x7f4bf8069060 2024-04-23T18:29:31.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.211+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94136632710096] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.212+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.212+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94136632717696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48db650 con 0x7f4bf8069060 2024-04-23T18:29:31.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.212+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48dc0a0 con 0x7f4bf8069060 2024-04-23T18:29:31.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.212+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94136632715072] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.213+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94136632717696] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.213+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.213+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94136632712400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48dbbf0 con 0x7f4bf8069060 2024-04-23T18:29:31.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.213+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48dc5b0 con 0x7f4bf8069060 2024-04-23T18:29:31.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.214+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94136632712400] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.214+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.214+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94136632716128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48dc5b0 con 0x7f4bf8069060 2024-04-23T18:29:31.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.214+0000 7f4c0992f800 20 add_watcher() i=0 2024-04-23T18:29:31.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.214+0000 7f4c0992f800 20 add_watcher() i=1 2024-04-23T18:29:31.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.214+0000 7f4c0992f800 20 add_watcher() i=2 2024-04-23T18:29:31.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.214+0000 7f4c0992f800 20 add_watcher() i=3 2024-04-23T18:29:31.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.214+0000 7f4c0992f800 20 add_watcher() i=4 2024-04-23T18:29:31.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.214+0000 7f4c0992f800 20 add_watcher() i=5 2024-04-23T18:29:31.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.214+0000 7f4c0992f800 20 add_watcher() i=6 2024-04-23T18:29:31.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.215+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94136632716128] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.215+0000 7f4c0992f800 20 add_watcher() i=7 2024-04-23T18:29:31.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.215+0000 7f4c0992f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:31.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.215+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de48df870 con 0x559de48c9230 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.215+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.215+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94136632722032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48dcb40 con 0x559de48c9230 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.216+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94136632722032] v32'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.216+0000 7f4abb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.216+0000 7f4c0992f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.216+0000 7f4c0992f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.216+0000 7f4c0992f800 5 note: GC not initialized 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.217+0000 7f4aba7e4640 20 reqs_thread_entry: start 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.217+0000 7f4c0992f800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.217+0000 7f4c0992f800 20 Filter name: none 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.217+0000 7f4a2bfff640 20 reqs_thread_entry: start 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.217+0000 7f4c0992f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.217+0000 7f4c0992f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.217+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de4913070 con 0x559de48c9230 2024-04-23T18:29:31.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.217+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.217+0000 7f4c0992f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:31.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.217+0000 7f4c0992f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:31.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.217+0000 7f4c0992f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:31.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.217+0000 7f4c0992f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:31.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.217+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de4912b90 con 0x559de48cd880 2024-04-23T18:29:31.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.218+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.218+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de4919330 con 0x559de48c9230 2024-04-23T18:29:31.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.219+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.219+0000 7f4c0992f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:31.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.219+0000 7f4c0992f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:31.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.219+0000 7f4c0992f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:31.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.219+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94136632971200 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559de4916050 con 0x559de48c9230 2024-04-23T18:29:31.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.219+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify (1) cookie 94136632715072 notify 137438953474 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f4c00010040 con 0x559de48c9230 2024-04-23T18:29:31.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.219+0000 7f4ae8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94136632715072 notifier 4322 bl.length()=567 2024-04-23T18:29:31.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.219+0000 7f4ae8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:31.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.219+0000 7f4ae8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:31.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.219+0000 7f4ae8ff9640 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4ac8003ea0 con 0x559de48c9230 2024-04-23T18:29:31.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.219+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(65 notify.4 [notify cookie 94136632971200 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.219+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.219+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify_complete (2) cookie 94136632971200 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4c0002c450 con 0x559de48c9230 2024-04-23T18:29:31.225 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:31.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.220+0000 7f4abb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.220+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94136632722032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48dea60 con 0x559de48c9230 2024-04-23T18:29:31.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.221+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94136632722032] v32'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.221+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94136632695824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48dc270 con 0x559de48cd880 2024-04-23T18:29:31.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.222+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94136632695824] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.222+0000 7f4c0992f800 20 remove_watcher() i=0 2024-04-23T18:29:31.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.222+0000 7f4c0992f800 2 removed watcher, disabling cache 2024-04-23T18:29:31.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.222+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94136632702720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48dc270 con 0x559de48c9230 2024-04-23T18:29:31.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.223+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94136632702720] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.223+0000 7f4c0992f800 20 remove_watcher() i=1 2024-04-23T18:29:31.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.223+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94136632706368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48dc270 con 0x559de48d2230 2024-04-23T18:29:31.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.224+0000 7f4c04dd0640 1 -- 172.21.15.119:0/2246979814 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94136632706368] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf0081070 con 0x559de48d2230 2024-04-23T18:29:31.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.224+0000 7f4c0992f800 20 remove_watcher() i=2 2024-04-23T18:29:31.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.224+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94136632710096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48d7700 con 0x559de48cd880 2024-04-23T18:29:31.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.225+0000 7f4c055d1640 1 -- 172.21.15.119:0/2246979814 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94136632710096] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf8066030 con 0x559de48cd880 2024-04-23T18:29:31.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.225+0000 7f4c0992f800 20 remove_watcher() i=3 2024-04-23T18:29:31.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.225+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94136632715072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48d8540 con 0x559de48c9230 2024-04-23T18:29:31.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.227+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94136632715072] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x559de48c9230 2024-04-23T18:29:31.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.227+0000 7f4c0992f800 20 remove_watcher() i=4 2024-04-23T18:29:31.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.227+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94136632717696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48d7700 con 0x7f4bf8069060 2024-04-23T18:29:31.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.228+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94136632717696] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.228+0000 7f4c0992f800 20 remove_watcher() i=5 2024-04-23T18:29:31.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.228+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94136632712400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48da740 con 0x7f4bf8069060 2024-04-23T18:29:31.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.229+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94136632712400] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.229+0000 7f4c0992f800 20 remove_watcher() i=6 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.229+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94136632716128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559de48d8540 con 0x7f4bf8069060 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.229+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94136632716128] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c00026040 con 0x7f4bf8069060 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.229+0000 7f4c0992f800 20 remove_watcher() i=7 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4bf8069060 msgr2=0x7f4bf8050180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4bf8069060 0x7f4bf8050180 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559de48c9230 msgr2=0x559de48cb6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559de48c9230 0x559de48cb6f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559de48cd880 msgr2=0x559de48cfc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559de48cd880 0x559de48cfc70 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559de48d2230 msgr2=0x559de48d46f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559de48d2230 0x559de48d46f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ad0036eb0 msgr2=0x7f4ad0039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4ad0036eb0 0x7f4ad0039370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0052fd0 tx=0x7f4bf004f000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 msgr2=0x559de48bdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c05dd2640 1 -- 172.21.15.119:0/2246979814 reap_dead start 2024-04-23T18:29:31.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 0x559de48bdad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4bf801a860 tx=0x7f4bf8044090 comp rx=0 tx=0).stop 2024-04-23T18:29:31.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 shutdown_connections 2024-04-23T18:29:31.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 --2- 172.21.15.119:0/2246979814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48815e0 0x559de48bdad0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 >> 172.21.15.119:0/2246979814 conn(0x559de48b0830 msgr2=0x559de48ade90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 shutdown_connections 2024-04-23T18:29:31.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/2246979814 wait complete. 2024-04-23T18:29:31.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/1610211753 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4adc036e30 msgr2=0x7f4adc0392f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 --2- 172.21.15.119:0/1610211753 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4adc036e30 0x7f4adc0392f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x559de4890600 tx=0x7f4bf0005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:31.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/1610211753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48a73d0 msgr2=0x559de48a77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 --2- 172.21.15.119:0/1610211753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48a73d0 0x559de48a77f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4bf804a6a0 tx=0x7f4bf8010f50 comp rx=0 tx=0).stop 2024-04-23T18:29:31.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/1610211753 shutdown_connections 2024-04-23T18:29:31.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 --2- 172.21.15.119:0/1610211753 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4adc036e30 0x7f4adc0392f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 --2- 172.21.15.119:0/1610211753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de48a73d0 0x559de48a77f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/1610211753 >> 172.21.15.119:0/1610211753 conn(0x559de489b470 msgr2=0x559de489b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/1610211753 shutdown_connections 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.230+0000 7f4c0992f800 1 -- 172.21.15.119:0/1610211753 wait complete. 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559de48963f0 msgr2=0x559de4898820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559de48963f0 0x559de4898820 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559de47932f0 msgr2=0x559de488fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559de47932f0 0x559de488fac0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559de4892460 msgr2=0x559de4894850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559de4892460 0x559de4894850 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4aec036e60 msgr2=0x7f4aec039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4aec036e60 0x7f4aec039320 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0054000 tx=0x7f4bf004e000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de478ee60 msgr2=0x559de4888ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 --2- 172.21.15.119:0/3193663164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559de478ee60 0x559de4888ba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8000f80 tx=0x7f4bf8001250 comp rx=0 tx=0).stop 2024-04-23T18:29:31.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c05dd2640 1 -- 172.21.15.119:0/3193663164 reap_dead start 2024-04-23T18:29:31.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 shutdown_connections 2024-04-23T18:29:31.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 >> 172.21.15.119:0/3193663164 conn(0x559de478a420 msgr2=0x559de487a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 shutdown_connections 2024-04-23T18:29:31.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.231+0000 7f4c0992f800 1 -- 172.21.15.119:0/3193663164 wait complete. 2024-04-23T18:29:31.237 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:31.237 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-23T18:29:31.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-23T18:29:31.237 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-23T18:29:31.320 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:31.320 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:31.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.328+0000 7f5516b0c800 1 Processor -- start 2024-04-23T18:29:31.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.328+0000 7f5516b0c800 1 -- start start 2024-04-23T18:29:31.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.328+0000 7f5516b0c800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55fd729a5f60 0x55fd729a6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.328+0000 7f5516b0c800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fd72856560 con 0x55fd729a7170 2024-04-23T18:29:31.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.328+0000 7f5516b0c800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55fd72847e20 con 0x55fd729a5f60 2024-04-23T18:29:31.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.328+0000 7f551460b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55fd729a5f60 0x55fd729a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.328+0000 7f5513e0a640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55fd729a7170 0x55fd729a75f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40538/0 (socket says 172.21.15.119:40538) 2024-04-23T18:29:31.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.328+0000 7f5513e0a640 1 -- 172.21.15.119:0/3314175323 learned_addr learned my addr 172.21.15.119:0/3314175323 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:31.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.328+0000 7f551460b640 1 -- 172.21.15.119:0/3314175323 >> v1:172.21.15.62:6789/0 conn(0x55fd729a7170 legacy=0x55fd729a75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.329+0000 7f551460b640 1 -- 172.21.15.119:0/3314175323 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd72855e60 con 0x55fd729a5f60 2024-04-23T18:29:31.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.330+0000 7f551460b640 1 --2- 172.21.15.119:0/3314175323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd729a6380 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f550400a470 tx=0x7f550401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa572f95da9459b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.330+0000 7f5513609640 1 -- 172.21.15.119:0/3314175323 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5504057070 con 0x55fd729a5f60 2024-04-23T18:29:31.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.330+0000 7f5513609640 1 -- 172.21.15.119:0/3314175323 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5504052570 con 0x55fd729a5f60 2024-04-23T18:29:31.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.330+0000 7f5513609640 1 -- 172.21.15.119:0/3314175323 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5504052870 con 0x55fd729a5f60 2024-04-23T18:29:31.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.331+0000 7f5516b0c800 1 -- 172.21.15.119:0/3314175323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 msgr2=0x55fd729a6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.331+0000 7f5516b0c800 1 --2- 172.21.15.119:0/3314175323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd729a6380 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f550400a470 tx=0x7f550401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:31.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.331+0000 7f5516b0c800 1 -- 172.21.15.119:0/3314175323 shutdown_connections 2024-04-23T18:29:31.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.331+0000 7f5516b0c800 1 --2- 172.21.15.119:0/3314175323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd729a6380 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.331+0000 7f5516b0c800 1 -- 172.21.15.119:0/3314175323 >> 172.21.15.119:0/3314175323 conn(0x55fd729a1540 msgr2=0x55fd729a3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.331+0000 7f5516b0c800 1 -- 172.21.15.119:0/3314175323 shutdown_connections 2024-04-23T18:29:31.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.331+0000 7f5516b0c800 1 -- 172.21.15.119:0/3314175323 wait complete. 2024-04-23T18:29:31.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.343+0000 7f5516b0c800 1 Processor -- start 2024-04-23T18:29:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.343+0000 7f5516b0c800 1 -- start start 2024-04-23T18:29:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.343+0000 7f5516b0c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd7291b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.343+0000 7f5516b0c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fd728f15b0 con 0x55fd729a5f60 2024-04-23T18:29:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.343+0000 7f551460b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd7291b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.343+0000 7f551460b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd7291b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60746/0 (socket says 172.21.15.119:60746) 2024-04-23T18:29:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.343+0000 7f551460b640 1 -- 172.21.15.119:0/3457486925 learned_addr learned my addr 172.21.15.119:0/3457486925 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.343+0000 7f551460b640 1 -- 172.21.15.119:0/3457486925 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd72867860 con 0x55fd729a5f60 2024-04-23T18:29:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.344+0000 7f551460b640 1 --2- 172.21.15.119:0/3457486925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd7291b810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5504055040 tx=0x7f550404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc55c32793da01 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.344+0000 7f540260c640 1 -- 172.21.15.119:0/3457486925 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5504057070 con 0x55fd729a5f60 2024-04-23T18:29:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.344+0000 7f540260c640 1 -- 172.21.15.119:0/3457486925 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5504063070 con 0x55fd729a5f60 2024-04-23T18:29:31.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.344+0000 7f540260c640 1 -- 172.21.15.119:0/3457486925 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5504052720 con 0x55fd729a5f60 2024-04-23T18:29:31.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.344+0000 7f5516b0c800 1 -- 172.21.15.119:0/3457486925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 msgr2=0x55fd7291b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.344+0000 7f5516b0c800 1 --2- 172.21.15.119:0/3457486925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd7291b810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5504055040 tx=0x7f550404c000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.344+0000 7f5516b0c800 1 -- 172.21.15.119:0/3457486925 shutdown_connections 2024-04-23T18:29:31.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.344+0000 7f5516b0c800 1 --2- 172.21.15.119:0/3457486925 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd7291b810 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.344+0000 7f5516b0c800 1 -- 172.21.15.119:0/3457486925 >> 172.21.15.119:0/3457486925 conn(0x55fd729a1540 msgr2=0x55fd72a92f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.345+0000 7f5516b0c800 1 -- 172.21.15.119:0/3457486925 shutdown_connections 2024-04-23T18:29:31.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.345+0000 7f5516b0c800 1 -- 172.21.15.119:0/3457486925 wait complete. 2024-04-23T18:29:31.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.345+0000 7f5516b0c800 1 Processor -- start 2024-04-23T18:29:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.345+0000 7f5516b0c800 1 -- start start 2024-04-23T18:29:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.345+0000 7f5516b0c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd72aa10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.345+0000 7f5516b0c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fd729af5e0 con 0x55fd729a5f60 2024-04-23T18:29:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.345+0000 7f551460b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd72aa10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.345+0000 7f551460b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd72aa10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60748/0 (socket says 172.21.15.119:60748) 2024-04-23T18:29:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.345+0000 7f551460b640 1 -- 172.21.15.119:0/3089217596 learned_addr learned my addr 172.21.15.119:0/3089217596 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.346+0000 7f551460b640 1 -- 172.21.15.119:0/3089217596 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd72865eb0 con 0x55fd729a5f60 2024-04-23T18:29:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.346+0000 7f551460b640 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd72aa10b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5504060040 tx=0x7f5504002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.346+0000 7f5400e09640 1 -- 172.21.15.119:0/3089217596 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5504052c70 con 0x55fd729a5f60 2024-04-23T18:29:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.346+0000 7f5400e09640 1 -- 172.21.15.119:0/3089217596 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550406c070 con 0x55fd729a5f60 2024-04-23T18:29:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.346+0000 7f5400e09640 1 -- 172.21.15.119:0/3089217596 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f550405e480 con 0x55fd729a5f60 2024-04-23T18:29:31.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.346+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd72aa15f0 con 0x55fd729a5f60 2024-04-23T18:29:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.346+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd72aa1b70 con 0x55fd729a5f60 2024-04-23T18:29:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.347+0000 7f5400e09640 1 -- 172.21.15.119:0/3089217596 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f550405e620 con 0x55fd729a5f60 2024-04-23T18:29:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.347+0000 7f5400e09640 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53fc036e60 0x7f53fc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.347+0000 7f5400e09640 1 -- 172.21.15.119:0/3089217596 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f550408eeb0 con 0x55fd729a5f60 2024-04-23T18:29:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.347+0000 7f5513e0a640 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53fc036e60 0x7f53fc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.347+0000 7f5516b0c800 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd729a7170 0x55fd72aa8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.347+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aa86f0 con 0x55fd729a7170 2024-04-23T18:29:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.347+0000 7f5514e0c640 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd729a7170 0x55fd72aa8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.347+0000 7f5513e0a640 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53fc036e60 0x7f53fc039320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5508000f60 tx=0x7f55080012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.348+0000 7f5514e0c640 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd729a7170 0x55fd72aa8120 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.348+0000 7f5514e0c640 1 -- 172.21.15.119:0/3089217596 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd729a7170 2024-04-23T18:29:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.348+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aa56f0 con 0x55fd729a7170 2024-04-23T18:29:31.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.348+0000 7f5514e0c640 1 -- 172.21.15.119:0/3089217596 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd729a7170 2024-04-23T18:29:31.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.348+0000 7f5516b0c800 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd72aaaa40 0x55fd72aace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.348+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aad4d0 con 0x55fd72aaaa40 2024-04-23T18:29:31.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.348+0000 7f551460b640 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd72aaaa40 0x55fd72aace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.348+0000 7f551460b640 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd72aaaa40 0x55fd72aace30 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.349+0000 7f551460b640 1 -- 172.21.15.119:0/3089217596 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5504068780 con 0x55fd72aaaa40 2024-04-23T18:29:31.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.349+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aa99f0 con 0x55fd729a7170 2024-04-23T18:29:31.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.349+0000 7f5514e0c640 1 -- 172.21.15.119:0/3089217596 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd729a7170 2024-04-23T18:29:31.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.349+0000 7f5516b0c800 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55fd72aae930 0x55fd72ab0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.349+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ab1520 con 0x55fd72aae930 2024-04-23T18:29:31.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.349+0000 7f5513e0a640 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55fd72aae930 0x55fd72ab0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.350+0000 7f5513e0a640 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55fd72aae930 0x55fd72ab0dc0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.350+0000 7f5513e0a640 1 -- 172.21.15.119:0/3089217596 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5508009050 con 0x55fd72aae930 2024-04-23T18:29:31.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.350+0000 7f5516b0c800 1 Processor -- start 2024-04-23T18:29:31.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.350+0000 7f5516b0c800 1 -- start start 2024-04-23T18:29:31.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.350+0000 7f5516b0c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72abf9d0 0x55fd72abfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.350+0000 7f5516b0c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fd72897df0 con 0x55fd72abf9d0 2024-04-23T18:29:31.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.351+0000 7f551460b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72abf9d0 0x55fd72abfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.351+0000 7f551460b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72abf9d0 0x55fd72abfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60756/0 (socket says 172.21.15.119:60756) 2024-04-23T18:29:31.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.351+0000 7f551460b640 1 -- 172.21.15.119:0/859192677 learned_addr learned my addr 172.21.15.119:0/859192677 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.351+0000 7f551460b640 1 -- 172.21.15.119:0/859192677 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd72ac0330 con 0x55fd72abf9d0 2024-04-23T18:29:31.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.351+0000 7f551460b640 1 --2- 172.21.15.119:0/859192677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72abf9d0 0x55fd72abfdf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f550406d000 tx=0x7f5504079950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.351+0000 7f53f9ffb640 1 -- 172.21.15.119:0/859192677 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5504081040 con 0x55fd72abf9d0 2024-04-23T18:29:31.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.351+0000 7f53f9ffb640 1 -- 172.21.15.119:0/859192677 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5504058040 con 0x55fd72abf9d0 2024-04-23T18:29:31.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.351+0000 7f53f9ffb640 1 -- 172.21.15.119:0/859192677 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f550407ac60 con 0x55fd72abf9d0 2024-04-23T18:29:31.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.351+0000 7f5516b0c800 1 -- 172.21.15.119:0/859192677 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd72ac0da0 con 0x55fd72abf9d0 2024-04-23T18:29:31.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.351+0000 7f5516b0c800 1 -- 172.21.15.119:0/859192677 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd72ac12a0 con 0x55fd72abf9d0 2024-04-23T18:29:31.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.352+0000 7f53f9ffb640 1 -- 172.21.15.119:0/859192677 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5504055a30 con 0x55fd72abf9d0 2024-04-23T18:29:31.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.352+0000 7f53f9ffb640 1 --2- 172.21.15.119:0/859192677 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53ec036e60 0x7f53ec039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.352+0000 7f53f9ffb640 1 -- 172.21.15.119:0/859192677 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5504094c40 con 0x55fd72abf9d0 2024-04-23T18:29:31.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.352+0000 7f5513e0a640 1 --2- 172.21.15.119:0/859192677 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53ec036e60 0x7f53ec039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.352+0000 7f5516b0c800 1 Processor -- start 2024-04-23T18:29:31.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.352+0000 7f5513e0a640 1 --2- 172.21.15.119:0/859192677 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53ec036e60 0x7f53ec039320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f550800bf50 tx=0x7f550800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.353+0000 7f5516b0c800 1 -- start start 2024-04-23T18:29:31.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.353+0000 7f5516b0c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 0x55fd72accfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.353+0000 7f5516b0c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fd72919dd0 con 0x55fd72accb80 2024-04-23T18:29:31.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.353+0000 7f551460b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 0x55fd72accfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.353+0000 7f551460b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 0x55fd72accfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60762/0 (socket says 172.21.15.119:60762) 2024-04-23T18:29:31.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.353+0000 7f551460b640 1 -- 172.21.15.119:0/45070250 learned_addr learned my addr 172.21.15.119:0/45070250 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.353+0000 7f551460b640 1 -- 172.21.15.119:0/45070250 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd72acd570 con 0x55fd72accb80 2024-04-23T18:29:31.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.353+0000 7f551460b640 1 --2- 172.21.15.119:0/45070250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 0x55fd72accfa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5504071c10 tx=0x7f5504071840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e3e9b7427d382e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.353+0000 7f53eb7fe640 1 -- 172.21.15.119:0/45070250 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55040ab070 con 0x55fd72accb80 2024-04-23T18:29:31.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.353+0000 7f53eb7fe640 1 -- 172.21.15.119:0/45070250 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5504055d20 con 0x55fd72accb80 2024-04-23T18:29:31.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.353+0000 7f53eb7fe640 1 -- 172.21.15.119:0/45070250 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5504098070 con 0x55fd72accb80 2024-04-23T18:29:31.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.354+0000 7f5516b0c800 1 -- 172.21.15.119:0/45070250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 msgr2=0x55fd72accfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.354+0000 7f5516b0c800 1 --2- 172.21.15.119:0/45070250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 0x55fd72accfa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5504071c10 tx=0x7f5504071840 comp rx=0 tx=0).stop 2024-04-23T18:29:31.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.354+0000 7f5516b0c800 1 -- 172.21.15.119:0/45070250 shutdown_connections 2024-04-23T18:29:31.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.354+0000 7f5516b0c800 1 --2- 172.21.15.119:0/45070250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 0x55fd72accfa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.354+0000 7f5516b0c800 1 -- 172.21.15.119:0/45070250 >> 172.21.15.119:0/45070250 conn(0x55fd72ac8e50 msgr2=0x55fd72ac6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.354+0000 7f5516b0c800 1 -- 172.21.15.119:0/45070250 shutdown_connections 2024-04-23T18:29:31.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.354+0000 7f5516b0c800 1 -- 172.21.15.119:0/45070250 wait complete. 2024-04-23T18:29:31.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.354+0000 7f5516b0c800 1 Processor -- start 2024-04-23T18:29:31.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.354+0000 7f5516b0c800 1 -- start start 2024-04-23T18:29:31.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.354+0000 7f5516b0c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 0x55fd72ad3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.354+0000 7f5516b0c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fd72acdbd0 con 0x55fd72accb80 2024-04-23T18:29:31.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.354+0000 7f551460b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 0x55fd72ad3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.355+0000 7f551460b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 0x55fd72ad3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60772/0 (socket says 172.21.15.119:60772) 2024-04-23T18:29:31.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.355+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 learned_addr learned my addr 172.21.15.119:0/2184109790 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.355+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd72ad4430 con 0x55fd72accb80 2024-04-23T18:29:31.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.355+0000 7f551460b640 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 0x55fd72ad3ef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5504002d00 tx=0x7f550405aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.355+0000 7f53e9ffb640 1 -- 172.21.15.119:0/2184109790 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55040b4020 con 0x55fd72accb80 2024-04-23T18:29:31.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.355+0000 7f53e9ffb640 1 -- 172.21.15.119:0/2184109790 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55040ac040 con 0x55fd72accb80 2024-04-23T18:29:31.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.355+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd72ad4430 con 0x55fd72accb80 2024-04-23T18:29:31.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.355+0000 7f53e9ffb640 1 -- 172.21.15.119:0/2184109790 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55040ab070 con 0x55fd72accb80 2024-04-23T18:29:31.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.355+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd72ad4430 con 0x55fd72accb80 2024-04-23T18:29:31.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.356+0000 7f53e9ffb640 1 -- 172.21.15.119:0/2184109790 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f55040b7020 con 0x55fd72accb80 2024-04-23T18:29:31.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.356+0000 7f53e9ffb640 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53dc036eb0 0x7f53dc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.356+0000 7f53e9ffb640 1 -- 172.21.15.119:0/2184109790 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f55040a3070 con 0x55fd72accb80 2024-04-23T18:29:31.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.356+0000 7f5516b0c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.356+0000 7f5513e0a640 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53dc036eb0 0x7f53dc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.356+0000 7f5516b0c800 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd72adf6d0 0x55fd72ae1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.356+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae22e0 con 0x55fd72adf6d0 2024-04-23T18:29:31.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.356+0000 7f5514e0c640 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd72adf6d0 0x55fd72ae1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5513e0a640 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53dc036eb0 0x7f53dc039370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5508001b60 tx=0x7f5508010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5514e0c640 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd72adf6d0 0x55fd72ae1b90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd72adf6d0 2024-04-23T18:29:31.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5516b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5516b0c800 20 realm 2024-04-23T18:29:31.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5516b0c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae26f0 con 0x55fd72adf6d0 2024-04-23T18:29:31.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd72adf6d0 2024-04-23T18:29:31.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5516b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5516b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:31.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5516b0c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae2f90 con 0x55fd72adf6d0 2024-04-23T18:29:31.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd72adf6d0 2024-04-23T18:29:31.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5516b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5516b0c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.357+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72adf6d0 2024-04-23T18:29:31.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.358+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd72adf6d0 2024-04-23T18:29:31.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.358+0000 7f5516b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.358+0000 7f5516b0c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.358+0000 7f5516b0c800 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd72ae3e60 0x55fd72ae6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.358+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae6990 con 0x55fd72ae3e60 2024-04-23T18:29:31.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.358+0000 7f551460b640 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd72ae3e60 0x55fd72ae6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.358+0000 7f551460b640 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd72ae3e60 0x55fd72ae6250 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.358+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f55040ae070 con 0x55fd72ae3e60 2024-04-23T18:29:31.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.358+0000 7f5516b0c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:31.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.358+0000 7f5516b0c800 20 searching for the correct realm 2024-04-23T18:29:31.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.358+0000 7f5516b0c800 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55fd72ae8a40 0x55fd72aeaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.358+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aeb5d0 con 0x55fd72ae8a40 2024-04-23T18:29:31.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.358+0000 7f5513e0a640 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55fd72ae8a40 0x55fd72aeaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.359+0000 7f5513e0a640 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55fd72ae8a40 0x55fd72aeaf00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.359+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.359+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aeb5d0 con 0x55fd72ae3e60 2024-04-23T18:29:31.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.359+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040ae070 con 0x55fd72ae3e60 2024-04-23T18:29:31.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.359+0000 7f551460b640 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f55040b9020 0x7f550406da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.359+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aeb5d0 con 0x7f55040b9020 2024-04-23T18:29:31.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.360+0000 7f5514e0c640 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f55040b9020 0x7f550406da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.360+0000 7f5514e0c640 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f55040b9020 0x7f550406da50 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.360+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00a4a0 con 0x7f55040b9020 2024-04-23T18:29:31.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.360+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72adf6d0 2024-04-23T18:29:31.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.360+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd72adf6d0 2024-04-23T18:29:31.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.360+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72adf6d0 2024-04-23T18:29:31.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.361+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd72adf6d0 2024-04-23T18:29:31.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.361+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x7f55040b9020 2024-04-23T18:29:31.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.361+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00a4a0 con 0x7f55040b9020 2024-04-23T18:29:31.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.361+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x7f55040b9020 2024-04-23T18:29:31.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.361+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f550c00a4a0 con 0x7f55040b9020 2024-04-23T18:29:31.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.361+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72ae3e60 2024-04-23T18:29:31.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.361+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040ae070 con 0x55fd72ae3e60 2024-04-23T18:29:31.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.361+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72ae8a40 2024-04-23T18:29:31.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.362+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.362+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72adf6d0 2024-04-23T18:29:31.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.362+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd72adf6d0 2024-04-23T18:29:31.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.362+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x7f55040b9020 2024-04-23T18:29:31.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.362+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00a4a0 con 0x7f55040b9020 2024-04-23T18:29:31.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.362+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72adf6d0 2024-04-23T18:29:31.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.362+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd72adf6d0 2024-04-23T18:29:31.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.362+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72ae3e60 2024-04-23T18:29:31.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.363+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f55040ae070 con 0x55fd72ae3e60 2024-04-23T18:29:31.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.363+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72ae8a40 2024-04-23T18:29:31.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.363+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.363+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72ae8a40 2024-04-23T18:29:31.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.363+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.363+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x7f55040b9020 2024-04-23T18:29:31.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.363+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00a4a0 con 0x7f55040b9020 2024-04-23T18:29:31.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.363+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72ae8a40 2024-04-23T18:29:31.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.364+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.364+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72ae8a40 2024-04-23T18:29:31.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.364+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.364+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72adf6d0 2024-04-23T18:29:31.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.364+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd72adf6d0 2024-04-23T18:29:31.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.364+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72adf6d0 2024-04-23T18:29:31.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.364+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd72adf6d0 2024-04-23T18:29:31.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.364+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x7f55040b9020 2024-04-23T18:29:31.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.365+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00a4a0 con 0x7f55040b9020 2024-04-23T18:29:31.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.365+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72ae8a40 2024-04-23T18:29:31.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.365+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.365+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72ae3e60 2024-04-23T18:29:31.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.365+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f55040ae070 con 0x55fd72ae3e60 2024-04-23T18:29:31.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.365+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72adf6d0 2024-04-23T18:29:31.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.366+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00a4a0 con 0x55fd72adf6d0 2024-04-23T18:29:31.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.366+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x7f55040b9020 2024-04-23T18:29:31.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.366+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00a4a0 con 0x7f55040b9020 2024-04-23T18:29:31.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.366+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72ae8a40 2024-04-23T18:29:31.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.366+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.366+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x7f55040b9020 2024-04-23T18:29:31.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.366+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c00a4a0 con 0x7f55040b9020 2024-04-23T18:29:31.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.366+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72ae3e60 2024-04-23T18:29:31.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.367+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040ae070 con 0x55fd72ae3e60 2024-04-23T18:29:31.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.367+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72ae8a40 2024-04-23T18:29:31.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.367+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.367+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x7f55040b9020 2024-04-23T18:29:31.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.367+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f550c040040 con 0x7f55040b9020 2024-04-23T18:29:31.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.367+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72adf6d0 2024-04-23T18:29:31.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.367+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f550c040040 con 0x55fd72adf6d0 2024-04-23T18:29:31.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.367+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae3330 con 0x55fd72ae3e60 2024-04-23T18:29:31.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55040d0040 con 0x55fd72ae3e60 2024-04-23T18:29:31.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:31.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:31.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:31.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:31.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:31.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:31.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae7340 con 0x55fd72adf6d0 2024-04-23T18:29:31.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f550c040040 con 0x55fd72adf6d0 2024-04-23T18:29:31.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae7340 con 0x55fd72adf6d0 2024-04-23T18:29:31.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f550c040040 con 0x55fd72adf6d0 2024-04-23T18:29:31.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae7340 con 0x7f55040b9020 2024-04-23T18:29:31.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.368+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f550c040040 con 0x7f55040b9020 2024-04-23T18:29:31.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:31.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 20 zone default found 2024-04-23T18:29:31.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 4 Realm: () 2024-04-23T18:29:31.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:31.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:31.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:31.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 20 zonegroup default 2024-04-23T18:29:31.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae7730 con 0x7f55040b9020 2024-04-23T18:29:31.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f550c040040 con 0x7f55040b9020 2024-04-23T18:29:31.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72ae7b70 con 0x55fd72ae8a40 2024-04-23T18:29:31.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aed430 con 0x55fd72ae8a40 2024-04-23T18:29:31.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 20 started sync module instance, tier type = 2024-04-23T18:29:31.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:31.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.369+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aec8d0 con 0x55fd72ae3e60 2024-04-23T18:29:31.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.370+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040d0040 con 0x55fd72ae3e60 2024-04-23T18:29:31.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.370+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94547039142944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aed7d0 con 0x55fd72ae3e60 2024-04-23T18:29:31.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.370+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aee020 con 0x55fd72adf6d0 2024-04-23T18:29:31.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.371+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94547039142944] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040d0040 con 0x55fd72ae3e60 2024-04-23T18:29:31.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.372+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x55fd72adf6d0 2024-04-23T18:29:31.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.372+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94547039148912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aee440 con 0x55fd72adf6d0 2024-04-23T18:29:31.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.372+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aeee00 con 0x55fd72ae8a40 2024-04-23T18:29:31.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.373+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.373+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94547039152464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aef6a0 con 0x55fd72ae8a40 2024-04-23T18:29:31.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.373+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72af0180 con 0x55fd72ae3e60 2024-04-23T18:29:31.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.373+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94547039148912] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x55fd72adf6d0 2024-04-23T18:29:31.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.374+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040d0040 con 0x55fd72ae3e60 2024-04-23T18:29:31.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.374+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94547039152464] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.374+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94547039157392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72af0570 con 0x55fd72ae3e60 2024-04-23T18:29:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.374+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aef1f0 con 0x55fd72adf6d0 2024-04-23T18:29:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.375+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94547039157392] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040d0040 con 0x55fd72ae3e60 2024-04-23T18:29:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.375+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x55fd72adf6d0 2024-04-23T18:29:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.375+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94547039149968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aef1f0 con 0x55fd72adf6d0 2024-04-23T18:29:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.375+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72af1440 con 0x7f55040b9020 2024-04-23T18:29:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.376+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x7f55040b9020 2024-04-23T18:29:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.376+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94547039162160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72af1400 con 0x7f55040b9020 2024-04-23T18:29:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.376+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72af2360 con 0x7f55040b9020 2024-04-23T18:29:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.376+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94547039149968] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x55fd72adf6d0 2024-04-23T18:29:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.377+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94547039162160] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x7f55040b9020 2024-04-23T18:29:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.377+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x7f55040b9020 2024-04-23T18:29:31.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.378+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94547039160960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72af1eb0 con 0x7f55040b9020 2024-04-23T18:29:31.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.378+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72af2870 con 0x7f55040b9020 2024-04-23T18:29:31.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.379+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94547039160960] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x7f55040b9020 2024-04-23T18:29:31.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.379+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x7f55040b9020 2024-04-23T18:29:31.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.379+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94547039163920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72af2870 con 0x7f55040b9020 2024-04-23T18:29:31.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.379+0000 7f5516b0c800 20 add_watcher() i=0 2024-04-23T18:29:31.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.379+0000 7f5516b0c800 20 add_watcher() i=1 2024-04-23T18:29:31.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.379+0000 7f5516b0c800 20 add_watcher() i=2 2024-04-23T18:29:31.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.379+0000 7f5516b0c800 20 add_watcher() i=3 2024-04-23T18:29:31.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.379+0000 7f5516b0c800 20 add_watcher() i=4 2024-04-23T18:29:31.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.379+0000 7f5516b0c800 20 add_watcher() i=5 2024-04-23T18:29:31.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.379+0000 7f5516b0c800 20 add_watcher() i=6 2024-04-23T18:29:31.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.380+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94547039163920] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x7f55040b9020 2024-04-23T18:29:31.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.380+0000 7f5516b0c800 20 add_watcher() i=7 2024-04-23T18:29:31.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.380+0000 7f5516b0c800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:31.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.380+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72af5ca0 con 0x55fd72adf6d0 2024-04-23T18:29:31.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.381+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f550c040040 con 0x55fd72adf6d0 2024-04-23T18:29:31.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.381+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94547039167888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72af3150 con 0x55fd72adf6d0 2024-04-23T18:29:31.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.382+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94547039167888] v32'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f550c040040 con 0x55fd72adf6d0 2024-04-23T18:29:31.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.382+0000 7f53ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.382+0000 7f5516b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:31.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.382+0000 7f5516b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:31.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.382+0000 7f5516b0c800 5 note: GC not initialized 2024-04-23T18:29:31.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.382+0000 7f53c97e2640 20 reqs_thread_entry: start 2024-04-23T18:29:31.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.382+0000 7f5516b0c800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:31.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.382+0000 7f5516b0c800 20 Filter name: none 2024-04-23T18:29:31.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.382+0000 7f533affd640 20 reqs_thread_entry: start 2024-04-23T18:29:31.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.382+0000 7f5516b0c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.382+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd72b28f00 con 0x55fd72adf6d0 2024-04-23T18:29:31.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.384+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f550c040040 con 0x55fd72adf6d0 2024-04-23T18:29:31.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.384+0000 7f5516b0c800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:31.388 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:31.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.385+0000 7f53ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.385+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94547039167888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72b27d10 con 0x55fd72adf6d0 2024-04-23T18:29:31.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.386+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94547039167888] v32'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f550c040040 con 0x55fd72adf6d0 2024-04-23T18:29:31.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.386+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94547039142944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72af2560 con 0x55fd72ae3e60 2024-04-23T18:29:31.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.387+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94547039142944] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040d0040 con 0x55fd72ae3e60 2024-04-23T18:29:31.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.387+0000 7f5516b0c800 20 remove_watcher() i=0 2024-04-23T18:29:31.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.387+0000 7f5516b0c800 2 removed watcher, disabling cache 2024-04-23T18:29:31.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.387+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94547039148912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aec420 con 0x55fd72adf6d0 2024-04-23T18:29:31.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.388+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94547039148912] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x55fd72adf6d0 2024-04-23T18:29:31.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.388+0000 7f5516b0c800 20 remove_watcher() i=1 2024-04-23T18:29:31.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.388+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94547039152464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aec420 con 0x55fd72ae8a40 2024-04-23T18:29:31.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.389+0000 7f5513e0a640 1 -- 172.21.15.119:0/2184109790 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94547039152464] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5508009050 con 0x55fd72ae8a40 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.389+0000 7f5516b0c800 20 remove_watcher() i=2 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.389+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94547039157392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aedb70 con 0x55fd72ae3e60 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.390+0000 7f551460b640 1 -- 172.21.15.119:0/2184109790 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94547039157392] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55040d0040 con 0x55fd72ae3e60 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.390+0000 7f5516b0c800 20 remove_watcher() i=3 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.390+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94547039149968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aedb70 con 0x55fd72adf6d0 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.391+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94547039149968] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x55fd72adf6d0 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.391+0000 7f5516b0c800 20 remove_watcher() i=4 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.391+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94547039162160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72af2560 con 0x7f55040b9020 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.392+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94547039162160] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x7f55040b9020 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.392+0000 7f5516b0c800 20 remove_watcher() i=5 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.392+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94547039160960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72aefc90 con 0x7f55040b9020 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.393+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94547039160960] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x7f55040b9020 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.393+0000 7f5516b0c800 20 remove_watcher() i=6 2024-04-23T18:29:31.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.393+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94547039163920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd72af0a80 con 0x7f55040b9020 2024-04-23T18:29:31.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94547039163920] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f550c040040 con 0x7f55040b9020 2024-04-23T18:29:31.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 20 remove_watcher() i=7 2024-04-23T18:29:31.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f55040b9020 msgr2=0x7f550406da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f55040b9020 0x7f550406da50 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd72adf6d0 msgr2=0x55fd72ae1b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd72adf6d0 0x55fd72ae1b90 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd72ae3e60 msgr2=0x55fd72ae6250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd72ae3e60 0x55fd72ae6250 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55fd72ae8a40 msgr2=0x55fd72aeaf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55fd72ae8a40 0x55fd72aeaf00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53dc036eb0 msgr2=0x7f53dc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53dc036eb0 0x7f53dc039370 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5508001b60 tx=0x7f5508010000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 msgr2=0x55fd72ad3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5514e0c640 1 -- 172.21.15.119:0/2184109790 reap_dead start 2024-04-23T18:29:31.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 0x55fd72ad3ef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5504002d00 tx=0x7f550405aed0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 shutdown_connections 2024-04-23T18:29:31.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 --2- 172.21.15.119:0/2184109790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72accb80 0x55fd72ad3ef0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 >> 172.21.15.119:0/2184109790 conn(0x55fd72ac8e50 msgr2=0x55fd72ac64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 shutdown_connections 2024-04-23T18:29:31.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 -- 172.21.15.119:0/2184109790 wait complete. 2024-04-23T18:29:31.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 -- 172.21.15.119:0/859192677 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53ec036e60 msgr2=0x7f53ec039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 --2- 172.21.15.119:0/859192677 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53ec036e60 0x7f53ec039320 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f550800bf50 tx=0x7f550800f000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 -- 172.21.15.119:0/859192677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72abf9d0 msgr2=0x55fd72abfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.394+0000 7f5516b0c800 1 --2- 172.21.15.119:0/859192677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72abf9d0 0x55fd72abfdf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f550406d000 tx=0x7f5504079950 comp rx=0 tx=0).stop 2024-04-23T18:29:31.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 -- 172.21.15.119:0/859192677 shutdown_connections 2024-04-23T18:29:31.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 --2- 172.21.15.119:0/859192677 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53ec036e60 0x7f53ec039320 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 --2- 172.21.15.119:0/859192677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd72abf9d0 0x55fd72abfdf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 -- 172.21.15.119:0/859192677 >> 172.21.15.119:0/859192677 conn(0x55fd72ab3a70 msgr2=0x55fd72ab3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 -- 172.21.15.119:0/859192677 shutdown_connections 2024-04-23T18:29:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 -- 172.21.15.119:0/859192677 wait complete. 2024-04-23T18:29:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55fd72aae930 msgr2=0x55fd72ab0dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55fd72aae930 0x55fd72ab0dc0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd729a7170 msgr2=0x55fd72aa8120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd729a7170 0x55fd72aa8120 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd72aaaa40 msgr2=0x55fd72aace30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd72aaaa40 0x55fd72aace30 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53fc036e60 msgr2=0x7f53fc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f53fc036e60 0x7f53fc039320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5508000f60 tx=0x7f55080012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 msgr2=0x55fd72aa10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 --2- 172.21.15.119:0/3089217596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd729a5f60 0x55fd72aa10b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5504060040 tx=0x7f5504002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5514e0c640 1 -- 172.21.15.119:0/3089217596 reap_dead start 2024-04-23T18:29:31.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 shutdown_connections 2024-04-23T18:29:31.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 >> 172.21.15.119:0/3089217596 conn(0x55fd729a1540 msgr2=0x55fd7291a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 shutdown_connections 2024-04-23T18:29:31.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.395+0000 7f5516b0c800 1 -- 172.21.15.119:0/3089217596 wait complete. 2024-04-23T18:29:31.400 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:31.400 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-23T18:29:31.400 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-23T18:29:31.400 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-04-23T18:29:31.487 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:31.487 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:31.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.495+0000 7faf0ed19800 1 Processor -- start 2024-04-23T18:29:31.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.495+0000 7faf0ed19800 1 -- start start 2024-04-23T18:29:31.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.495+0000 7faf0ed19800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b3040198b0 0x55b304019cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.495+0000 7faf0ed19800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b303ecb560 con 0x55b30401a210 2024-04-23T18:29:31.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.495+0000 7faf0ed19800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55b303ebce20 con 0x55b3040198b0 2024-04-23T18:29:31.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.496+0000 7faf0c818640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b3040198b0 0x55b304019cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.496+0000 7faf07fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55b30401a210 0x55b30401a6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40550/0 (socket says 172.21.15.119:40550) 2024-04-23T18:29:31.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.496+0000 7faf07fff640 1 -- 172.21.15.119:0/1989928620 learned_addr learned my addr 172.21.15.119:0/1989928620 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:31.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.496+0000 7faf0c818640 1 -- 172.21.15.119:0/1989928620 >> v1:172.21.15.62:6789/0 conn(0x55b30401a210 legacy=0x55b30401a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.496+0000 7faf0c818640 1 -- 172.21.15.119:0/1989928620 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b303ecae60 con 0x55b3040198b0 2024-04-23T18:29:31.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.498+0000 7faf0c818640 1 --2- 172.21.15.119:0/1989928620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b304019cd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf0000a470 tx=0x7faf0001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8925f32c11a96c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.498+0000 7faf077fe640 1 -- 172.21.15.119:0/1989928620 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf00057070 con 0x55b3040198b0 2024-04-23T18:29:31.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.498+0000 7faf077fe640 1 -- 172.21.15.119:0/1989928620 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0004adc0 con 0x55b3040198b0 2024-04-23T18:29:31.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.498+0000 7faf077fe640 1 -- 172.21.15.119:0/1989928620 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf00052590 con 0x55b3040198b0 2024-04-23T18:29:31.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.498+0000 7faf0ed19800 1 -- 172.21.15.119:0/1989928620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 msgr2=0x55b304019cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.498+0000 7faf0ed19800 1 --2- 172.21.15.119:0/1989928620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b304019cd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf0000a470 tx=0x7faf0001ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:31.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.498+0000 7faf0ed19800 1 -- 172.21.15.119:0/1989928620 shutdown_connections 2024-04-23T18:29:31.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.498+0000 7faf0ed19800 1 --2- 172.21.15.119:0/1989928620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b304019cd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.498+0000 7faf0ed19800 1 -- 172.21.15.119:0/1989928620 >> 172.21.15.119:0/1989928620 conn(0x55b304015430 msgr2=0x55b304017850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.498+0000 7faf0ed19800 1 -- 172.21.15.119:0/1989928620 shutdown_connections 2024-04-23T18:29:31.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.498+0000 7faf0ed19800 1 -- 172.21.15.119:0/1989928620 wait complete. 2024-04-23T18:29:31.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.511+0000 7faf0ed19800 1 Processor -- start 2024-04-23T18:29:31.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.511+0000 7faf0ed19800 1 -- start start 2024-04-23T18:29:31.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.511+0000 7faf0ed19800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b30410e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.511+0000 7faf0ed19800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b303f665d0 con 0x55b3040198b0 2024-04-23T18:29:31.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.511+0000 7faf0c818640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b30410e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.511+0000 7faf0c818640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b30410e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60788/0 (socket says 172.21.15.119:60788) 2024-04-23T18:29:31.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.511+0000 7faf0c818640 1 -- 172.21.15.119:0/3230168933 learned_addr learned my addr 172.21.15.119:0/3230168933 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.512+0000 7faf0c818640 1 -- 172.21.15.119:0/3230168933 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b303edc860 con 0x55b3040198b0 2024-04-23T18:29:31.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.512+0000 7faf0c818640 1 --2- 172.21.15.119:0/3230168933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b30410e5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faf00055040 tx=0x7faf0004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea08c0e22176cf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.512+0000 7fadfae05640 1 -- 172.21.15.119:0/3230168933 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf00057040 con 0x55b3040198b0 2024-04-23T18:29:31.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.512+0000 7fadfae05640 1 -- 172.21.15.119:0/3230168933 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf00062070 con 0x55b3040198b0 2024-04-23T18:29:31.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.512+0000 7fadfae05640 1 -- 172.21.15.119:0/3230168933 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf0005d470 con 0x55b3040198b0 2024-04-23T18:29:31.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0ed19800 1 -- 172.21.15.119:0/3230168933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 msgr2=0x55b30410e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0ed19800 1 --2- 172.21.15.119:0/3230168933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b30410e5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faf00055040 tx=0x7faf0004c000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0ed19800 1 -- 172.21.15.119:0/3230168933 shutdown_connections 2024-04-23T18:29:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0ed19800 1 --2- 172.21.15.119:0/3230168933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b30410e5a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0ed19800 1 -- 172.21.15.119:0/3230168933 >> 172.21.15.119:0/3230168933 conn(0x55b304015430 msgr2=0x55b304109ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0ed19800 1 -- 172.21.15.119:0/3230168933 shutdown_connections 2024-04-23T18:29:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0ed19800 1 -- 172.21.15.119:0/3230168933 wait complete. 2024-04-23T18:29:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0ed19800 1 Processor -- start 2024-04-23T18:29:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0ed19800 1 -- start start 2024-04-23T18:29:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0ed19800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b304115ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0ed19800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b30401b070 con 0x55b3040198b0 2024-04-23T18:29:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0c818640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b304115ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0c818640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b304115ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60802/0 (socket says 172.21.15.119:60802) 2024-04-23T18:29:31.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.513+0000 7faf0c818640 1 -- 172.21.15.119:0/636917526 learned_addr learned my addr 172.21.15.119:0/636917526 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.514+0000 7faf0c818640 1 -- 172.21.15.119:0/636917526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b303edaeb0 con 0x55b3040198b0 2024-04-23T18:29:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.514+0000 7faf0c818640 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b304115ec0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf0001ce60 tx=0x7faf00002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.514+0000 7fadf9602640 1 -- 172.21.15.119:0/636917526 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf0006b070 con 0x55b3040198b0 2024-04-23T18:29:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.514+0000 7fadf9602640 1 -- 172.21.15.119:0/636917526 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0005d970 con 0x55b3040198b0 2024-04-23T18:29:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.514+0000 7fadf9602640 1 -- 172.21.15.119:0/636917526 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf00057070 con 0x55b3040198b0 2024-04-23T18:29:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.514+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b304116400 con 0x55b3040198b0 2024-04-23T18:29:31.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.514+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b304116920 con 0x55b3040198b0 2024-04-23T18:29:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.515+0000 7fadf9602640 1 -- 172.21.15.119:0/636917526 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7faf0005dc90 con 0x55b3040198b0 2024-04-23T18:29:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.515+0000 7fadf9602640 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fadf4036eb0 0x7fadf4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.515+0000 7fadf9602640 1 -- 172.21.15.119:0/636917526 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7faf0008e7f0 con 0x55b3040198b0 2024-04-23T18:29:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.516+0000 7faf07fff640 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fadf4036eb0 0x7fadf4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.516+0000 7faf0ed19800 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b30401a210 0x55b30411cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.516+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30411d470 con 0x55b30401a210 2024-04-23T18:29:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.516+0000 7faf0d019640 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b30401a210 0x55b30411cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.516+0000 7faf07fff640 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fadf4036eb0 0x7fadf4039370 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faef8000f60 tx=0x7faef80012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.516+0000 7faf0d019640 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b30401a210 0x55b30411cee0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.516+0000 7faf0d019640 1 -- 172.21.15.119:0/636917526 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b30401a210 2024-04-23T18:29:31.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.516+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30411a490 con 0x55b30401a210 2024-04-23T18:29:31.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.516+0000 7faf0d019640 1 -- 172.21.15.119:0/636917526 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b30401a210 2024-04-23T18:29:31.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.517+0000 7faf0ed19800 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b30411f7f0 0x55b304121be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.517+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3041222d0 con 0x55b30411f7f0 2024-04-23T18:29:31.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.517+0000 7faf0c818640 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b30411f7f0 0x55b304121be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.517+0000 7faf0c818640 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b30411f7f0 0x55b304121be0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.517+0000 7faf0c818640 1 -- 172.21.15.119:0/636917526 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faf0005a040 con 0x55b30411f7f0 2024-04-23T18:29:31.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.517+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30411e7a0 con 0x55b30401a210 2024-04-23T18:29:31.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.517+0000 7faf0d019640 1 -- 172.21.15.119:0/636917526 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b30401a210 2024-04-23T18:29:31.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.517+0000 7faf0ed19800 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b304123780 0x55b304125bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.517+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b304126330 con 0x55b304123780 2024-04-23T18:29:31.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.518+0000 7faf07fff640 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b304123780 0x55b304125bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.518+0000 7faf07fff640 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b304123780 0x55b304125bd0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.518+0000 7faf07fff640 1 -- 172.21.15.119:0/636917526 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faef8009050 con 0x55b304123780 2024-04-23T18:29:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.519+0000 7faf0ed19800 1 Processor -- start 2024-04-23T18:29:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.519+0000 7faf0ed19800 1 -- start start 2024-04-23T18:29:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.519+0000 7faf0ed19800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304134790 0x55b304134bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.519+0000 7faf0ed19800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b303f0cdf0 con 0x55b304134790 2024-04-23T18:29:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.519+0000 7faf0c818640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304134790 0x55b304134bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.519+0000 7faf0c818640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304134790 0x55b304134bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60816/0 (socket says 172.21.15.119:60816) 2024-04-23T18:29:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.519+0000 7faf0c818640 1 -- 172.21.15.119:0/1383936291 learned_addr learned my addr 172.21.15.119:0/1383936291 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.519+0000 7faf0c818640 1 -- 172.21.15.119:0/1383936291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3041350f0 con 0x55b304134790 2024-04-23T18:29:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.519+0000 7faf0c818640 1 --2- 172.21.15.119:0/1383936291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304134790 0x55b304134bb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf0008cbe0 tx=0x7faf00072dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.519+0000 7fadf27fc640 1 -- 172.21.15.119:0/1383936291 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf0005bcd0 con 0x55b304134790 2024-04-23T18:29:31.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.519+0000 7fadf27fc640 1 -- 172.21.15.119:0/1383936291 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0008ea90 con 0x55b304134790 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.519+0000 7faf0ed19800 1 -- 172.21.15.119:0/1383936291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b304135b60 con 0x55b304134790 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.519+0000 7fadf27fc640 1 -- 172.21.15.119:0/1383936291 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf0008edb0 con 0x55b304134790 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.520+0000 7faf0ed19800 1 -- 172.21.15.119:0/1383936291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b304136060 con 0x55b304134790 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.520+0000 7fadf27fc640 1 -- 172.21.15.119:0/1383936291 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7faf0008e050 con 0x55b304134790 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.520+0000 7fadf27fc640 1 --2- 172.21.15.119:0/1383936291 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fade4036e60 0x7fade4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.520+0000 7fadf27fc640 1 -- 172.21.15.119:0/1383936291 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7faf00086070 con 0x55b304134790 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.520+0000 7faf07fff640 1 --2- 172.21.15.119:0/1383936291 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fade4036e60 0x7fade4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.521+0000 7faf0ed19800 1 Processor -- start 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.521+0000 7faf0ed19800 1 -- start start 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.521+0000 7faf0ed19800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304141910 0x55b304141d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.521+0000 7faf07fff640 1 --2- 172.21.15.119:0/1383936291 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fade4036e60 0x7fade4039320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faef800bf50 tx=0x7faef800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.521+0000 7faf0ed19800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b30410ec60 con 0x55b304141910 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.521+0000 7faf0c818640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304141910 0x55b304141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.521+0000 7faf0c818640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304141910 0x55b304141d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60830/0 (socket says 172.21.15.119:60830) 2024-04-23T18:29:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.521+0000 7faf0c818640 1 -- 172.21.15.119:0/3965710225 learned_addr learned my addr 172.21.15.119:0/3965710225 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.521+0000 7faf0c818640 1 -- 172.21.15.119:0/3965710225 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3041422e0 con 0x55b304141910 2024-04-23T18:29:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.521+0000 7faf0c818640 1 --2- 172.21.15.119:0/3965710225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304141910 0x55b304141d10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faf0006e510 tx=0x7faf0008e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863e86454cca7430 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.521+0000 7fade3fff640 1 -- 172.21.15.119:0/3965710225 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf000518b0 con 0x55b304141910 2024-04-23T18:29:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.521+0000 7fade3fff640 1 -- 172.21.15.119:0/3965710225 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf000a0070 con 0x55b304141910 2024-04-23T18:29:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.521+0000 7fade3fff640 1 -- 172.21.15.119:0/3965710225 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf000675d0 con 0x55b304141910 2024-04-23T18:29:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.522+0000 7faf0ed19800 1 -- 172.21.15.119:0/3965710225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304141910 msgr2=0x55b304141d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.522+0000 7faf0ed19800 1 --2- 172.21.15.119:0/3965710225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304141910 0x55b304141d10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faf0006e510 tx=0x7faf0008e710 comp rx=0 tx=0).stop 2024-04-23T18:29:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.522+0000 7faf0ed19800 1 -- 172.21.15.119:0/3965710225 shutdown_connections 2024-04-23T18:29:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.522+0000 7faf0ed19800 1 --2- 172.21.15.119:0/3965710225 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304141910 0x55b304141d10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.522+0000 7faf0ed19800 1 -- 172.21.15.119:0/3965710225 >> 172.21.15.119:0/3965710225 conn(0x55b30413dbe0 msgr2=0x55b30413bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.522+0000 7faf0ed19800 1 -- 172.21.15.119:0/3965710225 shutdown_connections 2024-04-23T18:29:31.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.522+0000 7faf0ed19800 1 -- 172.21.15.119:0/3965710225 wait complete. 2024-04-23T18:29:31.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.522+0000 7faf0ed19800 1 Processor -- start 2024-04-23T18:29:31.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.522+0000 7faf0ed19800 1 -- start start 2024-04-23T18:29:31.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.522+0000 7faf0ed19800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304141910 0x55b304148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.522+0000 7faf0ed19800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b3041429d0 con 0x55b304141910 2024-04-23T18:29:31.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.523+0000 7faf0c818640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304141910 0x55b304148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.523+0000 7faf0c818640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304141910 0x55b304148d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60832/0 (socket says 172.21.15.119:60832) 2024-04-23T18:29:31.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.523+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 learned_addr learned my addr 172.21.15.119:0/2059293927 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.523+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b304149250 con 0x55b304141910 2024-04-23T18:29:31.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.523+0000 7faf0c818640 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304141910 0x55b304148d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faf00072040 tx=0x7faf00059ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.524+0000 7fade27fc640 1 -- 172.21.15.119:0/2059293927 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf000b4070 con 0x55b304141910 2024-04-23T18:29:31.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.524+0000 7fade27fc640 1 -- 172.21.15.119:0/2059293927 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf00079850 con 0x55b304141910 2024-04-23T18:29:31.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.524+0000 7fade27fc640 1 -- 172.21.15.119:0/2059293927 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf000518b0 con 0x55b304141910 2024-04-23T18:29:31.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.524+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b304149250 con 0x55b304141910 2024-04-23T18:29:31.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.524+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3041496f0 con 0x55b304141910 2024-04-23T18:29:31.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.525+0000 7fade27fc640 1 -- 172.21.15.119:0/2059293927 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7faf000b7070 con 0x55b304141910 2024-04-23T18:29:31.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.525+0000 7faf0ed19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.525+0000 7fade27fc640 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fadd8036e80 0x7fadd8039340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.526+0000 7fade27fc640 1 -- 172.21.15.119:0/2059293927 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7faf000aa030 con 0x55b304141910 2024-04-23T18:29:31.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.526+0000 7faf07fff640 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fadd8036e80 0x7fadd8039340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.526+0000 7faf0ed19800 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b304154440 0x55b304156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.526+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b304157050 con 0x55b304154440 2024-04-23T18:29:31.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.526+0000 7faf0d019640 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b304154440 0x55b304156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.526+0000 7faf07fff640 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fadd8036e80 0x7fadd8039340 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faef8001b60 tx=0x7faef8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.526+0000 7faf0d019640 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b304154440 0x55b304156900 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b304154440 2024-04-23T18:29:31.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 20 realm 2024-04-23T18:29:31.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b304157460 con 0x55b304154440 2024-04-23T18:29:31.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b304154440 2024-04-23T18:29:31.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:31.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b304157d00 con 0x55b304154440 2024-04-23T18:29:31.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b304154440 2024-04-23T18:29:31.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304154440 2024-04-23T18:29:31.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b304154440 2024-04-23T18:29:31.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b304158e00 0x55b30415b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30415b840 con 0x55b304158e00 2024-04-23T18:29:31.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.527+0000 7faf0c818640 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b304158e00 0x55b30415b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.528+0000 7faf0c818640 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b304158e00 0x55b30415b1f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.528+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faf000b6030 con 0x55b304158e00 2024-04-23T18:29:31.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.528+0000 7faf0ed19800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:31.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.528+0000 7faf0ed19800 20 searching for the correct realm 2024-04-23T18:29:31.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.528+0000 7faf0ed19800 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b30415d7d0 0x55b30415fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.528+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b304160310 con 0x55b30415d7d0 2024-04-23T18:29:31.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.528+0000 7faf07fff640 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b30415d7d0 0x55b30415fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.528+0000 7faf07fff640 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b30415d7d0 0x55b30415fc90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.529+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.529+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b304160310 con 0x55b304158e00 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.529+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf000b6030 con 0x55b304158e00 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.529+0000 7faf0c818640 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7faf000b9060 0x7faf00092920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.529+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b304160310 con 0x7faf000b9060 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.529+0000 7faf0d019640 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7faf000b9060 0x7faf00092920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.530+0000 7faf0d019640 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7faf000b9060 0x7faf00092920 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.530+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf0800a4a0 con 0x7faf000b9060 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.530+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304154440 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.530+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b304154440 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.530+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304154440 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.530+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b304154440 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.530+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x7faf000b9060 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.531+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf0800a4a0 con 0x7faf000b9060 2024-04-23T18:29:31.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.531+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x7faf000b9060 2024-04-23T18:29:31.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.531+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faf0800a4a0 con 0x7faf000b9060 2024-04-23T18:29:31.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.531+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304158e00 2024-04-23T18:29:31.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.531+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf000b6030 con 0x55b304158e00 2024-04-23T18:29:31.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.531+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b30415d7d0 2024-04-23T18:29:31.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.531+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.531+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304154440 2024-04-23T18:29:31.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.532+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b304154440 2024-04-23T18:29:31.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.532+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x7faf000b9060 2024-04-23T18:29:31.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.532+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf0800a4a0 con 0x7faf000b9060 2024-04-23T18:29:31.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.532+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304154440 2024-04-23T18:29:31.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.532+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b304154440 2024-04-23T18:29:31.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.532+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304158e00 2024-04-23T18:29:31.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.532+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faf000b6030 con 0x55b304158e00 2024-04-23T18:29:31.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.532+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b30415d7d0 2024-04-23T18:29:31.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.532+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.532+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b30415d7d0 2024-04-23T18:29:31.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.533+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.533+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x7faf000b9060 2024-04-23T18:29:31.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.533+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf0800a4a0 con 0x7faf000b9060 2024-04-23T18:29:31.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.533+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b30415d7d0 2024-04-23T18:29:31.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.533+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.533+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b30415d7d0 2024-04-23T18:29:31.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.533+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.534+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304154440 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.534+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b304154440 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.534+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304154440 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.534+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b304154440 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.534+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x7faf000b9060 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.534+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf0800a4a0 con 0x7faf000b9060 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.534+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b30415d7d0 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.534+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.534+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304158e00 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.535+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faf000b6030 con 0x55b304158e00 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.535+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304154440 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.535+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf0800a4a0 con 0x55b304154440 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.535+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x7faf000b9060 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.535+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf0800a4a0 con 0x7faf000b9060 2024-04-23T18:29:31.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.535+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b30415d7d0 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.536+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.536+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x7faf000b9060 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.536+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf0800a4a0 con 0x7faf000b9060 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.536+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304158e00 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.536+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf000b6030 con 0x55b304158e00 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.536+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b30415d7d0 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.536+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.536+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x7faf000b9060 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304154440 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b3041580a0 con 0x55b304158e00 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf000cb040 con 0x55b304158e00 2024-04-23T18:29:31.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0ed19800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0ed19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0ed19800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0ed19800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0ed19800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0ed19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0ed19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30415bbe0 con 0x55b304154440 2024-04-23T18:29:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0ed19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0ed19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.537+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30415bbe0 con 0x55b304154440 2024-04-23T18:29:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0ed19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0ed19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30415bbe0 con 0x7faf000b9060 2024-04-23T18:29:31.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0ed19800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:31.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0ed19800 20 zone default found 2024-04-23T18:29:31.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0ed19800 4 Realm: () 2024-04-23T18:29:31.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0ed19800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:31.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0ed19800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:31.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0ed19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:31.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0ed19800 20 zonegroup default 2024-04-23T18:29:31.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0ed19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30415c4d0 con 0x7faf000b9060 2024-04-23T18:29:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.538+0000 7faf0ed19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.539+0000 7faf0ed19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.539+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30415c4d0 con 0x55b30415d7d0 2024-04-23T18:29:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.539+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.539+0000 7faf0ed19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.539+0000 7faf0ed19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.539+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b304162170 con 0x55b30415d7d0 2024-04-23T18:29:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.539+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.539+0000 7faf0ed19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.539+0000 7faf0ed19800 20 started sync module instance, tier type = 2024-04-23T18:29:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.539+0000 7faf0ed19800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:31.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.539+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304161610 con 0x55b304158e00 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.540+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf000cb040 con 0x55b304158e00 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.540+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94227356064256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304161270 con 0x55b304158e00 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.540+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304162ed0 con 0x55b304154440 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.541+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94227356064256] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf000cb040 con 0x55b304158e00 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.541+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.541+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94227356067088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3041632c0 con 0x55b304154440 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.541+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304163ce0 con 0x55b30415d7d0 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.542+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94227356067088] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.542+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.542+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94227356071888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3041640d0 con 0x55b30415d7d0 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.543+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304164b10 con 0x55b304158e00 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.543+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf000cb040 con 0x55b304158e00 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.543+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94227356071888] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.543+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94227356075488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3041653b0 con 0x55b304158e00 2024-04-23T18:29:31.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.543+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304162930 con 0x55b304154440 2024-04-23T18:29:31.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.544+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94227356075488] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf000cb040 con 0x55b304158e00 2024-04-23T18:29:31.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.545+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.545+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94227356077824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304165320 con 0x55b304154440 2024-04-23T18:29:31.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.545+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304166410 con 0x7faf000b9060 2024-04-23T18:29:31.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.545+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.546+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94227356082016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304166830 con 0x7faf000b9060 2024-04-23T18:29:31.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.546+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3041672e0 con 0x7faf000b9060 2024-04-23T18:29:31.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.546+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94227356077824] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.546+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94227356082016] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.547+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.547+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94227356080448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304166380 con 0x7faf000b9060 2024-04-23T18:29:31.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.547+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304167970 con 0x7faf000b9060 2024-04-23T18:29:31.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.548+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94227356080448] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.548+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.548+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94227356085696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304167970 con 0x7faf000b9060 2024-04-23T18:29:31.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.548+0000 7faf0ed19800 20 add_watcher() i=0 2024-04-23T18:29:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.548+0000 7faf0ed19800 20 add_watcher() i=1 2024-04-23T18:29:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.548+0000 7faf0ed19800 20 add_watcher() i=2 2024-04-23T18:29:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.548+0000 7faf0ed19800 20 add_watcher() i=3 2024-04-23T18:29:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.548+0000 7faf0ed19800 20 add_watcher() i=4 2024-04-23T18:29:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.548+0000 7faf0ed19800 20 add_watcher() i=5 2024-04-23T18:29:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.548+0000 7faf0ed19800 20 add_watcher() i=6 2024-04-23T18:29:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.548+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94227356085696] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.549+0000 7faf0ed19800 20 add_watcher() i=7 2024-04-23T18:29:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.549+0000 7faf0ed19800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.549+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30416abf0 con 0x55b304154440 2024-04-23T18:29:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.549+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.549+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94227356100032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3041679d0 con 0x55b304154440 2024-04-23T18:29:31.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.550+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94227356100032] v32'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.550+0000 7fadc2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.550+0000 7faf0ed19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:31.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.550+0000 7faf0ed19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:31.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.550+0000 7faf0ed19800 5 note: GC not initialized 2024-04-23T18:29:31.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.550+0000 7fadc1fe3640 20 reqs_thread_entry: start 2024-04-23T18:29:31.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.550+0000 7faf0ed19800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:31.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.550+0000 7faf0ed19800 20 Filter name: none 2024-04-23T18:29:31.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.550+0000 7fad337fe640 20 reqs_thread_entry: start 2024-04-23T18:29:31.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:31.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30419e370 con 0x55b304154440 2024-04-23T18:29:31.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:31.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:31.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:31.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:31.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-23T18:29:31.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30419ede0 con 0x7faf000b9060 2024-04-23T18:29:31.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-23T18:29:31.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-23T18:29:31.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-23T18:29:31.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.551+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3041a4710 con 0x55b304154440 2024-04-23T18:29:31.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.552+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v32'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.552+0000 7faf0ed19800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:31.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.552+0000 7faf0ed19800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:31.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.552+0000 7faf0ed19800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:31.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.553+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94227356336512 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30419fe20 con 0x55b304154440 2024-04-23T18:29:31.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.553+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify (1) cookie 94227356077824 notify 137438953475 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7faf08046450 con 0x55b304154440 2024-04-23T18:29:31.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.553+0000 7fade3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94227356077824 notifier 4336 bl.length()=678 2024-04-23T18:29:31.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.553+0000 7fade3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:31.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.553+0000 7fade3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:31.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.553+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(65 notify.4 [notify cookie 94227356336512 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.553+0000 7fade3fff640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fadd0003ea0 con 0x55b304154440 2024-04-23T18:29:31.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.553+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.553+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify_complete (2) cookie 94227356336512 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7faf08005040 con 0x55b304154440 2024-04-23T18:29:31.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.553+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3041a4180 con 0x7faf000b9060 2024-04-23T18:29:31.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.554+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.554+0000 7faf0ed19800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-23T18:29:31.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.554+0000 7faf0ed19800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-23T18:29:31.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.554+0000 7faf0ed19800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-23T18:29:31.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.554+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94227356336512 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b30419f970 con 0x55b30415d7d0 2024-04-23T18:29:31.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.555+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== watch-notify(notify (1) cookie 94227356071888 notify 137438953472 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55b303ecb560 con 0x55b30415d7d0 2024-04-23T18:29:31.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.555+0000 7fade37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94227356071888 notifier 4336 bl.length()=177 2024-04-23T18:29:31.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.555+0000 7fade37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-23T18:29:31.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.555+0000 7fade37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-23T18:29:31.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.555+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(68 notify.2 [notify cookie 94227356336512 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.555+0000 7fade37fe640 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fad40003400 con 0x55b30415d7d0 2024-04-23T18:29:31.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.555+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.555+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== watch-notify(notify_complete (2) cookie 94227356336512 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7faef8038430 con 0x55b30415d7d0 2024-04-23T18:29:31.562 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-23T18:29:31.552687Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:31.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.556+0000 7fadc2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.556+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94227356100032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3041a0250 con 0x55b304154440 2024-04-23T18:29:31.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.557+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94227356100032] v32'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.557+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94227356064256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b30416a5c0 con 0x55b304158e00 2024-04-23T18:29:31.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.558+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94227356064256] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf000cb040 con 0x55b304158e00 2024-04-23T18:29:31.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.558+0000 7faf0ed19800 20 remove_watcher() i=0 2024-04-23T18:29:31.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.558+0000 7faf0ed19800 2 removed watcher, disabling cache 2024-04-23T18:29:31.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.558+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94227356067088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304161a00 con 0x55b304154440 2024-04-23T18:29:31.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.559+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94227356067088] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.559+0000 7faf0ed19800 20 remove_watcher() i=1 2024-04-23T18:29:31.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.559+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94227356071888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304162510 con 0x55b30415d7d0 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.560+0000 7faf07fff640 1 -- 172.21.15.119:0/2059293927 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94227356071888] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef8009050 con 0x55b30415d7d0 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.560+0000 7faf0ed19800 20 remove_watcher() i=2 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.560+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94227356075488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304162510 con 0x55b304158e00 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.561+0000 7faf0c818640 1 -- 172.21.15.119:0/2059293927 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94227356075488] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf000cb040 con 0x55b304158e00 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.561+0000 7faf0ed19800 20 remove_watcher() i=3 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.561+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94227356077824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3041645e0 con 0x55b304154440 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.562+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94227356077824] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x55b304154440 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.562+0000 7faf0ed19800 20 remove_watcher() i=4 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.562+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94227356082016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304162510 con 0x7faf000b9060 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.564+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94227356082016] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.564+0000 7faf0ed19800 20 remove_watcher() i=5 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.564+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94227356080448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b3041645e0 con 0x7faf000b9060 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.565+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94227356080448] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.565+0000 7faf0ed19800 20 remove_watcher() i=6 2024-04-23T18:29:31.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.565+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94227356085696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b304162510 con 0x7faf000b9060 2024-04-23T18:29:31.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94227356085696] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf08040040 con 0x7faf000b9060 2024-04-23T18:29:31.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 20 remove_watcher() i=7 2024-04-23T18:29:31.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7faf000b9060 msgr2=0x7faf00092920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7faf000b9060 0x7faf00092920 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b304154440 msgr2=0x55b304156900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b304154440 0x55b304156900 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b304158e00 msgr2=0x55b30415b1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b304158e00 0x55b30415b1f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b30415d7d0 msgr2=0x55b30415fc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b30415d7d0 0x55b30415fc90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fadd8036e80 msgr2=0x7fadd8039340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fadd8036e80 0x7fadd8039340 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faef8001b60 tx=0x7faef8010000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304141910 msgr2=0x55b304148d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 --2- 172.21.15.119:0/2059293927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304141910 0x55b304148d10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faf00072040 tx=0x7faf00059ec0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 reap_dead start 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0d019640 1 -- 172.21.15.119:0/2059293927 reap_dead start 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 shutdown_connections 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 >> 172.21.15.119:0/2059293927 conn(0x55b30413dbe0 msgr2=0x55b30413b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 shutdown_connections 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/2059293927 wait complete. 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/1383936291 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fade4036e60 msgr2=0x7fade4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 --2- 172.21.15.119:0/1383936291 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fade4036e60 0x7fade4039320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faef800bf50 tx=0x7faef800f000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/1383936291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304134790 msgr2=0x55b304134bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 --2- 172.21.15.119:0/1383936291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304134790 0x55b304134bb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf0008cbe0 tx=0x7faf00072dc0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/1383936291 shutdown_connections 2024-04-23T18:29:31.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 --2- 172.21.15.119:0/1383936291 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fade4036e60 0x7fade4039320 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 --2- 172.21.15.119:0/1383936291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b304134790 0x55b304134bb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/1383936291 >> 172.21.15.119:0/1383936291 conn(0x55b304128830 msgr2=0x55b304128c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/1383936291 shutdown_connections 2024-04-23T18:29:31.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.566+0000 7faf0ed19800 1 -- 172.21.15.119:0/1383936291 wait complete. 2024-04-23T18:29:31.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b304123780 msgr2=0x55b304125bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b304123780 0x55b304125bd0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b30401a210 msgr2=0x55b30411cee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b30401a210 0x55b30411cee0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b30411f7f0 msgr2=0x55b304121be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b30411f7f0 0x55b304121be0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fadf4036eb0 msgr2=0x7fadf4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fadf4036eb0 0x7fadf4039370 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faef8000f60 tx=0x7faef80012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 msgr2=0x55b304115ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 --2- 172.21.15.119:0/636917526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b3040198b0 0x55b304115ec0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf0001ce60 tx=0x7faf00002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0d019640 1 -- 172.21.15.119:0/636917526 reap_dead start 2024-04-23T18:29:31.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 shutdown_connections 2024-04-23T18:29:31.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 >> 172.21.15.119:0/636917526 conn(0x55b304015430 msgr2=0x55b30410cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 shutdown_connections 2024-04-23T18:29:31.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.567+0000 7faf0ed19800 1 -- 172.21.15.119:0/636917526 wait complete. 2024-04-23T18:29:31.573 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-23T18:29:31.552687Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:31.573 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-23T18:29:31.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-23T18:29:31.574 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-23T18:29:31.616 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:31.616 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:31.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.624+0000 7f8f63c12800 1 Processor -- start 2024-04-23T18:29:31.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.624+0000 7f8f63c12800 1 -- start start 2024-04-23T18:29:31.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.624+0000 7f8f63c12800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5632b64303a0 0x5632b6432790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.624+0000 7f8f63c12800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5632b62dc560 con 0x5632b642bf60 2024-04-23T18:29:31.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.624+0000 7f8f63c12800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5632b62cde20 con 0x5632b64303a0 2024-04-23T18:29:31.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.625+0000 7f8f5ea7c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5632b64303a0 0x5632b6432790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.625+0000 7f8f5f27d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5632b642bf60 0x5632b642c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40560/0 (socket says 172.21.15.119:40560) 2024-04-23T18:29:31.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.625+0000 7f8f5f27d640 1 -- 172.21.15.119:0/1934921404 learned_addr learned my addr 172.21.15.119:0/1934921404 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:31.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.625+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/1934921404 >> v1:172.21.15.62:6789/0 conn(0x5632b642bf60 legacy=0x5632b642c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.625+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/1934921404 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632b62dbe60 con 0x5632b64303a0 2024-04-23T18:29:31.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.627+0000 7f8f5ea7c640 1 --2- 172.21.15.119:0/1934921404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b64303a0 0x5632b6432790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400a470 tx=0x7f8f5401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf5a686a93b517c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.627+0000 7f8f5e27b640 1 -- 172.21.15.119:0/1934921404 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f54057070 con 0x5632b64303a0 2024-04-23T18:29:31.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.627+0000 7f8f5e27b640 1 -- 172.21.15.119:0/1934921404 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f54052570 con 0x5632b64303a0 2024-04-23T18:29:31.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.627+0000 7f8f5e27b640 1 -- 172.21.15.119:0/1934921404 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f54052870 con 0x5632b64303a0 2024-04-23T18:29:31.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.627+0000 7f8f63c12800 1 -- 172.21.15.119:0/1934921404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b64303a0 msgr2=0x5632b6432790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.627+0000 7f8f63c12800 1 --2- 172.21.15.119:0/1934921404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b64303a0 0x5632b6432790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400a470 tx=0x7f8f5401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:31.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.627+0000 7f8f63c12800 1 -- 172.21.15.119:0/1934921404 shutdown_connections 2024-04-23T18:29:31.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.627+0000 7f8f63c12800 1 --2- 172.21.15.119:0/1934921404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b64303a0 0x5632b6432790 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.627+0000 7f8f63c12800 1 -- 172.21.15.119:0/1934921404 >> 172.21.15.119:0/1934921404 conn(0x5632b6427540 msgr2=0x5632b6429960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.627+0000 7f8f63c12800 1 -- 172.21.15.119:0/1934921404 shutdown_connections 2024-04-23T18:29:31.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.627+0000 7f8f63c12800 1 -- 172.21.15.119:0/1934921404 wait complete. 2024-04-23T18:29:31.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.639+0000 7f8f63c12800 1 Processor -- start 2024-04-23T18:29:31.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.639+0000 7f8f63c12800 1 -- start start 2024-04-23T18:29:31.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.639+0000 7f8f63c12800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b642bf60 0x5632b63a1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.639+0000 7f8f63c12800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5632b63775b0 con 0x5632b642bf60 2024-04-23T18:29:31.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.639+0000 7f8f5f27d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b642bf60 0x5632b63a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.639+0000 7f8f5f27d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b642bf60 0x5632b63a1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60846/0 (socket says 172.21.15.119:60846) 2024-04-23T18:29:31.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.639+0000 7f8f5f27d640 1 -- 172.21.15.119:0/672187180 learned_addr learned my addr 172.21.15.119:0/672187180 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.640+0000 7f8f5f27d640 1 -- 172.21.15.119:0/672187180 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632b62ed860 con 0x5632b642bf60 2024-04-23T18:29:31.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.640+0000 7f8f5f27d640 1 --2- 172.21.15.119:0/672187180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b642bf60 0x5632b63a1810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8f50001e10 tx=0x7f8f5000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc380babb6607ef server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.640+0000 7f8e4d60a640 1 -- 172.21.15.119:0/672187180 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f50012020 con 0x5632b642bf60 2024-04-23T18:29:31.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.640+0000 7f8e4d60a640 1 -- 172.21.15.119:0/672187180 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5000e5a0 con 0x5632b642bf60 2024-04-23T18:29:31.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.640+0000 7f8e4d60a640 1 -- 172.21.15.119:0/672187180 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5000e8e0 con 0x5632b642bf60 2024-04-23T18:29:31.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f63c12800 1 -- 172.21.15.119:0/672187180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b642bf60 msgr2=0x5632b63a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f63c12800 1 --2- 172.21.15.119:0/672187180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b642bf60 0x5632b63a1810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8f50001e10 tx=0x7f8f5000b780 comp rx=0 tx=0).stop 2024-04-23T18:29:31.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f63c12800 1 -- 172.21.15.119:0/672187180 shutdown_connections 2024-04-23T18:29:31.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f63c12800 1 --2- 172.21.15.119:0/672187180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b642bf60 0x5632b63a1810 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f63c12800 1 -- 172.21.15.119:0/672187180 >> 172.21.15.119:0/672187180 conn(0x5632b6427540 msgr2=0x5632b6518aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f63c12800 1 -- 172.21.15.119:0/672187180 shutdown_connections 2024-04-23T18:29:31.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f63c12800 1 -- 172.21.15.119:0/672187180 wait complete. 2024-04-23T18:29:31.638 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f63c12800 1 Processor -- start 2024-04-23T18:29:31.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f63c12800 1 -- start start 2024-04-23T18:29:31.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f63c12800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b642bf60 0x5632b6526cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f63c12800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5632b6433060 con 0x5632b642bf60 2024-04-23T18:29:31.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f5f27d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b642bf60 0x5632b6526cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f5f27d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b642bf60 0x5632b6526cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60848/0 (socket says 172.21.15.119:60848) 2024-04-23T18:29:31.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.641+0000 7f8f5f27d640 1 -- 172.21.15.119:0/350507082 learned_addr learned my addr 172.21.15.119:0/350507082 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.642+0000 7f8f5f27d640 1 -- 172.21.15.119:0/350507082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632b62ebeb0 con 0x5632b642bf60 2024-04-23T18:29:31.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.642+0000 7f8f5f27d640 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b642bf60 0x5632b6526cd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000b7c0 tx=0x7f8f50000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.642+0000 7f8e4be07640 1 -- 172.21.15.119:0/350507082 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f50012030 con 0x5632b642bf60 2024-04-23T18:29:31.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.642+0000 7f8e4be07640 1 -- 172.21.15.119:0/350507082 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f50001470 con 0x5632b642bf60 2024-04-23T18:29:31.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.642+0000 7f8e4be07640 1 -- 172.21.15.119:0/350507082 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5001a8d0 con 0x5632b642bf60 2024-04-23T18:29:31.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.642+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632b6527210 con 0x5632b642bf60 2024-04-23T18:29:31.639 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.642+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632b6527730 con 0x5632b642bf60 2024-04-23T18:29:31.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.643+0000 7f8e4be07640 1 -- 172.21.15.119:0/350507082 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8f50015020 con 0x5632b642bf60 2024-04-23T18:29:31.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.643+0000 7f8e4be07640 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e44036eb0 0x7f8e44039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.643+0000 7f8e4be07640 1 -- 172.21.15.119:0/350507082 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8f50020030 con 0x5632b642bf60 2024-04-23T18:29:31.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.643+0000 7f8f5ea7c640 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e44036eb0 0x7f8e44039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.643+0000 7f8f63c12800 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5632b64303a0 0x5632b652dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.643+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b652e2c0 con 0x5632b64303a0 2024-04-23T18:29:31.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.643+0000 7f8f5fa7e640 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5632b64303a0 0x5632b652dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.644+0000 7f8f5ea7c640 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e44036eb0 0x7f8e44039370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8f54054000 tx=0x7f8f5404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.644+0000 7f8f5fa7e640 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5632b64303a0 0x5632b652dd40 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.644+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/350507082 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b64303a0 2024-04-23T18:29:31.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.644+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b652b2f0 con 0x5632b64303a0 2024-04-23T18:29:31.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.644+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/350507082 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b64303a0 2024-04-23T18:29:31.640 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.644+0000 7f8f63c12800 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5632b65305d0 0x5632b65329c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.644+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b6533060 con 0x5632b65305d0 2024-04-23T18:29:31.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.644+0000 7f8f5f27d640 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5632b65305d0 0x5632b65329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.645+0000 7f8f5f27d640 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5632b65305d0 0x5632b65329c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.645+0000 7f8f5f27d640 1 -- 172.21.15.119:0/350507082 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f50026d90 con 0x5632b65305d0 2024-04-23T18:29:31.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.645+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b652f580 con 0x5632b64303a0 2024-04-23T18:29:31.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.645+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/350507082 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b64303a0 2024-04-23T18:29:31.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.645+0000 7f8f63c12800 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5632b6534510 0x5632b6536960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.645+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b65370c0 con 0x5632b6534510 2024-04-23T18:29:31.641 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.645+0000 7f8f5ea7c640 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5632b6534510 0x5632b6536960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.646+0000 7f8f5ea7c640 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5632b6534510 0x5632b6536960 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.646+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/350507082 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f54052a40 con 0x5632b6534510 2024-04-23T18:29:31.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.647+0000 7f8f63c12800 1 Processor -- start 2024-04-23T18:29:31.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.647+0000 7f8f63c12800 1 -- start start 2024-04-23T18:29:31.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.647+0000 7f8f63c12800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65454e0 0x5632b6545900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.647+0000 7f8f63c12800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5632b631ddf0 con 0x5632b65454e0 2024-04-23T18:29:31.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.647+0000 7f8f5f27d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65454e0 0x5632b6545900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.647+0000 7f8f5f27d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65454e0 0x5632b6545900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60862/0 (socket says 172.21.15.119:60862) 2024-04-23T18:29:31.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.647+0000 7f8f5f27d640 1 -- 172.21.15.119:0/3872732818 learned_addr learned my addr 172.21.15.119:0/3872732818 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.647+0000 7f8f5f27d640 1 -- 172.21.15.119:0/3872732818 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632b6545e40 con 0x5632b65454e0 2024-04-23T18:29:31.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.647+0000 7f8f5f27d640 1 --2- 172.21.15.119:0/3872732818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65454e0 0x5632b6545900 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8f5004b2d0 tx=0x7f8f5000db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.648+0000 7f8e49602640 1 -- 172.21.15.119:0/3872732818 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5003b070 con 0x5632b65454e0 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.648+0000 7f8e49602640 1 -- 172.21.15.119:0/3872732818 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f50017d80 con 0x5632b65454e0 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.648+0000 7f8f63c12800 1 -- 172.21.15.119:0/3872732818 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632b65468b0 con 0x5632b65454e0 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.648+0000 7f8e49602640 1 -- 172.21.15.119:0/3872732818 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5001ad80 con 0x5632b65454e0 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.648+0000 7f8f63c12800 1 -- 172.21.15.119:0/3872732818 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632b65468b0 con 0x5632b65454e0 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.648+0000 7f8e49602640 1 -- 172.21.15.119:0/3872732818 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8f5003e070 con 0x5632b65454e0 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.648+0000 7f8e49602640 1 --2- 172.21.15.119:0/3872732818 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e38036eb0 0x7f8e38039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.649+0000 7f8e49602640 1 -- 172.21.15.119:0/3872732818 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8f5004e8a0 con 0x5632b65454e0 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.649+0000 7f8f5ea7c640 1 --2- 172.21.15.119:0/3872732818 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e38036eb0 0x7f8e38039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.649+0000 7f8f63c12800 1 Processor -- start 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.649+0000 7f8f63c12800 1 -- start start 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.649+0000 7f8f5ea7c640 1 --2- 172.21.15.119:0/3872732818 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e38036eb0 0x7f8e38039370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5632b652b230 tx=0x7f8f54005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.649+0000 7f8f63c12800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 0x5632b65528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.649+0000 7f8f63c12800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5632b639fe90 con 0x5632b65524c0 2024-04-23T18:29:31.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.649+0000 7f8f5f27d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 0x5632b65528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.649+0000 7f8f5f27d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 0x5632b65528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60864/0 (socket says 172.21.15.119:60864) 2024-04-23T18:29:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.649+0000 7f8f5f27d640 1 -- 172.21.15.119:0/1353953708 learned_addr learned my addr 172.21.15.119:0/1353953708 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.649+0000 7f8f5f27d640 1 -- 172.21.15.119:0/1353953708 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632b6552eb0 con 0x5632b65524c0 2024-04-23T18:29:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.650+0000 7f8f5f27d640 1 --2- 172.21.15.119:0/1353953708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 0x5632b65528e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8f50018740 tx=0x7f8f50024b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5342dda148f9cab server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.650+0000 7f8e42ffd640 1 -- 172.21.15.119:0/1353953708 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5005f020 con 0x5632b65524c0 2024-04-23T18:29:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.650+0000 7f8e42ffd640 1 -- 172.21.15.119:0/1353953708 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5003fdd0 con 0x5632b65524c0 2024-04-23T18:29:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.650+0000 7f8e42ffd640 1 -- 172.21.15.119:0/1353953708 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5003fb10 con 0x5632b65524c0 2024-04-23T18:29:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.650+0000 7f8f63c12800 1 -- 172.21.15.119:0/1353953708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 msgr2=0x5632b65528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.650+0000 7f8f63c12800 1 --2- 172.21.15.119:0/1353953708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 0x5632b65528e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8f50018740 tx=0x7f8f50024b50 comp rx=0 tx=0).stop 2024-04-23T18:29:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.650+0000 7f8f63c12800 1 -- 172.21.15.119:0/1353953708 shutdown_connections 2024-04-23T18:29:31.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.650+0000 7f8f63c12800 1 --2- 172.21.15.119:0/1353953708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 0x5632b65528e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.650+0000 7f8f63c12800 1 -- 172.21.15.119:0/1353953708 >> 172.21.15.119:0/1353953708 conn(0x5632b654e790 msgr2=0x5632b654c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.650+0000 7f8f63c12800 1 -- 172.21.15.119:0/1353953708 shutdown_connections 2024-04-23T18:29:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.650+0000 7f8f63c12800 1 -- 172.21.15.119:0/1353953708 wait complete. 2024-04-23T18:29:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.651+0000 7f8f63c12800 1 Processor -- start 2024-04-23T18:29:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.651+0000 7f8f63c12800 1 -- start start 2024-04-23T18:29:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.651+0000 7f8f63c12800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 0x5632b65598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.651+0000 7f8f63c12800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5632b6553580 con 0x5632b65524c0 2024-04-23T18:29:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.651+0000 7f8f5f27d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 0x5632b65598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.651+0000 7f8f5f27d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 0x5632b65598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60876/0 (socket says 172.21.15.119:60876) 2024-04-23T18:29:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.651+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 learned_addr learned my addr 172.21.15.119:0/412371469 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.651+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632b6559e10 con 0x5632b65524c0 2024-04-23T18:29:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.652+0000 7f8f5f27d640 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 0x5632b65598d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000bcd0 tx=0x7f8f5001deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.652+0000 7f8e417fa640 1 -- 172.21.15.119:0/412371469 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f5005f030 con 0x5632b65524c0 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.652+0000 7f8e417fa640 1 -- 172.21.15.119:0/412371469 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f50044260 con 0x5632b65524c0 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.652+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632b6559e10 con 0x5632b65524c0 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.652+0000 7f8e417fa640 1 -- 172.21.15.119:0/412371469 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f50036550 con 0x5632b65524c0 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.652+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632b655a310 con 0x5632b65524c0 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.652+0000 7f8e417fa640 1 -- 172.21.15.119:0/412371469 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8f5004ade0 con 0x5632b65524c0 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.653+0000 7f8f63c12800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.653+0000 7f8e417fa640 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e28036e60 0x7f8e28039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.653+0000 7f8e417fa640 1 -- 172.21.15.119:0/412371469 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8f50070c70 con 0x5632b65524c0 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.653+0000 7f8f5ea7c640 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e28036e60 0x7f8e28039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.653+0000 7f8f63c12800 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5632b6565000 0x5632b65674a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.653+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b6567bf0 con 0x5632b6565000 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.653+0000 7f8f5fa7e640 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5632b6565000 0x5632b65674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.653+0000 7f8f5ea7c640 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e28036e60 0x7f8e28039320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8f54052fd0 tx=0x7f8f5404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.653+0000 7f8f5fa7e640 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5632b6565000 0x5632b65674a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.653+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b6565000 2024-04-23T18:29:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 20 realm 2024-04-23T18:29:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568000 con 0x5632b6565000 2024-04-23T18:29:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b6565000 2024-04-23T18:29:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b65688a0 con 0x5632b6565000 2024-04-23T18:29:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b6565000 2024-04-23T18:29:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b6565000 2024-04-23T18:29:31.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b6565000 2024-04-23T18:29:31.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5632b65699a0 0x5632b656bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b656c2d0 con 0x5632b65699a0 2024-04-23T18:29:31.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.654+0000 7f8f5f27d640 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5632b65699a0 0x5632b656bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.655+0000 7f8f5f27d640 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5632b65699a0 0x5632b656bd90 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.655+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f50076070 con 0x5632b65699a0 2024-04-23T18:29:31.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.655+0000 7f8f63c12800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:31.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.655+0000 7f8f63c12800 20 searching for the correct realm 2024-04-23T18:29:31.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.655+0000 7f8f63c12800 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5632b656e350 0x5632b6570810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.655+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6570ee0 con 0x5632b656e350 2024-04-23T18:29:31.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.655+0000 7f8f5ea7c640 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5632b656e350 0x5632b6570810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.655+0000 7f8f5ea7c640 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5632b656e350 0x5632b6570810 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.656+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.656+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6570ee0 con 0x5632b65699a0 2024-04-23T18:29:31.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.656+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f50076070 con 0x5632b65699a0 2024-04-23T18:29:31.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.656+0000 7f8f5f27d640 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8f50064070 0x7f8f50064810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.656+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6570ee0 con 0x7f8f50064070 2024-04-23T18:29:31.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.656+0000 7f8f5fa7e640 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8f50064070 0x7f8f50064810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.657+0000 7f8f5fa7e640 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8f50064070 0x7f8f50064810 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.657+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5800a4a0 con 0x7f8f50064070 2024-04-23T18:29:31.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.657+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b6565000 2024-04-23T18:29:31.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.657+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b6565000 2024-04-23T18:29:31.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.657+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b6565000 2024-04-23T18:29:31.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.657+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b6565000 2024-04-23T18:29:31.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.657+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x7f8f50064070 2024-04-23T18:29:31.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.657+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5800a4a0 con 0x7f8f50064070 2024-04-23T18:29:31.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.658+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x7f8f50064070 2024-04-23T18:29:31.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.658+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8f5800a4a0 con 0x7f8f50064070 2024-04-23T18:29:31.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.658+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b65699a0 2024-04-23T18:29:31.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.658+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f50076070 con 0x5632b65699a0 2024-04-23T18:29:31.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.658+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b656e350 2024-04-23T18:29:31.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.658+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.658+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b6565000 2024-04-23T18:29:31.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.658+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b6565000 2024-04-23T18:29:31.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.659+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x7f8f50064070 2024-04-23T18:29:31.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.659+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5800a4a0 con 0x7f8f50064070 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.659+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b6565000 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.659+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b6565000 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.659+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b65699a0 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.659+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8f50076070 con 0x5632b65699a0 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.659+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b656e350 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.659+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.660+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b656e350 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.660+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.660+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x7f8f50064070 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.660+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5800a4a0 con 0x7f8f50064070 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.660+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b656e350 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.660+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.660+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b656e350 2024-04-23T18:29:31.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.660+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.660+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b6565000 2024-04-23T18:29:31.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.661+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b6565000 2024-04-23T18:29:31.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.661+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b6565000 2024-04-23T18:29:31.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.661+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b6565000 2024-04-23T18:29:31.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.661+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x7f8f50064070 2024-04-23T18:29:31.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.661+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5800a4a0 con 0x7f8f50064070 2024-04-23T18:29:31.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.661+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b656e350 2024-04-23T18:29:31.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.661+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.662+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b65699a0 2024-04-23T18:29:31.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.662+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8f50076070 con 0x5632b65699a0 2024-04-23T18:29:31.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.662+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b6565000 2024-04-23T18:29:31.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.662+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5800a4a0 con 0x5632b6565000 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.662+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x7f8f50064070 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.662+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5800a4a0 con 0x7f8f50064070 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.662+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b656e350 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.662+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.662+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x7f8f50064070 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.663+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f5800a4a0 con 0x7f8f50064070 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.663+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b65699a0 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.663+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f50076070 con 0x5632b65699a0 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.663+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b656e350 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.663+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.663+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x7f8f50064070 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f58040040 con 0x7f8f50064070 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b6565000 2024-04-23T18:29:31.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8f58040040 con 0x5632b6565000 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632b6568c40 con 0x5632b65699a0 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f50076070 con 0x5632b65699a0 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f63c12800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f63c12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f63c12800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f63c12800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f63c12800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f63c12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f63c12800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b656cc50 con 0x5632b6565000 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x5632b6565000 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f63c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f63c12800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.664+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b656cc50 con 0x5632b6565000 2024-04-23T18:29:31.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f58040040 con 0x5632b6565000 2024-04-23T18:29:31.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b656cc50 con 0x7f8f50064070 2024-04-23T18:29:31.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f58040040 con 0x7f8f50064070 2024-04-23T18:29:31.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:31.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 20 zone default found 2024-04-23T18:29:31.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 4 Realm: () 2024-04-23T18:29:31.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:31.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:31.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:31.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 20 zonegroup default 2024-04-23T18:29:31.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b656d040 con 0x7f8f50064070 2024-04-23T18:29:31.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x7f8f50064070 2024-04-23T18:29:31.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.665+0000 7f8f63c12800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.666+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b656d480 con 0x5632b656e350 2024-04-23T18:29:31.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.666+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.666+0000 7f8f63c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.666+0000 7f8f63c12800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.666+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b656d8c0 con 0x5632b656e350 2024-04-23T18:29:31.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.666+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.666+0000 7f8f63c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.666+0000 7f8f63c12800 20 started sync module instance, tier type = 2024-04-23T18:29:31.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.666+0000 7f8f63c12800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:31.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.666+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b65721e0 con 0x5632b65699a0 2024-04-23T18:29:31.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.667+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f50076070 con 0x5632b65699a0 2024-04-23T18:29:31.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.667+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94775807518080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6572e50 con 0x5632b65699a0 2024-04-23T18:29:31.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.667+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6573850 con 0x5632b6565000 2024-04-23T18:29:31.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.668+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94775807518080] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f50076070 con 0x5632b65699a0 2024-04-23T18:29:31.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.668+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x5632b6565000 2024-04-23T18:29:31.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.668+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94775807519136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6573c40 con 0x5632b6565000 2024-04-23T18:29:31.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.668+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6574660 con 0x5632b656e350 2024-04-23T18:29:31.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.669+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94775807519136] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x5632b6565000 2024-04-23T18:29:31.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.669+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.669+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94775807525200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6574a80 con 0x5632b656e350 2024-04-23T18:29:31.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.669+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b65754a0 con 0x5632b65699a0 2024-04-23T18:29:31.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.670+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f50076070 con 0x5632b65699a0 2024-04-23T18:29:31.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.670+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94775807531152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6576160 con 0x5632b65699a0 2024-04-23T18:29:31.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.670+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94775807525200] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.671+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b65769b0 con 0x5632b6565000 2024-04-23T18:29:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.671+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94775807531152] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f50076070 con 0x5632b65699a0 2024-04-23T18:29:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.672+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x5632b6565000 2024-04-23T18:29:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.672+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94775807532208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b65769b0 con 0x5632b6565000 2024-04-23T18:29:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.672+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6577440 con 0x7f8f50064070 2024-04-23T18:29:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.673+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x7f8f50064070 2024-04-23T18:29:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.673+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94775807532208] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x5632b6565000 2024-04-23T18:29:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.673+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94775807536880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6577400 con 0x7f8f50064070 2024-04-23T18:29:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.673+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6576540 con 0x7f8f50064070 2024-04-23T18:29:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.673+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94775807536880] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x7f8f50064070 2024-04-23T18:29:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.674+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x7f8f50064070 2024-04-23T18:29:31.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.674+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94775807539248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6576540 con 0x7f8f50064070 2024-04-23T18:29:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.674+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6578890 con 0x7f8f50064070 2024-04-23T18:29:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.675+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94775807539248] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x7f8f50064070 2024-04-23T18:29:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.675+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x7f8f50064070 2024-04-23T18:29:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.675+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94775807541040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6578800 con 0x7f8f50064070 2024-04-23T18:29:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.675+0000 7f8f63c12800 20 add_watcher() i=0 2024-04-23T18:29:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.675+0000 7f8f63c12800 20 add_watcher() i=1 2024-04-23T18:29:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.675+0000 7f8f63c12800 20 add_watcher() i=2 2024-04-23T18:29:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.675+0000 7f8f63c12800 20 add_watcher() i=3 2024-04-23T18:29:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.675+0000 7f8f63c12800 20 add_watcher() i=4 2024-04-23T18:29:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.675+0000 7f8f63c12800 20 add_watcher() i=5 2024-04-23T18:29:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.675+0000 7f8f63c12800 20 add_watcher() i=6 2024-04-23T18:29:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.676+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94775807541040] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x7f8f50064070 2024-04-23T18:29:31.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.676+0000 7f8f63c12800 20 add_watcher() i=7 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.676+0000 7f8f63c12800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.676+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b657bce0 con 0x5632b6565000 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.676+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f58040040 con 0x5632b6565000 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.676+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94775807542560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6579160 con 0x5632b6565000 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.677+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94775807542560] v32'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x5632b6565000 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.677+0000 7f8e15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.677+0000 7f8f63c12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.677+0000 7f8f63c12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.677+0000 7f8f63c12800 5 note: GC not initialized 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.677+0000 7f8e14fe1640 20 reqs_thread_entry: start 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.677+0000 7f8f63c12800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.677+0000 7f8f63c12800 20 Filter name: none 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.678+0000 7f8d8e7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:31.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.678+0000 7f8f63c12800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.678+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632b65af000 con 0x5632b6565000 2024-04-23T18:29:31.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.678+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f8f58040040 con 0x5632b6565000 2024-04-23T18:29:31.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.678+0000 7f8f63c12800 20 rados_obj.operate() r=0 bl.length=502 2024-04-23T18:29:31.684 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-23T18:29:31.552687Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:31.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.679+0000 7f8e15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.679+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94775807542560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b65ada50 con 0x5632b6565000 2024-04-23T18:29:31.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.680+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94775807542560] v32'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x5632b6565000 2024-04-23T18:29:31.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.680+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94775807518080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b65784f0 con 0x5632b65699a0 2024-04-23T18:29:31.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.681+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94775807518080] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f50076070 con 0x5632b65699a0 2024-04-23T18:29:31.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.681+0000 7f8f63c12800 20 remove_watcher() i=0 2024-04-23T18:29:31.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.681+0000 7f8f63c12800 2 removed watcher, disabling cache 2024-04-23T18:29:31.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.681+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94775807519136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6572580 con 0x5632b6565000 2024-04-23T18:29:31.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.682+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94775807519136] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x5632b6565000 2024-04-23T18:29:31.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.682+0000 7f8f63c12800 20 remove_watcher() i=1 2024-04-23T18:29:31.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.682+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94775807525200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b65784f0 con 0x5632b656e350 2024-04-23T18:29:31.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.683+0000 7f8f5ea7c640 1 -- 172.21.15.119:0/412371469 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94775807525200] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f54081070 con 0x5632b656e350 2024-04-23T18:29:31.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.683+0000 7f8f63c12800 20 remove_watcher() i=2 2024-04-23T18:29:31.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.683+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94775807531152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6574150 con 0x5632b65699a0 2024-04-23T18:29:31.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.684+0000 7f8f5f27d640 1 -- 172.21.15.119:0/412371469 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94775807531152] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f50076070 con 0x5632b65699a0 2024-04-23T18:29:31.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.684+0000 7f8f63c12800 20 remove_watcher() i=3 2024-04-23T18:29:31.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.684+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94775807532208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6575890 con 0x5632b6565000 2024-04-23T18:29:31.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.685+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94775807532208] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x5632b6565000 2024-04-23T18:29:31.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.685+0000 7f8f63c12800 20 remove_watcher() i=4 2024-04-23T18:29:31.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.685+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94775807536880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6574150 con 0x7f8f50064070 2024-04-23T18:29:31.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.686+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94775807536880] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x7f8f50064070 2024-04-23T18:29:31.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.686+0000 7f8f63c12800 20 remove_watcher() i=5 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.686+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94775807539248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6576ef0 con 0x7f8f50064070 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.687+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94775807539248] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x7f8f50064070 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.687+0000 7f8f63c12800 20 remove_watcher() i=6 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.687+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94775807541040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632b6576ef0 con 0x7f8f50064070 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94775807541040] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f58040040 con 0x7f8f50064070 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 20 remove_watcher() i=7 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8f50064070 msgr2=0x7f8f50064810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8f50064070 0x7f8f50064810 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5632b6565000 msgr2=0x5632b65674a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5632b6565000 0x5632b65674a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5632b65699a0 msgr2=0x5632b656bd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5632b65699a0 0x5632b656bd90 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5632b656e350 msgr2=0x5632b6570810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5632b656e350 0x5632b6570810 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e28036e60 msgr2=0x7f8e28039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e28036e60 0x7f8e28039320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8f54052fd0 tx=0x7f8f5404f000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 msgr2=0x5632b65598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/412371469 reap_dead start 2024-04-23T18:29:31.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 0x5632b65598d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000bcd0 tx=0x7f8f5001deb0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 shutdown_connections 2024-04-23T18:29:31.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 --2- 172.21.15.119:0/412371469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65524c0 0x5632b65598d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 >> 172.21.15.119:0/412371469 conn(0x5632b654e790 msgr2=0x5632b654bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 shutdown_connections 2024-04-23T18:29:31.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.688+0000 7f8f63c12800 1 -- 172.21.15.119:0/412371469 wait complete. 2024-04-23T18:29:31.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/3872732818 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e38036eb0 msgr2=0x7f8e38039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 --2- 172.21.15.119:0/3872732818 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e38036eb0 0x7f8e38039370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5632b652b230 tx=0x7f8f54005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:31.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/3872732818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65454e0 msgr2=0x5632b6545900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 --2- 172.21.15.119:0/3872732818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65454e0 0x5632b6545900 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8f5004b2d0 tx=0x7f8f5000db20 comp rx=0 tx=0).stop 2024-04-23T18:29:31.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/3872732818 shutdown_connections 2024-04-23T18:29:31.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 --2- 172.21.15.119:0/3872732818 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e38036eb0 0x7f8e38039370 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 --2- 172.21.15.119:0/3872732818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b65454e0 0x5632b6545900 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/3872732818 >> 172.21.15.119:0/3872732818 conn(0x5632b6539580 msgr2=0x5632b6539980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/3872732818 shutdown_connections 2024-04-23T18:29:31.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/3872732818 wait complete. 2024-04-23T18:29:31.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5632b6534510 msgr2=0x5632b6536960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5632b6534510 0x5632b6536960 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5632b64303a0 msgr2=0x5632b652dd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5632b64303a0 0x5632b652dd40 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5632b65305d0 msgr2=0x5632b65329c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5632b65305d0 0x5632b65329c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e44036eb0 msgr2=0x7f8e44039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e44036eb0 0x7f8e44039370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8f54054000 tx=0x7f8f5404e000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b642bf60 msgr2=0x5632b6526cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 --2- 172.21.15.119:0/350507082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632b642bf60 0x5632b6526cd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000b7c0 tx=0x7f8f50000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f5fa7e640 1 -- 172.21.15.119:0/350507082 reap_dead start 2024-04-23T18:29:31.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 shutdown_connections 2024-04-23T18:29:31.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 >> 172.21.15.119:0/350507082 conn(0x5632b6427540 msgr2=0x5632b6518670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 shutdown_connections 2024-04-23T18:29:31.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.689+0000 7f8f63c12800 1 -- 172.21.15.119:0/350507082 wait complete. 2024-04-23T18:29:31.695 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-23T18:29:31.552687Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:31.696 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-23T18:29:31.696 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-23T18:29:31.696 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-04-23T18:29:31.775 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:31.775 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:31.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.783+0000 7f133e52f800 1 Processor -- start 2024-04-23T18:29:31.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.784+0000 7f133e52f800 1 -- start start 2024-04-23T18:29:31.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.784+0000 7f133e52f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56432c6bba80 0x56432c6bde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.784+0000 7f133e52f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56432c56b560 con 0x56432c6be3b0 2024-04-23T18:29:31.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.784+0000 7f133e52f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x56432c55ce20 con 0x56432c6bba80 2024-04-23T18:29:31.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.784+0000 7f133a1ae640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56432c6bba80 0x56432c6bde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.784+0000 7f1333fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x56432c6be3b0 0x56432c6c07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40564/0 (socket says 172.21.15.119:40564) 2024-04-23T18:29:31.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.784+0000 7f1333fff640 1 -- 172.21.15.119:0/4081814424 learned_addr learned my addr 172.21.15.119:0/4081814424 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:31.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.784+0000 7f133a1ae640 1 -- 172.21.15.119:0/4081814424 >> v1:172.21.15.62:6789/0 conn(0x56432c6be3b0 legacy=0x56432c6c07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.784+0000 7f133a1ae640 1 -- 172.21.15.119:0/4081814424 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432c56ae60 con 0x56432c6bba80 2024-04-23T18:29:31.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.786+0000 7f133a1ae640 1 --2- 172.21.15.119:0/4081814424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c6bde70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f132c00a470 tx=0x7f132c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585476e941453d33 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.786+0000 7f13399ad640 1 -- 172.21.15.119:0/4081814424 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c057070 con 0x56432c6bba80 2024-04-23T18:29:31.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.786+0000 7f13399ad640 1 -- 172.21.15.119:0/4081814424 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c052570 con 0x56432c6bba80 2024-04-23T18:29:31.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.786+0000 7f13399ad640 1 -- 172.21.15.119:0/4081814424 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c052870 con 0x56432c6bba80 2024-04-23T18:29:31.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.787+0000 7f133e52f800 1 -- 172.21.15.119:0/4081814424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 msgr2=0x56432c6bde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.787+0000 7f133e52f800 1 --2- 172.21.15.119:0/4081814424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c6bde70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f132c00a470 tx=0x7f132c01ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:31.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.787+0000 7f133e52f800 1 -- 172.21.15.119:0/4081814424 shutdown_connections 2024-04-23T18:29:31.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.787+0000 7f133e52f800 1 --2- 172.21.15.119:0/4081814424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c6bde70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.787+0000 7f133e52f800 1 -- 172.21.15.119:0/4081814424 >> 172.21.15.119:0/4081814424 conn(0x56432c6b5430 msgr2=0x56432c6b7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.787+0000 7f133e52f800 1 -- 172.21.15.119:0/4081814424 shutdown_connections 2024-04-23T18:29:31.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.787+0000 7f133e52f800 1 -- 172.21.15.119:0/4081814424 wait complete. 2024-04-23T18:29:31.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.798+0000 7f133e52f800 1 Processor -- start 2024-04-23T18:29:31.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.798+0000 7f133e52f800 1 -- start start 2024-04-23T18:29:31.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.799+0000 7f133e52f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c7ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.799+0000 7f133e52f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56432c6065d0 con 0x56432c6bba80 2024-04-23T18:29:31.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.799+0000 7f133a1ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c7ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.799+0000 7f133a1ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c7ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60884/0 (socket says 172.21.15.119:60884) 2024-04-23T18:29:31.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.799+0000 7f133a1ae640 1 -- 172.21.15.119:0/1926655365 learned_addr learned my addr 172.21.15.119:0/1926655365 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.799+0000 7f133a1ae640 1 -- 172.21.15.119:0/1926655365 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432c57c860 con 0x56432c6bba80 2024-04-23T18:29:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.799+0000 7f133a1ae640 1 --2- 172.21.15.119:0/1926655365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c7ac240 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f132c055040 tx=0x7f132c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d31289017fa180e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.800+0000 7f1228608640 1 -- 172.21.15.119:0/1926655365 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c057070 con 0x56432c6bba80 2024-04-23T18:29:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.800+0000 7f1228608640 1 -- 172.21.15.119:0/1926655365 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c063070 con 0x56432c6bba80 2024-04-23T18:29:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.800+0000 7f1228608640 1 -- 172.21.15.119:0/1926655365 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c052720 con 0x56432c6bba80 2024-04-23T18:29:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.800+0000 7f133e52f800 1 -- 172.21.15.119:0/1926655365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 msgr2=0x56432c7ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.800+0000 7f133e52f800 1 --2- 172.21.15.119:0/1926655365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c7ac240 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f132c055040 tx=0x7f132c04c000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.800+0000 7f133e52f800 1 -- 172.21.15.119:0/1926655365 shutdown_connections 2024-04-23T18:29:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.800+0000 7f133e52f800 1 --2- 172.21.15.119:0/1926655365 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c7ac240 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.800+0000 7f133e52f800 1 -- 172.21.15.119:0/1926655365 >> 172.21.15.119:0/1926655365 conn(0x56432c6b5430 msgr2=0x56432c7a7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.800+0000 7f133e52f800 1 -- 172.21.15.119:0/1926655365 shutdown_connections 2024-04-23T18:29:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.800+0000 7f133e52f800 1 -- 172.21.15.119:0/1926655365 wait complete. 2024-04-23T18:29:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.801+0000 7f133e52f800 1 Processor -- start 2024-04-23T18:29:31.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.801+0000 7f133e52f800 1 -- start start 2024-04-23T18:29:31.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.801+0000 7f133e52f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c7b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.801+0000 7f133e52f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56432c6c41d0 con 0x56432c6bba80 2024-04-23T18:29:31.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.801+0000 7f133a1ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c7b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.801+0000 7f133a1ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c7b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60888/0 (socket says 172.21.15.119:60888) 2024-04-23T18:29:31.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.801+0000 7f133a1ae640 1 -- 172.21.15.119:0/1112301615 learned_addr learned my addr 172.21.15.119:0/1112301615 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.801+0000 7f133a1ae640 1 -- 172.21.15.119:0/1112301615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432c57aeb0 con 0x56432c6bba80 2024-04-23T18:29:31.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.801+0000 7f133a1ae640 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c7b3b40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f132c060040 tx=0x7f132c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.802+0000 7f1226e05640 1 -- 172.21.15.119:0/1112301615 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c052e30 con 0x56432c6bba80 2024-04-23T18:29:31.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.802+0000 7f1226e05640 1 -- 172.21.15.119:0/1112301615 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c06c070 con 0x56432c6bba80 2024-04-23T18:29:31.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.802+0000 7f1226e05640 1 -- 172.21.15.119:0/1112301615 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c05e5d0 con 0x56432c6bba80 2024-04-23T18:29:31.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.802+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56432c7b4080 con 0x56432c6bba80 2024-04-23T18:29:31.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.802+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432c7b4600 con 0x56432c6bba80 2024-04-23T18:29:31.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.802+0000 7f1226e05640 1 -- 172.21.15.119:0/1112301615 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f132c05e770 con 0x56432c6bba80 2024-04-23T18:29:31.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.802+0000 7f1226e05640 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1220036eb0 0x7f1220039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.803+0000 7f1226e05640 1 -- 172.21.15.119:0/1112301615 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f132c08ee70 con 0x56432c6bba80 2024-04-23T18:29:31.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.803+0000 7f1333fff640 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1220036eb0 0x7f1220039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.803+0000 7f133e52f800 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56432c6be3b0 0x56432c7bab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.803+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7bb0a0 con 0x56432c6be3b0 2024-04-23T18:29:31.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.803+0000 7f133a9af640 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56432c6be3b0 0x56432c7bab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.803+0000 7f1333fff640 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1220036eb0 0x7f1220039370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1324000f60 tx=0x7f13240012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.803+0000 7f133a9af640 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56432c6be3b0 0x56432c7bab60 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.803+0000 7f133a9af640 1 -- 172.21.15.119:0/1112301615 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c6be3b0 2024-04-23T18:29:31.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.803+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7b8130 con 0x56432c6be3b0 2024-04-23T18:29:31.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.804+0000 7f133a9af640 1 -- 172.21.15.119:0/1112301615 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c6be3b0 2024-04-23T18:29:31.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.804+0000 7f133e52f800 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56432c7bd3f0 0x56432c7bf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.804+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7bfed0 con 0x56432c7bd3f0 2024-04-23T18:29:31.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.804+0000 7f133a1ae640 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56432c7bd3f0 0x56432c7bf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.804+0000 7f133a1ae640 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56432c7bd3f0 0x56432c7bf7e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.804+0000 7f133a1ae640 1 -- 172.21.15.119:0/1112301615 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f132c009d10 con 0x56432c7bd3f0 2024-04-23T18:29:31.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.804+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7bc3a0 con 0x56432c6be3b0 2024-04-23T18:29:31.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.805+0000 7f133a9af640 1 -- 172.21.15.119:0/1112301615 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c6be3b0 2024-04-23T18:29:31.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.805+0000 7f133e52f800 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56432c7c1330 0x56432c7c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.805+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7c3f00 con 0x56432c7c1330 2024-04-23T18:29:31.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.805+0000 7f1333fff640 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56432c7c1330 0x56432c7c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.805+0000 7f1333fff640 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56432c7c1330 0x56432c7c37a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.806+0000 7f1333fff640 1 -- 172.21.15.119:0/1112301615 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1324009050 con 0x56432c7c1330 2024-04-23T18:29:31.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.806+0000 7f133e52f800 1 Processor -- start 2024-04-23T18:29:31.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.806+0000 7f133e52f800 1 -- start start 2024-04-23T18:29:31.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.806+0000 7f133e52f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7d23b0 0x56432c7d27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.806+0000 7f133e52f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56432c5acdf0 con 0x56432c7d23b0 2024-04-23T18:29:31.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.806+0000 7f133a1ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7d23b0 0x56432c7d27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.806+0000 7f133a1ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7d23b0 0x56432c7d27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60902/0 (socket says 172.21.15.119:60902) 2024-04-23T18:29:31.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.806+0000 7f133a1ae640 1 -- 172.21.15.119:0/3535829403 learned_addr learned my addr 172.21.15.119:0/3535829403 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.807+0000 7f133a1ae640 1 -- 172.21.15.119:0/3535829403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432c7d2d10 con 0x56432c7d23b0 2024-04-23T18:29:31.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.807+0000 7f133a1ae640 1 --2- 172.21.15.119:0/3535829403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7d23b0 0x56432c7d27d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f132c08d320 tx=0x7f132c066440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.807+0000 7f121ffff640 1 -- 172.21.15.119:0/3535829403 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c04cc40 con 0x56432c7d23b0 2024-04-23T18:29:31.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.807+0000 7f121ffff640 1 -- 172.21.15.119:0/3535829403 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c058040 con 0x56432c7d23b0 2024-04-23T18:29:31.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.807+0000 7f133e52f800 1 -- 172.21.15.119:0/3535829403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56432c7d3780 con 0x56432c7d23b0 2024-04-23T18:29:31.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.807+0000 7f121ffff640 1 -- 172.21.15.119:0/3535829403 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c067420 con 0x56432c7d23b0 2024-04-23T18:29:31.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.807+0000 7f133e52f800 1 -- 172.21.15.119:0/3535829403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432c7d3c80 con 0x56432c7d23b0 2024-04-23T18:29:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.808+0000 7f121ffff640 1 -- 172.21.15.119:0/3535829403 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f132c086040 con 0x56432c7d23b0 2024-04-23T18:29:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.808+0000 7f121ffff640 1 --2- 172.21.15.119:0/3535829403 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1214036eb0 0x7f1214039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.808+0000 7f121ffff640 1 -- 172.21.15.119:0/3535829403 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f132c090030 con 0x56432c7d23b0 2024-04-23T18:29:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.808+0000 7f1333fff640 1 --2- 172.21.15.119:0/3535829403 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1214036eb0 0x7f1214039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.808+0000 7f133e52f800 1 Processor -- start 2024-04-23T18:29:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.808+0000 7f133e52f800 1 -- start start 2024-04-23T18:29:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.808+0000 7f1333fff640 1 --2- 172.21.15.119:0/3535829403 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1214036eb0 0x7f1214039370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f132400bf50 tx=0x7f132400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.808+0000 7f133e52f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7df5d0 0x56432c7df9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.808+0000 7f133e52f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56432c7ac900 con 0x56432c7df5d0 2024-04-23T18:29:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.809+0000 7f133a1ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7df5d0 0x56432c7df9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.809+0000 7f133a1ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7df5d0 0x56432c7df9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60904/0 (socket says 172.21.15.119:60904) 2024-04-23T18:29:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.809+0000 7f133a1ae640 1 -- 172.21.15.119:0/2701675513 learned_addr learned my addr 172.21.15.119:0/2701675513 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.809+0000 7f133a1ae640 1 -- 172.21.15.119:0/2701675513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432c7dffc0 con 0x56432c7df5d0 2024-04-23T18:29:31.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.809+0000 7f133a1ae640 1 --2- 172.21.15.119:0/2701675513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7df5d0 0x56432c7df9f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f132c07dfd0 tx=0x7f132c0936b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582b13c50792e6fb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.809+0000 7f121dffb640 1 -- 172.21.15.119:0/2701675513 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c05cab0 con 0x56432c7df5d0 2024-04-23T18:29:31.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.809+0000 7f121dffb640 1 -- 172.21.15.119:0/2701675513 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c05c590 con 0x56432c7df5d0 2024-04-23T18:29:31.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.809+0000 7f121dffb640 1 -- 172.21.15.119:0/2701675513 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c08d400 con 0x56432c7df5d0 2024-04-23T18:29:31.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133e52f800 1 -- 172.21.15.119:0/2701675513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7df5d0 msgr2=0x56432c7df9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133e52f800 1 --2- 172.21.15.119:0/2701675513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7df5d0 0x56432c7df9f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f132c07dfd0 tx=0x7f132c0936b0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133e52f800 1 -- 172.21.15.119:0/2701675513 shutdown_connections 2024-04-23T18:29:31.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133e52f800 1 --2- 172.21.15.119:0/2701675513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7df5d0 0x56432c7df9f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133e52f800 1 -- 172.21.15.119:0/2701675513 >> 172.21.15.119:0/2701675513 conn(0x56432c7db8a0 msgr2=0x56432c7d9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133e52f800 1 -- 172.21.15.119:0/2701675513 shutdown_connections 2024-04-23T18:29:31.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133e52f800 1 -- 172.21.15.119:0/2701675513 wait complete. 2024-04-23T18:29:31.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133e52f800 1 Processor -- start 2024-04-23T18:29:31.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133e52f800 1 -- start start 2024-04-23T18:29:31.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133e52f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7df5d0 0x56432c7e68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133e52f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56432c7e0620 con 0x56432c7df5d0 2024-04-23T18:29:31.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133a1ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7df5d0 0x56432c7e68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133a1ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7df5d0 0x56432c7e68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60914/0 (socket says 172.21.15.119:60914) 2024-04-23T18:29:31.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.810+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 learned_addr learned my addr 172.21.15.119:0/429455313 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.811+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56432c7e6e10 con 0x56432c7df5d0 2024-04-23T18:29:31.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.811+0000 7f133a1ae640 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7df5d0 0x56432c7e68d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f132c07ddc0 tx=0x7f132c078f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.811+0000 7f120bfff640 1 -- 172.21.15.119:0/429455313 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c04c6f0 con 0x56432c7df5d0 2024-04-23T18:29:31.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.811+0000 7f120bfff640 1 -- 172.21.15.119:0/429455313 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c0b8070 con 0x56432c7df5d0 2024-04-23T18:29:31.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.811+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56432c7e6e10 con 0x56432c7df5d0 2024-04-23T18:29:31.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.811+0000 7f120bfff640 1 -- 172.21.15.119:0/429455313 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c08d780 con 0x56432c7df5d0 2024-04-23T18:29:31.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.811+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56432c7e6e10 con 0x56432c7df5d0 2024-04-23T18:29:31.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.812+0000 7f120bfff640 1 -- 172.21.15.119:0/429455313 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f132c08d920 con 0x56432c7df5d0 2024-04-23T18:29:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.812+0000 7f120bfff640 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1204036eb0 0x7f1204039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.812+0000 7f120bfff640 1 -- 172.21.15.119:0/429455313 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f132c0752e0 con 0x56432c7df5d0 2024-04-23T18:29:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.812+0000 7f1333fff640 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1204036eb0 0x7f1204039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.812+0000 7f1333fff640 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1204036eb0 0x7f1204039370 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1324001b60 tx=0x7f1324010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.812+0000 7f133e52f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.812+0000 7f133e52f800 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56432c7f1e50 0x56432c7f4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.812+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f4a60 con 0x56432c7f1e50 2024-04-23T18:29:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.812+0000 7f133a9af640 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56432c7f1e50 0x56432c7f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.813+0000 7f133a9af640 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56432c7f1e50 0x56432c7f4310 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.813+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c7f1e50 2024-04-23T18:29:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.813+0000 7f133e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.813+0000 7f133e52f800 20 realm 2024-04-23T18:29:31.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.813+0000 7f133e52f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.813+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f4e70 con 0x56432c7f1e50 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.813+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c7f1e50 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.813+0000 7f133e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.813+0000 7f133e52f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.813+0000 7f133e52f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.813+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5740 con 0x56432c7f1e50 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.813+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c7f1e50 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133e52f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f1e50 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c7f1e50 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133e52f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133e52f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133e52f800 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56432c7f6840 0x56432c7f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f91f0 con 0x56432c7f6840 2024-04-23T18:29:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133a1ae640 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56432c7f6840 0x56432c7f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133a1ae640 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56432c7f6840 0x56432c7f8c30 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f132c009d10 con 0x56432c7f6840 2024-04-23T18:29:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133e52f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133e52f800 20 searching for the correct realm 2024-04-23T18:29:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133e52f800 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56432c7fb1a0 0x56432c7fd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.814+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7fdd30 con 0x56432c7fb1a0 2024-04-23T18:29:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.815+0000 7f1333fff640 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56432c7fb1a0 0x56432c7fd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.815+0000 7f1333fff640 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56432c7fb1a0 0x56432c7fd660 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.815+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.815+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7fdd30 con 0x56432c7f6840 2024-04-23T18:29:31.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.815+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c009d10 con 0x56432c7f6840 2024-04-23T18:29:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.815+0000 7f133a1ae640 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f132c09f040 0x7f132c077700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.815+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7fdd30 con 0x7f132c09f040 2024-04-23T18:29:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.816+0000 7f133a9af640 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f132c09f040 0x7f132c077700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.816+0000 7f133a9af640 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f132c09f040 0x7f132c077700 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.816+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133400a4a0 con 0x7f132c09f040 2024-04-23T18:29:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.816+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f1e50 2024-04-23T18:29:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.816+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c7f1e50 2024-04-23T18:29:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.816+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f1e50 2024-04-23T18:29:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.817+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c7f1e50 2024-04-23T18:29:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.817+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x7f132c09f040 2024-04-23T18:29:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.817+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133400a4a0 con 0x7f132c09f040 2024-04-23T18:29:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.817+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x7f132c09f040 2024-04-23T18:29:31.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.817+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f133400a4a0 con 0x7f132c09f040 2024-04-23T18:29:31.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.817+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f6840 2024-04-23T18:29:31.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.817+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c009d10 con 0x56432c7f6840 2024-04-23T18:29:31.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.817+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7fb1a0 2024-04-23T18:29:31.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.818+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.818+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f1e50 2024-04-23T18:29:31.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.818+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c7f1e50 2024-04-23T18:29:31.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.818+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x7f132c09f040 2024-04-23T18:29:31.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.818+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133400a4a0 con 0x7f132c09f040 2024-04-23T18:29:31.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.818+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f1e50 2024-04-23T18:29:31.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.818+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c7f1e50 2024-04-23T18:29:31.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.818+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f6840 2024-04-23T18:29:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.819+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f132c009d10 con 0x56432c7f6840 2024-04-23T18:29:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.819+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7fb1a0 2024-04-23T18:29:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.819+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.819+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7fb1a0 2024-04-23T18:29:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.819+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.819+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x7f132c09f040 2024-04-23T18:29:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.819+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133400a4a0 con 0x7f132c09f040 2024-04-23T18:29:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.819+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7fb1a0 2024-04-23T18:29:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.820+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.820+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7fb1a0 2024-04-23T18:29:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.820+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.820+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f1e50 2024-04-23T18:29:31.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.820+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c7f1e50 2024-04-23T18:29:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.820+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f1e50 2024-04-23T18:29:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.820+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c7f1e50 2024-04-23T18:29:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.820+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x7f132c09f040 2024-04-23T18:29:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.821+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133400a4a0 con 0x7f132c09f040 2024-04-23T18:29:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.821+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7fb1a0 2024-04-23T18:29:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.821+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.821+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f6840 2024-04-23T18:29:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.821+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f132c009d10 con 0x56432c7f6840 2024-04-23T18:29:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.821+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f1e50 2024-04-23T18:29:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.821+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133400a4a0 con 0x56432c7f1e50 2024-04-23T18:29:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.821+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x7f132c09f040 2024-04-23T18:29:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.822+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133400a4a0 con 0x7f132c09f040 2024-04-23T18:29:31.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.822+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7fb1a0 2024-04-23T18:29:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.822+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.822+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x7f132c09f040 2024-04-23T18:29:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.822+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f133400a4a0 con 0x7f132c09f040 2024-04-23T18:29:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.822+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f6840 2024-04-23T18:29:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.823+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c009d10 con 0x56432c7f6840 2024-04-23T18:29:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.823+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7fb1a0 2024-04-23T18:29:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.823+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.823+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x7f132c09f040 2024-04-23T18:29:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.823+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1334040040 con 0x7f132c09f040 2024-04-23T18:29:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.823+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f1e50 2024-04-23T18:29:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.823+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f5ae0 con 0x56432c7f6840 2024-04-23T18:29:31.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c0d6040 con 0x56432c7f6840 2024-04-23T18:29:31.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:31.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:31.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:31.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:31.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:31.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:31.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f9ab0 con 0x56432c7f1e50 2024-04-23T18:29:31.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f9ab0 con 0x56432c7f1e50 2024-04-23T18:29:31.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.824+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7f9ab0 con 0x7f132c09f040 2024-04-23T18:29:31.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1334040040 con 0x7f132c09f040 2024-04-23T18:29:31.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133e52f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:31.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133e52f800 20 zone default found 2024-04-23T18:29:31.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133e52f800 4 Realm: () 2024-04-23T18:29:31.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133e52f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:31.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133e52f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:31.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133e52f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:31.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133e52f800 20 zonegroup default 2024-04-23T18:29:31.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133e52f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7fa350 con 0x7f132c09f040 2024-04-23T18:29:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1334040040 con 0x7f132c09f040 2024-04-23T18:29:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133e52f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7fa350 con 0x56432c7fb1a0 2024-04-23T18:29:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.825+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.826+0000 7f133e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.826+0000 7f133e52f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.826+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c7ffb90 con 0x56432c7fb1a0 2024-04-23T18:29:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.826+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.826+0000 7f133e52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.826+0000 7f133e52f800 20 started sync module instance, tier type = 2024-04-23T18:29:31.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.826+0000 7f133e52f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.826+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c7ff030 con 0x56432c7f6840 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.827+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0d6040 con 0x56432c7f6840 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.827+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94846509380688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c7fec90 con 0x56432c7f6840 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.827+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c8008d0 con 0x56432c7f1e50 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.828+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94846509380688] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0d6040 con 0x56432c7f6840 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.828+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.828+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94846509383472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c800cc0 con 0x56432c7f1e50 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.828+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c801710 con 0x56432c7fb1a0 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.829+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94846509383472] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.829+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.829+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94846509388288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c801b00 con 0x56432c7fb1a0 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.829+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c802520 con 0x56432c7f6840 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.830+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0d6040 con 0x56432c7f6840 2024-04-23T18:29:31.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.830+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94846509394240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c803210 con 0x56432c7f6840 2024-04-23T18:29:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.830+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c803c30 con 0x56432c7f1e50 2024-04-23T18:29:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.830+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94846509388288] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.831+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94846509394240] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0d6040 con 0x56432c7f6840 2024-04-23T18:29:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.831+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.831+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94846509397792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c802d60 con 0x56432c7f1e50 2024-04-23T18:29:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.831+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c8044d0 con 0x7f132c09f040 2024-04-23T18:29:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.832+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x7f132c09f040 2024-04-23T18:29:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.832+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94846509397792] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.832+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94846509400016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c8048a0 con 0x7f132c09f040 2024-04-23T18:29:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.832+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c800350 con 0x7f132c09f040 2024-04-23T18:29:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.833+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94846509400016] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x7f132c09f040 2024-04-23T18:29:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.833+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x7f132c09f040 2024-04-23T18:29:31.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.833+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94846509401072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c804cc0 con 0x7f132c09f040 2024-04-23T18:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.833+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c805510 con 0x7f132c09f040 2024-04-23T18:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.834+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x7f132c09f040 2024-04-23T18:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.834+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94846509403808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c8058d0 con 0x7f132c09f040 2024-04-23T18:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.834+0000 7f133e52f800 20 add_watcher() i=0 2024-04-23T18:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.834+0000 7f133e52f800 20 add_watcher() i=1 2024-04-23T18:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.834+0000 7f133e52f800 20 add_watcher() i=2 2024-04-23T18:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.834+0000 7f133e52f800 20 add_watcher() i=3 2024-04-23T18:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.834+0000 7f133e52f800 20 add_watcher() i=4 2024-04-23T18:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.834+0000 7f133e52f800 20 add_watcher() i=5 2024-04-23T18:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.834+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94846509401072] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x7f132c09f040 2024-04-23T18:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.834+0000 7f133e52f800 20 add_watcher() i=6 2024-04-23T18:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.835+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94846509403808] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x7f132c09f040 2024-04-23T18:29:31.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.835+0000 7f133e52f800 20 add_watcher() i=7 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.835+0000 7f133e52f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.835+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c804810 con 0x56432c7f1e50 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.835+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.835+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94846509405024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c804810 con 0x56432c7f1e50 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.836+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94846509405024] v32'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.836+0000 7f11f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133e52f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133e52f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133e52f800 5 note: GC not initialized 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f116b7fe640 20 reqs_thread_entry: start 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133e52f800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133e52f800 20 Filter name: none 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f11697fa640 20 reqs_thread_entry: start 2024-04-23T18:29:31.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133e52f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:31.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133e52f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c83c010 con 0x56432c7f1e50 2024-04-23T18:29:31.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133e52f800 20 rados_obj.operate() r=0 bl.length=502 2024-04-23T18:29:31.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133e52f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:31.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133e52f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:31.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133e52f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:31.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.837+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c8426c0 con 0x56432c7f1e50 2024-04-23T18:29:31.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f133e52f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:31.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f133e52f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:31.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f133e52f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:31.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94846509654320 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c83ddb0 con 0x56432c7f1e50 2024-04-23T18:29:31.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify (1) cookie 94846509397792 notify 137438953476 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f1334046450 con 0x56432c7f1e50 2024-04-23T18:29:31.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f121dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94846509397792 notifier 4350 bl.length()=567 2024-04-23T18:29:31.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(64 notify.4 [notify cookie 94846509654320 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f121dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:31.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f121dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:31.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f121dffb640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1200003ea0 con 0x56432c7f1e50 2024-04-23T18:29:31.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify_complete (2) cookie 94846509654320 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1334046620 con 0x56432c7f1e50 2024-04-23T18:29:31.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.839+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c842130 con 0x7f132c09f040 2024-04-23T18:29:31.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.840+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1334040040 con 0x7f132c09f040 2024-04-23T18:29:31.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.840+0000 7f133e52f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-23T18:29:31.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.840+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94846509654320 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56432c83d900 con 0x56432c7fb1a0 2024-04-23T18:29:31.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.841+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== watch-notify(notify (1) cookie 94846509388288 notify 137438953473 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56432c56b560 con 0x56432c7fb1a0 2024-04-23T18:29:31.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.841+0000 7f121dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94846509388288 notifier 4350 bl.length()=170 2024-04-23T18:29:31.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.841+0000 7f121dffb640 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1200003ea0 con 0x56432c7fb1a0 2024-04-23T18:29:31.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.841+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 notify.2 [notify cookie 94846509654320 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.841+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.841+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== watch-notify(notify_complete (2) cookie 94846509654320 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1324038430 con 0x56432c7fb1a0 2024-04-23T18:29:31.846 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:31.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.842+0000 7f11f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.842+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94846509405024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c83a590 con 0x56432c7f1e50 2024-04-23T18:29:31.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.843+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94846509405024] v32'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.843+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94846509380688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c805320 con 0x56432c7f6840 2024-04-23T18:29:31.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.844+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94846509380688] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0d6040 con 0x56432c7f6840 2024-04-23T18:29:31.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.844+0000 7f133e52f800 20 remove_watcher() i=0 2024-04-23T18:29:31.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.844+0000 7f133e52f800 2 removed watcher, disabling cache 2024-04-23T18:29:31.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.844+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94846509383472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c7ff450 con 0x56432c7f1e50 2024-04-23T18:29:31.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.845+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94846509383472] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.845+0000 7f133e52f800 20 remove_watcher() i=1 2024-04-23T18:29:31.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.845+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94846509388288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c7ff450 con 0x56432c7fb1a0 2024-04-23T18:29:31.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.846+0000 7f1333fff640 1 -- 172.21.15.119:0/429455313 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94846509388288] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324009050 con 0x56432c7fb1a0 2024-04-23T18:29:31.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.846+0000 7f133e52f800 20 remove_watcher() i=2 2024-04-23T18:29:31.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.846+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94846509394240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c7ff450 con 0x56432c7f6840 2024-04-23T18:29:31.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.847+0000 7f133a1ae640 1 -- 172.21.15.119:0/429455313 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94846509394240] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0d6040 con 0x56432c7f6840 2024-04-23T18:29:31.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.847+0000 7f133e52f800 20 remove_watcher() i=3 2024-04-23T18:29:31.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.847+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94846509397792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c7ff450 con 0x56432c7f1e50 2024-04-23T18:29:31.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.848+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94846509397792] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x56432c7f1e50 2024-04-23T18:29:31.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.848+0000 7f133e52f800 20 remove_watcher() i=4 2024-04-23T18:29:31.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.848+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94846509400016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c803720 con 0x7f132c09f040 2024-04-23T18:29:31.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.849+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94846509400016] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x7f132c09f040 2024-04-23T18:29:31.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.849+0000 7f133e52f800 20 remove_watcher() i=5 2024-04-23T18:29:31.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.849+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94846509401072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c7ff450 con 0x7f132c09f040 2024-04-23T18:29:31.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.850+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94846509401072] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x7f132c09f040 2024-04-23T18:29:31.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.850+0000 7f133e52f800 20 remove_watcher() i=6 2024-04-23T18:29:31.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.850+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94846509403808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56432c803720 con 0x7f132c09f040 2024-04-23T18:29:31.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94846509403808] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1334040040 con 0x7f132c09f040 2024-04-23T18:29:31.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 20 remove_watcher() i=7 2024-04-23T18:29:31.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f132c09f040 msgr2=0x7f132c077700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f132c09f040 0x7f132c077700 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56432c7f1e50 msgr2=0x56432c7f4310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56432c7f1e50 0x56432c7f4310 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56432c7f6840 msgr2=0x56432c7f8c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56432c7f6840 0x56432c7f8c30 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56432c7fb1a0 msgr2=0x56432c7fd660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56432c7fb1a0 0x56432c7fd660 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1204036eb0 msgr2=0x7f1204039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1204036eb0 0x7f1204039370 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1324001b60 tx=0x7f1324010000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7df5d0 msgr2=0x56432c7e68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 --2- 172.21.15.119:0/429455313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7df5d0 0x56432c7e68d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f132c07ddc0 tx=0x7f132c078f80 comp rx=0 tx=0).stop 2024-04-23T18:29:31.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 reap_dead start 2024-04-23T18:29:31.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133a9af640 1 -- 172.21.15.119:0/429455313 reap_dead start 2024-04-23T18:29:31.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 shutdown_connections 2024-04-23T18:29:31.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 >> 172.21.15.119:0/429455313 conn(0x56432c7db8a0 msgr2=0x56432c7d8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 shutdown_connections 2024-04-23T18:29:31.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.851+0000 7f133e52f800 1 -- 172.21.15.119:0/429455313 wait complete. 2024-04-23T18:29:31.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/3535829403 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1214036eb0 msgr2=0x7f1214039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 --2- 172.21.15.119:0/3535829403 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1214036eb0 0x7f1214039370 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f132400bf50 tx=0x7f132400f000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/3535829403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7d23b0 msgr2=0x56432c7d27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 --2- 172.21.15.119:0/3535829403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7d23b0 0x56432c7d27d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f132c08d320 tx=0x7f132c066440 comp rx=0 tx=0).stop 2024-04-23T18:29:31.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/3535829403 shutdown_connections 2024-04-23T18:29:31.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 --2- 172.21.15.119:0/3535829403 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1214036eb0 0x7f1214039370 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 --2- 172.21.15.119:0/3535829403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c7d23b0 0x56432c7d27d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/3535829403 >> 172.21.15.119:0/3535829403 conn(0x56432c7c6450 msgr2=0x56432c7c6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/3535829403 shutdown_connections 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/3535829403 wait complete. 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56432c7c1330 msgr2=0x56432c7c37a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56432c7c1330 0x56432c7c37a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56432c6be3b0 msgr2=0x56432c7bab60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56432c6be3b0 0x56432c7bab60 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56432c7bd3f0 msgr2=0x56432c7bf7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56432c7bd3f0 0x56432c7bf7e0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1220036eb0 msgr2=0x7f1220039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1220036eb0 0x7f1220039370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1324000f60 tx=0x7f13240012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 msgr2=0x56432c7b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 --2- 172.21.15.119:0/1112301615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56432c6bba80 0x56432c7b3b40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f132c060040 tx=0x7f132c002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133a9af640 1 -- 172.21.15.119:0/1112301615 reap_dead start 2024-04-23T18:29:31.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 shutdown_connections 2024-04-23T18:29:31.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 >> 172.21.15.119:0/1112301615 conn(0x56432c6b5430 msgr2=0x56432c7aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 shutdown_connections 2024-04-23T18:29:31.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.852+0000 7f133e52f800 1 -- 172.21.15.119:0/1112301615 wait complete. 2024-04-23T18:29:31.858 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:31.858 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-23T18:29:31.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-23T18:29:31.858 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-04-23T18:29:31.903 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:31.903 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:31.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.911+0000 7f996e887800 1 Processor -- start 2024-04-23T18:29:31.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.911+0000 7f996e887800 1 -- start start 2024-04-23T18:29:31.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.911+0000 7f996e887800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c2e48013d0 0x55c2e4809ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.911+0000 7f996e887800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c2e46b1560 con 0x55c2e47ff890 2024-04-23T18:29:31.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.911+0000 7f996e887800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55c2e46a2e20 con 0x55c2e48013d0 2024-04-23T18:29:31.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.912+0000 7f9963b85640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c2e48013d0 0x55c2e4809ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.912+0000 7f996c386640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55c2e47ff890 0x55c2e47ffcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40572/0 (socket says 172.21.15.119:40572) 2024-04-23T18:29:31.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.912+0000 7f996c386640 1 -- 172.21.15.119:0/2769868065 learned_addr learned my addr 172.21.15.119:0/2769868065 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:31.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.912+0000 7f9963b85640 1 -- 172.21.15.119:0/2769868065 >> v1:172.21.15.62:6789/0 conn(0x55c2e47ff890 legacy=0x55c2e47ffcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.912+0000 7f9963b85640 1 -- 172.21.15.119:0/2769868065 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e46b0e60 con 0x55c2e48013d0 2024-04-23T18:29:31.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.914+0000 7f9963b85640 1 --2- 172.21.15.119:0/2769868065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e48013d0 0x55c2e4809ed0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f995400a470 tx=0x7f995401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2718a09aeb970 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.914+0000 7f996bb85640 1 -- 172.21.15.119:0/2769868065 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9954057070 con 0x55c2e48013d0 2024-04-23T18:29:31.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.914+0000 7f996bb85640 1 -- 172.21.15.119:0/2769868065 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995404adc0 con 0x55c2e48013d0 2024-04-23T18:29:31.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.914+0000 7f996bb85640 1 -- 172.21.15.119:0/2769868065 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9954052590 con 0x55c2e48013d0 2024-04-23T18:29:31.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.915+0000 7f996e887800 1 -- 172.21.15.119:0/2769868065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e48013d0 msgr2=0x55c2e4809ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.915+0000 7f996e887800 1 --2- 172.21.15.119:0/2769868065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e48013d0 0x55c2e4809ed0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f995400a470 tx=0x7f995401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:31.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.915+0000 7f996e887800 1 -- 172.21.15.119:0/2769868065 shutdown_connections 2024-04-23T18:29:31.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.915+0000 7f996e887800 1 --2- 172.21.15.119:0/2769868065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e48013d0 0x55c2e4809ed0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.915+0000 7f996e887800 1 -- 172.21.15.119:0/2769868065 >> 172.21.15.119:0/2769868065 conn(0x55c2e47fb430 msgr2=0x55c2e47fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.915+0000 7f996e887800 1 -- 172.21.15.119:0/2769868065 shutdown_connections 2024-04-23T18:29:31.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.915+0000 7f996e887800 1 -- 172.21.15.119:0/2769868065 wait complete. 2024-04-23T18:29:31.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.926+0000 7f996e887800 1 Processor -- start 2024-04-23T18:29:31.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.926+0000 7f996e887800 1 -- start start 2024-04-23T18:29:31.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.927+0000 7f996e887800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e47ff890 0x55c2e48f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.927+0000 7f996e887800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c2e474c5d0 con 0x55c2e47ff890 2024-04-23T18:29:31.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.927+0000 7f996c386640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e47ff890 0x55c2e48f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.927+0000 7f996c386640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e47ff890 0x55c2e48f46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60932/0 (socket says 172.21.15.119:60932) 2024-04-23T18:29:31.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.927+0000 7f996c386640 1 -- 172.21.15.119:0/1293586350 learned_addr learned my addr 172.21.15.119:0/1293586350 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.927+0000 7f996c386640 1 -- 172.21.15.119:0/1293586350 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e46c2860 con 0x55c2e47ff890 2024-04-23T18:29:31.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.927+0000 7f996c386640 1 --2- 172.21.15.119:0/1293586350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e47ff890 0x55c2e48f46e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f995c001de0 tx=0x7f995c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c465719aae7da2c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.927+0000 7f985a60c640 1 -- 172.21.15.119:0/1293586350 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c012020 con 0x55c2e47ff890 2024-04-23T18:29:31.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.927+0000 7f985a60c640 1 -- 172.21.15.119:0/1293586350 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c00e5a0 con 0x55c2e47ff890 2024-04-23T18:29:31.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.927+0000 7f985a60c640 1 -- 172.21.15.119:0/1293586350 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c00e8c0 con 0x55c2e47ff890 2024-04-23T18:29:31.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.928+0000 7f996e887800 1 -- 172.21.15.119:0/1293586350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e47ff890 msgr2=0x55c2e48f46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.928+0000 7f996e887800 1 --2- 172.21.15.119:0/1293586350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e47ff890 0x55c2e48f46e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f995c001de0 tx=0x7f995c00b6c0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.928+0000 7f996e887800 1 -- 172.21.15.119:0/1293586350 shutdown_connections 2024-04-23T18:29:31.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.928+0000 7f996e887800 1 --2- 172.21.15.119:0/1293586350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e47ff890 0x55c2e48f46e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.928+0000 7f996e887800 1 -- 172.21.15.119:0/1293586350 >> 172.21.15.119:0/1293586350 conn(0x55c2e47fb430 msgr2=0x55c2e48f0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.928+0000 7f996e887800 1 -- 172.21.15.119:0/1293586350 shutdown_connections 2024-04-23T18:29:31.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.928+0000 7f996e887800 1 -- 172.21.15.119:0/1293586350 wait complete. 2024-04-23T18:29:31.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.928+0000 7f996e887800 1 Processor -- start 2024-04-23T18:29:31.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.929+0000 7f996e887800 1 -- start start 2024-04-23T18:29:31.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.929+0000 7f996e887800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e47ff890 0x55c2e48fc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.929+0000 7f996e887800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c2e480c6f0 con 0x55c2e47ff890 2024-04-23T18:29:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.929+0000 7f996c386640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e47ff890 0x55c2e48fc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.929+0000 7f996c386640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e47ff890 0x55c2e48fc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60946/0 (socket says 172.21.15.119:60946) 2024-04-23T18:29:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.929+0000 7f996c386640 1 -- 172.21.15.119:0/2674079052 learned_addr learned my addr 172.21.15.119:0/2674079052 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.929+0000 7f996c386640 1 -- 172.21.15.119:0/2674079052 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e46c0eb0 con 0x55c2e47ff890 2024-04-23T18:29:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.930+0000 7f996c386640 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e47ff890 0x55c2e48fc080 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f995c001de0 tx=0x7f995c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.930+0000 7f9858e09640 1 -- 172.21.15.119:0/2674079052 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c012030 con 0x55c2e47ff890 2024-04-23T18:29:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.930+0000 7f9858e09640 1 -- 172.21.15.119:0/2674079052 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c01a7a0 con 0x55c2e47ff890 2024-04-23T18:29:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.930+0000 7f9858e09640 1 -- 172.21.15.119:0/2674079052 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c01aac0 con 0x55c2e47ff890 2024-04-23T18:29:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.930+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2e48fc5c0 con 0x55c2e47ff890 2024-04-23T18:29:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.930+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e48fcae0 con 0x55c2e47ff890 2024-04-23T18:29:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.930+0000 7f9858e09640 1 -- 172.21.15.119:0/2674079052 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f995c015020 con 0x55c2e47ff890 2024-04-23T18:29:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.931+0000 7f9858e09640 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9854036e60 0x7f9854039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.931+0000 7f9858e09640 1 -- 172.21.15.119:0/2674079052 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f995c020070 con 0x55c2e47ff890 2024-04-23T18:29:31.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.931+0000 7f9963b85640 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9854036e60 0x7f9854039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.931+0000 7f996e887800 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c2e48013d0 0x55c2e49030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.931+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4903620 con 0x55c2e48013d0 2024-04-23T18:29:31.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.931+0000 7f996cb87640 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c2e48013d0 0x55c2e49030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.931+0000 7f9963b85640 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9854036e60 0x7f9854039320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9954054000 tx=0x7f995404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.931+0000 7f996cb87640 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c2e48013d0 0x55c2e49030a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.931+0000 7f996cb87640 1 -- 172.21.15.119:0/2674079052 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e48013d0 2024-04-23T18:29:31.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.932+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4900650 con 0x55c2e48013d0 2024-04-23T18:29:31.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.932+0000 7f996cb87640 1 -- 172.21.15.119:0/2674079052 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e48013d0 2024-04-23T18:29:31.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.932+0000 7f996e887800 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c2e4905930 0x55c2e4907d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.932+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e49083c0 con 0x55c2e4905930 2024-04-23T18:29:31.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.932+0000 7f996c386640 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c2e4905930 0x55c2e4907d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.932+0000 7f996c386640 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c2e4905930 0x55c2e4907d20 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.932+0000 7f996c386640 1 -- 172.21.15.119:0/2674079052 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f995c024980 con 0x55c2e4905930 2024-04-23T18:29:31.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.932+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e49048e0 con 0x55c2e48013d0 2024-04-23T18:29:31.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.933+0000 7f996cb87640 1 -- 172.21.15.119:0/2674079052 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e48013d0 2024-04-23T18:29:31.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.933+0000 7f996e887800 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c2e4909870 0x55c2e490bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.933+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e490c420 con 0x55c2e4909870 2024-04-23T18:29:31.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.933+0000 7f9963b85640 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c2e4909870 0x55c2e490bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.933+0000 7f9963b85640 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c2e4909870 0x55c2e490bcc0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.934+0000 7f9963b85640 1 -- 172.21.15.119:0/2674079052 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f995405a040 con 0x55c2e4909870 2024-04-23T18:29:31.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.934+0000 7f996e887800 1 Processor -- start 2024-04-23T18:29:31.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.934+0000 7f996e887800 1 -- start start 2024-04-23T18:29:31.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.934+0000 7f996e887800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e491a880 0x55c2e491aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.934+0000 7f996e887800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c2e46f2df0 con 0x55c2e491a880 2024-04-23T18:29:31.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.934+0000 7f996c386640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e491a880 0x55c2e491aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.934+0000 7f996c386640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e491a880 0x55c2e491aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60962/0 (socket says 172.21.15.119:60962) 2024-04-23T18:29:31.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.934+0000 7f996c386640 1 -- 172.21.15.119:0/2850503618 learned_addr learned my addr 172.21.15.119:0/2850503618 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.935+0000 7f996c386640 1 -- 172.21.15.119:0/2850503618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e491b1e0 con 0x55c2e491a880 2024-04-23T18:29:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.935+0000 7f996c386640 1 --2- 172.21.15.119:0/2850503618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e491a880 0x55c2e491aca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f995c01afb0 tx=0x7f995c03fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.935+0000 7f9851ffb640 1 -- 172.21.15.119:0/2850503618 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c04ba30 con 0x55c2e491a880 2024-04-23T18:29:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.935+0000 7f9851ffb640 1 -- 172.21.15.119:0/2850503618 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c04bbd0 con 0x55c2e491a880 2024-04-23T18:29:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.935+0000 7f996e887800 1 -- 172.21.15.119:0/2850503618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2e491bc50 con 0x55c2e491a880 2024-04-23T18:29:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.935+0000 7f9851ffb640 1 -- 172.21.15.119:0/2850503618 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c016590 con 0x55c2e491a880 2024-04-23T18:29:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.935+0000 7f996e887800 1 -- 172.21.15.119:0/2850503618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e491c150 con 0x55c2e491a880 2024-04-23T18:29:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.936+0000 7f9851ffb640 1 -- 172.21.15.119:0/2850503618 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f995c016730 con 0x55c2e491a880 2024-04-23T18:29:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.936+0000 7f9851ffb640 1 --2- 172.21.15.119:0/2850503618 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9844036eb0 0x7f9844039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.936+0000 7f9851ffb640 1 -- 172.21.15.119:0/2850503618 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f995c040000 con 0x55c2e491a880 2024-04-23T18:29:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.936+0000 7f9963b85640 1 --2- 172.21.15.119:0/2850503618 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9844036eb0 0x7f9844039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.936+0000 7f996e887800 1 Processor -- start 2024-04-23T18:29:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.936+0000 7f996e887800 1 -- start start 2024-04-23T18:29:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.936+0000 7f9963b85640 1 --2- 172.21.15.119:0/2850503618 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9844036eb0 0x7f9844039370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55c2e4900590 tx=0x7f9954005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.936+0000 7f996e887800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e49278f0 0x55c2e4927d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.936+0000 7f996e887800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c2e48f4e60 con 0x55c2e49278f0 2024-04-23T18:29:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.936+0000 7f996c386640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e49278f0 0x55c2e4927d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.936+0000 7f996c386640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e49278f0 0x55c2e4927d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60970/0 (socket says 172.21.15.119:60970) 2024-04-23T18:29:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.936+0000 7f996c386640 1 -- 172.21.15.119:0/254527075 learned_addr learned my addr 172.21.15.119:0/254527075 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.937+0000 7f996c386640 1 -- 172.21.15.119:0/254527075 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e49282e0 con 0x55c2e49278f0 2024-04-23T18:29:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.937+0000 7f996c386640 1 --2- 172.21.15.119:0/254527075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e49278f0 0x55c2e4927d10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f995c00d6e0 tx=0x7f995c04fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44ad826ea423cfe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.937+0000 7f984b7fe640 1 -- 172.21.15.119:0/254527075 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c056050 con 0x55c2e49278f0 2024-04-23T18:29:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.937+0000 7f984b7fe640 1 -- 172.21.15.119:0/254527075 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c057040 con 0x55c2e49278f0 2024-04-23T18:29:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.937+0000 7f984b7fe640 1 -- 172.21.15.119:0/254527075 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c037d50 con 0x55c2e49278f0 2024-04-23T18:29:31.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.937+0000 7f996e887800 1 -- 172.21.15.119:0/254527075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e49278f0 msgr2=0x55c2e4927d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.937+0000 7f996e887800 1 --2- 172.21.15.119:0/254527075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e49278f0 0x55c2e4927d10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f995c00d6e0 tx=0x7f995c04fd80 comp rx=0 tx=0).stop 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.937+0000 7f996e887800 1 -- 172.21.15.119:0/254527075 shutdown_connections 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.937+0000 7f996e887800 1 --2- 172.21.15.119:0/254527075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e49278f0 0x55c2e4927d10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.937+0000 7f996e887800 1 -- 172.21.15.119:0/254527075 >> 172.21.15.119:0/254527075 conn(0x55c2e4923c50 msgr2=0x55c2e4921cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.937+0000 7f996e887800 1 -- 172.21.15.119:0/254527075 shutdown_connections 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.937+0000 7f996e887800 1 -- 172.21.15.119:0/254527075 wait complete. 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.938+0000 7f996e887800 1 Processor -- start 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.938+0000 7f996e887800 1 -- start start 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.938+0000 7f996e887800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e49278f0 0x55c2e492ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.938+0000 7f996e887800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c2e4928990 con 0x55c2e49278f0 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.938+0000 7f996c386640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e49278f0 0x55c2e492ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.938+0000 7f996c386640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e49278f0 0x55c2e492ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60972/0 (socket says 172.21.15.119:60972) 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.938+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 learned_addr learned my addr 172.21.15.119:0/3773405940 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:31.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.938+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e492f270 con 0x55c2e49278f0 2024-04-23T18:29:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.938+0000 7f996c386640 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e49278f0 0x55c2e492ed30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f995c009ef0 tx=0x7f995c04cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.939+0000 7f9849ffb640 1 -- 172.21.15.119:0/3773405940 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c0442c0 con 0x55c2e49278f0 2024-04-23T18:29:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.939+0000 7f9849ffb640 1 -- 172.21.15.119:0/3773405940 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c03f350 con 0x55c2e49278f0 2024-04-23T18:29:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.939+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2e492f270 con 0x55c2e49278f0 2024-04-23T18:29:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.939+0000 7f9849ffb640 1 -- 172.21.15.119:0/3773405940 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c04f5d0 con 0x55c2e49278f0 2024-04-23T18:29:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.939+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e492f270 con 0x55c2e49278f0 2024-04-23T18:29:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.939+0000 7f9849ffb640 1 -- 172.21.15.119:0/3773405940 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f995c04f770 con 0x55c2e49278f0 2024-04-23T18:29:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.940+0000 7f9849ffb640 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f983c036eb0 0x7f983c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.940+0000 7f9849ffb640 1 -- 172.21.15.119:0/3773405940 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f995c060210 con 0x55c2e49278f0 2024-04-23T18:29:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.940+0000 7f9963b85640 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f983c036eb0 0x7f983c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.940+0000 7f9963b85640 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f983c036eb0 0x7f983c039370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9954000c00 tx=0x7f9954060040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.940+0000 7f996e887800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.940+0000 7f996e887800 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c2e493a490 0x55c2e493c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.940+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493d0a0 con 0x55c2e493a490 2024-04-23T18:29:31.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.940+0000 7f996cb87640 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c2e493a490 0x55c2e493c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.940+0000 7f996cb87640 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c2e493a490 0x55c2e493c950 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e493a490 2024-04-23T18:29:31.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 20 realm 2024-04-23T18:29:31.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493d4b0 con 0x55c2e493a490 2024-04-23T18:29:31.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e493a490 2024-04-23T18:29:31.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:31.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493dd80 con 0x55c2e493a490 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e493a490 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493a490 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e493a490 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c2e493ee80 0x55c2e4941270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4941880 con 0x55c2e493ee80 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.941+0000 7f996c386640 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c2e493ee80 0x55c2e4941270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.942+0000 7f996c386640 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c2e493ee80 0x55c2e4941270 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.942+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.942+0000 7f996e887800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:31.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.942+0000 7f996e887800 20 searching for the correct realm 2024-04-23T18:29:31.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.942+0000 7f996e887800 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c2e4943830 0x55c2e4945cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.942+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e49463c0 con 0x55c2e4943830 2024-04-23T18:29:31.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.942+0000 7f9963b85640 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c2e4943830 0x55c2e4945cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.942+0000 7f9963b85640 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c2e4943830 0x55c2e4945cf0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.943+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.943+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e49463c0 con 0x55c2e493ee80 2024-04-23T18:29:31.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.943+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.943+0000 7f996c386640 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f995c017050 0x7f995c019490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:31.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.943+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e49463c0 con 0x7f995c017050 2024-04-23T18:29:31.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.943+0000 7f996cb87640 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f995c017050 0x7f995c019490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:31.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.944+0000 7f996cb87640 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f995c017050 0x7f995c019490 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:31.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.944+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996400a4a0 con 0x7f995c017050 2024-04-23T18:29:31.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.944+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493a490 2024-04-23T18:29:31.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.944+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e493a490 2024-04-23T18:29:31.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.944+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493a490 2024-04-23T18:29:31.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.944+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e493a490 2024-04-23T18:29:31.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.944+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x7f995c017050 2024-04-23T18:29:31.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.944+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996400a4a0 con 0x7f995c017050 2024-04-23T18:29:31.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.944+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x7f995c017050 2024-04-23T18:29:31.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.945+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f996400a4a0 con 0x7f995c017050 2024-04-23T18:29:31.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.945+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493ee80 2024-04-23T18:29:31.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.945+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.945+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e4943830 2024-04-23T18:29:31.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.945+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.945+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493a490 2024-04-23T18:29:31.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.945+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e493a490 2024-04-23T18:29:31.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.945+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x7f995c017050 2024-04-23T18:29:31.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.946+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996400a4a0 con 0x7f995c017050 2024-04-23T18:29:31.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.946+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493a490 2024-04-23T18:29:31.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.946+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e493a490 2024-04-23T18:29:31.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.946+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493ee80 2024-04-23T18:29:31.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.946+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.946+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e4943830 2024-04-23T18:29:31.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.947+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.947+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e4943830 2024-04-23T18:29:31.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.947+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.947+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x7f995c017050 2024-04-23T18:29:31.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.947+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996400a4a0 con 0x7f995c017050 2024-04-23T18:29:31.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.947+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e4943830 2024-04-23T18:29:31.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.947+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.947+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e4943830 2024-04-23T18:29:31.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.948+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.948+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493a490 2024-04-23T18:29:31.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.948+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e493a490 2024-04-23T18:29:31.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.948+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493a490 2024-04-23T18:29:31.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.948+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e493a490 2024-04-23T18:29:31.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.948+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x7f995c017050 2024-04-23T18:29:31.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.948+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996400a4a0 con 0x7f995c017050 2024-04-23T18:29:31.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.948+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e4943830 2024-04-23T18:29:31.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.949+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.949+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493ee80 2024-04-23T18:29:31.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.949+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.949+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493a490 2024-04-23T18:29:31.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.949+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996400a4a0 con 0x55c2e493a490 2024-04-23T18:29:31.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.949+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x7f995c017050 2024-04-23T18:29:31.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.949+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996400a4a0 con 0x7f995c017050 2024-04-23T18:29:31.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.949+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e4943830 2024-04-23T18:29:31.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.949+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.950+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x7f995c017050 2024-04-23T18:29:31.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.950+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996400a4a0 con 0x7f995c017050 2024-04-23T18:29:31.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.950+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493ee80 2024-04-23T18:29:31.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.950+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.950+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e4943830 2024-04-23T18:29:31.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.950+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.950+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x7f995c017050 2024-04-23T18:29:31.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9964040040 con 0x7f995c017050 2024-04-23T18:29:31.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493a490 2024-04-23T18:29:31.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c2e493e120 con 0x55c2e493ee80 2024-04-23T18:29:31.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:31.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:31.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:31.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:31.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:31.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:31.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4942140 con 0x55c2e493a490 2024-04-23T18:29:31.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4942140 con 0x55c2e493a490 2024-04-23T18:29:31.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.951+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4942140 con 0x7f995c017050 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9964040040 con 0x7f995c017050 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996e887800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996e887800 20 zone default found 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996e887800 4 Realm: () 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996e887800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996e887800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996e887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996e887800 20 zonegroup default 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996e887800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e49429e0 con 0x7f995c017050 2024-04-23T18:29:31.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9964040040 con 0x7f995c017050 2024-04-23T18:29:31.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996e887800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.952+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e49429e0 con 0x55c2e4943830 2024-04-23T18:29:31.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.953+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.953+0000 7f996e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.953+0000 7f996e887800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.953+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4948220 con 0x55c2e4943830 2024-04-23T18:29:31.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.953+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.953+0000 7f996e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.953+0000 7f996e887800 20 started sync module instance, tier type = 2024-04-23T18:29:31.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.953+0000 7f996e887800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:31.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.953+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e49476c0 con 0x55c2e493ee80 2024-04-23T18:29:31.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.954+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.954+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94295546950160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e49485c0 con 0x55c2e493ee80 2024-04-23T18:29:31.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.954+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4948f80 con 0x55c2e493a490 2024-04-23T18:29:31.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.955+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94295546950160] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.955+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.955+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94295546956496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e49493a0 con 0x55c2e493a490 2024-04-23T18:29:31.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.955+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4949d60 con 0x55c2e4943830 2024-04-23T18:29:31.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.956+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94295546956496] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.956+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.956+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94295546957552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4949310 con 0x55c2e4943830 2024-04-23T18:29:31.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.956+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494abd0 con 0x55c2e493ee80 2024-04-23T18:29:31.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.957+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.957+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94295546957552] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.957+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94295546965872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494b390 con 0x55c2e493ee80 2024-04-23T18:29:31.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.957+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494bd50 con 0x55c2e493a490 2024-04-23T18:29:31.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.958+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94295546965872] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.959+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.959+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94295546968224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494bcc0 con 0x55c2e493a490 2024-04-23T18:29:31.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.959+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494cc10 con 0x7f995c017050 2024-04-23T18:29:31.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.959+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x7f995c017050 2024-04-23T18:29:31.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.960+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94295546972000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494d030 con 0x7f995c017050 2024-04-23T18:29:31.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.960+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494da90 con 0x7f995c017050 2024-04-23T18:29:31.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.960+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94295546968224] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.961+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94295546972000] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x7f995c017050 2024-04-23T18:29:31.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.961+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x7f995c017050 2024-04-23T18:29:31.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.961+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94295546970432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494cb80 con 0x7f995c017050 2024-04-23T18:29:31.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.961+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494e120 con 0x7f995c017050 2024-04-23T18:29:31.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.962+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x7f995c017050 2024-04-23T18:29:31.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.962+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94295546977392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494e540 con 0x7f995c017050 2024-04-23T18:29:31.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.962+0000 7f996e887800 20 add_watcher() i=0 2024-04-23T18:29:31.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.962+0000 7f996e887800 20 add_watcher() i=1 2024-04-23T18:29:31.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.962+0000 7f996e887800 20 add_watcher() i=2 2024-04-23T18:29:31.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.962+0000 7f996e887800 20 add_watcher() i=3 2024-04-23T18:29:31.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.962+0000 7f996e887800 20 add_watcher() i=4 2024-04-23T18:29:31.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.962+0000 7f996e887800 20 add_watcher() i=5 2024-04-23T18:29:31.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.962+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94295546970432] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x7f995c017050 2024-04-23T18:29:31.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.962+0000 7f996e887800 20 add_watcher() i=6 2024-04-23T18:29:31.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.963+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94295546977392] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x7f995c017050 2024-04-23T18:29:31.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.963+0000 7f996e887800 20 add_watcher() i=7 2024-04-23T18:29:31.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.963+0000 7f996e887800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:31.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.963+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4951570 con 0x55c2e493a490 2024-04-23T18:29:31.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.963+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.963+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94295546978448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494e9d0 con 0x55c2e493a490 2024-04-23T18:29:31.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.964+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94295546978448] v32'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.964+0000 7f98227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.964+0000 7f996e887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:31.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.964+0000 7f996e887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:31.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.965+0000 7f996e887800 5 note: GC not initialized 2024-04-23T18:29:31.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.965+0000 7f98217e2640 20 reqs_thread_entry: start 2024-04-23T18:29:31.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.965+0000 7f996e887800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:31.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.965+0000 7f996e887800 20 Filter name: none 2024-04-23T18:29:31.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.965+0000 7f9792ffd640 20 reqs_thread_entry: start 2024-04-23T18:29:31.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.965+0000 7f996e887800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:31.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.965+0000 7f996e887800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.965+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4984b00 con 0x55c2e493a490 2024-04-23T18:29:31.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.965+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.966+0000 7f996e887800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:31.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.966+0000 7f996e887800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:31.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.966+0000 7f996e887800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:31.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.966+0000 7f996e887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:31.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.966+0000 7f996e887800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-04-23T18:29:31.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.966+0000 7f996e887800 20 rados->read ofs=0 len=0 2024-04-23T18:29:31.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.966+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4985570 con 0x55c2e493a490 2024-04-23T18:29:31.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.966+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.966+0000 7f996e887800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.966+0000 7f996e887800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-04-23T18:29:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.966+0000 7f996e887800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-23T18:29:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.966+0000 7f996e887800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-04-23T18:29:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.966+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e498af30 con 0x55c2e493a490 2024-04-23T18:29:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.967+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.967+0000 7f996e887800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.967+0000 7f996e887800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.967+0000 7f996e887800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.967+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94295547226496 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4986580 con 0x55c2e493a490 2024-04-23T18:29:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.967+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== watch-notify(notify (1) cookie 94295546968224 notify 137438953477 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f9964018d90 con 0x55c2e493a490 2024-04-23T18:29:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.967+0000 7f984b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94295546968224 notifier 4357 bl.length()=732 2024-04-23T18:29:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.967+0000 7f984b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:31.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.967+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(65 notify.4 [notify cookie 94295547226496 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.967+0000 7f984b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:31.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.967+0000 7f984b7fe640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9830003ea0 con 0x55c2e493a490 2024-04-23T18:29:31.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.967+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.968+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== watch-notify(notify_complete (2) cookie 94295547226496 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9964005040 con 0x55c2e493a490 2024-04-23T18:29:31.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.968+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e498a980 con 0x55c2e493a490 2024-04-23T18:29:31.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.969+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.969+0000 7f996e887800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-23T18:29:31.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.969+0000 7f996e887800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-23T18:29:31.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.969+0000 7f996e887800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-23T18:29:31.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.969+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94295547226496 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c2e49860d0 con 0x55c2e493ee80 2024-04-23T18:29:31.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.969+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== watch-notify(notify (1) cookie 94295546950160 notify 137438953474 ret 0) ==== 208+0+0 (crc 0 0 0) 0x55c2e491bc50 con 0x55c2e493ee80 2024-04-23T18:29:31.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.969+0000 7f984b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94295546950160 notifier 4357 bl.length()=166 2024-04-23T18:29:31.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.969+0000 7f984b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-23T18:29:31.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.969+0000 7f984b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-23T18:29:31.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.969+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(68 notify.0 [notify cookie 94295547226496 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.969+0000 7f984b7fe640 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9830003ea0 con 0x55c2e493ee80 2024-04-23T18:29:31.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.969+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== watch-notify(notify_complete (2) cookie 94295547226496 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c2e491b1e0 con 0x55c2e493ee80 2024-04-23T18:29:31.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.969+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.977 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"aRXBfoBTXi2iRajsY0ZBT0h8uofAx3fKBLIWuL4a","active":true,"create_date":"2024-04-23T18:29:31.967215Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:31.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.970+0000 7f98227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:31.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.970+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94295546978448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4989e10 con 0x55c2e493a490 2024-04-23T18:29:31.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.971+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94295546978448] v32'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.971+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94295546950160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494e090 con 0x55c2e493ee80 2024-04-23T18:29:31.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.972+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94295546950160] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.972+0000 7f996e887800 20 remove_watcher() i=0 2024-04-23T18:29:31.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.972+0000 7f996e887800 2 removed watcher, disabling cache 2024-04-23T18:29:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.972+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94295546956496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4947210 con 0x55c2e493a490 2024-04-23T18:29:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.973+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94295546956496] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.973+0000 7f996e887800 20 remove_watcher() i=1 2024-04-23T18:29:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.973+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94295546957552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e4948ad0 con 0x55c2e4943830 2024-04-23T18:29:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.974+0000 7f9963b85640 1 -- 172.21.15.119:0/3773405940 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94295546957552] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9954070070 con 0x55c2e4943830 2024-04-23T18:29:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.974+0000 7f996e887800 20 remove_watcher() i=2 2024-04-23T18:29:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.974+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94295546965872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494e090 con 0x55c2e493ee80 2024-04-23T18:29:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.975+0000 7f996c386640 1 -- 172.21.15.119:0/3773405940 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94295546965872] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995c059070 con 0x55c2e493ee80 2024-04-23T18:29:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.975+0000 7f996e887800 20 remove_watcher() i=3 2024-04-23T18:29:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.975+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94295546968224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494af70 con 0x55c2e493a490 2024-04-23T18:29:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.976+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94295546968224] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x55c2e493a490 2024-04-23T18:29:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.976+0000 7f996e887800 20 remove_watcher() i=4 2024-04-23T18:29:31.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.976+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94295546972000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494af70 con 0x7f995c017050 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.977+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94295546972000] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x7f995c017050 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.977+0000 7f996e887800 20 remove_watcher() i=5 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.977+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94295546970432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494c760 con 0x7f995c017050 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.978+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94295546970432] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x7f995c017050 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.978+0000 7f996e887800 20 remove_watcher() i=6 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.978+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94295546977392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c2e494af70 con 0x7f995c017050 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94295546977392] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9964040040 con 0x7f995c017050 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 20 remove_watcher() i=7 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f995c017050 msgr2=0x7f995c019490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f995c017050 0x7f995c019490 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c2e493a490 msgr2=0x55c2e493c950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c2e493a490 0x55c2e493c950 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c2e493ee80 msgr2=0x55c2e4941270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c2e493ee80 0x55c2e4941270 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c2e4943830 msgr2=0x55c2e4945cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55c2e4943830 0x55c2e4945cf0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f983c036eb0 msgr2=0x7f983c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f983c036eb0 0x7f983c039370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9954000c00 tx=0x7f9954060040 comp rx=0 tx=0).stop 2024-04-23T18:29:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e49278f0 msgr2=0x55c2e492ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 1 --2- 172.21.15.119:0/3773405940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e49278f0 0x55c2e492ed30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f995c009ef0 tx=0x7f995c04cee0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 reap_dead start 2024-04-23T18:29:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996cb87640 1 -- 172.21.15.119:0/3773405940 reap_dead start 2024-04-23T18:29:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.979+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 shutdown_connections 2024-04-23T18:29:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 >> 172.21.15.119:0/3773405940 conn(0x55c2e4923c50 msgr2=0x55c2e49212b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 shutdown_connections 2024-04-23T18:29:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/3773405940 wait complete. 2024-04-23T18:29:31.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2850503618 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9844036eb0 msgr2=0x7f9844039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 --2- 172.21.15.119:0/2850503618 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9844036eb0 0x7f9844039370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55c2e4900590 tx=0x7f9954005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:31.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2850503618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e491a880 msgr2=0x55c2e491aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 --2- 172.21.15.119:0/2850503618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e491a880 0x55c2e491aca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f995c01afb0 tx=0x7f995c03fe00 comp rx=0 tx=0).stop 2024-04-23T18:29:31.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2850503618 shutdown_connections 2024-04-23T18:29:31.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 --2- 172.21.15.119:0/2850503618 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9844036eb0 0x7f9844039370 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 --2- 172.21.15.119:0/2850503618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e491a880 0x55c2e491aca0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2850503618 >> 172.21.15.119:0/2850503618 conn(0x55c2e490e920 msgr2=0x55c2e490ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2850503618 shutdown_connections 2024-04-23T18:29:31.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2850503618 wait complete. 2024-04-23T18:29:31.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c2e4909870 msgr2=0x55c2e490bcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55c2e4909870 0x55c2e490bcc0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c2e48013d0 msgr2=0x55c2e49030a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c2e48013d0 0x55c2e49030a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c2e4905930 msgr2=0x55c2e4907d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c2e4905930 0x55c2e4907d20 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9854036e60 msgr2=0x7f9854039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9854036e60 0x7f9854039320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9954054000 tx=0x7f995404e000 comp rx=0 tx=0).stop 2024-04-23T18:29:31.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e47ff890 msgr2=0x55c2e48fc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:31.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 --2- 172.21.15.119:0/2674079052 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c2e47ff890 0x55c2e48fc080 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f995c001de0 tx=0x7f995c000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:31.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996cb87640 1 -- 172.21.15.119:0/2674079052 reap_dead start 2024-04-23T18:29:31.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 shutdown_connections 2024-04-23T18:29:31.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 >> 172.21.15.119:0/2674079052 conn(0x55c2e47fb430 msgr2=0x55c2e48ee840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:31.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.980+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 shutdown_connections 2024-04-23T18:29:31.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:31.981+0000 7f996e887800 1 -- 172.21.15.119:0/2674079052 wait complete. 2024-04-23T18:29:31.988 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'aRXBfoBTXi2iRajsY0ZBT0h8uofAx3fKBLIWuL4a', 'active': True, 'create_date': '2024-04-23T18:29:31.967215Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:31.989 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-23T18:29:31.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-23T18:29:31.989 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-04-23T18:29:32.035 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:32.035 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:32.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.043+0000 7f6a05928800 1 Processor -- start 2024-04-23T18:29:32.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.043+0000 7f6a05928800 1 -- start start 2024-04-23T18:29:32.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.044+0000 7f6a05928800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f62032b8e0 0x55f6203bab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.044+0000 7f6a05928800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f620268560 con 0x55f6203bb0a0 2024-04-23T18:29:32.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.044+0000 7f6a05928800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55f620259e20 con 0x55f62032b8e0 2024-04-23T18:29:32.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.044+0000 7f6a015a7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f62032b8e0 0x55f6203bab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.044+0000 7f6a00da6640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55f6203bb0a0 0x55f6203bd560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40582/0 (socket says 172.21.15.119:40582) 2024-04-23T18:29:32.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.044+0000 7f6a00da6640 1 -- 172.21.15.119:0/2575811782 learned_addr learned my addr 172.21.15.119:0/2575811782 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:32.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.044+0000 7f6a015a7640 1 -- 172.21.15.119:0/2575811782 >> v1:172.21.15.62:6789/0 conn(0x55f6203bb0a0 legacy=0x55f6203bd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.044+0000 7f6a015a7640 1 -- 172.21.15.119:0/2575811782 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f620267e60 con 0x55f62032b8e0 2024-04-23T18:29:32.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.046+0000 7f6a015a7640 1 --2- 172.21.15.119:0/2575811782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6203bab30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f69f800a470 tx=0x7f69f801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244c3dde81b36659 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.046+0000 7f69f3fff640 1 -- 172.21.15.119:0/2575811782 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8057070 con 0x55f62032b8e0 2024-04-23T18:29:32.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.046+0000 7f69f3fff640 1 -- 172.21.15.119:0/2575811782 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f8052570 con 0x55f62032b8e0 2024-04-23T18:29:32.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.046+0000 7f69f3fff640 1 -- 172.21.15.119:0/2575811782 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8052870 con 0x55f62032b8e0 2024-04-23T18:29:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.047+0000 7f6a05928800 1 -- 172.21.15.119:0/2575811782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 msgr2=0x55f6203bab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.047+0000 7f6a05928800 1 --2- 172.21.15.119:0/2575811782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6203bab30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f69f800a470 tx=0x7f69f801ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.047+0000 7f6a05928800 1 -- 172.21.15.119:0/2575811782 shutdown_connections 2024-04-23T18:29:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.047+0000 7f6a05928800 1 --2- 172.21.15.119:0/2575811782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6203bab30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.047+0000 7f6a05928800 1 -- 172.21.15.119:0/2575811782 >> 172.21.15.119:0/2575811782 conn(0x55f6203b2430 msgr2=0x55f6203b4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.047+0000 7f6a05928800 1 -- 172.21.15.119:0/2575811782 shutdown_connections 2024-04-23T18:29:32.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.047+0000 7f6a05928800 1 -- 172.21.15.119:0/2575811782 wait complete. 2024-04-23T18:29:32.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.058+0000 7f6a05928800 1 Processor -- start 2024-04-23T18:29:32.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.058+0000 7f6a05928800 1 -- start start 2024-04-23T18:29:32.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.059+0000 7f6a05928800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6204a9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.059+0000 7f6a05928800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f6203035d0 con 0x55f62032b8e0 2024-04-23T18:29:32.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.059+0000 7f6a015a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6204a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.059+0000 7f6a015a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6204a9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60990/0 (socket says 172.21.15.119:60990) 2024-04-23T18:29:32.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.059+0000 7f6a015a7640 1 -- 172.21.15.119:0/2132995113 learned_addr learned my addr 172.21.15.119:0/2132995113 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.059+0000 7f6a015a7640 1 -- 172.21.15.119:0/2132995113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f620279860 con 0x55f62032b8e0 2024-04-23T18:29:32.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.059+0000 7f6a015a7640 1 --2- 172.21.15.119:0/2132995113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6204a9270 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f69f8055040 tx=0x7f69f804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b863ec09eeae2338 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.059+0000 7f68ef606640 1 -- 172.21.15.119:0/2132995113 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8057070 con 0x55f62032b8e0 2024-04-23T18:29:32.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.059+0000 7f68ef606640 1 -- 172.21.15.119:0/2132995113 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f8063070 con 0x55f62032b8e0 2024-04-23T18:29:32.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.059+0000 7f68ef606640 1 -- 172.21.15.119:0/2132995113 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8052720 con 0x55f62032b8e0 2024-04-23T18:29:32.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.060+0000 7f6a05928800 1 -- 172.21.15.119:0/2132995113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 msgr2=0x55f6204a9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.060+0000 7f6a05928800 1 --2- 172.21.15.119:0/2132995113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6204a9270 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f69f8055040 tx=0x7f69f804c000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.060+0000 7f6a05928800 1 -- 172.21.15.119:0/2132995113 shutdown_connections 2024-04-23T18:29:32.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.060+0000 7f6a05928800 1 --2- 172.21.15.119:0/2132995113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6204a9270 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.060+0000 7f6a05928800 1 -- 172.21.15.119:0/2132995113 >> 172.21.15.119:0/2132995113 conn(0x55f6203b2430 msgr2=0x55f6204a4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.060+0000 7f6a05928800 1 -- 172.21.15.119:0/2132995113 shutdown_connections 2024-04-23T18:29:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.060+0000 7f6a05928800 1 -- 172.21.15.119:0/2132995113 wait complete. 2024-04-23T18:29:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.060+0000 7f6a05928800 1 Processor -- start 2024-04-23T18:29:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.061+0000 7f6a05928800 1 -- start start 2024-04-23T18:29:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.061+0000 7f6a05928800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6204b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.061+0000 7f6a05928800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f6203bf090 con 0x55f62032b8e0 2024-04-23T18:29:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.061+0000 7f6a015a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6204b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.061+0000 7f6a015a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6204b0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60992/0 (socket says 172.21.15.119:60992) 2024-04-23T18:29:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.061+0000 7f6a015a7640 1 -- 172.21.15.119:0/43640729 learned_addr learned my addr 172.21.15.119:0/43640729 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.061+0000 7f6a015a7640 1 -- 172.21.15.119:0/43640729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f620277eb0 con 0x55f62032b8e0 2024-04-23T18:29:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.061+0000 7f6a015a7640 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6204b0a20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f69f8055040 tx=0x7f69f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.062+0000 7f68ede03640 1 -- 172.21.15.119:0/43640729 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f805e480 con 0x55f62032b8e0 2024-04-23T18:29:32.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.062+0000 7f68ede03640 1 -- 172.21.15.119:0/43640729 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f806c070 con 0x55f62032b8e0 2024-04-23T18:29:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.062+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6204b0f60 con 0x55f62032b8e0 2024-04-23T18:29:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.062+0000 7f68ede03640 1 -- 172.21.15.119:0/43640729 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f805e750 con 0x55f62032b8e0 2024-04-23T18:29:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.062+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6204b14e0 con 0x55f62032b8e0 2024-04-23T18:29:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.062+0000 7f68ede03640 1 -- 172.21.15.119:0/43640729 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f69f805e8f0 con 0x55f62032b8e0 2024-04-23T18:29:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.063+0000 7f68ede03640 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68e8036eb0 0x7f68e8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.063+0000 7f68ede03640 1 -- 172.21.15.119:0/43640729 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f69f808efe0 con 0x55f62032b8e0 2024-04-23T18:29:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.063+0000 7f6a00da6640 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68e8036eb0 0x7f68e8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.063+0000 7f6a05928800 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f6203bb0a0 0x55f6204b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.063+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204b8070 con 0x55f6203bb0a0 2024-04-23T18:29:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.063+0000 7f6a01da8640 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f6203bb0a0 0x55f6204b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.063+0000 7f6a00da6640 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68e8036eb0 0x7f68e8039370 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f69f4000f60 tx=0x7f69f40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.063+0000 7f6a01da8640 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f6203bb0a0 0x55f6204b7af0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.063+0000 7f6a01da8640 1 -- 172.21.15.119:0/43640729 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6203bb0a0 2024-04-23T18:29:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.063+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204b50a0 con 0x55f6203bb0a0 2024-04-23T18:29:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.064+0000 7f6a01da8640 1 -- 172.21.15.119:0/43640729 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6203bb0a0 2024-04-23T18:29:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.064+0000 7f6a05928800 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f6204ba3a0 0x55f6204bc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.064+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204bce30 con 0x55f6204ba3a0 2024-04-23T18:29:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.064+0000 7f6a015a7640 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f6204ba3a0 0x55f6204bc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.064+0000 7f6a015a7640 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f6204ba3a0 0x55f6204bc790 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.064+0000 7f6a015a7640 1 -- 172.21.15.119:0/43640729 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f69f8071990 con 0x55f6204ba3a0 2024-04-23T18:29:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.064+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204b9350 con 0x55f6203bb0a0 2024-04-23T18:29:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.065+0000 7f6a01da8640 1 -- 172.21.15.119:0/43640729 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6203bb0a0 2024-04-23T18:29:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.065+0000 7f6a05928800 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f6204be2e0 0x55f6204c0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.065+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204c0e90 con 0x55f6204be2e0 2024-04-23T18:29:32.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.065+0000 7f6a00da6640 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f6204be2e0 0x55f6204c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.065+0000 7f6a00da6640 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f6204be2e0 0x55f6204c0730 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.066+0000 7f6a00da6640 1 -- 172.21.15.119:0/43640729 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204be2e0 2024-04-23T18:29:32.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.066+0000 7f6a05928800 1 Processor -- start 2024-04-23T18:29:32.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.066+0000 7f6a05928800 1 -- start start 2024-04-23T18:29:32.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.066+0000 7f6a05928800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6204cf2f0 0x55f6204cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.066+0000 7f6a05928800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f6202a9df0 con 0x55f6204cf2f0 2024-04-23T18:29:32.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.066+0000 7f6a015a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6204cf2f0 0x55f6204cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.066+0000 7f6a015a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6204cf2f0 0x55f6204cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:60994/0 (socket says 172.21.15.119:60994) 2024-04-23T18:29:32.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.066+0000 7f6a015a7640 1 -- 172.21.15.119:0/684713406 learned_addr learned my addr 172.21.15.119:0/684713406 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.066+0000 7f6a015a7640 1 -- 172.21.15.119:0/684713406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6204cfc50 con 0x55f6204cf2f0 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.067+0000 7f6a015a7640 1 --2- 172.21.15.119:0/684713406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6204cf2f0 0x55f6204cf710 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f69f8052fd0 tx=0x7f69f8067490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.067+0000 7f68e6ffd640 1 -- 172.21.15.119:0/684713406 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8066a70 con 0x55f6204cf2f0 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.067+0000 7f68e6ffd640 1 -- 172.21.15.119:0/684713406 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f8058040 con 0x55f6204cf2f0 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.067+0000 7f6a05928800 1 -- 172.21.15.119:0/684713406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6204d06c0 con 0x55f6204cf2f0 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.067+0000 7f68e6ffd640 1 -- 172.21.15.119:0/684713406 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8067640 con 0x55f6204cf2f0 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.067+0000 7f6a05928800 1 -- 172.21.15.119:0/684713406 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6204d0bc0 con 0x55f6204cf2f0 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.067+0000 7f68e6ffd640 1 -- 172.21.15.119:0/684713406 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f69f8086070 con 0x55f6204cf2f0 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.068+0000 7f68e6ffd640 1 --2- 172.21.15.119:0/684713406 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68d8036e60 0x7f68d8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.068+0000 7f68e6ffd640 1 -- 172.21.15.119:0/684713406 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f69f8092c80 con 0x55f6204cf2f0 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.068+0000 7f6a00da6640 1 --2- 172.21.15.119:0/684713406 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68d8036e60 0x7f68d8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.068+0000 7f6a05928800 1 Processor -- start 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.068+0000 7f6a05928800 1 -- start start 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.068+0000 7f6a00da6640 1 --2- 172.21.15.119:0/684713406 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68d8036e60 0x7f68d8039320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69f400bf50 tx=0x7f69f400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.068+0000 7f6a05928800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 0x55f6203b6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.068+0000 7f6a05928800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f6204a9930 con 0x55f6203b81e0 2024-04-23T18:29:32.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.068+0000 7f6a015a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 0x55f6203b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.068+0000 7f6a015a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 0x55f6203b6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32770/0 (socket says 172.21.15.119:32770) 2024-04-23T18:29:32.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.068+0000 7f6a015a7640 1 -- 172.21.15.119:0/3643236892 learned_addr learned my addr 172.21.15.119:0/3643236892 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.069+0000 7f6a015a7640 1 -- 172.21.15.119:0/3643236892 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6203b8690 con 0x55f6203b81e0 2024-04-23T18:29:32.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.069+0000 7f6a015a7640 1 --2- 172.21.15.119:0/3643236892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 0x55f6203b6910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f69f8059c70 tx=0x7f69f804bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770f26102add34a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.069+0000 7f68e4ff9640 1 -- 172.21.15.119:0/3643236892 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f80aa070 con 0x55f6203b81e0 2024-04-23T18:29:32.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.069+0000 7f68e4ff9640 1 -- 172.21.15.119:0/3643236892 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f8059270 con 0x55f6203b81e0 2024-04-23T18:29:32.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.069+0000 7f68e4ff9640 1 -- 172.21.15.119:0/3643236892 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8089c70 con 0x55f6203b81e0 2024-04-23T18:29:32.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.069+0000 7f6a05928800 1 -- 172.21.15.119:0/3643236892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 msgr2=0x55f6203b6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.069+0000 7f6a05928800 1 --2- 172.21.15.119:0/3643236892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 0x55f6203b6910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f69f8059c70 tx=0x7f69f804bf80 comp rx=0 tx=0).stop 2024-04-23T18:29:32.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.069+0000 7f6a05928800 1 -- 172.21.15.119:0/3643236892 shutdown_connections 2024-04-23T18:29:32.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.069+0000 7f6a05928800 1 --2- 172.21.15.119:0/3643236892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 0x55f6203b6910 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.069+0000 7f6a05928800 1 -- 172.21.15.119:0/3643236892 >> 172.21.15.119:0/3643236892 conn(0x55f6204d8750 msgr2=0x55f6204d67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.069+0000 7f6a05928800 1 -- 172.21.15.119:0/3643236892 shutdown_connections 2024-04-23T18:29:32.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.069+0000 7f6a05928800 1 -- 172.21.15.119:0/3643236892 wait complete. 2024-04-23T18:29:32.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.070+0000 7f6a05928800 1 Processor -- start 2024-04-23T18:29:32.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.070+0000 7f6a05928800 1 -- start start 2024-04-23T18:29:32.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.070+0000 7f6a05928800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 0x55f6204e5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.070+0000 7f6a05928800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f6203b6e50 con 0x55f6203b81e0 2024-04-23T18:29:32.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.070+0000 7f6a015a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 0x55f6204e5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.070+0000 7f6a015a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 0x55f6204e5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32784/0 (socket says 172.21.15.119:32784) 2024-04-23T18:29:32.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.070+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 learned_addr learned my addr 172.21.15.119:0/2841666796 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.070+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6204e6000 con 0x55f6203b81e0 2024-04-23T18:29:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.071+0000 7f6a015a7640 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 0x55f6204e5ac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f69f80a8040 tx=0x7f69f8067e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.071+0000 7f68d6ffd640 1 -- 172.21.15.119:0/2841666796 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f80b5070 con 0x55f6203b81e0 2024-04-23T18:29:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.071+0000 7f68d6ffd640 1 -- 172.21.15.119:0/2841666796 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f8076e60 con 0x55f6203b81e0 2024-04-23T18:29:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.071+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6204e6000 con 0x55f6203b81e0 2024-04-23T18:29:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.071+0000 7f68d6ffd640 1 -- 172.21.15.119:0/2841666796 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f80aa040 con 0x55f6203b81e0 2024-04-23T18:29:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.071+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6204e6000 con 0x55f6203b81e0 2024-04-23T18:29:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.071+0000 7f68d6ffd640 1 -- 172.21.15.119:0/2841666796 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f69f80b8070 con 0x55f6203b81e0 2024-04-23T18:29:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.072+0000 7f68d6ffd640 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68cc036eb0 0x7f68cc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.072+0000 7f68d6ffd640 1 -- 172.21.15.119:0/2841666796 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f69f80bbc90 con 0x55f6203b81e0 2024-04-23T18:29:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.072+0000 7f6a00da6640 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68cc036eb0 0x7f68cc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.072+0000 7f6a05928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.072+0000 7f6a05928800 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f6204f1020 0x55f6204f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.072+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f3c30 con 0x55f6204f1020 2024-04-23T18:29:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.072+0000 7f6a00da6640 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68cc036eb0 0x7f68cc039370 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f69f4001b60 tx=0x7f69f4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.072+0000 7f6a01da8640 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f6204f1020 0x55f6204f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.072+0000 7f6a01da8640 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f6204f1020 0x55f6204f34e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6204f1020 2024-04-23T18:29:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 20 realm 2024-04-23T18:29:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4040 con 0x55f6204f1020 2024-04-23T18:29:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6204f1020 2024-04-23T18:29:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4910 con 0x55f6204f1020 2024-04-23T18:29:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6204f1020 2024-04-23T18:29:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f1020 2024-04-23T18:29:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6204f1020 2024-04-23T18:29:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f6204f5a10 0x55f6204f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f8410 con 0x55f6204f5a10 2024-04-23T18:29:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.073+0000 7f6a015a7640 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f6204f5a10 0x55f6204f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.074+0000 7f6a015a7640 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f6204f5a10 0x55f6204f7e00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.074+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f69f80c1070 con 0x55f6204f5a10 2024-04-23T18:29:32.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.074+0000 7f6a05928800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:32.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.074+0000 7f6a05928800 20 searching for the correct realm 2024-04-23T18:29:32.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.074+0000 7f6a05928800 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f6204fa3e0 0x55f6204fc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.074+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204fcf40 con 0x55f6204fa3e0 2024-04-23T18:29:32.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.074+0000 7f6a00da6640 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f6204fa3e0 0x55f6204fc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.074+0000 7f6a00da6640 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f6204fa3e0 0x55f6204fc870 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.075+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.075+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204fcf40 con 0x55f6204f5a10 2024-04-23T18:29:32.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.075+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f80c1070 con 0x55f6204f5a10 2024-04-23T18:29:32.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.075+0000 7f6a015a7640 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f69f80ba070 0x7f69f8076550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.075+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204fcf40 con 0x7f69f80ba070 2024-04-23T18:29:32.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.075+0000 7f6a01da8640 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f69f80ba070 0x7f69f8076550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.075+0000 7f6a01da8640 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f69f80ba070 0x7f69f8076550 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.076+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc00a4a0 con 0x7f69f80ba070 2024-04-23T18:29:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.076+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f1020 2024-04-23T18:29:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.076+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6204f1020 2024-04-23T18:29:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.076+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f1020 2024-04-23T18:29:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.076+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6204f1020 2024-04-23T18:29:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.076+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x7f69f80ba070 2024-04-23T18:29:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.076+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc00a4a0 con 0x7f69f80ba070 2024-04-23T18:29:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.076+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x7f69f80ba070 2024-04-23T18:29:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.077+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f69fc00a4a0 con 0x7f69f80ba070 2024-04-23T18:29:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.077+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f5a10 2024-04-23T18:29:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.077+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f80c1070 con 0x55f6204f5a10 2024-04-23T18:29:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.077+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204fa3e0 2024-04-23T18:29:32.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.077+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.077+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f1020 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.077+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6204f1020 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.077+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x7f69f80ba070 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.078+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc00a4a0 con 0x7f69f80ba070 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.078+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f1020 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.078+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6204f1020 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.078+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f5a10 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.078+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f69f80c1070 con 0x55f6204f5a10 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.078+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204fa3e0 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.079+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.079+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204fa3e0 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.079+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.079+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x7f69f80ba070 2024-04-23T18:29:32.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.079+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc00a4a0 con 0x7f69f80ba070 2024-04-23T18:29:32.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.079+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204fa3e0 2024-04-23T18:29:32.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.079+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.079+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204fa3e0 2024-04-23T18:29:32.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.079+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.080+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f1020 2024-04-23T18:29:32.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.080+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6204f1020 2024-04-23T18:29:32.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.080+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f1020 2024-04-23T18:29:32.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.080+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6204f1020 2024-04-23T18:29:32.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.080+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x7f69f80ba070 2024-04-23T18:29:32.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.080+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc00a4a0 con 0x7f69f80ba070 2024-04-23T18:29:32.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.080+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204fa3e0 2024-04-23T18:29:32.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.080+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.080+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f5a10 2024-04-23T18:29:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.081+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f69f80c1070 con 0x55f6204f5a10 2024-04-23T18:29:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.081+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f1020 2024-04-23T18:29:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.081+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc00a4a0 con 0x55f6204f1020 2024-04-23T18:29:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.081+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x7f69f80ba070 2024-04-23T18:29:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.081+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc00a4a0 con 0x7f69f80ba070 2024-04-23T18:29:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.081+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204fa3e0 2024-04-23T18:29:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.081+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.081+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x7f69f80ba070 2024-04-23T18:29:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.082+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc00a4a0 con 0x7f69f80ba070 2024-04-23T18:29:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.082+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f5a10 2024-04-23T18:29:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.082+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f80c1070 con 0x55f6204f5a10 2024-04-23T18:29:32.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.082+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204fa3e0 2024-04-23T18:29:32.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.082+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.082+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x7f69f80ba070 2024-04-23T18:29:32.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.082+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69fc040040 con 0x7f69f80ba070 2024-04-23T18:29:32.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.082+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f1020 2024-04-23T18:29:32.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f4cb0 con 0x55f6204f5a10 2024-04-23T18:29:32.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f80d3040 con 0x55f6204f5a10 2024-04-23T18:29:32.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:32.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:32.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:32.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:32.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:32.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:32.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f8cd0 con 0x55f6204f1020 2024-04-23T18:29:32.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f8cd0 con 0x55f6204f1020 2024-04-23T18:29:32.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.083+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f8cd0 con 0x7f69f80ba070 2024-04-23T18:29:32.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69fc040040 con 0x7f69f80ba070 2024-04-23T18:29:32.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a05928800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:32.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a05928800 20 zone default found 2024-04-23T18:29:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a05928800 4 Realm: () 2024-04-23T18:29:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a05928800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a05928800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a05928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a05928800 20 zonegroup default 2024-04-23T18:29:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a05928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f9570 con 0x7f69f80ba070 2024-04-23T18:29:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x7f69f80ba070 2024-04-23T18:29:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a05928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a05928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.084+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204f9570 con 0x55f6204fa3e0 2024-04-23T18:29:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.085+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.085+0000 7f6a05928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.085+0000 7f6a05928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.085+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f6204feda0 con 0x55f6204fa3e0 2024-04-23T18:29:32.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.085+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.085+0000 7f6a05928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.085+0000 7f6a05928800 20 started sync module instance, tier type = 2024-04-23T18:29:32.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.085+0000 7f6a05928800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:32.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.085+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f6204fe240 con 0x55f6204f5a10 2024-04-23T18:29:32.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.086+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f80d3040 con 0x55f6204f5a10 2024-04-23T18:29:32.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.086+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94515592420752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f6204ff140 con 0x55f6204f5a10 2024-04-23T18:29:32.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.086+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f6204ffa10 con 0x55f6204f1020 2024-04-23T18:29:32.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.087+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94515592420752] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f80d3040 con 0x55f6204f5a10 2024-04-23T18:29:32.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.087+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.087+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94515592426720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f6204ffe00 con 0x55f6204f1020 2024-04-23T18:29:32.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.087+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f620500800 con 0x55f6204fa3e0 2024-04-23T18:29:32.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.088+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.088+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94515592426720] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.088+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94515592430352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f6205010a0 con 0x55f6204fa3e0 2024-04-23T18:29:32.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.088+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f6204fe6a0 con 0x55f6204f5a10 2024-04-23T18:29:32.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.089+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f80d3040 con 0x55f6204f5a10 2024-04-23T18:29:32.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.089+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94515592435344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f620501f60 con 0x55f6204f5a10 2024-04-23T18:29:32.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.089+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f620502980 con 0x55f6204f1020 2024-04-23T18:29:32.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.089+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94515592430352] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.090+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94515592435344] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f80d3040 con 0x55f6204f5a10 2024-04-23T18:29:32.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.090+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.090+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94515592438896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f620501ab0 con 0x55f6204f1020 2024-04-23T18:29:32.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.091+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f620503220 con 0x7f69f80ba070 2024-04-23T18:29:32.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.091+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x7f69f80ba070 2024-04-23T18:29:32.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.092+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94515592440944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f620503540 con 0x7f69f80ba070 2024-04-23T18:29:32.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.092+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f620503dd0 con 0x7f69f80ba070 2024-04-23T18:29:32.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.092+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94515592438896] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.092+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94515592440944] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x7f69f80ba070 2024-04-23T18:29:32.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.093+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x7f69f80ba070 2024-04-23T18:29:32.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.093+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94515592432624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f620503540 con 0x7f69f80ba070 2024-04-23T18:29:32.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.093+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f620504460 con 0x7f69f80ba070 2024-04-23T18:29:32.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.094+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94515592432624] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x7f69f80ba070 2024-04-23T18:29:32.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.095+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x7f69f80ba070 2024-04-23T18:29:32.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.095+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94515592442000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f620504460 con 0x7f69f80ba070 2024-04-23T18:29:32.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.095+0000 7f6a05928800 20 add_watcher() i=0 2024-04-23T18:29:32.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.095+0000 7f6a05928800 20 add_watcher() i=1 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.095+0000 7f6a05928800 20 add_watcher() i=2 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.095+0000 7f6a05928800 20 add_watcher() i=3 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.095+0000 7f6a05928800 20 add_watcher() i=4 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.095+0000 7f6a05928800 20 add_watcher() i=5 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.095+0000 7f6a05928800 20 add_watcher() i=6 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.097+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94515592442000] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x7f69f80ba070 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.097+0000 7f6a05928800 20 add_watcher() i=7 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.097+0000 7f6a05928800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.097+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f620507600 con 0x55f6204f1020 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.097+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.097+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94515592445872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f620504880 con 0x55f6204f1020 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.098+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94515592445872] v32'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.098+0000 7f68b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.098+0000 7f6a05928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.098+0000 7f6a05928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.098+0000 7f6a05928800 5 note: GC not initialized 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.098+0000 7f68b67e4640 20 reqs_thread_entry: start 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.098+0000 7f6a05928800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.098+0000 7f6a05928800 20 Filter name: none 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.099+0000 7f6827fff640 20 reqs_thread_entry: start 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.099+0000 7f6a05928800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.099+0000 7f6a05928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.099+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f62053ae40 con 0x55f6204f1020 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.099+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.099+0000 7f6a05928800 20 rados_obj.operate() r=0 bl.length=556 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.099+0000 7f6a05928800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.099+0000 7f6a05928800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:32.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.099+0000 7f6a05928800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.099+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f6205415b0 con 0x55f6204f1020 2024-04-23T18:29:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.100+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.100+0000 7f6a05928800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.100+0000 7f6a05928800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.100+0000 7f6a05928800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.100+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94515592695840 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f62053cce0 con 0x55f6204f1020 2024-04-23T18:29:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.101+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify (1) cookie 94515592438896 notify 137438953478 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f69fc018d90 con 0x55f6204f1020 2024-04-23T18:29:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.101+0000 7f68e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94515592438896 notifier 4364 bl.length()=732 2024-04-23T18:29:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.101+0000 7f68e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.101+0000 7f68e4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.101+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(64 notify.4 [notify cookie 94515592695840 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.101+0000 7f68e4ff9640 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f68c4003ea0 con 0x55f6204f1020 2024-04-23T18:29:32.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.101+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.101+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify_complete (2) cookie 94515592695840 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f69fc046450 con 0x55f6204f1020 2024-04-23T18:29:32.106 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:32.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.102+0000 7f68b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.102+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94515592445872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f62053d110 con 0x55f6204f1020 2024-04-23T18:29:32.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.103+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94515592445872] v32'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.103+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94515592420752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f62053c830 con 0x55f6204f5a10 2024-04-23T18:29:32.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.104+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94515592420752] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f80d3040 con 0x55f6204f5a10 2024-04-23T18:29:32.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.104+0000 7f6a05928800 20 remove_watcher() i=0 2024-04-23T18:29:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.104+0000 7f6a05928800 2 removed watcher, disabling cache 2024-04-23T18:29:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.104+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94515592426720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f6204fdd90 con 0x55f6204f1020 2024-04-23T18:29:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.105+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94515592426720] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.105+0000 7f6a05928800 20 remove_watcher() i=1 2024-04-23T18:29:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.105+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94515592430352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f6204fdd90 con 0x55f6204fa3e0 2024-04-23T18:29:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.106+0000 7f6a00da6640 1 -- 172.21.15.119:0/2841666796 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94515592430352] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f4009050 con 0x55f6204fa3e0 2024-04-23T18:29:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.106+0000 7f6a05928800 20 remove_watcher() i=2 2024-04-23T18:29:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.106+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94515592435344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f6204ff4e0 con 0x55f6204f5a10 2024-04-23T18:29:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.107+0000 7f6a015a7640 1 -- 172.21.15.119:0/2841666796 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94515592435344] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f80d3040 con 0x55f6204f5a10 2024-04-23T18:29:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.107+0000 7f6a05928800 20 remove_watcher() i=3 2024-04-23T18:29:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.107+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94515592438896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f6204ff4e0 con 0x55f6204f1020 2024-04-23T18:29:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.108+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94515592438896] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x55f6204f1020 2024-04-23T18:29:32.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.108+0000 7f6a05928800 20 remove_watcher() i=4 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.108+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94515592440944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f6204ff4e0 con 0x7f69f80ba070 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.109+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94515592440944] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x7f69f80ba070 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.109+0000 7f6a05928800 20 remove_watcher() i=5 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.109+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94515592432624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f620502c70 con 0x7f69f80ba070 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.109+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94515592432624] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x7f69f80ba070 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.109+0000 7f6a05928800 20 remove_watcher() i=6 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.109+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94515592442000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f6204ff4e0 con 0x7f69f80ba070 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.110+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94515592442000] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69fc040040 con 0x7f69f80ba070 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.110+0000 7f6a05928800 20 remove_watcher() i=7 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f69f80ba070 msgr2=0x7f69f8076550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f69f80ba070 0x7f69f8076550 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f6204f1020 msgr2=0x55f6204f34e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f6204f1020 0x55f6204f34e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f6204f5a10 msgr2=0x55f6204f7e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f6204f5a10 0x55f6204f7e00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f6204fa3e0 msgr2=0x55f6204fc870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f6204fa3e0 0x55f6204fc870 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68cc036eb0 msgr2=0x7f68cc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68cc036eb0 0x7f68cc039370 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f69f4001b60 tx=0x7f69f4010000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a01da8640 1 -- 172.21.15.119:0/2841666796 reap_dead start 2024-04-23T18:29:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 msgr2=0x55f6204e5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 0x55f6204e5ac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f69f80a8040 tx=0x7f69f8067e60 comp rx=0 tx=0).stop 2024-04-23T18:29:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 shutdown_connections 2024-04-23T18:29:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 --2- 172.21.15.119:0/2841666796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6203b81e0 0x55f6204e5ac0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 >> 172.21.15.119:0/2841666796 conn(0x55f6204d8750 msgr2=0x55f6204d5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 shutdown_connections 2024-04-23T18:29:32.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/2841666796 wait complete. 2024-04-23T18:29:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/684713406 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68d8036e60 msgr2=0x7f68d8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 --2- 172.21.15.119:0/684713406 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68d8036e60 0x7f68d8039320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69f400bf50 tx=0x7f69f400f000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/684713406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6204cf2f0 msgr2=0x55f6204cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 --2- 172.21.15.119:0/684713406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6204cf2f0 0x55f6204cf710 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f69f8052fd0 tx=0x7f69f8067490 comp rx=0 tx=0).stop 2024-04-23T18:29:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/684713406 shutdown_connections 2024-04-23T18:29:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 --2- 172.21.15.119:0/684713406 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68d8036e60 0x7f68d8039320 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 --2- 172.21.15.119:0/684713406 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f6204cf2f0 0x55f6204cf710 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/684713406 >> 172.21.15.119:0/684713406 conn(0x55f6204c3390 msgr2=0x55f6204c3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/684713406 shutdown_connections 2024-04-23T18:29:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.111+0000 7f6a05928800 1 -- 172.21.15.119:0/684713406 wait complete. 2024-04-23T18:29:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f6204be2e0 msgr2=0x55f6204c0730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f6204be2e0 0x55f6204c0730 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f6203bb0a0 msgr2=0x55f6204b7af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f6203bb0a0 0x55f6204b7af0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f6204ba3a0 msgr2=0x55f6204bc790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f6204ba3a0 0x55f6204bc790 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68e8036eb0 msgr2=0x7f68e8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f68e8036eb0 0x7f68e8039370 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f69f4000f60 tx=0x7f69f40012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 msgr2=0x55f6204b0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 --2- 172.21.15.119:0/43640729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f62032b8e0 0x55f6204b0a20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f69f8055040 tx=0x7f69f8002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a01da8640 1 -- 172.21.15.119:0/43640729 reap_dead start 2024-04-23T18:29:32.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 shutdown_connections 2024-04-23T18:29:32.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 >> 172.21.15.119:0/43640729 conn(0x55f6203b2430 msgr2=0x55f6204a33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 shutdown_connections 2024-04-23T18:29:32.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.112+0000 7f6a05928800 1 -- 172.21.15.119:0/43640729 wait complete. 2024-04-23T18:29:32.117 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:32.117 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-23T18:29:32.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-23T18:29:32.118 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-23T18:29:32.160 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:32.160 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:32.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.168+0000 7f730cf28800 1 Processor -- start 2024-04-23T18:29:32.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.168+0000 7f730cf28800 1 -- start start 2024-04-23T18:29:32.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.168+0000 7f730cf28800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5580d427c890 0x5580d427ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.168+0000 7f730cf28800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5580d412e560 con 0x5580d427d1f0 2024-04-23T18:29:32.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.168+0000 7f730cf28800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5580d411fe20 con 0x5580d427c890 2024-04-23T18:29:32.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.169+0000 7f7308c28640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5580d427c890 0x5580d427ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.169+0000 7f7300427640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5580d427d1f0 0x5580d427d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40594/0 (socket says 172.21.15.119:40594) 2024-04-23T18:29:32.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.169+0000 7f7300427640 1 -- 172.21.15.119:0/2031079396 learned_addr learned my addr 172.21.15.119:0/2031079396 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:32.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.169+0000 7f7308c28640 1 -- 172.21.15.119:0/2031079396 >> v1:172.21.15.62:6789/0 conn(0x5580d427d1f0 legacy=0x5580d427d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.169+0000 7f7308c28640 1 -- 172.21.15.119:0/2031079396 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d412de60 con 0x5580d427c890 2024-04-23T18:29:32.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.171+0000 7f7308c28640 1 --2- 172.21.15.119:0/2031079396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d427ccb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f72f800a470 tx=0x7f72f801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f7aa06bd991750 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.171+0000 7f7303fff640 1 -- 172.21.15.119:0/2031079396 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f8057070 con 0x5580d427c890 2024-04-23T18:29:32.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.171+0000 7f7303fff640 1 -- 172.21.15.119:0/2031079396 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f804adc0 con 0x5580d427c890 2024-04-23T18:29:32.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.171+0000 7f7303fff640 1 -- 172.21.15.119:0/2031079396 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f8052590 con 0x5580d427c890 2024-04-23T18:29:32.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.172+0000 7f730cf28800 1 -- 172.21.15.119:0/2031079396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 msgr2=0x5580d427ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.172+0000 7f730cf28800 1 --2- 172.21.15.119:0/2031079396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d427ccb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f72f800a470 tx=0x7f72f801ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:32.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.172+0000 7f730cf28800 1 -- 172.21.15.119:0/2031079396 shutdown_connections 2024-04-23T18:29:32.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.172+0000 7f730cf28800 1 --2- 172.21.15.119:0/2031079396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d427ccb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.172+0000 7f730cf28800 1 -- 172.21.15.119:0/2031079396 >> 172.21.15.119:0/2031079396 conn(0x5580d4278410 msgr2=0x5580d427a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.172+0000 7f730cf28800 1 -- 172.21.15.119:0/2031079396 shutdown_connections 2024-04-23T18:29:32.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.172+0000 7f730cf28800 1 -- 172.21.15.119:0/2031079396 wait complete. 2024-04-23T18:29:32.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.183+0000 7f730cf28800 1 Processor -- start 2024-04-23T18:29:32.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.183+0000 7f730cf28800 1 -- start start 2024-04-23T18:29:32.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.183+0000 7f730cf28800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d43714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.183+0000 7f730cf28800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5580d41c95b0 con 0x5580d427c890 2024-04-23T18:29:32.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.184+0000 7f7308c28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d43714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.184+0000 7f7308c28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d43714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32806/0 (socket says 172.21.15.119:32806) 2024-04-23T18:29:32.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.184+0000 7f7308c28640 1 -- 172.21.15.119:0/2376437495 learned_addr learned my addr 172.21.15.119:0/2376437495 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.184+0000 7f7308c28640 1 -- 172.21.15.119:0/2376437495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d413f860 con 0x5580d427c890 2024-04-23T18:29:32.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.184+0000 7f7308c28640 1 --2- 172.21.15.119:0/2376437495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d43714b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72f8055040 tx=0x7f72f804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4423ca0982bc8fbd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.184+0000 7f71f6e0d640 1 -- 172.21.15.119:0/2376437495 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f8057040 con 0x5580d427c890 2024-04-23T18:29:32.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.184+0000 7f71f6e0d640 1 -- 172.21.15.119:0/2376437495 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f8062070 con 0x5580d427c890 2024-04-23T18:29:32.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.184+0000 7f71f6e0d640 1 -- 172.21.15.119:0/2376437495 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f805d470 con 0x5580d427c890 2024-04-23T18:29:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.185+0000 7f730cf28800 1 -- 172.21.15.119:0/2376437495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 msgr2=0x5580d43714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.185+0000 7f730cf28800 1 --2- 172.21.15.119:0/2376437495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d43714b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72f8055040 tx=0x7f72f804c000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.185+0000 7f730cf28800 1 -- 172.21.15.119:0/2376437495 shutdown_connections 2024-04-23T18:29:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.185+0000 7f730cf28800 1 --2- 172.21.15.119:0/2376437495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d43714b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.185+0000 7f730cf28800 1 -- 172.21.15.119:0/2376437495 >> 172.21.15.119:0/2376437495 conn(0x5580d4278410 msgr2=0x5580d436cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.185+0000 7f730cf28800 1 -- 172.21.15.119:0/2376437495 shutdown_connections 2024-04-23T18:29:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.185+0000 7f730cf28800 1 -- 172.21.15.119:0/2376437495 wait complete. 2024-04-23T18:29:32.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.185+0000 7f730cf28800 1 Processor -- start 2024-04-23T18:29:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.185+0000 7f730cf28800 1 -- start start 2024-04-23T18:29:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.186+0000 7f730cf28800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d4378d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.186+0000 7f730cf28800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5580d427e050 con 0x5580d427c890 2024-04-23T18:29:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.186+0000 7f7308c28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d4378d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.186+0000 7f7308c28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d4378d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32816/0 (socket says 172.21.15.119:32816) 2024-04-23T18:29:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.186+0000 7f7308c28640 1 -- 172.21.15.119:0/1089543338 learned_addr learned my addr 172.21.15.119:0/1089543338 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.186+0000 7f7308c28640 1 -- 172.21.15.119:0/1089543338 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d413deb0 con 0x5580d427c890 2024-04-23T18:29:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.186+0000 7f7308c28640 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d4378d60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f72f801ce60 tx=0x7f72f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.186+0000 7f71f560a640 1 -- 172.21.15.119:0/1089543338 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f806b070 con 0x5580d427c890 2024-04-23T18:29:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.186+0000 7f71f560a640 1 -- 172.21.15.119:0/1089543338 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f805d970 con 0x5580d427c890 2024-04-23T18:29:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.186+0000 7f71f560a640 1 -- 172.21.15.119:0/1089543338 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f8057070 con 0x5580d427c890 2024-04-23T18:29:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.186+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580d43792a0 con 0x5580d427c890 2024-04-23T18:29:32.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.186+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580d43797c0 con 0x5580d427c890 2024-04-23T18:29:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.187+0000 7f71f560a640 1 -- 172.21.15.119:0/1089543338 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f72f805dc90 con 0x5580d427c890 2024-04-23T18:29:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.187+0000 7f71f560a640 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71f0036eb0 0x7f71f0039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.187+0000 7f71f560a640 1 -- 172.21.15.119:0/1089543338 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f72f808e720 con 0x5580d427c890 2024-04-23T18:29:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.187+0000 7f7300427640 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71f0036eb0 0x7f71f0039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.187+0000 7f730cf28800 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5580d427d1f0 0x5580d437fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.187+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d4380310 con 0x5580d427d1f0 2024-04-23T18:29:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.188+0000 7f7309429640 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5580d427d1f0 0x5580d437fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.188+0000 7f7300427640 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71f0036eb0 0x7f71f0039370 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f72f0000f60 tx=0x7f72f00012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.188+0000 7f7309429640 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5580d427d1f0 0x5580d437fdd0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.188+0000 7f7309429640 1 -- 172.21.15.119:0/1089543338 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d427d1f0 2024-04-23T18:29:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.188+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d437d380 con 0x5580d427d1f0 2024-04-23T18:29:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.188+0000 7f7309429640 1 -- 172.21.15.119:0/1089543338 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d427d1f0 2024-04-23T18:29:32.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.188+0000 7f730cf28800 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5580d4382620 0x5580d4384a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.188+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43850b0 con 0x5580d4382620 2024-04-23T18:29:32.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.189+0000 7f7308c28640 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5580d4382620 0x5580d4384a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.189+0000 7f7308c28640 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5580d4382620 0x5580d4384a10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.189+0000 7f7308c28640 1 -- 172.21.15.119:0/1089543338 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72f805a040 con 0x5580d4382620 2024-04-23T18:29:32.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.189+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43815d0 con 0x5580d427d1f0 2024-04-23T18:29:32.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.189+0000 7f7309429640 1 -- 172.21.15.119:0/1089543338 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d427d1f0 2024-04-23T18:29:32.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.189+0000 7f730cf28800 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5580d4386510 0x5580d43889b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.189+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d4389140 con 0x5580d4386510 2024-04-23T18:29:32.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.190+0000 7f7300427640 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5580d4386510 0x5580d43889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.190+0000 7f7300427640 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5580d4386510 0x5580d43889b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.190+0000 7f7300427640 1 -- 172.21.15.119:0/1089543338 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f72f0009050 con 0x5580d4386510 2024-04-23T18:29:32.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.190+0000 7f730cf28800 1 Processor -- start 2024-04-23T18:29:32.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.190+0000 7f730cf28800 1 -- start start 2024-04-23T18:29:32.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.191+0000 7f730cf28800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43975a0 0x5580d43979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.191+0000 7f730cf28800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5580d416fdf0 con 0x5580d43975a0 2024-04-23T18:29:32.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.191+0000 7f7308c28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43975a0 0x5580d43979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.191+0000 7f7308c28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43975a0 0x5580d43979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32828/0 (socket says 172.21.15.119:32828) 2024-04-23T18:29:32.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.191+0000 7f7308c28640 1 -- 172.21.15.119:0/3638537596 learned_addr learned my addr 172.21.15.119:0/3638537596 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.191+0000 7f7308c28640 1 -- 172.21.15.119:0/3638537596 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d4397f00 con 0x5580d43975a0 2024-04-23T18:29:32.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.191+0000 7f7308c28640 1 --2- 172.21.15.119:0/3638537596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43975a0 0x5580d43979c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f72f808cbd0 tx=0x7f72f805bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.191+0000 7f71ee7fc640 1 -- 172.21.15.119:0/3638537596 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f805bd80 con 0x5580d43975a0 2024-04-23T18:29:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.191+0000 7f71ee7fc640 1 -- 172.21.15.119:0/3638537596 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f8009840 con 0x5580d43975a0 2024-04-23T18:29:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.191+0000 7f71ee7fc640 1 -- 172.21.15.119:0/3638537596 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f808ebd0 con 0x5580d43975a0 2024-04-23T18:29:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.191+0000 7f730cf28800 1 -- 172.21.15.119:0/3638537596 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580d4398970 con 0x5580d43975a0 2024-04-23T18:29:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.191+0000 7f730cf28800 1 -- 172.21.15.119:0/3638537596 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580d4398e70 con 0x5580d43975a0 2024-04-23T18:29:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.192+0000 7f71ee7fc640 1 -- 172.21.15.119:0/3638537596 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f72f808b260 con 0x5580d43975a0 2024-04-23T18:29:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.192+0000 7f71ee7fc640 1 --2- 172.21.15.119:0/3638537596 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71e0036e60 0x7f71e0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.192+0000 7f71ee7fc640 1 -- 172.21.15.119:0/3638537596 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f72f8089030 con 0x5580d43975a0 2024-04-23T18:29:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.192+0000 7f7300427640 1 --2- 172.21.15.119:0/3638537596 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71e0036e60 0x7f71e0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.193+0000 7f730cf28800 1 Processor -- start 2024-04-23T18:29:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.193+0000 7f730cf28800 1 -- start start 2024-04-23T18:29:32.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.193+0000 7f7300427640 1 --2- 172.21.15.119:0/3638537596 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71e0036e60 0x7f71e0039320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f72f000bf50 tx=0x7f72f000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.193+0000 7f730cf28800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43a4670 0x5580d43a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.193+0000 7f730cf28800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5580d4371b70 con 0x5580d43a4670 2024-04-23T18:29:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.193+0000 7f7308c28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43a4670 0x5580d43a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.193+0000 7f7308c28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43a4670 0x5580d43a4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32842/0 (socket says 172.21.15.119:32842) 2024-04-23T18:29:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.193+0000 7f7308c28640 1 -- 172.21.15.119:0/2122290272 learned_addr learned my addr 172.21.15.119:0/2122290272 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.193+0000 7f7308c28640 1 -- 172.21.15.119:0/2122290272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d43a5060 con 0x5580d43a4670 2024-04-23T18:29:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.193+0000 7f7308c28640 1 --2- 172.21.15.119:0/2122290272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43a4670 0x5580d43a4a90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f72f8081fb0 tx=0x7f72f806e6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb335ec3e65a7dde server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.193+0000 7f71dffff640 1 -- 172.21.15.119:0/2122290272 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f809ae50 con 0x5580d43a4670 2024-04-23T18:29:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.193+0000 7f71dffff640 1 -- 172.21.15.119:0/2122290272 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f808b550 con 0x5580d43a4670 2024-04-23T18:29:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.193+0000 7f71dffff640 1 -- 172.21.15.119:0/2122290272 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f808dcc0 con 0x5580d43a4670 2024-04-23T18:29:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.194+0000 7f730cf28800 1 -- 172.21.15.119:0/2122290272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43a4670 msgr2=0x5580d43a4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.194+0000 7f730cf28800 1 --2- 172.21.15.119:0/2122290272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43a4670 0x5580d43a4a90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f72f8081fb0 tx=0x7f72f806e6f0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.194+0000 7f730cf28800 1 -- 172.21.15.119:0/2122290272 shutdown_connections 2024-04-23T18:29:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.194+0000 7f730cf28800 1 --2- 172.21.15.119:0/2122290272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43a4670 0x5580d43a4a90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.194+0000 7f730cf28800 1 -- 172.21.15.119:0/2122290272 >> 172.21.15.119:0/2122290272 conn(0x5580d43a09d0 msgr2=0x5580d439ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.194+0000 7f730cf28800 1 -- 172.21.15.119:0/2122290272 shutdown_connections 2024-04-23T18:29:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.194+0000 7f730cf28800 1 -- 172.21.15.119:0/2122290272 wait complete. 2024-04-23T18:29:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.194+0000 7f730cf28800 1 Processor -- start 2024-04-23T18:29:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.194+0000 7f730cf28800 1 -- start start 2024-04-23T18:29:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.194+0000 7f730cf28800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43a4670 0x5580d43aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.194+0000 7f730cf28800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5580d43a5710 con 0x5580d43a4670 2024-04-23T18:29:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.195+0000 7f7308c28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43a4670 0x5580d43aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.195+0000 7f7308c28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43a4670 0x5580d43aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32850/0 (socket says 172.21.15.119:32850) 2024-04-23T18:29:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.195+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 learned_addr learned my addr 172.21.15.119:0/2694520891 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.195+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580d43abfa0 con 0x5580d43a4670 2024-04-23T18:29:32.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.195+0000 7f7308c28640 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43a4670 0x5580d43aba60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f72f80a6040 tx=0x7f72f8070b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.195+0000 7f71de7fc640 1 -- 172.21.15.119:0/2694520891 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f80725a0 con 0x5580d43a4670 2024-04-23T18:29:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.195+0000 7f71de7fc640 1 -- 172.21.15.119:0/2694520891 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f8072740 con 0x5580d43a4670 2024-04-23T18:29:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.195+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580d43abfa0 con 0x5580d43a4670 2024-04-23T18:29:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.195+0000 7f71de7fc640 1 -- 172.21.15.119:0/2694520891 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72f8067700 con 0x5580d43a4670 2024-04-23T18:29:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.195+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580d43abfa0 con 0x5580d43a4670 2024-04-23T18:29:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.196+0000 7f71de7fc640 1 -- 172.21.15.119:0/2694520891 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f72f80ab040 con 0x5580d43a4670 2024-04-23T18:29:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.196+0000 7f71de7fc640 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71d4036eb0 0x7f71d4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.196+0000 7f71de7fc640 1 -- 172.21.15.119:0/2694520891 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f72f80a9020 con 0x5580d43a4670 2024-04-23T18:29:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.196+0000 7f730cf28800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.196+0000 7f7300427640 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71d4036eb0 0x7f71d4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.196+0000 7f730cf28800 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5580d43b7170 0x5580d43b9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.196+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43b9d80 con 0x5580d43b7170 2024-04-23T18:29:32.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f7309429640 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5580d43b7170 0x5580d43b9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f7300427640 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71d4036eb0 0x7f71d4039370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f72f0001b60 tx=0x7f72f0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f7309429640 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5580d43b7170 0x5580d43b9630 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d43b7170 2024-04-23T18:29:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f730cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f730cf28800 20 realm 2024-04-23T18:29:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f730cf28800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43ba190 con 0x5580d43b7170 2024-04-23T18:29:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d43b7170 2024-04-23T18:29:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f730cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f730cf28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f730cf28800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43baa30 con 0x5580d43b7170 2024-04-23T18:29:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.197+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d43b7170 2024-04-23T18:29:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f730cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f730cf28800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43b7170 2024-04-23T18:29:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d43b7170 2024-04-23T18:29:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f730cf28800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f730cf28800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f730cf28800 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5580d43bb900 0x5580d43bdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43be430 con 0x5580d43bb900 2024-04-23T18:29:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f7308c28640 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5580d43bb900 0x5580d43bdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f7308c28640 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5580d43bb900 0x5580d43bdcf0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f72f80a2030 con 0x5580d43bb900 2024-04-23T18:29:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f730cf28800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f730cf28800 20 searching for the correct realm 2024-04-23T18:29:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f730cf28800 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5580d43c04d0 0x5580d43c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.198+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c3060 con 0x5580d43c04d0 2024-04-23T18:29:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.199+0000 7f7300427640 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5580d43c04d0 0x5580d43c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.199+0000 7f7300427640 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5580d43c04d0 0x5580d43c2990 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.199+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.199+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c3060 con 0x5580d43bb900 2024-04-23T18:29:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.199+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f80a2030 con 0x5580d43bb900 2024-04-23T18:29:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.199+0000 7f7308c28640 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f72f80ae040 0x7f72f80b9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.199+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c3060 con 0x7f72f80ae040 2024-04-23T18:29:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.200+0000 7f7309429640 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f72f80ae040 0x7f72f80b9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.200+0000 7f7309429640 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f72f80ae040 0x7f72f80b9480 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.200+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730400a4a0 con 0x7f72f80ae040 2024-04-23T18:29:32.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.200+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43b7170 2024-04-23T18:29:32.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.201+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d43b7170 2024-04-23T18:29:32.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.201+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43b7170 2024-04-23T18:29:32.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.201+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d43b7170 2024-04-23T18:29:32.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.201+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x7f72f80ae040 2024-04-23T18:29:32.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.201+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730400a4a0 con 0x7f72f80ae040 2024-04-23T18:29:32.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.201+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x7f72f80ae040 2024-04-23T18:29:32.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.201+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f730400a4a0 con 0x7f72f80ae040 2024-04-23T18:29:32.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.201+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43bb900 2024-04-23T18:29:32.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.202+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f80a2030 con 0x5580d43bb900 2024-04-23T18:29:32.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.202+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43c04d0 2024-04-23T18:29:32.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.202+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.202+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43b7170 2024-04-23T18:29:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.202+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d43b7170 2024-04-23T18:29:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.202+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x7f72f80ae040 2024-04-23T18:29:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.202+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730400a4a0 con 0x7f72f80ae040 2024-04-23T18:29:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.202+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43b7170 2024-04-23T18:29:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.202+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d43b7170 2024-04-23T18:29:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.203+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43bb900 2024-04-23T18:29:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.203+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f72f80a2030 con 0x5580d43bb900 2024-04-23T18:29:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.203+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43c04d0 2024-04-23T18:29:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.203+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.203+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43c04d0 2024-04-23T18:29:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.203+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.203+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x7f72f80ae040 2024-04-23T18:29:32.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.204+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730400a4a0 con 0x7f72f80ae040 2024-04-23T18:29:32.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.204+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43c04d0 2024-04-23T18:29:32.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.204+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.204+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43c04d0 2024-04-23T18:29:32.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.204+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.204+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43b7170 2024-04-23T18:29:32.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.204+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d43b7170 2024-04-23T18:29:32.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.204+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43b7170 2024-04-23T18:29:32.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.204+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d43b7170 2024-04-23T18:29:32.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.204+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x7f72f80ae040 2024-04-23T18:29:32.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.205+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730400a4a0 con 0x7f72f80ae040 2024-04-23T18:29:32.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.205+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43c04d0 2024-04-23T18:29:32.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.205+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.205+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43bb900 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.205+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f72f80a2030 con 0x5580d43bb900 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.205+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43b7170 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.206+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730400a4a0 con 0x5580d43b7170 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.206+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x7f72f80ae040 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.206+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730400a4a0 con 0x7f72f80ae040 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.206+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43c04d0 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.206+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.206+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x7f72f80ae040 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.207+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730400a4a0 con 0x7f72f80ae040 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.207+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43bb900 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.207+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f80a2030 con 0x5580d43bb900 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.207+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43c04d0 2024-04-23T18:29:32.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.207+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.207+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x7f72f80ae040 2024-04-23T18:29:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.207+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7304040040 con 0x7f72f80ae040 2024-04-23T18:29:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.207+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43b7170 2024-04-23T18:29:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7304040040 con 0x5580d43b7170 2024-04-23T18:29:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5580d43badd0 con 0x5580d43bb900 2024-04-23T18:29:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72f80d5040 con 0x5580d43bb900 2024-04-23T18:29:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:32.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43bedd0 con 0x5580d43b7170 2024-04-23T18:29:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7304040040 con 0x5580d43b7170 2024-04-23T18:29:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43bedd0 con 0x5580d43b7170 2024-04-23T18:29:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7304040040 con 0x5580d43b7170 2024-04-23T18:29:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.208+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43bed80 con 0x7f72f80ae040 2024-04-23T18:29:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7304040040 con 0x7f72f80ae040 2024-04-23T18:29:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 20 zone default found 2024-04-23T18:29:32.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 4 Realm: () 2024-04-23T18:29:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 20 zonegroup default 2024-04-23T18:29:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43bf1c0 con 0x7f72f80ae040 2024-04-23T18:29:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7304040040 con 0x7f72f80ae040 2024-04-23T18:29:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43bf600 con 0x5580d43c04d0 2024-04-23T18:29:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.209+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c4ec0 con 0x5580d43c04d0 2024-04-23T18:29:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.210+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.210+0000 7f730cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.210+0000 7f730cf28800 20 started sync module instance, tier type = 2024-04-23T18:29:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.210+0000 7f730cf28800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.210+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c4360 con 0x5580d43bb900 2024-04-23T18:29:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.211+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f80d5040 con 0x5580d43bb900 2024-04-23T18:29:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.211+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94011804892848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c5260 con 0x5580d43bb900 2024-04-23T18:29:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.211+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c5ab0 con 0x5580d43b7170 2024-04-23T18:29:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.212+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94011804892848] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f80d5040 con 0x5580d43bb900 2024-04-23T18:29:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.212+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x5580d43b7170 2024-04-23T18:29:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.212+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94011804898816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c5ed0 con 0x5580d43b7170 2024-04-23T18:29:32.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.212+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c6720 con 0x5580d43c04d0 2024-04-23T18:29:32.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.213+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.213+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94011804901552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c6fc0 con 0x5580d43c04d0 2024-04-23T18:29:32.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.213+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c7a70 con 0x5580d43bb900 2024-04-23T18:29:32.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.213+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94011804898816] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x5580d43b7170 2024-04-23T18:29:32.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.214+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f80d5040 con 0x5580d43bb900 2024-04-23T18:29:32.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.214+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94011804899872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c8310 con 0x5580d43bb900 2024-04-23T18:29:32.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.214+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c8cd0 con 0x5580d43b7170 2024-04-23T18:29:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.214+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94011804901552] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.215+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x5580d43b7170 2024-04-23T18:29:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.215+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94011804904208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c8cd0 con 0x5580d43b7170 2024-04-23T18:29:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.215+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c96d0 con 0x7f72f80ae040 2024-04-23T18:29:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.215+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94011804899872] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f80d5040 con 0x5580d43bb900 2024-04-23T18:29:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.216+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x7f72f80ae040 2024-04-23T18:29:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.216+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94011804909152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c9690 con 0x7f72f80ae040 2024-04-23T18:29:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.216+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43ca0e0 con 0x7f72f80ae040 2024-04-23T18:29:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.216+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94011804904208] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x5580d43b7170 2024-04-23T18:29:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.218+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94011804909152] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x7f72f80ae040 2024-04-23T18:29:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.218+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x7f72f80ae040 2024-04-23T18:29:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.218+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94011804911648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c9c30 con 0x7f72f80ae040 2024-04-23T18:29:32.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.218+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43ca520 con 0x7f72f80ae040 2024-04-23T18:29:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.219+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94011804911648] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x7f72f80ae040 2024-04-23T18:29:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.219+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x7f72f80ae040 2024-04-23T18:29:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.219+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94011804914144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43ca4e0 con 0x7f72f80ae040 2024-04-23T18:29:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.219+0000 7f730cf28800 20 add_watcher() i=0 2024-04-23T18:29:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.219+0000 7f730cf28800 20 add_watcher() i=1 2024-04-23T18:29:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.219+0000 7f730cf28800 20 add_watcher() i=2 2024-04-23T18:29:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.219+0000 7f730cf28800 20 add_watcher() i=3 2024-04-23T18:29:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.219+0000 7f730cf28800 20 add_watcher() i=4 2024-04-23T18:29:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.219+0000 7f730cf28800 20 add_watcher() i=5 2024-04-23T18:29:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.219+0000 7f730cf28800 20 add_watcher() i=6 2024-04-23T18:29:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.220+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94011804914144] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x7f72f80ae040 2024-04-23T18:29:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.220+0000 7f730cf28800 20 add_watcher() i=7 2024-04-23T18:29:32.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.220+0000 7f730cf28800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.220+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d43cd940 con 0x5580d43b7170 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.220+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7304040040 con 0x5580d43b7170 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.220+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94011804917072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43cae00 con 0x5580d43b7170 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.221+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94011804917072] v32'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7304040040 con 0x5580d43b7170 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.222+0000 7f71befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.222+0000 7f730cf28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.222+0000 7f730cf28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.222+0000 7f730cf28800 5 note: GC not initialized 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.222+0000 7f71bdfe3640 20 reqs_thread_entry: start 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.222+0000 7f730cf28800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.222+0000 7f730cf28800 20 Filter name: none 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.222+0000 7f712f7fe640 20 reqs_thread_entry: start 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.222+0000 7f730cf28800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.222+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5580d4400b30 con 0x5580d43b7170 2024-04-23T18:29:32.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.223+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f7304040040 con 0x5580d43b7170 2024-04-23T18:29:32.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.223+0000 7f730cf28800 20 rados_obj.operate() r=0 bl.length=556 2024-04-23T18:29:32.229 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:32.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.224+0000 7f71befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.224+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94011804917072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43ff5c0 con 0x5580d43b7170 2024-04-23T18:29:32.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.225+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94011804917072] v32'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7304040040 con 0x5580d43b7170 2024-04-23T18:29:32.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.225+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94011804892848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c9d50 con 0x5580d43bb900 2024-04-23T18:29:32.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.226+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94011804892848] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f80d5040 con 0x5580d43bb900 2024-04-23T18:29:32.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.226+0000 7f730cf28800 20 remove_watcher() i=0 2024-04-23T18:29:32.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.226+0000 7f730cf28800 2 removed watcher, disabling cache 2024-04-23T18:29:32.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.226+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94011804898816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c9d50 con 0x5580d43b7170 2024-04-23T18:29:32.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.227+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94011804898816] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x5580d43b7170 2024-04-23T18:29:32.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.227+0000 7f730cf28800 20 remove_watcher() i=1 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.227+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94011804901552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c5600 con 0x5580d43c04d0 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.228+0000 7f7300427640 1 -- 172.21.15.119:0/2694520891 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94011804901552] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f0009050 con 0x5580d43c04d0 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.228+0000 7f730cf28800 20 remove_watcher() i=2 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.228+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94011804899872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c9d50 con 0x5580d43bb900 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.229+0000 7f7308c28640 1 -- 172.21.15.119:0/2694520891 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94011804899872] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72f80d5040 con 0x5580d43bb900 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.229+0000 7f730cf28800 20 remove_watcher() i=3 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.229+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94011804904208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c9d50 con 0x5580d43b7170 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.230+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94011804904208] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x5580d43b7170 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.230+0000 7f730cf28800 20 remove_watcher() i=4 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.230+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94011804909152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c9d50 con 0x7f72f80ae040 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.231+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94011804909152] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x7f72f80ae040 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.231+0000 7f730cf28800 20 remove_watcher() i=5 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.231+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94011804911648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c9d50 con 0x7f72f80ae040 2024-04-23T18:29:32.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.232+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94011804911648] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x7f72f80ae040 2024-04-23T18:29:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.232+0000 7f730cf28800 20 remove_watcher() i=6 2024-04-23T18:29:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.232+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94011804914144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5580d43c9d50 con 0x7f72f80ae040 2024-04-23T18:29:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94011804914144] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7304040040 con 0x7f72f80ae040 2024-04-23T18:29:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 20 remove_watcher() i=7 2024-04-23T18:29:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f72f80ae040 msgr2=0x7f72f80b9480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f72f80ae040 0x7f72f80b9480 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5580d43b7170 msgr2=0x5580d43b9630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5580d43b7170 0x5580d43b9630 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5580d43bb900 msgr2=0x5580d43bdcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5580d43bb900 0x5580d43bdcf0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5580d43c04d0 msgr2=0x5580d43c2990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5580d43c04d0 0x5580d43c2990 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71d4036eb0 msgr2=0x7f71d4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71d4036eb0 0x7f71d4039370 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f72f0001b60 tx=0x7f72f0010000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43a4670 msgr2=0x5580d43aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 --2- 172.21.15.119:0/2694520891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43a4670 0x5580d43aba60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f72f80a6040 tx=0x7f72f8070b90 comp rx=0 tx=0).stop 2024-04-23T18:29:32.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 reap_dead start 2024-04-23T18:29:32.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f7309429640 1 -- 172.21.15.119:0/2694520891 reap_dead start 2024-04-23T18:29:32.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 shutdown_connections 2024-04-23T18:29:32.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 >> 172.21.15.119:0/2694520891 conn(0x5580d43a09d0 msgr2=0x5580d439e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 shutdown_connections 2024-04-23T18:29:32.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.233+0000 7f730cf28800 1 -- 172.21.15.119:0/2694520891 wait complete. 2024-04-23T18:29:32.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/3638537596 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71e0036e60 msgr2=0x7f71e0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 --2- 172.21.15.119:0/3638537596 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71e0036e60 0x7f71e0039320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f72f000bf50 tx=0x7f72f000f000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/3638537596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43975a0 msgr2=0x5580d43979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 --2- 172.21.15.119:0/3638537596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43975a0 0x5580d43979c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f72f808cbd0 tx=0x7f72f805bc50 comp rx=0 tx=0).stop 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/3638537596 shutdown_connections 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 --2- 172.21.15.119:0/3638537596 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71e0036e60 0x7f71e0039320 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 --2- 172.21.15.119:0/3638537596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d43975a0 0x5580d43979c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/3638537596 >> 172.21.15.119:0/3638537596 conn(0x5580d438b640 msgr2=0x5580d438ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/3638537596 shutdown_connections 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/3638537596 wait complete. 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5580d4386510 msgr2=0x5580d43889b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5580d4386510 0x5580d43889b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5580d427d1f0 msgr2=0x5580d437fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5580d427d1f0 0x5580d437fdd0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5580d4382620 msgr2=0x5580d4384a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5580d4382620 0x5580d4384a10 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71f0036eb0 msgr2=0x7f71f0039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f71f0036eb0 0x7f71f0039370 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f72f0000f60 tx=0x7f72f00012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 msgr2=0x5580d4378d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 --2- 172.21.15.119:0/1089543338 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5580d427c890 0x5580d4378d60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f72f801ce60 tx=0x7f72f8002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f7309429640 1 -- 172.21.15.119:0/1089543338 reap_dead start 2024-04-23T18:29:32.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 shutdown_connections 2024-04-23T18:29:32.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 >> 172.21.15.119:0/1089543338 conn(0x5580d4278410 msgr2=0x5580d436fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 shutdown_connections 2024-04-23T18:29:32.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.234+0000 7f730cf28800 1 -- 172.21.15.119:0/1089543338 wait complete. 2024-04-23T18:29:32.240 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:32.240 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-23T18:29:32.241 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-23T18:29:32.241 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-23T18:29:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:32.318 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:32.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.326+0000 7fb163462800 1 Processor -- start 2024-04-23T18:29:32.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.326+0000 7fb163462800 1 -- start start 2024-04-23T18:29:32.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.326+0000 7fb163462800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f9bd4f6e50 0x55f9bd4f7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.326+0000 7fb163462800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f9bd3a8560 con 0x55f9bd4f80b0 2024-04-23T18:29:32.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.326+0000 7fb163462800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55f9bd399e20 con 0x55f9bd4f6e50 2024-04-23T18:29:32.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.326+0000 7fb160f61640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f9bd4f6e50 0x55f9bd4f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.326+0000 7fb15bfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55f9bd4f80b0 0x55f9bd4f8530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40608/0 (socket says 172.21.15.119:40608) 2024-04-23T18:29:32.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.326+0000 7fb15bfff640 1 -- 172.21.15.119:0/4219615299 learned_addr learned my addr 172.21.15.119:0/4219615299 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:32.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.327+0000 7fb160f61640 1 -- 172.21.15.119:0/4219615299 >> v1:172.21.15.62:6789/0 conn(0x55f9bd4f80b0 legacy=0x55f9bd4f8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.327+0000 7fb160f61640 1 -- 172.21.15.119:0/4219615299 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9bd3a7e60 con 0x55f9bd4f6e50 2024-04-23T18:29:32.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.328+0000 7fb160f61640 1 --2- 172.21.15.119:0/4219615299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd4f7270 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb15400a470 tx=0x7fb15401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301e749dfe7b4454 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.329+0000 7fb15b7fe640 1 -- 172.21.15.119:0/4219615299 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb154057070 con 0x55f9bd4f6e50 2024-04-23T18:29:32.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.329+0000 7fb15b7fe640 1 -- 172.21.15.119:0/4219615299 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb154052570 con 0x55f9bd4f6e50 2024-04-23T18:29:32.321 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.329+0000 7fb15b7fe640 1 -- 172.21.15.119:0/4219615299 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb154052870 con 0x55f9bd4f6e50 2024-04-23T18:29:32.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.329+0000 7fb163462800 1 -- 172.21.15.119:0/4219615299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 msgr2=0x55f9bd4f7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.329+0000 7fb163462800 1 --2- 172.21.15.119:0/4219615299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd4f7270 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb15400a470 tx=0x7fb15401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:32.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.329+0000 7fb163462800 1 -- 172.21.15.119:0/4219615299 shutdown_connections 2024-04-23T18:29:32.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.329+0000 7fb163462800 1 --2- 172.21.15.119:0/4219615299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd4f7270 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.322 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.329+0000 7fb163462800 1 -- 172.21.15.119:0/4219615299 >> 172.21.15.119:0/4219615299 conn(0x55f9bd4f2410 msgr2=0x55f9bd4f4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.329+0000 7fb163462800 1 -- 172.21.15.119:0/4219615299 shutdown_connections 2024-04-23T18:29:32.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.329+0000 7fb163462800 1 -- 172.21.15.119:0/4219615299 wait complete. 2024-04-23T18:29:32.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.341+0000 7fb163462800 1 Processor -- start 2024-04-23T18:29:32.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.341+0000 7fb163462800 1 -- start start 2024-04-23T18:29:32.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.341+0000 7fb163462800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd5e8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.341+0000 7fb163462800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f9bd4435b0 con 0x55f9bd4f6e50 2024-04-23T18:29:32.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.341+0000 7fb160f61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd5e8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.341+0000 7fb160f61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd5e8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32862/0 (socket says 172.21.15.119:32862) 2024-04-23T18:29:32.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.341+0000 7fb160f61640 1 -- 172.21.15.119:0/3162647713 learned_addr learned my addr 172.21.15.119:0/3162647713 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.342+0000 7fb160f61640 1 -- 172.21.15.119:0/3162647713 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9bd3b9860 con 0x55f9bd4f6e50 2024-04-23T18:29:32.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.342+0000 7fb160f61640 1 --2- 172.21.15.119:0/3162647713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd5e8520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb154055040 tx=0x7fb15404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15dbf61be0b3b74 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.342+0000 7fb04ee05640 1 -- 172.21.15.119:0/3162647713 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb154057070 con 0x55f9bd4f6e50 2024-04-23T18:29:32.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.342+0000 7fb04ee05640 1 -- 172.21.15.119:0/3162647713 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb154063070 con 0x55f9bd4f6e50 2024-04-23T18:29:32.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.342+0000 7fb04ee05640 1 -- 172.21.15.119:0/3162647713 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb154052720 con 0x55f9bd4f6e50 2024-04-23T18:29:32.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb163462800 1 -- 172.21.15.119:0/3162647713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 msgr2=0x55f9bd5e8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb163462800 1 --2- 172.21.15.119:0/3162647713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd5e8520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb154055040 tx=0x7fb15404c000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb163462800 1 -- 172.21.15.119:0/3162647713 shutdown_connections 2024-04-23T18:29:32.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb163462800 1 --2- 172.21.15.119:0/3162647713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd5e8520 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb163462800 1 -- 172.21.15.119:0/3162647713 >> 172.21.15.119:0/3162647713 conn(0x55f9bd4f2410 msgr2=0x55f9bd5e3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb163462800 1 -- 172.21.15.119:0/3162647713 shutdown_connections 2024-04-23T18:29:32.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb163462800 1 -- 172.21.15.119:0/3162647713 wait complete. 2024-04-23T18:29:32.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb163462800 1 Processor -- start 2024-04-23T18:29:32.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb163462800 1 -- start start 2024-04-23T18:29:32.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb163462800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd5f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb163462800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f9bd500520 con 0x55f9bd4f6e50 2024-04-23T18:29:32.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb160f61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd5f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb160f61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd5f3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32868/0 (socket says 172.21.15.119:32868) 2024-04-23T18:29:32.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.343+0000 7fb160f61640 1 -- 172.21.15.119:0/220085757 learned_addr learned my addr 172.21.15.119:0/220085757 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.344+0000 7fb160f61640 1 -- 172.21.15.119:0/220085757 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9bd3b7eb0 con 0x55f9bd4f6e50 2024-04-23T18:29:32.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.344+0000 7fb160f61640 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd5f3a00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb154055040 tx=0x7fb154002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.344+0000 7fb04d602640 1 -- 172.21.15.119:0/220085757 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb154052cd0 con 0x55f9bd4f6e50 2024-04-23T18:29:32.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.344+0000 7fb04d602640 1 -- 172.21.15.119:0/220085757 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15406c070 con 0x55f9bd4f6e50 2024-04-23T18:29:32.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.344+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9bd46b7d0 con 0x55f9bd4f6e50 2024-04-23T18:29:32.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.344+0000 7fb04d602640 1 -- 172.21.15.119:0/220085757 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb15405e480 con 0x55f9bd4f6e50 2024-04-23T18:29:32.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.344+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9bd5f4150 con 0x55f9bd4f6e50 2024-04-23T18:29:32.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.345+0000 7fb04d602640 1 -- 172.21.15.119:0/220085757 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb15405e620 con 0x55f9bd4f6e50 2024-04-23T18:29:32.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.345+0000 7fb04d602640 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb048036eb0 0x7fb048039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.345+0000 7fb04d602640 1 -- 172.21.15.119:0/220085757 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb15408ef50 con 0x55f9bd4f6e50 2024-04-23T18:29:32.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.345+0000 7fb15bfff640 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb048036eb0 0x7fb048039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.345+0000 7fb163462800 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9bd4f80b0 0x55f9bd5f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.345+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd5f8450 con 0x55f9bd4f80b0 2024-04-23T18:29:32.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.345+0000 7fb161762640 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9bd4f80b0 0x55f9bd5f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.345+0000 7fb15bfff640 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb048036eb0 0x7fb048039370 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb14c000f60 tx=0x7fb14c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.346+0000 7fb161762640 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9bd4f80b0 0x55f9bd5f7f10 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.346+0000 7fb161762640 1 -- 172.21.15.119:0/220085757 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd4f80b0 2024-04-23T18:29:32.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.346+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd5f54c0 con 0x55f9bd4f80b0 2024-04-23T18:29:32.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.346+0000 7fb161762640 1 -- 172.21.15.119:0/220085757 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd4f80b0 2024-04-23T18:29:32.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.346+0000 7fb163462800 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9bd5fa740 0x55f9bd5fcb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.346+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd5fd1d0 con 0x55f9bd5fa740 2024-04-23T18:29:32.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.346+0000 7fb160f61640 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9bd5fa740 0x55f9bd5fcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.347+0000 7fb160f61640 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9bd5fa740 0x55f9bd5fcb30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.347+0000 7fb160f61640 1 -- 172.21.15.119:0/220085757 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb1540717f0 con 0x55f9bd5fa740 2024-04-23T18:29:32.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.347+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd5f96f0 con 0x55f9bd4f80b0 2024-04-23T18:29:32.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.347+0000 7fb161762640 1 -- 172.21.15.119:0/220085757 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd4f80b0 2024-04-23T18:29:32.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.347+0000 7fb163462800 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f9bd5fe680 0x55f9bd600ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.347+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd601230 con 0x55f9bd5fe680 2024-04-23T18:29:32.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.347+0000 7fb15bfff640 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f9bd5fe680 0x55f9bd600ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.348+0000 7fb15bfff640 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f9bd5fe680 0x55f9bd600ad0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.348+0000 7fb15bfff640 1 -- 172.21.15.119:0/220085757 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd5fe680 2024-04-23T18:29:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.348+0000 7fb163462800 1 Processor -- start 2024-04-23T18:29:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.348+0000 7fb163462800 1 -- start start 2024-04-23T18:29:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.348+0000 7fb163462800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd60f620 0x55f9bd60fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.348+0000 7fb163462800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f9bd3e9df0 con 0x55f9bd60f620 2024-04-23T18:29:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.349+0000 7fb160f61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd60f620 0x55f9bd60fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.349+0000 7fb160f61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd60f620 0x55f9bd60fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32874/0 (socket says 172.21.15.119:32874) 2024-04-23T18:29:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.349+0000 7fb160f61640 1 -- 172.21.15.119:0/1658865774 learned_addr learned my addr 172.21.15.119:0/1658865774 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.349+0000 7fb160f61640 1 -- 172.21.15.119:0/1658865774 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9bd60ff80 con 0x55f9bd60f620 2024-04-23T18:29:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.349+0000 7fb160f61640 1 --2- 172.21.15.119:0/1658865774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd60f620 0x55f9bd60fa40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb15400a360 tx=0x7fb154009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.349+0000 7fb0467fc640 1 -- 172.21.15.119:0/1658865774 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb154066a20 con 0x55f9bd60f620 2024-04-23T18:29:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.349+0000 7fb0467fc640 1 -- 172.21.15.119:0/1658865774 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb154058040 con 0x55f9bd60f620 2024-04-23T18:29:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.349+0000 7fb163462800 1 -- 172.21.15.119:0/1658865774 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9bd6109f0 con 0x55f9bd60f620 2024-04-23T18:29:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.349+0000 7fb0467fc640 1 -- 172.21.15.119:0/1658865774 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb15407a3f0 con 0x55f9bd60f620 2024-04-23T18:29:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.349+0000 7fb163462800 1 -- 172.21.15.119:0/1658865774 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9bd610ef0 con 0x55f9bd60f620 2024-04-23T18:29:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.350+0000 7fb0467fc640 1 -- 172.21.15.119:0/1658865774 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb15409a020 con 0x55f9bd60f620 2024-04-23T18:29:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.350+0000 7fb0467fc640 1 --2- 172.21.15.119:0/1658865774 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb038036eb0 0x7fb038039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.350+0000 7fb0467fc640 1 -- 172.21.15.119:0/1658865774 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb154098020 con 0x55f9bd60f620 2024-04-23T18:29:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.350+0000 7fb15bfff640 1 --2- 172.21.15.119:0/1658865774 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb038036eb0 0x7fb038039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.350+0000 7fb163462800 1 Processor -- start 2024-04-23T18:29:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.350+0000 7fb163462800 1 -- start start 2024-04-23T18:29:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.350+0000 7fb15bfff640 1 --2- 172.21.15.119:0/1658865774 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb038036eb0 0x7fb038039370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00bf50 tx=0x7fb14c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.351+0000 7fb163462800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 0x55f9bd61cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.351+0000 7fb163462800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f9bd5e8be0 con 0x55f9bd61c740 2024-04-23T18:29:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.351+0000 7fb160f61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 0x55f9bd61cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.351+0000 7fb160f61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 0x55f9bd61cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32882/0 (socket says 172.21.15.119:32882) 2024-04-23T18:29:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.351+0000 7fb160f61640 1 -- 172.21.15.119:0/2331157825 learned_addr learned my addr 172.21.15.119:0/2331157825 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.351+0000 7fb160f61640 1 -- 172.21.15.119:0/2331157825 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9bd61d130 con 0x55f9bd61c740 2024-04-23T18:29:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.351+0000 7fb160f61640 1 --2- 172.21.15.119:0/2331157825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 0x55f9bd61cb60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb15409c560 tx=0x7fb154067db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e98267c73ae9f96 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.351+0000 7fb037fff640 1 -- 172.21.15.119:0/2331157825 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb15408aac0 con 0x55f9bd61c740 2024-04-23T18:29:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.351+0000 7fb037fff640 1 -- 172.21.15.119:0/2331157825 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15408ad80 con 0x55f9bd61c740 2024-04-23T18:29:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.351+0000 7fb037fff640 1 -- 172.21.15.119:0/2331157825 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb15408d610 con 0x55f9bd61c740 2024-04-23T18:29:32.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.352+0000 7fb163462800 1 -- 172.21.15.119:0/2331157825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 msgr2=0x55f9bd61cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.352+0000 7fb163462800 1 --2- 172.21.15.119:0/2331157825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 0x55f9bd61cb60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb15409c560 tx=0x7fb154067db0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.352+0000 7fb163462800 1 -- 172.21.15.119:0/2331157825 shutdown_connections 2024-04-23T18:29:32.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.352+0000 7fb163462800 1 --2- 172.21.15.119:0/2331157825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 0x55f9bd61cb60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.352+0000 7fb163462800 1 -- 172.21.15.119:0/2331157825 >> 172.21.15.119:0/2331157825 conn(0x55f9bd618aa0 msgr2=0x55f9bd616b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.352+0000 7fb163462800 1 -- 172.21.15.119:0/2331157825 shutdown_connections 2024-04-23T18:29:32.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.352+0000 7fb163462800 1 -- 172.21.15.119:0/2331157825 wait complete. 2024-04-23T18:29:32.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.352+0000 7fb163462800 1 Processor -- start 2024-04-23T18:29:32.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.352+0000 7fb163462800 1 -- start start 2024-04-23T18:29:32.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.352+0000 7fb163462800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 0x55f9bd5f1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.352+0000 7fb163462800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f9bd61d7e0 con 0x55f9bd61c740 2024-04-23T18:29:32.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.353+0000 7fb160f61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 0x55f9bd5f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.353+0000 7fb160f61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 0x55f9bd5f1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32884/0 (socket says 172.21.15.119:32884) 2024-04-23T18:29:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.353+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 learned_addr learned my addr 172.21.15.119:0/1960579464 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.353+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9bd5efa00 con 0x55f9bd61c740 2024-04-23T18:29:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.353+0000 7fb160f61640 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 0x55f9bd5f1310 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb15409c5d0 tx=0x7fb154090f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.353+0000 7fb0367fc640 1 -- 172.21.15.119:0/1960579464 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1540c0070 con 0x55f9bd61c740 2024-04-23T18:29:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.353+0000 7fb0367fc640 1 -- 172.21.15.119:0/1960579464 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15407a590 con 0x55f9bd61c740 2024-04-23T18:29:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.353+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9bd5efa00 con 0x55f9bd61c740 2024-04-23T18:29:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.353+0000 7fb0367fc640 1 -- 172.21.15.119:0/1960579464 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb15407a740 con 0x55f9bd61c740 2024-04-23T18:29:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.353+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9bd5efa00 con 0x55f9bd61c740 2024-04-23T18:29:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.354+0000 7fb0367fc640 1 -- 172.21.15.119:0/1960579464 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb1540c3070 con 0x55f9bd61c740 2024-04-23T18:29:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.354+0000 7fb0367fc640 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb02c036e60 0x7fb02c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.354+0000 7fb163462800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.354+0000 7fb0367fc640 1 -- 172.21.15.119:0/1960579464 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb1540b8070 con 0x55f9bd61c740 2024-04-23T18:29:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.354+0000 7fb15bfff640 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb02c036e60 0x7fb02c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.354+0000 7fb163462800 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9bd631330 0x55f9bd633780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.354+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd633ed0 con 0x55f9bd631330 2024-04-23T18:29:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.354+0000 7fb161762640 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9bd631330 0x55f9bd633780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb15bfff640 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb02c036e60 0x7fb02c039320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb14c001b60 tx=0x7fb14c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb161762640 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9bd631330 0x55f9bd633780 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd631330 2024-04-23T18:29:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb163462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb163462800 20 realm 2024-04-23T18:29:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb163462800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd6342e0 con 0x55f9bd631330 2024-04-23T18:29:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd631330 2024-04-23T18:29:32.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb163462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb163462800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:32.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb163462800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634b80 con 0x55f9bd631330 2024-04-23T18:29:32.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd631330 2024-04-23T18:29:32.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb163462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb163462800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.355+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd631330 2024-04-23T18:29:32.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.356+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd631330 2024-04-23T18:29:32.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.356+0000 7fb163462800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.356+0000 7fb163462800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.356+0000 7fb163462800 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9bd635c80 0x55f9bd638070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.356+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd6385b0 con 0x55f9bd635c80 2024-04-23T18:29:32.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.356+0000 7fb160f61640 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9bd635c80 0x55f9bd638070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.356+0000 7fb160f61640 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9bd635c80 0x55f9bd638070 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.356+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb1540c2030 con 0x55f9bd635c80 2024-04-23T18:29:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.356+0000 7fb163462800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.356+0000 7fb163462800 20 searching for the correct realm 2024-04-23T18:29:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.356+0000 7fb163462800 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9bd63a630 0x55f9bd63caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.356+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd63d1c0 con 0x55f9bd63a630 2024-04-23T18:29:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.356+0000 7fb15bfff640 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9bd63a630 0x55f9bd63caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.357+0000 7fb15bfff640 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9bd63a630 0x55f9bd63caf0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.357+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.357+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd63d1c0 con 0x55f9bd635c80 2024-04-23T18:29:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.357+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1540c2030 con 0x55f9bd635c80 2024-04-23T18:29:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.357+0000 7fb160f61640 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb1540c5060 0x7fb15404c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.357+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd63d1c0 con 0x7fb1540c5060 2024-04-23T18:29:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.358+0000 7fb161762640 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb1540c5060 0x7fb15404c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.358+0000 7fb161762640 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb1540c5060 0x7fb15404c0e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.358+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c00a4a0 con 0x7fb1540c5060 2024-04-23T18:29:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.358+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd631330 2024-04-23T18:29:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.359+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd631330 2024-04-23T18:29:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.359+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd631330 2024-04-23T18:29:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.359+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd631330 2024-04-23T18:29:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.359+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x7fb1540c5060 2024-04-23T18:29:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.359+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c00a4a0 con 0x7fb1540c5060 2024-04-23T18:29:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.359+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x7fb1540c5060 2024-04-23T18:29:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.359+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb15c00a4a0 con 0x7fb1540c5060 2024-04-23T18:29:32.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.359+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd635c80 2024-04-23T18:29:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.360+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1540c2030 con 0x55f9bd635c80 2024-04-23T18:29:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.360+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd63a630 2024-04-23T18:29:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.360+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.360+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd631330 2024-04-23T18:29:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.360+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd631330 2024-04-23T18:29:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.360+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x7fb1540c5060 2024-04-23T18:29:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.360+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c00a4a0 con 0x7fb1540c5060 2024-04-23T18:29:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.360+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd631330 2024-04-23T18:29:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.361+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd631330 2024-04-23T18:29:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.361+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd635c80 2024-04-23T18:29:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.361+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb1540c2030 con 0x55f9bd635c80 2024-04-23T18:29:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.361+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd63a630 2024-04-23T18:29:32.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.361+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.361+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd63a630 2024-04-23T18:29:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.361+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.361+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x7fb1540c5060 2024-04-23T18:29:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.362+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c00a4a0 con 0x7fb1540c5060 2024-04-23T18:29:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.362+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd63a630 2024-04-23T18:29:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.362+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.362+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd63a630 2024-04-23T18:29:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.362+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.362+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd631330 2024-04-23T18:29:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.362+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd631330 2024-04-23T18:29:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.362+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd631330 2024-04-23T18:29:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.362+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd631330 2024-04-23T18:29:32.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.362+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x7fb1540c5060 2024-04-23T18:29:32.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.363+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c00a4a0 con 0x7fb1540c5060 2024-04-23T18:29:32.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.363+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd63a630 2024-04-23T18:29:32.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.363+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.363+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd635c80 2024-04-23T18:29:32.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.363+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb1540c2030 con 0x55f9bd635c80 2024-04-23T18:29:32.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.363+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd631330 2024-04-23T18:29:32.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.364+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c00a4a0 con 0x55f9bd631330 2024-04-23T18:29:32.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.364+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x7fb1540c5060 2024-04-23T18:29:32.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.364+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c00a4a0 con 0x7fb1540c5060 2024-04-23T18:29:32.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.364+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd63a630 2024-04-23T18:29:32.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.364+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.364+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x7fb1540c5060 2024-04-23T18:29:32.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.365+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c00a4a0 con 0x7fb1540c5060 2024-04-23T18:29:32.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.365+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd635c80 2024-04-23T18:29:32.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.365+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1540c2030 con 0x55f9bd635c80 2024-04-23T18:29:32.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.365+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd63a630 2024-04-23T18:29:32.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.365+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.365+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x7fb1540c5060 2024-04-23T18:29:32.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.365+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb15c040040 con 0x7fb1540c5060 2024-04-23T18:29:32.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.365+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd631330 2024-04-23T18:29:32.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb15c040040 con 0x55f9bd631330 2024-04-23T18:29:32.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd634f20 con 0x55f9bd635c80 2024-04-23T18:29:32.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1540dc040 con 0x55f9bd635c80 2024-04-23T18:29:32.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:32.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:32.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:32.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:32.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:32.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:32.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd638f30 con 0x55f9bd631330 2024-04-23T18:29:32.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x55f9bd631330 2024-04-23T18:29:32.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd638f30 con 0x55f9bd631330 2024-04-23T18:29:32.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb15c040040 con 0x55f9bd631330 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.366+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd638f30 con 0x7fb1540c5060 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb15c040040 con 0x7fb1540c5060 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb163462800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb163462800 20 zone default found 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb163462800 4 Realm: () 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb163462800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb163462800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb163462800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb163462800 20 zonegroup default 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb163462800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd639320 con 0x7fb1540c5060 2024-04-23T18:29:32.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x7fb1540c5060 2024-04-23T18:29:32.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb163462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb163462800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.367+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd639760 con 0x55f9bd63a630 2024-04-23T18:29:32.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.368+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.368+0000 7fb163462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.368+0000 7fb163462800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.368+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd63f020 con 0x55f9bd63a630 2024-04-23T18:29:32.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.368+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.368+0000 7fb163462800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.368+0000 7fb163462800 20 started sync module instance, tier type = 2024-04-23T18:29:32.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.368+0000 7fb163462800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:32.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.368+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd63e4c0 con 0x55f9bd635c80 2024-04-23T18:29:32.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.369+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1540dc040 con 0x55f9bd635c80 2024-04-23T18:29:32.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.369+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94531112659120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd63e4c0 con 0x55f9bd635c80 2024-04-23T18:29:32.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.369+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd63f870 con 0x55f9bd631330 2024-04-23T18:29:32.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.370+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94531112659120] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1540dc040 con 0x55f9bd635c80 2024-04-23T18:29:32.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.370+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x55f9bd631330 2024-04-23T18:29:32.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.370+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94531112657184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd63f870 con 0x55f9bd631330 2024-04-23T18:29:32.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.370+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd640230 con 0x55f9bd63a630 2024-04-23T18:29:32.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.371+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.371+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94531112657184] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x55f9bd631330 2024-04-23T18:29:32.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.371+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94531112664448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd640a80 con 0x55f9bd63a630 2024-04-23T18:29:32.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.371+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd63f3c0 con 0x55f9bd635c80 2024-04-23T18:29:32.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.372+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1540dc040 con 0x55f9bd635c80 2024-04-23T18:29:32.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.372+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94531112664448] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.372+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94531112669120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd6413e0 con 0x55f9bd635c80 2024-04-23T18:29:32.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.372+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd641da0 con 0x55f9bd631330 2024-04-23T18:29:32.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.373+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94531112669120] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1540dc040 con 0x55f9bd635c80 2024-04-23T18:29:32.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.373+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x55f9bd631330 2024-04-23T18:29:32.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.373+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94531112666576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd641da0 con 0x55f9bd631330 2024-04-23T18:29:32.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.373+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd6427f0 con 0x7fb1540c5060 2024-04-23T18:29:32.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.374+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x7fb1540c5060 2024-04-23T18:29:32.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.374+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94531112674048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd642760 con 0x7fb1540c5060 2024-04-23T18:29:32.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.374+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd643750 con 0x7fb1540c5060 2024-04-23T18:29:32.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.374+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94531112666576] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x55f9bd631330 2024-04-23T18:29:32.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.375+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94531112674048] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x7fb1540c5060 2024-04-23T18:29:32.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.375+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x7fb1540c5060 2024-04-23T18:29:32.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.375+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94531112671472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd643750 con 0x7fb1540c5060 2024-04-23T18:29:32.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.375+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd642cc0 con 0x7fb1540c5060 2024-04-23T18:29:32.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.376+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94531112671472] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x7fb1540c5060 2024-04-23T18:29:32.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.376+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x7fb1540c5060 2024-04-23T18:29:32.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.376+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94531112677936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd643de0 con 0x7fb1540c5060 2024-04-23T18:29:32.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.376+0000 7fb163462800 20 add_watcher() i=0 2024-04-23T18:29:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.376+0000 7fb163462800 20 add_watcher() i=1 2024-04-23T18:29:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.376+0000 7fb163462800 20 add_watcher() i=2 2024-04-23T18:29:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.376+0000 7fb163462800 20 add_watcher() i=3 2024-04-23T18:29:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.376+0000 7fb163462800 20 add_watcher() i=4 2024-04-23T18:29:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.376+0000 7fb163462800 20 add_watcher() i=5 2024-04-23T18:29:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.376+0000 7fb163462800 20 add_watcher() i=6 2024-04-23T18:29:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.377+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94531112677936] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x7fb1540c5060 2024-04-23T18:29:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.377+0000 7fb163462800 20 add_watcher() i=7 2024-04-23T18:29:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.377+0000 7fb163462800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.377+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd646fb0 con 0x55f9bd631330 2024-04-23T18:29:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.378+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb15c040040 con 0x55f9bd631330 2024-04-23T18:29:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.378+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94531112679824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd644260 con 0x55f9bd631330 2024-04-23T18:29:32.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.379+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94531112679824] v32'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x55f9bd631330 2024-04-23T18:29:32.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.379+0000 7fb016fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.379+0000 7fb163462800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:32.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.379+0000 7fb163462800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:32.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.379+0000 7fb163462800 5 note: GC not initialized 2024-04-23T18:29:32.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.379+0000 7fb015fe3640 20 reqs_thread_entry: start 2024-04-23T18:29:32.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.379+0000 7fb163462800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:32.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.379+0000 7fb163462800 20 Filter name: none 2024-04-23T18:29:32.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.379+0000 7faf877fe640 20 reqs_thread_entry: start 2024-04-23T18:29:32.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.379+0000 7fb163462800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.379+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd67a320 con 0x55f9bd631330 2024-04-23T18:29:32.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.380+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fb15c040040 con 0x55f9bd631330 2024-04-23T18:29:32.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.380+0000 7fb163462800 20 rados_obj.operate() r=0 bl.length=556 2024-04-23T18:29:32.390 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:32.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.380+0000 7fb016fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.381+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94531112679824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd678d90 con 0x55f9bd631330 2024-04-23T18:29:32.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.381+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94531112679824] v32'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x55f9bd631330 2024-04-23T18:29:32.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.381+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94531112659120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd643990 con 0x55f9bd635c80 2024-04-23T18:29:32.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.382+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94531112659120] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1540dc040 con 0x55f9bd635c80 2024-04-23T18:29:32.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.382+0000 7fb163462800 20 remove_watcher() i=0 2024-04-23T18:29:32.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.382+0000 7fb163462800 2 removed watcher, disabling cache 2024-04-23T18:29:32.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.382+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94531112657184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd643990 con 0x55f9bd631330 2024-04-23T18:29:32.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.384+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94531112657184] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x55f9bd631330 2024-04-23T18:29:32.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.384+0000 7fb163462800 20 remove_watcher() i=1 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.384+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94531112664448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd63e120 con 0x55f9bd63a630 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.384+0000 7fb15bfff640 1 -- 172.21.15.119:0/1960579464 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94531112664448] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb14c009050 con 0x55f9bd63a630 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.384+0000 7fb163462800 20 remove_watcher() i=2 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.385+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94531112669120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd643990 con 0x55f9bd635c80 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.385+0000 7fb160f61640 1 -- 172.21.15.119:0/1960579464 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94531112669120] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1540dc040 con 0x55f9bd635c80 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.385+0000 7fb163462800 20 remove_watcher() i=3 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.385+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94531112666576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd63fd80 con 0x55f9bd631330 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.386+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94531112666576] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x55f9bd631330 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.386+0000 7fb163462800 20 remove_watcher() i=4 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.386+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94531112674048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd640fc0 con 0x7fb1540c5060 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.387+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94531112674048] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x7fb1540c5060 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.387+0000 7fb163462800 20 remove_watcher() i=5 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.387+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94531112671472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd643990 con 0x7fb1540c5060 2024-04-23T18:29:32.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.388+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94531112671472] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x7fb1540c5060 2024-04-23T18:29:32.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.388+0000 7fb163462800 20 remove_watcher() i=6 2024-04-23T18:29:32.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.388+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94531112677936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f9bd63fd80 con 0x7fb1540c5060 2024-04-23T18:29:32.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94531112677936] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb15c040040 con 0x7fb1540c5060 2024-04-23T18:29:32.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 20 remove_watcher() i=7 2024-04-23T18:29:32.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb1540c5060 msgr2=0x7fb15404c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb1540c5060 0x7fb15404c0e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9bd631330 msgr2=0x55f9bd633780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9bd631330 0x55f9bd633780 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9bd635c80 msgr2=0x55f9bd638070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9bd635c80 0x55f9bd638070 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9bd63a630 msgr2=0x55f9bd63caf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9bd63a630 0x55f9bd63caf0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb02c036e60 msgr2=0x7fb02c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb02c036e60 0x7fb02c039320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb14c001b60 tx=0x7fb14c010000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 msgr2=0x55f9bd5f1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 0x55f9bd5f1310 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb15409c5d0 tx=0x7fb154090f00 comp rx=0 tx=0).stop 2024-04-23T18:29:32.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb161762640 1 -- 172.21.15.119:0/1960579464 reap_dead start 2024-04-23T18:29:32.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 shutdown_connections 2024-04-23T18:29:32.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 --2- 172.21.15.119:0/1960579464 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd61c740 0x55f9bd5f1310 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 >> 172.21.15.119:0/1960579464 conn(0x55f9bd618aa0 msgr2=0x55f9bd616100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 shutdown_connections 2024-04-23T18:29:32.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.389+0000 7fb163462800 1 -- 172.21.15.119:0/1960579464 wait complete. 2024-04-23T18:29:32.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/1658865774 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb038036eb0 msgr2=0x7fb038039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 --2- 172.21.15.119:0/1658865774 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb038036eb0 0x7fb038039370 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00bf50 tx=0x7fb14c00f000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/1658865774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd60f620 msgr2=0x55f9bd60fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 --2- 172.21.15.119:0/1658865774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd60f620 0x55f9bd60fa40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb15400a360 tx=0x7fb154009b50 comp rx=0 tx=0).stop 2024-04-23T18:29:32.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/1658865774 shutdown_connections 2024-04-23T18:29:32.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 --2- 172.21.15.119:0/1658865774 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb038036eb0 0x7fb038039370 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 --2- 172.21.15.119:0/1658865774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd60f620 0x55f9bd60fa40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/1658865774 >> 172.21.15.119:0/1658865774 conn(0x55f9bd6036c0 msgr2=0x55f9bd603ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/1658865774 shutdown_connections 2024-04-23T18:29:32.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/1658865774 wait complete. 2024-04-23T18:29:32.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f9bd5fe680 msgr2=0x55f9bd600ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f9bd5fe680 0x55f9bd600ad0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9bd4f80b0 msgr2=0x55f9bd5f7f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f9bd4f80b0 0x55f9bd5f7f10 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9bd5fa740 msgr2=0x55f9bd5fcb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f9bd5fa740 0x55f9bd5fcb30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb048036eb0 msgr2=0x7fb048039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb048036eb0 0x7fb048039370 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb14c000f60 tx=0x7fb14c0012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 msgr2=0x55f9bd5f3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 --2- 172.21.15.119:0/220085757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9bd4f6e50 0x55f9bd5f3a00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb154055040 tx=0x7fb154002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb161762640 1 -- 172.21.15.119:0/220085757 reap_dead start 2024-04-23T18:29:32.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 shutdown_connections 2024-04-23T18:29:32.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 >> 172.21.15.119:0/220085757 conn(0x55f9bd4f2410 msgr2=0x55f9bd5e6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 shutdown_connections 2024-04-23T18:29:32.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.390+0000 7fb163462800 1 -- 172.21.15.119:0/220085757 wait complete. 2024-04-23T18:29:32.401 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:32.402 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-23T18:29:32.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-23T18:29:32.402 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-04-23T18:29:32.483 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:32.483 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:32.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.491+0000 7f78ad736800 1 Processor -- start 2024-04-23T18:29:32.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.491+0000 7f78ad736800 1 -- start start 2024-04-23T18:29:32.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.492+0000 7f78ad736800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55db2876c270 0x55db2876c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.492+0000 7f78ad736800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55db2861e560 con 0x55db2876f260 2024-04-23T18:29:32.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.492+0000 7f78ad736800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55db2860fe20 con 0x55db2876c270 2024-04-23T18:29:32.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.492+0000 7f78a94cc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55db2876c270 0x55db2876c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.492+0000 7f78a3fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55db2876f260 0x55db2876f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40620/0 (socket says 172.21.15.119:40620) 2024-04-23T18:29:32.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.492+0000 7f78a3fff640 1 -- 172.21.15.119:0/4110135810 learned_addr learned my addr 172.21.15.119:0/4110135810 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:32.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.492+0000 7f78a94cc640 1 -- 172.21.15.119:0/4110135810 >> v1:172.21.15.62:6789/0 conn(0x55db2876f260 legacy=0x55db2876f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.492+0000 7f78a94cc640 1 -- 172.21.15.119:0/4110135810 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db2861de60 con 0x55db2876c270 2024-04-23T18:29:32.486 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.494+0000 7f78a94cc640 1 --2- 172.21.15.119:0/4110135810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db2876c690 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f789c00a470 tx=0x7f789c01ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de6c31a7a8bb7f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.494+0000 7f78a8ccb640 1 -- 172.21.15.119:0/4110135810 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f789c057070 con 0x55db2876c270 2024-04-23T18:29:32.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.494+0000 7f78a8ccb640 1 -- 172.21.15.119:0/4110135810 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c04ad80 con 0x55db2876c270 2024-04-23T18:29:32.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.494+0000 7f78a8ccb640 1 -- 172.21.15.119:0/4110135810 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f789c052590 con 0x55db2876c270 2024-04-23T18:29:32.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.495+0000 7f78ad736800 1 -- 172.21.15.119:0/4110135810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 msgr2=0x55db2876c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.495+0000 7f78ad736800 1 --2- 172.21.15.119:0/4110135810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db2876c690 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f789c00a470 tx=0x7f789c01ce50 comp rx=0 tx=0).stop 2024-04-23T18:29:32.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.495+0000 7f78ad736800 1 -- 172.21.15.119:0/4110135810 shutdown_connections 2024-04-23T18:29:32.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.495+0000 7f78ad736800 1 --2- 172.21.15.119:0/4110135810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db2876c690 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.495+0000 7f78ad736800 1 -- 172.21.15.119:0/4110135810 >> 172.21.15.119:0/4110135810 conn(0x55db28767bc0 msgr2=0x55db28769fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.495+0000 7f78ad736800 1 -- 172.21.15.119:0/4110135810 shutdown_connections 2024-04-23T18:29:32.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.495+0000 7f78ad736800 1 -- 172.21.15.119:0/4110135810 wait complete. 2024-04-23T18:29:32.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.506+0000 7f78ad736800 1 Processor -- start 2024-04-23T18:29:32.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.506+0000 7f78ad736800 1 -- start start 2024-04-23T18:29:32.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.506+0000 7f78ad736800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db2885f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.506+0000 7f78ad736800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55db286b95d0 con 0x55db2876c270 2024-04-23T18:29:32.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.507+0000 7f78a94cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db2885f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.507+0000 7f78a94cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db2885f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32910/0 (socket says 172.21.15.119:32910) 2024-04-23T18:29:32.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.507+0000 7f78a94cc640 1 -- 172.21.15.119:0/2916825345 learned_addr learned my addr 172.21.15.119:0/2916825345 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.507+0000 7f78a94cc640 1 -- 172.21.15.119:0/2916825345 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db2862f860 con 0x55db2876c270 2024-04-23T18:29:32.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.507+0000 7f78a94cc640 1 --2- 172.21.15.119:0/2916825345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db2885f760 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f789c055040 tx=0x7f789c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a0a3c2e23f33cc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.507+0000 7f7797606640 1 -- 172.21.15.119:0/2916825345 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f789c057040 con 0x55db2876c270 2024-04-23T18:29:32.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.507+0000 7f7797606640 1 -- 172.21.15.119:0/2916825345 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c063070 con 0x55db2876c270 2024-04-23T18:29:32.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.507+0000 7f7797606640 1 -- 172.21.15.119:0/2916825345 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f789c05d470 con 0x55db2876c270 2024-04-23T18:29:32.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.508+0000 7f78ad736800 1 -- 172.21.15.119:0/2916825345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 msgr2=0x55db2885f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.508+0000 7f78ad736800 1 --2- 172.21.15.119:0/2916825345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db2885f760 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f789c055040 tx=0x7f789c04c000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.508+0000 7f78ad736800 1 -- 172.21.15.119:0/2916825345 shutdown_connections 2024-04-23T18:29:32.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.508+0000 7f78ad736800 1 --2- 172.21.15.119:0/2916825345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db2885f760 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.508+0000 7f78ad736800 1 -- 172.21.15.119:0/2916825345 >> 172.21.15.119:0/2916825345 conn(0x55db28767bc0 msgr2=0x55db2885b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.508+0000 7f78ad736800 1 -- 172.21.15.119:0/2916825345 shutdown_connections 2024-04-23T18:29:32.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.508+0000 7f78ad736800 1 -- 172.21.15.119:0/2916825345 wait complete. 2024-04-23T18:29:32.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.508+0000 7f78ad736800 1 Processor -- start 2024-04-23T18:29:32.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.508+0000 7f78ad736800 1 -- start start 2024-04-23T18:29:32.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.508+0000 7f78ad736800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db28866f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.508+0000 7f78ad736800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55db28777760 con 0x55db2876c270 2024-04-23T18:29:32.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.508+0000 7f78a94cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db28866f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.508+0000 7f78a94cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db28866f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32916/0 (socket says 172.21.15.119:32916) 2024-04-23T18:29:32.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.509+0000 7f78a94cc640 1 -- 172.21.15.119:0/8402939 learned_addr learned my addr 172.21.15.119:0/8402939 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.509+0000 7f78a94cc640 1 -- 172.21.15.119:0/8402939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db2862deb0 con 0x55db2876c270 2024-04-23T18:29:32.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.509+0000 7f78a94cc640 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db28866f70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f789c000c00 tx=0x7f789c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.509+0000 7f7795e03640 1 -- 172.21.15.119:0/8402939 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f789c06c070 con 0x55db2876c270 2024-04-23T18:29:32.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.509+0000 7f7795e03640 1 -- 172.21.15.119:0/8402939 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c05d8f0 con 0x55db2876c270 2024-04-23T18:29:32.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.509+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db288674b0 con 0x55db2876c270 2024-04-23T18:29:32.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.509+0000 7f7795e03640 1 -- 172.21.15.119:0/8402939 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f789c057070 con 0x55db2876c270 2024-04-23T18:29:32.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.509+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db288679d0 con 0x55db2876c270 2024-04-23T18:29:32.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.510+0000 7f7795e03640 1 -- 172.21.15.119:0/8402939 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f789c05dbf0 con 0x55db2876c270 2024-04-23T18:29:32.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.510+0000 7f7795e03640 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7790036e60 0x7f7790039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.510+0000 7f7795e03640 1 -- 172.21.15.119:0/8402939 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f789c08ec40 con 0x55db2876c270 2024-04-23T18:29:32.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.510+0000 7f78a3fff640 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7790036e60 0x7f7790039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.510+0000 7f78ad736800 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55db2876f260 0x55db2886dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.510+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db2886e520 con 0x55db2876f260 2024-04-23T18:29:32.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.510+0000 7f78a9ccd640 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55db2876f260 0x55db2886dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.510+0000 7f78a3fff640 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7790036e60 0x7f7790039320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7894000f60 tx=0x7f78940012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.511+0000 7f78a9ccd640 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55db2876f260 0x55db2886dfe0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.511+0000 7f78a9ccd640 1 -- 172.21.15.119:0/8402939 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db2876f260 2024-04-23T18:29:32.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.511+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db2886b5b0 con 0x55db2876f260 2024-04-23T18:29:32.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.511+0000 7f78a9ccd640 1 -- 172.21.15.119:0/8402939 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db2876f260 2024-04-23T18:29:32.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.511+0000 7f78ad736800 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55db28870850 0x55db28872c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.511+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db28873330 con 0x55db28870850 2024-04-23T18:29:32.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.511+0000 7f78a94cc640 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55db28870850 0x55db28872c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.512+0000 7f78a94cc640 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55db28870850 0x55db28872c40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.512+0000 7f78a94cc640 1 -- 172.21.15.119:0/8402939 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f789c05a040 con 0x55db28870850 2024-04-23T18:29:32.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.512+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db2886f800 con 0x55db2876f260 2024-04-23T18:29:32.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.512+0000 7f78a9ccd640 1 -- 172.21.15.119:0/8402939 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db2876f260 2024-04-23T18:29:32.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.512+0000 7f78ad736800 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55db288747e0 0x55db28876c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.512+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db28877390 con 0x55db288747e0 2024-04-23T18:29:32.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.512+0000 7f78a3fff640 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55db288747e0 0x55db28876c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.513+0000 7f78a3fff640 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55db288747e0 0x55db28876c30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.513+0000 7f78a3fff640 1 -- 172.21.15.119:0/8402939 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7894009050 con 0x55db288747e0 2024-04-23T18:29:32.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.513+0000 7f78ad736800 1 Processor -- start 2024-04-23T18:29:32.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.513+0000 7f78ad736800 1 -- start start 2024-04-23T18:29:32.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.514+0000 7f78ad736800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876ede0 0x55db2876d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.514+0000 7f78ad736800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55db2865fdf0 con 0x55db2876ede0 2024-04-23T18:29:32.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.514+0000 7f78a94cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876ede0 0x55db2876d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.514+0000 7f78a94cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876ede0 0x55db2876d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32918/0 (socket says 172.21.15.119:32918) 2024-04-23T18:29:32.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.514+0000 7f78a94cc640 1 -- 172.21.15.119:0/3500467745 learned_addr learned my addr 172.21.15.119:0/3500467745 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.514+0000 7f78a94cc640 1 -- 172.21.15.119:0/3500467745 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db2876d790 con 0x55db2876ede0 2024-04-23T18:29:32.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.514+0000 7f78a94cc640 1 --2- 172.21.15.119:0/3500467745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876ede0 0x55db2876d250 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f789c079920 tx=0x7f789c079c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.514+0000 7f778effd640 1 -- 172.21.15.119:0/3500467745 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f789c07ad90 con 0x55db2876ede0 2024-04-23T18:29:32.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.514+0000 7f78ad736800 1 -- 172.21.15.119:0/3500467745 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db2876d960 con 0x55db2876ede0 2024-04-23T18:29:32.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.514+0000 7f78ad736800 1 -- 172.21.15.119:0/3500467745 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db2876de60 con 0x55db2876ede0 2024-04-23T18:29:32.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.515+0000 7f778effd640 1 -- 172.21.15.119:0/3500467745 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c093070 con 0x55db2876ede0 2024-04-23T18:29:32.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.515+0000 7f778effd640 1 -- 172.21.15.119:0/3500467745 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f789c07a520 con 0x55db2876ede0 2024-04-23T18:29:32.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.515+0000 7f778effd640 1 -- 172.21.15.119:0/3500467745 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f789c07a6c0 con 0x55db2876ede0 2024-04-23T18:29:32.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.515+0000 7f778effd640 1 --2- 172.21.15.119:0/3500467745 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7780036e60 0x7f7780039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.515+0000 7f778effd640 1 -- 172.21.15.119:0/3500467745 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f789c08a070 con 0x55db2876ede0 2024-04-23T18:29:32.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.516+0000 7f78a3fff640 1 --2- 172.21.15.119:0/3500467745 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7780036e60 0x7f7780039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.516+0000 7f78ad736800 1 Processor -- start 2024-04-23T18:29:32.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.516+0000 7f78a3fff640 1 --2- 172.21.15.119:0/3500467745 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7780036e60 0x7f7780039320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f789400bf50 tx=0x7f789400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.516+0000 7f78ad736800 1 -- start start 2024-04-23T18:29:32.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.516+0000 7f78ad736800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db28894ac0 0x55db28894ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.516+0000 7f78ad736800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55db2885fe20 con 0x55db28894ac0 2024-04-23T18:29:32.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.516+0000 7f78a94cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db28894ac0 0x55db28894ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.516+0000 7f78a94cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db28894ac0 0x55db28894ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32934/0 (socket says 172.21.15.119:32934) 2024-04-23T18:29:32.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.516+0000 7f78a94cc640 1 -- 172.21.15.119:0/3684162613 learned_addr learned my addr 172.21.15.119:0/3684162613 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.516+0000 7f78a94cc640 1 -- 172.21.15.119:0/3684162613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db288954b0 con 0x55db28894ac0 2024-04-23T18:29:32.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.517+0000 7f78a94cc640 1 --2- 172.21.15.119:0/3684162613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db28894ac0 0x55db28894ee0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f789c07af50 tx=0x7f789c08e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f2cbbcec735205 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.517+0000 7f778cff9640 1 -- 172.21.15.119:0/3684162613 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f789c083700 con 0x55db28894ac0 2024-04-23T18:29:32.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.517+0000 7f778cff9640 1 -- 172.21.15.119:0/3684162613 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c0a8070 con 0x55db28894ac0 2024-04-23T18:29:32.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.517+0000 7f778cff9640 1 -- 172.21.15.119:0/3684162613 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f789c0725a0 con 0x55db28894ac0 2024-04-23T18:29:32.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.517+0000 7f78ad736800 1 -- 172.21.15.119:0/3684162613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db28894ac0 msgr2=0x55db28894ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.517+0000 7f78ad736800 1 --2- 172.21.15.119:0/3684162613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db28894ac0 0x55db28894ee0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f789c07af50 tx=0x7f789c08e540 comp rx=0 tx=0).stop 2024-04-23T18:29:32.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.517+0000 7f78ad736800 1 -- 172.21.15.119:0/3684162613 shutdown_connections 2024-04-23T18:29:32.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.517+0000 7f78ad736800 1 --2- 172.21.15.119:0/3684162613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db28894ac0 0x55db28894ee0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.517+0000 7f78ad736800 1 -- 172.21.15.119:0/3684162613 >> 172.21.15.119:0/3684162613 conn(0x55db28890e20 msgr2=0x55db2888ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.517+0000 7f78ad736800 1 -- 172.21.15.119:0/3684162613 shutdown_connections 2024-04-23T18:29:32.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.517+0000 7f78ad736800 1 -- 172.21.15.119:0/3684162613 wait complete. 2024-04-23T18:29:32.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.517+0000 7f78ad736800 1 Processor -- start 2024-04-23T18:29:32.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.518+0000 7f78ad736800 1 -- start start 2024-04-23T18:29:32.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.518+0000 7f78ad736800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db28894ac0 0x55db2889beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.518+0000 7f78ad736800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55db28895b60 con 0x55db28894ac0 2024-04-23T18:29:32.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.518+0000 7f78a94cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db28894ac0 0x55db2889beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.518+0000 7f78a94cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db28894ac0 0x55db2889beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32940/0 (socket says 172.21.15.119:32940) 2024-04-23T18:29:32.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.518+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 learned_addr learned my addr 172.21.15.119:0/2464230291 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.518+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db2889c3f0 con 0x55db28894ac0 2024-04-23T18:29:32.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.518+0000 7f78a94cc640 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db28894ac0 0x55db2889beb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f789c07af50 tx=0x7f789c06aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.518+0000 7f777effd640 1 -- 172.21.15.119:0/2464230291 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f789c068cf0 con 0x55db28894ac0 2024-04-23T18:29:32.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.518+0000 7f777effd640 1 -- 172.21.15.119:0/2464230291 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c083920 con 0x55db28894ac0 2024-04-23T18:29:32.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.518+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db2889c3f0 con 0x55db28894ac0 2024-04-23T18:29:32.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.518+0000 7f777effd640 1 -- 172.21.15.119:0/2464230291 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f789c083c20 con 0x55db28894ac0 2024-04-23T18:29:32.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.518+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db2889c3f0 con 0x55db28894ac0 2024-04-23T18:29:32.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.519+0000 7f777effd640 1 -- 172.21.15.119:0/2464230291 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f789c08e5f0 con 0x55db28894ac0 2024-04-23T18:29:32.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f777effd640 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7774036e60 0x7f7774039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f777effd640 1 -- 172.21.15.119:0/2464230291 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f789c081040 con 0x55db28894ac0 2024-04-23T18:29:32.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f78ad736800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f78a3fff640 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7774036e60 0x7f7774039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f78ad736800 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55db288a7640 0x55db288a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288aa250 con 0x55db288a7640 2024-04-23T18:29:32.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f78a9ccd640 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55db288a7640 0x55db288a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f78a3fff640 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7774036e60 0x7f7774039320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7894001b60 tx=0x7f7894010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f78a9ccd640 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55db288a7640 0x55db288a9b00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db288a7640 2024-04-23T18:29:32.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f78ad736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f78ad736800 20 realm 2024-04-23T18:29:32.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f78ad736800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.520+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288aa660 con 0x55db288a7640 2024-04-23T18:29:32.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db288a7640 2024-04-23T18:29:32.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78ad736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78ad736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:32.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78ad736800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288aaf00 con 0x55db288a7640 2024-04-23T18:29:32.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db288a7640 2024-04-23T18:29:32.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78ad736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78ad736800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288a7640 2024-04-23T18:29:32.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db288a7640 2024-04-23T18:29:32.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78ad736800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78ad736800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78ad736800 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55db288ac000 0x55db288ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288aea40 con 0x55db288ac000 2024-04-23T18:29:32.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78a94cc640 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55db288ac000 0x55db288ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.521+0000 7f78a94cc640 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55db288ac000 0x55db288ae3f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.522+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.522+0000 7f78ad736800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:32.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.522+0000 7f78ad736800 20 searching for the correct realm 2024-04-23T18:29:32.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.522+0000 7f78ad736800 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55db288b09d0 0x55db288b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.522+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288b3510 con 0x55db288b09d0 2024-04-23T18:29:32.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.522+0000 7f78a3fff640 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55db288b09d0 0x55db288b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.522+0000 7f78a3fff640 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55db288b09d0 0x55db288b2e90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.522+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.523+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288b3510 con 0x55db288ac000 2024-04-23T18:29:32.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.523+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.523+0000 7f78a94cc640 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f789c006380 0x7f789c0067a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.523+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288b3510 con 0x7f789c006380 2024-04-23T18:29:32.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.523+0000 7f78a9ccd640 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f789c006380 0x7f789c0067a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.523+0000 7f78a9ccd640 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f789c006380 0x7f789c0067a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.523+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x7f789c006380 2024-04-23T18:29:32.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.523+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288a7640 2024-04-23T18:29:32.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.524+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db288a7640 2024-04-23T18:29:32.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.524+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288a7640 2024-04-23T18:29:32.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.524+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db288a7640 2024-04-23T18:29:32.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.524+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x7f789c006380 2024-04-23T18:29:32.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.524+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x7f789c006380 2024-04-23T18:29:32.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.524+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x7f789c006380 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.525+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f78a400a4a0 con 0x7f789c006380 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.525+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288ac000 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.525+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.525+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288b09d0 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.525+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.525+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288a7640 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.525+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db288a7640 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.525+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x7f789c006380 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.526+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x7f789c006380 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.526+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288a7640 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.526+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db288a7640 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.526+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288ac000 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.526+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.526+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288b09d0 2024-04-23T18:29:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.526+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.526+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288b09d0 2024-04-23T18:29:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.526+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.526+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x7f789c006380 2024-04-23T18:29:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.527+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x7f789c006380 2024-04-23T18:29:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.527+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288b09d0 2024-04-23T18:29:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.527+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.527+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288b09d0 2024-04-23T18:29:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.527+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.527+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288a7640 2024-04-23T18:29:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.527+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db288a7640 2024-04-23T18:29:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.527+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288a7640 2024-04-23T18:29:32.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.528+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db288a7640 2024-04-23T18:29:32.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.528+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x7f789c006380 2024-04-23T18:29:32.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.528+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x7f789c006380 2024-04-23T18:29:32.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.528+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288b09d0 2024-04-23T18:29:32.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.528+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.528+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288ac000 2024-04-23T18:29:32.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.528+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.528+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288a7640 2024-04-23T18:29:32.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.529+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x55db288a7640 2024-04-23T18:29:32.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.529+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x7f789c006380 2024-04-23T18:29:32.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.529+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x7f789c006380 2024-04-23T18:29:32.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.529+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288b09d0 2024-04-23T18:29:32.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.529+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.529+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x7f789c006380 2024-04-23T18:29:32.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.530+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a400a4a0 con 0x7f789c006380 2024-04-23T18:29:32.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.530+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288ac000 2024-04-23T18:29:32.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.530+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.530+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288b09d0 2024-04-23T18:29:32.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.530+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.530+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x7f789c006380 2024-04-23T18:29:32.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.530+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78a4040040 con 0x7f789c006380 2024-04-23T18:29:32.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.530+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288a7640 2024-04-23T18:29:32.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55db288ab2a0 con 0x55db288ac000 2024-04-23T18:29:32.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:32.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:32.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:32.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:32.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:32.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:32.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288aede0 con 0x55db288a7640 2024-04-23T18:29:32.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288aede0 con 0x55db288a7640 2024-04-23T18:29:32.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.531+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288aede0 con 0x7f789c006380 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f78a4040040 con 0x7f789c006380 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 20 zone default found 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 4 Realm: () 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 20 zonegroup default 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288af680 con 0x7f789c006380 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x7f789c006380 2024-04-23T18:29:32.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288af680 con 0x55db288b09d0 2024-04-23T18:29:32.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.532+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288b5370 con 0x55db288b09d0 2024-04-23T18:29:32.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.533+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.533+0000 7f78ad736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.533+0000 7f78ad736800 20 started sync module instance, tier type = 2024-04-23T18:29:32.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.533+0000 7f78ad736800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:32.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.533+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b4810 con 0x55db288ac000 2024-04-23T18:29:32.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.533+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.534+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94399766416384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b5bc0 con 0x55db288ac000 2024-04-23T18:29:32.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.534+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b6410 con 0x55db288a7640 2024-04-23T18:29:32.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.535+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94399766416384] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.535+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.535+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94399766419216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b6410 con 0x55db288a7640 2024-04-23T18:29:32.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.535+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b6e50 con 0x55db288b09d0 2024-04-23T18:29:32.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.536+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94399766419216] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.536+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.536+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94399766421344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b6380 con 0x55db288b09d0 2024-04-23T18:29:32.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.536+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b7d10 con 0x55db288ac000 2024-04-23T18:29:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.537+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94399766421344] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.537+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.537+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94399766427744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b7c80 con 0x55db288ac000 2024-04-23T18:29:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.537+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b8bd0 con 0x55db288a7640 2024-04-23T18:29:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.538+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94399766427744] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.538+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.538+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94399766429952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b8bd0 con 0x55db288a7640 2024-04-23T18:29:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.539+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b95d0 con 0x7f789c006380 2024-04-23T18:29:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.539+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x7f789c006380 2024-04-23T18:29:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.540+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94399766434016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b9500 con 0x7f789c006380 2024-04-23T18:29:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.540+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288ba500 con 0x7f789c006380 2024-04-23T18:29:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.540+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94399766429952] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.540+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94399766434016] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x7f789c006380 2024-04-23T18:29:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.541+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x7f789c006380 2024-04-23T18:29:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.541+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94399766431520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288ba010 con 0x7f789c006380 2024-04-23T18:29:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.541+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288ba9d0 con 0x7f789c006380 2024-04-23T18:29:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.542+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94399766431520] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x7f789c006380 2024-04-23T18:29:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.542+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x7f789c006380 2024-04-23T18:29:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.542+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94399766436208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288ba9d0 con 0x7f789c006380 2024-04-23T18:29:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.542+0000 7f78ad736800 20 add_watcher() i=0 2024-04-23T18:29:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.542+0000 7f78ad736800 20 add_watcher() i=1 2024-04-23T18:29:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.542+0000 7f78ad736800 20 add_watcher() i=2 2024-04-23T18:29:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.542+0000 7f78ad736800 20 add_watcher() i=3 2024-04-23T18:29:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.542+0000 7f78ad736800 20 add_watcher() i=4 2024-04-23T18:29:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.542+0000 7f78ad736800 20 add_watcher() i=5 2024-04-23T18:29:32.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.542+0000 7f78ad736800 20 add_watcher() i=6 2024-04-23T18:29:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.542+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94399766436208] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x7f789c006380 2024-04-23T18:29:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.542+0000 7f78ad736800 20 add_watcher() i=7 2024-04-23T18:29:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.542+0000 7f78ad736800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.543+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288bdd30 con 0x55db288a7640 2024-04-23T18:29:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.543+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.543+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94399766439568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288baf60 con 0x55db288a7640 2024-04-23T18:29:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.544+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94399766439568] v32'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.544+0000 7f775f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.544+0000 7f78ad736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.544+0000 7f78ad736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.544+0000 7f78ad736800 5 note: GC not initialized 2024-04-23T18:29:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.544+0000 7f775e7e4640 20 reqs_thread_entry: start 2024-04-23T18:29:32.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.544+0000 7f78ad736800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:32.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.544+0000 7f78ad736800 20 Filter name: none 2024-04-23T18:29:32.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.544+0000 7f76cffff640 20 reqs_thread_entry: start 2024-04-23T18:29:32.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.544+0000 7f78ad736800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:32.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.544+0000 7f78ad736800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.544+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288f15b0 con 0x55db288a7640 2024-04-23T18:29:32.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78ad736800 20 rados_obj.operate() r=0 bl.length=556 2024-04-23T18:29:32.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78ad736800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:32.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78ad736800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:32.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78ad736800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:32.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78ad736800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-04-23T18:29:32.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78ad736800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288f2340 con 0x55db288ac000 2024-04-23T18:29:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78ad736800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78ad736800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-04-23T18:29:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78ad736800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-23T18:29:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78ad736800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-04-23T18:29:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.545+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288f8090 con 0x55db288a7640 2024-04-23T18:29:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.546+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.546+0000 7f78ad736800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.546+0000 7f78ad736800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.546+0000 7f78ad736800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.546+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94399766690608 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288f4c30 con 0x55db288a7640 2024-04-23T18:29:32.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.546+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify (1) cookie 94399766429952 notify 137438953479 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7f78a4018e10 con 0x55db288a7640 2024-04-23T18:29:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.546+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(65 notify.4 [notify cookie 94399766690608 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.546+0000 7f778cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94399766429952 notifier 4385 bl.length()=849 2024-04-23T18:29:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.546+0000 7f778cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.546+0000 7f778cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.547+0000 7f778cff9640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f776c003ea0 con 0x55db288a7640 2024-04-23T18:29:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.547+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.547+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify_complete (2) cookie 94399766690608 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f78a4005040 con 0x55db288a7640 2024-04-23T18:29:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.547+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288f7b30 con 0x55db288ac000 2024-04-23T18:29:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.548+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.548+0000 7f78ad736800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-23T18:29:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.548+0000 7f78ad736800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-23T18:29:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.548+0000 7f78ad736800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-23T18:29:32.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.548+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94399766690608 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55db288f4c30 con 0x55db288ac000 2024-04-23T18:29:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.548+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== watch-notify(notify (1) cookie 94399766416384 notify 137438953475 ret 0) ==== 208+0+0 (crc 0 0 0) 0x55db2876d960 con 0x55db288ac000 2024-04-23T18:29:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.548+0000 7f778cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94399766416384 notifier 4385 bl.length()=166 2024-04-23T18:29:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.548+0000 7f778cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-23T18:29:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.548+0000 7f778cff9640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-23T18:29:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.548+0000 7f778cff9640 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f776c003ea0 con 0x55db288ac000 2024-04-23T18:29:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.548+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(68 notify.0 [notify cookie 94399766690608 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.549+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.549+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== watch-notify(notify_complete (2) cookie 94399766690608 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55db2876d790 con 0x55db288ac000 2024-04-23T18:29:32.557 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-23T18:29:32.546463Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:32.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.550+0000 7f775f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.550+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94399766439568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288f2640 con 0x55db288a7640 2024-04-23T18:29:32.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.551+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94399766439568] v32'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.551+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94399766416384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288ba690 con 0x55db288ac000 2024-04-23T18:29:32.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.551+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94399766416384] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.552+0000 7f78ad736800 20 remove_watcher() i=0 2024-04-23T18:29:32.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.552+0000 7f78ad736800 2 removed watcher, disabling cache 2024-04-23T18:29:32.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.552+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94399766419216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288ba690 con 0x55db288a7640 2024-04-23T18:29:32.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.552+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94399766419216] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.552+0000 7f78ad736800 20 remove_watcher() i=1 2024-04-23T18:29:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.552+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94399766421344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b5710 con 0x55db288b09d0 2024-04-23T18:29:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.553+0000 7f78a3fff640 1 -- 172.21.15.119:0/2464230291 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94399766421344] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7894009050 con 0x55db288b09d0 2024-04-23T18:29:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.554+0000 7f78ad736800 20 remove_watcher() i=2 2024-04-23T18:29:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.554+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94399766427744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b5f60 con 0x55db288ac000 2024-04-23T18:29:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.554+0000 7f78a94cc640 1 -- 172.21.15.119:0/2464230291 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94399766427744] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f789c05a040 con 0x55db288ac000 2024-04-23T18:29:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.554+0000 7f78ad736800 20 remove_watcher() i=3 2024-04-23T18:29:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.554+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94399766429952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b7860 con 0x55db288a7640 2024-04-23T18:29:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.555+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94399766429952] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x55db288a7640 2024-04-23T18:29:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.555+0000 7f78ad736800 20 remove_watcher() i=4 2024-04-23T18:29:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.556+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94399766434016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b5f60 con 0x7f789c006380 2024-04-23T18:29:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.556+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94399766434016] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x7f789c006380 2024-04-23T18:29:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.556+0000 7f78ad736800 20 remove_watcher() i=5 2024-04-23T18:29:32.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.556+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94399766431520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b7860 con 0x7f789c006380 2024-04-23T18:29:32.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.558+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94399766431520] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x7f789c006380 2024-04-23T18:29:32.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.558+0000 7f78ad736800 20 remove_watcher() i=6 2024-04-23T18:29:32.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.558+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94399766436208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55db288b90e0 con 0x7f789c006380 2024-04-23T18:29:32.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.558+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94399766436208] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78a4040040 con 0x7f789c006380 2024-04-23T18:29:32.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.558+0000 7f78ad736800 20 remove_watcher() i=7 2024-04-23T18:29:32.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f789c006380 msgr2=0x7f789c0067a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f789c006380 0x7f789c0067a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55db288a7640 msgr2=0x55db288a9b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55db288a7640 0x55db288a9b00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55db288ac000 msgr2=0x55db288ae3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55db288ac000 0x55db288ae3f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55db288b09d0 msgr2=0x55db288b2e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55db288b09d0 0x55db288b2e90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7774036e60 msgr2=0x7f7774039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7774036e60 0x7f7774039320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7894001b60 tx=0x7f7894010000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db28894ac0 msgr2=0x55db2889beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 --2- 172.21.15.119:0/2464230291 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db28894ac0 0x55db2889beb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f789c07af50 tx=0x7f789c06aeb0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78a9ccd640 1 -- 172.21.15.119:0/2464230291 reap_dead start 2024-04-23T18:29:32.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 shutdown_connections 2024-04-23T18:29:32.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 >> 172.21.15.119:0/2464230291 conn(0x55db28890e20 msgr2=0x55db2888e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 shutdown_connections 2024-04-23T18:29:32.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/2464230291 wait complete. 2024-04-23T18:29:32.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/3500467745 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7780036e60 msgr2=0x7f7780039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 --2- 172.21.15.119:0/3500467745 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7780036e60 0x7f7780039320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f789400bf50 tx=0x7f789400f000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/3500467745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876ede0 msgr2=0x55db2876d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 --2- 172.21.15.119:0/3500467745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876ede0 0x55db2876d250 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f789c079920 tx=0x7f789c079c80 comp rx=0 tx=0).stop 2024-04-23T18:29:32.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/3500467745 shutdown_connections 2024-04-23T18:29:32.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 --2- 172.21.15.119:0/3500467745 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7780036e60 0x7f7780039320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 --2- 172.21.15.119:0/3500467745 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876ede0 0x55db2876d250 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/3500467745 >> 172.21.15.119:0/3500467745 conn(0x55db28879890 msgr2=0x55db28879c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/3500467745 shutdown_connections 2024-04-23T18:29:32.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.559+0000 7f78ad736800 1 -- 172.21.15.119:0/3500467745 wait complete. 2024-04-23T18:29:32.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55db288747e0 msgr2=0x55db28876c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55db288747e0 0x55db28876c30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55db2876f260 msgr2=0x55db2886dfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55db2876f260 0x55db2886dfe0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55db28870850 msgr2=0x55db28872c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55db28870850 0x55db28872c40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7790036e60 msgr2=0x7f7790039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7790036e60 0x7f7790039320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7894000f60 tx=0x7f78940012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 msgr2=0x55db28866f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 --2- 172.21.15.119:0/8402939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55db2876c270 0x55db28866f70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f789c000c00 tx=0x7f789c002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78a9ccd640 1 -- 172.21.15.119:0/8402939 reap_dead start 2024-04-23T18:29:32.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 shutdown_connections 2024-04-23T18:29:32.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 >> 172.21.15.119:0/8402939 conn(0x55db28767bc0 msgr2=0x55db2885e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 shutdown_connections 2024-04-23T18:29:32.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.560+0000 7f78ad736800 1 -- 172.21.15.119:0/8402939 wait complete. 2024-04-23T18:29:32.571 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-23T18:29:32.546463Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:32.571 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-23T18:29:32.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-23T18:29:32.572 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-23T18:29:32.614 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:32.614 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:32.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.622+0000 7f8fc9694800 1 Processor -- start 2024-04-23T18:29:32.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.622+0000 7f8fc9694800 1 -- start start 2024-04-23T18:29:32.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.622+0000 7f8fc9694800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55abb7ba22e0 0x55abb7ba46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.622+0000 7f8fc9694800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55abb7a4f560 con 0x55abb7b9de50 2024-04-23T18:29:32.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.622+0000 7f8fc9694800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55abb7a40e20 con 0x55abb7ba22e0 2024-04-23T18:29:32.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.623+0000 7f8fbe992640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55abb7ba22e0 0x55abb7ba46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.623+0000 7f8fc7193640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55abb7b9de50 0x55abb7b9e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40632/0 (socket says 172.21.15.119:40632) 2024-04-23T18:29:32.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.623+0000 7f8fc7193640 1 -- 172.21.15.119:0/1441351993 learned_addr learned my addr 172.21.15.119:0/1441351993 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:32.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.623+0000 7f8fbe992640 1 -- 172.21.15.119:0/1441351993 >> v1:172.21.15.62:6789/0 conn(0x55abb7b9de50 legacy=0x55abb7b9e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.623+0000 7f8fbe992640 1 -- 172.21.15.119:0/1441351993 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb7a4ee60 con 0x55abb7ba22e0 2024-04-23T18:29:32.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.625+0000 7f8fbe992640 1 --2- 172.21.15.119:0/1441351993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7ba22e0 0x55abb7ba46d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000a470 tx=0x7f8fb001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17541f5c4a5dbfd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.625+0000 7f8fc6992640 1 -- 172.21.15.119:0/1441351993 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb0057070 con 0x55abb7ba22e0 2024-04-23T18:29:32.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.625+0000 7f8fc6992640 1 -- 172.21.15.119:0/1441351993 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb0052570 con 0x55abb7ba22e0 2024-04-23T18:29:32.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.625+0000 7f8fc6992640 1 -- 172.21.15.119:0/1441351993 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb0052870 con 0x55abb7ba22e0 2024-04-23T18:29:32.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.626+0000 7f8fc9694800 1 -- 172.21.15.119:0/1441351993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7ba22e0 msgr2=0x55abb7ba46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.626+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1441351993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7ba22e0 0x55abb7ba46d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000a470 tx=0x7f8fb001ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:32.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.626+0000 7f8fc9694800 1 -- 172.21.15.119:0/1441351993 shutdown_connections 2024-04-23T18:29:32.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.626+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1441351993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7ba22e0 0x55abb7ba46d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.626+0000 7f8fc9694800 1 -- 172.21.15.119:0/1441351993 >> 172.21.15.119:0/1441351993 conn(0x55abb7b99410 msgr2=0x55abb7b9b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.626+0000 7f8fc9694800 1 -- 172.21.15.119:0/1441351993 shutdown_connections 2024-04-23T18:29:32.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.626+0000 7f8fc9694800 1 -- 172.21.15.119:0/1441351993 wait complete. 2024-04-23T18:29:32.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.637+0000 7f8fc9694800 1 Processor -- start 2024-04-23T18:29:32.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.638+0000 7f8fc9694800 1 -- start start 2024-04-23T18:29:32.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.638+0000 7f8fc9694800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7b9de50 0x55abb7b126f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.638+0000 7f8fc9694800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55abb7aea5b0 con 0x55abb7b9de50 2024-04-23T18:29:32.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.638+0000 7f8fc7193640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7b9de50 0x55abb7b126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.638+0000 7f8fc7193640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7b9de50 0x55abb7b126f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32964/0 (socket says 172.21.15.119:32964) 2024-04-23T18:29:32.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.638+0000 7f8fc7193640 1 -- 172.21.15.119:0/2171873436 learned_addr learned my addr 172.21.15.119:0/2171873436 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.638+0000 7f8fc7193640 1 -- 172.21.15.119:0/2171873436 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb7a60860 con 0x55abb7b9de50 2024-04-23T18:29:32.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.639+0000 7f8fc7193640 1 --2- 172.21.15.119:0/2171873436 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7b9de50 0x55abb7b126f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8001e10 tx=0x7f8fb800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344121eeef31d4fc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.639+0000 7f8eb560a640 1 -- 172.21.15.119:0/2171873436 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb8012020 con 0x55abb7b9de50 2024-04-23T18:29:32.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.639+0000 7f8eb560a640 1 -- 172.21.15.119:0/2171873436 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb800e5a0 con 0x55abb7b9de50 2024-04-23T18:29:32.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.639+0000 7f8eb560a640 1 -- 172.21.15.119:0/2171873436 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb800e8e0 con 0x55abb7b9de50 2024-04-23T18:29:32.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.639+0000 7f8fc9694800 1 -- 172.21.15.119:0/2171873436 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7b9de50 msgr2=0x55abb7b126f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.639+0000 7f8fc9694800 1 --2- 172.21.15.119:0/2171873436 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7b9de50 0x55abb7b126f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8001e10 tx=0x7f8fb800b780 comp rx=0 tx=0).stop 2024-04-23T18:29:32.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.639+0000 7f8fc9694800 1 -- 172.21.15.119:0/2171873436 shutdown_connections 2024-04-23T18:29:32.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.639+0000 7f8fc9694800 1 --2- 172.21.15.119:0/2171873436 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7b9de50 0x55abb7b126f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.639+0000 7f8fc9694800 1 -- 172.21.15.119:0/2171873436 >> 172.21.15.119:0/2171873436 conn(0x55abb7b99410 msgr2=0x55abb7c8a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.639+0000 7f8fc9694800 1 -- 172.21.15.119:0/2171873436 shutdown_connections 2024-04-23T18:29:32.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.639+0000 7f8fc9694800 1 -- 172.21.15.119:0/2171873436 wait complete. 2024-04-23T18:29:32.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.640+0000 7f8fc9694800 1 Processor -- start 2024-04-23T18:29:32.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.640+0000 7f8fc9694800 1 -- start start 2024-04-23T18:29:32.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.640+0000 7f8fc9694800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7b9de50 0x55abb7c97ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.640+0000 7f8fc9694800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55abb7ba4fa0 con 0x55abb7b9de50 2024-04-23T18:29:32.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.640+0000 7f8fc7193640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7b9de50 0x55abb7c97ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.640+0000 7f8fc7193640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7b9de50 0x55abb7c97ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32972/0 (socket says 172.21.15.119:32972) 2024-04-23T18:29:32.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.640+0000 7f8fc7193640 1 -- 172.21.15.119:0/1856291820 learned_addr learned my addr 172.21.15.119:0/1856291820 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.641+0000 7f8fc7193640 1 -- 172.21.15.119:0/1856291820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb7a5eeb0 con 0x55abb7b9de50 2024-04-23T18:29:32.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.641+0000 7f8fc7193640 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7b9de50 0x55abb7c97ba0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8001e10 tx=0x7f8fb8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.641+0000 7f8eb3e07640 1 -- 172.21.15.119:0/1856291820 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb8012030 con 0x55abb7b9de50 2024-04-23T18:29:32.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.641+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abb7c980e0 con 0x55abb7b9de50 2024-04-23T18:29:32.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.641+0000 7f8eb3e07640 1 -- 172.21.15.119:0/1856291820 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb801a7a0 con 0x55abb7b9de50 2024-04-23T18:29:32.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.641+0000 7f8eb3e07640 1 -- 172.21.15.119:0/1856291820 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb801a990 con 0x55abb7b9de50 2024-04-23T18:29:32.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.641+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb7c98600 con 0x55abb7b9de50 2024-04-23T18:29:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.642+0000 7f8eb3e07640 1 -- 172.21.15.119:0/1856291820 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8fb8015020 con 0x55abb7b9de50 2024-04-23T18:29:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.642+0000 7f8eb3e07640 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8eac036e60 0x7f8eac039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.642+0000 7f8eb3e07640 1 -- 172.21.15.119:0/1856291820 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8fb8020030 con 0x55abb7b9de50 2024-04-23T18:29:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.642+0000 7f8fbe992640 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8eac036e60 0x7f8eac039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.642+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55abb7ba22e0 0x55abb7c9ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.642+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7c9f150 con 0x55abb7ba22e0 2024-04-23T18:29:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.642+0000 7f8fc7994640 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55abb7ba22e0 0x55abb7c9ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.642+0000 7f8fbe992640 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8eac036e60 0x7f8eac039320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0054000 tx=0x7f8fb004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.643+0000 7f8fc7994640 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55abb7ba22e0 0x55abb7c9ec10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.643+0000 7f8fc7994640 1 -- 172.21.15.119:0/1856291820 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7ba22e0 2024-04-23T18:29:32.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.643+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7c9c1e0 con 0x55abb7ba22e0 2024-04-23T18:29:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.643+0000 7f8fc7994640 1 -- 172.21.15.119:0/1856291820 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7ba22e0 2024-04-23T18:29:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.643+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55abb7ca1480 0x55abb7ca3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.643+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ca3f10 con 0x55abb7ca1480 2024-04-23T18:29:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.643+0000 7f8fc7193640 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55abb7ca1480 0x55abb7ca3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.643+0000 7f8fc7193640 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55abb7ca1480 0x55abb7ca3870 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.644+0000 7f8fc7193640 1 -- 172.21.15.119:0/1856291820 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8fb8018430 con 0x55abb7ca1480 2024-04-23T18:29:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.644+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ca0430 con 0x55abb7ba22e0 2024-04-23T18:29:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.644+0000 7f8fc7994640 1 -- 172.21.15.119:0/1856291820 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7ba22e0 2024-04-23T18:29:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.644+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55abb7ca53c0 0x55abb7ca7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.644+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ca7f70 con 0x55abb7ca53c0 2024-04-23T18:29:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.644+0000 7f8fbe992640 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55abb7ca53c0 0x55abb7ca7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.644+0000 7f8fbe992640 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55abb7ca53c0 0x55abb7ca7810 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.645+0000 7f8fbe992640 1 -- 172.21.15.119:0/1856291820 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8fb0052940 con 0x55abb7ca53c0 2024-04-23T18:29:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.645+0000 7f8fc9694800 1 Processor -- start 2024-04-23T18:29:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.645+0000 7f8fc9694800 1 -- start start 2024-04-23T18:29:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.645+0000 7f8fc9694800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cb6360 0x55abb7cb6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.645+0000 7f8fc9694800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55abb7a90df0 con 0x55abb7cb6360 2024-04-23T18:29:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.645+0000 7f8fc7193640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cb6360 0x55abb7cb6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.645+0000 7f8fc7193640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cb6360 0x55abb7cb6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32980/0 (socket says 172.21.15.119:32980) 2024-04-23T18:29:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.645+0000 7f8fc7193640 1 -- 172.21.15.119:0/1817272833 learned_addr learned my addr 172.21.15.119:0/1817272833 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.646+0000 7f8fc7193640 1 -- 172.21.15.119:0/1817272833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb7cb6cc0 con 0x55abb7cb6360 2024-04-23T18:29:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.646+0000 7f8fc7193640 1 --2- 172.21.15.119:0/1817272833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cb6360 0x55abb7cb6780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8016550 tx=0x7f8fb800db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.646+0000 7f8eb1602640 1 -- 172.21.15.119:0/1817272833 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb80443c0 con 0x55abb7cb6360 2024-04-23T18:29:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.646+0000 7f8fc9694800 1 -- 172.21.15.119:0/1817272833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abb7cb7730 con 0x55abb7cb6360 2024-04-23T18:29:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.646+0000 7f8eb1602640 1 -- 172.21.15.119:0/1817272833 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb8044560 con 0x55abb7cb6360 2024-04-23T18:29:32.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.646+0000 7f8eb1602640 1 -- 172.21.15.119:0/1817272833 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb803f7e0 con 0x55abb7cb6360 2024-04-23T18:29:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.646+0000 7f8fc9694800 1 -- 172.21.15.119:0/1817272833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb7cb7c30 con 0x55abb7cb6360 2024-04-23T18:29:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.647+0000 7f8eb1602640 1 -- 172.21.15.119:0/1817272833 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8fb803f440 con 0x55abb7cb6360 2024-04-23T18:29:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.647+0000 7f8eb1602640 1 --2- 172.21.15.119:0/1817272833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8ea0036e60 0x7f8ea0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.647+0000 7f8eb1602640 1 -- 172.21.15.119:0/1817272833 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8fb8037c60 con 0x55abb7cb6360 2024-04-23T18:29:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.647+0000 7f8fbe992640 1 --2- 172.21.15.119:0/1817272833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8ea0036e60 0x7f8ea0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.647+0000 7f8fc9694800 1 Processor -- start 2024-04-23T18:29:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.647+0000 7f8fbe992640 1 --2- 172.21.15.119:0/1817272833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8ea0036e60 0x7f8ea0039320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55abb7c9c100 tx=0x7f8fb0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.647+0000 7f8fc9694800 1 -- start start 2024-04-23T18:29:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.648+0000 7f8fc9694800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cc34e0 0x55abb7cc3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.648+0000 7f8fc9694800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55abb7c93050 con 0x55abb7cc34e0 2024-04-23T18:29:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.648+0000 7f8fc7193640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cc34e0 0x55abb7cc3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.648+0000 7f8fc7193640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cc34e0 0x55abb7cc3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32992/0 (socket says 172.21.15.119:32992) 2024-04-23T18:29:32.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.648+0000 7f8fc7193640 1 -- 172.21.15.119:0/2113199432 learned_addr learned my addr 172.21.15.119:0/2113199432 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.648+0000 7f8fc7193640 1 -- 172.21.15.119:0/2113199432 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb7cc3ed0 con 0x55abb7cc34e0 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.648+0000 7f8fc7193640 1 --2- 172.21.15.119:0/2113199432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cc34e0 0x55abb7cc3900 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8fb801bfd0 tx=0x7f8fb8034550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f8d1e56b5774e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.648+0000 7f8eaaffd640 1 -- 172.21.15.119:0/2113199432 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb805b020 con 0x55abb7cc34e0 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.648+0000 7f8eaaffd640 1 -- 172.21.15.119:0/2113199432 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb804b6f0 con 0x55abb7cc34e0 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.648+0000 7f8eaaffd640 1 -- 172.21.15.119:0/2113199432 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb8035ce0 con 0x55abb7cc34e0 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.649+0000 7f8fc9694800 1 -- 172.21.15.119:0/2113199432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cc34e0 msgr2=0x55abb7cc3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.649+0000 7f8fc9694800 1 --2- 172.21.15.119:0/2113199432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cc34e0 0x55abb7cc3900 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8fb801bfd0 tx=0x7f8fb8034550 comp rx=0 tx=0).stop 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.649+0000 7f8fc9694800 1 -- 172.21.15.119:0/2113199432 shutdown_connections 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.649+0000 7f8fc9694800 1 --2- 172.21.15.119:0/2113199432 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cc34e0 0x55abb7cc3900 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.649+0000 7f8fc9694800 1 -- 172.21.15.119:0/2113199432 >> 172.21.15.119:0/2113199432 conn(0x55abb7cbf840 msgr2=0x55abb7cbd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.649+0000 7f8fc9694800 1 -- 172.21.15.119:0/2113199432 shutdown_connections 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.649+0000 7f8fc9694800 1 -- 172.21.15.119:0/2113199432 wait complete. 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.649+0000 7f8fc9694800 1 Processor -- start 2024-04-23T18:29:32.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.649+0000 7f8fc9694800 1 -- start start 2024-04-23T18:29:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.649+0000 7f8fc9694800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cc34e0 0x55abb7cca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.649+0000 7f8fc9694800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55abb7cc4580 con 0x55abb7cc34e0 2024-04-23T18:29:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.649+0000 7f8fc7193640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cc34e0 0x55abb7cca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.650+0000 7f8fc7193640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cc34e0 0x55abb7cca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:32996/0 (socket says 172.21.15.119:32996) 2024-04-23T18:29:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.650+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 learned_addr learned my addr 172.21.15.119:0/3032043431 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.650+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb7ccae80 con 0x55abb7cc34e0 2024-04-23T18:29:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.650+0000 7f8fc7193640 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cc34e0 0x55abb7cca940 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8040670 tx=0x7f8fb8039f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.650+0000 7f8ea97fa640 1 -- 172.21.15.119:0/3032043431 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb80401f0 con 0x55abb7cc34e0 2024-04-23T18:29:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.650+0000 7f8ea97fa640 1 -- 172.21.15.119:0/3032043431 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb8035750 con 0x55abb7cc34e0 2024-04-23T18:29:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.650+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abb7ccae80 con 0x55abb7cc34e0 2024-04-23T18:29:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.650+0000 7f8ea97fa640 1 -- 172.21.15.119:0/3032043431 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb8035ab0 con 0x55abb7cc34e0 2024-04-23T18:29:32.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.650+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb7ccae80 con 0x55abb7cc34e0 2024-04-23T18:29:32.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.651+0000 7f8ea97fa640 1 -- 172.21.15.119:0/3032043431 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8fb805e020 con 0x55abb7cc34e0 2024-04-23T18:29:32.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.651+0000 7f8ea97fa640 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e90036dc0 0x7f8e90039280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.651+0000 7f8ea97fa640 1 -- 172.21.15.119:0/3032043431 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8fb8069070 con 0x55abb7cc34e0 2024-04-23T18:29:32.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.651+0000 7f8fbe992640 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e90036dc0 0x7f8e90039280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.651+0000 7f8fc9694800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.651+0000 7f8fc9694800 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55abb7cd6050 0x55abb7cd8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.651+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd8c60 con 0x55abb7cd6050 2024-04-23T18:29:32.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.651+0000 7f8fc7994640 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55abb7cd6050 0x55abb7cd8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fbe992640 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e90036dc0 0x7f8e90039280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0052fd0 tx=0x7f8fb004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc7994640 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55abb7cd6050 0x55abb7cd8510 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7cd6050 2024-04-23T18:29:32.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc9694800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc9694800 20 realm 2024-04-23T18:29:32.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc9694800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9070 con 0x55abb7cd6050 2024-04-23T18:29:32.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7cd6050 2024-04-23T18:29:32.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc9694800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc9694800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:32.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc9694800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9940 con 0x55abb7cd6050 2024-04-23T18:29:32.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7cd6050 2024-04-23T18:29:32.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc9694800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc9694800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.652+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cd6050 2024-04-23T18:29:32.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.653+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7cd6050 2024-04-23T18:29:32.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.653+0000 7f8fc9694800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.653+0000 7f8fc9694800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.653+0000 7f8fc9694800 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55abb7cda7d0 0x55abb7cdcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.653+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cdd320 con 0x55abb7cda7d0 2024-04-23T18:29:32.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.653+0000 7f8fc7193640 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55abb7cda7d0 0x55abb7cdcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.653+0000 7f8fc7193640 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55abb7cda7d0 0x55abb7cdcbc0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.653+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8fb8052070 con 0x55abb7cda7d0 2024-04-23T18:29:32.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.653+0000 7f8fc9694800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:32.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.653+0000 7f8fc9694800 20 searching for the correct realm 2024-04-23T18:29:32.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.653+0000 7f8fc9694800 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55abb7cdf3d0 0x55abb7ce1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.653+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce1f60 con 0x55abb7cdf3d0 2024-04-23T18:29:32.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.653+0000 7f8fbe992640 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55abb7cdf3d0 0x55abb7ce1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.654+0000 7f8fbe992640 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55abb7cdf3d0 0x55abb7ce1890 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.654+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.654+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce1f60 con 0x55abb7cda7d0 2024-04-23T18:29:32.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.654+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb8052070 con 0x55abb7cda7d0 2024-04-23T18:29:32.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.654+0000 7f8fc7193640 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8fb8060050 0x7f8fb80082b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.654+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce1f60 con 0x7f8fb8060050 2024-04-23T18:29:32.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.655+0000 7f8fc7994640 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8fb8060050 0x7f8fb80082b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.655+0000 7f8fc7994640 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8fb8060050 0x7f8fb80082b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.655+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc000a4a0 con 0x7f8fb8060050 2024-04-23T18:29:32.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.655+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cd6050 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.656+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7cd6050 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.656+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cd6050 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.656+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7cd6050 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.656+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x7f8fb8060050 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.656+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc000a4a0 con 0x7f8fb8060050 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.656+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x7f8fb8060050 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.656+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8fc000a4a0 con 0x7f8fb8060050 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.656+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cda7d0 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.657+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb8052070 con 0x55abb7cda7d0 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.657+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cdf3d0 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.657+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.657+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cd6050 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.657+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7cd6050 2024-04-23T18:29:32.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.657+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x7f8fb8060050 2024-04-23T18:29:32.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.657+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc000a4a0 con 0x7f8fb8060050 2024-04-23T18:29:32.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.657+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cd6050 2024-04-23T18:29:32.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.658+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7cd6050 2024-04-23T18:29:32.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.658+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cda7d0 2024-04-23T18:29:32.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.658+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8fb8052070 con 0x55abb7cda7d0 2024-04-23T18:29:32.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.658+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cdf3d0 2024-04-23T18:29:32.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.658+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.658+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cdf3d0 2024-04-23T18:29:32.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.658+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.658+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x7f8fb8060050 2024-04-23T18:29:32.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.659+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc000a4a0 con 0x7f8fb8060050 2024-04-23T18:29:32.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.659+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cdf3d0 2024-04-23T18:29:32.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.659+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.659+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cdf3d0 2024-04-23T18:29:32.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.659+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.659+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cd6050 2024-04-23T18:29:32.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.659+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7cd6050 2024-04-23T18:29:32.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.659+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cd6050 2024-04-23T18:29:32.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.660+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7cd6050 2024-04-23T18:29:32.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.660+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x7f8fb8060050 2024-04-23T18:29:32.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.660+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc000a4a0 con 0x7f8fb8060050 2024-04-23T18:29:32.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.660+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cdf3d0 2024-04-23T18:29:32.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.660+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.660+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cda7d0 2024-04-23T18:29:32.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.661+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8fb8052070 con 0x55abb7cda7d0 2024-04-23T18:29:32.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.661+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cd6050 2024-04-23T18:29:32.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.661+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc000a4a0 con 0x55abb7cd6050 2024-04-23T18:29:32.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.661+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x7f8fb8060050 2024-04-23T18:29:32.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.661+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc000a4a0 con 0x7f8fb8060050 2024-04-23T18:29:32.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.661+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cdf3d0 2024-04-23T18:29:32.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.661+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.661+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x7f8fb8060050 2024-04-23T18:29:32.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.661+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc000a4a0 con 0x7f8fb8060050 2024-04-23T18:29:32.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.662+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cda7d0 2024-04-23T18:29:32.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.662+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb8052070 con 0x55abb7cda7d0 2024-04-23T18:29:32.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.662+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cdf3d0 2024-04-23T18:29:32.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.662+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.662+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x7f8fb8060050 2024-04-23T18:29:32.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.662+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fc0040040 con 0x7f8fb8060050 2024-04-23T18:29:32.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.662+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cd6050 2024-04-23T18:29:32.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.662+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8fc0040040 con 0x55abb7cd6050 2024-04-23T18:29:32.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.662+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cd9ce0 con 0x55abb7cda7d0 2024-04-23T18:29:32.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb808a040 con 0x55abb7cda7d0 2024-04-23T18:29:32.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:32.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:32.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:32.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:32.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:32.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:32.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cddcd0 con 0x55abb7cd6050 2024-04-23T18:29:32.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x55abb7cd6050 2024-04-23T18:29:32.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cddcd0 con 0x55abb7cd6050 2024-04-23T18:29:32.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fc0040040 con 0x55abb7cd6050 2024-04-23T18:29:32.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.663+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cddcd0 con 0x7f8fb8060050 2024-04-23T18:29:32.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8fc0040040 con 0x7f8fb8060050 2024-04-23T18:29:32.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc9694800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:32.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc9694800 20 zone default found 2024-04-23T18:29:32.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc9694800 4 Realm: () 2024-04-23T18:29:32.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc9694800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:32.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc9694800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:32.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc9694800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:32.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc9694800 20 zonegroup default 2024-04-23T18:29:32.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc9694800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cde0c0 con 0x7f8fb8060050 2024-04-23T18:29:32.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x7f8fb8060050 2024-04-23T18:29:32.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc9694800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc9694800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cde500 con 0x55abb7cdf3d0 2024-04-23T18:29:32.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.664+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.665+0000 7f8fc9694800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.665+0000 7f8fc9694800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.665+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cde940 con 0x55abb7cdf3d0 2024-04-23T18:29:32.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.665+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.665+0000 7f8fc9694800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.665+0000 7f8fc9694800 20 started sync module instance, tier type = 2024-04-23T18:29:32.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.665+0000 7f8fc9694800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:32.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.665+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce3260 con 0x55abb7cda7d0 2024-04-23T18:29:32.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.666+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb808a040 con 0x55abb7cda7d0 2024-04-23T18:29:32.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.666+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94196011513344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce3ed0 con 0x55abb7cda7d0 2024-04-23T18:29:32.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.666+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce4760 con 0x55abb7cd6050 2024-04-23T18:29:32.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.667+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94196011513344] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb808a040 con 0x55abb7cda7d0 2024-04-23T18:29:32.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.667+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x55abb7cd6050 2024-04-23T18:29:32.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.667+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94196011514400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce4b80 con 0x55abb7cd6050 2024-04-23T18:29:32.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.667+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce5580 con 0x55abb7cdf3d0 2024-04-23T18:29:32.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.668+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94196011514400] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x55abb7cd6050 2024-04-23T18:29:32.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.668+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.668+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94196011516528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce59a0 con 0x55abb7cdf3d0 2024-04-23T18:29:32.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.668+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce63c0 con 0x55abb7cda7d0 2024-04-23T18:29:32.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.669+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94196011516528] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.669+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb808a040 con 0x55abb7cda7d0 2024-04-23T18:29:32.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.669+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94196011523760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce67b0 con 0x55abb7cda7d0 2024-04-23T18:29:32.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.669+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce71b0 con 0x55abb7cd6050 2024-04-23T18:29:32.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.670+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x55abb7cd6050 2024-04-23T18:29:32.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.670+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94196011527360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce7140 con 0x55abb7cd6050 2024-04-23T18:29:32.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.670+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce8160 con 0x7f8fb8060050 2024-04-23T18:29:32.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.670+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94196011523760] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb808a040 con 0x55abb7cda7d0 2024-04-23T18:29:32.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.671+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x7f8fb8060050 2024-04-23T18:29:32.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.671+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94196011520144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce8160 con 0x7f8fb8060050 2024-04-23T18:29:32.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.671+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce8b70 con 0x7f8fb8060050 2024-04-23T18:29:32.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.671+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94196011527360] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x55abb7cd6050 2024-04-23T18:29:32.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.672+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(56 notify.6 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x7f8fb8060050 2024-04-23T18:29:32.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.672+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94196011529520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce8b70 con 0x7f8fb8060050 2024-04-23T18:29:32.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.672+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce9530 con 0x7f8fb8060050 2024-04-23T18:29:32.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.672+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94196011520144] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x7f8fb8060050 2024-04-23T18:29:32.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.673+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x7f8fb8060050 2024-04-23T18:29:32.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.673+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94196011529520] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x7f8fb8060050 2024-04-23T18:29:32.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.673+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94196011531328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce9080 con 0x7f8fb8060050 2024-04-23T18:29:32.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.673+0000 7f8fc9694800 20 add_watcher() i=0 2024-04-23T18:29:32.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.673+0000 7f8fc9694800 20 add_watcher() i=1 2024-04-23T18:29:32.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.673+0000 7f8fc9694800 20 add_watcher() i=2 2024-04-23T18:29:32.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.673+0000 7f8fc9694800 20 add_watcher() i=3 2024-04-23T18:29:32.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.673+0000 7f8fc9694800 20 add_watcher() i=4 2024-04-23T18:29:32.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.673+0000 7f8fc9694800 20 add_watcher() i=5 2024-04-23T18:29:32.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.673+0000 7f8fc9694800 20 add_watcher() i=6 2024-04-23T18:29:32.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.674+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94196011531328] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x7f8fb8060050 2024-04-23T18:29:32.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.674+0000 7f8fc9694800 20 add_watcher() i=7 2024-04-23T18:29:32.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.674+0000 7f8fc9694800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:32.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.674+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7cec560 con 0x55abb7cd6050 2024-04-23T18:29:32.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.674+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8fc0040040 con 0x55abb7cd6050 2024-04-23T18:29:32.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.675+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94196011536512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce9aa0 con 0x55abb7cd6050 2024-04-23T18:29:32.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.675+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94196011536512] v32'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x55abb7cd6050 2024-04-23T18:29:32.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.676+0000 7f8e7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.676+0000 7f8fc9694800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:32.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.676+0000 7f8fc9694800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:32.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.676+0000 7f8fc9694800 5 note: GC not initialized 2024-04-23T18:29:32.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.676+0000 7f8e7cfe1640 20 reqs_thread_entry: start 2024-04-23T18:29:32.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.676+0000 7f8fc9694800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:32.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.676+0000 7f8fc9694800 20 Filter name: none 2024-04-23T18:29:32.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.676+0000 7f8df67fc640 20 reqs_thread_entry: start 2024-04-23T18:29:32.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.676+0000 7f8fc9694800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.676+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abb7d1f6d0 con 0x55abb7cd6050 2024-04-23T18:29:32.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.677+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f8fc0040040 con 0x55abb7cd6050 2024-04-23T18:29:32.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.677+0000 7f8fc9694800 20 rados_obj.operate() r=0 bl.length=673 2024-04-23T18:29:32.683 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-23T18:29:32.546463Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:32.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.677+0000 7f8e7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.677+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94196011536512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7d1fc10 con 0x55abb7cd6050 2024-04-23T18:29:32.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.678+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94196011536512] v32'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x55abb7cd6050 2024-04-23T18:29:32.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.678+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94196011513344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce9080 con 0x55abb7cda7d0 2024-04-23T18:29:32.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.679+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94196011513344] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb808a040 con 0x55abb7cda7d0 2024-04-23T18:29:32.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.679+0000 7f8fc9694800 20 remove_watcher() i=0 2024-04-23T18:29:32.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.679+0000 7f8fc9694800 2 removed watcher, disabling cache 2024-04-23T18:29:32.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.679+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94196011514400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce3600 con 0x55abb7cd6050 2024-04-23T18:29:32.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.680+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94196011514400] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x55abb7cd6050 2024-04-23T18:29:32.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.680+0000 7f8fc9694800 20 remove_watcher() i=1 2024-04-23T18:29:32.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.680+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94196011516528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7d1fc10 con 0x55abb7cdf3d0 2024-04-23T18:29:32.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.681+0000 7f8fbe992640 1 -- 172.21.15.119:0/3032043431 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94196011516528] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb0081070 con 0x55abb7cdf3d0 2024-04-23T18:29:32.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.681+0000 7f8fc9694800 20 remove_watcher() i=2 2024-04-23T18:29:32.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.681+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94196011523760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce4270 con 0x55abb7cda7d0 2024-04-23T18:29:32.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.682+0000 7f8fc7193640 1 -- 172.21.15.119:0/3032043431 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94196011523760] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb808a040 con 0x55abb7cda7d0 2024-04-23T18:29:32.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.682+0000 7f8fc9694800 20 remove_watcher() i=3 2024-04-23T18:29:32.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.682+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94196011527360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce4270 con 0x55abb7cd6050 2024-04-23T18:29:32.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.683+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94196011527360] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x55abb7cd6050 2024-04-23T18:29:32.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.683+0000 7f8fc9694800 20 remove_watcher() i=4 2024-04-23T18:29:32.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.683+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94196011520144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce4270 con 0x7f8fb8060050 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.684+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94196011520144] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x7f8fb8060050 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.684+0000 7f8fc9694800 20 remove_watcher() i=5 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.684+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94196011529520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce5090 con 0x7f8fb8060050 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.685+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94196011529520] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x7f8fb8060050 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.685+0000 7f8fc9694800 20 remove_watcher() i=6 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.685+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94196011531328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abb7ce4270 con 0x7f8fb8060050 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94196011531328] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fc0040040 con 0x7f8fb8060050 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 20 remove_watcher() i=7 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8fb8060050 msgr2=0x7f8fb80082b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8fb8060050 0x7f8fb80082b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55abb7cd6050 msgr2=0x55abb7cd8510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55abb7cd6050 0x55abb7cd8510 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55abb7cda7d0 msgr2=0x55abb7cdcbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55abb7cda7d0 0x55abb7cdcbc0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55abb7cdf3d0 msgr2=0x55abb7ce1890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55abb7cdf3d0 0x55abb7ce1890 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e90036dc0 msgr2=0x7f8e90039280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e90036dc0 0x7f8e90039280 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0052fd0 tx=0x7f8fb004f000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cc34e0 msgr2=0x55abb7cca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 --2- 172.21.15.119:0/3032043431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cc34e0 0x55abb7cca940 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8040670 tx=0x7f8fb8039f90 comp rx=0 tx=0).stop 2024-04-23T18:29:32.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 reap_dead start 2024-04-23T18:29:32.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc7994640 1 -- 172.21.15.119:0/3032043431 reap_dead start 2024-04-23T18:29:32.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 shutdown_connections 2024-04-23T18:29:32.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 >> 172.21.15.119:0/3032043431 conn(0x55abb7cbf840 msgr2=0x55abb7cbcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.686+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 shutdown_connections 2024-04-23T18:29:32.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/3032043431 wait complete. 2024-04-23T18:29:32.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1817272833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8ea0036e60 msgr2=0x7f8ea0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1817272833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8ea0036e60 0x7f8ea0039320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55abb7c9c100 tx=0x7f8fb0005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:32.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1817272833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cb6360 msgr2=0x55abb7cb6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1817272833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cb6360 0x55abb7cb6780 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8016550 tx=0x7f8fb800db20 comp rx=0 tx=0).stop 2024-04-23T18:29:32.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1817272833 shutdown_connections 2024-04-23T18:29:32.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1817272833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8ea0036e60 0x7f8ea0039320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1817272833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7cb6360 0x55abb7cb6780 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1817272833 >> 172.21.15.119:0/1817272833 conn(0x55abb7caa400 msgr2=0x55abb7caa800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1817272833 shutdown_connections 2024-04-23T18:29:32.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1817272833 wait complete. 2024-04-23T18:29:32.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55abb7ca53c0 msgr2=0x55abb7ca7810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55abb7ca53c0 0x55abb7ca7810 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55abb7ba22e0 msgr2=0x55abb7c9ec10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55abb7ba22e0 0x55abb7c9ec10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55abb7ca1480 msgr2=0x55abb7ca3870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55abb7ca1480 0x55abb7ca3870 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8eac036e60 msgr2=0x7f8eac039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8eac036e60 0x7f8eac039320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0054000 tx=0x7f8fb004e000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7b9de50 msgr2=0x55abb7c97ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 --2- 172.21.15.119:0/1856291820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55abb7b9de50 0x55abb7c97ba0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8001e10 tx=0x7f8fb8000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc7994640 1 -- 172.21.15.119:0/1856291820 reap_dead start 2024-04-23T18:29:32.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 shutdown_connections 2024-04-23T18:29:32.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 >> 172.21.15.119:0/1856291820 conn(0x55abb7b99410 msgr2=0x55abb7c891e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 shutdown_connections 2024-04-23T18:29:32.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.687+0000 7f8fc9694800 1 -- 172.21.15.119:0/1856291820 wait complete. 2024-04-23T18:29:32.695 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-23T18:29:32.546463Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:32.695 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-23T18:29:32.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-23T18:29:32.695 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-04-23T18:29:32.774 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:32.774 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:32.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.782+0000 7f9911a1b800 1 Processor -- start 2024-04-23T18:29:32.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.782+0000 7f9911a1b800 1 -- start start 2024-04-23T18:29:32.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.782+0000 7f9911a1b800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f7e253fe80 0x55f7e25402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.782+0000 7f9911a1b800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f7e23f1560 con 0x55f7e25410e0 2024-04-23T18:29:32.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.782+0000 7f9911a1b800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55f7e23e2e20 con 0x55f7e253fe80 2024-04-23T18:29:32.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.783+0000 7f990f51a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f7e253fe80 0x55f7e25402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.783+0000 7f9906d19640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55f7e25410e0 0x55f7e2541560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40648/0 (socket says 172.21.15.119:40648) 2024-04-23T18:29:32.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.783+0000 7f9906d19640 1 -- 172.21.15.119:0/610531579 learned_addr learned my addr 172.21.15.119:0/610531579 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:32.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.783+0000 7f990f51a640 1 -- 172.21.15.119:0/610531579 >> v1:172.21.15.62:6789/0 conn(0x55f7e25410e0 legacy=0x55f7e2541560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.783+0000 7f990f51a640 1 -- 172.21.15.119:0/610531579 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7e23f0e60 con 0x55f7e253fe80 2024-04-23T18:29:32.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.785+0000 7f990f51a640 1 --2- 172.21.15.119:0/610531579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e25402a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f990000a470 tx=0x7f990001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b797d359c333ea2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.785+0000 7f990ed19640 1 -- 172.21.15.119:0/610531579 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9900057070 con 0x55f7e253fe80 2024-04-23T18:29:32.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.785+0000 7f990ed19640 1 -- 172.21.15.119:0/610531579 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9900052570 con 0x55f7e253fe80 2024-04-23T18:29:32.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.785+0000 7f990ed19640 1 -- 172.21.15.119:0/610531579 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9900052870 con 0x55f7e253fe80 2024-04-23T18:29:32.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.785+0000 7f9911a1b800 1 -- 172.21.15.119:0/610531579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 msgr2=0x55f7e25402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.785+0000 7f9911a1b800 1 --2- 172.21.15.119:0/610531579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e25402a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f990000a470 tx=0x7f990001ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:32.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.785+0000 7f9911a1b800 1 -- 172.21.15.119:0/610531579 shutdown_connections 2024-04-23T18:29:32.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.785+0000 7f9911a1b800 1 --2- 172.21.15.119:0/610531579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e25402a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.785+0000 7f9911a1b800 1 -- 172.21.15.119:0/610531579 >> 172.21.15.119:0/610531579 conn(0x55f7e253b440 msgr2=0x55f7e253d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.786+0000 7f9911a1b800 1 -- 172.21.15.119:0/610531579 shutdown_connections 2024-04-23T18:29:32.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.786+0000 7f9911a1b800 1 -- 172.21.15.119:0/610531579 wait complete. 2024-04-23T18:29:32.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.797+0000 7f9911a1b800 1 Processor -- start 2024-04-23T18:29:32.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.797+0000 7f9911a1b800 1 -- start start 2024-04-23T18:29:32.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.797+0000 7f9911a1b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e24b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.797+0000 7f9911a1b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f7e248c5d0 con 0x55f7e253fe80 2024-04-23T18:29:32.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.798+0000 7f990f51a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e24b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.798+0000 7f990f51a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e24b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33028/0 (socket says 172.21.15.119:33028) 2024-04-23T18:29:32.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.798+0000 7f990f51a640 1 -- 172.21.15.119:0/1990514296 learned_addr learned my addr 172.21.15.119:0/1990514296 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.798+0000 7f990f51a640 1 -- 172.21.15.119:0/1990514296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7e2402860 con 0x55f7e253fe80 2024-04-23T18:29:32.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.798+0000 7f990f51a640 1 --2- 172.21.15.119:0/1990514296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e24b3e80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9900055040 tx=0x7f990004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ec982912434ccb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.798+0000 7f97fd60a640 1 -- 172.21.15.119:0/1990514296 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9900057070 con 0x55f7e253fe80 2024-04-23T18:29:32.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.798+0000 7f97fd60a640 1 -- 172.21.15.119:0/1990514296 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9900063070 con 0x55f7e253fe80 2024-04-23T18:29:32.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.798+0000 7f97fd60a640 1 -- 172.21.15.119:0/1990514296 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9900052720 con 0x55f7e253fe80 2024-04-23T18:29:32.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.799+0000 7f9911a1b800 1 -- 172.21.15.119:0/1990514296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 msgr2=0x55f7e24b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.799+0000 7f9911a1b800 1 --2- 172.21.15.119:0/1990514296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e24b3e80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9900055040 tx=0x7f990004c000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.799+0000 7f9911a1b800 1 -- 172.21.15.119:0/1990514296 shutdown_connections 2024-04-23T18:29:32.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.799+0000 7f9911a1b800 1 --2- 172.21.15.119:0/1990514296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e24b3e80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.799+0000 7f9911a1b800 1 -- 172.21.15.119:0/1990514296 >> 172.21.15.119:0/1990514296 conn(0x55f7e253b440 msgr2=0x55f7e262ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.799+0000 7f9911a1b800 1 -- 172.21.15.119:0/1990514296 shutdown_connections 2024-04-23T18:29:32.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.799+0000 7f9911a1b800 1 -- 172.21.15.119:0/1990514296 wait complete. 2024-04-23T18:29:32.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.799+0000 7f9911a1b800 1 Processor -- start 2024-04-23T18:29:32.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.799+0000 7f9911a1b800 1 -- start start 2024-04-23T18:29:32.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.799+0000 7f9911a1b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e2639f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.799+0000 7f9911a1b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f7e2549550 con 0x55f7e253fe80 2024-04-23T18:29:32.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.800+0000 7f990f51a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e2639f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.800+0000 7f990f51a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e2639f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33044/0 (socket says 172.21.15.119:33044) 2024-04-23T18:29:32.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.800+0000 7f990f51a640 1 -- 172.21.15.119:0/969994954 learned_addr learned my addr 172.21.15.119:0/969994954 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.800+0000 7f990f51a640 1 -- 172.21.15.119:0/969994954 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7e2400eb0 con 0x55f7e253fe80 2024-04-23T18:29:32.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.800+0000 7f990f51a640 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e2639f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9900060040 tx=0x7f9900002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.800+0000 7f97fbe07640 1 -- 172.21.15.119:0/969994954 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9900052c70 con 0x55f7e253fe80 2024-04-23T18:29:32.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.800+0000 7f97fbe07640 1 -- 172.21.15.119:0/969994954 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990006c070 con 0x55f7e253fe80 2024-04-23T18:29:32.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.800+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7e263a460 con 0x55f7e253fe80 2024-04-23T18:29:32.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.800+0000 7f97fbe07640 1 -- 172.21.15.119:0/969994954 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f990005e480 con 0x55f7e253fe80 2024-04-23T18:29:32.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.800+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7e263a9e0 con 0x55f7e253fe80 2024-04-23T18:29:32.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.801+0000 7f97fbe07640 1 -- 172.21.15.119:0/969994954 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f990005e620 con 0x55f7e253fe80 2024-04-23T18:29:32.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.801+0000 7f97fbe07640 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97f4036e60 0x7f97f4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.801+0000 7f97fbe07640 1 -- 172.21.15.119:0/969994954 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f990008ee30 con 0x55f7e253fe80 2024-04-23T18:29:32.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.801+0000 7f9906d19640 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97f4036e60 0x7f97f4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.801+0000 7f9911a1b800 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f7e25410e0 0x55f7e2640f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.801+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2641560 con 0x55f7e25410e0 2024-04-23T18:29:32.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.802+0000 7f990fd1b640 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f7e25410e0 0x55f7e2640f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.802+0000 7f9906d19640 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97f4036e60 0x7f97f4039320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f98f8000f60 tx=0x7f98f80012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.802+0000 7f990fd1b640 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f7e25410e0 0x55f7e2640f90 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.802+0000 7f990fd1b640 1 -- 172.21.15.119:0/969994954 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e25410e0 2024-04-23T18:29:32.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.802+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e263e560 con 0x55f7e25410e0 2024-04-23T18:29:32.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.802+0000 7f990fd1b640 1 -- 172.21.15.119:0/969994954 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e25410e0 2024-04-23T18:29:32.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.802+0000 7f9911a1b800 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f7e2643890 0x55f7e2645c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.802+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2646320 con 0x55f7e2643890 2024-04-23T18:29:32.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.802+0000 7f990f51a640 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f7e2643890 0x55f7e2645c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.803+0000 7f990f51a640 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f7e2643890 0x55f7e2645c80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.803+0000 7f990f51a640 1 -- 172.21.15.119:0/969994954 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9900068780 con 0x55f7e2643890 2024-04-23T18:29:32.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.803+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2642840 con 0x55f7e25410e0 2024-04-23T18:29:32.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.803+0000 7f990fd1b640 1 -- 172.21.15.119:0/969994954 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e25410e0 2024-04-23T18:29:32.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.803+0000 7f9911a1b800 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f7e26477d0 0x55f7e2649c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.803+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e264a380 con 0x55f7e26477d0 2024-04-23T18:29:32.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.804+0000 7f9906d19640 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f7e26477d0 0x55f7e2649c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.804+0000 7f9906d19640 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f7e26477d0 0x55f7e2649c20 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.804+0000 7f9906d19640 1 -- 172.21.15.119:0/969994954 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e26477d0 2024-04-23T18:29:32.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.805+0000 7f9911a1b800 1 Processor -- start 2024-04-23T18:29:32.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.805+0000 7f9911a1b800 1 -- start start 2024-04-23T18:29:32.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.805+0000 7f9911a1b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2632f30 0x55f7e26313a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.805+0000 7f9911a1b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f7e2432df0 con 0x55f7e2632f30 2024-04-23T18:29:32.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.805+0000 7f990f51a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2632f30 0x55f7e26313a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.805+0000 7f990f51a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2632f30 0x55f7e26313a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33046/0 (socket says 172.21.15.119:33046) 2024-04-23T18:29:32.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.805+0000 7f990f51a640 1 -- 172.21.15.119:0/1328544612 learned_addr learned my addr 172.21.15.119:0/1328544612 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.805+0000 7f990f51a640 1 -- 172.21.15.119:0/1328544612 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7e26318e0 con 0x55f7e2632f30 2024-04-23T18:29:32.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.806+0000 7f990f51a640 1 --2- 172.21.15.119:0/1328544612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2632f30 0x55f7e26313a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f990008d2e0 tx=0x7f990007d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.806+0000 7f97f9602640 1 -- 172.21.15.119:0/1328544612 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9900081040 con 0x55f7e2632f30 2024-04-23T18:29:32.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.806+0000 7f97f9602640 1 -- 172.21.15.119:0/1328544612 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9900058040 con 0x55f7e2632f30 2024-04-23T18:29:32.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.806+0000 7f9911a1b800 1 -- 172.21.15.119:0/1328544612 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7e2631b70 con 0x55f7e2632f30 2024-04-23T18:29:32.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.806+0000 7f97f9602640 1 -- 172.21.15.119:0/1328544612 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f990007aa70 con 0x55f7e2632f30 2024-04-23T18:29:32.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.806+0000 7f9911a1b800 1 -- 172.21.15.119:0/1328544612 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7e2632070 con 0x55f7e2632f30 2024-04-23T18:29:32.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.806+0000 7f97f9602640 1 -- 172.21.15.119:0/1328544612 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9900092070 con 0x55f7e2632f30 2024-04-23T18:29:32.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.807+0000 7f97f9602640 1 --2- 172.21.15.119:0/1328544612 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97e8036eb0 0x7f97e8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.807+0000 7f97f9602640 1 -- 172.21.15.119:0/1328544612 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f9900095c90 con 0x55f7e2632f30 2024-04-23T18:29:32.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.807+0000 7f9906d19640 1 --2- 172.21.15.119:0/1328544612 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97e8036eb0 0x7f97e8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.807+0000 7f9911a1b800 1 Processor -- start 2024-04-23T18:29:32.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.807+0000 7f9906d19640 1 --2- 172.21.15.119:0/1328544612 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97e8036eb0 0x7f97e8039370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f98f800bf50 tx=0x7f98f800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.807+0000 7f9911a1b800 1 -- start start 2024-04-23T18:29:32.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.807+0000 7f9911a1b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 0x55f7e2667f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.807+0000 7f9911a1b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f7e2635460 con 0x55f7e2667b20 2024-04-23T18:29:32.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.807+0000 7f990f51a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 0x55f7e2667f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.807+0000 7f990f51a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 0x55f7e2667f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33050/0 (socket says 172.21.15.119:33050) 2024-04-23T18:29:32.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.807+0000 7f990f51a640 1 -- 172.21.15.119:0/2195288560 learned_addr learned my addr 172.21.15.119:0/2195288560 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.808+0000 7f990f51a640 1 -- 172.21.15.119:0/2195288560 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7e2668510 con 0x55f7e2667b20 2024-04-23T18:29:32.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.808+0000 7f990f51a640 1 --2- 172.21.15.119:0/2195288560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 0x55f7e2667f40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9900052520 tx=0x7f990007d580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4dbe8044f4e2582 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.808+0000 7f97f2ffd640 1 -- 172.21.15.119:0/2195288560 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f990005e910 con 0x55f7e2667b20 2024-04-23T18:29:32.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.808+0000 7f97f2ffd640 1 -- 172.21.15.119:0/2195288560 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9900055a30 con 0x55f7e2667b20 2024-04-23T18:29:32.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.808+0000 7f97f2ffd640 1 -- 172.21.15.119:0/2195288560 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f990005eab0 con 0x55f7e2667b20 2024-04-23T18:29:32.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.808+0000 7f9911a1b800 1 -- 172.21.15.119:0/2195288560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 msgr2=0x55f7e2667f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.808+0000 7f9911a1b800 1 --2- 172.21.15.119:0/2195288560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 0x55f7e2667f40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9900052520 tx=0x7f990007d580 comp rx=0 tx=0).stop 2024-04-23T18:29:32.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.808+0000 7f9911a1b800 1 -- 172.21.15.119:0/2195288560 shutdown_connections 2024-04-23T18:29:32.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.808+0000 7f9911a1b800 1 --2- 172.21.15.119:0/2195288560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 0x55f7e2667f40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.808+0000 7f9911a1b800 1 -- 172.21.15.119:0/2195288560 >> 172.21.15.119:0/2195288560 conn(0x55f7e2663e80 msgr2=0x55f7e2661ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.808+0000 7f9911a1b800 1 -- 172.21.15.119:0/2195288560 shutdown_connections 2024-04-23T18:29:32.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.808+0000 7f9911a1b800 1 -- 172.21.15.119:0/2195288560 wait complete. 2024-04-23T18:29:32.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.809+0000 7f9911a1b800 1 Processor -- start 2024-04-23T18:29:32.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.809+0000 7f9911a1b800 1 -- start start 2024-04-23T18:29:32.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.809+0000 7f9911a1b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 0x55f7e266ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.809+0000 7f9911a1b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f7e2668bc0 con 0x55f7e2667b20 2024-04-23T18:29:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.809+0000 7f990f51a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 0x55f7e266ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.809+0000 7f990f51a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 0x55f7e266ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33066/0 (socket says 172.21.15.119:33066) 2024-04-23T18:29:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.809+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 learned_addr learned my addr 172.21.15.119:0/383669195 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.809+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7e266f460 con 0x55f7e2667b20 2024-04-23T18:29:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.809+0000 7f990f51a640 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 0x55f7e266ef20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f990006d000 tx=0x7f9900082ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.810+0000 7f97f17fa640 1 -- 172.21.15.119:0/383669195 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99000ba070 con 0x55f7e2667b20 2024-04-23T18:29:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.810+0000 7f97f17fa640 1 -- 172.21.15.119:0/383669195 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990008e7b0 con 0x55f7e2667b20 2024-04-23T18:29:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.810+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7e266f460 con 0x55f7e2667b20 2024-04-23T18:29:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.810+0000 7f97f17fa640 1 -- 172.21.15.119:0/383669195 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f990008eab0 con 0x55f7e2667b20 2024-04-23T18:29:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.810+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7e266f460 con 0x55f7e2667b20 2024-04-23T18:29:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.811+0000 7f97f17fa640 1 -- 172.21.15.119:0/383669195 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f99000bd070 con 0x55f7e2667b20 2024-04-23T18:29:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.811+0000 7f97f17fa640 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97d8036e60 0x7f97d8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.811+0000 7f97f17fa640 1 -- 172.21.15.119:0/383669195 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f99000a6070 con 0x55f7e2667b20 2024-04-23T18:29:32.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.811+0000 7f9906d19640 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97d8036e60 0x7f97d8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.811+0000 7f9911a1b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.811+0000 7f9911a1b800 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f7e267a6b0 0x55f7e267cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.811+0000 7f9906d19640 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97d8036e60 0x7f97d8039320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f98f8001b60 tx=0x7f98f8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.811+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267d2c0 con 0x55f7e267a6b0 2024-04-23T18:29:32.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.811+0000 7f990fd1b640 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f7e267a6b0 0x55f7e267cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f990fd1b640 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f7e267a6b0 0x55f7e267cb70 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e267a6b0 2024-04-23T18:29:32.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f9911a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f9911a1b800 20 realm 2024-04-23T18:29:32.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f9911a1b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267d6d0 con 0x55f7e267a6b0 2024-04-23T18:29:32.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e267a6b0 2024-04-23T18:29:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f9911a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f9911a1b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f9911a1b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267dfa0 con 0x55f7e267a6b0 2024-04-23T18:29:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e267a6b0 2024-04-23T18:29:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f9911a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f9911a1b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267a6b0 2024-04-23T18:29:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e267a6b0 2024-04-23T18:29:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.812+0000 7f9911a1b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.813+0000 7f9911a1b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.813+0000 7f9911a1b800 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f7e267f0a0 0x55f7e2681490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.813+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2681aa0 con 0x55f7e267f0a0 2024-04-23T18:29:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.813+0000 7f990f51a640 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f7e267f0a0 0x55f7e2681490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.813+0000 7f990f51a640 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f7e267f0a0 0x55f7e2681490 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.813+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f99000bc030 con 0x55f7e267f0a0 2024-04-23T18:29:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.813+0000 7f9911a1b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.813+0000 7f9911a1b800 20 searching for the correct realm 2024-04-23T18:29:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.813+0000 7f9911a1b800 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f7e2683a70 0x55f7e2685f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.813+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e26865d0 con 0x55f7e2683a70 2024-04-23T18:29:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.813+0000 7f9906d19640 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f7e2683a70 0x55f7e2685f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.814+0000 7f9906d19640 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f7e2683a70 0x55f7e2685f00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.814+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.814+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e26865d0 con 0x55f7e267f0a0 2024-04-23T18:29:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.814+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99000bc030 con 0x55f7e267f0a0 2024-04-23T18:29:32.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.814+0000 7f990f51a640 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f99000bf060 0x7f99000c0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.814+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e26865d0 con 0x7f99000bf060 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.814+0000 7f990fd1b640 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f99000bf060 0x7f99000c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.815+0000 7f990fd1b640 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f99000bf060 0x7f99000c0450 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.815+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990800a4a0 con 0x7f99000bf060 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.815+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267a6b0 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.815+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e267a6b0 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.815+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267a6b0 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.815+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e267a6b0 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.815+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x7f99000bf060 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.816+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990800a4a0 con 0x7f99000bf060 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.816+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x7f99000bf060 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.816+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f990800a4a0 con 0x7f99000bf060 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.816+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267f0a0 2024-04-23T18:29:32.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.816+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99000bc030 con 0x55f7e267f0a0 2024-04-23T18:29:32.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.816+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e2683a70 2024-04-23T18:29:32.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.816+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.816+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267a6b0 2024-04-23T18:29:32.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.816+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e267a6b0 2024-04-23T18:29:32.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.817+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x7f99000bf060 2024-04-23T18:29:32.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.817+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990800a4a0 con 0x7f99000bf060 2024-04-23T18:29:32.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.817+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267a6b0 2024-04-23T18:29:32.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.817+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e267a6b0 2024-04-23T18:29:32.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.817+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267f0a0 2024-04-23T18:29:32.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.817+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f99000bc030 con 0x55f7e267f0a0 2024-04-23T18:29:32.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.817+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e2683a70 2024-04-23T18:29:32.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.817+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.817+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e2683a70 2024-04-23T18:29:32.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.818+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.818+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x7f99000bf060 2024-04-23T18:29:32.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.818+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990800a4a0 con 0x7f99000bf060 2024-04-23T18:29:32.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.818+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e2683a70 2024-04-23T18:29:32.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.818+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.818+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e2683a70 2024-04-23T18:29:32.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.818+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.818+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267a6b0 2024-04-23T18:29:32.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.819+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e267a6b0 2024-04-23T18:29:32.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.819+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267a6b0 2024-04-23T18:29:32.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.819+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e267a6b0 2024-04-23T18:29:32.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.819+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x7f99000bf060 2024-04-23T18:29:32.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.819+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990800a4a0 con 0x7f99000bf060 2024-04-23T18:29:32.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.819+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e2683a70 2024-04-23T18:29:32.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.819+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.819+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267f0a0 2024-04-23T18:29:32.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.820+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f99000bc030 con 0x55f7e267f0a0 2024-04-23T18:29:32.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.820+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267a6b0 2024-04-23T18:29:32.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.820+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990800a4a0 con 0x55f7e267a6b0 2024-04-23T18:29:32.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.820+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x7f99000bf060 2024-04-23T18:29:32.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.820+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990800a4a0 con 0x7f99000bf060 2024-04-23T18:29:32.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.820+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e2683a70 2024-04-23T18:29:32.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.821+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.821+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x7f99000bf060 2024-04-23T18:29:32.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.821+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990800a4a0 con 0x7f99000bf060 2024-04-23T18:29:32.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.821+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267f0a0 2024-04-23T18:29:32.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.821+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99000bc030 con 0x55f7e267f0a0 2024-04-23T18:29:32.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.821+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e2683a70 2024-04-23T18:29:32.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.821+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.821+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x7f99000bf060 2024-04-23T18:29:32.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.822+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908040040 con 0x7f99000bf060 2024-04-23T18:29:32.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.822+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267a6b0 2024-04-23T18:29:32.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.822+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.822+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7e267e340 con 0x55f7e267f0a0 2024-04-23T18:29:32.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99000d5040 con 0x55f7e267f0a0 2024-04-23T18:29:32.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:32.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:32.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:32.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:32.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:32.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2682360 con 0x55f7e267a6b0 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2682360 con 0x55f7e267a6b0 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.823+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2682360 con 0x7f99000bf060 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9908040040 con 0x7f99000bf060 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 20 zone default found 2024-04-23T18:29:32.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 4 Realm: () 2024-04-23T18:29:32.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:32.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:32.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:32.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 20 zonegroup default 2024-04-23T18:29:32.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2682c50 con 0x7f99000bf060 2024-04-23T18:29:32.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9908040040 con 0x7f99000bf060 2024-04-23T18:29:32.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2682c50 con 0x55f7e2683a70 2024-04-23T18:29:32.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2688430 con 0x55f7e2683a70 2024-04-23T18:29:32.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 20 started sync module instance, tier type = 2024-04-23T18:29:32.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:32.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.824+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e26878d0 con 0x55f7e267f0a0 2024-04-23T18:29:32.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.825+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99000d5040 con 0x55f7e267f0a0 2024-04-23T18:29:32.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.825+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94523143779360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e26887d0 con 0x55f7e267f0a0 2024-04-23T18:29:32.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.825+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e26890a0 con 0x55f7e267a6b0 2024-04-23T18:29:32.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.826+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94523143779360] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99000d5040 con 0x55f7e267f0a0 2024-04-23T18:29:32.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.827+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.827+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94523143785328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2689490 con 0x55f7e267a6b0 2024-04-23T18:29:32.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.827+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2689f00 con 0x55f7e2683a70 2024-04-23T18:29:32.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.828+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94523143785328] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.828+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.828+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94523143789008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268a2f0 con 0x55f7e2683a70 2024-04-23T18:29:32.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.828+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268ad10 con 0x55f7e267f0a0 2024-04-23T18:29:32.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.829+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99000d5040 con 0x55f7e267f0a0 2024-04-23T18:29:32.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.829+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94523143789008] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.829+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94523143792640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268b5e0 con 0x55f7e267f0a0 2024-04-23T18:29:32.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.829+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268bfa0 con 0x55f7e267a6b0 2024-04-23T18:29:32.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.830+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.830+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94523143797488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268c3c0 con 0x55f7e267a6b0 2024-04-23T18:29:32.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.830+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94523143792640] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99000d5040 con 0x55f7e267f0a0 2024-04-23T18:29:32.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.830+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268ce80 con 0x7f99000bf060 2024-04-23T18:29:32.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.831+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x7f99000bf060 2024-04-23T18:29:32.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.831+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94523143801168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268ce40 con 0x7f99000bf060 2024-04-23T18:29:32.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.831+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268d890 con 0x7f99000bf060 2024-04-23T18:29:32.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.831+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94523143797488] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.832+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94523143801168] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x7f99000bf060 2024-04-23T18:29:32.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.832+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x7f99000bf060 2024-04-23T18:29:32.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.832+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94523143794992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268d3e0 con 0x7f99000bf060 2024-04-23T18:29:32.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.832+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268dcd0 con 0x7f99000bf060 2024-04-23T18:29:32.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.833+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94523143794992] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x7f99000bf060 2024-04-23T18:29:32.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.833+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x7f99000bf060 2024-04-23T18:29:32.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.833+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94523143798544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268dc90 con 0x7f99000bf060 2024-04-23T18:29:32.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.833+0000 7f9911a1b800 20 add_watcher() i=0 2024-04-23T18:29:32.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.833+0000 7f9911a1b800 20 add_watcher() i=1 2024-04-23T18:29:32.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.833+0000 7f9911a1b800 20 add_watcher() i=2 2024-04-23T18:29:32.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.833+0000 7f9911a1b800 20 add_watcher() i=3 2024-04-23T18:29:32.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.833+0000 7f9911a1b800 20 add_watcher() i=4 2024-04-23T18:29:32.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.833+0000 7f9911a1b800 20 add_watcher() i=5 2024-04-23T18:29:32.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.833+0000 7f9911a1b800 20 add_watcher() i=6 2024-04-23T18:29:32.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.834+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94523143798544] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x7f99000bf060 2024-04-23T18:29:32.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.834+0000 7f9911a1b800 20 add_watcher() i=7 2024-04-23T18:29:32.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.834+0000 7f9911a1b800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:32.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.834+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2691120 con 0x55f7e267a6b0 2024-04-23T18:29:32.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.834+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.834+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94523143804160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268e670 con 0x55f7e267a6b0 2024-04-23T18:29:32.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.835+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94523143804160] v32'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.835+0000 7f97c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.835+0000 7f9911a1b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:32.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.835+0000 7f9911a1b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:32.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.835+0000 7f9911a1b800 5 note: GC not initialized 2024-04-23T18:29:32.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.836+0000 7f97c4fe1640 20 reqs_thread_entry: start 2024-04-23T18:29:32.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.836+0000 7f9911a1b800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:32.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.836+0000 7f9911a1b800 20 Filter name: none 2024-04-23T18:29:32.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.836+0000 7f973e7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:32.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.836+0000 7f9911a1b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:32.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.836+0000 7f9911a1b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.836+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e26c48f0 con 0x55f7e267a6b0 2024-04-23T18:29:32.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.836+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.836+0000 7f9911a1b800 20 rados_obj.operate() r=0 bl.length=673 2024-04-23T18:29:32.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.836+0000 7f9911a1b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:32.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.836+0000 7f9911a1b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.836+0000 7f9911a1b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.836+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e26cb4c0 con 0x55f7e267a6b0 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.837+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.837+0000 7f9911a1b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.837+0000 7f9911a1b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.837+0000 7f9911a1b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.837+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94523144056624 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e26c6c30 con 0x55f7e267a6b0 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.838+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify (1) cookie 94523143797488 notify 137438953480 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f9908018df0 con 0x55f7e267a6b0 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.838+0000 7f97f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94523143797488 notifier 4399 bl.length()=758 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.838+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(64 notify.4 [notify cookie 94523144056624 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.838+0000 7f97f2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.838+0000 7f97f2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.838+0000 7f97f2ffd640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f97d4003ea0 con 0x55f7e267a6b0 2024-04-23T18:29:32.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.838+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.838+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify_complete (2) cookie 94523144056624 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9908046450 con 0x55f7e267a6b0 2024-04-23T18:29:32.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.838+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e26caf30 con 0x55f7e267a6b0 2024-04-23T18:29:32.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.839+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(66 foo:foo1 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.839+0000 7f9911a1b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-23T18:29:32.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.839+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94523144056624 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7e26c6780 con 0x55f7e267f0a0 2024-04-23T18:29:32.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.839+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== watch-notify(notify (1) cookie 94523143779360 notify 137438953476 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55f7e2631b70 con 0x55f7e267f0a0 2024-04-23T18:29:32.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.839+0000 7f97f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94523143779360 notifier 4399 bl.length()=159 2024-04-23T18:29:32.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.839+0000 7f97f2ffd640 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f97d4003ea0 con 0x55f7e267f0a0 2024-04-23T18:29:32.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.839+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(67 notify.0 [notify cookie 94523144056624 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f99000d5040 con 0x55f7e267f0a0 2024-04-23T18:29:32.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.840+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== watch-notify(notify_complete (2) cookie 94523144056624 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f7e26318e0 con 0x55f7e267f0a0 2024-04-23T18:29:32.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.840+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99000d5040 con 0x55f7e267f0a0 2024-04-23T18:29:32.845 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-23T18:29:32.546463Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:32.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.840+0000 7f97c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.840+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94523143804160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e26907d0 con 0x55f7e267a6b0 2024-04-23T18:29:32.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.841+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94523143804160] v32'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.841+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94523143779360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268d500 con 0x55f7e267f0a0 2024-04-23T18:29:32.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.842+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94523143779360] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99000d5040 con 0x55f7e267f0a0 2024-04-23T18:29:32.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.842+0000 7f9911a1b800 20 remove_watcher() i=0 2024-04-23T18:29:32.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.842+0000 7f9911a1b800 2 removed watcher, disabling cache 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.842+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94523143785328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2687420 con 0x55f7e267a6b0 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.843+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94523143785328] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.843+0000 7f9911a1b800 20 remove_watcher() i=1 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.843+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94523143789008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2687420 con 0x55f7e2683a70 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.844+0000 7f9906d19640 1 -- 172.21.15.119:0/383669195 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94523143789008] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98f8009050 con 0x55f7e2683a70 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.844+0000 7f9911a1b800 20 remove_watcher() i=2 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.844+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94523143792640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2688b70 con 0x55f7e267f0a0 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.845+0000 7f990f51a640 1 -- 172.21.15.119:0/383669195 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94523143792640] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99000d5040 con 0x55f7e267f0a0 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.845+0000 7f9911a1b800 20 remove_watcher() i=3 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.845+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94523143797488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e2688b70 con 0x55f7e267a6b0 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.846+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94523143797488] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x55f7e267a6b0 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.846+0000 7f9911a1b800 20 remove_watcher() i=4 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.846+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94523143801168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268baf0 con 0x7f99000bf060 2024-04-23T18:29:32.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.847+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94523143801168] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x7f99000bf060 2024-04-23T18:29:32.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.847+0000 7f9911a1b800 20 remove_watcher() i=5 2024-04-23T18:29:32.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.847+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94523143794992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268c950 con 0x7f99000bf060 2024-04-23T18:29:32.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.848+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94523143794992] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x7f99000bf060 2024-04-23T18:29:32.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.848+0000 7f9911a1b800 20 remove_watcher() i=6 2024-04-23T18:29:32.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.848+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94523143798544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7e268baf0 con 0x7f99000bf060 2024-04-23T18:29:32.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.849+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94523143798544] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908040040 con 0x7f99000bf060 2024-04-23T18:29:32.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.849+0000 7f9911a1b800 20 remove_watcher() i=7 2024-04-23T18:29:32.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.849+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f99000bf060 msgr2=0x7f99000c0450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.849+0000 7f9911a1b800 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f99000bf060 0x7f99000c0450 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.849+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f7e267a6b0 msgr2=0x55f7e267cb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.849+0000 7f9911a1b800 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f7e267a6b0 0x55f7e267cb70 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.849+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f7e267f0a0 msgr2=0x55f7e2681490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.849+0000 7f9911a1b800 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f7e267f0a0 0x55f7e2681490 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.849+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f7e2683a70 msgr2=0x55f7e2685f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.849+0000 7f9911a1b800 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f7e2683a70 0x55f7e2685f00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97d8036e60 msgr2=0x7f97d8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97d8036e60 0x7f97d8039320 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f98f8001b60 tx=0x7f98f8010000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 msgr2=0x55f7e266ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f990fd1b640 1 -- 172.21.15.119:0/383669195 reap_dead start 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 0x55f7e266ef20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f990006d000 tx=0x7f9900082ea0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 shutdown_connections 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 --2- 172.21.15.119:0/383669195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2667b20 0x55f7e266ef20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 >> 172.21.15.119:0/383669195 conn(0x55f7e2663e80 msgr2=0x55f7e26614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 shutdown_connections 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/383669195 wait complete. 2024-04-23T18:29:32.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/1328544612 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97e8036eb0 msgr2=0x7f97e8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 --2- 172.21.15.119:0/1328544612 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97e8036eb0 0x7f97e8039370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f98f800bf50 tx=0x7f98f800f000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/1328544612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2632f30 msgr2=0x55f7e26313a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 --2- 172.21.15.119:0/1328544612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2632f30 0x55f7e26313a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f990008d2e0 tx=0x7f990007d380 comp rx=0 tx=0).stop 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/1328544612 shutdown_connections 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 --2- 172.21.15.119:0/1328544612 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97e8036eb0 0x7f97e8039370 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 --2- 172.21.15.119:0/1328544612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e2632f30 0x55f7e26313a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/1328544612 >> 172.21.15.119:0/1328544612 conn(0x55f7e264c880 msgr2=0x55f7e264cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/1328544612 shutdown_connections 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/1328544612 wait complete. 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f7e26477d0 msgr2=0x55f7e2649c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f7e26477d0 0x55f7e2649c20 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f7e25410e0 msgr2=0x55f7e2640f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f7e25410e0 0x55f7e2640f90 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f7e2643890 msgr2=0x55f7e2645c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.850+0000 7f9911a1b800 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f7e2643890 0x55f7e2645c80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.851+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97f4036e60 msgr2=0x7f97f4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.851+0000 7f9911a1b800 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f97f4036e60 0x7f97f4039320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f98f8000f60 tx=0x7f98f80012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.851+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 msgr2=0x55f7e2639f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.851+0000 7f9911a1b800 1 --2- 172.21.15.119:0/969994954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f7e253fe80 0x55f7e2639f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9900060040 tx=0x7f9900002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.851+0000 7f990fd1b640 1 -- 172.21.15.119:0/969994954 reap_dead start 2024-04-23T18:29:32.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.851+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 shutdown_connections 2024-04-23T18:29:32.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.851+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 >> 172.21.15.119:0/969994954 conn(0x55f7e253b440 msgr2=0x55f7e262b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.851+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 shutdown_connections 2024-04-23T18:29:32.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.851+0000 7f9911a1b800 1 -- 172.21.15.119:0/969994954 wait complete. 2024-04-23T18:29:32.856 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-23T18:29:32.546463Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:32.856 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-23T18:29:32.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-23T18:29:32.856 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-04-23T18:29:32.899 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:32.899 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:32.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.907+0000 7f2000baf800 1 Processor -- start 2024-04-23T18:29:32.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.907+0000 7f2000baf800 1 -- start start 2024-04-23T18:29:32.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.907+0000 7f2000baf800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d5e42d73d0 0x55d5e42dfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.907+0000 7f2000baf800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d5e4187560 con 0x55d5e42d5890 2024-04-23T18:29:32.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.907+0000 7f2000baf800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55d5e4178e20 con 0x55d5e42d73d0 2024-04-23T18:29:32.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.907+0000 7f1ff7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d5e42d73d0 0x55d5e42dfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.907+0000 7f1ffe6b5640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55d5e42d5890 0x55d5e42d5cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40654/0 (socket says 172.21.15.119:40654) 2024-04-23T18:29:32.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.907+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/1466574478 learned_addr learned my addr 172.21.15.119:0/1466574478 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:32.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.908+0000 7f1ff7fff640 1 -- 172.21.15.119:0/1466574478 >> v1:172.21.15.62:6789/0 conn(0x55d5e42d5890 legacy=0x55d5e42d5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.908+0000 7f1ffdeb4640 1 -- 172.21.15.119:0/1466574478 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099145573 0 0) 0x55d5e4187560 con 0x55d5e42d5890 2024-04-23T18:29:32.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.908+0000 7f1ff7fff640 1 -- 172.21.15.119:0/1466574478 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5e4186e60 con 0x55d5e42d73d0 2024-04-23T18:29:32.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.910+0000 7f1ff7fff640 1 --2- 172.21.15.119:0/1466574478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d73d0 0x55d5e42dfed0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800a470 tx=0x7f1fe801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676f5d2362dbc91b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.910+0000 7f1ffdeb4640 1 -- 172.21.15.119:0/1466574478 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe8057070 con 0x55d5e42d73d0 2024-04-23T18:29:32.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.910+0000 7f1ffdeb4640 1 -- 172.21.15.119:0/1466574478 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe8052440 con 0x55d5e42d73d0 2024-04-23T18:29:32.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.910+0000 7f1ffdeb4640 1 -- 172.21.15.119:0/1466574478 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe8052740 con 0x55d5e42d73d0 2024-04-23T18:29:32.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.910+0000 7f2000baf800 1 -- 172.21.15.119:0/1466574478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d73d0 msgr2=0x55d5e42dfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.910+0000 7f2000baf800 1 --2- 172.21.15.119:0/1466574478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d73d0 0x55d5e42dfed0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800a470 tx=0x7f1fe801ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:32.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.910+0000 7f2000baf800 1 -- 172.21.15.119:0/1466574478 shutdown_connections 2024-04-23T18:29:32.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.910+0000 7f2000baf800 1 --2- 172.21.15.119:0/1466574478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d73d0 0x55d5e42dfed0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.910+0000 7f2000baf800 1 -- 172.21.15.119:0/1466574478 >> 172.21.15.119:0/1466574478 conn(0x55d5e42d1410 msgr2=0x55d5e42d3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.910+0000 7f2000baf800 1 -- 172.21.15.119:0/1466574478 shutdown_connections 2024-04-23T18:29:32.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.910+0000 7f2000baf800 1 -- 172.21.15.119:0/1466574478 wait complete. 2024-04-23T18:29:32.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.922+0000 7f2000baf800 1 Processor -- start 2024-04-23T18:29:32.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.922+0000 7f2000baf800 1 -- start start 2024-04-23T18:29:32.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.922+0000 7f2000baf800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d5890 0x55d5e43ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.922+0000 7f2000baf800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d5e42225b0 con 0x55d5e42d5890 2024-04-23T18:29:32.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.922+0000 7f1ffe6b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d5890 0x55d5e43ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.922+0000 7f1ffe6b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d5890 0x55d5e43ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33092/0 (socket says 172.21.15.119:33092) 2024-04-23T18:29:32.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.922+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3137456496 learned_addr learned my addr 172.21.15.119:0/3137456496 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.922+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3137456496 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5e4198860 con 0x55d5e42d5890 2024-04-23T18:29:32.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.923+0000 7f1ffe6b5640 1 --2- 172.21.15.119:0/3137456496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d5890 0x55d5e43ca4a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0001e00 tx=0x7f1ff000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87f99c320944774 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.923+0000 7f1eec608640 1 -- 172.21.15.119:0/3137456496 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff0012020 con 0x55d5e42d5890 2024-04-23T18:29:32.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.923+0000 7f1eec608640 1 -- 172.21.15.119:0/3137456496 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff000e5c0 con 0x55d5e42d5890 2024-04-23T18:29:32.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.923+0000 7f1eec608640 1 -- 172.21.15.119:0/3137456496 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff000e8e0 con 0x55d5e42d5890 2024-04-23T18:29:32.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.923+0000 7f2000baf800 1 -- 172.21.15.119:0/3137456496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d5890 msgr2=0x55d5e43ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.924+0000 7f2000baf800 1 --2- 172.21.15.119:0/3137456496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d5890 0x55d5e43ca4a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0001e00 tx=0x7f1ff000b780 comp rx=0 tx=0).stop 2024-04-23T18:29:32.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.924+0000 7f2000baf800 1 -- 172.21.15.119:0/3137456496 shutdown_connections 2024-04-23T18:29:32.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.924+0000 7f2000baf800 1 --2- 172.21.15.119:0/3137456496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d5890 0x55d5e43ca4a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.924+0000 7f2000baf800 1 -- 172.21.15.119:0/3137456496 >> 172.21.15.119:0/3137456496 conn(0x55d5e42d1410 msgr2=0x55d5e43c5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.924+0000 7f2000baf800 1 -- 172.21.15.119:0/3137456496 shutdown_connections 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.924+0000 7f2000baf800 1 -- 172.21.15.119:0/3137456496 wait complete. 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.924+0000 7f2000baf800 1 Processor -- start 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.924+0000 7f2000baf800 1 -- start start 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.924+0000 7f2000baf800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d5890 0x55d5e43d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.924+0000 7f2000baf800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d5e42e26f0 con 0x55d5e42d5890 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.924+0000 7f1ffe6b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d5890 0x55d5e43d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.924+0000 7f1ffe6b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d5890 0x55d5e43d1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33098/0 (socket says 172.21.15.119:33098) 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.924+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/2049784896 learned_addr learned my addr 172.21.15.119:0/2049784896 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.925+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/2049784896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5e4196eb0 con 0x55d5e42d5890 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.925+0000 7f1ffe6b5640 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d5890 0x55d5e43d1e70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55d5e43cb230 tx=0x7f1ff0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.925+0000 7f1eeae05640 1 -- 172.21.15.119:0/2049784896 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff0012030 con 0x55d5e42d5890 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.925+0000 7f1eeae05640 1 -- 172.21.15.119:0/2049784896 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff001a700 con 0x55d5e42d5890 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.925+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5e43d23b0 con 0x55d5e42d5890 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.925+0000 7f1eeae05640 1 -- 172.21.15.119:0/2049784896 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff001a9e0 con 0x55d5e42d5890 2024-04-23T18:29:32.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.925+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5e43d28d0 con 0x55d5e42d5890 2024-04-23T18:29:32.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.926+0000 7f1eeae05640 1 -- 172.21.15.119:0/2049784896 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1ff0015020 con 0x55d5e42d5890 2024-04-23T18:29:32.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.926+0000 7f1eeae05640 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ee4036eb0 0x7f1ee4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.926+0000 7f1eeae05640 1 -- 172.21.15.119:0/2049784896 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f1ff0020030 con 0x55d5e42d5890 2024-04-23T18:29:32.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.926+0000 7f1ff7fff640 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ee4036eb0 0x7f1ee4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.926+0000 7f2000baf800 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d5e43d6ed0 0x55d5e43d92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.926+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e43d9800 con 0x55d5e43d6ed0 2024-04-23T18:29:32.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.926+0000 7f1ffeeb6640 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d5e43d6ed0 0x55d5e43d92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.926+0000 7f1ff7fff640 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ee4036eb0 0x7f1ee4039370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8054000 tx=0x7f1fe804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.927+0000 7f1ffeeb6640 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d5e43d6ed0 0x55d5e43d92c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.927+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/2049784896 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e43d6ed0 2024-04-23T18:29:32.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.927+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e43d64b0 con 0x55d5e43d6ed0 2024-04-23T18:29:32.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.927+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/2049784896 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e43d6ed0 2024-04-23T18:29:32.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.927+0000 7f2000baf800 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d5e43dbaf0 0x55d5e43ddee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.927+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e43de5d0 con 0x55d5e43dbaf0 2024-04-23T18:29:32.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.927+0000 7f1ffe6b5640 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d5e43dbaf0 0x55d5e43ddee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.927+0000 7f1ffe6b5640 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d5e43dbaf0 0x55d5e43ddee0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.928+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/2049784896 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1ff000dcd0 con 0x55d5e43dbaf0 2024-04-23T18:29:32.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.928+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e43daaa0 con 0x55d5e43d6ed0 2024-04-23T18:29:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.928+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/2049784896 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e43d6ed0 2024-04-23T18:29:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.928+0000 7f2000baf800 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d5e43dfa80 0x55d5e43e1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.928+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e43e2630 con 0x55d5e43dfa80 2024-04-23T18:29:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.928+0000 7f1ff7fff640 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d5e43dfa80 0x55d5e43e1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.929+0000 7f1ff7fff640 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d5e43dfa80 0x55d5e43e1ed0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.929+0000 7f1ff7fff640 1 -- 172.21.15.119:0/2049784896 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1fe8052740 con 0x55d5e43dfa80 2024-04-23T18:29:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.929+0000 7f2000baf800 1 Processor -- start 2024-04-23T18:29:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.929+0000 7f2000baf800 1 -- start start 2024-04-23T18:29:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.930+0000 7f2000baf800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43f0a90 0x55d5e43f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.930+0000 7f2000baf800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d5e41c8df0 con 0x55d5e43f0a90 2024-04-23T18:29:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.930+0000 7f1ffe6b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43f0a90 0x55d5e43f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.930+0000 7f1ffe6b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43f0a90 0x55d5e43f0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33104/0 (socket says 172.21.15.119:33104) 2024-04-23T18:29:32.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.930+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3089182816 learned_addr learned my addr 172.21.15.119:0/3089182816 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.930+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3089182816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5e43f13f0 con 0x55d5e43f0a90 2024-04-23T18:29:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.930+0000 7f1ffe6b5640 1 --2- 172.21.15.119:0/3089182816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43f0a90 0x55d5e43f0eb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1ff004b290 tx=0x7f1ff001af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.930+0000 7f1ee3fff640 1 -- 172.21.15.119:0/3089182816 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff001c210 con 0x55d5e43f0a90 2024-04-23T18:29:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.930+0000 7f1ee3fff640 1 -- 172.21.15.119:0/3089182816 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff001c3b0 con 0x55d5e43f0a90 2024-04-23T18:29:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.930+0000 7f1ee3fff640 1 -- 172.21.15.119:0/3089182816 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff0044af0 con 0x55d5e43f0a90 2024-04-23T18:29:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.930+0000 7f2000baf800 1 -- 172.21.15.119:0/3089182816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5e43f1e60 con 0x55d5e43f0a90 2024-04-23T18:29:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.930+0000 7f2000baf800 1 -- 172.21.15.119:0/3089182816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5e43f2360 con 0x55d5e43f0a90 2024-04-23T18:29:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.931+0000 7f1ee3fff640 1 -- 172.21.15.119:0/3089182816 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1ff0044c90 con 0x55d5e43f0a90 2024-04-23T18:29:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.931+0000 7f1ee3fff640 1 --2- 172.21.15.119:0/3089182816 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ed8036e60 0x7f1ed8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.931+0000 7f1ee3fff640 1 -- 172.21.15.119:0/3089182816 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f1ff0038d00 con 0x55d5e43f0a90 2024-04-23T18:29:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.931+0000 7f1ff7fff640 1 --2- 172.21.15.119:0/3089182816 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ed8036e60 0x7f1ed8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.931+0000 7f2000baf800 1 Processor -- start 2024-04-23T18:29:32.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.931+0000 7f2000baf800 1 -- start start 2024-04-23T18:29:32.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.932+0000 7f1ff7fff640 1 --2- 172.21.15.119:0/3089182816 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ed8036e60 0x7f1ed8039320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55d5e43da0a0 tx=0x7f1fe8005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.932+0000 7f2000baf800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 0x55d5e43fe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.932+0000 7f2000baf800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d5e43cac20 con 0x55d5e43fdc90 2024-04-23T18:29:32.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.932+0000 7f1ffe6b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 0x55d5e43fe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.932+0000 7f1ffe6b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 0x55d5e43fe0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33120/0 (socket says 172.21.15.119:33120) 2024-04-23T18:29:32.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.932+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/1484730474 learned_addr learned my addr 172.21.15.119:0/1484730474 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.932+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/1484730474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5e43fe680 con 0x55d5e43fdc90 2024-04-23T18:29:32.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.932+0000 7f1ffe6b5640 1 --2- 172.21.15.119:0/1484730474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 0x55d5e43fe0b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0016040 tx=0x7f1ff003f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbe52005cfd592d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.932+0000 7f1ee1ffb640 1 -- 172.21.15.119:0/1484730474 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff00446f0 con 0x55d5e43fdc90 2024-04-23T18:29:32.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.932+0000 7f1ee1ffb640 1 -- 172.21.15.119:0/1484730474 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff0042030 con 0x55d5e43fdc90 2024-04-23T18:29:32.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.932+0000 7f1ee1ffb640 1 -- 172.21.15.119:0/1484730474 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff003f830 con 0x55d5e43fdc90 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.933+0000 7f2000baf800 1 -- 172.21.15.119:0/1484730474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 msgr2=0x55d5e43fe0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.933+0000 7f2000baf800 1 --2- 172.21.15.119:0/1484730474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 0x55d5e43fe0b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0016040 tx=0x7f1ff003f720 comp rx=0 tx=0).stop 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.933+0000 7f2000baf800 1 -- 172.21.15.119:0/1484730474 shutdown_connections 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.933+0000 7f2000baf800 1 --2- 172.21.15.119:0/1484730474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 0x55d5e43fe0b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.933+0000 7f2000baf800 1 -- 172.21.15.119:0/1484730474 >> 172.21.15.119:0/1484730474 conn(0x55d5e43f9f10 msgr2=0x55d5e43f7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.933+0000 7f2000baf800 1 -- 172.21.15.119:0/1484730474 shutdown_connections 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.933+0000 7f2000baf800 1 -- 172.21.15.119:0/1484730474 wait complete. 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.933+0000 7f2000baf800 1 Processor -- start 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.933+0000 7f2000baf800 1 -- start start 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.933+0000 7f2000baf800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 0x55d5e4405040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.933+0000 7f2000baf800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d5e43fecf0 con 0x55d5e43fdc90 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.933+0000 7f1ffe6b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 0x55d5e4405040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.934+0000 7f1ffe6b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 0x55d5e4405040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33136/0 (socket says 172.21.15.119:33136) 2024-04-23T18:29:32.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.934+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 learned_addr learned my addr 172.21.15.119:0/3009758030 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.934+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5e4405580 con 0x55d5e43fdc90 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.934+0000 7f1ffe6b5640 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 0x55d5e4405040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1ff004b630 tx=0x7f1ff000cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.934+0000 7f1ecffff640 1 -- 172.21.15.119:0/3009758030 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff003f960 con 0x55d5e43fdc90 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.934+0000 7f1ecffff640 1 -- 172.21.15.119:0/3009758030 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff0044050 con 0x55d5e43fdc90 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.934+0000 7f1ecffff640 1 -- 172.21.15.119:0/3009758030 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff0044330 con 0x55d5e43fdc90 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.934+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5e4405580 con 0x55d5e43fdc90 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.934+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5e4405a20 con 0x55d5e43fdc90 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.935+0000 7f1ecffff640 1 -- 172.21.15.119:0/3009758030 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1ff001c6d0 con 0x55d5e43fdc90 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.935+0000 7f1ecffff640 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ec8036eb0 0x7f1ec8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.935+0000 7f1ecffff640 1 -- 172.21.15.119:0/3009758030 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f1ff006ec30 con 0x55d5e43fdc90 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.936+0000 7f1ff7fff640 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ec8036eb0 0x7f1ec8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.936+0000 7f1ff7fff640 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ec8036eb0 0x7f1ec8039370 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55d5e43e2a30 tx=0x7f1fe804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.936+0000 7f2000baf800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.936+0000 7f2000baf800 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d5e4410790 0x55d5e4412c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.936+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e44133a0 con 0x55d5e4410790 2024-04-23T18:29:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.936+0000 7f1ffeeb6640 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d5e4410790 0x55d5e4412c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.936+0000 7f1ffeeb6640 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d5e4410790 0x55d5e4412c50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e4410790 2024-04-23T18:29:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 20 realm 2024-04-23T18:29:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e44137b0 con 0x55d5e4410790 2024-04-23T18:29:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e4410790 2024-04-23T18:29:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:32.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414080 con 0x55d5e4410790 2024-04-23T18:29:32.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e4410790 2024-04-23T18:29:32.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4410790 2024-04-23T18:29:32.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e4410790 2024-04-23T18:29:32.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d5e4415180 0x55d5e4417570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.937+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4417b80 con 0x55d5e4415180 2024-04-23T18:29:32.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.938+0000 7f1ffe6b5640 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d5e4415180 0x55d5e4417570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.938+0000 7f1ffe6b5640 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d5e4415180 0x55d5e4417570 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.938+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1ff000dcd0 con 0x55d5e4415180 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.938+0000 7f2000baf800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.938+0000 7f2000baf800 20 searching for the correct realm 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.938+0000 7f2000baf800 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d5e4419b30 0x55d5e441bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.938+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441c6c0 con 0x55d5e4419b30 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.938+0000 7f1ff7fff640 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d5e4419b30 0x55d5e441bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.938+0000 7f1ff7fff640 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d5e4419b30 0x55d5e441bff0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.939+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.939+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441c6c0 con 0x55d5e4415180 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.939+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff000dcd0 con 0x55d5e4415180 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.939+0000 7f1ffe6b5640 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1ff0017050 0x7f1ff00217b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.939+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441c6c0 con 0x7f1ff0017050 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.939+0000 7f1ffeeb6640 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1ff0017050 0x7f1ff00217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.940+0000 7f1ffeeb6640 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1ff0017050 0x7f1ff00217b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:32.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.940+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff800a4a0 con 0x7f1ff0017050 2024-04-23T18:29:32.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.940+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4410790 2024-04-23T18:29:32.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.940+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e4410790 2024-04-23T18:29:32.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.940+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4410790 2024-04-23T18:29:32.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.940+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e4410790 2024-04-23T18:29:32.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.940+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x7f1ff0017050 2024-04-23T18:29:32.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.940+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff800a4a0 con 0x7f1ff0017050 2024-04-23T18:29:32.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.941+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x7f1ff0017050 2024-04-23T18:29:32.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.941+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1ff800a4a0 con 0x7f1ff0017050 2024-04-23T18:29:32.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.941+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4415180 2024-04-23T18:29:32.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.941+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff000dcd0 con 0x55d5e4415180 2024-04-23T18:29:32.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.941+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4419b30 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.942+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.942+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4410790 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.942+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e4410790 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.942+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x7f1ff0017050 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.942+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff800a4a0 con 0x7f1ff0017050 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.942+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4410790 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.942+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e4410790 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.942+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4415180 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.943+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1ff000dcd0 con 0x55d5e4415180 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.943+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4419b30 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.943+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.943+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4419b30 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.943+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.943+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x7f1ff0017050 2024-04-23T18:29:32.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.943+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff800a4a0 con 0x7f1ff0017050 2024-04-23T18:29:32.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.943+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4419b30 2024-04-23T18:29:32.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.943+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.943+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4419b30 2024-04-23T18:29:32.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.944+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.944+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4410790 2024-04-23T18:29:32.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.944+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e4410790 2024-04-23T18:29:32.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.944+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4410790 2024-04-23T18:29:32.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.944+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e4410790 2024-04-23T18:29:32.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.944+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x7f1ff0017050 2024-04-23T18:29:32.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.944+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff800a4a0 con 0x7f1ff0017050 2024-04-23T18:29:32.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.944+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4419b30 2024-04-23T18:29:32.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.944+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.944+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4415180 2024-04-23T18:29:32.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.945+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1ff000dcd0 con 0x55d5e4415180 2024-04-23T18:29:32.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.945+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4410790 2024-04-23T18:29:32.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.945+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff800a4a0 con 0x55d5e4410790 2024-04-23T18:29:32.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.945+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x7f1ff0017050 2024-04-23T18:29:32.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.945+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff800a4a0 con 0x7f1ff0017050 2024-04-23T18:29:32.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.945+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4419b30 2024-04-23T18:29:32.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.946+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.946+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x7f1ff0017050 2024-04-23T18:29:32.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.946+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff800a4a0 con 0x7f1ff0017050 2024-04-23T18:29:32.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.946+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4415180 2024-04-23T18:29:32.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.946+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff000dcd0 con 0x55d5e4415180 2024-04-23T18:29:32.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.946+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4419b30 2024-04-23T18:29:32.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x7f1ff0017050 2024-04-23T18:29:32.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff8040040 con 0x7f1ff0017050 2024-04-23T18:29:32.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4410790 2024-04-23T18:29:32.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4414420 con 0x55d5e4415180 2024-04-23T18:29:32.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff0084040 con 0x55d5e4415180 2024-04-23T18:29:32.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f2000baf800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:32.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f2000baf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:32.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f2000baf800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:32.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f2000baf800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:32.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f2000baf800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:32.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f2000baf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f2000baf800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.947+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4418440 con 0x55d5e4410790 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4418440 con 0x55d5e4410790 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4418440 con 0x7f1ff0017050 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1ff8040040 con 0x7f1ff0017050 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 20 zone default found 2024-04-23T18:29:32.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 4 Realm: () 2024-04-23T18:29:32.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:32.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:32.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:32.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 20 zonegroup default 2024-04-23T18:29:32.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4418ce0 con 0x7f1ff0017050 2024-04-23T18:29:32.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.948+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x7f1ff0017050 2024-04-23T18:29:32.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.949+0000 7f2000baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.949+0000 7f2000baf800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.949+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4418ce0 con 0x55d5e4419b30 2024-04-23T18:29:32.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.949+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.949+0000 7f2000baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.949+0000 7f2000baf800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.949+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441e520 con 0x55d5e4419b30 2024-04-23T18:29:32.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.949+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.949+0000 7f2000baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:32.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.949+0000 7f2000baf800 20 started sync module instance, tier type = 2024-04-23T18:29:32.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.949+0000 7f2000baf800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:32.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.949+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441d9c0 con 0x55d5e4415180 2024-04-23T18:29:32.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.950+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff0084040 con 0x55d5e4415180 2024-04-23T18:29:32.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.950+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94377145914640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441e8c0 con 0x55d5e4415180 2024-04-23T18:29:32.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.950+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441f190 con 0x55d5e4410790 2024-04-23T18:29:32.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.951+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94377145914640] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff0084040 con 0x55d5e4415180 2024-04-23T18:29:32.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.951+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.951+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94377145920608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441f580 con 0x55d5e4410790 2024-04-23T18:29:32.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.951+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441ffe0 con 0x55d5e4419b30 2024-04-23T18:29:32.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.952+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94377145920608] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.952+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.952+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94377145924240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e44203d0 con 0x55d5e4419b30 2024-04-23T18:29:32.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.952+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4420e10 con 0x55d5e4415180 2024-04-23T18:29:32.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.953+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94377145924240] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.953+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff0084040 con 0x55d5e4415180 2024-04-23T18:29:32.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.953+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94377145916896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e44216b0 con 0x55d5e4415180 2024-04-23T18:29:32.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.953+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4422070 con 0x55d5e4410790 2024-04-23T18:29:32.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.954+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94377145916896] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff0084040 con 0x55d5e4415180 2024-04-23T18:29:32.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.954+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.954+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94377145932736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4422490 con 0x55d5e4410790 2024-04-23T18:29:32.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.955+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4422e50 con 0x7f1ff0017050 2024-04-23T18:29:32.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.955+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x7f1ff0017050 2024-04-23T18:29:32.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.955+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94377145936288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4423270 con 0x7f1ff0017050 2024-04-23T18:29:32.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.955+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94377145932736] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.955+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4422020 con 0x7f1ff0017050 2024-04-23T18:29:32.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.956+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94377145936288] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x7f1ff0017050 2024-04-23T18:29:32.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.956+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x7f1ff0017050 2024-04-23T18:29:32.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.956+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94377145937344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e44231e0 con 0x7f1ff0017050 2024-04-23T18:29:32.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.957+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4424180 con 0x7f1ff0017050 2024-04-23T18:29:32.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.957+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94377145937344] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x7f1ff0017050 2024-04-23T18:29:32.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.957+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x7f1ff0017050 2024-04-23T18:29:32.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.957+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94377145939936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e44240b0 con 0x7f1ff0017050 2024-04-23T18:29:32.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.957+0000 7f2000baf800 20 add_watcher() i=0 2024-04-23T18:29:32.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.957+0000 7f2000baf800 20 add_watcher() i=1 2024-04-23T18:29:32.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.957+0000 7f2000baf800 20 add_watcher() i=2 2024-04-23T18:29:32.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.957+0000 7f2000baf800 20 add_watcher() i=3 2024-04-23T18:29:32.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.957+0000 7f2000baf800 20 add_watcher() i=4 2024-04-23T18:29:32.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.957+0000 7f2000baf800 20 add_watcher() i=5 2024-04-23T18:29:32.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.957+0000 7f2000baf800 20 add_watcher() i=6 2024-04-23T18:29:32.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.958+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94377145939936] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x7f1ff0017050 2024-04-23T18:29:32.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.958+0000 7f2000baf800 20 add_watcher() i=7 2024-04-23T18:29:32.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.958+0000 7f2000baf800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:32.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.958+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e44275a0 con 0x55d5e4410790 2024-04-23T18:29:32.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.959+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.959+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94377145941456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4424aa0 con 0x55d5e4410790 2024-04-23T18:29:32.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.960+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94377145941456] v32'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.960+0000 7f1eb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.960+0000 7f2000baf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.960+0000 7f2000baf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.960+0000 7f2000baf800 5 note: GC not initialized 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.960+0000 7f1e2f7fe640 20 reqs_thread_entry: start 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.960+0000 7f2000baf800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.960+0000 7f2000baf800 20 Filter name: none 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.960+0000 7f1e2d7fa640 20 reqs_thread_entry: start 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.960+0000 7f2000baf800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.960+0000 7f2000baf800 20 rados->read ofs=0 len=0 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.960+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e445ad30 con 0x55d5e4410790 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.961+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.961+0000 7f2000baf800 20 rados_obj.operate() r=0 bl.length=582 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.961+0000 7f2000baf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.961+0000 7f2000baf800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:32.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.961+0000 7f2000baf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:32.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.961+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4461390 con 0x55d5e4410790 2024-04-23T18:29:32.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.962+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.962+0000 7f2000baf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:32.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.962+0000 7f2000baf800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:32.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.962+0000 7f2000baf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:32.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.962+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94377146191360 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5e445cd30 con 0x55d5e4410790 2024-04-23T18:29:32.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.962+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify (1) cookie 94377145932736 notify 137438953481 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f1ff8046450 con 0x55d5e4410790 2024-04-23T18:29:32.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.962+0000 7f1ee1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94377145932736 notifier 4406 bl.length()=732 2024-04-23T18:29:32.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.962+0000 7f1ee1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:32.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.962+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(64 notify.4 [notify cookie 94377146191360 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.962+0000 7f1ee1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:32.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.962+0000 7f1ee1ffb640 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1ec4003ea0 con 0x55d5e4410790 2024-04-23T18:29:32.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.962+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.962+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify_complete (2) cookie 94377146191360 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1ff8046620 con 0x55d5e4410790 2024-04-23T18:29:32.968 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-23T18:29:32.546463Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:32.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.963+0000 7f1eb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:32.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.963+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94377145941456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4426c70 con 0x55d5e4410790 2024-04-23T18:29:32.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.964+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94377145941456] v32'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.964+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94377145914640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e4423da0 con 0x55d5e4415180 2024-04-23T18:29:32.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.965+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94377145914640] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff0084040 con 0x55d5e4415180 2024-04-23T18:29:32.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.965+0000 7f2000baf800 20 remove_watcher() i=0 2024-04-23T18:29:32.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.965+0000 7f2000baf800 2 removed watcher, disabling cache 2024-04-23T18:29:32.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.965+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94377145920608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441d510 con 0x55d5e4410790 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.966+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94377145920608] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.966+0000 7f2000baf800 20 remove_watcher() i=1 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.966+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94377145924240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441d510 con 0x55d5e4419b30 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.967+0000 7f1ff7fff640 1 -- 172.21.15.119:0/3009758030 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94377145924240] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fe8081070 con 0x55d5e4419b30 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.967+0000 7f2000baf800 20 remove_watcher() i=2 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.967+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94377145916896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441ec60 con 0x55d5e4415180 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.968+0000 7f1ffe6b5640 1 -- 172.21.15.119:0/3009758030 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94377145916896] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff0084040 con 0x55d5e4415180 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.968+0000 7f2000baf800 20 remove_watcher() i=3 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.968+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94377145932736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441ec60 con 0x55d5e4410790 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.969+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94377145932736] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x55d5e4410790 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.969+0000 7f2000baf800 20 remove_watcher() i=4 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.969+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94377145936288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441ec60 con 0x7f1ff0017050 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.970+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94377145936288] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x7f1ff0017050 2024-04-23T18:29:32.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.970+0000 7f2000baf800 20 remove_watcher() i=5 2024-04-23T18:29:32.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.970+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94377145937344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441ec60 con 0x7f1ff0017050 2024-04-23T18:29:32.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.971+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94377145937344] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x7f1ff0017050 2024-04-23T18:29:32.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.971+0000 7f2000baf800 20 remove_watcher() i=6 2024-04-23T18:29:32.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.971+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94377145939936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5e441ec60 con 0x7f1ff0017050 2024-04-23T18:29:32.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94377145939936] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff8040040 con 0x7f1ff0017050 2024-04-23T18:29:32.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 20 remove_watcher() i=7 2024-04-23T18:29:32.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1ff0017050 msgr2=0x7f1ff00217b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1ff0017050 0x7f1ff00217b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d5e4410790 msgr2=0x55d5e4412c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d5e4410790 0x55d5e4412c50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d5e4415180 msgr2=0x55d5e4417570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d5e4415180 0x55d5e4417570 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d5e4419b30 msgr2=0x55d5e441bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d5e4419b30 0x55d5e441bff0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ec8036eb0 msgr2=0x7f1ec8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ec8036eb0 0x7f1ec8039370 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55d5e43e2a30 tx=0x7f1fe804f000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 msgr2=0x55d5e4405040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/3009758030 reap_dead start 2024-04-23T18:29:32.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 0x55d5e4405040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1ff004b630 tx=0x7f1ff000cfd0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 shutdown_connections 2024-04-23T18:29:32.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 --2- 172.21.15.119:0/3009758030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43fdc90 0x55d5e4405040 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 >> 172.21.15.119:0/3009758030 conn(0x55d5e43f9f10 msgr2=0x55d5e43f7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 shutdown_connections 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.972+0000 7f2000baf800 1 -- 172.21.15.119:0/3009758030 wait complete. 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/3089182816 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ed8036e60 msgr2=0x7f1ed8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 --2- 172.21.15.119:0/3089182816 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ed8036e60 0x7f1ed8039320 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55d5e43da0a0 tx=0x7f1fe8005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/3089182816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43f0a90 msgr2=0x55d5e43f0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 --2- 172.21.15.119:0/3089182816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43f0a90 0x55d5e43f0eb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1ff004b290 tx=0x7f1ff001af50 comp rx=0 tx=0).stop 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/3089182816 shutdown_connections 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 --2- 172.21.15.119:0/3089182816 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ed8036e60 0x7f1ed8039320 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 --2- 172.21.15.119:0/3089182816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e43f0a90 0x55d5e43f0eb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/3089182816 >> 172.21.15.119:0/3089182816 conn(0x55d5e43e4b30 msgr2=0x55d5e43e4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/3089182816 shutdown_connections 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/3089182816 wait complete. 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d5e43dfa80 msgr2=0x55d5e43e1ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d5e43dfa80 0x55d5e43e1ed0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d5e43d6ed0 msgr2=0x55d5e43d92c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d5e43d6ed0 0x55d5e43d92c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d5e43dbaf0 msgr2=0x55d5e43ddee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d5e43dbaf0 0x55d5e43ddee0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ee4036eb0 msgr2=0x7f1ee4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ee4036eb0 0x7f1ee4039370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8054000 tx=0x7f1fe804e000 comp rx=0 tx=0).stop 2024-04-23T18:29:32.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d5890 msgr2=0x55d5e43d1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:32.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 --2- 172.21.15.119:0/2049784896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d5e42d5890 0x55d5e43d1e70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55d5e43cb230 tx=0x7f1ff0000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:32.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f1ffeeb6640 1 -- 172.21.15.119:0/2049784896 reap_dead start 2024-04-23T18:29:32.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 shutdown_connections 2024-04-23T18:29:32.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 >> 172.21.15.119:0/2049784896 conn(0x55d5e42d1410 msgr2=0x55d5e43c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:32.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 shutdown_connections 2024-04-23T18:29:32.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:32.973+0000 7f2000baf800 1 -- 172.21.15.119:0/2049784896 wait complete. 2024-04-23T18:29:32.981 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-23T18:29:32.546463Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:32.981 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-23T18:29:32.981 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-23T18:29:32.981 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-04-23T18:29:33.061 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:33.061 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:33.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.069+0000 7fe597136800 1 Processor -- start 2024-04-23T18:29:33.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.069+0000 7fe597136800 1 -- start start 2024-04-23T18:29:33.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.069+0000 7fe597136800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558f25b62a80 0x558f25b64e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.069+0000 7fe597136800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558f25a12560 con 0x558f25b653b0 2024-04-23T18:29:33.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.069+0000 7fe597136800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x558f25a03e20 con 0x558f25b62a80 2024-04-23T18:29:33.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.070+0000 7fe592e36640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558f25b62a80 0x558f25b64e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.070+0000 7fe592635640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x558f25b653b0 0x558f25b677a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40666/0 (socket says 172.21.15.119:40666) 2024-04-23T18:29:33.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.070+0000 7fe592635640 1 -- 172.21.15.119:0/1664790820 learned_addr learned my addr 172.21.15.119:0/1664790820 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:33.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.070+0000 7fe592e36640 1 -- 172.21.15.119:0/1664790820 >> v1:172.21.15.62:6789/0 conn(0x558f25b653b0 legacy=0x558f25b677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.070+0000 7fe592e36640 1 -- 172.21.15.119:0/1664790820 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f25a11e60 con 0x558f25b62a80 2024-04-23T18:29:33.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.070+0000 7fe591e34640 1 -- 172.21.15.119:0/1664790820 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806325097 0 0) 0x558f25a12560 con 0x558f25b653b0 2024-04-23T18:29:33.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.072+0000 7fe592e36640 1 --2- 172.21.15.119:0/1664790820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25b64e70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe58400a470 tx=0x7fe58401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4dc397a592110b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.072+0000 7fe591e34640 1 -- 172.21.15.119:0/1664790820 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe584057070 con 0x558f25b62a80 2024-04-23T18:29:33.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.072+0000 7fe591e34640 1 -- 172.21.15.119:0/1664790820 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe584052570 con 0x558f25b62a80 2024-04-23T18:29:33.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.072+0000 7fe591e34640 1 -- 172.21.15.119:0/1664790820 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe584052870 con 0x558f25b62a80 2024-04-23T18:29:33.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.072+0000 7fe597136800 1 -- 172.21.15.119:0/1664790820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 msgr2=0x558f25b64e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.072+0000 7fe597136800 1 --2- 172.21.15.119:0/1664790820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25b64e70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe58400a470 tx=0x7fe58401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:33.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.072+0000 7fe597136800 1 -- 172.21.15.119:0/1664790820 shutdown_connections 2024-04-23T18:29:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.072+0000 7fe597136800 1 --2- 172.21.15.119:0/1664790820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25b64e70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.072+0000 7fe597136800 1 -- 172.21.15.119:0/1664790820 >> 172.21.15.119:0/1664790820 conn(0x558f25b5c430 msgr2=0x558f25b5e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.072+0000 7fe597136800 1 -- 172.21.15.119:0/1664790820 shutdown_connections 2024-04-23T18:29:33.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.072+0000 7fe597136800 1 -- 172.21.15.119:0/1664790820 wait complete. 2024-04-23T18:29:33.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.084+0000 7fe597136800 1 Processor -- start 2024-04-23T18:29:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.084+0000 7fe597136800 1 -- start start 2024-04-23T18:29:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.084+0000 7fe597136800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25c52fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.084+0000 7fe597136800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558f25aad5d0 con 0x558f25b62a80 2024-04-23T18:29:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.084+0000 7fe592e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25c52fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.085+0000 7fe592e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25c52fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33164/0 (socket says 172.21.15.119:33164) 2024-04-23T18:29:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.085+0000 7fe592e36640 1 -- 172.21.15.119:0/1383401048 learned_addr learned my addr 172.21.15.119:0/1383401048 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.085+0000 7fe592e36640 1 -- 172.21.15.119:0/1383401048 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f25a23860 con 0x558f25b62a80 2024-04-23T18:29:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.085+0000 7fe592e36640 1 --2- 172.21.15.119:0/1383401048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25c52fb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe584055040 tx=0x7fe58404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ab3b996f013a4c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.085+0000 7fe480e09640 1 -- 172.21.15.119:0/1383401048 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe584057070 con 0x558f25b62a80 2024-04-23T18:29:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.085+0000 7fe480e09640 1 -- 172.21.15.119:0/1383401048 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe584063070 con 0x558f25b62a80 2024-04-23T18:29:33.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.085+0000 7fe480e09640 1 -- 172.21.15.119:0/1383401048 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe584052720 con 0x558f25b62a80 2024-04-23T18:29:33.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.086+0000 7fe597136800 1 -- 172.21.15.119:0/1383401048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 msgr2=0x558f25c52fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.086+0000 7fe597136800 1 --2- 172.21.15.119:0/1383401048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25c52fb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe584055040 tx=0x7fe58404c000 comp rx=0 tx=0).stop 2024-04-23T18:29:33.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.086+0000 7fe597136800 1 -- 172.21.15.119:0/1383401048 shutdown_connections 2024-04-23T18:29:33.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.086+0000 7fe597136800 1 --2- 172.21.15.119:0/1383401048 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25c52fb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.086+0000 7fe597136800 1 -- 172.21.15.119:0/1383401048 >> 172.21.15.119:0/1383401048 conn(0x558f25b5c430 msgr2=0x558f25c4e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.086+0000 7fe597136800 1 -- 172.21.15.119:0/1383401048 shutdown_connections 2024-04-23T18:29:33.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.086+0000 7fe597136800 1 -- 172.21.15.119:0/1383401048 wait complete. 2024-04-23T18:29:33.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.086+0000 7fe597136800 1 Processor -- start 2024-04-23T18:29:33.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.086+0000 7fe597136800 1 -- start start 2024-04-23T18:29:33.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.086+0000 7fe597136800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25c5a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.086+0000 7fe597136800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558f25b6b1d0 con 0x558f25b62a80 2024-04-23T18:29:33.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.087+0000 7fe592e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25c5a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.087+0000 7fe592e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25c5a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33180/0 (socket says 172.21.15.119:33180) 2024-04-23T18:29:33.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.087+0000 7fe592e36640 1 -- 172.21.15.119:0/3910481867 learned_addr learned my addr 172.21.15.119:0/3910481867 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.087+0000 7fe592e36640 1 -- 172.21.15.119:0/3910481867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f25a21eb0 con 0x558f25b62a80 2024-04-23T18:29:33.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.087+0000 7fe592e36640 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25c5a780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe584055040 tx=0x7fe584002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.087+0000 7fe47f606640 1 -- 172.21.15.119:0/3910481867 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58405e480 con 0x558f25b62a80 2024-04-23T18:29:33.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.087+0000 7fe47f606640 1 -- 172.21.15.119:0/3910481867 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58406c070 con 0x558f25b62a80 2024-04-23T18:29:33.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.087+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f25c5acc0 con 0x558f25b62a80 2024-04-23T18:29:33.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.087+0000 7fe47f606640 1 -- 172.21.15.119:0/3910481867 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58405e750 con 0x558f25b62a80 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.087+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f25c5b240 con 0x558f25b62a80 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.088+0000 7fe47f606640 1 -- 172.21.15.119:0/3910481867 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe58405e8f0 con 0x558f25b62a80 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.088+0000 7fe47f606640 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe478036e60 0x7fe478039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.088+0000 7fe47f606640 1 -- 172.21.15.119:0/3910481867 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe58408f020 con 0x558f25b62a80 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.088+0000 7fe592635640 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe478036e60 0x7fe478039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.088+0000 7fe597136800 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f25b653b0 0x558f25c617f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.088+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25c61dc0 con 0x558f25b653b0 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.088+0000 7fe593637640 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f25b653b0 0x558f25c617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.089+0000 7fe592635640 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe478036e60 0x7fe478039320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe588000c00 tx=0x7fe5880013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.089+0000 7fe593637640 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f25b653b0 0x558f25c617f0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.089+0000 7fe593637640 1 -- 172.21.15.119:0/3910481867 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25b653b0 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.089+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25c5eda0 con 0x558f25b653b0 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.089+0000 7fe593637640 1 -- 172.21.15.119:0/3910481867 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25b653b0 2024-04-23T18:29:33.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.089+0000 7fe597136800 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f25c640b0 0x558f25c664a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.089+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25c66b40 con 0x558f25c640b0 2024-04-23T18:29:33.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.089+0000 7fe592e36640 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f25c640b0 0x558f25c664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.090+0000 7fe592e36640 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f25c640b0 0x558f25c664a0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.090+0000 7fe592e36640 1 -- 172.21.15.119:0/3910481867 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe584071990 con 0x558f25c640b0 2024-04-23T18:29:33.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.090+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25c63060 con 0x558f25b653b0 2024-04-23T18:29:33.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.090+0000 7fe593637640 1 -- 172.21.15.119:0/3910481867 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25b653b0 2024-04-23T18:29:33.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.090+0000 7fe597136800 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558f25c67ff0 0x558f25c6a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.090+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25c6aba0 con 0x558f25c67ff0 2024-04-23T18:29:33.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.091+0000 7fe592635640 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558f25c67ff0 0x558f25c6a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.091+0000 7fe592635640 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558f25c67ff0 0x558f25c6a440 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.092+0000 7fe592635640 1 -- 172.21.15.119:0/3910481867 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe58800f670 con 0x558f25c67ff0 2024-04-23T18:29:33.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.092+0000 7fe597136800 1 Processor -- start 2024-04-23T18:29:33.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.092+0000 7fe597136800 1 -- start start 2024-04-23T18:29:33.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.092+0000 7fe597136800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62620 0x558f25b60a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.092+0000 7fe597136800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558f25a53df0 con 0x558f25b62620 2024-04-23T18:29:33.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.092+0000 7fe592e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62620 0x558f25b60a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.092+0000 7fe592e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62620 0x558f25b60a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33186/0 (socket says 172.21.15.119:33186) 2024-04-23T18:29:33.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.092+0000 7fe592e36640 1 -- 172.21.15.119:0/3738149549 learned_addr learned my addr 172.21.15.119:0/3738149549 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.092+0000 7fe592e36640 1 -- 172.21.15.119:0/3738149549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f25b60fd0 con 0x558f25b62620 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.093+0000 7fe592e36640 1 --2- 172.21.15.119:0/3738149549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62620 0x558f25b60a90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe584052460 tx=0x7fe584066e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.093+0000 7fe47ce01640 1 -- 172.21.15.119:0/3738149549 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe584066a70 con 0x558f25b62620 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.093+0000 7fe47ce01640 1 -- 172.21.15.119:0/3738149549 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe584058040 con 0x558f25b62620 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.093+0000 7fe597136800 1 -- 172.21.15.119:0/3738149549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f25b61260 con 0x558f25b62620 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.093+0000 7fe47ce01640 1 -- 172.21.15.119:0/3738149549 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe584067640 con 0x558f25b62620 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.093+0000 7fe597136800 1 -- 172.21.15.119:0/3738149549 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f25b61760 con 0x558f25b62620 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.094+0000 7fe47ce01640 1 -- 172.21.15.119:0/3738149549 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe584086070 con 0x558f25b62620 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.094+0000 7fe47ce01640 1 --2- 172.21.15.119:0/3738149549 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe46c036eb0 0x7fe46c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.094+0000 7fe47ce01640 1 -- 172.21.15.119:0/3738149549 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe584090c40 con 0x558f25b62620 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.094+0000 7fe592635640 1 --2- 172.21.15.119:0/3738149549 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe46c036eb0 0x7fe46c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.094+0000 7fe597136800 1 Processor -- start 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.094+0000 7fe597136800 1 -- start start 2024-04-23T18:29:33.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.094+0000 7fe592635640 1 --2- 172.21.15.119:0/3738149549 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe46c036eb0 0x7fe46c039370 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x558f25c5ece0 tx=0x7fe588006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.094+0000 7fe597136800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25c88350 0x558f25c88770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.094+0000 7fe597136800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558f25c53670 con 0x558f25c88350 2024-04-23T18:29:33.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.094+0000 7fe592e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25c88350 0x558f25c88770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.094+0000 7fe592e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25c88350 0x558f25c88770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33200/0 (socket says 172.21.15.119:33200) 2024-04-23T18:29:33.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.094+0000 7fe592e36640 1 -- 172.21.15.119:0/731262364 learned_addr learned my addr 172.21.15.119:0/731262364 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.095+0000 7fe592e36640 1 -- 172.21.15.119:0/731262364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f25c88d40 con 0x558f25c88350 2024-04-23T18:29:33.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.095+0000 7fe592e36640 1 --2- 172.21.15.119:0/731262364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25c88350 0x558f25c88770 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe584009720 tx=0x7fe584059330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b74baaf0b4bb6f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.095+0000 7fe4767fc640 1 -- 172.21.15.119:0/731262364 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58409f040 con 0x558f25c88350 2024-04-23T18:29:33.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.095+0000 7fe4767fc640 1 -- 172.21.15.119:0/731262364 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe584098a50 con 0x558f25c88350 2024-04-23T18:29:33.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.095+0000 7fe4767fc640 1 -- 172.21.15.119:0/731262364 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe584098e40 con 0x558f25c88350 2024-04-23T18:29:33.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.095+0000 7fe597136800 1 -- 172.21.15.119:0/731262364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25c88350 msgr2=0x558f25c88770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.095+0000 7fe597136800 1 --2- 172.21.15.119:0/731262364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25c88350 0x558f25c88770 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe584009720 tx=0x7fe584059330 comp rx=0 tx=0).stop 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.096+0000 7fe597136800 1 -- 172.21.15.119:0/731262364 shutdown_connections 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.096+0000 7fe597136800 1 --2- 172.21.15.119:0/731262364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25c88350 0x558f25c88770 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.096+0000 7fe597136800 1 -- 172.21.15.119:0/731262364 >> 172.21.15.119:0/731262364 conn(0x558f25c84660 msgr2=0x558f25c826c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.096+0000 7fe597136800 1 -- 172.21.15.119:0/731262364 shutdown_connections 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.096+0000 7fe597136800 1 -- 172.21.15.119:0/731262364 wait complete. 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.096+0000 7fe597136800 1 Processor -- start 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.096+0000 7fe597136800 1 -- start start 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.096+0000 7fe597136800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25c88350 0x558f25c8f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.096+0000 7fe597136800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558f25c893d0 con 0x558f25c88350 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.096+0000 7fe592e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25c88350 0x558f25c8f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.096+0000 7fe592e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25c88350 0x558f25c8f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33212/0 (socket says 172.21.15.119:33212) 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.096+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 learned_addr learned my addr 172.21.15.119:0/4015975707 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.096+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f25c8fc90 con 0x558f25c88350 2024-04-23T18:29:33.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.097+0000 7fe592e36640 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25c88350 0x558f25c8f750 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe58408ed70 tx=0x7fe584055ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.097+0000 7fe474ff9640 1 -- 172.21.15.119:0/4015975707 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5840677e0 con 0x558f25c88350 2024-04-23T18:29:33.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.097+0000 7fe474ff9640 1 -- 172.21.15.119:0/4015975707 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5840b3030 con 0x558f25c88350 2024-04-23T18:29:33.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.097+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f25c8fc90 con 0x558f25c88350 2024-04-23T18:29:33.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.097+0000 7fe474ff9640 1 -- 172.21.15.119:0/4015975707 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58407ab00 con 0x558f25c88350 2024-04-23T18:29:33.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.097+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f25c8fc90 con 0x558f25c88350 2024-04-23T18:29:33.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.097+0000 7fe474ff9640 1 -- 172.21.15.119:0/4015975707 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe58407aca0 con 0x558f25c88350 2024-04-23T18:29:33.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.098+0000 7fe474ff9640 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe45c036e60 0x7fe45c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.098+0000 7fe474ff9640 1 -- 172.21.15.119:0/4015975707 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe5840b9c60 con 0x558f25c88350 2024-04-23T18:29:33.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.098+0000 7fe592635640 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe45c036e60 0x7fe45c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.098+0000 7fe597136800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.098+0000 7fe592635640 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe45c036e60 0x7fe45c039320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe58800ffd0 tx=0x7fe588023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.098+0000 7fe597136800 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f25c9ae80 0x558f25c9d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.098+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9da90 con 0x558f25c9ae80 2024-04-23T18:29:33.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.098+0000 7fe593637640 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f25c9ae80 0x558f25c9d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe593637640 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f25c9ae80 0x558f25c9d340 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25c9ae80 2024-04-23T18:29:33.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe597136800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe597136800 20 realm 2024-04-23T18:29:33.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe597136800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9dea0 con 0x558f25c9ae80 2024-04-23T18:29:33.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25c9ae80 2024-04-23T18:29:33.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe597136800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe597136800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:33.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe597136800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9e770 con 0x558f25c9ae80 2024-04-23T18:29:33.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25c9ae80 2024-04-23T18:29:33.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe597136800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe597136800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9ae80 2024-04-23T18:29:33.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25c9ae80 2024-04-23T18:29:33.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe597136800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:33.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.099+0000 7fe597136800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.100+0000 7fe597136800 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f25c9f870 0x558f25ca1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.100+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca2270 con 0x558f25c9f870 2024-04-23T18:29:33.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.100+0000 7fe592e36640 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f25c9f870 0x558f25ca1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.100+0000 7fe592e36640 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f25c9f870 0x558f25ca1c60 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.100+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe5840bf070 con 0x558f25c9f870 2024-04-23T18:29:33.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.100+0000 7fe597136800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:33.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.100+0000 7fe597136800 20 searching for the correct realm 2024-04-23T18:29:33.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.100+0000 7fe597136800 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558f25ca4220 0x558f25ca66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.100+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca6db0 con 0x558f25ca4220 2024-04-23T18:29:33.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.100+0000 7fe592635640 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558f25ca4220 0x558f25ca66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.100+0000 7fe592635640 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558f25ca4220 0x558f25ca66e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.101+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.101+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca6db0 con 0x558f25c9f870 2024-04-23T18:29:33.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.101+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5840bf070 con 0x558f25c9f870 2024-04-23T18:29:33.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.101+0000 7fe592e36640 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe5840ae050 0x7fe5840afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.101+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca6db0 con 0x7fe5840ae050 2024-04-23T18:29:33.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.101+0000 7fe593637640 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe5840ae050 0x7fe5840afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.102+0000 7fe593637640 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe5840ae050 0x7fe5840afa40 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.102+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x7fe5840ae050 2024-04-23T18:29:33.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.102+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9ae80 2024-04-23T18:29:33.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.102+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25c9ae80 2024-04-23T18:29:33.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.102+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9ae80 2024-04-23T18:29:33.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.102+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25c9ae80 2024-04-23T18:29:33.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.102+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x7fe5840ae050 2024-04-23T18:29:33.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.103+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x7fe5840ae050 2024-04-23T18:29:33.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.103+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x7fe5840ae050 2024-04-23T18:29:33.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.103+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe58c00a4a0 con 0x7fe5840ae050 2024-04-23T18:29:33.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.103+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9f870 2024-04-23T18:29:33.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.103+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5840bf070 con 0x558f25c9f870 2024-04-23T18:29:33.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.103+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25ca4220 2024-04-23T18:29:33.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.103+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.103+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9ae80 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.104+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25c9ae80 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.104+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x7fe5840ae050 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.104+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x7fe5840ae050 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.104+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9ae80 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.104+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25c9ae80 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.104+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9f870 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.104+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe5840bf070 con 0x558f25c9f870 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.104+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25ca4220 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.105+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.105+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25ca4220 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.105+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.105+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x7fe5840ae050 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.105+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x7fe5840ae050 2024-04-23T18:29:33.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.105+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25ca4220 2024-04-23T18:29:33.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.105+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.105+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25ca4220 2024-04-23T18:29:33.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.105+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.105+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9ae80 2024-04-23T18:29:33.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.106+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25c9ae80 2024-04-23T18:29:33.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.106+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9ae80 2024-04-23T18:29:33.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.106+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25c9ae80 2024-04-23T18:29:33.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.106+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x7fe5840ae050 2024-04-23T18:29:33.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.106+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x7fe5840ae050 2024-04-23T18:29:33.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.106+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25ca4220 2024-04-23T18:29:33.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.106+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.106+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9f870 2024-04-23T18:29:33.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.107+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe5840bf070 con 0x558f25c9f870 2024-04-23T18:29:33.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.107+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9ae80 2024-04-23T18:29:33.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.107+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x558f25c9ae80 2024-04-23T18:29:33.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.107+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x7fe5840ae050 2024-04-23T18:29:33.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.107+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x7fe5840ae050 2024-04-23T18:29:33.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.107+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25ca4220 2024-04-23T18:29:33.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.107+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.107+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x7fe5840ae050 2024-04-23T18:29:33.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.108+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x7fe5840ae050 2024-04-23T18:29:33.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.108+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9f870 2024-04-23T18:29:33.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.108+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5840bf070 con 0x558f25c9f870 2024-04-23T18:29:33.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.108+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25ca4220 2024-04-23T18:29:33.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.108+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.108+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x7fe5840ae050 2024-04-23T18:29:33.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c040040 con 0x7fe5840ae050 2024-04-23T18:29:33.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9ae80 2024-04-23T18:29:33.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f25c9eb10 con 0x558f25c9f870 2024-04-23T18:29:33.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe5840d5040 con 0x558f25c9f870 2024-04-23T18:29:33.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:33.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:33.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca2b30 con 0x558f25c9ae80 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca2b30 con 0x558f25c9ae80 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.109+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca2b30 con 0x7fe5840ae050 2024-04-23T18:29:33.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe58c040040 con 0x7fe5840ae050 2024-04-23T18:29:33.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:33.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 20 zone default found 2024-04-23T18:29:33.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 4 Realm: () 2024-04-23T18:29:33.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:33.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:33.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:33.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 20 zonegroup default 2024-04-23T18:29:33.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca3460 con 0x7fe5840ae050 2024-04-23T18:29:33.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe5840ae050 2024-04-23T18:29:33.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca3460 con 0x558f25ca4220 2024-04-23T18:29:33.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.110+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca8c10 con 0x558f25ca4220 2024-04-23T18:29:33.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.111+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.111+0000 7fe597136800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.111+0000 7fe597136800 20 started sync module instance, tier type = 2024-04-23T18:29:33.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.111+0000 7fe597136800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:33.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.111+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca80b0 con 0x558f25c9f870 2024-04-23T18:29:33.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.112+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5840d5040 con 0x558f25c9f870 2024-04-23T18:29:33.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.112+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94073302713552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca9460 con 0x558f25c9f870 2024-04-23T18:29:33.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.112+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca9cb0 con 0x558f25c9ae80 2024-04-23T18:29:33.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.113+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94073302713552] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5840d5040 con 0x558f25c9f870 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.113+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.113+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94073302716336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca9cb0 con 0x558f25c9ae80 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.113+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25caa7d0 con 0x558f25ca4220 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.114+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94073302716336] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.114+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.114+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94073302718464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca9c20 con 0x558f25ca4220 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.114+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25cab690 con 0x558f25c9f870 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.115+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94073302718464] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.115+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5840d5040 con 0x558f25c9f870 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.115+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94073302723520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25cabee0 con 0x558f25c9f870 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.115+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25cac790 con 0x558f25c9ae80 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.116+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.116+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94073302723520] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5840d5040 con 0x558f25c9f870 2024-04-23T18:29:33.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.116+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94073302727216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25cac300 con 0x558f25c9ae80 2024-04-23T18:29:33.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.116+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25cad200 con 0x7fe5840ae050 2024-04-23T18:29:33.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.117+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe5840ae050 2024-04-23T18:29:33.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.117+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94073302732016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25cad1c0 con 0x7fe5840ae050 2024-04-23T18:29:33.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.117+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25cae170 con 0x7fe5840ae050 2024-04-23T18:29:33.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.117+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94073302727216] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.118+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94073302732016] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe5840ae050 2024-04-23T18:29:33.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.119+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe5840ae050 2024-04-23T18:29:33.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.119+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94073302734368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25cae170 con 0x7fe5840ae050 2024-04-23T18:29:33.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.119+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25caea40 con 0x7fe5840ae050 2024-04-23T18:29:33.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.120+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94073302734368] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe5840ae050 2024-04-23T18:29:33.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.120+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe5840ae050 2024-04-23T18:29:33.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.120+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94073302728272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25cae170 con 0x7fe5840ae050 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.120+0000 7fe597136800 20 add_watcher() i=0 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.120+0000 7fe597136800 20 add_watcher() i=1 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.120+0000 7fe597136800 20 add_watcher() i=2 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.120+0000 7fe597136800 20 add_watcher() i=3 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.120+0000 7fe597136800 20 add_watcher() i=4 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.120+0000 7fe597136800 20 add_watcher() i=5 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.120+0000 7fe597136800 20 add_watcher() i=6 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.121+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94073302728272] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe5840ae050 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.121+0000 7fe597136800 20 add_watcher() i=7 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.121+0000 7fe597136800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.121+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25cb1a70 con 0x558f25c9ae80 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.121+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.121+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94073302738240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25caef10 con 0x558f25c9ae80 2024-04-23T18:29:33.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.122+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94073302738240] v32'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.122+0000 7fe4497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:33.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.122+0000 7fe597136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:33.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.122+0000 7fe597136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:33.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.123+0000 7fe597136800 5 note: GC not initialized 2024-04-23T18:29:33.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.123+0000 7fe3c3fff640 20 reqs_thread_entry: start 2024-04-23T18:29:33.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.123+0000 7fe597136800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:33.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.123+0000 7fe597136800 20 Filter name: none 2024-04-23T18:29:33.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.123+0000 7fe3c1ffb640 20 reqs_thread_entry: start 2024-04-23T18:29:33.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.123+0000 7fe597136800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:33.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.123+0000 7fe597136800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.123+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25ce5110 con 0x558f25c9ae80 2024-04-23T18:29:33.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.123+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.123+0000 7fe597136800 20 rados_obj.operate() r=0 bl.length=556 2024-04-23T18:29:33.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.123+0000 7fe597136800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:33.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.123+0000 7fe597136800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:33.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.123+0000 7fe597136800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:33.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.124+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25ceb850 con 0x558f25c9ae80 2024-04-23T18:29:33.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe597136800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:33.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe597136800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:33.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe597136800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:33.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94073302987488 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25ce6fe0 con 0x558f25c9ae80 2024-04-23T18:29:33.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify (1) cookie 94073302727216 notify 137438953482 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fe58c018df0 con 0x558f25c9ae80 2024-04-23T18:29:33.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe4767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94073302727216 notifier 4413 bl.length()=567 2024-04-23T18:29:33.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe4767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:33.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe4767fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe4767fc640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe458003ea0 con 0x558f25c9ae80 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(64 notify.4 [notify cookie 94073302987488 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify_complete (2) cookie 94073302987488 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe58c005040 con 0x558f25c9ae80 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.125+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25ceb2e0 con 0x558f25c9f870 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.126+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(66 foo:foo2 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5840d5040 con 0x558f25c9f870 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.126+0000 7fe597136800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.126+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94073302987488 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f25ce6b30 con 0x558f25c9f870 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.127+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== watch-notify(notify (1) cookie 94073302713552 notify 137438953477 ret 0) ==== 201+0+0 (crc 0 0 0) 0x558f25b61260 con 0x558f25c9f870 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.127+0000 7fe475ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94073302713552 notifier 4413 bl.length()=159 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.127+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 notify.0 [notify cookie 94073302987488 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe5840d5040 con 0x558f25c9f870 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.127+0000 7fe475ffb640 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe3c80032c0 con 0x558f25c9f870 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.127+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== watch-notify(notify_complete (2) cookie 94073302987488 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558f25b60fd0 con 0x558f25c9f870 2024-04-23T18:29:33.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.127+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5840d5040 con 0x558f25c9f870 2024-04-23T18:29:33.133 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:33.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.128+0000 7fe4497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:33.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.128+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94073302738240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25ce3690 con 0x558f25c9ae80 2024-04-23T18:29:33.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.129+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94073302738240] v32'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.129+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94073302713552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25cae540 con 0x558f25c9f870 2024-04-23T18:29:33.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.130+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94073302713552] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5840d5040 con 0x558f25c9f870 2024-04-23T18:29:33.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.130+0000 7fe597136800 20 remove_watcher() i=0 2024-04-23T18:29:33.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.130+0000 7fe597136800 2 removed watcher, disabling cache 2024-04-23T18:29:33.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.130+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94073302716336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25cae540 con 0x558f25c9ae80 2024-04-23T18:29:33.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.131+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94073302716336] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.131+0000 7fe597136800 20 remove_watcher() i=1 2024-04-23T18:29:33.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.131+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94073302718464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca8fb0 con 0x558f25ca4220 2024-04-23T18:29:33.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.132+0000 7fe592635640 1 -- 172.21.15.119:0/4015975707 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94073302718464] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe588037040 con 0x558f25ca4220 2024-04-23T18:29:33.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.132+0000 7fe597136800 20 remove_watcher() i=2 2024-04-23T18:29:33.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.132+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94073302723520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca9800 con 0x558f25c9f870 2024-04-23T18:29:33.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.133+0000 7fe592e36640 1 -- 172.21.15.119:0/4015975707 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94073302723520] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe5840d5040 con 0x558f25c9f870 2024-04-23T18:29:33.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.133+0000 7fe597136800 20 remove_watcher() i=3 2024-04-23T18:29:33.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.133+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94073302727216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25ca9800 con 0x558f25c9ae80 2024-04-23T18:29:33.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.134+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94073302727216] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x558f25c9ae80 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.134+0000 7fe597136800 20 remove_watcher() i=4 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.134+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94073302732016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25caba30 con 0x7fe5840ae050 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.135+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94073302732016] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe5840ae050 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.135+0000 7fe597136800 20 remove_watcher() i=5 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.135+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94073302734368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25caba30 con 0x7fe5840ae050 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.137+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94073302734368] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe5840ae050 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.137+0000 7fe597136800 20 remove_watcher() i=6 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.137+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94073302728272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f25cad620 con 0x7fe5840ae050 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.137+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94073302728272] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c040040 con 0x7fe5840ae050 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.137+0000 7fe597136800 20 remove_watcher() i=7 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe5840ae050 msgr2=0x7fe5840afa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe5840ae050 0x7fe5840afa40 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f25c9ae80 msgr2=0x558f25c9d340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f25c9ae80 0x558f25c9d340 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f25c9f870 msgr2=0x558f25ca1c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f25c9f870 0x558f25ca1c60 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558f25ca4220 msgr2=0x558f25ca66e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558f25ca4220 0x558f25ca66e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe45c036e60 msgr2=0x7fe45c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe45c036e60 0x7fe45c039320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe58800ffd0 tx=0x7fe588023040 comp rx=0 tx=0).stop 2024-04-23T18:29:33.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25c88350 msgr2=0x558f25c8f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 --2- 172.21.15.119:0/4015975707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25c88350 0x558f25c8f750 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe58408ed70 tx=0x7fe584055ec0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 reap_dead start 2024-04-23T18:29:33.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe593637640 1 -- 172.21.15.119:0/4015975707 reap_dead start 2024-04-23T18:29:33.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 shutdown_connections 2024-04-23T18:29:33.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 >> 172.21.15.119:0/4015975707 conn(0x558f25c84660 msgr2=0x558f25c81cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 shutdown_connections 2024-04-23T18:29:33.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/4015975707 wait complete. 2024-04-23T18:29:33.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/3738149549 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe46c036eb0 msgr2=0x7fe46c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 --2- 172.21.15.119:0/3738149549 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe46c036eb0 0x7fe46c039370 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x558f25c5ece0 tx=0x7fe588006000 comp rx=0 tx=0).stop 2024-04-23T18:29:33.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/3738149549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62620 msgr2=0x558f25b60a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 --2- 172.21.15.119:0/3738149549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62620 0x558f25b60a90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe584052460 tx=0x7fe584066e80 comp rx=0 tx=0).stop 2024-04-23T18:29:33.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/3738149549 shutdown_connections 2024-04-23T18:29:33.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 --2- 172.21.15.119:0/3738149549 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe46c036eb0 0x7fe46c039370 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 --2- 172.21.15.119:0/3738149549 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62620 0x558f25b60a90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/3738149549 >> 172.21.15.119:0/3738149549 conn(0x558f25c6d0a0 msgr2=0x558f25c6d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/3738149549 shutdown_connections 2024-04-23T18:29:33.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.138+0000 7fe597136800 1 -- 172.21.15.119:0/3738149549 wait complete. 2024-04-23T18:29:33.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558f25c67ff0 msgr2=0x558f25c6a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.142 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558f25c67ff0 0x558f25c6a440 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f25b653b0 msgr2=0x558f25c617f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f25b653b0 0x558f25c617f0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f25c640b0 msgr2=0x558f25c664a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f25c640b0 0x558f25c664a0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe478036e60 msgr2=0x7fe478039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe478036e60 0x7fe478039320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe588000c00 tx=0x7fe5880013b0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 msgr2=0x558f25c5a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 --2- 172.21.15.119:0/3910481867 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f25b62a80 0x558f25c5a780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe584055040 tx=0x7fe584002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe593637640 1 -- 172.21.15.119:0/3910481867 reap_dead start 2024-04-23T18:29:33.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 shutdown_connections 2024-04-23T18:29:33.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 >> 172.21.15.119:0/3910481867 conn(0x558f25b5c430 msgr2=0x558f25c519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 shutdown_connections 2024-04-23T18:29:33.143 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.139+0000 7fe597136800 1 -- 172.21.15.119:0/3910481867 wait complete. 2024-04-23T18:29:33.144 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:33.144 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-23T18:29:33.145 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-23T18:29:33.145 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-23T18:29:33.187 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:33.187 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:33.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.195+0000 7fb754f19800 1 Processor -- start 2024-04-23T18:29:33.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.195+0000 7fb754f19800 1 -- start start 2024-04-23T18:29:33.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.196+0000 7fb754f19800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55be85267a60 0x55be85269e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.196+0000 7fb754f19800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55be85117560 con 0x55be8526a390 2024-04-23T18:29:33.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.196+0000 7fb754f19800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55be85108e20 con 0x55be85267a60 2024-04-23T18:29:33.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.196+0000 7fb752a18640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55be85267a60 0x55be85269e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.196+0000 7fb74bfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55be8526a390 0x55be8526c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40682/0 (socket says 172.21.15.119:40682) 2024-04-23T18:29:33.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.196+0000 7fb74bfff640 1 -- 172.21.15.119:0/3428121501 learned_addr learned my addr 172.21.15.119:0/3428121501 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:33.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.196+0000 7fb752217640 1 -- 172.21.15.119:0/3428121501 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4191075130 0 0) 0x55be85117560 con 0x55be8526a390 2024-04-23T18:29:33.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.196+0000 7fb752217640 1 -- 172.21.15.119:0/3428121501 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb740001e10 con 0x55be8526a390 2024-04-23T18:29:33.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.196+0000 7fb752a18640 1 -- 172.21.15.119:0/3428121501 >> v1:172.21.15.62:6789/0 conn(0x55be8526a390 legacy=0x55be8526c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.196+0000 7fb752a18640 1 -- 172.21.15.119:0/3428121501 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be85116e60 con 0x55be85267a60 2024-04-23T18:29:33.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.198+0000 7fb752a18640 1 --2- 172.21.15.119:0/3428121501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be85269e50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb74400a470 tx=0x7fb74401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6a531d9d47e6be server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.198+0000 7fb752217640 1 -- 172.21.15.119:0/3428121501 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb744057070 con 0x55be85267a60 2024-04-23T18:29:33.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.198+0000 7fb752217640 1 -- 172.21.15.119:0/3428121501 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb744052570 con 0x55be85267a60 2024-04-23T18:29:33.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.198+0000 7fb752217640 1 -- 172.21.15.119:0/3428121501 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb744052870 con 0x55be85267a60 2024-04-23T18:29:33.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.199+0000 7fb754f19800 1 -- 172.21.15.119:0/3428121501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 msgr2=0x55be85269e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.199+0000 7fb754f19800 1 --2- 172.21.15.119:0/3428121501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be85269e50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb74400a470 tx=0x7fb74401cdb0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.199+0000 7fb754f19800 1 -- 172.21.15.119:0/3428121501 shutdown_connections 2024-04-23T18:29:33.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.199+0000 7fb754f19800 1 --2- 172.21.15.119:0/3428121501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be85269e50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.199+0000 7fb754f19800 1 -- 172.21.15.119:0/3428121501 >> 172.21.15.119:0/3428121501 conn(0x55be85261410 msgr2=0x55be85263830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.199+0000 7fb754f19800 1 -- 172.21.15.119:0/3428121501 shutdown_connections 2024-04-23T18:29:33.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.199+0000 7fb754f19800 1 -- 172.21.15.119:0/3428121501 wait complete. 2024-04-23T18:29:33.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.210+0000 7fb754f19800 1 Processor -- start 2024-04-23T18:29:33.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.210+0000 7fb754f19800 1 -- start start 2024-04-23T18:29:33.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.211+0000 7fb754f19800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be85357fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.211+0000 7fb754f19800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55be851b25b0 con 0x55be85267a60 2024-04-23T18:29:33.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.211+0000 7fb752a18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be85357fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.211+0000 7fb752a18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be85357fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33240/0 (socket says 172.21.15.119:33240) 2024-04-23T18:29:33.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.211+0000 7fb752a18640 1 -- 172.21.15.119:0/2618989580 learned_addr learned my addr 172.21.15.119:0/2618989580 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.211+0000 7fb752a18640 1 -- 172.21.15.119:0/2618989580 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be85128860 con 0x55be85267a60 2024-04-23T18:29:33.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.211+0000 7fb752a18640 1 --2- 172.21.15.119:0/2618989580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be85357fb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb744055040 tx=0x7fb74404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111ad5baad208a9b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.212+0000 7fb640e09640 1 -- 172.21.15.119:0/2618989580 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb744057070 con 0x55be85267a60 2024-04-23T18:29:33.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.212+0000 7fb640e09640 1 -- 172.21.15.119:0/2618989580 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb744063070 con 0x55be85267a60 2024-04-23T18:29:33.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.212+0000 7fb640e09640 1 -- 172.21.15.119:0/2618989580 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb744052720 con 0x55be85267a60 2024-04-23T18:29:33.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.212+0000 7fb754f19800 1 -- 172.21.15.119:0/2618989580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 msgr2=0x55be85357fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.212+0000 7fb754f19800 1 --2- 172.21.15.119:0/2618989580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be85357fb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb744055040 tx=0x7fb74404c000 comp rx=0 tx=0).stop 2024-04-23T18:29:33.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.212+0000 7fb754f19800 1 -- 172.21.15.119:0/2618989580 shutdown_connections 2024-04-23T18:29:33.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.212+0000 7fb754f19800 1 --2- 172.21.15.119:0/2618989580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be85357fb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.212+0000 7fb754f19800 1 -- 172.21.15.119:0/2618989580 >> 172.21.15.119:0/2618989580 conn(0x55be85261410 msgr2=0x55be853538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.212+0000 7fb754f19800 1 -- 172.21.15.119:0/2618989580 shutdown_connections 2024-04-23T18:29:33.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.212+0000 7fb754f19800 1 -- 172.21.15.119:0/2618989580 wait complete. 2024-04-23T18:29:33.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.213+0000 7fb754f19800 1 Processor -- start 2024-04-23T18:29:33.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.213+0000 7fb754f19800 1 -- start start 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.213+0000 7fb754f19800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be852673a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.213+0000 7fb754f19800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55be852701b0 con 0x55be85267a60 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.213+0000 7fb752a18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be852673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.213+0000 7fb752a18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be852673a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33248/0 (socket says 172.21.15.119:33248) 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.213+0000 7fb752a18640 1 -- 172.21.15.119:0/4005661594 learned_addr learned my addr 172.21.15.119:0/4005661594 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.213+0000 7fb752a18640 1 -- 172.21.15.119:0/4005661594 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be85126eb0 con 0x55be85267a60 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.214+0000 7fb752a18640 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be852673a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb744055040 tx=0x7fb744002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.214+0000 7fb63f606640 1 -- 172.21.15.119:0/4005661594 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb744052e50 con 0x55be85267a60 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.214+0000 7fb63f606640 1 -- 172.21.15.119:0/4005661594 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74406c070 con 0x55be85267a60 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.214+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be85265a90 con 0x55be85267a60 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.214+0000 7fb63f606640 1 -- 172.21.15.119:0/4005661594 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb74405e5f0 con 0x55be85267a60 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.214+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be85265fb0 con 0x55be85267a60 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.214+0000 7fb63f606640 1 -- 172.21.15.119:0/4005661594 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb74405e790 con 0x55be85267a60 2024-04-23T18:29:33.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.215+0000 7fb63f606640 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb638037050 0x7fb638039510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.215+0000 7fb63f606640 1 -- 172.21.15.119:0/4005661594 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb74408eff0 con 0x55be85267a60 2024-04-23T18:29:33.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.215+0000 7fb74bfff640 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb638037050 0x7fb638039510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.215+0000 7fb754f19800 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55be8526a390 0x55be85368be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.215+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be85369120 con 0x55be8526a390 2024-04-23T18:29:33.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.215+0000 7fb753219640 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55be8526a390 0x55be85368be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.215+0000 7fb74bfff640 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb638037050 0x7fb638039510 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb73c000f60 tx=0x7fb73c0010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.215+0000 7fb753219640 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55be8526a390 0x55be85368be0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.216+0000 7fb753219640 1 -- 172.21.15.119:0/4005661594 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8526a390 2024-04-23T18:29:33.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.216+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be852662f0 con 0x55be8526a390 2024-04-23T18:29:33.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.216+0000 7fb753219640 1 -- 172.21.15.119:0/4005661594 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8526a390 2024-04-23T18:29:33.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.216+0000 7fb754f19800 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55be8536b390 0x55be8536d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.216+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be8536df90 con 0x55be8536b390 2024-04-23T18:29:33.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.216+0000 7fb752a18640 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55be8536b390 0x55be8536d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.216+0000 7fb752a18640 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55be8536b390 0x55be8536d800 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.216+0000 7fb752a18640 1 -- 172.21.15.119:0/4005661594 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb744071990 con 0x55be8536b390 2024-04-23T18:29:33.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.216+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be8536a340 con 0x55be8526a390 2024-04-23T18:29:33.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.217+0000 7fb753219640 1 -- 172.21.15.119:0/4005661594 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8526a390 2024-04-23T18:29:33.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.217+0000 7fb754f19800 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55be8536f3f0 0x55be85371880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.217+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be85371fe0 con 0x55be8536f3f0 2024-04-23T18:29:33.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.217+0000 7fb74bfff640 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55be8536f3f0 0x55be85371880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.217+0000 7fb74bfff640 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55be8536f3f0 0x55be85371880 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.218+0000 7fb74bfff640 1 -- 172.21.15.119:0/4005661594 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb73c009050 con 0x55be8536f3f0 2024-04-23T18:29:33.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.218+0000 7fb754f19800 1 Processor -- start 2024-04-23T18:29:33.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.218+0000 7fb754f19800 1 -- start start 2024-04-23T18:29:33.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.218+0000 7fb754f19800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85380490 0x55be853808b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.218+0000 7fb754f19800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55be85266980 con 0x55be85380490 2024-04-23T18:29:33.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.218+0000 7fb752a18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85380490 0x55be853808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.218+0000 7fb752a18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85380490 0x55be853808b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33258/0 (socket says 172.21.15.119:33258) 2024-04-23T18:29:33.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.218+0000 7fb752a18640 1 -- 172.21.15.119:0/534627271 learned_addr learned my addr 172.21.15.119:0/534627271 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.219+0000 7fb752a18640 1 -- 172.21.15.119:0/534627271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be85380df0 con 0x55be85380490 2024-04-23T18:29:33.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.219+0000 7fb752a18640 1 --2- 172.21.15.119:0/534627271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85380490 0x55be853808b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb744071fd0 tx=0x7fb744066e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.219+0000 7fb63ce01640 1 -- 172.21.15.119:0/534627271 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb74405ebb0 con 0x55be85380490 2024-04-23T18:29:33.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.219+0000 7fb63ce01640 1 -- 172.21.15.119:0/534627271 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb744058040 con 0x55be85380490 2024-04-23T18:29:33.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.219+0000 7fb63ce01640 1 -- 172.21.15.119:0/534627271 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb744066580 con 0x55be85380490 2024-04-23T18:29:33.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.219+0000 7fb754f19800 1 -- 172.21.15.119:0/534627271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be85381860 con 0x55be85380490 2024-04-23T18:29:33.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.219+0000 7fb754f19800 1 -- 172.21.15.119:0/534627271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be85381d60 con 0x55be85380490 2024-04-23T18:29:33.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.220+0000 7fb63ce01640 1 -- 172.21.15.119:0/534627271 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb744066720 con 0x55be85380490 2024-04-23T18:29:33.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.220+0000 7fb63ce01640 1 --2- 172.21.15.119:0/534627271 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb62c036e60 0x7fb62c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.220+0000 7fb63ce01640 1 -- 172.21.15.119:0/534627271 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb74409f9e0 con 0x55be85380490 2024-04-23T18:29:33.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.220+0000 7fb74bfff640 1 --2- 172.21.15.119:0/534627271 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb62c036e60 0x7fb62c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.220+0000 7fb754f19800 1 Processor -- start 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.220+0000 7fb754f19800 1 -- start start 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.220+0000 7fb74bfff640 1 --2- 172.21.15.119:0/534627271 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb62c036e60 0x7fb62c039320 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00bf90 tx=0x7fb73c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.220+0000 7fb754f19800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 0x55be8538db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.220+0000 7fb754f19800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55be852678e0 con 0x55be8538d720 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.221+0000 7fb752a18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 0x55be8538db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.221+0000 7fb752a18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 0x55be8538db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33266/0 (socket says 172.21.15.119:33266) 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.221+0000 7fb752a18640 1 -- 172.21.15.119:0/1770760074 learned_addr learned my addr 172.21.15.119:0/1770760074 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.221+0000 7fb752a18640 1 -- 172.21.15.119:0/1770760074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be8538e110 con 0x55be8538d720 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.221+0000 7fb752a18640 1 --2- 172.21.15.119:0/1770760074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 0x55be8538db40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb74405c4b0 tx=0x7fb744090460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574261eeb14efc31 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.221+0000 7fb6367fc640 1 -- 172.21.15.119:0/1770760074 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7440ad020 con 0x55be8538d720 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.221+0000 7fb6367fc640 1 -- 172.21.15.119:0/1770760074 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74408d8e0 con 0x55be8538d720 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.221+0000 7fb6367fc640 1 -- 172.21.15.119:0/1770760074 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb74407a520 con 0x55be8538d720 2024-04-23T18:29:33.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.221+0000 7fb754f19800 1 -- 172.21.15.119:0/1770760074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 msgr2=0x55be8538db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.221+0000 7fb754f19800 1 --2- 172.21.15.119:0/1770760074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 0x55be8538db40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb74405c4b0 tx=0x7fb744090460 comp rx=0 tx=0).stop 2024-04-23T18:29:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.222+0000 7fb754f19800 1 -- 172.21.15.119:0/1770760074 shutdown_connections 2024-04-23T18:29:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.222+0000 7fb754f19800 1 --2- 172.21.15.119:0/1770760074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 0x55be8538db40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.222+0000 7fb754f19800 1 -- 172.21.15.119:0/1770760074 >> 172.21.15.119:0/1770760074 conn(0x55be853899a0 msgr2=0x55be85387a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.222+0000 7fb754f19800 1 -- 172.21.15.119:0/1770760074 shutdown_connections 2024-04-23T18:29:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.222+0000 7fb754f19800 1 -- 172.21.15.119:0/1770760074 wait complete. 2024-04-23T18:29:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.222+0000 7fb754f19800 1 Processor -- start 2024-04-23T18:29:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.222+0000 7fb754f19800 1 -- start start 2024-04-23T18:29:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.222+0000 7fb754f19800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 0x55be853947a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.222+0000 7fb754f19800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55be85358670 con 0x55be8538d720 2024-04-23T18:29:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.222+0000 7fb752a18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 0x55be853947a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.222+0000 7fb752a18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 0x55be853947a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33274/0 (socket says 172.21.15.119:33274) 2024-04-23T18:29:33.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.222+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 learned_addr learned my addr 172.21.15.119:0/4151541893 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.223+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be85394ce0 con 0x55be8538d720 2024-04-23T18:29:33.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.223+0000 7fb752a18640 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 0x55be853947a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb744067ef0 tx=0x7fb74405bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.223+0000 7fb634ff9640 1 -- 172.21.15.119:0/4151541893 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb74409fe30 con 0x55be8538d720 2024-04-23T18:29:33.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.223+0000 7fb634ff9640 1 -- 172.21.15.119:0/4151541893 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb744091440 con 0x55be8538d720 2024-04-23T18:29:33.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.223+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be85394ce0 con 0x55be8538d720 2024-04-23T18:29:33.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.223+0000 7fb634ff9640 1 -- 172.21.15.119:0/4151541893 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb74409ab30 con 0x55be8538d720 2024-04-23T18:29:33.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.223+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be85394ce0 con 0x55be8538d720 2024-04-23T18:29:33.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.224+0000 7fb634ff9640 1 -- 172.21.15.119:0/4151541893 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb7440c4060 con 0x55be8538d720 2024-04-23T18:29:33.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.224+0000 7fb634ff9640 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb61c036eb0 0x7fb61c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.224+0000 7fb754f19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.224+0000 7fb634ff9640 1 -- 172.21.15.119:0/4151541893 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb7440b8030 con 0x55be8538d720 2024-04-23T18:29:33.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.224+0000 7fb74bfff640 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb61c036eb0 0x7fb61c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.224+0000 7fb754f19800 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55be8539fdb0 0x55be853a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.224+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853a29c0 con 0x55be8539fdb0 2024-04-23T18:29:33.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.224+0000 7fb753219640 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55be8539fdb0 0x55be853a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb74bfff640 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb61c036eb0 0x7fb61c039370 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00efd0 tx=0x7fb73c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb753219640 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55be8539fdb0 0x55be853a2270 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8539fdb0 2024-04-23T18:29:33.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 20 realm 2024-04-23T18:29:33.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853a2dd0 con 0x55be8539fdb0 2024-04-23T18:29:33.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8539fdb0 2024-04-23T18:29:33.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:33.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3670 con 0x55be8539fdb0 2024-04-23T18:29:33.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8539fdb0 2024-04-23T18:29:33.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be8539fdb0 2024-04-23T18:29:33.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8539fdb0 2024-04-23T18:29:33.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:33.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.225+0000 7fb754f19800 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55be853a4540 0x55be853a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.226+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853a7070 con 0x55be853a4540 2024-04-23T18:29:33.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.226+0000 7fb752a18640 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55be853a4540 0x55be853a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.226+0000 7fb752a18640 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55be853a4540 0x55be853a6930 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.226+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb744097020 con 0x55be853a4540 2024-04-23T18:29:33.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.226+0000 7fb754f19800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:33.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.226+0000 7fb754f19800 20 searching for the correct realm 2024-04-23T18:29:33.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.226+0000 7fb754f19800 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55be853a90f0 0x55be853ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.226+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853abc80 con 0x55be853a90f0 2024-04-23T18:29:33.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.226+0000 7fb74bfff640 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55be853a90f0 0x55be853ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.226+0000 7fb74bfff640 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55be853a90f0 0x55be853ab5b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.227+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.227+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853abc80 con 0x55be853a4540 2024-04-23T18:29:33.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.227+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb744097020 con 0x55be853a4540 2024-04-23T18:29:33.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.227+0000 7fb752a18640 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb7440c6070 0x7fb7440951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.227+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853abc80 con 0x7fb7440c6070 2024-04-23T18:29:33.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.227+0000 7fb753219640 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb7440c6070 0x7fb7440951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.228+0000 7fb753219640 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb7440c6070 0x7fb7440951c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.228+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c00a4a0 con 0x7fb7440c6070 2024-04-23T18:29:33.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.228+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be8539fdb0 2024-04-23T18:29:33.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.228+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8539fdb0 2024-04-23T18:29:33.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.228+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be8539fdb0 2024-04-23T18:29:33.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.228+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8539fdb0 2024-04-23T18:29:33.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.228+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x7fb7440c6070 2024-04-23T18:29:33.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.229+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c00a4a0 con 0x7fb7440c6070 2024-04-23T18:29:33.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.229+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x7fb7440c6070 2024-04-23T18:29:33.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.229+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb74c00a4a0 con 0x7fb7440c6070 2024-04-23T18:29:33.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.229+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be853a4540 2024-04-23T18:29:33.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.229+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb744097020 con 0x55be853a4540 2024-04-23T18:29:33.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.229+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be853a90f0 2024-04-23T18:29:33.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.229+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.229+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be8539fdb0 2024-04-23T18:29:33.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.230+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8539fdb0 2024-04-23T18:29:33.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.230+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x7fb7440c6070 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.230+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c00a4a0 con 0x7fb7440c6070 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.230+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be8539fdb0 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.230+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8539fdb0 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.230+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be853a4540 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.230+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb744097020 con 0x55be853a4540 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.230+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be853a90f0 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.231+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.231+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be853a90f0 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.231+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.231+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x7fb7440c6070 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.231+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c00a4a0 con 0x7fb7440c6070 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.231+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be853a90f0 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.231+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.231+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be853a90f0 2024-04-23T18:29:33.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.232+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.232+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be8539fdb0 2024-04-23T18:29:33.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.232+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8539fdb0 2024-04-23T18:29:33.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.232+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be8539fdb0 2024-04-23T18:29:33.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.232+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8539fdb0 2024-04-23T18:29:33.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.232+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x7fb7440c6070 2024-04-23T18:29:33.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.232+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c00a4a0 con 0x7fb7440c6070 2024-04-23T18:29:33.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.232+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be853a90f0 2024-04-23T18:29:33.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.233+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.233+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be853a4540 2024-04-23T18:29:33.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.233+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb744097020 con 0x55be853a4540 2024-04-23T18:29:33.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.233+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be8539fdb0 2024-04-23T18:29:33.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.233+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c00a4a0 con 0x55be8539fdb0 2024-04-23T18:29:33.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.233+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x7fb7440c6070 2024-04-23T18:29:33.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.233+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c00a4a0 con 0x7fb7440c6070 2024-04-23T18:29:33.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.233+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be853a90f0 2024-04-23T18:29:33.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.234+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.234+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x7fb7440c6070 2024-04-23T18:29:33.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.234+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c00a4a0 con 0x7fb7440c6070 2024-04-23T18:29:33.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.234+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be853a4540 2024-04-23T18:29:33.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.234+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb744097020 con 0x55be853a4540 2024-04-23T18:29:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.234+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be853a90f0 2024-04-23T18:29:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.234+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.234+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x7fb7440c6070 2024-04-23T18:29:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.235+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74c040040 con 0x7fb7440c6070 2024-04-23T18:29:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.235+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be8539fdb0 2024-04-23T18:29:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.235+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.235+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55be853a3a10 con 0x55be853a4540 2024-04-23T18:29:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.235+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7440d9040 con 0x55be853a4540 2024-04-23T18:29:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.235+0000 7fb754f19800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.235+0000 7fb754f19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.235+0000 7fb754f19800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.235+0000 7fb754f19800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:33.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.235+0000 7fb754f19800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.235+0000 7fb754f19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.235+0000 7fb754f19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.235+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853a79f0 con 0x55be8539fdb0 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853a79f0 con 0x55be8539fdb0 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853a79f0 con 0x7fb7440c6070 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb74c040040 con 0x7fb7440c6070 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:33.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 20 zone default found 2024-04-23T18:29:33.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 4 Realm: () 2024-04-23T18:29:33.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:33.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:33.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:33.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 20 zonegroup default 2024-04-23T18:29:33.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853a7de0 con 0x7fb7440c6070 2024-04-23T18:29:33.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x7fb7440c6070 2024-04-23T18:29:33.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.236+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853a8220 con 0x55be853a90f0 2024-04-23T18:29:33.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.237+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.237+0000 7fb754f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.237+0000 7fb754f19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.237+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853adae0 con 0x55be853a90f0 2024-04-23T18:29:33.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.237+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.237+0000 7fb754f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.237+0000 7fb754f19800 20 started sync module instance, tier type = 2024-04-23T18:29:33.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.237+0000 7fb754f19800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:33.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.237+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853acf80 con 0x55be853a4540 2024-04-23T18:29:33.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.238+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7440d9040 con 0x55be853a4540 2024-04-23T18:29:33.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.238+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94276767369936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853ade80 con 0x55be853a4540 2024-04-23T18:29:33.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.238+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853ae6d0 con 0x55be8539fdb0 2024-04-23T18:29:33.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.239+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94276767369936] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7440d9040 con 0x55be853a4540 2024-04-23T18:29:33.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.239+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.239+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94276767375904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853aeaf0 con 0x55be8539fdb0 2024-04-23T18:29:33.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.239+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853af4b0 con 0x55be853a90f0 2024-04-23T18:29:33.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.240+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94276767375904] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.240+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.240+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94276767376960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853aea60 con 0x55be853a90f0 2024-04-23T18:29:33.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.240+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b0320 con 0x55be853a4540 2024-04-23T18:29:33.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.241+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94276767376960] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.241+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7440d9040 con 0x55be853a4540 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.242+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94276767381584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b0b70 con 0x55be853a4540 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.242+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b1420 con 0x55be8539fdb0 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.242+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94276767381584] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7440d9040 con 0x55be853a4540 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.243+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.243+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94276767385280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b0f90 con 0x55be8539fdb0 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.243+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b1ea0 con 0x7fb7440c6070 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.243+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x7fb7440c6070 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.244+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94276767390128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b1e10 con 0x7fb7440c6070 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.244+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b2e10 con 0x7fb7440c6070 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.244+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94276767385280] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.245+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94276767390128] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x7fb7440c6070 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.245+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x7fb7440c6070 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.245+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94276767392448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b2910 con 0x7fb7440c6070 2024-04-23T18:29:33.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.245+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b32c0 con 0x7fb7440c6070 2024-04-23T18:29:33.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.245+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94276767392448] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x7fb7440c6070 2024-04-23T18:29:33.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.245+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x7fb7440c6070 2024-04-23T18:29:33.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.246+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94276767386336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b32c0 con 0x7fb7440c6070 2024-04-23T18:29:33.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.246+0000 7fb754f19800 20 add_watcher() i=0 2024-04-23T18:29:33.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.246+0000 7fb754f19800 20 add_watcher() i=1 2024-04-23T18:29:33.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.246+0000 7fb754f19800 20 add_watcher() i=2 2024-04-23T18:29:33.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.246+0000 7fb754f19800 20 add_watcher() i=3 2024-04-23T18:29:33.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.246+0000 7fb754f19800 20 add_watcher() i=4 2024-04-23T18:29:33.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.246+0000 7fb754f19800 20 add_watcher() i=5 2024-04-23T18:29:33.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.246+0000 7fb754f19800 20 add_watcher() i=6 2024-04-23T18:29:33.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.246+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94276767386336] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x7fb7440c6070 2024-04-23T18:29:33.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.246+0000 7fb754f19800 20 add_watcher() i=7 2024-04-23T18:29:33.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.246+0000 7fb754f19800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:33.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.246+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853b6670 con 0x55be8539fdb0 2024-04-23T18:29:33.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.247+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.247+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94276767408160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b3430 con 0x55be8539fdb0 2024-04-23T18:29:33.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.248+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94276767408160] v32'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.248+0000 7fb6097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:33.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.248+0000 7fb754f19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:33.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.248+0000 7fb754f19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:33.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.248+0000 7fb754f19800 5 note: GC not initialized 2024-04-23T18:29:33.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.248+0000 7fb583fff640 20 reqs_thread_entry: start 2024-04-23T18:29:33.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.248+0000 7fb754f19800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:33.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.248+0000 7fb754f19800 20 Filter name: none 2024-04-23T18:29:33.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.248+0000 7fb581ffb640 20 reqs_thread_entry: start 2024-04-23T18:29:33.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.249+0000 7fb754f19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.249+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853e99b0 con 0x55be8539fdb0 2024-04-23T18:29:33.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.249+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.249+0000 7fb754f19800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:33.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.249+0000 7fb754f19800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.249+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853ea3a0 con 0x55be8539fdb0 2024-04-23T18:29:33.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.249+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.249+0000 7fb754f19800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:33.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.249+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55be853eb3b0 con 0x55be853a4540 2024-04-23T18:29:33.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.250+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fb7440d9040 con 0x55be853a4540 2024-04-23T18:29:33.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.250+0000 7fb6097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:33.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.250+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94276767408160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853bff40 con 0x55be8539fdb0 2024-04-23T18:29:33.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.251+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94276767408160] v32'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.251+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94276767369936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b6020 con 0x55be853a4540 2024-04-23T18:29:33.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.252+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94276767369936] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7440d9040 con 0x55be853a4540 2024-04-23T18:29:33.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.252+0000 7fb754f19800 20 remove_watcher() i=0 2024-04-23T18:29:33.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.252+0000 7fb754f19800 2 removed watcher, disabling cache 2024-04-23T18:29:33.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.252+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94276767375904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b6020 con 0x55be8539fdb0 2024-04-23T18:29:33.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.253+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94276767375904] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.253+0000 7fb754f19800 20 remove_watcher() i=1 2024-04-23T18:29:33.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.253+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94276767376960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853ae220 con 0x55be853a90f0 2024-04-23T18:29:33.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.254+0000 7fb74bfff640 1 -- 172.21.15.119:0/4151541893 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94276767376960] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73c009050 con 0x55be853a90f0 2024-04-23T18:29:33.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.254+0000 7fb754f19800 20 remove_watcher() i=2 2024-04-23T18:29:33.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.254+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94276767381584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b6020 con 0x55be853a4540 2024-04-23T18:29:33.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.255+0000 7fb752a18640 1 -- 172.21.15.119:0/4151541893 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94276767381584] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7440d9040 con 0x55be853a4540 2024-04-23T18:29:33.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.255+0000 7fb754f19800 20 remove_watcher() i=3 2024-04-23T18:29:33.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.255+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94276767385280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853af850 con 0x55be8539fdb0 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.256+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94276767385280] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x55be8539fdb0 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.256+0000 7fb754f19800 20 remove_watcher() i=4 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.256+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94276767390128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b6020 con 0x7fb7440c6070 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.257+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94276767390128] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x7fb7440c6070 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.257+0000 7fb754f19800 20 remove_watcher() i=5 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.257+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94276767392448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b06c0 con 0x7fb7440c6070 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.258+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94276767392448] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x7fb7440c6070 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.258+0000 7fb754f19800 20 remove_watcher() i=6 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.258+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94276767386336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55be853b19b0 con 0x7fb7440c6070 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94276767386336] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74c040040 con 0x7fb7440c6070 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 20 remove_watcher() i=7 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb7440c6070 msgr2=0x7fb7440951c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb7440c6070 0x7fb7440951c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55be8539fdb0 msgr2=0x55be853a2270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55be8539fdb0 0x55be853a2270 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55be853a4540 msgr2=0x55be853a6930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55be853a4540 0x55be853a6930 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55be853a90f0 msgr2=0x55be853ab5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55be853a90f0 0x55be853ab5b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb61c036eb0 msgr2=0x7fb61c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb61c036eb0 0x7fb61c039370 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00efd0 tx=0x7fb73c010000 comp rx=0 tx=0).stop 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 msgr2=0x55be853947a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb753219640 1 -- 172.21.15.119:0/4151541893 reap_dead start 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 0x55be853947a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb744067ef0 tx=0x7fb74405bf50 comp rx=0 tx=0).stop 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 shutdown_connections 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 --2- 172.21.15.119:0/4151541893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be8538d720 0x55be853947a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 >> 172.21.15.119:0/4151541893 conn(0x55be853899a0 msgr2=0x55be85387000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 shutdown_connections 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.259+0000 7fb754f19800 1 -- 172.21.15.119:0/4151541893 wait complete. 2024-04-23T18:29:33.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/534627271 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb62c036e60 msgr2=0x7fb62c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 --2- 172.21.15.119:0/534627271 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb62c036e60 0x7fb62c039320 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00bf90 tx=0x7fb73c00f000 comp rx=0 tx=0).stop 2024-04-23T18:29:33.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/534627271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85380490 msgr2=0x55be853808b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 --2- 172.21.15.119:0/534627271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85380490 0x55be853808b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb744071fd0 tx=0x7fb744066e70 comp rx=0 tx=0).stop 2024-04-23T18:29:33.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/534627271 shutdown_connections 2024-04-23T18:29:33.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 --2- 172.21.15.119:0/534627271 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb62c036e60 0x7fb62c039320 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 --2- 172.21.15.119:0/534627271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85380490 0x55be853808b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/534627271 >> 172.21.15.119:0/534627271 conn(0x55be85374530 msgr2=0x55be85374930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/534627271 shutdown_connections 2024-04-23T18:29:33.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/534627271 wait complete. 2024-04-23T18:29:33.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55be8536f3f0 msgr2=0x55be85371880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55be8536f3f0 0x55be85371880 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55be8526a390 msgr2=0x55be85368be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55be8526a390 0x55be85368be0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55be8536b390 msgr2=0x55be8536d800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55be8536b390 0x55be8536d800 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb638037050 msgr2=0x7fb638039510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb638037050 0x7fb638039510 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb73c000f60 tx=0x7fb73c0010a0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 msgr2=0x55be852673a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 --2- 172.21.15.119:0/4005661594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55be85267a60 0x55be852673a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb744055040 tx=0x7fb744002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb753219640 1 -- 172.21.15.119:0/4005661594 reap_dead start 2024-04-23T18:29:33.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 shutdown_connections 2024-04-23T18:29:33.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 >> 172.21.15.119:0/4005661594 conn(0x55be85261410 msgr2=0x55be853569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 shutdown_connections 2024-04-23T18:29:33.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.260+0000 7fb754f19800 1 -- 172.21.15.119:0/4005661594 wait complete. 2024-04-23T18:29:33.268 INFO:teuthology.orchestra.run.smithi119.stdout:[] 2024-04-23T18:29:33.268 DEBUG:tasks.util.rgw: json result: [] 2024-04-23T18:29:33.268 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-23T18:29:33.268 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-23T18:29:33.269 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-23T18:29:33.351 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:33.351 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:33.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.359+0000 7f014f135800 1 Processor -- start 2024-04-23T18:29:33.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.359+0000 7f014f135800 1 -- start start 2024-04-23T18:29:33.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.359+0000 7f014f135800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x562df2a1aa60 0x562df2a1ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.359+0000 7f014f135800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562df28ca560 con 0x562df2a1d390 2024-04-23T18:29:33.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.359+0000 7f014f135800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x562df28bbe20 con 0x562df2a1aa60 2024-04-23T18:29:33.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.360+0000 7f014adb5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x562df2a1aa60 0x562df2a1ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.360+0000 7f01425b4640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x562df2a1d390 0x562df2a1f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40692/0 (socket says 172.21.15.119:40692) 2024-04-23T18:29:33.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.360+0000 7f014adb5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x562df2a1aa60 0x562df2a1ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33280/0 (socket says 172.21.15.119:33280) 2024-04-23T18:29:33.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.360+0000 7f01425b4640 1 -- 172.21.15.119:0/1535972593 learned_addr learned my addr 172.21.15.119:0/1535972593 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:33.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.360+0000 7f014adb5640 1 -- 172.21.15.119:0/1535972593 >> v1:172.21.15.62:6789/0 conn(0x562df2a1d390 legacy=0x562df2a1f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.360+0000 7f014adb5640 1 -- 172.21.15.119:0/1535972593 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562df28c9e60 con 0x562df2a1aa60 2024-04-23T18:29:33.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.362+0000 7f014adb5640 1 --2- 172.21.15.119:0/1535972593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2a1ce50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f013c00a470 tx=0x7f013c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0b29cedda1be73 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.362+0000 7f014a5b4640 1 -- 172.21.15.119:0/1535972593 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f013c057070 con 0x562df2a1aa60 2024-04-23T18:29:33.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.362+0000 7f014a5b4640 1 -- 172.21.15.119:0/1535972593 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013c052570 con 0x562df2a1aa60 2024-04-23T18:29:33.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.362+0000 7f014a5b4640 1 -- 172.21.15.119:0/1535972593 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f013c052870 con 0x562df2a1aa60 2024-04-23T18:29:33.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.362+0000 7f014f135800 1 -- 172.21.15.119:0/1535972593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 msgr2=0x562df2a1ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.362+0000 7f014f135800 1 --2- 172.21.15.119:0/1535972593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2a1ce50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f013c00a470 tx=0x7f013c01ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:33.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.362+0000 7f014f135800 1 -- 172.21.15.119:0/1535972593 shutdown_connections 2024-04-23T18:29:33.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.362+0000 7f014f135800 1 --2- 172.21.15.119:0/1535972593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2a1ce50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.362+0000 7f014f135800 1 -- 172.21.15.119:0/1535972593 >> 172.21.15.119:0/1535972593 conn(0x562df2a14410 msgr2=0x562df2a16830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.363+0000 7f014f135800 1 -- 172.21.15.119:0/1535972593 shutdown_connections 2024-04-23T18:29:33.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.363+0000 7f014f135800 1 -- 172.21.15.119:0/1535972593 wait complete. 2024-04-23T18:29:33.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.374+0000 7f014f135800 1 Processor -- start 2024-04-23T18:29:33.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.374+0000 7f014f135800 1 -- start start 2024-04-23T18:29:33.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.374+0000 7f014f135800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2a1a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.374+0000 7f014f135800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562df29655b0 con 0x562df2a1aa60 2024-04-23T18:29:33.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.375+0000 7f014adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2a1a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.375+0000 7f014adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2a1a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33296/0 (socket says 172.21.15.119:33296) 2024-04-23T18:29:33.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.375+0000 7f014adb5640 1 -- 172.21.15.119:0/1036963390 learned_addr learned my addr 172.21.15.119:0/1036963390 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.375+0000 7f014adb5640 1 -- 172.21.15.119:0/1036963390 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562df28db860 con 0x562df2a1aa60 2024-04-23T18:29:33.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.375+0000 7f014adb5640 1 --2- 172.21.15.119:0/1036963390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2a1a3a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f013c055040 tx=0x7f013c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511f255be3203a67 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.375+0000 7f0038e09640 1 -- 172.21.15.119:0/1036963390 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f013c057070 con 0x562df2a1aa60 2024-04-23T18:29:33.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.375+0000 7f0038e09640 1 -- 172.21.15.119:0/1036963390 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013c063070 con 0x562df2a1aa60 2024-04-23T18:29:33.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.375+0000 7f0038e09640 1 -- 172.21.15.119:0/1036963390 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f013c052720 con 0x562df2a1aa60 2024-04-23T18:29:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.376+0000 7f014f135800 1 -- 172.21.15.119:0/1036963390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 msgr2=0x562df2a1a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.376+0000 7f014f135800 1 --2- 172.21.15.119:0/1036963390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2a1a3a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f013c055040 tx=0x7f013c04c000 comp rx=0 tx=0).stop 2024-04-23T18:29:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.376+0000 7f014f135800 1 -- 172.21.15.119:0/1036963390 shutdown_connections 2024-04-23T18:29:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.376+0000 7f014f135800 1 --2- 172.21.15.119:0/1036963390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2a1a3a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.376+0000 7f014f135800 1 -- 172.21.15.119:0/1036963390 >> 172.21.15.119:0/1036963390 conn(0x562df2a14410 msgr2=0x562df2b06ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.376+0000 7f014f135800 1 -- 172.21.15.119:0/1036963390 shutdown_connections 2024-04-23T18:29:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.376+0000 7f014f135800 1 -- 172.21.15.119:0/1036963390 wait complete. 2024-04-23T18:29:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.376+0000 7f014f135800 1 Processor -- start 2024-04-23T18:29:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.376+0000 7f014f135800 1 -- start start 2024-04-23T18:29:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.376+0000 7f014f135800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2b14c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.377+0000 7f014f135800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562df2a231b0 con 0x562df2a1aa60 2024-04-23T18:29:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.377+0000 7f014adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2b14c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.377+0000 7f014adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2b14c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33306/0 (socket says 172.21.15.119:33306) 2024-04-23T18:29:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.377+0000 7f014adb5640 1 -- 172.21.15.119:0/4019599697 learned_addr learned my addr 172.21.15.119:0/4019599697 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.377+0000 7f014adb5640 1 -- 172.21.15.119:0/4019599697 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562df28d9eb0 con 0x562df2a1aa60 2024-04-23T18:29:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.377+0000 7f014adb5640 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2b14c80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f013c060040 tx=0x7f013c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.377+0000 7f0037606640 1 -- 172.21.15.119:0/4019599697 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f013c052e30 con 0x562df2a1aa60 2024-04-23T18:29:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.377+0000 7f0037606640 1 -- 172.21.15.119:0/4019599697 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013c06c070 con 0x562df2a1aa60 2024-04-23T18:29:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.377+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562df2b151c0 con 0x562df2a1aa60 2024-04-23T18:29:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.377+0000 7f0037606640 1 -- 172.21.15.119:0/4019599697 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f013c05e5d0 con 0x562df2a1aa60 2024-04-23T18:29:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.377+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562df2b15740 con 0x562df2a1aa60 2024-04-23T18:29:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.378+0000 7f0037606640 1 -- 172.21.15.119:0/4019599697 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f013c05e770 con 0x562df2a1aa60 2024-04-23T18:29:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.378+0000 7f0037606640 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0030036e60 0x7f0030039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.378+0000 7f0037606640 1 -- 172.21.15.119:0/4019599697 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f013c08ef80 con 0x562df2a1aa60 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.378+0000 7f01425b4640 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0030036e60 0x7f0030039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.378+0000 7f014f135800 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562df2a1d390 0x562df2b1bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.378+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b1c2c0 con 0x562df2a1d390 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.378+0000 7f014b5b6640 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562df2a1d390 0x562df2b1bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.379+0000 7f01425b4640 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0030036e60 0x7f0030039320 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0134000f60 tx=0x7f01340012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.379+0000 7f014b5b6640 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562df2a1d390 0x562df2b1bcf0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.379+0000 7f014b5b6640 1 -- 172.21.15.119:0/4019599697 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2a1d390 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.379+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b192c0 con 0x562df2a1d390 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.379+0000 7f014b5b6640 1 -- 172.21.15.119:0/4019599697 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2a1d390 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.379+0000 7f014f135800 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562df2b1e5f0 0x562df2b209e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.379+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b21080 con 0x562df2b1e5f0 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.379+0000 7f014adb5640 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562df2b1e5f0 0x562df2b209e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.380+0000 7f014adb5640 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562df2b1e5f0 0x562df2b209e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.380+0000 7f014adb5640 1 -- 172.21.15.119:0/4019599697 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f013c068920 con 0x562df2b1e5f0 2024-04-23T18:29:33.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.380+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b1d5a0 con 0x562df2a1d390 2024-04-23T18:29:33.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.380+0000 7f014b5b6640 1 -- 172.21.15.119:0/4019599697 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2a1d390 2024-04-23T18:29:33.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.380+0000 7f014f135800 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562df2b22530 0x562df2b24980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.380+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b250e0 con 0x562df2b22530 2024-04-23T18:29:33.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.381+0000 7f01425b4640 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562df2b22530 0x562df2b24980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.381+0000 7f01425b4640 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562df2b22530 0x562df2b24980 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.381+0000 7f01425b4640 1 -- 172.21.15.119:0/4019599697 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0134009050 con 0x562df2b22530 2024-04-23T18:29:33.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.382+0000 7f014f135800 1 Processor -- start 2024-04-23T18:29:33.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.382+0000 7f014f135800 1 -- start start 2024-04-23T18:29:33.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.382+0000 7f014f135800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b33540 0x562df2b33960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.382+0000 7f014f135800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562df290bdf0 con 0x562df2b33540 2024-04-23T18:29:33.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.382+0000 7f014adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b33540 0x562df2b33960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.382+0000 7f014adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b33540 0x562df2b33960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33320/0 (socket says 172.21.15.119:33320) 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.382+0000 7f014adb5640 1 -- 172.21.15.119:0/1745180732 learned_addr learned my addr 172.21.15.119:0/1745180732 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.382+0000 7f014adb5640 1 -- 172.21.15.119:0/1745180732 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562df2b33ea0 con 0x562df2b33540 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.382+0000 7f014adb5640 1 --2- 172.21.15.119:0/1745180732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b33540 0x562df2b33960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f013c066fb0 tx=0x7f013c068400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.383+0000 7f0034e01640 1 -- 172.21.15.119:0/1745180732 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f013c05ec40 con 0x562df2b33540 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.383+0000 7f0034e01640 1 -- 172.21.15.119:0/1745180732 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013c058040 con 0x562df2b33540 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.383+0000 7f014f135800 1 -- 172.21.15.119:0/1745180732 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562df2b34910 con 0x562df2b33540 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.383+0000 7f0034e01640 1 -- 172.21.15.119:0/1745180732 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f013c067420 con 0x562df2b33540 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.383+0000 7f014f135800 1 -- 172.21.15.119:0/1745180732 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562df2b34e10 con 0x562df2b33540 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.383+0000 7f0034e01640 1 -- 172.21.15.119:0/1745180732 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f013c086040 con 0x562df2b33540 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.383+0000 7f0034e01640 1 --2- 172.21.15.119:0/1745180732 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0024036e60 0x7f0024039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.383+0000 7f0034e01640 1 -- 172.21.15.119:0/1745180732 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f013c093c60 con 0x562df2b33540 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.384+0000 7f01425b4640 1 --2- 172.21.15.119:0/1745180732 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0024036e60 0x7f0024039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.384+0000 7f014f135800 1 Processor -- start 2024-04-23T18:29:33.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.384+0000 7f014f135800 1 -- start start 2024-04-23T18:29:33.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.384+0000 7f01425b4640 1 --2- 172.21.15.119:0/1745180732 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0024036e60 0x7f0024039320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f013400bf50 tx=0x7f013400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.384+0000 7f014f135800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b40660 0x562df2b40a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.384+0000 7f014f135800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562df2a18960 con 0x562df2b40660 2024-04-23T18:29:33.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.384+0000 7f014adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b40660 0x562df2b40a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.384+0000 7f014adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b40660 0x562df2b40a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33334/0 (socket says 172.21.15.119:33334) 2024-04-23T18:29:33.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.384+0000 7f014adb5640 1 -- 172.21.15.119:0/96454005 learned_addr learned my addr 172.21.15.119:0/96454005 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.384+0000 7f014adb5640 1 -- 172.21.15.119:0/96454005 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562df2b41050 con 0x562df2b40660 2024-04-23T18:29:33.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.385+0000 7f014adb5640 1 --2- 172.21.15.119:0/96454005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b40660 0x562df2b40a80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f013c067ec0 tx=0x7f013c088cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ec5dc6b850f812 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.385+0000 7f002e7fc640 1 -- 172.21.15.119:0/96454005 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f013c0aa070 con 0x562df2b40660 2024-04-23T18:29:33.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.385+0000 7f002e7fc640 1 -- 172.21.15.119:0/96454005 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013c05cab0 con 0x562df2b40660 2024-04-23T18:29:33.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.385+0000 7f002e7fc640 1 -- 172.21.15.119:0/96454005 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f013c05c590 con 0x562df2b40660 2024-04-23T18:29:33.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.385+0000 7f014f135800 1 -- 172.21.15.119:0/96454005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b40660 msgr2=0x562df2b40a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.385+0000 7f014f135800 1 --2- 172.21.15.119:0/96454005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b40660 0x562df2b40a80 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f013c067ec0 tx=0x7f013c088cd0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.385+0000 7f014f135800 1 -- 172.21.15.119:0/96454005 shutdown_connections 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.385+0000 7f014f135800 1 --2- 172.21.15.119:0/96454005 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b40660 0x562df2b40a80 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.385+0000 7f014f135800 1 -- 172.21.15.119:0/96454005 >> 172.21.15.119:0/96454005 conn(0x562df2b3c9c0 msgr2=0x562df2b3aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.385+0000 7f014f135800 1 -- 172.21.15.119:0/96454005 shutdown_connections 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.385+0000 7f014f135800 1 -- 172.21.15.119:0/96454005 wait complete. 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.385+0000 7f014f135800 1 Processor -- start 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.386+0000 7f014f135800 1 -- start start 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.386+0000 7f014f135800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b40660 0x562df2b47a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.386+0000 7f014f135800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562df2b41700 con 0x562df2b40660 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.386+0000 7f014adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b40660 0x562df2b47a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.386+0000 7f014adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b40660 0x562df2b47a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33344/0 (socket says 172.21.15.119:33344) 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.386+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 learned_addr learned my addr 172.21.15.119:0/3703504014 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.386+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562df2b47f90 con 0x562df2b40660 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.386+0000 7f014adb5640 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b40660 0x562df2b47a50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f013c09b560 tx=0x7f013c06df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.386+0000 7f002cff9640 1 -- 172.21.15.119:0/3703504014 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f013c0b4070 con 0x562df2b40660 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.386+0000 7f002cff9640 1 -- 172.21.15.119:0/3703504014 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013c074250 con 0x562df2b40660 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.386+0000 7f002cff9640 1 -- 172.21.15.119:0/3703504014 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f013c0aa040 con 0x562df2b40660 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.386+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562df2b47f90 con 0x562df2b40660 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.386+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562df2b47f90 con 0x562df2b40660 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.387+0000 7f002cff9640 1 -- 172.21.15.119:0/3703504014 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f013c0a4070 con 0x562df2b40660 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.387+0000 7f002cff9640 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0014036e60 0x7f0014039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.387+0000 7f002cff9640 1 -- 172.21.15.119:0/3703504014 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f013c0b9c40 con 0x562df2b40660 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.387+0000 7f014f135800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.387+0000 7f01425b4640 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0014036e60 0x7f0014039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.388+0000 7f014f135800 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562df2b531c0 0x562df2b55660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.388+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b55db0 con 0x562df2b531c0 2024-04-23T18:29:33.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.388+0000 7f014b5b6640 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562df2b531c0 0x562df2b55660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.388+0000 7f01425b4640 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0014036e60 0x7f0014039320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0134001b60 tx=0x7f0134010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.388+0000 7f014b5b6640 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562df2b531c0 0x562df2b55660 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.388+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2b531c0 2024-04-23T18:29:33.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.388+0000 7f014f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.388+0000 7f014f135800 20 realm 2024-04-23T18:29:33.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.388+0000 7f014f135800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.388+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b561c0 con 0x562df2b531c0 2024-04-23T18:29:33.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.388+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2b531c0 2024-04-23T18:29:33.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.388+0000 7f014f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.388+0000 7f014f135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:33.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.389+0000 7f014f135800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.389+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56a60 con 0x562df2b531c0 2024-04-23T18:29:33.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.389+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2b531c0 2024-04-23T18:29:33.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.389+0000 7f014f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.389+0000 7f014f135800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.389+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b531c0 2024-04-23T18:29:33.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.389+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2b531c0 2024-04-23T18:29:33.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.389+0000 7f014f135800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:33.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.389+0000 7f014f135800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.389+0000 7f014f135800 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562df2b57b60 0x562df2b59f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.389+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b5a490 con 0x562df2b57b60 2024-04-23T18:29:33.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.389+0000 7f014adb5640 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562df2b57b60 0x562df2b59f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.389+0000 7f014adb5640 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562df2b57b60 0x562df2b59f50 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.390+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.390+0000 7f014f135800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:33.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.390+0000 7f014f135800 20 searching for the correct realm 2024-04-23T18:29:33.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.390+0000 7f014f135800 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562df2b5c510 0x562df2b5e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.390+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b5f0a0 con 0x562df2b5c510 2024-04-23T18:29:33.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.390+0000 7f01425b4640 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562df2b5c510 0x562df2b5e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.390+0000 7f01425b4640 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562df2b5c510 0x562df2b5e9d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.390+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.390+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b5f0a0 con 0x562df2b57b60 2024-04-23T18:29:33.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.391+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.391+0000 7f014adb5640 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f013c0727c0 0x7f013c092420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.391+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b5f0a0 con 0x7f013c0727c0 2024-04-23T18:29:33.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.391+0000 7f014b5b6640 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f013c0727c0 0x7f013c092420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.391+0000 7f014b5b6640 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f013c0727c0 0x7f013c092420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.391+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014400a4a0 con 0x7f013c0727c0 2024-04-23T18:29:33.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.391+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b531c0 2024-04-23T18:29:33.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.392+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2b531c0 2024-04-23T18:29:33.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.392+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b531c0 2024-04-23T18:29:33.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.392+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2b531c0 2024-04-23T18:29:33.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.392+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x7f013c0727c0 2024-04-23T18:29:33.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.392+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014400a4a0 con 0x7f013c0727c0 2024-04-23T18:29:33.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.392+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x7f013c0727c0 2024-04-23T18:29:33.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.392+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f014400a4a0 con 0x7f013c0727c0 2024-04-23T18:29:33.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.392+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b57b60 2024-04-23T18:29:33.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.393+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.393+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b5c510 2024-04-23T18:29:33.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.393+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.393+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b531c0 2024-04-23T18:29:33.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.393+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2b531c0 2024-04-23T18:29:33.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.393+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x7f013c0727c0 2024-04-23T18:29:33.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.393+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014400a4a0 con 0x7f013c0727c0 2024-04-23T18:29:33.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.393+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b531c0 2024-04-23T18:29:33.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.394+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2b531c0 2024-04-23T18:29:33.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.394+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b57b60 2024-04-23T18:29:33.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.394+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.394+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b5c510 2024-04-23T18:29:33.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.394+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.394+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b5c510 2024-04-23T18:29:33.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.394+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.394+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x7f013c0727c0 2024-04-23T18:29:33.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.395+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014400a4a0 con 0x7f013c0727c0 2024-04-23T18:29:33.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.395+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b5c510 2024-04-23T18:29:33.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.395+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.395+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b5c510 2024-04-23T18:29:33.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.395+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.395+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b531c0 2024-04-23T18:29:33.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.395+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2b531c0 2024-04-23T18:29:33.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.395+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b531c0 2024-04-23T18:29:33.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.396+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2b531c0 2024-04-23T18:29:33.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.396+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x7f013c0727c0 2024-04-23T18:29:33.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.396+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014400a4a0 con 0x7f013c0727c0 2024-04-23T18:29:33.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.396+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b5c510 2024-04-23T18:29:33.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.396+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.396+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b57b60 2024-04-23T18:29:33.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.396+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.396+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b531c0 2024-04-23T18:29:33.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.397+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014400a4a0 con 0x562df2b531c0 2024-04-23T18:29:33.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.397+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x7f013c0727c0 2024-04-23T18:29:33.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.397+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014400a4a0 con 0x7f013c0727c0 2024-04-23T18:29:33.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.397+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b5c510 2024-04-23T18:29:33.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.397+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.397+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x7f013c0727c0 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.398+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f014400a4a0 con 0x7f013c0727c0 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.398+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b57b60 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.398+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.398+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b5c510 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.398+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.398+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x7f013c0727c0 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.398+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0144040040 con 0x7f013c0727c0 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.398+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b531c0 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562df2b56e00 con 0x562df2b57b60 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:33.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:33.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:33.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:33.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:33.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:33.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b5ae10 con 0x562df2b531c0 2024-04-23T18:29:33.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b5ae10 con 0x562df2b531c0 2024-04-23T18:29:33.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:33.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.399+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b5ae10 con 0x7f013c0727c0 2024-04-23T18:29:33.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0144040040 con 0x7f013c0727c0 2024-04-23T18:29:33.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014f135800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:33.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014f135800 20 zone default found 2024-04-23T18:29:33.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014f135800 4 Realm: () 2024-04-23T18:29:33.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014f135800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:33.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014f135800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:33.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014f135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:33.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014f135800 20 zonegroup default 2024-04-23T18:29:33.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014f135800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b5b200 con 0x7f013c0727c0 2024-04-23T18:29:33.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0144040040 con 0x7f013c0727c0 2024-04-23T18:29:33.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014f135800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b5b620 con 0x562df2b5c510 2024-04-23T18:29:33.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.400+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.401+0000 7f014f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.401+0000 7f014f135800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.401+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b5ba80 con 0x562df2b5c510 2024-04-23T18:29:33.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.401+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.401+0000 7f014f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.401+0000 7f014f135800 20 started sync module instance, tier type = 2024-04-23T18:29:33.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.401+0000 7f014f135800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:33.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.401+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b603a0 con 0x562df2b57b60 2024-04-23T18:29:33.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.402+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.402+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94755345532736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b61010 con 0x562df2b57b60 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.402+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b619d0 con 0x562df2b531c0 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.403+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94755345532736] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.403+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.403+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94755345536288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b61df0 con 0x562df2b531c0 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.403+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b627b0 con 0x562df2b5c510 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.404+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94755345536288] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.404+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.404+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94755345537344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b61d60 con 0x562df2b5c510 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.404+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b63620 con 0x562df2b57b60 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.405+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94755345537344] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.405+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.405+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94755345541968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b63ec0 con 0x562df2b57b60 2024-04-23T18:29:33.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.405+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b64750 con 0x562df2b531c0 2024-04-23T18:29:33.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.406+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94755345541968] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.406+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.406+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94755345545744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b642e0 con 0x562df2b531c0 2024-04-23T18:29:33.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.406+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b651d0 con 0x7f013c0727c0 2024-04-23T18:29:33.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.407+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94755345545744] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.407+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x7f013c0727c0 2024-04-23T18:29:33.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.407+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94755345550560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b642e0 con 0x7f013c0727c0 2024-04-23T18:29:33.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.407+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b65be0 con 0x7f013c0727c0 2024-04-23T18:29:33.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.408+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94755345550560] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x7f013c0727c0 2024-04-23T18:29:33.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.408+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x7f013c0727c0 2024-04-23T18:29:33.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.408+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94755345546800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b65dc0 con 0x7f013c0727c0 2024-04-23T18:29:33.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.408+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b66610 con 0x7f013c0727c0 2024-04-23T18:29:33.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.409+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94755345546800] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x7f013c0727c0 2024-04-23T18:29:33.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.409+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x7f013c0727c0 2024-04-23T18:29:33.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.409+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94755345554160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b66440 con 0x7f013c0727c0 2024-04-23T18:29:33.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.409+0000 7f014f135800 20 add_watcher() i=0 2024-04-23T18:29:33.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.409+0000 7f014f135800 20 add_watcher() i=1 2024-04-23T18:29:33.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.409+0000 7f014f135800 20 add_watcher() i=2 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.409+0000 7f014f135800 20 add_watcher() i=3 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.409+0000 7f014f135800 20 add_watcher() i=4 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.409+0000 7f014f135800 20 add_watcher() i=5 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.409+0000 7f014f135800 20 add_watcher() i=6 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.410+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94755345554160] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x7f013c0727c0 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.410+0000 7f014f135800 20 add_watcher() i=7 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.410+0000 7f014f135800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.410+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b69980 con 0x562df2b531c0 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.411+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.411+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94755345555216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b66e00 con 0x562df2b531c0 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.411+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94755345555216] v32'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.412+0000 7f00017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.412+0000 7f014f135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:33.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.412+0000 7f014f135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:33.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.412+0000 7f014f135800 5 note: GC not initialized 2024-04-23T18:29:33.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.412+0000 7eff7bfff640 20 reqs_thread_entry: start 2024-04-23T18:29:33.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.412+0000 7f014f135800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:33.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.412+0000 7f014f135800 20 Filter name: none 2024-04-23T18:29:33.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.412+0000 7eff79ffb640 20 reqs_thread_entry: start 2024-04-23T18:29:33.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.412+0000 7f014f135800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.412+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b9cc80 con 0x562df2b531c0 2024-04-23T18:29:33.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.413+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.413+0000 7f014f135800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:33.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.413+0000 7f014f135800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.413+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b9d670 con 0x562df2b531c0 2024-04-23T18:29:33.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.413+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.413+0000 7f014f135800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:33.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.413+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562df2b9e680 con 0x562df2b57b60 2024-04-23T18:29:33.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.413+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.414+0000 7f00017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:33.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.414+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94755345555216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b69280 con 0x562df2b531c0 2024-04-23T18:29:33.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.415+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94755345555216] v32'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.415+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94755345532736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b65f10 con 0x562df2b57b60 2024-04-23T18:29:33.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.416+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94755345532736] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.416+0000 7f014f135800 20 remove_watcher() i=0 2024-04-23T18:29:33.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.416+0000 7f014f135800 2 removed watcher, disabling cache 2024-04-23T18:29:33.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.416+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94755345536288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b65f10 con 0x562df2b531c0 2024-04-23T18:29:33.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.417+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94755345536288] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.417+0000 7f014f135800 20 remove_watcher() i=1 2024-04-23T18:29:33.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.417+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94755345537344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b61520 con 0x562df2b5c510 2024-04-23T18:29:33.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.419+0000 7f01425b4640 1 -- 172.21.15.119:0/3703504014 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94755345537344] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0134009050 con 0x562df2b5c510 2024-04-23T18:29:33.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.419+0000 7f014f135800 20 remove_watcher() i=2 2024-04-23T18:29:33.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.419+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94755345541968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b65f10 con 0x562df2b57b60 2024-04-23T18:29:33.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.419+0000 7f014adb5640 1 -- 172.21.15.119:0/3703504014 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94755345541968] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f013c0bf070 con 0x562df2b57b60 2024-04-23T18:29:33.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.419+0000 7f014f135800 20 remove_watcher() i=3 2024-04-23T18:29:33.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.419+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94755345545744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b62b50 con 0x562df2b531c0 2024-04-23T18:29:33.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.421+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94755345545744] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x562df2b531c0 2024-04-23T18:29:33.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.421+0000 7f014f135800 20 remove_watcher() i=4 2024-04-23T18:29:33.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.421+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94755345550560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b65f10 con 0x7f013c0727c0 2024-04-23T18:29:33.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.421+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94755345550560] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x7f013c0727c0 2024-04-23T18:29:33.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.421+0000 7f014f135800 20 remove_watcher() i=5 2024-04-23T18:29:33.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.421+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94755345546800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b63a10 con 0x7f013c0727c0 2024-04-23T18:29:33.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.422+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94755345546800] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x7f013c0727c0 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.422+0000 7f014f135800 20 remove_watcher() i=6 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.422+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94755345554160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562df2b64ce0 con 0x7f013c0727c0 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94755345554160] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0144040040 con 0x7f013c0727c0 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014f135800 20 remove_watcher() i=7 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f013c0727c0 msgr2=0x7f013c092420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014f135800 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f013c0727c0 0x7f013c092420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562df2b531c0 msgr2=0x562df2b55660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014f135800 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562df2b531c0 0x562df2b55660 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562df2b57b60 msgr2=0x562df2b59f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014f135800 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562df2b57b60 0x562df2b59f50 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562df2b5c510 msgr2=0x562df2b5e9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014f135800 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562df2b5c510 0x562df2b5e9d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0014036e60 msgr2=0x7f0014039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014f135800 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0014036e60 0x7f0014039320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0134001b60 tx=0x7f0134010000 comp rx=0 tx=0).stop 2024-04-23T18:29:33.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b40660 msgr2=0x562df2b47a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014f135800 1 --2- 172.21.15.119:0/3703504014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b40660 0x562df2b47a50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f013c09b560 tx=0x7f013c06df50 comp rx=0 tx=0).stop 2024-04-23T18:29:33.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 reap_dead start 2024-04-23T18:29:33.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.423+0000 7f014b5b6640 1 -- 172.21.15.119:0/3703504014 reap_dead start 2024-04-23T18:29:33.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 shutdown_connections 2024-04-23T18:29:33.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 >> 172.21.15.119:0/3703504014 conn(0x562df2b3c9c0 msgr2=0x562df2b3a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 shutdown_connections 2024-04-23T18:29:33.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/3703504014 wait complete. 2024-04-23T18:29:33.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/1745180732 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0024036e60 msgr2=0x7f0024039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 --2- 172.21.15.119:0/1745180732 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0024036e60 0x7f0024039320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f013400bf50 tx=0x7f013400f000 comp rx=0 tx=0).stop 2024-04-23T18:29:33.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/1745180732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b33540 msgr2=0x562df2b33960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 --2- 172.21.15.119:0/1745180732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b33540 0x562df2b33960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f013c066fb0 tx=0x7f013c068400 comp rx=0 tx=0).stop 2024-04-23T18:29:33.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/1745180732 shutdown_connections 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 --2- 172.21.15.119:0/1745180732 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0024036e60 0x7f0024039320 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 --2- 172.21.15.119:0/1745180732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2b33540 0x562df2b33960 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/1745180732 >> 172.21.15.119:0/1745180732 conn(0x562df2b275e0 msgr2=0x562df2b279e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/1745180732 shutdown_connections 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/1745180732 wait complete. 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562df2b22530 msgr2=0x562df2b24980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562df2b22530 0x562df2b24980 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562df2a1d390 msgr2=0x562df2b1bcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562df2a1d390 0x562df2b1bcf0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562df2b1e5f0 msgr2=0x562df2b209e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562df2b1e5f0 0x562df2b209e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0030036e60 msgr2=0x7f0030039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0030036e60 0x7f0030039320 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0134000f60 tx=0x7f01340012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 msgr2=0x562df2b14c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 --2- 172.21.15.119:0/4019599697 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562df2a1aa60 0x562df2b14c80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f013c060040 tx=0x7f013c002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014b5b6640 1 -- 172.21.15.119:0/4019599697 reap_dead start 2024-04-23T18:29:33.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 shutdown_connections 2024-04-23T18:29:33.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 >> 172.21.15.119:0/4019599697 conn(0x562df2a14410 msgr2=0x562df2a18e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.424+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 shutdown_connections 2024-04-23T18:29:33.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.425+0000 7f014f135800 1 -- 172.21.15.119:0/4019599697 wait complete. 2024-04-23T18:29:33.435 INFO:teuthology.orchestra.run.smithi119.stdout:[] 2024-04-23T18:29:33.435 DEBUG:tasks.util.rgw: json result: [] 2024-04-23T18:29:33.448 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:33.448 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-23T18:29:33.450 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-23T18:29:33.450 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-23T18:29:33.518 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:33.519 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:33.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.527+0000 7f1c20746800 1 Processor -- start 2024-04-23T18:29:33.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.527+0000 7f1c20746800 1 -- start start 2024-04-23T18:29:33.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.527+0000 7f1c20746800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x562b24769270 0x562b2476b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.527+0000 7f1c20746800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562b24615560 con 0x562b246d88e0 2024-04-23T18:29:33.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.527+0000 7f1c20746800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x562b24606e20 con 0x562b24769270 2024-04-23T18:29:33.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.527+0000 7f1c1da4b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x562b24769270 0x562b2476b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.527+0000 7f1c1da4b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x562b24769270 0x562b2476b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33356/0 (socket says 172.21.15.119:33356) 2024-04-23T18:29:33.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.527+0000 7f1c1e24c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x562b246d88e0 0x562b24767af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40704/0 (socket says 172.21.15.119:40704) 2024-04-23T18:29:33.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.527+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2828116101 learned_addr learned my addr 172.21.15.119:0/2828116101 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.527+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2828116101 >> v1:172.21.15.62:6789/0 conn(0x562b246d88e0 legacy=0x562b24767af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.527+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2828116101 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b24614e60 con 0x562b24769270 2024-04-23T18:29:33.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.527+0000 7f1c1d24a640 1 -- 172.21.15.119:0/2828116101 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3302365184 0 0) 0x562b24615560 con 0x562b246d88e0 2024-04-23T18:29:33.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.529+0000 7f1c1da4b640 1 --2- 172.21.15.119:0/2828116101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b24769270 0x562b2476b710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400a520 tx=0x7f1c1401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed09893e663ae4b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.529+0000 7f1c1d24a640 1 -- 172.21.15.119:0/2828116101 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c14057070 con 0x562b24769270 2024-04-23T18:29:33.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.529+0000 7f1c1d24a640 1 -- 172.21.15.119:0/2828116101 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c14052570 con 0x562b24769270 2024-04-23T18:29:33.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.529+0000 7f1c1d24a640 1 -- 172.21.15.119:0/2828116101 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1404ae60 con 0x562b24769270 2024-04-23T18:29:33.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.530+0000 7f1c20746800 1 -- 172.21.15.119:0/2828116101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b24769270 msgr2=0x562b2476b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.530+0000 7f1c20746800 1 --2- 172.21.15.119:0/2828116101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b24769270 0x562b2476b710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400a520 tx=0x7f1c1401d010 comp rx=0 tx=0).stop 2024-04-23T18:29:33.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.530+0000 7f1c20746800 1 -- 172.21.15.119:0/2828116101 shutdown_connections 2024-04-23T18:29:33.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.530+0000 7f1c20746800 1 --2- 172.21.15.119:0/2828116101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b24769270 0x562b2476b710 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.530+0000 7f1c20746800 1 -- 172.21.15.119:0/2828116101 >> 172.21.15.119:0/2828116101 conn(0x562b2475f410 msgr2=0x562b24761830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.530+0000 7f1c20746800 1 -- 172.21.15.119:0/2828116101 shutdown_connections 2024-04-23T18:29:33.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.530+0000 7f1c20746800 1 -- 172.21.15.119:0/2828116101 wait complete. 2024-04-23T18:29:33.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.541+0000 7f1c20746800 1 Processor -- start 2024-04-23T18:29:33.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.542+0000 7f1c20746800 1 -- start start 2024-04-23T18:29:33.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.542+0000 7f1c20746800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b246d88e0 0x562b24855fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.542+0000 7f1c20746800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562b246b05b0 con 0x562b246d88e0 2024-04-23T18:29:33.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.542+0000 7f1c1e24c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b246d88e0 0x562b24855fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.542+0000 7f1c1e24c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b246d88e0 0x562b24855fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33358/0 (socket says 172.21.15.119:33358) 2024-04-23T18:29:33.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.542+0000 7f1c1e24c640 1 -- 172.21.15.119:0/932545135 learned_addr learned my addr 172.21.15.119:0/932545135 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.542+0000 7f1c1e24c640 1 -- 172.21.15.119:0/932545135 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b24626860 con 0x562b246d88e0 2024-04-23T18:29:33.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.542+0000 7f1c1e24c640 1 --2- 172.21.15.119:0/932545135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b246d88e0 0x562b24855fe0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000b210 tx=0x7f1c1000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709b1f1e6dc55611 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.543+0000 7f1b0c608640 1 -- 172.21.15.119:0/932545135 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c10008070 con 0x562b246d88e0 2024-04-23T18:29:33.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.543+0000 7f1b0c608640 1 -- 172.21.15.119:0/932545135 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1000d500 con 0x562b246d88e0 2024-04-23T18:29:33.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.543+0000 7f1b0c608640 1 -- 172.21.15.119:0/932545135 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1000d840 con 0x562b246d88e0 2024-04-23T18:29:33.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.543+0000 7f1c20746800 1 -- 172.21.15.119:0/932545135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b246d88e0 msgr2=0x562b24855fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.543+0000 7f1c20746800 1 --2- 172.21.15.119:0/932545135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b246d88e0 0x562b24855fe0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000b210 tx=0x7f1c1000b6d0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.543+0000 7f1c20746800 1 -- 172.21.15.119:0/932545135 shutdown_connections 2024-04-23T18:29:33.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.543+0000 7f1c20746800 1 --2- 172.21.15.119:0/932545135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b246d88e0 0x562b24855fe0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.543+0000 7f1c20746800 1 -- 172.21.15.119:0/932545135 >> 172.21.15.119:0/932545135 conn(0x562b2475f410 msgr2=0x562b24851900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.540 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.543+0000 7f1c20746800 1 -- 172.21.15.119:0/932545135 shutdown_connections 2024-04-23T18:29:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.543+0000 7f1c20746800 1 -- 172.21.15.119:0/932545135 wait complete. 2024-04-23T18:29:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.544+0000 7f1c20746800 1 Processor -- start 2024-04-23T18:29:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.544+0000 7f1c20746800 1 -- start start 2024-04-23T18:29:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.544+0000 7f1c20746800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b246d88e0 0x562b2485d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.544+0000 7f1c20746800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562b2476c090 con 0x562b246d88e0 2024-04-23T18:29:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.544+0000 7f1c1e24c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b246d88e0 0x562b2485d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.544+0000 7f1c1e24c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b246d88e0 0x562b2485d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33362/0 (socket says 172.21.15.119:33362) 2024-04-23T18:29:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.544+0000 7f1c1e24c640 1 -- 172.21.15.119:0/299584651 learned_addr learned my addr 172.21.15.119:0/299584651 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.544+0000 7f1c1e24c640 1 -- 172.21.15.119:0/299584651 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b24624eb0 con 0x562b246d88e0 2024-04-23T18:29:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.544+0000 7f1c1e24c640 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b246d88e0 0x562b2485d980 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000b210 tx=0x7f1c10000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.545+0000 7f1b0ae05640 1 -- 172.21.15.119:0/299584651 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1000f950 con 0x562b246d88e0 2024-04-23T18:29:33.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.545+0000 7f1b0ae05640 1 -- 172.21.15.119:0/299584651 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1000faf0 con 0x562b246d88e0 2024-04-23T18:29:33.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.545+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b2485dec0 con 0x562b246d88e0 2024-04-23T18:29:33.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.545+0000 7f1b0ae05640 1 -- 172.21.15.119:0/299584651 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1000fdd0 con 0x562b246d88e0 2024-04-23T18:29:33.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.545+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2485e3e0 con 0x562b246d88e0 2024-04-23T18:29:33.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.545+0000 7f1b0ae05640 1 -- 172.21.15.119:0/299584651 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1c10017040 con 0x562b246d88e0 2024-04-23T18:29:33.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.546+0000 7f1b0ae05640 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1b04036e60 0x7f1b04039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.546+0000 7f1b0ae05640 1 -- 172.21.15.119:0/299584651 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f1c10015020 con 0x562b246d88e0 2024-04-23T18:29:33.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.546+0000 7f1c1da4b640 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1b04036e60 0x7f1b04039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.546+0000 7f1c20746800 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562b24769270 0x562b248649f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.546+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b24864f30 con 0x562b24769270 2024-04-23T18:29:33.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.546+0000 7f1c1ea4d640 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562b24769270 0x562b248649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.546+0000 7f1c1da4b640 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1b04036e60 0x7f1b04039320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c14054000 tx=0x7f1c1404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.546+0000 7f1c1ea4d640 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562b24769270 0x562b248649f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.546+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/299584651 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b24769270 2024-04-23T18:29:33.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.546+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b24861f80 con 0x562b24769270 2024-04-23T18:29:33.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.547+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/299584651 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b24769270 2024-04-23T18:29:33.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.547+0000 7f1c20746800 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562b24867200 0x562b248695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.547+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b24869c90 con 0x562b24867200 2024-04-23T18:29:33.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.547+0000 7f1c1e24c640 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562b24867200 0x562b248695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.547+0000 7f1c1e24c640 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562b24867200 0x562b248695f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.547+0000 7f1c1e24c640 1 -- 172.21.15.119:0/299584651 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1c1002d070 con 0x562b24867200 2024-04-23T18:29:33.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.547+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248661b0 con 0x562b24769270 2024-04-23T18:29:33.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.548+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/299584651 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b24769270 2024-04-23T18:29:33.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.548+0000 7f1c20746800 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562b2486b0d0 0x562b2486d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.548+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b2486dcf0 con 0x562b2486b0d0 2024-04-23T18:29:33.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.548+0000 7f1c1da4b640 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562b2486b0d0 0x562b2486d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.548+0000 7f1c1da4b640 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562b2486b0d0 0x562b2486d560 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.549+0000 7f1c1da4b640 1 -- 172.21.15.119:0/299584651 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1c1405a040 con 0x562b2486b0d0 2024-04-23T18:29:33.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.549+0000 7f1c20746800 1 Processor -- start 2024-04-23T18:29:33.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.549+0000 7f1c20746800 1 -- start start 2024-04-23T18:29:33.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.549+0000 7f1c20746800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b24765680 0x562b24763af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.549+0000 7f1c20746800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562b24656df0 con 0x562b24765680 2024-04-23T18:29:33.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.549+0000 7f1c1e24c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b24765680 0x562b24763af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.549+0000 7f1c1e24c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b24765680 0x562b24763af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33370/0 (socket says 172.21.15.119:33370) 2024-04-23T18:29:33.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.549+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2621052482 learned_addr learned my addr 172.21.15.119:0/2621052482 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.550+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2621052482 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b24764030 con 0x562b24765680 2024-04-23T18:29:33.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.550+0000 7f1c1e24c640 1 --2- 172.21.15.119:0/2621052482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b24765680 0x562b24763af0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1c10028000 tx=0x7f1c1000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.550+0000 7f1b03fff640 1 -- 172.21.15.119:0/2621052482 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1001a540 con 0x562b24765680 2024-04-23T18:29:33.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.550+0000 7f1b03fff640 1 -- 172.21.15.119:0/2621052482 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c10018ab0 con 0x562b24765680 2024-04-23T18:29:33.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.550+0000 7f1c20746800 1 -- 172.21.15.119:0/2621052482 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b247642c0 con 0x562b24765680 2024-04-23T18:29:33.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.550+0000 7f1b03fff640 1 -- 172.21.15.119:0/2621052482 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c10018d90 con 0x562b24765680 2024-04-23T18:29:33.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.550+0000 7f1c20746800 1 -- 172.21.15.119:0/2621052482 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b247647c0 con 0x562b24765680 2024-04-23T18:29:33.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.551+0000 7f1b03fff640 1 -- 172.21.15.119:0/2621052482 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1c1004d0b0 con 0x562b24765680 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.551+0000 7f1b03fff640 1 --2- 172.21.15.119:0/2621052482 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1af8036ed0 0x7f1af8039390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.551+0000 7f1b03fff640 1 -- 172.21.15.119:0/2621052482 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f1c10040000 con 0x562b24765680 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.551+0000 7f1c1da4b640 1 --2- 172.21.15.119:0/2621052482 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1af8036ed0 0x7f1af8039390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.551+0000 7f1c20746800 1 Processor -- start 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.551+0000 7f1c20746800 1 -- start start 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.551+0000 7f1c1da4b640 1 --2- 172.21.15.119:0/2621052482 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1af8036ed0 0x7f1af8039390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x562b24861ee0 tx=0x7f1c14005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.551+0000 7f1c20746800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 0x562b2488b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.551+0000 7f1c20746800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562b24856760 con 0x562b2488b470 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.551+0000 7f1c1e24c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 0x562b2488b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.551+0000 7f1c1e24c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 0x562b2488b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33378/0 (socket says 172.21.15.119:33378) 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.551+0000 7f1c1e24c640 1 -- 172.21.15.119:0/1900277288 learned_addr learned my addr 172.21.15.119:0/1900277288 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.552+0000 7f1c1e24c640 1 -- 172.21.15.119:0/1900277288 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2488be80 con 0x562b2488b470 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.552+0000 7f1c1e24c640 1 --2- 172.21.15.119:0/1900277288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 0x562b2488b890 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1c10030fd0 tx=0x7f1c10048f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4659576a0ff84d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.552+0000 7f1b01ffb640 1 -- 172.21.15.119:0/1900277288 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c10060070 con 0x562b2488b470 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.552+0000 7f1b01ffb640 1 -- 172.21.15.119:0/1900277288 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1001ca00 con 0x562b2488b470 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.552+0000 7f1b01ffb640 1 -- 172.21.15.119:0/1900277288 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1004d3a0 con 0x562b2488b470 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.552+0000 7f1c20746800 1 -- 172.21.15.119:0/1900277288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 msgr2=0x562b2488b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.552+0000 7f1c20746800 1 --2- 172.21.15.119:0/1900277288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 0x562b2488b890 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1c10030fd0 tx=0x7f1c10048f80 comp rx=0 tx=0).stop 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.552+0000 7f1c20746800 1 -- 172.21.15.119:0/1900277288 shutdown_connections 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.552+0000 7f1c20746800 1 --2- 172.21.15.119:0/1900277288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 0x562b2488b890 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.552+0000 7f1c20746800 1 -- 172.21.15.119:0/1900277288 >> 172.21.15.119:0/1900277288 conn(0x562b248877b0 msgr2=0x562b24885810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.552+0000 7f1c20746800 1 -- 172.21.15.119:0/1900277288 shutdown_connections 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.552+0000 7f1c20746800 1 -- 172.21.15.119:0/1900277288 wait complete. 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.553+0000 7f1c20746800 1 Processor -- start 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.553+0000 7f1c20746800 1 -- start start 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.553+0000 7f1c20746800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 0x562b248928a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.553+0000 7f1c20746800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562b2488c5a0 con 0x562b2488b470 2024-04-23T18:29:33.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.553+0000 7f1c1e24c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 0x562b248928a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.553+0000 7f1c1e24c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 0x562b248928a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33384/0 (socket says 172.21.15.119:33384) 2024-04-23T18:29:33.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.553+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 learned_addr learned my addr 172.21.15.119:0/2416056804 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.553+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b24892de0 con 0x562b2488b470 2024-04-23T18:29:33.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.553+0000 7f1c1e24c640 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 0x562b248928a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1c10032fd0 tx=0x7f1c1002af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.554+0000 7f1aeffff640 1 -- 172.21.15.119:0/2416056804 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1006b020 con 0x562b2488b470 2024-04-23T18:29:33.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.554+0000 7f1aeffff640 1 -- 172.21.15.119:0/2416056804 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1004aa10 con 0x562b2488b470 2024-04-23T18:29:33.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.554+0000 7f1aeffff640 1 -- 172.21.15.119:0/2416056804 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c10060030 con 0x562b2488b470 2024-04-23T18:29:33.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.554+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b24892de0 con 0x562b2488b470 2024-04-23T18:29:33.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.554+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b24892de0 con 0x562b2488b470 2024-04-23T18:29:33.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.554+0000 7f1aeffff640 1 -- 172.21.15.119:0/2416056804 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1c1006e020 con 0x562b2488b470 2024-04-23T18:29:33.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1aeffff640 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ae8036e60 0x7f1ae8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1aeffff640 1 -- 172.21.15.119:0/2416056804 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f1c10061070 con 0x562b2488b470 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1c1da4b640 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ae8036e60 0x7f1ae8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1c20746800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1c20746800 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562b2489dfc0 0x562b248a0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248a0bd0 con 0x562b2489dfc0 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1c1ea4d640 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562b2489dfc0 0x562b248a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1c1da4b640 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ae8036e60 0x7f1ae8039320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1c14000c00 tx=0x7f1c1404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1c1ea4d640 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562b2489dfc0 0x562b248a0480 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b2489dfc0 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1c20746800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1c20746800 20 realm 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1c20746800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.555+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248a0fe0 con 0x562b2489dfc0 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b2489dfc0 2024-04-23T18:29:33.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c20746800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c20746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:33.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c20746800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248a18b0 con 0x562b2489dfc0 2024-04-23T18:29:33.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b2489dfc0 2024-04-23T18:29:33.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c20746800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c20746800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b2489dfc0 2024-04-23T18:29:33.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b2489dfc0 2024-04-23T18:29:33.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c20746800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:33.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c20746800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c20746800 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562b248a2780 0x562b248a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248a52b0 con 0x562b248a2780 2024-04-23T18:29:33.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c1e24c640 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562b248a2780 0x562b248a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.556+0000 7f1c1e24c640 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562b248a2780 0x562b248a4b70 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.557+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1c1002d070 con 0x562b248a2780 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.557+0000 7f1c20746800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.557+0000 7f1c20746800 20 searching for the correct realm 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.557+0000 7f1c20746800 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562b248a7310 0x562b248a97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.557+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a9e80 con 0x562b248a7310 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.557+0000 7f1c1da4b640 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562b248a7310 0x562b248a97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.557+0000 7f1c1da4b640 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562b248a7310 0x562b248a97b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.557+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.557+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a9e80 con 0x562b248a2780 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.558+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1002d070 con 0x562b248a2780 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.558+0000 7f1c1e24c640 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1c10070020 0x7f1c1004d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.558+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a9e80 con 0x7f1c10070020 2024-04-23T18:29:33.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.558+0000 7f1c1ea4d640 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1c10070020 0x7f1c1004d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.558+0000 7f1c1ea4d640 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1c10070020 0x7f1c1004d960 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.558+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1800a4a0 con 0x7f1c10070020 2024-04-23T18:29:33.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.558+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b2489dfc0 2024-04-23T18:29:33.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.559+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b2489dfc0 2024-04-23T18:29:33.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.559+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b2489dfc0 2024-04-23T18:29:33.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.559+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b2489dfc0 2024-04-23T18:29:33.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.559+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x7f1c10070020 2024-04-23T18:29:33.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.559+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1800a4a0 con 0x7f1c10070020 2024-04-23T18:29:33.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.559+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x7f1c10070020 2024-04-23T18:29:33.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.559+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1c1800a4a0 con 0x7f1c10070020 2024-04-23T18:29:33.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.559+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b248a2780 2024-04-23T18:29:33.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.560+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1002d070 con 0x562b248a2780 2024-04-23T18:29:33.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.560+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b248a7310 2024-04-23T18:29:33.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.560+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.560+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b2489dfc0 2024-04-23T18:29:33.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.560+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b2489dfc0 2024-04-23T18:29:33.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.560+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x7f1c10070020 2024-04-23T18:29:33.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.560+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1800a4a0 con 0x7f1c10070020 2024-04-23T18:29:33.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.560+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b2489dfc0 2024-04-23T18:29:33.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.560+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b2489dfc0 2024-04-23T18:29:33.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.561+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b248a2780 2024-04-23T18:29:33.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.561+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1c1002d070 con 0x562b248a2780 2024-04-23T18:29:33.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.561+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b248a7310 2024-04-23T18:29:33.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.561+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.561+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b248a7310 2024-04-23T18:29:33.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.561+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.561+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x7f1c10070020 2024-04-23T18:29:33.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.562+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1800a4a0 con 0x7f1c10070020 2024-04-23T18:29:33.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.562+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b248a7310 2024-04-23T18:29:33.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.562+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.562+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b248a7310 2024-04-23T18:29:33.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.562+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.562+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b2489dfc0 2024-04-23T18:29:33.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.562+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b2489dfc0 2024-04-23T18:29:33.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.562+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b2489dfc0 2024-04-23T18:29:33.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.563+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b2489dfc0 2024-04-23T18:29:33.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.563+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x7f1c10070020 2024-04-23T18:29:33.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.563+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1800a4a0 con 0x7f1c10070020 2024-04-23T18:29:33.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.563+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b248a7310 2024-04-23T18:29:33.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.563+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.563+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b248a2780 2024-04-23T18:29:33.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.564+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1c1002d070 con 0x562b248a2780 2024-04-23T18:29:33.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.564+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b2489dfc0 2024-04-23T18:29:33.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.564+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1800a4a0 con 0x562b2489dfc0 2024-04-23T18:29:33.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.564+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x7f1c10070020 2024-04-23T18:29:33.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.564+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1800a4a0 con 0x7f1c10070020 2024-04-23T18:29:33.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.564+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b248a7310 2024-04-23T18:29:33.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.565+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.565+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x7f1c10070020 2024-04-23T18:29:33.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.565+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1800a4a0 con 0x7f1c10070020 2024-04-23T18:29:33.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.565+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b248a2780 2024-04-23T18:29:33.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.565+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1002d070 con 0x562b248a2780 2024-04-23T18:29:33.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.565+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b248a7310 2024-04-23T18:29:33.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.565+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.565+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x7f1c10070020 2024-04-23T18:29:33.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.566+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c18040040 con 0x7f1c10070020 2024-04-23T18:29:33.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.566+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b2489dfc0 2024-04-23T18:29:33.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.566+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.566+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562b248a1c50 con 0x562b248a2780 2024-04-23T18:29:33.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.566+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1c10089040 con 0x562b248a2780 2024-04-23T18:29:33.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.566+0000 7f1c20746800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:33.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.566+0000 7f1c20746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:33.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.566+0000 7f1c20746800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:33.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.566+0000 7f1c20746800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:33.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.566+0000 7f1c20746800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:33.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.566+0000 7f1c20746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:33.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.566+0000 7f1c20746800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.566+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248a5c30 con 0x562b2489dfc0 2024-04-23T18:29:33.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248a5c30 con 0x562b2489dfc0 2024-04-23T18:29:33.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:33.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248a5c00 con 0x7f1c10070020 2024-04-23T18:29:33.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1c18040040 con 0x7f1c10070020 2024-04-23T18:29:33.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:33.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 20 zone default found 2024-04-23T18:29:33.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 4 Realm: () 2024-04-23T18:29:33.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:33.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:33.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:33.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 20 zonegroup default 2024-04-23T18:29:33.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248a6020 con 0x7f1c10070020 2024-04-23T18:29:33.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x7f1c10070020 2024-04-23T18:29:33.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.567+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248a6460 con 0x562b248a7310 2024-04-23T18:29:33.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.568+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.568+0000 7f1c20746800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.568+0000 7f1c20746800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.568+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248abce0 con 0x562b248a7310 2024-04-23T18:29:33.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.568+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.568+0000 7f1c20746800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.568+0000 7f1c20746800 20 started sync module instance, tier type = 2024-04-23T18:29:33.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.568+0000 7f1c20746800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:33.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.568+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248ab180 con 0x562b248a2780 2024-04-23T18:29:33.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.569+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c10089040 con 0x562b248a2780 2024-04-23T18:29:33.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.569+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94743296650448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248ac080 con 0x562b248a2780 2024-04-23T18:29:33.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.569+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248ac8d0 con 0x562b2489dfc0 2024-04-23T18:29:33.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.570+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94743296650448] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c10089040 con 0x562b248a2780 2024-04-23T18:29:33.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.570+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.570+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94743296656416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248accf0 con 0x562b2489dfc0 2024-04-23T18:29:33.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.570+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248ad6b0 con 0x562b248a7310 2024-04-23T18:29:33.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.571+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94743296656416] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.572+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.572+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94743296657472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248acc60 con 0x562b248a7310 2024-04-23T18:29:33.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.572+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248ae520 con 0x562b248a2780 2024-04-23T18:29:33.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.572+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94743296657472] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.573+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c10089040 con 0x562b248a2780 2024-04-23T18:29:33.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.573+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94743296662096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248aed70 con 0x562b248a2780 2024-04-23T18:29:33.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.573+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248af600 con 0x562b2489dfc0 2024-04-23T18:29:33.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.573+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94743296662096] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c10089040 con 0x562b248a2780 2024-04-23T18:29:33.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.574+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.574+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94743296665792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248af190 con 0x562b2489dfc0 2024-04-23T18:29:33.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.574+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248b0010 con 0x7f1c10070020 2024-04-23T18:29:33.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.575+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x7f1c10070020 2024-04-23T18:29:33.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.575+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94743296670560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248aff80 con 0x7f1c10070020 2024-04-23T18:29:33.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.575+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248b0f80 con 0x7f1c10070020 2024-04-23T18:29:33.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.575+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94743296665792] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.576+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94743296670560] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x7f1c10070020 2024-04-23T18:29:33.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.576+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x7f1c10070020 2024-04-23T18:29:33.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.576+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94743296666848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248b0ad0 con 0x7f1c10070020 2024-04-23T18:29:33.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.576+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248b13c0 con 0x7f1c10070020 2024-04-23T18:29:33.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.577+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x7f1c10070020 2024-04-23T18:29:33.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.577+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94743296666848] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x7f1c10070020 2024-04-23T18:29:33.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.577+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94743296674512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248b15a0 con 0x7f1c10070020 2024-04-23T18:29:33.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.577+0000 7f1c20746800 20 add_watcher() i=0 2024-04-23T18:29:33.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.577+0000 7f1c20746800 20 add_watcher() i=1 2024-04-23T18:29:33.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.577+0000 7f1c20746800 20 add_watcher() i=2 2024-04-23T18:29:33.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.577+0000 7f1c20746800 20 add_watcher() i=3 2024-04-23T18:29:33.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.577+0000 7f1c20746800 20 add_watcher() i=4 2024-04-23T18:29:33.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.577+0000 7f1c20746800 20 add_watcher() i=5 2024-04-23T18:29:33.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.577+0000 7f1c20746800 20 add_watcher() i=6 2024-04-23T18:29:33.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.578+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94743296674512] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x7f1c10070020 2024-04-23T18:29:33.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.578+0000 7f1c20746800 20 add_watcher() i=7 2024-04-23T18:29:33.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.578+0000 7f1c20746800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:33.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.578+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248b4970 con 0x562b2489dfc0 2024-04-23T18:29:33.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.578+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.578+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94743296677008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248b1e40 con 0x562b2489dfc0 2024-04-23T18:29:33.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.579+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94743296677008] v32'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.579+0000 7f1ad4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:33.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.579+0000 7f1c20746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:33.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.579+0000 7f1c20746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:33.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.579+0000 7f1c20746800 5 note: GC not initialized 2024-04-23T18:29:33.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.580+0000 7f1a4f7fe640 20 reqs_thread_entry: start 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.580+0000 7f1c20746800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.580+0000 7f1c20746800 20 Filter name: none 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.580+0000 7f1a4d7fa640 20 reqs_thread_entry: start 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.580+0000 7f1c20746800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.580+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248e7aa0 con 0x562b2489dfc0 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.580+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.580+0000 7f1c20746800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.580+0000 7f1c20746800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.580+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248e8490 con 0x562b2489dfc0 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.581+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.581+0000 7f1c20746800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.581+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562b248e94a0 con 0x562b248a2780 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.581+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f1c10089040 con 0x562b248a2780 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.582+0000 7f1ad4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:33.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.582+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94743296677008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248b2710 con 0x562b2489dfc0 2024-04-23T18:29:33.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.583+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94743296677008] v32'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.583+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94743296650448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248b1490 con 0x562b248a2780 2024-04-23T18:29:33.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.584+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94743296650448] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c10089040 con 0x562b248a2780 2024-04-23T18:29:33.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.584+0000 7f1c20746800 20 remove_watcher() i=0 2024-04-23T18:29:33.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.584+0000 7f1c20746800 2 removed watcher, disabling cache 2024-04-23T18:29:33.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.584+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94743296656416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248b1490 con 0x562b2489dfc0 2024-04-23T18:29:33.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.585+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94743296656416] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.585+0000 7f1c20746800 20 remove_watcher() i=1 2024-04-23T18:29:33.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.585+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94743296657472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248ac420 con 0x562b248a7310 2024-04-23T18:29:33.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.586+0000 7f1c1da4b640 1 -- 172.21.15.119:0/2416056804 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94743296657472] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c1407f070 con 0x562b248a7310 2024-04-23T18:29:33.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.586+0000 7f1c20746800 20 remove_watcher() i=2 2024-04-23T18:29:33.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.586+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94743296662096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248b1490 con 0x562b248a2780 2024-04-23T18:29:33.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.587+0000 7f1c1e24c640 1 -- 172.21.15.119:0/2416056804 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94743296662096] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c10089040 con 0x562b248a2780 2024-04-23T18:29:33.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.587+0000 7f1c20746800 20 remove_watcher() i=3 2024-04-23T18:29:33.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.587+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94743296665792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248ada50 con 0x562b2489dfc0 2024-04-23T18:29:33.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.588+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94743296665792] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x562b2489dfc0 2024-04-23T18:29:33.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.588+0000 7f1c20746800 20 remove_watcher() i=4 2024-04-23T18:29:33.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.588+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94743296670560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248b1490 con 0x7f1c10070020 2024-04-23T18:29:33.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.589+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94743296670560] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x7f1c10070020 2024-04-23T18:29:33.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.589+0000 7f1c20746800 20 remove_watcher() i=5 2024-04-23T18:29:33.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.589+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94743296666848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248ae8c0 con 0x7f1c10070020 2024-04-23T18:29:33.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.589+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94743296666848] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x7f1c10070020 2024-04-23T18:29:33.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.589+0000 7f1c20746800 20 remove_watcher() i=6 2024-04-23T18:29:33.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.589+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94743296674512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562b248afb60 con 0x7f1c10070020 2024-04-23T18:29:33.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.590+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94743296674512] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1c18040040 con 0x7f1c10070020 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.590+0000 7f1c20746800 20 remove_watcher() i=7 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.590+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1c10070020 msgr2=0x7f1c1004d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.590+0000 7f1c20746800 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1c10070020 0x7f1c1004d960 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.590+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562b2489dfc0 msgr2=0x562b248a0480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.590+0000 7f1c20746800 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562b2489dfc0 0x562b248a0480 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.590+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562b248a2780 msgr2=0x562b248a4b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.590+0000 7f1c20746800 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562b248a2780 0x562b248a4b70 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.590+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562b248a7310 msgr2=0x562b248a97b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.590+0000 7f1c20746800 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562b248a7310 0x562b248a97b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ae8036e60 msgr2=0x7f1ae8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1ae8036e60 0x7f1ae8039320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1c14000c00 tx=0x7f1c1404f000 comp rx=0 tx=0).stop 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 msgr2=0x562b248928a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 0x562b248928a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1c10032fd0 tx=0x7f1c1002af50 comp rx=0 tx=0).stop 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/2416056804 reap_dead start 2024-04-23T18:29:33.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 shutdown_connections 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 --2- 172.21.15.119:0/2416056804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b2488b470 0x562b248928a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 >> 172.21.15.119:0/2416056804 conn(0x562b248877b0 msgr2=0x562b24884e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 shutdown_connections 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/2416056804 wait complete. 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/2621052482 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1af8036ed0 msgr2=0x7f1af8039390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 --2- 172.21.15.119:0/2621052482 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1af8036ed0 0x7f1af8039390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x562b24861ee0 tx=0x7f1c14005ac0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/2621052482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b24765680 msgr2=0x562b24763af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 --2- 172.21.15.119:0/2621052482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b24765680 0x562b24763af0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1c10028000 tx=0x7f1c1000ef60 comp rx=0 tx=0).stop 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/2621052482 shutdown_connections 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 --2- 172.21.15.119:0/2621052482 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1af8036ed0 0x7f1af8039390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 --2- 172.21.15.119:0/2621052482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b24765680 0x562b24763af0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/2621052482 >> 172.21.15.119:0/2621052482 conn(0x562b248701f0 msgr2=0x562b248705f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/2621052482 shutdown_connections 2024-04-23T18:29:33.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/2621052482 wait complete. 2024-04-23T18:29:33.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562b2486b0d0 msgr2=0x562b2486d560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562b2486b0d0 0x562b2486d560 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562b24769270 msgr2=0x562b248649f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562b24769270 0x562b248649f0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562b24867200 msgr2=0x562b248695f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.591+0000 7f1c20746800 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562b24867200 0x562b248695f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.592+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1b04036e60 msgr2=0x7f1b04039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.592+0000 7f1c20746800 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1b04036e60 0x7f1b04039320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c14054000 tx=0x7f1c1404e000 comp rx=0 tx=0).stop 2024-04-23T18:29:33.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.592+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b246d88e0 msgr2=0x562b2485d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.592+0000 7f1c20746800 1 --2- 172.21.15.119:0/299584651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562b246d88e0 0x562b2485d980 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000b210 tx=0x7f1c10000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.592+0000 7f1c1ea4d640 1 -- 172.21.15.119:0/299584651 reap_dead start 2024-04-23T18:29:33.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.592+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 shutdown_connections 2024-04-23T18:29:33.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.592+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 >> 172.21.15.119:0/299584651 conn(0x562b2475f410 msgr2=0x562b248549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.592+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 shutdown_connections 2024-04-23T18:29:33.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.592+0000 7f1c20746800 1 -- 172.21.15.119:0/299584651 wait complete. 2024-04-23T18:29:33.600 INFO:teuthology.orchestra.run.smithi119.stdout:["myfoo"] 2024-04-23T18:29:33.600 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-23T18:29:33.603 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:33.604 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-23T18:29:33.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-23T18:29:33.604 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-23T18:29:33.681 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:33.681 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:33.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.689+0000 7fb728d35800 1 Processor -- start 2024-04-23T18:29:33.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.689+0000 7fb728d35800 1 -- start start 2024-04-23T18:29:33.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.689+0000 7fb728d35800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556bb8b2b3a0 0x556bb8b33ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.690+0000 7fb728d35800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556bb89db560 con 0x556bb8b29860 2024-04-23T18:29:33.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.690+0000 7fb728d35800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x556bb89cce20 con 0x556bb8b2b3a0 2024-04-23T18:29:33.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.690+0000 7fb71ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556bb8b2b3a0 0x556bb8b33ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.690+0000 7fb71ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556bb8b2b3a0 0x556bb8b33ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33400/0 (socket says 172.21.15.119:33400) 2024-04-23T18:29:33.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.690+0000 7fb7249b5640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x556bb8b29860 0x556bb8b29c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40720/0 (socket says 172.21.15.119:40720) 2024-04-23T18:29:33.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.690+0000 7fb71ffff640 1 -- 172.21.15.119:0/3065439420 learned_addr learned my addr 172.21.15.119:0/3065439420 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.690+0000 7fb71ffff640 1 -- 172.21.15.119:0/3065439420 >> v1:172.21.15.62:6789/0 conn(0x556bb8b29860 legacy=0x556bb8b29c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.690+0000 7fb71ffff640 1 -- 172.21.15.119:0/3065439420 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bb89dae60 con 0x556bb8b2b3a0 2024-04-23T18:29:33.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.692+0000 7fb71ffff640 1 --2- 172.21.15.119:0/3065439420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b2b3a0 0x556bb8b33ea0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb71000a520 tx=0x7fb71001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165e88545716fe86 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.692+0000 7fb71f7fe640 1 -- 172.21.15.119:0/3065439420 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb710057070 con 0x556bb8b2b3a0 2024-04-23T18:29:33.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.692+0000 7fb71f7fe640 1 -- 172.21.15.119:0/3065439420 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb710052570 con 0x556bb8b2b3a0 2024-04-23T18:29:33.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.692+0000 7fb71f7fe640 1 -- 172.21.15.119:0/3065439420 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb710052870 con 0x556bb8b2b3a0 2024-04-23T18:29:33.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.693+0000 7fb728d35800 1 -- 172.21.15.119:0/3065439420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b2b3a0 msgr2=0x556bb8b33ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.693+0000 7fb728d35800 1 --2- 172.21.15.119:0/3065439420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b2b3a0 0x556bb8b33ea0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb71000a520 tx=0x7fb71001d010 comp rx=0 tx=0).stop 2024-04-23T18:29:33.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.693+0000 7fb728d35800 1 -- 172.21.15.119:0/3065439420 shutdown_connections 2024-04-23T18:29:33.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.693+0000 7fb728d35800 1 --2- 172.21.15.119:0/3065439420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b2b3a0 0x556bb8b33ea0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.693+0000 7fb728d35800 1 -- 172.21.15.119:0/3065439420 >> 172.21.15.119:0/3065439420 conn(0x556bb8b25400 msgr2=0x556bb8b27820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.693+0000 7fb728d35800 1 -- 172.21.15.119:0/3065439420 shutdown_connections 2024-04-23T18:29:33.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.693+0000 7fb728d35800 1 -- 172.21.15.119:0/3065439420 wait complete. 2024-04-23T18:29:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.704+0000 7fb728d35800 1 Processor -- start 2024-04-23T18:29:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.704+0000 7fb728d35800 1 -- start start 2024-04-23T18:29:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.704+0000 7fb728d35800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b29860 0x556bb8c1e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.704+0000 7fb728d35800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556bb8a765a0 con 0x556bb8b29860 2024-04-23T18:29:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.705+0000 7fb7249b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b29860 0x556bb8c1e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.705+0000 7fb7249b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b29860 0x556bb8c1e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33410/0 (socket says 172.21.15.119:33410) 2024-04-23T18:29:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.705+0000 7fb7249b5640 1 -- 172.21.15.119:0/3542189684 learned_addr learned my addr 172.21.15.119:0/3542189684 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.705+0000 7fb7249b5640 1 -- 172.21.15.119:0/3542189684 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bb89ec860 con 0x556bb8b29860 2024-04-23T18:29:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.705+0000 7fb7249b5640 1 --2- 172.21.15.119:0/3542189684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b29860 0x556bb8c1e6b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb718001e90 tx=0x7fb71800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585109e77f7fb49b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.705+0000 7fb612e05640 1 -- 172.21.15.119:0/3542189684 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71800e5c0 con 0x556bb8b29860 2024-04-23T18:29:33.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.705+0000 7fb612e05640 1 -- 172.21.15.119:0/3542189684 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb718006070 con 0x556bb8b29860 2024-04-23T18:29:33.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.705+0000 7fb612e05640 1 -- 172.21.15.119:0/3542189684 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71800e890 con 0x556bb8b29860 2024-04-23T18:29:33.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.706+0000 7fb728d35800 1 -- 172.21.15.119:0/3542189684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b29860 msgr2=0x556bb8c1e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.706+0000 7fb728d35800 1 --2- 172.21.15.119:0/3542189684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b29860 0x556bb8c1e6b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb718001e90 tx=0x7fb71800b6c0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.706+0000 7fb728d35800 1 -- 172.21.15.119:0/3542189684 shutdown_connections 2024-04-23T18:29:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.706+0000 7fb728d35800 1 --2- 172.21.15.119:0/3542189684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b29860 0x556bb8c1e6b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.706+0000 7fb728d35800 1 -- 172.21.15.119:0/3542189684 >> 172.21.15.119:0/3542189684 conn(0x556bb8b25400 msgr2=0x556bb8c19fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.706+0000 7fb728d35800 1 -- 172.21.15.119:0/3542189684 shutdown_connections 2024-04-23T18:29:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.706+0000 7fb728d35800 1 -- 172.21.15.119:0/3542189684 wait complete. 2024-04-23T18:29:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.706+0000 7fb728d35800 1 Processor -- start 2024-04-23T18:29:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.706+0000 7fb728d35800 1 -- start start 2024-04-23T18:29:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.707+0000 7fb728d35800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b29860 0x556bb8c26080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.707+0000 7fb728d35800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556bb8b366c0 con 0x556bb8b29860 2024-04-23T18:29:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.707+0000 7fb7249b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b29860 0x556bb8c26080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.707+0000 7fb7249b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b29860 0x556bb8c26080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33420/0 (socket says 172.21.15.119:33420) 2024-04-23T18:29:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.707+0000 7fb7249b5640 1 -- 172.21.15.119:0/1929921460 learned_addr learned my addr 172.21.15.119:0/1929921460 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.707+0000 7fb7249b5640 1 -- 172.21.15.119:0/1929921460 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bb89eaeb0 con 0x556bb8b29860 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.707+0000 7fb7249b5640 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b29860 0x556bb8c26080 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb718001ed0 tx=0x7fb718000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.707+0000 7fb611602640 1 -- 172.21.15.119:0/1929921460 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71801a880 con 0x556bb8b29860 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.708+0000 7fb611602640 1 -- 172.21.15.119:0/1929921460 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71801aa20 con 0x556bb8b29860 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.708+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556bb8c265c0 con 0x556bb8b29860 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.708+0000 7fb611602640 1 -- 172.21.15.119:0/1929921460 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71801ad40 con 0x556bb8b29860 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.708+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bb8c26ae0 con 0x556bb8b29860 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.708+0000 7fb611602640 1 -- 172.21.15.119:0/1929921460 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb718017070 con 0x556bb8b29860 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.708+0000 7fb611602640 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb60c036eb0 0x7fb60c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.709+0000 7fb611602640 1 -- 172.21.15.119:0/1929921460 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb718015020 con 0x556bb8b29860 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.709+0000 7fb71ffff640 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb60c036eb0 0x7fb60c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.709+0000 7fb728d35800 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556bb8b2b3a0 0x556bb8c2d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.709+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c2d620 con 0x556bb8b2b3a0 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.709+0000 7fb7251b6640 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556bb8b2b3a0 0x556bb8c2d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.709+0000 7fb71ffff640 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb60c036eb0 0x7fb60c039370 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb710054000 tx=0x7fb71004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.709+0000 7fb7251b6640 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556bb8b2b3a0 0x556bb8c2d0a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.709+0000 7fb7251b6640 1 -- 172.21.15.119:0/1929921460 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8b2b3a0 2024-04-23T18:29:33.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.709+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c2a670 con 0x556bb8b2b3a0 2024-04-23T18:29:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.710+0000 7fb7251b6640 1 -- 172.21.15.119:0/1929921460 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8b2b3a0 2024-04-23T18:29:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.710+0000 7fb728d35800 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556bb8c2f970 0x556bb8c31d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.710+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c32450 con 0x556bb8c2f970 2024-04-23T18:29:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.710+0000 7fb7249b5640 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556bb8c2f970 0x556bb8c31d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.710+0000 7fb7249b5640 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556bb8c2f970 0x556bb8c31d60 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.710+0000 7fb7249b5640 1 -- 172.21.15.119:0/1929921460 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb71802e070 con 0x556bb8c2f970 2024-04-23T18:29:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.710+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c2e920 con 0x556bb8b2b3a0 2024-04-23T18:29:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.711+0000 7fb7251b6640 1 -- 172.21.15.119:0/1929921460 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8b2b3a0 2024-04-23T18:29:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.711+0000 7fb728d35800 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556bb8c33900 0x556bb8c35d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.711+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c364b0 con 0x556bb8c33900 2024-04-23T18:29:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.711+0000 7fb71ffff640 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556bb8c33900 0x556bb8c35d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.711+0000 7fb71ffff640 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556bb8c33900 0x556bb8c35d50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.712+0000 7fb71ffff640 1 -- 172.21.15.119:0/1929921460 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb71005a040 con 0x556bb8c33900 2024-04-23T18:29:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.712+0000 7fb728d35800 1 Processor -- start 2024-04-23T18:29:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.712+0000 7fb728d35800 1 -- start start 2024-04-23T18:29:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.712+0000 7fb728d35800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c44910 0x556bb8c44d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.712+0000 7fb728d35800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556bb8a1cdf0 con 0x556bb8c44910 2024-04-23T18:29:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.712+0000 7fb7249b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c44910 0x556bb8c44d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.712+0000 7fb7249b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c44910 0x556bb8c44d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33422/0 (socket says 172.21.15.119:33422) 2024-04-23T18:29:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.712+0000 7fb7249b5640 1 -- 172.21.15.119:0/3948800682 learned_addr learned my addr 172.21.15.119:0/3948800682 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.713+0000 7fb7249b5640 1 -- 172.21.15.119:0/3948800682 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bb8c45270 con 0x556bb8c44910 2024-04-23T18:29:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.713+0000 7fb7249b5640 1 --2- 172.21.15.119:0/3948800682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c44910 0x556bb8c44d30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb71801cfd0 tx=0x7fb71804bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.713+0000 7fb60a7fc640 1 -- 172.21.15.119:0/3948800682 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb718017e20 con 0x556bb8c44910 2024-04-23T18:29:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.713+0000 7fb60a7fc640 1 -- 172.21.15.119:0/3948800682 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71801d450 con 0x556bb8c44910 2024-04-23T18:29:33.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.713+0000 7fb728d35800 1 -- 172.21.15.119:0/3948800682 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556bb8c45ce0 con 0x556bb8c44910 2024-04-23T18:29:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.713+0000 7fb60a7fc640 1 -- 172.21.15.119:0/3948800682 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71801d730 con 0x556bb8c44910 2024-04-23T18:29:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.713+0000 7fb728d35800 1 -- 172.21.15.119:0/3948800682 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bb8c461e0 con 0x556bb8c44910 2024-04-23T18:29:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.714+0000 7fb60a7fc640 1 -- 172.21.15.119:0/3948800682 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb7180450e0 con 0x556bb8c44910 2024-04-23T18:29:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.714+0000 7fb60a7fc640 1 --2- 172.21.15.119:0/3948800682 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb5fc036e10 0x7fb5fc0392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.714+0000 7fb60a7fc640 1 -- 172.21.15.119:0/3948800682 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb71803dc80 con 0x556bb8c44910 2024-04-23T18:29:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.714+0000 7fb71ffff640 1 --2- 172.21.15.119:0/3948800682 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb5fc036e10 0x7fb5fc0392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.714+0000 7fb728d35800 1 Processor -- start 2024-04-23T18:29:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.714+0000 7fb71ffff640 1 --2- 172.21.15.119:0/3948800682 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb5fc036e10 0x7fb5fc0392d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x556bb8c2df20 tx=0x7fb710005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.714+0000 7fb728d35800 1 -- start start 2024-04-23T18:29:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.714+0000 7fb728d35800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c51a50 0x556bb8c51e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.714+0000 7fb728d35800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556bb8c1ee30 con 0x556bb8c51a50 2024-04-23T18:29:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.715+0000 7fb7249b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c51a50 0x556bb8c51e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.715+0000 7fb7249b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c51a50 0x556bb8c51e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33426/0 (socket says 172.21.15.119:33426) 2024-04-23T18:29:33.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.715+0000 7fb7249b5640 1 -- 172.21.15.119:0/2877114793 learned_addr learned my addr 172.21.15.119:0/2877114793 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.715+0000 7fb7249b5640 1 -- 172.21.15.119:0/2877114793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bb8c52440 con 0x556bb8c51a50 2024-04-23T18:29:33.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.715+0000 7fb7249b5640 1 --2- 172.21.15.119:0/2877114793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c51a50 0x556bb8c51e70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb71800d010 tx=0x7fb718027b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6295250651107319 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.715+0000 7fb5fbfff640 1 -- 172.21.15.119:0/2877114793 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71800f9f0 con 0x556bb8c51a50 2024-04-23T18:29:33.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.715+0000 7fb5fbfff640 1 -- 172.21.15.119:0/2877114793 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71800fcb0 con 0x556bb8c51a50 2024-04-23T18:29:33.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.715+0000 7fb5fbfff640 1 -- 172.21.15.119:0/2877114793 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7180453d0 con 0x556bb8c51a50 2024-04-23T18:29:33.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb728d35800 1 -- 172.21.15.119:0/2877114793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c51a50 msgr2=0x556bb8c51e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb728d35800 1 --2- 172.21.15.119:0/2877114793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c51a50 0x556bb8c51e70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb71800d010 tx=0x7fb718027b20 comp rx=0 tx=0).stop 2024-04-23T18:29:33.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb728d35800 1 -- 172.21.15.119:0/2877114793 shutdown_connections 2024-04-23T18:29:33.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb728d35800 1 --2- 172.21.15.119:0/2877114793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c51a50 0x556bb8c51e70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb728d35800 1 -- 172.21.15.119:0/2877114793 >> 172.21.15.119:0/2877114793 conn(0x556bb8c4ddb0 msgr2=0x556bb8c4be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb728d35800 1 -- 172.21.15.119:0/2877114793 shutdown_connections 2024-04-23T18:29:33.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb728d35800 1 -- 172.21.15.119:0/2877114793 wait complete. 2024-04-23T18:29:33.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb728d35800 1 Processor -- start 2024-04-23T18:29:33.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb728d35800 1 -- start start 2024-04-23T18:29:33.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb728d35800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c51a50 0x556bb8c58e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb728d35800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556bb8c52af0 con 0x556bb8c51a50 2024-04-23T18:29:33.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb7249b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c51a50 0x556bb8c58e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb7249b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c51a50 0x556bb8c58e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33442/0 (socket says 172.21.15.119:33442) 2024-04-23T18:29:33.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.716+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 learned_addr learned my addr 172.21.15.119:0/1973023439 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.717+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bb8c59380 con 0x556bb8c51a50 2024-04-23T18:29:33.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.717+0000 7fb7249b5640 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c51a50 0x556bb8c58e40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb718027fd0 tx=0x7fb718052f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.717+0000 7fb5fa7fc640 1 -- 172.21.15.119:0/1973023439 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71804a0d0 con 0x556bb8c51a50 2024-04-23T18:29:33.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.717+0000 7fb5fa7fc640 1 -- 172.21.15.119:0/1973023439 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb718013130 con 0x556bb8c51a50 2024-04-23T18:29:33.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.717+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556bb8c59380 con 0x556bb8c51a50 2024-04-23T18:29:33.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.717+0000 7fb5fa7fc640 1 -- 172.21.15.119:0/1973023439 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb71804a270 con 0x556bb8c51a50 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.717+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bb8c59380 con 0x556bb8c51a50 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.718+0000 7fb5fa7fc640 1 -- 172.21.15.119:0/1973023439 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb71806d070 con 0x556bb8c51a50 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.718+0000 7fb5fa7fc640 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb5f0036e60 0x7fb5f0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.718+0000 7fb728d35800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.718+0000 7fb5fa7fc640 1 -- 172.21.15.119:0/1973023439 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb718071ca0 con 0x556bb8c51a50 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.718+0000 7fb71ffff640 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb5f0036e60 0x7fb5f0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.718+0000 7fb728d35800 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556bb8c64350 0x556bb8c667f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.718+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c66f40 con 0x556bb8c64350 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.718+0000 7fb7251b6640 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556bb8c64350 0x556bb8c667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.718+0000 7fb71ffff640 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb5f0036e60 0x7fb5f0039320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x556bb8c368b0 tx=0x7fb71004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb7251b6640 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556bb8c64350 0x556bb8c667f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8c64350 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 20 realm 2024-04-23T18:29:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67350 con 0x556bb8c64350 2024-04-23T18:29:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8c64350 2024-04-23T18:29:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67bf0 con 0x556bb8c64350 2024-04-23T18:29:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8c64350 2024-04-23T18:29:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c64350 2024-04-23T18:29:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8c64350 2024-04-23T18:29:33.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556bb8c68cf0 0x556bb8c6b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.719+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c6b660 con 0x556bb8c68cf0 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.720+0000 7fb7249b5640 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556bb8c68cf0 0x556bb8c6b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.720+0000 7fb7249b5640 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556bb8c68cf0 0x556bb8c6b0e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.720+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb718076020 con 0x556bb8c68cf0 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.720+0000 7fb728d35800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.720+0000 7fb728d35800 20 searching for the correct realm 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.720+0000 7fb728d35800 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556bb8c6d6b0 0x556bb8c6fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.720+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c70240 con 0x556bb8c6d6b0 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.720+0000 7fb71ffff640 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556bb8c6d6b0 0x556bb8c6fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.720+0000 7fb71ffff640 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556bb8c6d6b0 0x556bb8c6fb70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.721+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.721+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c70240 con 0x556bb8c68cf0 2024-04-23T18:29:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.721+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb718076020 con 0x556bb8c68cf0 2024-04-23T18:29:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.721+0000 7fb7249b5640 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb71800f070 0x7fb718010690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.721+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c70240 con 0x7fb71800f070 2024-04-23T18:29:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.721+0000 7fb7251b6640 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb71800f070 0x7fb718010690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.722+0000 7fb7251b6640 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb71800f070 0x7fb718010690 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.722+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb72000a4a0 con 0x7fb71800f070 2024-04-23T18:29:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.722+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c64350 2024-04-23T18:29:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.722+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8c64350 2024-04-23T18:29:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.722+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c64350 2024-04-23T18:29:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.722+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8c64350 2024-04-23T18:29:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.722+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x7fb71800f070 2024-04-23T18:29:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.722+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb72000a4a0 con 0x7fb71800f070 2024-04-23T18:29:33.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.722+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x7fb71800f070 2024-04-23T18:29:33.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.723+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb72000a4a0 con 0x7fb71800f070 2024-04-23T18:29:33.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.723+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c68cf0 2024-04-23T18:29:33.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.723+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb718076020 con 0x556bb8c68cf0 2024-04-23T18:29:33.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.723+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c6d6b0 2024-04-23T18:29:33.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.723+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.723+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c64350 2024-04-23T18:29:33.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.723+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8c64350 2024-04-23T18:29:33.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.723+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x7fb71800f070 2024-04-23T18:29:33.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.724+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb72000a4a0 con 0x7fb71800f070 2024-04-23T18:29:33.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.724+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c64350 2024-04-23T18:29:33.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.724+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8c64350 2024-04-23T18:29:33.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.724+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c68cf0 2024-04-23T18:29:33.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.724+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb718076020 con 0x556bb8c68cf0 2024-04-23T18:29:33.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.724+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c6d6b0 2024-04-23T18:29:33.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.724+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.724+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c6d6b0 2024-04-23T18:29:33.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.725+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.725+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x7fb71800f070 2024-04-23T18:29:33.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.725+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb72000a4a0 con 0x7fb71800f070 2024-04-23T18:29:33.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.725+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c6d6b0 2024-04-23T18:29:33.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.725+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.725+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c6d6b0 2024-04-23T18:29:33.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.725+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.725+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c64350 2024-04-23T18:29:33.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.726+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8c64350 2024-04-23T18:29:33.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.726+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c64350 2024-04-23T18:29:33.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.726+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8c64350 2024-04-23T18:29:33.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.726+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x7fb71800f070 2024-04-23T18:29:33.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.726+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb72000a4a0 con 0x7fb71800f070 2024-04-23T18:29:33.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.726+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c6d6b0 2024-04-23T18:29:33.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.726+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.726+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c68cf0 2024-04-23T18:29:33.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.727+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb718076020 con 0x556bb8c68cf0 2024-04-23T18:29:33.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.727+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c64350 2024-04-23T18:29:33.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.727+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb72000a4a0 con 0x556bb8c64350 2024-04-23T18:29:33.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.727+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x7fb71800f070 2024-04-23T18:29:33.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.727+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb72000a4a0 con 0x7fb71800f070 2024-04-23T18:29:33.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.727+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c6d6b0 2024-04-23T18:29:33.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.727+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.727+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x7fb71800f070 2024-04-23T18:29:33.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.728+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb72000a4a0 con 0x7fb71800f070 2024-04-23T18:29:33.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.728+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c68cf0 2024-04-23T18:29:33.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.728+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.728+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c6d6b0 2024-04-23T18:29:33.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.728+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.728+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x7fb71800f070 2024-04-23T18:29:33.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.728+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.728+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c64350 2024-04-23T18:29:33.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.728+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c67f90 con 0x556bb8c68cf0 2024-04-23T18:29:33.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:33.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:33.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:33.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:33.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:33.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:33.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c6bfb0 con 0x556bb8c64350 2024-04-23T18:29:33.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c6bfb0 con 0x556bb8c64350 2024-04-23T18:29:33.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:33.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.729+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c6bf80 con 0x7fb71800f070 2024-04-23T18:29:33.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:33.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 20 zone default found 2024-04-23T18:29:33.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 4 Realm: () 2024-04-23T18:29:33.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:33.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:33.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:33.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 20 zonegroup default 2024-04-23T18:29:33.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c6c3a0 con 0x7fb71800f070 2024-04-23T18:29:33.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c6c7e0 con 0x556bb8c6d6b0 2024-04-23T18:29:33.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.730+0000 7fb728d35800 20 rados->read ofs=0 len=0 2024-04-23T18:29:33.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.731+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c720a0 con 0x556bb8c6d6b0 2024-04-23T18:29:33.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.731+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.731+0000 7fb728d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:33.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.731+0000 7fb728d35800 20 started sync module instance, tier type = 2024-04-23T18:29:33.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.731+0000 7fb728d35800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:33.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.731+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c71540 con 0x556bb8c68cf0 2024-04-23T18:29:33.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.732+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.732+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93921149915280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c72440 con 0x556bb8c68cf0 2024-04-23T18:29:33.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.732+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c72c90 con 0x556bb8c64350 2024-04-23T18:29:33.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.733+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93921149915280] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.733+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.733+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93921149917488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c72d70 con 0x556bb8c64350 2024-04-23T18:29:33.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.733+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c73890 con 0x556bb8c6d6b0 2024-04-23T18:29:33.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.734+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93921149917488] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.734+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.734+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93921149924192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c73c80 con 0x556bb8c6d6b0 2024-04-23T18:29:33.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.734+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c746c0 con 0x556bb8c68cf0 2024-04-23T18:29:33.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.735+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93921149924192] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.735+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.736+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93921149921248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c74f60 con 0x556bb8c68cf0 2024-04-23T18:29:33.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.736+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c75920 con 0x556bb8c64350 2024-04-23T18:29:33.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.736+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.737+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93921149932656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c75d40 con 0x556bb8c64350 2024-04-23T18:29:33.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.737+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c76820 con 0x7fb71800f070 2024-04-23T18:29:33.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.737+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93921149921248] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.738+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.738+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93921149936432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c76820 con 0x7fb71800f070 2024-04-23T18:29:33.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.738+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93921149932656] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.738+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c75890 con 0x7fb71800f070 2024-04-23T18:29:33.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.739+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93921149936432] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.739+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.739+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93921149933712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c76d80 con 0x7fb71800f070 2024-04-23T18:29:33.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.739+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c77740 con 0x7fb71800f070 2024-04-23T18:29:33.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.740+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.740+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93921149940368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c77b60 con 0x7fb71800f070 2024-04-23T18:29:33.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.740+0000 7fb728d35800 20 add_watcher() i=0 2024-04-23T18:29:33.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.740+0000 7fb728d35800 20 add_watcher() i=1 2024-04-23T18:29:33.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.740+0000 7fb728d35800 20 add_watcher() i=2 2024-04-23T18:29:33.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.740+0000 7fb728d35800 20 add_watcher() i=3 2024-04-23T18:29:33.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.740+0000 7fb728d35800 20 add_watcher() i=4 2024-04-23T18:29:33.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.740+0000 7fb728d35800 20 add_watcher() i=5 2024-04-23T18:29:33.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.740+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93921149933712] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.740+0000 7fb728d35800 20 add_watcher() i=6 2024-04-23T18:29:33.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.741+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93921149940368] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.741+0000 7fb728d35800 20 add_watcher() i=7 2024-04-23T18:29:33.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.741+0000 7fb728d35800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:33.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.741+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c77b60 con 0x556bb8c64350 2024-04-23T18:29:33.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.741+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.741+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93921149941424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c78440 con 0x556bb8c64350 2024-04-23T18:29:33.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.742+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93921149941424] v32'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.742+0000 7fb5db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:33.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.742+0000 7fb728d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:33.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.742+0000 7fb728d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:33.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.742+0000 7fb728d35800 5 note: GC not initialized 2024-04-23T18:29:33.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.742+0000 7fb5da7e4640 20 reqs_thread_entry: start 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.743+0000 7fb728d35800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.743+0000 7fb728d35800 20 Filter name: none 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.743+0000 7fb5d3fff640 20 reqs_thread_entry: start 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.743+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8cad8a0 con 0x556bb8c6d6b0 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.743+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.743+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8cad8a0 con 0x556bb8c6d6b0 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.743+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.743+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8cad8a0 con 0x556bb8c64350 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.744+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.744+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c64350 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.744+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v32'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.744+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c68cf0 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.744+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.744+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c746c0 con 0x556bb8c6d6b0 2024-04-23T18:29:33.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.744+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.744+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c746c0 con 0x556bb8c64350 2024-04-23T18:29:33.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.745+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.745+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c6d6b0 2024-04-23T18:29:33.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.745+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.745+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c68cf0 2024-04-23T18:29:33.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.745+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.745+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c6d6b0 2024-04-23T18:29:33.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.745+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.745+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c64350 2024-04-23T18:29:33.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.745+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.745+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x7fb71800f070 2024-04-23T18:29:33.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.746+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.746+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x7fb71800f070 2024-04-23T18:29:33.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.746+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.746+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c6d6b0 2024-04-23T18:29:33.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.746+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.746+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x7fb71800f070 2024-04-23T18:29:33.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.747+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.747+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x7fb71800f070 2024-04-23T18:29:33.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.747+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.747+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x7fb71800f070 2024-04-23T18:29:33.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.747+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.747+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c6d6b0 2024-04-23T18:29:33.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.747+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.747+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c68cf0 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.748+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(80 [pgnls start_epoch 32 out=70b] v32'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.748+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c64350 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.748+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.748+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c64350 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.748+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.748+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c6d6b0 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.748+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.748+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c68cf0 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.749+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.749+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x7fb71800f070 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.749+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.749+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c64350 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.749+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.749+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x7fb71800f070 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.749+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.749+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c6d6b0 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.750+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=127b] v32'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.750+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c68cf0 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.750+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.750+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x7fb71800f070 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.750+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.750+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c64350 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.750+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.750+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c6d6b0 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.751+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.751+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb720045040 con 0x556bb8c68cf0 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.751+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.751+0000 7fb728d35800 20 RGWRados::pool_iterate: got myfoo 2024-04-23T18:29:33.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.751+0000 7fb728d35800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 2024-04-23T18:29:33.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.752+0000 7fb5db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:33.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.752+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93921149941424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c746c0 con 0x556bb8c64350 2024-04-23T18:29:33.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.753+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93921149941424] v32'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.753+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93921149915280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c776b0 con 0x556bb8c68cf0 2024-04-23T18:29:33.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.754+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93921149915280] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.754+0000 7fb728d35800 20 remove_watcher() i=0 2024-04-23T18:29:33.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.754+0000 7fb728d35800 2 removed watcher, disabling cache 2024-04-23T18:29:33.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.754+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93921149917488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c776b0 con 0x556bb8c64350 2024-04-23T18:29:33.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.755+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93921149917488] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.755+0000 7fb728d35800 20 remove_watcher() i=1 2024-04-23T18:29:33.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.755+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93921149924192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c71930 con 0x556bb8c6d6b0 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.756+0000 7fb71ffff640 1 -- 172.21.15.119:0/1973023439 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93921149924192] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71007f070 con 0x556bb8c6d6b0 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.756+0000 7fb728d35800 20 remove_watcher() i=2 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.756+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93921149921248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c776b0 con 0x556bb8c68cf0 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.757+0000 7fb7249b5640 1 -- 172.21.15.119:0/1973023439 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93921149921248] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb71808d040 con 0x556bb8c68cf0 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.757+0000 7fb728d35800 20 remove_watcher() i=3 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.757+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93921149932656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c73360 con 0x556bb8c64350 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.758+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93921149932656] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x556bb8c64350 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.758+0000 7fb728d35800 20 remove_watcher() i=4 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.758+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93921149936432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c776b0 con 0x7fb71800f070 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.759+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93921149936432] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.759+0000 7fb728d35800 20 remove_watcher() i=5 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.759+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93921149933712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c75470 con 0x7fb71800f070 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.760+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93921149933712] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.760+0000 7fb728d35800 20 remove_watcher() i=6 2024-04-23T18:29:33.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.760+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93921149940368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556bb8c73360 con 0x7fb71800f070 2024-04-23T18:29:33.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93921149940368] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb720040040 con 0x7fb71800f070 2024-04-23T18:29:33.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 20 remove_watcher() i=7 2024-04-23T18:29:33.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb71800f070 msgr2=0x7fb718010690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb71800f070 0x7fb718010690 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556bb8c64350 msgr2=0x556bb8c667f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556bb8c64350 0x556bb8c667f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556bb8c68cf0 msgr2=0x556bb8c6b0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556bb8c68cf0 0x556bb8c6b0e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556bb8c6d6b0 msgr2=0x556bb8c6fb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556bb8c6d6b0 0x556bb8c6fb70 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb5f0036e60 msgr2=0x7fb5f0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb5f0036e60 0x7fb5f0039320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x556bb8c368b0 tx=0x7fb71004f000 comp rx=0 tx=0).stop 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c51a50 msgr2=0x556bb8c58e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 --2- 172.21.15.119:0/1973023439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c51a50 0x556bb8c58e40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb718027fd0 tx=0x7fb718052f70 comp rx=0 tx=0).stop 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb7251b6640 1 -- 172.21.15.119:0/1973023439 reap_dead start 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 shutdown_connections 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 >> 172.21.15.119:0/1973023439 conn(0x556bb8c4ddb0 msgr2=0x556bb8c4b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 shutdown_connections 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/1973023439 wait complete. 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/3948800682 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb5fc036e10 msgr2=0x7fb5fc0392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 --2- 172.21.15.119:0/3948800682 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb5fc036e10 0x7fb5fc0392d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x556bb8c2df20 tx=0x7fb710005ac0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/3948800682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c44910 msgr2=0x556bb8c44d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 --2- 172.21.15.119:0/3948800682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c44910 0x556bb8c44d30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb71801cfd0 tx=0x7fb71804bf60 comp rx=0 tx=0).stop 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/3948800682 shutdown_connections 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 --2- 172.21.15.119:0/3948800682 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb5fc036e10 0x7fb5fc0392d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 --2- 172.21.15.119:0/3948800682 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8c44910 0x556bb8c44d30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/3948800682 >> 172.21.15.119:0/3948800682 conn(0x556bb8c389b0 msgr2=0x556bb8c38db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/3948800682 shutdown_connections 2024-04-23T18:29:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.761+0000 7fb728d35800 1 -- 172.21.15.119:0/3948800682 wait complete. 2024-04-23T18:29:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556bb8c33900 msgr2=0x556bb8c35d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556bb8c33900 0x556bb8c35d50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556bb8b2b3a0 msgr2=0x556bb8c2d0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556bb8b2b3a0 0x556bb8c2d0a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556bb8c2f970 msgr2=0x556bb8c31d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556bb8c2f970 0x556bb8c31d60 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb60c036eb0 msgr2=0x7fb60c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb60c036eb0 0x7fb60c039370 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb710054000 tx=0x7fb71004e000 comp rx=0 tx=0).stop 2024-04-23T18:29:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b29860 msgr2=0x556bb8c26080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 --2- 172.21.15.119:0/1929921460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556bb8b29860 0x556bb8c26080 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb718001ed0 tx=0x7fb718000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb7251b6640 1 -- 172.21.15.119:0/1929921460 reap_dead start 2024-04-23T18:29:33.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 shutdown_connections 2024-04-23T18:29:33.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 >> 172.21.15.119:0/1929921460 conn(0x556bb8b25400 msgr2=0x556bb8c18810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 shutdown_connections 2024-04-23T18:29:33.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.762+0000 7fb728d35800 1 -- 172.21.15.119:0/1929921460 wait complete. 2024-04-23T18:29:33.772 INFO:teuthology.orchestra.run.smithi119.stdout:["myfoo"] 2024-04-23T18:29:33.772 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-23T18:29:33.782 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:33.792 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:33.805 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:33.851 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-04-23T18:29:33.877 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:33.907 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:33.936 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:33.936 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-23T18:29:33.936 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-23T18:29:33.936 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-23T18:29:33.979 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:33.979 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:33.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.987+0000 7f499e32b800 1 Processor -- start 2024-04-23T18:29:33.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.987+0000 7f499e32b800 1 -- start start 2024-04-23T18:29:33.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.987+0000 7f499e32b800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ad717c0e50 0x55ad717c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.987+0000 7f499e32b800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ad71672560 con 0x55ad717c20b0 2024-04-23T18:29:33.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.987+0000 7f499e32b800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55ad71663e20 con 0x55ad717c0e50 2024-04-23T18:29:33.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.987+0000 7f4999f52640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ad717c0e50 0x55ad717c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.987+0000 7f4999751640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55ad717c20b0 0x55ad717c2530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40732/0 (socket says 172.21.15.119:40732) 2024-04-23T18:29:33.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.987+0000 7f4999751640 1 -- 172.21.15.119:0/1893068022 learned_addr learned my addr 172.21.15.119:0/1893068022 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:33.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.988+0000 7f4999f52640 1 -- 172.21.15.119:0/1893068022 >> v1:172.21.15.62:6789/0 conn(0x55ad717c20b0 legacy=0x55ad717c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.988+0000 7f4998f50640 1 -- 172.21.15.119:0/1893068022 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2292181483 0 0) 0x55ad71672560 con 0x55ad717c20b0 2024-04-23T18:29:33.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.988+0000 7f4999f52640 1 -- 172.21.15.119:0/1893068022 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad71671e60 con 0x55ad717c0e50 2024-04-23T18:29:33.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.989+0000 7f4999f52640 1 --2- 172.21.15.119:0/1893068022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad717c1270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f499000a470 tx=0x7f499001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8443a18e573ab042 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:33.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.990+0000 7f4998f50640 1 -- 172.21.15.119:0/1893068022 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4990057070 con 0x55ad717c0e50 2024-04-23T18:29:33.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.990+0000 7f4998f50640 1 -- 172.21.15.119:0/1893068022 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4990052570 con 0x55ad717c0e50 2024-04-23T18:29:33.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.990+0000 7f4998f50640 1 -- 172.21.15.119:0/1893068022 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4990052870 con 0x55ad717c0e50 2024-04-23T18:29:33.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.990+0000 7f499e32b800 1 -- 172.21.15.119:0/1893068022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 msgr2=0x55ad717c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:33.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.990+0000 7f499e32b800 1 --2- 172.21.15.119:0/1893068022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad717c1270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f499000a470 tx=0x7f499001ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:33.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.990+0000 7f499e32b800 1 -- 172.21.15.119:0/1893068022 shutdown_connections 2024-04-23T18:29:33.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.990+0000 7f499e32b800 1 --2- 172.21.15.119:0/1893068022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad717c1270 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:33.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.990+0000 7f499e32b800 1 -- 172.21.15.119:0/1893068022 >> 172.21.15.119:0/1893068022 conn(0x55ad717bc410 msgr2=0x55ad717be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:33.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.991+0000 7f499e32b800 1 -- 172.21.15.119:0/1893068022 shutdown_connections 2024-04-23T18:29:33.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:33.991+0000 7f499e32b800 1 -- 172.21.15.119:0/1893068022 wait complete. 2024-04-23T18:29:33.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.002+0000 7f499e32b800 1 Processor -- start 2024-04-23T18:29:33.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.002+0000 7f499e32b800 1 -- start start 2024-04-23T18:29:33.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.002+0000 7f499e32b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad718b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:33.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.002+0000 7f499e32b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ad7170d5b0 con 0x55ad717c0e50 2024-04-23T18:29:33.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.002+0000 7f4999f52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad718b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:33.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.002+0000 7f4999f52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad718b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33446/0 (socket says 172.21.15.119:33446) 2024-04-23T18:29:33.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.002+0000 7f4999f52640 1 -- 172.21.15.119:0/2553816785 learned_addr learned my addr 172.21.15.119:0/2553816785 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:33.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.003+0000 7f4999f52640 1 -- 172.21.15.119:0/2553816785 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad71683860 con 0x55ad717c0e50 2024-04-23T18:29:33.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.003+0000 7f4999f52640 1 --2- 172.21.15.119:0/2553816785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad718b3470 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4990055040 tx=0x7f499004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccb013bf452de30 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.003+0000 7f4887e07640 1 -- 172.21.15.119:0/2553816785 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4990057070 con 0x55ad717c0e50 2024-04-23T18:29:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.003+0000 7f4887e07640 1 -- 172.21.15.119:0/2553816785 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4990063070 con 0x55ad717c0e50 2024-04-23T18:29:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.003+0000 7f4887e07640 1 -- 172.21.15.119:0/2553816785 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4990052720 con 0x55ad717c0e50 2024-04-23T18:29:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.004+0000 7f499e32b800 1 -- 172.21.15.119:0/2553816785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 msgr2=0x55ad718b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.004+0000 7f499e32b800 1 --2- 172.21.15.119:0/2553816785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad718b3470 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4990055040 tx=0x7f499004c000 comp rx=0 tx=0).stop 2024-04-23T18:29:34.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.004+0000 7f499e32b800 1 -- 172.21.15.119:0/2553816785 shutdown_connections 2024-04-23T18:29:34.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.004+0000 7f499e32b800 1 --2- 172.21.15.119:0/2553816785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad718b3470 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.004+0000 7f499e32b800 1 -- 172.21.15.119:0/2553816785 >> 172.21.15.119:0/2553816785 conn(0x55ad717bc410 msgr2=0x55ad718aed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.004+0000 7f499e32b800 1 -- 172.21.15.119:0/2553816785 shutdown_connections 2024-04-23T18:29:34.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.004+0000 7f499e32b800 1 -- 172.21.15.119:0/2553816785 wait complete. 2024-04-23T18:29:34.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.004+0000 7f499e32b800 1 Processor -- start 2024-04-23T18:29:34.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.004+0000 7f499e32b800 1 -- start start 2024-04-23T18:29:34.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.004+0000 7f499e32b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad718bac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.004+0000 7f499e32b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ad71734e20 con 0x55ad717c0e50 2024-04-23T18:29:34.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.005+0000 7f4999f52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad718bac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.005+0000 7f4999f52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad718bac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33458/0 (socket says 172.21.15.119:33458) 2024-04-23T18:29:34.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.005+0000 7f4999f52640 1 -- 172.21.15.119:0/693484899 learned_addr learned my addr 172.21.15.119:0/693484899 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.005+0000 7f4999f52640 1 -- 172.21.15.119:0/693484899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad71681eb0 con 0x55ad717c0e50 2024-04-23T18:29:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.005+0000 7f4999f52640 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad718bac50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4990055040 tx=0x7f4990002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.005+0000 7f4886604640 1 -- 172.21.15.119:0/693484899 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4990052cd0 con 0x55ad717c0e50 2024-04-23T18:29:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.005+0000 7f4886604640 1 -- 172.21.15.119:0/693484899 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f499006c070 con 0x55ad717c0e50 2024-04-23T18:29:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.005+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad718bb190 con 0x55ad717c0e50 2024-04-23T18:29:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.005+0000 7f4886604640 1 -- 172.21.15.119:0/693484899 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f499005e480 con 0x55ad717c0e50 2024-04-23T18:29:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.005+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad718bb710 con 0x55ad717c0e50 2024-04-23T18:29:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.006+0000 7f4886604640 1 -- 172.21.15.119:0/693484899 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f499005e620 con 0x55ad717c0e50 2024-04-23T18:29:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.006+0000 7f4886604640 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4880036e60 0x7f4880039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.006+0000 7f4886604640 1 -- 172.21.15.119:0/693484899 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f499008ee60 con 0x55ad717c0e50 2024-04-23T18:29:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.006+0000 7f4999751640 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4880036e60 0x7f4880039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.006+0000 7f499e32b800 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ad717c20b0 0x55ad718c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.006+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad718c2240 con 0x55ad717c20b0 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.007+0000 7f499a753640 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ad717c20b0 0x55ad718c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.007+0000 7f4999751640 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4880036e60 0x7f4880039320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f498c000c00 tx=0x7f498c0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.007+0000 7f499a753640 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ad717c20b0 0x55ad718c1cc0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.007+0000 7f499a753640 1 -- 172.21.15.119:0/693484899 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad717c20b0 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.007+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad718bf270 con 0x55ad717c20b0 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.007+0000 7f499a753640 1 -- 172.21.15.119:0/693484899 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad717c20b0 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.007+0000 7f499e32b800 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ad718c4550 0x55ad718c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.007+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad718c7010 con 0x55ad718c4550 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.007+0000 7f4999f52640 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ad718c4550 0x55ad718c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.008+0000 7f4999f52640 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ad718c4550 0x55ad718c6940 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.008+0000 7f4999f52640 1 -- 172.21.15.119:0/693484899 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f49900717f0 con 0x55ad718c4550 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.008+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad718c3500 con 0x55ad717c20b0 2024-04-23T18:29:34.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.008+0000 7f499a753640 1 -- 172.21.15.119:0/693484899 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad717c20b0 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.008+0000 7f499e32b800 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55ad718c8450 0x55ad718ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.008+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad718cb0a0 con 0x55ad718c8450 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.009+0000 7f4999751640 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55ad718c8450 0x55ad718ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.009+0000 7f4999751640 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55ad718c8450 0x55ad718ca910 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.010+0000 7f4999751640 1 -- 172.21.15.119:0/693484899 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f498c00f670 con 0x55ad718c8450 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.010+0000 7f499e32b800 1 Processor -- start 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.010+0000 7f499e32b800 1 -- start start 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.010+0000 7f499e32b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717cc0e0 0x55ad717ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.010+0000 7f499e32b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ad716b3df0 con 0x55ad717cc0e0 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.010+0000 7f4999f52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717cc0e0 0x55ad717ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.010+0000 7f4999f52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717cc0e0 0x55ad717ca550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33464/0 (socket says 172.21.15.119:33464) 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.010+0000 7f4999f52640 1 -- 172.21.15.119:0/1072914664 learned_addr learned my addr 172.21.15.119:0/1072914664 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.010+0000 7f4999f52640 1 -- 172.21.15.119:0/1072914664 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad717caa90 con 0x55ad717cc0e0 2024-04-23T18:29:34.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.011+0000 7f4999f52640 1 --2- 172.21.15.119:0/1072914664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717cc0e0 0x55ad717ca550 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f499008d310 tx=0x7f4990009a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.011+0000 7f487f7fe640 1 -- 172.21.15.119:0/1072914664 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4990073e10 con 0x55ad717cc0e0 2024-04-23T18:29:34.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.011+0000 7f487f7fe640 1 -- 172.21.15.119:0/1072914664 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4990058040 con 0x55ad717cc0e0 2024-04-23T18:29:34.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.011+0000 7f499e32b800 1 -- 172.21.15.119:0/1072914664 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad717cad20 con 0x55ad717cc0e0 2024-04-23T18:29:34.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.011+0000 7f487f7fe640 1 -- 172.21.15.119:0/1072914664 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4990066690 con 0x55ad717cc0e0 2024-04-23T18:29:34.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.011+0000 7f499e32b800 1 -- 172.21.15.119:0/1072914664 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad717cb220 con 0x55ad717cc0e0 2024-04-23T18:29:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.012+0000 7f487f7fe640 1 -- 172.21.15.119:0/1072914664 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4990066830 con 0x55ad717cc0e0 2024-04-23T18:29:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.012+0000 7f487f7fe640 1 --2- 172.21.15.119:0/1072914664 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4874036eb0 0x7f4874039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.012+0000 7f487f7fe640 1 -- 172.21.15.119:0/1072914664 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f499008b050 con 0x55ad717cc0e0 2024-04-23T18:29:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.012+0000 7f4999751640 1 --2- 172.21.15.119:0/1072914664 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4874036eb0 0x7f4874039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.012+0000 7f499e32b800 1 Processor -- start 2024-04-23T18:29:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.012+0000 7f499e32b800 1 -- start start 2024-04-23T18:29:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.012+0000 7f4999751640 1 --2- 172.21.15.119:0/1072914664 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4874036eb0 0x7f4874039370 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55ad718c26f0 tx=0x7f498c006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.012+0000 7f499e32b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad718e8900 0x55ad718e8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.012+0000 7f499e32b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ad718b3b30 con 0x55ad718e8900 2024-04-23T18:29:34.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.012+0000 7f4999f52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad718e8900 0x55ad718e8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.012+0000 7f4999f52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad718e8900 0x55ad718e8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33468/0 (socket says 172.21.15.119:33468) 2024-04-23T18:29:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.013+0000 7f4999f52640 1 -- 172.21.15.119:0/3915813169 learned_addr learned my addr 172.21.15.119:0/3915813169 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.013+0000 7f4999f52640 1 -- 172.21.15.119:0/3915813169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad718e92f0 con 0x55ad718e8900 2024-04-23T18:29:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.013+0000 7f4999f52640 1 --2- 172.21.15.119:0/3915813169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad718e8900 0x55ad718e8d20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4990067de0 tx=0x7f499007ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2548b296fd39c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.013+0000 7f487d7fa640 1 -- 172.21.15.119:0/3915813169 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49900ac070 con 0x55ad718e8900 2024-04-23T18:29:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.013+0000 7f487d7fa640 1 -- 172.21.15.119:0/3915813169 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4990083680 con 0x55ad718e8900 2024-04-23T18:29:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.013+0000 7f487d7fa640 1 -- 172.21.15.119:0/3915813169 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4990067420 con 0x55ad718e8900 2024-04-23T18:29:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.013+0000 7f499e32b800 1 -- 172.21.15.119:0/3915813169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad718e8900 msgr2=0x55ad718e8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.013+0000 7f499e32b800 1 --2- 172.21.15.119:0/3915813169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad718e8900 0x55ad718e8d20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4990067de0 tx=0x7f499007ae40 comp rx=0 tx=0).stop 2024-04-23T18:29:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.013+0000 7f499e32b800 1 -- 172.21.15.119:0/3915813169 shutdown_connections 2024-04-23T18:29:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.013+0000 7f499e32b800 1 --2- 172.21.15.119:0/3915813169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad718e8900 0x55ad718e8d20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.014+0000 7f499e32b800 1 -- 172.21.15.119:0/3915813169 >> 172.21.15.119:0/3915813169 conn(0x55ad718e4c10 msgr2=0x55ad718e2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.014+0000 7f499e32b800 1 -- 172.21.15.119:0/3915813169 shutdown_connections 2024-04-23T18:29:34.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.014+0000 7f499e32b800 1 -- 172.21.15.119:0/3915813169 wait complete. 2024-04-23T18:29:34.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.014+0000 7f499e32b800 1 Processor -- start 2024-04-23T18:29:34.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.014+0000 7f499e32b800 1 -- start start 2024-04-23T18:29:34.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.014+0000 7f499e32b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad718e8900 0x55ad718efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.014+0000 7f499e32b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ad718e9980 con 0x55ad718e8900 2024-04-23T18:29:34.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.014+0000 7f4999f52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad718e8900 0x55ad718efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.014+0000 7f4999f52640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad718e8900 0x55ad718efc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33474/0 (socket says 172.21.15.119:33474) 2024-04-23T18:29:34.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.014+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 learned_addr learned my addr 172.21.15.119:0/3520422750 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.014+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad718f0170 con 0x55ad718e8900 2024-04-23T18:29:34.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.015+0000 7f4999f52640 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad718e8900 0x55ad718efc30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4990067e20 tx=0x7f4990062f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.015+0000 7f486b7fe640 1 -- 172.21.15.119:0/3520422750 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49900b7020 con 0x55ad718e8900 2024-04-23T18:29:34.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.015+0000 7f486b7fe640 1 -- 172.21.15.119:0/3520422750 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49900730c0 con 0x55ad718e8900 2024-04-23T18:29:34.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.015+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad718f0170 con 0x55ad718e8900 2024-04-23T18:29:34.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.015+0000 7f486b7fe640 1 -- 172.21.15.119:0/3520422750 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49900ac030 con 0x55ad718e8900 2024-04-23T18:29:34.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.015+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad718f0170 con 0x55ad718e8900 2024-04-23T18:29:34.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.016+0000 7f486b7fe640 1 -- 172.21.15.119:0/3520422750 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f49900ba020 con 0x55ad718e8900 2024-04-23T18:29:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.016+0000 7f486b7fe640 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4864036e60 0x7f4864039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.016+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.016+0000 7f486b7fe640 1 -- 172.21.15.119:0/3520422750 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f49900ad070 con 0x55ad718e8900 2024-04-23T18:29:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.016+0000 7f4999751640 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4864036e60 0x7f4864039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.016+0000 7f499e32b800 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ad718fb270 0x55ad718fd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.016+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad718fde80 con 0x55ad718fb270 2024-04-23T18:29:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.016+0000 7f499a753640 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ad718fb270 0x55ad718fd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.016+0000 7f4999751640 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4864036e60 0x7f4864039320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55ad718cb4a0 tx=0x7f498c023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.016+0000 7f499a753640 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ad718fb270 0x55ad718fd730 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad718fb270 2024-04-23T18:29:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 20 realm 2024-04-23T18:29:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad718fe290 con 0x55ad718fb270 2024-04-23T18:29:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad718fb270 2024-04-23T18:29:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feb30 con 0x55ad718fb270 2024-04-23T18:29:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad718fb270 2024-04-23T18:29:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718fb270 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad718fb270 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ad718ffc30 0x55ad71902020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad719025a0 con 0x55ad718ffc30 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.017+0000 7f4999f52640 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ad718ffc30 0x55ad71902020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.018+0000 7f4999f52640 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ad718ffc30 0x55ad71902020 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.018+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f49900717f0 con 0x55ad718ffc30 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.018+0000 7f499e32b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.018+0000 7f499e32b800 20 searching for the correct realm 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.018+0000 7f499e32b800 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55ad71904600 0x55ad71906ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.018+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad71907190 con 0x55ad71904600 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.018+0000 7f4999751640 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55ad71904600 0x55ad71906ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.018+0000 7f4999751640 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55ad71904600 0x55ad71906ac0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.019+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.019+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad71907190 con 0x55ad718ffc30 2024-04-23T18:29:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.019+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49900717f0 con 0x55ad718ffc30 2024-04-23T18:29:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.019+0000 7f4999f52640 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f49900c7040 0x7f4990093430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.019+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad71907190 con 0x7f49900c7040 2024-04-23T18:29:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.019+0000 7f499a753640 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f49900c7040 0x7f4990093430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.020+0000 7f499a753640 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f49900c7040 0x7f4990093430 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.020+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f499400a4a0 con 0x7f49900c7040 2024-04-23T18:29:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.020+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718fb270 2024-04-23T18:29:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.020+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad718fb270 2024-04-23T18:29:34.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.020+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718fb270 2024-04-23T18:29:34.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.020+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad718fb270 2024-04-23T18:29:34.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.020+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x7f49900c7040 2024-04-23T18:29:34.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.021+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f499400a4a0 con 0x7f49900c7040 2024-04-23T18:29:34.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.021+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x7f49900c7040 2024-04-23T18:29:34.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.021+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f499400a4a0 con 0x7f49900c7040 2024-04-23T18:29:34.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.021+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718ffc30 2024-04-23T18:29:34.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.021+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49900717f0 con 0x55ad718ffc30 2024-04-23T18:29:34.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.021+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad71904600 2024-04-23T18:29:34.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.021+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.021+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718fb270 2024-04-23T18:29:34.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.021+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad718fb270 2024-04-23T18:29:34.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.021+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x7f49900c7040 2024-04-23T18:29:34.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.022+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f499400a4a0 con 0x7f49900c7040 2024-04-23T18:29:34.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.022+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718fb270 2024-04-23T18:29:34.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.022+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad718fb270 2024-04-23T18:29:34.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.022+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718ffc30 2024-04-23T18:29:34.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.022+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f49900717f0 con 0x55ad718ffc30 2024-04-23T18:29:34.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.022+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad71904600 2024-04-23T18:29:34.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.022+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.022+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad71904600 2024-04-23T18:29:34.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.023+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.023+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x7f49900c7040 2024-04-23T18:29:34.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.023+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f499400a4a0 con 0x7f49900c7040 2024-04-23T18:29:34.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.023+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad71904600 2024-04-23T18:29:34.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.023+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.023+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad71904600 2024-04-23T18:29:34.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.023+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.023+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718fb270 2024-04-23T18:29:34.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.024+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad718fb270 2024-04-23T18:29:34.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.024+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718fb270 2024-04-23T18:29:34.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.024+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad718fb270 2024-04-23T18:29:34.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.024+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x7f49900c7040 2024-04-23T18:29:34.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.024+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f499400a4a0 con 0x7f49900c7040 2024-04-23T18:29:34.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.024+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad71904600 2024-04-23T18:29:34.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.024+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.024+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718ffc30 2024-04-23T18:29:34.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.025+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f49900717f0 con 0x55ad718ffc30 2024-04-23T18:29:34.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.025+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718fb270 2024-04-23T18:29:34.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.025+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f499400a4a0 con 0x55ad718fb270 2024-04-23T18:29:34.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.025+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x7f49900c7040 2024-04-23T18:29:34.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.025+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f499400a4a0 con 0x7f49900c7040 2024-04-23T18:29:34.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.025+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad71904600 2024-04-23T18:29:34.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.025+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.025+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x7f49900c7040 2024-04-23T18:29:34.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.026+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f499400a4a0 con 0x7f49900c7040 2024-04-23T18:29:34.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.026+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718ffc30 2024-04-23T18:29:34.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.026+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49900717f0 con 0x55ad718ffc30 2024-04-23T18:29:34.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.026+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad71904600 2024-04-23T18:29:34.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.026+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.026+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x7f49900c7040 2024-04-23T18:29:34.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718fb270 2024-04-23T18:29:34.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4994040040 con 0x55ad718fb270 2024-04-23T18:29:34.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad718feed0 con 0x55ad718ffc30 2024-04-23T18:29:34.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49900d4040 con 0x55ad718ffc30 2024-04-23T18:29:34.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499e32b800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:34.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499e32b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:34.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499e32b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:34.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499e32b800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:34.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499e32b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:34.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499e32b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:34.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71902f20 con 0x55ad718fb270 2024-04-23T18:29:34.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4994040040 con 0x55ad718fb270 2024-04-23T18:29:34.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499e32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.027+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71902f20 con 0x55ad718fb270 2024-04-23T18:29:34.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4994040040 con 0x55ad718fb270 2024-04-23T18:29:34.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:34.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71902f20 con 0x7f49900c7040 2024-04-23T18:29:34.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:34.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 20 zone default found 2024-04-23T18:29:34.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 4 Realm: () 2024-04-23T18:29:34.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:34.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:34.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:34.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 20 zonegroup default 2024-04-23T18:29:34.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71903310 con 0x7f49900c7040 2024-04-23T18:29:34.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.028+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71903750 con 0x55ad71904600 2024-04-23T18:29:34.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.029+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.029+0000 7f499e32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.029+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.029+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71908ff0 con 0x55ad71904600 2024-04-23T18:29:34.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.029+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.029+0000 7f499e32b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.029+0000 7f499e32b800 20 started sync module instance, tier type = 2024-04-23T18:29:34.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.029+0000 7f499e32b800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:34.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.029+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad71908490 con 0x55ad718ffc30 2024-04-23T18:29:34.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.030+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49900d4040 con 0x55ad718ffc30 2024-04-23T18:29:34.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.030+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94203422998496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad71909390 con 0x55ad718ffc30 2024-04-23T18:29:34.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.030+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad71909be0 con 0x55ad718fb270 2024-04-23T18:29:34.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.031+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94203422998496] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49900d4040 con 0x55ad718ffc30 2024-04-23T18:29:34.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.031+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x55ad718fb270 2024-04-23T18:29:34.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.031+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94203423004464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190a000 con 0x55ad718fb270 2024-04-23T18:29:34.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.031+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190a9c0 con 0x55ad71904600 2024-04-23T18:29:34.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.032+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94203423004464] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x55ad718fb270 2024-04-23T18:29:34.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.032+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.032+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94203423005520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad71909f70 con 0x55ad71904600 2024-04-23T18:29:34.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.033+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190b830 con 0x55ad718ffc30 2024-04-23T18:29:34.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.033+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94203423005520] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.034+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49900d4040 con 0x55ad718ffc30 2024-04-23T18:29:34.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.034+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94203423011712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190b7a0 con 0x55ad718ffc30 2024-04-23T18:29:34.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.034+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190c5a0 con 0x55ad718fb270 2024-04-23T18:29:34.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.035+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94203423011712] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49900d4040 con 0x55ad718ffc30 2024-04-23T18:29:34.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.035+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x55ad718fb270 2024-04-23T18:29:34.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.035+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94203423013920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190c5a0 con 0x55ad718fb270 2024-04-23T18:29:34.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.035+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190cff0 con 0x7f49900c7040 2024-04-23T18:29:34.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.036+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.036+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94203423017728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190cf60 con 0x7f49900c7040 2024-04-23T18:29:34.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.036+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94203423013920] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x55ad718fb270 2024-04-23T18:29:34.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.036+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190da30 con 0x7f49900c7040 2024-04-23T18:29:34.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.037+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94203423017728] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.037+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.037+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94203423014976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190da30 con 0x7f49900c7040 2024-04-23T18:29:34.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.037+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190e3f0 con 0x7f49900c7040 2024-04-23T18:29:34.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.038+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94203423014976] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.038+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.038+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94203423020048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190e3f0 con 0x7f49900c7040 2024-04-23T18:29:34.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.038+0000 7f499e32b800 20 add_watcher() i=0 2024-04-23T18:29:34.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.038+0000 7f499e32b800 20 add_watcher() i=1 2024-04-23T18:29:34.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.038+0000 7f499e32b800 20 add_watcher() i=2 2024-04-23T18:29:34.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.038+0000 7f499e32b800 20 add_watcher() i=3 2024-04-23T18:29:34.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.038+0000 7f499e32b800 20 add_watcher() i=4 2024-04-23T18:29:34.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.038+0000 7f499e32b800 20 add_watcher() i=5 2024-04-23T18:29:34.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.038+0000 7f499e32b800 20 add_watcher() i=6 2024-04-23T18:29:34.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.039+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94203423020048] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.039+0000 7f499e32b800 20 add_watcher() i=7 2024-04-23T18:29:34.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.039+0000 7f499e32b800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:34.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.039+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71911820 con 0x55ad718fb270 2024-04-23T18:29:34.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.039+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4994040040 con 0x55ad718fb270 2024-04-23T18:29:34.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.039+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94203423023376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190ed10 con 0x55ad718fb270 2024-04-23T18:29:34.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.040+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94203423023376] v32'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4994040040 con 0x55ad718fb270 2024-04-23T18:29:34.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.040+0000 7f484b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:34.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.040+0000 7f499e32b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:34.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.040+0000 7f499e32b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:34.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.040+0000 7f499e32b800 5 note: GC not initialized 2024-04-23T18:29:34.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.041+0000 7f484a7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:34.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.041+0000 7f499e32b800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:34.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.041+0000 7f499e32b800 20 Filter name: none 2024-04-23T18:29:34.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.041+0000 7f47bbfff640 20 reqs_thread_entry: start 2024-04-23T18:29:34.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.041+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.041+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71944ec0 con 0x55ad718ffc30 2024-04-23T18:29:34.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.041+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f49900d4040 con 0x55ad718ffc30 2024-04-23T18:29:34.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.041+0000 7f499e32b800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:34.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.041+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.041+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:63 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad719457e0 con 0x55ad71904600 2024-04-23T18:29:34.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.042+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(63 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.042+0000 7f499e32b800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:34.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.042+0000 7f499e32b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-23T18:29:34.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.042+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.042+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad719452e0 con 0x55ad718ffc30 2024-04-23T18:29:34.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.042+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f49900d4040 con 0x55ad718ffc30 2024-04-23T18:29:34.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.042+0000 7f499e32b800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:34.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.042+0000 7f499e32b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.042+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:65 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71947360 con 0x55ad71904600 2024-04-23T18:29:34.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.042+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(65 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.042+0000 7f499e32b800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:34.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.042+0000 7f499e32b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-23T18:29:34.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 4.3e 4:7dbf76af:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71946d50 con 0x55ad718ffc30 2024-04-23T18:29:34.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 4.1 4:81f4b350:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad7194bcf0 con 0x55ad718ffc30 2024-04-23T18:29:34.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 4.11 4:891fea53:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad7194e710 con 0x7f49900c7040 2024-04-23T18:29:34.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 4.21 4:842d5f4d:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71950f80 con 0x7f49900c7040 2024-04-23T18:29:34.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:70 4.25 4:a75c3a3c:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71953a10 con 0x55ad71904600 2024-04-23T18:29:34.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 4.14 4:28337734:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71956280 con 0x55ad71904600 2024-04-23T18:29:34.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 4.1c 4:39198531:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71958fe0 con 0x7f49900c7040 2024-04-23T18:29:34.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 4.1c 4:3a706890:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71956280 con 0x7f49900c7040 2024-04-23T18:29:34.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:74 4.0 4:03724c23:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad7195df20 con 0x55ad71904600 2024-04-23T18:29:34.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:75 4.3d 4:bc4cc370:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad71960910 con 0x55ad71904600 2024-04-23T18:29:34.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 4.1e 4:7a26d6dd:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad719632a0 con 0x7f49900c7040 2024-04-23T18:29:34.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f49900d4040 con 0x55ad718ffc30 2024-04-23T18:29:34.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(70 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(67 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f49900d4040 con 0x55ad718ffc30 2024-04-23T18:29:34.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(71 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(68 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(69 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(74 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(76 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(75 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.043+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(73 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.044+0000 7f484b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:34.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.044+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94203423023376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad71943dd0 con 0x55ad718fb270 2024-04-23T18:29:34.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.045+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94203423023376] v32'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4994040040 con 0x55ad718fb270 2024-04-23T18:29:34.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.045+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94203422998496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190e0e0 con 0x55ad718ffc30 2024-04-23T18:29:34.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.046+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94203422998496] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49900d4040 con 0x55ad718ffc30 2024-04-23T18:29:34.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.046+0000 7f499e32b800 20 remove_watcher() i=0 2024-04-23T18:29:34.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.046+0000 7f499e32b800 2 removed watcher, disabling cache 2024-04-23T18:29:34.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.046+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94203423004464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad71907fe0 con 0x55ad718fb270 2024-04-23T18:29:34.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.047+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94203423004464] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x55ad718fb270 2024-04-23T18:29:34.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.047+0000 7f499e32b800 20 remove_watcher() i=1 2024-04-23T18:29:34.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.047+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94203423005520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad71907fe0 con 0x55ad71904600 2024-04-23T18:29:34.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.048+0000 7f4999751640 1 -- 172.21.15.119:0/3520422750 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94203423005520] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f498c037040 con 0x55ad71904600 2024-04-23T18:29:34.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.048+0000 7f499e32b800 20 remove_watcher() i=2 2024-04-23T18:29:34.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.048+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94203423011712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad71907fe0 con 0x55ad718ffc30 2024-04-23T18:29:34.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.049+0000 7f4999f52640 1 -- 172.21.15.119:0/3520422750 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94203423011712] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49900d4040 con 0x55ad718ffc30 2024-04-23T18:29:34.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.049+0000 7f499e32b800 20 remove_watcher() i=3 2024-04-23T18:29:34.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.049+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94203423013920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad71907fe0 con 0x55ad718fb270 2024-04-23T18:29:34.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.050+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94203423013920] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x55ad718fb270 2024-04-23T18:29:34.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.050+0000 7f499e32b800 20 remove_watcher() i=4 2024-04-23T18:29:34.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.050+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94203423017728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad7190bc20 con 0x7f49900c7040 2024-04-23T18:29:34.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.051+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94203423017728] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.051+0000 7f499e32b800 20 remove_watcher() i=5 2024-04-23T18:29:34.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.051+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94203423014976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad71907fe0 con 0x7f49900c7040 2024-04-23T18:29:34.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.052+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94203423014976] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.052+0000 7f499e32b800 20 remove_watcher() i=6 2024-04-23T18:29:34.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.052+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94203423020048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad71907fe0 con 0x7f49900c7040 2024-04-23T18:29:34.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94203423020048] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4994040040 con 0x7f49900c7040 2024-04-23T18:29:34.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 20 remove_watcher() i=7 2024-04-23T18:29:34.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f49900c7040 msgr2=0x7f4990093430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f49900c7040 0x7f4990093430 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ad718fb270 msgr2=0x55ad718fd730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ad718fb270 0x55ad718fd730 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ad718ffc30 msgr2=0x55ad71902020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ad718ffc30 0x55ad71902020 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55ad71904600 msgr2=0x55ad71906ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55ad71904600 0x55ad71906ac0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4864036e60 msgr2=0x7f4864039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4864036e60 0x7f4864039320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55ad718cb4a0 tx=0x7f498c023040 comp rx=0 tx=0).stop 2024-04-23T18:29:34.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad718e8900 msgr2=0x55ad718efc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 --2- 172.21.15.119:0/3520422750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad718e8900 0x55ad718efc30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4990067e20 tx=0x7f4990062f80 comp rx=0 tx=0).stop 2024-04-23T18:29:34.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 reap_dead start 2024-04-23T18:29:34.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499a753640 1 -- 172.21.15.119:0/3520422750 reap_dead start 2024-04-23T18:29:34.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 shutdown_connections 2024-04-23T18:29:34.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 >> 172.21.15.119:0/3520422750 conn(0x55ad718e4c10 msgr2=0x55ad718e2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 shutdown_connections 2024-04-23T18:29:34.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.053+0000 7f499e32b800 1 -- 172.21.15.119:0/3520422750 wait complete. 2024-04-23T18:29:34.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/1072914664 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4874036eb0 msgr2=0x7f4874039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 --2- 172.21.15.119:0/1072914664 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4874036eb0 0x7f4874039370 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55ad718c26f0 tx=0x7f498c006000 comp rx=0 tx=0).stop 2024-04-23T18:29:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/1072914664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717cc0e0 msgr2=0x55ad717ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 --2- 172.21.15.119:0/1072914664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717cc0e0 0x55ad717ca550 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f499008d310 tx=0x7f4990009a80 comp rx=0 tx=0).stop 2024-04-23T18:29:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/1072914664 shutdown_connections 2024-04-23T18:29:34.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 --2- 172.21.15.119:0/1072914664 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4874036eb0 0x7f4874039370 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 --2- 172.21.15.119:0/1072914664 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717cc0e0 0x55ad717ca550 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/1072914664 >> 172.21.15.119:0/1072914664 conn(0x55ad718cd580 msgr2=0x55ad718cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/1072914664 shutdown_connections 2024-04-23T18:29:34.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/1072914664 wait complete. 2024-04-23T18:29:34.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55ad718c8450 msgr2=0x55ad718ca910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55ad718c8450 0x55ad718ca910 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ad717c20b0 msgr2=0x55ad718c1cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ad717c20b0 0x55ad718c1cc0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ad718c4550 msgr2=0x55ad718c6940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ad718c4550 0x55ad718c6940 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4880036e60 msgr2=0x7f4880039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4880036e60 0x7f4880039320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f498c000c00 tx=0x7f498c0013b0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 msgr2=0x55ad718bac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 --2- 172.21.15.119:0/693484899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ad717c0e50 0x55ad718bac50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4990055040 tx=0x7f4990002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499a753640 1 -- 172.21.15.119:0/693484899 reap_dead start 2024-04-23T18:29:34.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 shutdown_connections 2024-04-23T18:29:34.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 >> 172.21.15.119:0/693484899 conn(0x55ad717bc410 msgr2=0x55ad718b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 shutdown_connections 2024-04-23T18:29:34.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.054+0000 7f499e32b800 1 -- 172.21.15.119:0/693484899 wait complete. 2024-04-23T18:29:34.082 INFO:teuthology.orchestra.run.smithi119.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"4f165054-0d30-4e3c-af82-245e56f34813","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1","marker":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-23T18:29:33.452606Z","creation_time":"2024-04-23T18:29:33.450324Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-23T18:29:34.083 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4f165054-0d30-4e3c-af82-245e56f34813', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1', 'marker': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-23T18:29:33.452606Z', 'creation_time': '2024-04-23T18:29:33.450324Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-23T18:29:34.083 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-23T18:29:34.083 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-23T18:29:34.084 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-23T18:29:34.165 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:34.165 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:34.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.173+0000 7fc46c3a2800 1 Processor -- start 2024-04-23T18:29:34.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.173+0000 7fc46c3a2800 1 -- start start 2024-04-23T18:29:34.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.173+0000 7fc46c3a2800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b7a4748570 0x55b7a474a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.173+0000 7fc46c3a2800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b7a45f4560 con 0x55b7a4744a60 2024-04-23T18:29:34.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.173+0000 7fc46c3a2800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55b7a45e5e20 con 0x55b7a4748570 2024-04-23T18:29:34.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.174+0000 7fc4616a7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b7a4748570 0x55b7a474a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.174+0000 7fc4616a7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b7a4748570 0x55b7a474a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33488/0 (socket says 172.21.15.119:33488) 2024-04-23T18:29:34.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.174+0000 7fc4616a7640 1 -- 172.21.15.119:0/2905126692 learned_addr learned my addr 172.21.15.119:0/2905126692 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.174+0000 7fc4616a7640 1 -- 172.21.15.119:0/2905126692 >> v1:172.21.15.62:6789/0 conn(0x55b7a4744a60 legacy=0x55b7a4746e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.174+0000 7fc4616a7640 1 -- 172.21.15.119:0/2905126692 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7a45f3e60 con 0x55b7a4748570 2024-04-23T18:29:34.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.176+0000 7fc4616a7640 1 --2- 172.21.15.119:0/2905126692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4748570 0x55b7a474a960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc45400a520 tx=0x7fc45401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab746f0c2489431 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.176+0000 7fc4696a7640 1 -- 172.21.15.119:0/2905126692 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc454057070 con 0x55b7a4748570 2024-04-23T18:29:34.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.176+0000 7fc4696a7640 1 -- 172.21.15.119:0/2905126692 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc454052570 con 0x55b7a4748570 2024-04-23T18:29:34.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.176+0000 7fc4696a7640 1 -- 172.21.15.119:0/2905126692 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc45404ae60 con 0x55b7a4748570 2024-04-23T18:29:34.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.177+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2905126692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4748570 msgr2=0x55b7a474a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.177+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/2905126692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4748570 0x55b7a474a960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc45400a520 tx=0x7fc45401d010 comp rx=0 tx=0).stop 2024-04-23T18:29:34.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.177+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2905126692 shutdown_connections 2024-04-23T18:29:34.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.177+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/2905126692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4748570 0x55b7a474a960 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.177+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2905126692 >> 172.21.15.119:0/2905126692 conn(0x55b7a473e410 msgr2=0x55b7a4740830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.177+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2905126692 shutdown_connections 2024-04-23T18:29:34.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.177+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2905126692 wait complete. 2024-04-23T18:29:34.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.188+0000 7fc46c3a2800 1 Processor -- start 2024-04-23T18:29:34.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.188+0000 7fc46c3a2800 1 -- start start 2024-04-23T18:29:34.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.188+0000 7fc46c3a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744a60 0x55b7a48351d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.188+0000 7fc46c3a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b7a468f5b0 con 0x55b7a4744a60 2024-04-23T18:29:34.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.189+0000 7fc469ea8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744a60 0x55b7a48351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.189+0000 7fc469ea8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744a60 0x55b7a48351d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33492/0 (socket says 172.21.15.119:33492) 2024-04-23T18:29:34.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.189+0000 7fc469ea8640 1 -- 172.21.15.119:0/3848228913 learned_addr learned my addr 172.21.15.119:0/3848228913 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.189+0000 7fc469ea8640 1 -- 172.21.15.119:0/3848228913 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7a4605860 con 0x55b7a4744a60 2024-04-23T18:29:34.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.189+0000 7fc469ea8640 1 --2- 172.21.15.119:0/3848228913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744a60 0x55b7a48351d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc45c001d20 tx=0x7fc45c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e529c1889c24afc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.189+0000 7fc357e07640 1 -- 172.21.15.119:0/3848228913 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc45c00f400 con 0x55b7a4744a60 2024-04-23T18:29:34.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.190+0000 7fc357e07640 1 -- 172.21.15.119:0/3848228913 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc45c00f5a0 con 0x55b7a4744a60 2024-04-23T18:29:34.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.190+0000 7fc357e07640 1 -- 172.21.15.119:0/3848228913 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc45c00f7d0 con 0x55b7a4744a60 2024-04-23T18:29:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.190+0000 7fc46c3a2800 1 -- 172.21.15.119:0/3848228913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744a60 msgr2=0x55b7a48351d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.190+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/3848228913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744a60 0x55b7a48351d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc45c001d20 tx=0x7fc45c00b5b0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.190+0000 7fc46c3a2800 1 -- 172.21.15.119:0/3848228913 shutdown_connections 2024-04-23T18:29:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.190+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/3848228913 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744a60 0x55b7a48351d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.190+0000 7fc46c3a2800 1 -- 172.21.15.119:0/3848228913 >> 172.21.15.119:0/3848228913 conn(0x55b7a473e410 msgr2=0x55b7a4830af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.190+0000 7fc46c3a2800 1 -- 172.21.15.119:0/3848228913 shutdown_connections 2024-04-23T18:29:34.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.190+0000 7fc46c3a2800 1 -- 172.21.15.119:0/3848228913 wait complete. 2024-04-23T18:29:34.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.191+0000 7fc46c3a2800 1 Processor -- start 2024-04-23T18:29:34.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.191+0000 7fc46c3a2800 1 -- start start 2024-04-23T18:29:34.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.191+0000 7fc46c3a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744a60 0x55b7a483cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.191+0000 7fc46c3a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b7a474d1b0 con 0x55b7a4744a60 2024-04-23T18:29:34.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.191+0000 7fc469ea8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744a60 0x55b7a483cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.191+0000 7fc469ea8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744a60 0x55b7a483cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33504/0 (socket says 172.21.15.119:33504) 2024-04-23T18:29:34.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.191+0000 7fc469ea8640 1 -- 172.21.15.119:0/2954827862 learned_addr learned my addr 172.21.15.119:0/2954827862 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.191+0000 7fc469ea8640 1 -- 172.21.15.119:0/2954827862 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7a4603eb0 con 0x55b7a4744a60 2024-04-23T18:29:34.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.192+0000 7fc469ea8640 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744a60 0x55b7a483cba0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x55b7a4835f60 tx=0x7fc45c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.192+0000 7fc356604640 1 -- 172.21.15.119:0/2954827862 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc45c01a690 con 0x55b7a4744a60 2024-04-23T18:29:34.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.192+0000 7fc356604640 1 -- 172.21.15.119:0/2954827862 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc45c01a830 con 0x55b7a4744a60 2024-04-23T18:29:34.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.192+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7a483d0e0 con 0x55b7a4744a60 2024-04-23T18:29:34.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.192+0000 7fc356604640 1 -- 172.21.15.119:0/2954827862 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc45c01ab30 con 0x55b7a4744a60 2024-04-23T18:29:34.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.192+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7a483d660 con 0x55b7a4744a60 2024-04-23T18:29:34.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.192+0000 7fc356604640 1 -- 172.21.15.119:0/2954827862 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc45c017070 con 0x55b7a4744a60 2024-04-23T18:29:34.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.193+0000 7fc356604640 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc350036f00 0x7fc3500393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.193+0000 7fc356604640 1 -- 172.21.15.119:0/2954827862 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fc45c015020 con 0x55b7a4744a60 2024-04-23T18:29:34.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.193+0000 7fc4616a7640 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc350036f00 0x7fc3500393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.193+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b7a4748570 0x55b7a4843bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.193+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4844140 con 0x55b7a4748570 2024-04-23T18:29:34.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.193+0000 7fc46a6a9640 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b7a4748570 0x55b7a4843bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.193+0000 7fc4616a7640 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc350036f00 0x7fc3500393c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc454054000 tx=0x7fc45404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.193+0000 7fc46a6a9640 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b7a4748570 0x55b7a4843bc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.194+0000 7fc46a6a9640 1 -- 172.21.15.119:0/2954827862 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a4748570 2024-04-23T18:29:34.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.194+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4841190 con 0x55b7a4748570 2024-04-23T18:29:34.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.194+0000 7fc46a6a9640 1 -- 172.21.15.119:0/2954827862 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a4748570 2024-04-23T18:29:34.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.194+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b7a4846450 0x55b7a4848840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.194+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4848ee0 con 0x55b7a4846450 2024-04-23T18:29:34.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.194+0000 7fc469ea8640 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b7a4846450 0x55b7a4848840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.194+0000 7fc469ea8640 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b7a4846450 0x55b7a4848840 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.195+0000 7fc469ea8640 1 -- 172.21.15.119:0/2954827862 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a4846450 2024-04-23T18:29:34.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.195+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4845400 con 0x55b7a4748570 2024-04-23T18:29:34.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.195+0000 7fc46a6a9640 1 -- 172.21.15.119:0/2954827862 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a4748570 2024-04-23T18:29:34.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.195+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b7a484a390 0x55b7a484c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.195+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a484cf40 con 0x55b7a484a390 2024-04-23T18:29:34.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.195+0000 7fc4616a7640 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b7a484a390 0x55b7a484c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.196+0000 7fc4616a7640 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b7a484a390 0x55b7a484c7e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.196+0000 7fc4616a7640 1 -- 172.21.15.119:0/2954827862 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc45405a040 con 0x55b7a484a390 2024-04-23T18:29:34.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.196+0000 7fc46c3a2800 1 Processor -- start 2024-04-23T18:29:34.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.196+0000 7fc46c3a2800 1 -- start start 2024-04-23T18:29:34.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.196+0000 7fc46c3a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a485b3a0 0x55b7a485b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.196+0000 7fc46c3a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b7a4635df0 con 0x55b7a485b3a0 2024-04-23T18:29:34.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.197+0000 7fc469ea8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a485b3a0 0x55b7a485b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.197+0000 7fc469ea8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a485b3a0 0x55b7a485b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33516/0 (socket says 172.21.15.119:33516) 2024-04-23T18:29:34.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.197+0000 7fc469ea8640 1 -- 172.21.15.119:0/351947370 learned_addr learned my addr 172.21.15.119:0/351947370 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.197+0000 7fc469ea8640 1 -- 172.21.15.119:0/351947370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7a485bd00 con 0x55b7a485b3a0 2024-04-23T18:29:34.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.197+0000 7fc469ea8640 1 --2- 172.21.15.119:0/351947370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a485b3a0 0x55b7a485b7c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc45c04b860 tx=0x7fc45c017ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.197+0000 7fc34f7fe640 1 -- 172.21.15.119:0/351947370 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc45c04bb80 con 0x55b7a485b3a0 2024-04-23T18:29:34.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.197+0000 7fc34f7fe640 1 -- 172.21.15.119:0/351947370 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc45c04bd20 con 0x55b7a485b3a0 2024-04-23T18:29:34.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.197+0000 7fc46c3a2800 1 -- 172.21.15.119:0/351947370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7a485c770 con 0x55b7a485b3a0 2024-04-23T18:29:34.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.197+0000 7fc34f7fe640 1 -- 172.21.15.119:0/351947370 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc45c044ec0 con 0x55b7a485b3a0 2024-04-23T18:29:34.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.197+0000 7fc46c3a2800 1 -- 172.21.15.119:0/351947370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7a485c770 con 0x55b7a485b3a0 2024-04-23T18:29:34.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.198+0000 7fc34f7fe640 1 -- 172.21.15.119:0/351947370 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc45c00e070 con 0x55b7a485b3a0 2024-04-23T18:29:34.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.198+0000 7fc34f7fe640 1 --2- 172.21.15.119:0/351947370 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc344036eb0 0x7fc344039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.198+0000 7fc34f7fe640 1 -- 172.21.15.119:0/351947370 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fc45c04ee30 con 0x55b7a485b3a0 2024-04-23T18:29:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.198+0000 7fc4616a7640 1 --2- 172.21.15.119:0/351947370 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc344036eb0 0x7fc344039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.198+0000 7fc46c3a2800 1 Processor -- start 2024-04-23T18:29:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.198+0000 7fc46c3a2800 1 -- start start 2024-04-23T18:29:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.199+0000 7fc4616a7640 1 --2- 172.21.15.119:0/351947370 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc344036eb0 0x7fc344039370 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55b7a48410b0 tx=0x7fc454005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.199+0000 7fc46c3a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744050 0x55b7a4744470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.199+0000 7fc46c3a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b7a4835950 con 0x55b7a4744050 2024-04-23T18:29:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.199+0000 7fc469ea8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744050 0x55b7a4744470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.199+0000 7fc469ea8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744050 0x55b7a4744470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33528/0 (socket says 172.21.15.119:33528) 2024-04-23T18:29:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.199+0000 7fc469ea8640 1 -- 172.21.15.119:0/271695265 learned_addr learned my addr 172.21.15.119:0/271695265 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.199+0000 7fc469ea8640 1 -- 172.21.15.119:0/271695265 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7a4742850 con 0x55b7a4744050 2024-04-23T18:29:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.199+0000 7fc469ea8640 1 --2- 172.21.15.119:0/271695265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744050 0x55b7a4744470 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc45c01c760 tx=0x7fc45c031bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1dd5414ec2e833 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.199+0000 7fc34d7fa640 1 -- 172.21.15.119:0/271695265 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc45c060070 con 0x55b7a4744050 2024-04-23T18:29:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.199+0000 7fc34d7fa640 1 -- 172.21.15.119:0/271695265 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc45c01b720 con 0x55b7a4744050 2024-04-23T18:29:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.199+0000 7fc34d7fa640 1 -- 172.21.15.119:0/271695265 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc45c03f040 con 0x55b7a4744050 2024-04-23T18:29:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc46c3a2800 1 -- 172.21.15.119:0/271695265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744050 msgr2=0x55b7a4744470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/271695265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744050 0x55b7a4744470 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc45c01c760 tx=0x7fc45c031bd0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc46c3a2800 1 -- 172.21.15.119:0/271695265 shutdown_connections 2024-04-23T18:29:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/271695265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744050 0x55b7a4744470 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc46c3a2800 1 -- 172.21.15.119:0/271695265 >> 172.21.15.119:0/271695265 conn(0x55b7a4864670 msgr2=0x55b7a48626d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc46c3a2800 1 -- 172.21.15.119:0/271695265 shutdown_connections 2024-04-23T18:29:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc46c3a2800 1 -- 172.21.15.119:0/271695265 wait complete. 2024-04-23T18:29:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc46c3a2800 1 Processor -- start 2024-04-23T18:29:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc46c3a2800 1 -- start start 2024-04-23T18:29:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc46c3a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744050 0x55b7a4871930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc46c3a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b7a4742c60 con 0x55b7a4744050 2024-04-23T18:29:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc469ea8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744050 0x55b7a4871930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc469ea8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744050 0x55b7a4871930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33532/0 (socket says 172.21.15.119:33532) 2024-04-23T18:29:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.200+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 learned_addr learned my addr 172.21.15.119:0/1440350414 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.201+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7a4871e70 con 0x55b7a4744050 2024-04-23T18:29:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.201+0000 7fc469ea8640 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744050 0x55b7a4871930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc45c04a660 tx=0x7fc45c010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.201+0000 7fc33b7fe640 1 -- 172.21.15.119:0/1440350414 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc45c060030 con 0x55b7a4744050 2024-04-23T18:29:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.201+0000 7fc33b7fe640 1 -- 172.21.15.119:0/1440350414 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc45c027860 con 0x55b7a4744050 2024-04-23T18:29:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.201+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7a4871e70 con 0x55b7a4744050 2024-04-23T18:29:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.201+0000 7fc33b7fe640 1 -- 172.21.15.119:0/1440350414 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc45c03f050 con 0x55b7a4744050 2024-04-23T18:29:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.201+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7a4871e70 con 0x55b7a4744050 2024-04-23T18:29:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.202+0000 7fc33b7fe640 1 -- 172.21.15.119:0/1440350414 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc45c06e020 con 0x55b7a4744050 2024-04-23T18:29:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.202+0000 7fc33b7fe640 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc334036e60 0x7fc334039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.202+0000 7fc33b7fe640 1 -- 172.21.15.119:0/1440350414 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fc45c06c020 con 0x55b7a4744050 2024-04-23T18:29:34.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.202+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.202+0000 7fc4616a7640 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc334036e60 0x7fc334039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.202+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b7a487d020 0x55b7a487f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.202+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a487fc10 con 0x55b7a487d020 2024-04-23T18:29:34.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.202+0000 7fc46a6a9640 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b7a487d020 0x55b7a487f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc4616a7640 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc334036e60 0x7fc334039320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55b7a484d340 tx=0x7fc45404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46a6a9640 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b7a487d020 0x55b7a487f4c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a487d020 2024-04-23T18:29:34.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46c3a2800 20 realm 2024-04-23T18:29:34.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880020 con 0x55b7a487d020 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a487d020 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46c3a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48808c0 con 0x55b7a487d020 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a487d020 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.203+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a487d020 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.204+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a487d020 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.204+0000 7fc46c3a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.204+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.204+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b7a48819c0 0x55b7a4883db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.204+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48842f0 con 0x55b7a48819c0 2024-04-23T18:29:34.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.204+0000 7fc469ea8640 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b7a48819c0 0x55b7a4883db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.204+0000 7fc469ea8640 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b7a48819c0 0x55b7a4883db0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.204+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.204+0000 7fc46c3a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:34.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.204+0000 7fc46c3a2800 20 searching for the correct realm 2024-04-23T18:29:34.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.204+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b7a4886370 0x55b7a4888830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.204+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4888f00 con 0x55b7a4886370 2024-04-23T18:29:34.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.204+0000 7fc4616a7640 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b7a4886370 0x55b7a4888830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.205+0000 7fc4616a7640 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b7a4886370 0x55b7a4888830 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.205+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.205+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4888f00 con 0x55b7a48819c0 2024-04-23T18:29:34.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.205+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.205+0000 7fc469ea8640 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc45c03d640 0x7fc45c05b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.205+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4888f00 con 0x7fc45c03d640 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.206+0000 7fc46a6a9640 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc45c03d640 0x7fc45c05b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.206+0000 7fc46a6a9640 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc45c03d640 0x7fc45c05b410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.206+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc46400a4a0 con 0x7fc45c03d640 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.206+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a487d020 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.206+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a487d020 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.206+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a487d020 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.207+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a487d020 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.207+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x7fc45c03d640 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.207+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc46400a4a0 con 0x7fc45c03d640 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.207+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x7fc45c03d640 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.207+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc46400a4a0 con 0x7fc45c03d640 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.207+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a48819c0 2024-04-23T18:29:34.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.207+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.207+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a4886370 2024-04-23T18:29:34.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.208+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.208+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a487d020 2024-04-23T18:29:34.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.208+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a487d020 2024-04-23T18:29:34.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.208+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x7fc45c03d640 2024-04-23T18:29:34.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.208+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc46400a4a0 con 0x7fc45c03d640 2024-04-23T18:29:34.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.208+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a487d020 2024-04-23T18:29:34.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.208+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a487d020 2024-04-23T18:29:34.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.208+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a48819c0 2024-04-23T18:29:34.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.209+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.209+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a4886370 2024-04-23T18:29:34.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.209+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.209+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a4886370 2024-04-23T18:29:34.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.209+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.209+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x7fc45c03d640 2024-04-23T18:29:34.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.209+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc46400a4a0 con 0x7fc45c03d640 2024-04-23T18:29:34.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.209+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a4886370 2024-04-23T18:29:34.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.210+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.210+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a4886370 2024-04-23T18:29:34.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.210+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.210+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a487d020 2024-04-23T18:29:34.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.210+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a487d020 2024-04-23T18:29:34.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.210+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a487d020 2024-04-23T18:29:34.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.210+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a487d020 2024-04-23T18:29:34.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.210+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x7fc45c03d640 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.211+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc46400a4a0 con 0x7fc45c03d640 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.211+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a4886370 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.211+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.211+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a48819c0 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.211+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.211+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a487d020 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.211+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc46400a4a0 con 0x55b7a487d020 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.211+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x7fc45c03d640 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.212+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc46400a4a0 con 0x7fc45c03d640 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.212+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a4886370 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.212+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.212+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x7fc45c03d640 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.212+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc46400a4a0 con 0x7fc45c03d640 2024-04-23T18:29:34.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.212+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a48819c0 2024-04-23T18:29:34.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.212+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.212+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a4886370 2024-04-23T18:29:34.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x7fc45c03d640 2024-04-23T18:29:34.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a487d020 2024-04-23T18:29:34.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4880c60 con 0x55b7a48819c0 2024-04-23T18:29:34.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc46c3a2800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:34.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc46c3a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:34.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc46c3a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:34.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc46c3a2800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:34.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc46c3a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:34.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc46c3a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:34.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.213+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4884c70 con 0x55b7a487d020 2024-04-23T18:29:34.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4884c70 con 0x55b7a487d020 2024-04-23T18:29:34.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:34.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4884c70 con 0x7fc45c03d640 2024-04-23T18:29:34.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:34.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 20 zone default found 2024-04-23T18:29:34.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 4 Realm: () 2024-04-23T18:29:34.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:34.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:34.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:34.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 20 zonegroup default 2024-04-23T18:29:34.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4885060 con 0x7fc45c03d640 2024-04-23T18:29:34.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.214+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48854a0 con 0x55b7a4886370 2024-04-23T18:29:34.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.215+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.215+0000 7fc46c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.215+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.215+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488ad60 con 0x55b7a4886370 2024-04-23T18:29:34.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.215+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.215+0000 7fc46c3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.215+0000 7fc46c3a2800 20 started sync module instance, tier type = 2024-04-23T18:29:34.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.215+0000 7fc46c3a2800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:34.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.215+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488a200 con 0x55b7a48819c0 2024-04-23T18:29:34.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.216+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.216+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94247227792720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488b100 con 0x55b7a48819c0 2024-04-23T18:29:34.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.216+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488b950 con 0x55b7a487d020 2024-04-23T18:29:34.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.217+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94247227792720] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.217+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.217+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94247227797760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488b9d0 con 0x55b7a487d020 2024-04-23T18:29:34.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.217+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488c220 con 0x55b7a4886370 2024-04-23T18:29:34.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.218+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.218+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94247227800528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488cac0 con 0x55b7a4886370 2024-04-23T18:29:34.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.218+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488d570 con 0x55b7a48819c0 2024-04-23T18:29:34.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.218+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94247227797760] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.219+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94247227800528] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.219+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.219+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94247227803152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488d080 con 0x55b7a48819c0 2024-04-23T18:29:34.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.219+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488de40 con 0x55b7a487d020 2024-04-23T18:29:34.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.220+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94247227803152] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.220+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.220+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94247227798816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488de40 con 0x55b7a487d020 2024-04-23T18:29:34.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.220+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488e800 con 0x7fc45c03d640 2024-04-23T18:29:34.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.221+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.221+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94247227810640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488e770 con 0x7fc45c03d640 2024-04-23T18:29:34.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.221+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488f780 con 0x7fc45c03d640 2024-04-23T18:29:34.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.221+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94247227798816] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.222+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94247227810640] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.222+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.222+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94247227814544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488f780 con 0x7fc45c03d640 2024-04-23T18:29:34.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.222+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488f780 con 0x7fc45c03d640 2024-04-23T18:29:34.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.223+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94247227814544] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.223+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.223+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94247227808144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a488fc30 con 0x7fc45c03d640 2024-04-23T18:29:34.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.223+0000 7fc46c3a2800 20 add_watcher() i=0 2024-04-23T18:29:34.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.223+0000 7fc46c3a2800 20 add_watcher() i=1 2024-04-23T18:29:34.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.223+0000 7fc46c3a2800 20 add_watcher() i=2 2024-04-23T18:29:34.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.223+0000 7fc46c3a2800 20 add_watcher() i=3 2024-04-23T18:29:34.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.223+0000 7fc46c3a2800 20 add_watcher() i=4 2024-04-23T18:29:34.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.223+0000 7fc46c3a2800 20 add_watcher() i=5 2024-04-23T18:29:34.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.223+0000 7fc46c3a2800 20 add_watcher() i=6 2024-04-23T18:29:34.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.224+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94247227808144] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.224+0000 7fc46c3a2800 20 add_watcher() i=7 2024-04-23T18:29:34.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.224+0000 7fc46c3a2800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:34.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.224+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a4893030 con 0x55b7a487d020 2024-04-23T18:29:34.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.225+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.225+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94247227816272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48904e0 con 0x55b7a487d020 2024-04-23T18:29:34.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.226+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94247227816272] v32'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.226+0000 7fc31b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:34.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.226+0000 7fc46c3a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:34.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.226+0000 7fc46c3a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:34.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.226+0000 7fc46c3a2800 5 note: GC not initialized 2024-04-23T18:29:34.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.226+0000 7fc31a7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:34.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.226+0000 7fc46c3a2800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:34.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.226+0000 7fc46c3a2800 20 Filter name: none 2024-04-23T18:29:34.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.226+0000 7fc28bfff640 20 reqs_thread_entry: start 2024-04-23T18:29:34.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.226+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.226+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48c6370 con 0x55b7a487d020 2024-04-23T18:29:34.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.227+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.227+0000 7fc46c3a2800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:34.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.227+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.227+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48c6d60 con 0x55b7a487d020 2024-04-23T18:29:34.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.227+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.227+0000 7fc46c3a2800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:34.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.227+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48c7d70 con 0x55b7a48819c0 2024-04-23T18:29:34.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.227+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.227+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.227+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48c54c0 con 0x55b7a48819c0 2024-04-23T18:29:34.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:34.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48c7d70 con 0x55b7a4886370 2024-04-23T18:29:34.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(66 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:34.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-23T18:29:34.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 4.3e 4:7dbf76af:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48c7800 con 0x55b7a48819c0 2024-04-23T18:29:34.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 4.1 4:81f4b350:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48cc950 con 0x55b7a48819c0 2024-04-23T18:29:34.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 4.11 4:891fea53:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48cf530 con 0x7fc45c03d640 2024-04-23T18:29:34.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 4.21 4:842d5f4d:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48d1e90 con 0x7fc45c03d640 2024-04-23T18:29:34.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 4.25 4:a75c3a3c:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48d4790 con 0x55b7a4886370 2024-04-23T18:29:34.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:72 4.14 4:28337734:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48d73e0 con 0x55b7a4886370 2024-04-23T18:29:34.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 4.1c 4:39198531:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48d9da0 con 0x7fc45c03d640 2024-04-23T18:29:34.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 4.1c 4:3a706890:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48dc270 con 0x7fc45c03d640 2024-04-23T18:29:34.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:75 4.0 4:03724c23:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48dea20 con 0x55b7a4886370 2024-04-23T18:29:34.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:76 4.3d 4:bc4cc370:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48e18f0 con 0x55b7a4886370 2024-04-23T18:29:34.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 4.1e 4:7a26d6dd:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48e4400 con 0x7fc45c03d640 2024-04-23T18:29:34.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.228+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.229+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(68 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.229+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(69 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.229+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(70 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.229+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(71 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.229+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(72 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.229+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(73 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.229+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(77 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.229+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(76 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.229+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(75 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.229+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(74 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.230+0000 7fc31b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:34.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.230+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94247227816272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48aeca0 con 0x55b7a487d020 2024-04-23T18:29:34.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.231+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94247227816272] v32'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.231+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94247227792720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48aeca0 con 0x55b7a48819c0 2024-04-23T18:29:34.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.232+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94247227792720] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.232+0000 7fc46c3a2800 20 remove_watcher() i=0 2024-04-23T18:29:34.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.232+0000 7fc46c3a2800 2 removed watcher, disabling cache 2024-04-23T18:29:34.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.232+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94247227797760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48aeca0 con 0x55b7a487d020 2024-04-23T18:29:34.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.232+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94247227797760] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.233+0000 7fc46c3a2800 20 remove_watcher() i=1 2024-04-23T18:29:34.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.233+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94247227800528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48aeca0 con 0x55b7a4886370 2024-04-23T18:29:34.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.233+0000 7fc4616a7640 1 -- 172.21.15.119:0/1440350414 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94247227800528] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc45407f070 con 0x55b7a4886370 2024-04-23T18:29:34.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.233+0000 7fc46c3a2800 20 remove_watcher() i=2 2024-04-23T18:29:34.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.234+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94247227803152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48aeca0 con 0x55b7a48819c0 2024-04-23T18:29:34.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.234+0000 7fc469ea8640 1 -- 172.21.15.119:0/1440350414 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94247227803152] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc45c02e070 con 0x55b7a48819c0 2024-04-23T18:29:34.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.234+0000 7fc46c3a2800 20 remove_watcher() i=3 2024-04-23T18:29:34.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.234+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94247227798816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48aeca0 con 0x55b7a487d020 2024-04-23T18:29:34.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.235+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94247227798816] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x55b7a487d020 2024-04-23T18:29:34.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.235+0000 7fc46c3a2800 20 remove_watcher() i=4 2024-04-23T18:29:34.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.235+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94247227810640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48aeca0 con 0x7fc45c03d640 2024-04-23T18:29:34.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.237+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94247227810640] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.237+0000 7fc46c3a2800 20 remove_watcher() i=5 2024-04-23T18:29:34.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.237+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94247227814544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48aeca0 con 0x7fc45c03d640 2024-04-23T18:29:34.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.237+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94247227814544] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.237+0000 7fc46c3a2800 20 remove_watcher() i=6 2024-04-23T18:29:34.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.237+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94247227808144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7a48aeca0 con 0x7fc45c03d640 2024-04-23T18:29:34.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.238+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94247227808144] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc464040040 con 0x7fc45c03d640 2024-04-23T18:29:34.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.238+0000 7fc46c3a2800 20 remove_watcher() i=7 2024-04-23T18:29:34.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.238+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc45c03d640 msgr2=0x7fc45c05b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.238+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc45c03d640 0x7fc45c05b410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b7a487d020 msgr2=0x55b7a487f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b7a487d020 0x55b7a487f4c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b7a48819c0 msgr2=0x55b7a4883db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b7a48819c0 0x55b7a4883db0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b7a4886370 msgr2=0x55b7a4888830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b7a4886370 0x55b7a4888830 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc334036e60 msgr2=0x7fc334039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc334036e60 0x7fc334039320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55b7a484d340 tx=0x7fc45404f000 comp rx=0 tx=0).stop 2024-04-23T18:29:34.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744050 msgr2=0x55b7a4871930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/1440350414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744050 0x55b7a4871930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc45c04a660 tx=0x7fc45c010f40 comp rx=0 tx=0).stop 2024-04-23T18:29:34.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 reap_dead start 2024-04-23T18:29:34.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46a6a9640 1 -- 172.21.15.119:0/1440350414 reap_dead start 2024-04-23T18:29:34.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 shutdown_connections 2024-04-23T18:29:34.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 >> 172.21.15.119:0/1440350414 conn(0x55b7a4864670 msgr2=0x55b7a4861cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 shutdown_connections 2024-04-23T18:29:34.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/1440350414 wait complete. 2024-04-23T18:29:34.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/351947370 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc344036eb0 msgr2=0x7fc344039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/351947370 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc344036eb0 0x7fc344039370 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55b7a48410b0 tx=0x7fc454005ac0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/351947370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a485b3a0 msgr2=0x55b7a485b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/351947370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a485b3a0 0x55b7a485b7c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc45c04b860 tx=0x7fc45c017ab0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/351947370 shutdown_connections 2024-04-23T18:29:34.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/351947370 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc344036eb0 0x7fc344039370 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/351947370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a485b3a0 0x55b7a485b7c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/351947370 >> 172.21.15.119:0/351947370 conn(0x55b7a484f440 msgr2=0x55b7a484f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/351947370 shutdown_connections 2024-04-23T18:29:34.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/351947370 wait complete. 2024-04-23T18:29:34.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b7a484a390 msgr2=0x55b7a484c7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b7a484a390 0x55b7a484c7e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b7a4748570 msgr2=0x55b7a4843bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b7a4748570 0x55b7a4843bc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b7a4846450 msgr2=0x55b7a4848840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.239+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b7a4846450 0x55b7a4848840 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.240+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc350036f00 msgr2=0x7fc3500393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.240+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc350036f00 0x7fc3500393c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc454054000 tx=0x7fc45404e000 comp rx=0 tx=0).stop 2024-04-23T18:29:34.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.240+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744a60 msgr2=0x55b7a483cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.240+0000 7fc46c3a2800 1 --2- 172.21.15.119:0/2954827862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b7a4744a60 0x55b7a483cba0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x55b7a4835f60 tx=0x7fc45c000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.240+0000 7fc46a6a9640 1 -- 172.21.15.119:0/2954827862 reap_dead start 2024-04-23T18:29:34.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.240+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 shutdown_connections 2024-04-23T18:29:34.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.240+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 >> 172.21.15.119:0/2954827862 conn(0x55b7a473e410 msgr2=0x55b7a482f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.240+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 shutdown_connections 2024-04-23T18:29:34.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.240+0000 7fc46c3a2800 1 -- 172.21.15.119:0/2954827862 wait complete. 2024-04-23T18:29:34.255 INFO:teuthology.orchestra.run.smithi119.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"4f165054-0d30-4e3c-af82-245e56f34813","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1","marker":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-23T18:29:33.452606Z","creation_time":"2024-04-23T18:29:33.450324Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-04-23T18:29:34.255 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4f165054-0d30-4e3c-af82-245e56f34813', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1', 'marker': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-23T18:29:33.452606Z', 'creation_time': '2024-04-23T18:29:33.450324Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-23T18:29:34.261 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-23T18:29:34.261 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-23T18:29:34.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-23T18:29:34.261 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-23T18:29:34.338 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:34.338 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:34.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.346+0000 7fa4d3230800 1 Processor -- start 2024-04-23T18:29:34.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.346+0000 7fa4d3230800 1 -- start start 2024-04-23T18:29:34.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.347+0000 7fa4d3230800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56452debc3a0 0x56452debe790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.347+0000 7fa4d3230800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56452dd68560 con 0x56452deb7f60 2024-04-23T18:29:34.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.347+0000 7fa4d3230800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x56452dd59e20 con 0x56452debc3a0 2024-04-23T18:29:34.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.347+0000 7fa4c7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56452debc3a0 0x56452debe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.347+0000 7fa4ce48b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x56452deb7f60 0x56452deb8380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40748/0 (socket says 172.21.15.119:40748) 2024-04-23T18:29:34.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.347+0000 7fa4c7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56452debc3a0 0x56452debe790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33534/0 (socket says 172.21.15.119:33534) 2024-04-23T18:29:34.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.347+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1188160929 learned_addr learned my addr 172.21.15.119:0/1188160929 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:34.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.347+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1188160929 >> v1:172.21.15.62:6789/0 conn(0x56452deb7f60 legacy=0x56452deb8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.347+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1188160929 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452dd67e60 con 0x56452debc3a0 2024-04-23T18:29:34.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.349+0000 7fa4c7fff640 1 --2- 172.21.15.119:0/1188160929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452debc3a0 0x56452debe790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800a470 tx=0x7fa4b801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78551f3157931c7c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.349+0000 7fa4cdc8a640 1 -- 172.21.15.119:0/1188160929 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4b8057070 con 0x56452debc3a0 2024-04-23T18:29:34.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.349+0000 7fa4cdc8a640 1 -- 172.21.15.119:0/1188160929 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b8052570 con 0x56452debc3a0 2024-04-23T18:29:34.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.349+0000 7fa4cdc8a640 1 -- 172.21.15.119:0/1188160929 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4b8052870 con 0x56452debc3a0 2024-04-23T18:29:34.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.350+0000 7fa4d3230800 1 -- 172.21.15.119:0/1188160929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452debc3a0 msgr2=0x56452debe790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.350+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1188160929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452debc3a0 0x56452debe790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800a470 tx=0x7fa4b801ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:34.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.350+0000 7fa4d3230800 1 -- 172.21.15.119:0/1188160929 shutdown_connections 2024-04-23T18:29:34.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.350+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1188160929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452debc3a0 0x56452debe790 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.350+0000 7fa4d3230800 1 -- 172.21.15.119:0/1188160929 >> 172.21.15.119:0/1188160929 conn(0x56452deb3540 msgr2=0x56452deb5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.350+0000 7fa4d3230800 1 -- 172.21.15.119:0/1188160929 shutdown_connections 2024-04-23T18:29:34.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.350+0000 7fa4d3230800 1 -- 172.21.15.119:0/1188160929 wait complete. 2024-04-23T18:29:34.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.361+0000 7fa4d3230800 1 Processor -- start 2024-04-23T18:29:34.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.362+0000 7fa4d3230800 1 -- start start 2024-04-23T18:29:34.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.362+0000 7fa4d3230800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452deb7f60 0x56452dfa9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.362+0000 7fa4d3230800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56452de035b0 con 0x56452deb7f60 2024-04-23T18:29:34.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.362+0000 7fa4ce48b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452deb7f60 0x56452dfa9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.362+0000 7fa4ce48b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452deb7f60 0x56452dfa9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33550/0 (socket says 172.21.15.119:33550) 2024-04-23T18:29:34.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.362+0000 7fa4ce48b640 1 -- 172.21.15.119:0/3862396215 learned_addr learned my addr 172.21.15.119:0/3862396215 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.362+0000 7fa4ce48b640 1 -- 172.21.15.119:0/3862396215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452dd79860 con 0x56452deb7f60 2024-04-23T18:29:34.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.362+0000 7fa4ce48b640 1 --2- 172.21.15.119:0/3862396215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452deb7f60 0x56452dfa9180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0001e10 tx=0x7fa4c000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761e8c8c46c24785 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.362+0000 7fa3bc608640 1 -- 172.21.15.119:0/3862396215 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c0012020 con 0x56452deb7f60 2024-04-23T18:29:34.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.363+0000 7fa3bc608640 1 -- 172.21.15.119:0/3862396215 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c000e5a0 con 0x56452deb7f60 2024-04-23T18:29:34.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.363+0000 7fa3bc608640 1 -- 172.21.15.119:0/3862396215 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c000e8e0 con 0x56452deb7f60 2024-04-23T18:29:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.363+0000 7fa4d3230800 1 -- 172.21.15.119:0/3862396215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452deb7f60 msgr2=0x56452dfa9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.363+0000 7fa4d3230800 1 --2- 172.21.15.119:0/3862396215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452deb7f60 0x56452dfa9180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0001e10 tx=0x7fa4c000b780 comp rx=0 tx=0).stop 2024-04-23T18:29:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.363+0000 7fa4d3230800 1 -- 172.21.15.119:0/3862396215 shutdown_connections 2024-04-23T18:29:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.363+0000 7fa4d3230800 1 --2- 172.21.15.119:0/3862396215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452deb7f60 0x56452dfa9180 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.363+0000 7fa4d3230800 1 -- 172.21.15.119:0/3862396215 >> 172.21.15.119:0/3862396215 conn(0x56452deb3540 msgr2=0x56452dfa4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.363+0000 7fa4d3230800 1 -- 172.21.15.119:0/3862396215 shutdown_connections 2024-04-23T18:29:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.363+0000 7fa4d3230800 1 -- 172.21.15.119:0/3862396215 wait complete. 2024-04-23T18:29:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.363+0000 7fa4d3230800 1 Processor -- start 2024-04-23T18:29:34.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.364+0000 7fa4d3230800 1 -- start start 2024-04-23T18:29:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.364+0000 7fa4d3230800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452deb7f60 0x56452de2d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.364+0000 7fa4d3230800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56452debf060 con 0x56452deb7f60 2024-04-23T18:29:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.364+0000 7fa4ce48b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452deb7f60 0x56452de2d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.364+0000 7fa4ce48b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452deb7f60 0x56452de2d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33558/0 (socket says 172.21.15.119:33558) 2024-04-23T18:29:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.364+0000 7fa4ce48b640 1 -- 172.21.15.119:0/2460741382 learned_addr learned my addr 172.21.15.119:0/2460741382 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.364+0000 7fa4ce48b640 1 -- 172.21.15.119:0/2460741382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452dd77eb0 con 0x56452deb7f60 2024-04-23T18:29:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.364+0000 7fa4ce48b640 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452deb7f60 0x56452de2d810 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000b7c0 tx=0x7fa4c0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.364+0000 7fa3bae05640 1 -- 172.21.15.119:0/2460741382 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c0012030 con 0x56452deb7f60 2024-04-23T18:29:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.364+0000 7fa3bae05640 1 -- 172.21.15.119:0/2460741382 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c0001470 con 0x56452deb7f60 2024-04-23T18:29:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.364+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56452de2bf00 con 0x56452deb7f60 2024-04-23T18:29:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.364+0000 7fa3bae05640 1 -- 172.21.15.119:0/2460741382 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c001a8d0 con 0x56452deb7f60 2024-04-23T18:29:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.365+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56452de2c420 con 0x56452deb7f60 2024-04-23T18:29:34.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.366+0000 7fa3bae05640 1 -- 172.21.15.119:0/2460741382 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa4c0015020 con 0x56452deb7f60 2024-04-23T18:29:34.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.366+0000 7fa3bae05640 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa3b4036eb0 0x7fa3b4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.366+0000 7fa3bae05640 1 -- 172.21.15.119:0/2460741382 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fa4c0020030 con 0x56452deb7f60 2024-04-23T18:29:34.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.366+0000 7fa4c7fff640 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa3b4036eb0 0x7fa3b4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.366+0000 7fa4d3230800 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56452debc3a0 0x56452dfb9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.366+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dfba420 con 0x56452debc3a0 2024-04-23T18:29:34.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.366+0000 7fa4cec8c640 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56452debc3a0 0x56452dfb9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.366+0000 7fa4c7fff640 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa3b4036eb0 0x7fa3b4039370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8054000 tx=0x7fa4b804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.366+0000 7fa4cec8c640 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56452debc3a0 0x56452dfb9ee0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.367+0000 7fa4cec8c640 1 -- 172.21.15.119:0/2460741382 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452debc3a0 2024-04-23T18:29:34.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.367+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dfbac70 con 0x56452debc3a0 2024-04-23T18:29:34.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.367+0000 7fa4cec8c640 1 -- 172.21.15.119:0/2460741382 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452debc3a0 2024-04-23T18:29:34.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.367+0000 7fa4d3230800 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56452dfbc6a0 0x56452dfbead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.367+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dfbf260 con 0x56452dfbc6a0 2024-04-23T18:29:34.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.367+0000 7fa4ce48b640 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56452dfbc6a0 0x56452dfbead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.367+0000 7fa4ce48b640 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56452dfbc6a0 0x56452dfbead0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.368+0000 7fa4ce48b640 1 -- 172.21.15.119:0/2460741382 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa4c0026d90 con 0x56452dfbc6a0 2024-04-23T18:29:34.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.368+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dfbb4c0 con 0x56452debc3a0 2024-04-23T18:29:34.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.368+0000 7fa4cec8c640 1 -- 172.21.15.119:0/2460741382 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452debc3a0 2024-04-23T18:29:34.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.368+0000 7fa4d3230800 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56452dfc06c0 0x56452dfc2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.368+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dfc3290 con 0x56452dfc06c0 2024-04-23T18:29:34.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.368+0000 7fa4c7fff640 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56452dfc06c0 0x56452dfc2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.368+0000 7fa4c7fff640 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56452dfc06c0 0x56452dfc2b30 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.369+0000 7fa4c7fff640 1 -- 172.21.15.119:0/2460741382 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa4b8052a40 con 0x56452dfc06c0 2024-04-23T18:29:34.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.369+0000 7fa4d3230800 1 Processor -- start 2024-04-23T18:29:34.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.369+0000 7fa4d3230800 1 -- start start 2024-04-23T18:29:34.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.369+0000 7fa4d3230800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfd16b0 0x56452dfd1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.369+0000 7fa4d3230800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56452de2dd50 con 0x56452dfd16b0 2024-04-23T18:29:34.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.369+0000 7fa4ce48b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfd16b0 0x56452dfd1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.369+0000 7fa4ce48b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfd16b0 0x56452dfd1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33568/0 (socket says 172.21.15.119:33568) 2024-04-23T18:29:34.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.369+0000 7fa4ce48b640 1 -- 172.21.15.119:0/2638630591 learned_addr learned my addr 172.21.15.119:0/2638630591 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.370+0000 7fa4ce48b640 1 -- 172.21.15.119:0/2638630591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452dfd2010 con 0x56452dfd16b0 2024-04-23T18:29:34.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.370+0000 7fa4ce48b640 1 --2- 172.21.15.119:0/2638630591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfd16b0 0x56452dfd1ad0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0016570 tx=0x7fa4c000db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.370+0000 7fa3b3fff640 1 -- 172.21.15.119:0/2638630591 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c001ae60 con 0x56452dfd16b0 2024-04-23T18:29:34.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.370+0000 7fa3b3fff640 1 -- 172.21.15.119:0/2638630591 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c000d510 con 0x56452dfd16b0 2024-04-23T18:29:34.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.370+0000 7fa4d3230800 1 -- 172.21.15.119:0/2638630591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56452dfd2a80 con 0x56452dfd16b0 2024-04-23T18:29:34.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.370+0000 7fa3b3fff640 1 -- 172.21.15.119:0/2638630591 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c00449a0 con 0x56452dfd16b0 2024-04-23T18:29:34.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.370+0000 7fa4d3230800 1 -- 172.21.15.119:0/2638630591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56452dfd2a80 con 0x56452dfd16b0 2024-04-23T18:29:34.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.371+0000 7fa3b3fff640 1 -- 172.21.15.119:0/2638630591 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa4c003e060 con 0x56452dfd16b0 2024-04-23T18:29:34.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.371+0000 7fa3b3fff640 1 --2- 172.21.15.119:0/2638630591 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa3a8036eb0 0x7fa3a8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.371+0000 7fa3b3fff640 1 -- 172.21.15.119:0/2638630591 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fa4c0038c70 con 0x56452dfd16b0 2024-04-23T18:29:34.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.371+0000 7fa4c7fff640 1 --2- 172.21.15.119:0/2638630591 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa3a8036eb0 0x7fa3a8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.371+0000 7fa4d3230800 1 Processor -- start 2024-04-23T18:29:34.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.371+0000 7fa4c7fff640 1 --2- 172.21.15.119:0/2638630591 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa3a8036eb0 0x7fa3a8039370 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x56452de2c860 tx=0x7fa4b8005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.371+0000 7fa4d3230800 1 -- start start 2024-04-23T18:29:34.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.371+0000 7fa4d3230800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 0x56452dfdea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.371+0000 7fa4d3230800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56452dda9df0 con 0x56452dfde650 2024-04-23T18:29:34.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.372+0000 7fa4ce48b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 0x56452dfdea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.372+0000 7fa4ce48b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 0x56452dfdea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33570/0 (socket says 172.21.15.119:33570) 2024-04-23T18:29:34.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.372+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1239073779 learned_addr learned my addr 172.21.15.119:0/1239073779 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.372+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1239073779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452dfdf040 con 0x56452dfde650 2024-04-23T18:29:34.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.372+0000 7fa4ce48b640 1 --2- 172.21.15.119:0/1239073779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 0x56452dfdea70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa4c004bfd0 tx=0x7fa4c00083e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc0122978d1d1d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.372+0000 7fa3b1ffb640 1 -- 172.21.15.119:0/1239073779 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c003f4d0 con 0x56452dfde650 2024-04-23T18:29:34.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.372+0000 7fa3b1ffb640 1 -- 172.21.15.119:0/1239073779 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c00165e0 con 0x56452dfde650 2024-04-23T18:29:34.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.372+0000 7fa3b1ffb640 1 -- 172.21.15.119:0/1239073779 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c00363e0 con 0x56452dfde650 2024-04-23T18:29:34.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4d3230800 1 -- 172.21.15.119:0/1239073779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 msgr2=0x56452dfdea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1239073779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 0x56452dfdea70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa4c004bfd0 tx=0x7fa4c00083e0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4d3230800 1 -- 172.21.15.119:0/1239073779 shutdown_connections 2024-04-23T18:29:34.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1239073779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 0x56452dfdea70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4d3230800 1 -- 172.21.15.119:0/1239073779 >> 172.21.15.119:0/1239073779 conn(0x56452dfda920 msgr2=0x56452dfd8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4d3230800 1 -- 172.21.15.119:0/1239073779 shutdown_connections 2024-04-23T18:29:34.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4d3230800 1 -- 172.21.15.119:0/1239073779 wait complete. 2024-04-23T18:29:34.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4d3230800 1 Processor -- start 2024-04-23T18:29:34.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4d3230800 1 -- start start 2024-04-23T18:29:34.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4d3230800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 0x56452dfe58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4d3230800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56452dfdf590 con 0x56452dfde650 2024-04-23T18:29:34.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4ce48b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 0x56452dfe58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4ce48b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 0x56452dfe58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33576/0 (socket says 172.21.15.119:33576) 2024-04-23T18:29:34.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.373+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 learned_addr learned my addr 172.21.15.119:0/1488321824 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.374+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452dfe5e10 con 0x56452dfde650 2024-04-23T18:29:34.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.374+0000 7fa4ce48b640 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 0x56452dfe58d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0008420 tx=0x7fa4c0039e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.374+0000 7fa39ffff640 1 -- 172.21.15.119:0/1488321824 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c0036970 con 0x56452dfde650 2024-04-23T18:29:34.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.374+0000 7fa39ffff640 1 -- 172.21.15.119:0/1488321824 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c0068030 con 0x56452dfde650 2024-04-23T18:29:34.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.374+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56452dfe5e10 con 0x56452dfde650 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.374+0000 7fa39ffff640 1 -- 172.21.15.119:0/1488321824 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c003d9e0 con 0x56452dfde650 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.374+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56452dfe5e10 con 0x56452dfde650 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.375+0000 7fa39ffff640 1 -- 172.21.15.119:0/1488321824 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa4c005f040 con 0x56452dfde650 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.375+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.375+0000 7fa39ffff640 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa398036e60 0x7fa398039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.375+0000 7fa39ffff640 1 -- 172.21.15.119:0/1488321824 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fa4c006ec60 con 0x56452dfde650 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.375+0000 7fa4c7fff640 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa398036e60 0x7fa398039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.375+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56452dff1010 0x56452dff34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.375+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dff3c00 con 0x56452dff1010 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.375+0000 7fa4cec8c640 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56452dff1010 0x56452dff34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4c7fff640 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa398036e60 0x7fa398039320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8052fd0 tx=0x7fa4b804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4cec8c640 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56452dff1010 0x56452dff34b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452dff1010 2024-04-23T18:29:34.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4d3230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4d3230800 20 realm 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4010 con 0x56452dff1010 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452dff1010 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4d3230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4d3230800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dff48b0 con 0x56452dff1010 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452dff1010 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4d3230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff1010 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452dff1010 2024-04-23T18:29:34.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4d3230800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.376+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.377+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56452dff59b0 0x56452dff7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.377+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dff8320 con 0x56452dff59b0 2024-04-23T18:29:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.377+0000 7fa4ce48b640 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56452dff59b0 0x56452dff7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.377+0000 7fa4ce48b640 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56452dff59b0 0x56452dff7da0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.377+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa4c0074070 con 0x56452dff59b0 2024-04-23T18:29:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.377+0000 7fa4d3230800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.377+0000 7fa4d3230800 20 searching for the correct realm 2024-04-23T18:29:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.377+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56452dffa390 0x56452dffc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.377+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dffcf20 con 0x56452dffa390 2024-04-23T18:29:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.377+0000 7fa4c7fff640 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56452dffa390 0x56452dffc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.378+0000 7fa4c7fff640 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56452dffa390 0x56452dffc850 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.378+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.378+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dffcf20 con 0x56452dff59b0 2024-04-23T18:29:34.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.378+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c0074070 con 0x56452dff59b0 2024-04-23T18:29:34.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.378+0000 7fa4ce48b640 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa4c003d2c0 0x7fa4c0043530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.378+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dffcf20 con 0x7fa4c003d2c0 2024-04-23T18:29:34.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.378+0000 7fa4cec8c640 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa4c003d2c0 0x7fa4c0043530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.379+0000 7fa4cec8c640 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa4c003d2c0 0x7fa4c0043530 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.379+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c800a4a0 con 0x7fa4c003d2c0 2024-04-23T18:29:34.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.379+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff1010 2024-04-23T18:29:34.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.379+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452dff1010 2024-04-23T18:29:34.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.379+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff1010 2024-04-23T18:29:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.379+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452dff1010 2024-04-23T18:29:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.379+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x7fa4c003d2c0 2024-04-23T18:29:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.380+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c800a4a0 con 0x7fa4c003d2c0 2024-04-23T18:29:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.380+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x7fa4c003d2c0 2024-04-23T18:29:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.380+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa4c800a4a0 con 0x7fa4c003d2c0 2024-04-23T18:29:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.380+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff59b0 2024-04-23T18:29:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.380+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c0074070 con 0x56452dff59b0 2024-04-23T18:29:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.380+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dffa390 2024-04-23T18:29:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.380+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.381+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff1010 2024-04-23T18:29:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.381+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452dff1010 2024-04-23T18:29:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.381+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x7fa4c003d2c0 2024-04-23T18:29:34.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.381+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c800a4a0 con 0x7fa4c003d2c0 2024-04-23T18:29:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.381+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff1010 2024-04-23T18:29:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.381+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452dff1010 2024-04-23T18:29:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.381+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff59b0 2024-04-23T18:29:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.381+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa4c0074070 con 0x56452dff59b0 2024-04-23T18:29:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.381+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dffa390 2024-04-23T18:29:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.382+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.382+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dffa390 2024-04-23T18:29:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.382+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.382+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x7fa4c003d2c0 2024-04-23T18:29:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.382+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c800a4a0 con 0x7fa4c003d2c0 2024-04-23T18:29:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.382+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dffa390 2024-04-23T18:29:34.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.382+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.382+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dffa390 2024-04-23T18:29:34.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.383+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.383+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff1010 2024-04-23T18:29:34.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.383+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452dff1010 2024-04-23T18:29:34.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.383+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff1010 2024-04-23T18:29:34.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.383+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452dff1010 2024-04-23T18:29:34.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.383+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x7fa4c003d2c0 2024-04-23T18:29:34.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.383+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c800a4a0 con 0x7fa4c003d2c0 2024-04-23T18:29:34.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.383+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dffa390 2024-04-23T18:29:34.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.384+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.384+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff59b0 2024-04-23T18:29:34.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.384+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa4c0074070 con 0x56452dff59b0 2024-04-23T18:29:34.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.384+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff1010 2024-04-23T18:29:34.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.384+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c800a4a0 con 0x56452dff1010 2024-04-23T18:29:34.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.384+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x7fa4c003d2c0 2024-04-23T18:29:34.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.385+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c800a4a0 con 0x7fa4c003d2c0 2024-04-23T18:29:34.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.385+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dffa390 2024-04-23T18:29:34.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.385+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.385+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x7fa4c003d2c0 2024-04-23T18:29:34.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.385+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c800a4a0 con 0x7fa4c003d2c0 2024-04-23T18:29:34.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.385+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff59b0 2024-04-23T18:29:34.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.385+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c0074070 con 0x56452dff59b0 2024-04-23T18:29:34.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.385+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dffa390 2024-04-23T18:29:34.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.386+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.386+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x7fa4c003d2c0 2024-04-23T18:29:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.386+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.386+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff1010 2024-04-23T18:29:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.386+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa4c8040040 con 0x56452dff1010 2024-04-23T18:29:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.386+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56452dff4c50 con 0x56452dff59b0 2024-04-23T18:29:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4c0089040 con 0x56452dff59b0 2024-04-23T18:29:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:34.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dff8c90 con 0x56452dff1010 2024-04-23T18:29:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x56452dff1010 2024-04-23T18:29:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dff8c90 con 0x56452dff1010 2024-04-23T18:29:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa4c8040040 con 0x56452dff1010 2024-04-23T18:29:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dff8c90 con 0x7fa4c003d2c0 2024-04-23T18:29:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 zone default found 2024-04-23T18:29:34.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 4 Realm: () 2024-04-23T18:29:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 zonegroup default 2024-04-23T18:29:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.387+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dff9080 con 0x7fa4c003d2c0 2024-04-23T18:29:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.388+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.388+0000 7fa4d3230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.388+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.388+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dff94c0 con 0x56452dffa390 2024-04-23T18:29:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.388+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.388+0000 7fa4d3230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.388+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.388+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452dff9900 con 0x56452dffa390 2024-04-23T18:29:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.388+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.388+0000 7fa4d3230800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.388+0000 7fa4d3230800 20 started sync module instance, tier type = 2024-04-23T18:29:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.388+0000 7fa4d3230800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.388+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452dffe220 con 0x56452dff59b0 2024-04-23T18:29:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.389+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c0089040 con 0x56452dff59b0 2024-04-23T18:29:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.389+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94855124477376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452dffee90 con 0x56452dff59b0 2024-04-23T18:29:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.389+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452dfff850 con 0x56452dff1010 2024-04-23T18:29:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.390+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94855124477376] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c0089040 con 0x56452dff59b0 2024-04-23T18:29:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.390+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x56452dff1010 2024-04-23T18:29:34.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.391+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94855124480928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452dfffc70 con 0x56452dff1010 2024-04-23T18:29:34.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.391+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e000630 con 0x56452dffa390 2024-04-23T18:29:34.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.391+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.391+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94855124484480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e000ed0 con 0x56452dffa390 2024-04-23T18:29:34.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.392+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e001990 con 0x56452dff59b0 2024-04-23T18:29:34.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.392+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94855124480928] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x56452dff1010 2024-04-23T18:29:34.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.392+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94855124484480] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.393+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c0089040 con 0x56452dff59b0 2024-04-23T18:29:34.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.393+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94855124489408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e001db0 con 0x56452dff59b0 2024-04-23T18:29:34.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.393+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e002640 con 0x56452dff1010 2024-04-23T18:29:34.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.394+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x56452dff1010 2024-04-23T18:29:34.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.394+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94855124489408] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c0089040 con 0x56452dff59b0 2024-04-23T18:29:34.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.394+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94855124481984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e002a30 con 0x56452dff1010 2024-04-23T18:29:34.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.394+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e003450 con 0x7fa4c003d2c0 2024-04-23T18:29:34.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.395+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94855124481984] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x56452dff1010 2024-04-23T18:29:34.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.395+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.395+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94855124496192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e003410 con 0x7fa4c003d2c0 2024-04-23T18:29:34.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.395+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e003e60 con 0x7fa4c003d2c0 2024-04-23T18:29:34.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.396+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94855124496192] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.396+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.396+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94855124492624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e003e60 con 0x7fa4c003d2c0 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.396+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e004820 con 0x7fa4c003d2c0 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.397+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.397+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94855124492624] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.397+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94855124501360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e004c40 con 0x7fa4c003d2c0 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.397+0000 7fa4d3230800 20 add_watcher() i=0 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.397+0000 7fa4d3230800 20 add_watcher() i=1 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.397+0000 7fa4d3230800 20 add_watcher() i=2 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.397+0000 7fa4d3230800 20 add_watcher() i=3 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.397+0000 7fa4d3230800 20 add_watcher() i=4 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.397+0000 7fa4d3230800 20 add_watcher() i=5 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.397+0000 7fa4d3230800 20 add_watcher() i=6 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.398+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94855124501360] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.398+0000 7fa4d3230800 20 add_watcher() i=7 2024-04-23T18:29:34.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.398+0000 7fa4d3230800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:34.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.398+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e004c40 con 0x56452dff1010 2024-04-23T18:29:34.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.398+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa4c8040040 con 0x56452dff1010 2024-04-23T18:29:34.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.398+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94855124502416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e004c20 con 0x56452dff1010 2024-04-23T18:29:34.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.399+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94855124502416] v32'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x56452dff1010 2024-04-23T18:29:34.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.399+0000 7fa384fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:34.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.399+0000 7fa4d3230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:34.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.399+0000 7fa4d3230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:34.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.399+0000 7fa4d3230800 5 note: GC not initialized 2024-04-23T18:29:34.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.400+0000 7fa2ff7fe640 20 reqs_thread_entry: start 2024-04-23T18:29:34.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.400+0000 7fa4d3230800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:34.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.400+0000 7fa4d3230800 20 Filter name: none 2024-04-23T18:29:34.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.400+0000 7fa2fd7fa640 20 reqs_thread_entry: start 2024-04-23T18:29:34.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.400+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.400+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e03b340 con 0x56452dff59b0 2024-04-23T18:29:34.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.400+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa4c0089040 con 0x56452dff59b0 2024-04-23T18:29:34.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.400+0000 7fa4d3230800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:34.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.400+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.400+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:63 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e03bc70 con 0x56452dffa390 2024-04-23T18:29:34.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.401+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(63 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.401+0000 7fa4d3230800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:34.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.401+0000 7fa4d3230800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-23T18:29:34.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.401+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.401+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e03b760 con 0x56452dff59b0 2024-04-23T18:29:34.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.401+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa4c0089040 con 0x56452dff59b0 2024-04-23T18:29:34.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.401+0000 7fa4d3230800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:34.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.401+0000 7fa4d3230800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.401+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:65 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e03d7d0 con 0x56452dffa390 2024-04-23T18:29:34.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.401+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(65 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.401+0000 7fa4d3230800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:34.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.401+0000 7fa4d3230800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-23T18:29:34.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 4.3e 4:7dbf76af:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e03d200 con 0x56452dff59b0 2024-04-23T18:29:34.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 4.1 4:81f4b350:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e0421a0 con 0x56452dff59b0 2024-04-23T18:29:34.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 4.11 4:891fea53:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e044ce0 con 0x7fa4c003d2c0 2024-04-23T18:29:34.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 4.21 4:842d5f4d:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e047550 con 0x7fa4c003d2c0 2024-04-23T18:29:34.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:70 4.25 4:a75c3a3c:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e049fb0 con 0x56452dffa390 2024-04-23T18:29:34.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 4.14 4:28337734:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e04c820 con 0x56452dffa390 2024-04-23T18:29:34.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 4.1c 4:39198531:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e04f4a0 con 0x7fa4c003d2c0 2024-04-23T18:29:34.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 4.1c 4:3a706890:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e052290 con 0x7fa4c003d2c0 2024-04-23T18:29:34.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:74 4.0 4:03724c23:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e04f4a0 con 0x56452dffa390 2024-04-23T18:29:34.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:75 4.3d 4:bc4cc370:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e04c820 con 0x56452dffa390 2024-04-23T18:29:34.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 4.1e 4:7a26d6dd:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56452e059af0 con 0x7fa4c003d2c0 2024-04-23T18:29:34.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa4c0090040 con 0x56452dff59b0 2024-04-23T18:29:34.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(66 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa4c0090040 con 0x56452dff59b0 2024-04-23T18:29:34.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(70 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(69 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(71 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(68 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(74 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(75 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(72 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(76 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.402+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(73 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.403+0000 7fa384fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.403+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94855124502416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e023930 con 0x56452dff1010 2024-04-23T18:29:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.404+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94855124502416] v32'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x56452dff1010 2024-04-23T18:29:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.404+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94855124477376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e023930 con 0x56452dff59b0 2024-04-23T18:29:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.405+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94855124477376] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c0090040 con 0x56452dff59b0 2024-04-23T18:29:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.405+0000 7fa4d3230800 20 remove_watcher() i=0 2024-04-23T18:29:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.405+0000 7fa4d3230800 2 removed watcher, disabling cache 2024-04-23T18:29:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.405+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94855124480928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452dffe5c0 con 0x56452dff1010 2024-04-23T18:29:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.406+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94855124480928] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x56452dff1010 2024-04-23T18:29:34.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.406+0000 7fa4d3230800 20 remove_watcher() i=1 2024-04-23T18:29:34.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.406+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94855124484480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e023930 con 0x56452dffa390 2024-04-23T18:29:34.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.407+0000 7fa4c7fff640 1 -- 172.21.15.119:0/1488321824 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94855124484480] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4b8081070 con 0x56452dffa390 2024-04-23T18:29:34.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.407+0000 7fa4d3230800 20 remove_watcher() i=2 2024-04-23T18:29:34.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.407+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94855124489408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452dfff3a0 con 0x56452dff59b0 2024-04-23T18:29:34.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.408+0000 7fa4ce48b640 1 -- 172.21.15.119:0/1488321824 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94855124489408] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c0090040 con 0x56452dff59b0 2024-04-23T18:29:34.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.408+0000 7fa4d3230800 20 remove_watcher() i=3 2024-04-23T18:29:34.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.408+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94855124481984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452dffe5c0 con 0x56452dff1010 2024-04-23T18:29:34.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.409+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94855124481984] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x56452dff1010 2024-04-23T18:29:34.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.409+0000 7fa4d3230800 20 remove_watcher() i=4 2024-04-23T18:29:34.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.409+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94855124496192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e023930 con 0x7fa4c003d2c0 2024-04-23T18:29:34.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.410+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94855124496192] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.410+0000 7fa4d3230800 20 remove_watcher() i=5 2024-04-23T18:29:34.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.410+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94855124492624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452e0014c0 con 0x7fa4c003d2c0 2024-04-23T18:29:34.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.411+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94855124492624] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.411+0000 7fa4d3230800 20 remove_watcher() i=6 2024-04-23T18:29:34.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.411+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94855124501360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56452dffe5c0 con 0x7fa4c003d2c0 2024-04-23T18:29:34.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94855124501360] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4c8040040 con 0x7fa4c003d2c0 2024-04-23T18:29:34.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 20 remove_watcher() i=7 2024-04-23T18:29:34.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa4c003d2c0 msgr2=0x7fa4c0043530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa4c003d2c0 0x7fa4c0043530 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56452dff1010 msgr2=0x56452dff34b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56452dff1010 0x56452dff34b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56452dff59b0 msgr2=0x56452dff7da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56452dff59b0 0x56452dff7da0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56452dffa390 msgr2=0x56452dffc850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56452dffa390 0x56452dffc850 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa398036e60 msgr2=0x7fa398039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa398036e60 0x7fa398039320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8052fd0 tx=0x7fa4b804f000 comp rx=0 tx=0).stop 2024-04-23T18:29:34.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 msgr2=0x56452dfe58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4cec8c640 1 -- 172.21.15.119:0/1488321824 reap_dead start 2024-04-23T18:29:34.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 0x56452dfe58d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0008420 tx=0x7fa4c0039e70 comp rx=0 tx=0).stop 2024-04-23T18:29:34.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 shutdown_connections 2024-04-23T18:29:34.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 --2- 172.21.15.119:0/1488321824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfde650 0x56452dfe58d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 >> 172.21.15.119:0/1488321824 conn(0x56452dfda920 msgr2=0x56452dfd7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 shutdown_connections 2024-04-23T18:29:34.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/1488321824 wait complete. 2024-04-23T18:29:34.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/2638630591 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa3a8036eb0 msgr2=0x7fa3a8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 --2- 172.21.15.119:0/2638630591 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa3a8036eb0 0x7fa3a8039370 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x56452de2c860 tx=0x7fa4b8005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/2638630591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfd16b0 msgr2=0x56452dfd1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 --2- 172.21.15.119:0/2638630591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfd16b0 0x56452dfd1ad0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0016570 tx=0x7fa4c000db20 comp rx=0 tx=0).stop 2024-04-23T18:29:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/2638630591 shutdown_connections 2024-04-23T18:29:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 --2- 172.21.15.119:0/2638630591 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa3a8036eb0 0x7fa3a8039370 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 --2- 172.21.15.119:0/2638630591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452dfd16b0 0x56452dfd1ad0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.412+0000 7fa4d3230800 1 -- 172.21.15.119:0/2638630591 >> 172.21.15.119:0/2638630591 conn(0x56452dfc5750 msgr2=0x56452dfc5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 -- 172.21.15.119:0/2638630591 shutdown_connections 2024-04-23T18:29:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 -- 172.21.15.119:0/2638630591 wait complete. 2024-04-23T18:29:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56452dfc06c0 msgr2=0x56452dfc2b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56452dfc06c0 0x56452dfc2b30 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56452debc3a0 msgr2=0x56452dfb9ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56452debc3a0 0x56452dfb9ee0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56452dfbc6a0 msgr2=0x56452dfbead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56452dfbc6a0 0x56452dfbead0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa3b4036eb0 msgr2=0x7fa3b4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa3b4036eb0 0x7fa3b4039370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8054000 tx=0x7fa4b804e000 comp rx=0 tx=0).stop 2024-04-23T18:29:34.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452deb7f60 msgr2=0x56452de2d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 --2- 172.21.15.119:0/2460741382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56452deb7f60 0x56452de2d810 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000b7c0 tx=0x7fa4c0000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4cec8c640 1 -- 172.21.15.119:0/2460741382 reap_dead start 2024-04-23T18:29:34.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 shutdown_connections 2024-04-23T18:29:34.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 >> 172.21.15.119:0/2460741382 conn(0x56452deb3540 msgr2=0x56452dfa32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 shutdown_connections 2024-04-23T18:29:34.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.413+0000 7fa4d3230800 1 -- 172.21.15.119:0/2460741382 wait complete. 2024-04-23T18:29:34.427 INFO:teuthology.orchestra.run.smithi119.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"4f165054-0d30-4e3c-af82-245e56f34813","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1","marker":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-23T18:29:33.452606Z","creation_time":"2024-04-23T18:29:33.450324Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-23T18:29:34.427 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4f165054-0d30-4e3c-af82-245e56f34813', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1', 'marker': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-23T18:29:33.452606Z', 'creation_time': '2024-04-23T18:29:33.450324Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-23T18:29:34.428 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-23T18:29:34.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-23T18:29:34.428 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-04-23T18:29:34.511 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:34.511 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:34.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.519+0000 7f2b42640800 1 Processor -- start 2024-04-23T18:29:34.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.519+0000 7f2b42640800 1 -- start start 2024-04-23T18:29:34.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.519+0000 7f2b42640800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561f6ac298b0 0x561f6ac29cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.519+0000 7f2b42640800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561f6aadb560 con 0x561f6ac2a210 2024-04-23T18:29:34.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.519+0000 7f2b42640800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x561f6aacce20 con 0x561f6ac298b0 2024-04-23T18:29:34.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.520+0000 7f2b3d2dc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561f6ac298b0 0x561f6ac29cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.520+0000 7f2b34adb640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x561f6ac2a210 0x561f6ac2a6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40762/0 (socket says 172.21.15.119:40762) 2024-04-23T18:29:34.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.520+0000 7f2b34adb640 1 -- 172.21.15.119:0/2586167783 learned_addr learned my addr 172.21.15.119:0/2586167783 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:34.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.520+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/2586167783 >> v1:172.21.15.62:6789/0 conn(0x561f6ac2a210 legacy=0x561f6ac2a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.520+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/2586167783 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f6aadae60 con 0x561f6ac298b0 2024-04-23T18:29:34.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.522+0000 7f2b3d2dc640 1 --2- 172.21.15.119:0/2586167783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ac29cd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000a470 tx=0x7f2b3001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded659d919f3ba70 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.522+0000 7f2b3cadb640 1 -- 172.21.15.119:0/2586167783 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b30057070 con 0x561f6ac298b0 2024-04-23T18:29:34.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.522+0000 7f2b3cadb640 1 -- 172.21.15.119:0/2586167783 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3004adc0 con 0x561f6ac298b0 2024-04-23T18:29:34.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.522+0000 7f2b3cadb640 1 -- 172.21.15.119:0/2586167783 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b30052590 con 0x561f6ac298b0 2024-04-23T18:29:34.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.522+0000 7f2b42640800 1 -- 172.21.15.119:0/2586167783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 msgr2=0x561f6ac29cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.522+0000 7f2b42640800 1 --2- 172.21.15.119:0/2586167783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ac29cd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000a470 tx=0x7f2b3001ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:34.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.522+0000 7f2b42640800 1 -- 172.21.15.119:0/2586167783 shutdown_connections 2024-04-23T18:29:34.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.522+0000 7f2b42640800 1 --2- 172.21.15.119:0/2586167783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ac29cd0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.522+0000 7f2b42640800 1 -- 172.21.15.119:0/2586167783 >> 172.21.15.119:0/2586167783 conn(0x561f6ac25430 msgr2=0x561f6ac27850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.522+0000 7f2b42640800 1 -- 172.21.15.119:0/2586167783 shutdown_connections 2024-04-23T18:29:34.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.522+0000 7f2b42640800 1 -- 172.21.15.119:0/2586167783 wait complete. 2024-04-23T18:29:34.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.534+0000 7f2b42640800 1 Processor -- start 2024-04-23T18:29:34.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.534+0000 7f2b42640800 1 -- start start 2024-04-23T18:29:34.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.534+0000 7f2b42640800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ad1e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.534+0000 7f2b42640800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561f6ab765d0 con 0x561f6ac298b0 2024-04-23T18:29:34.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.535+0000 7f2b3d2dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ad1e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.535+0000 7f2b3d2dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ad1e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33584/0 (socket says 172.21.15.119:33584) 2024-04-23T18:29:34.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.535+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4083887882 learned_addr learned my addr 172.21.15.119:0/4083887882 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.535+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4083887882 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f6aaec860 con 0x561f6ac298b0 2024-04-23T18:29:34.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.535+0000 7f2b3d2dc640 1 --2- 172.21.15.119:0/4083887882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ad1e4d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2b30055040 tx=0x7f2b3004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70335397b29e6ba0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.535+0000 7f2a2b606640 1 -- 172.21.15.119:0/4083887882 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b30057040 con 0x561f6ac298b0 2024-04-23T18:29:34.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.535+0000 7f2a2b606640 1 -- 172.21.15.119:0/4083887882 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b30062070 con 0x561f6ac298b0 2024-04-23T18:29:34.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.535+0000 7f2a2b606640 1 -- 172.21.15.119:0/4083887882 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b3005d470 con 0x561f6ac298b0 2024-04-23T18:29:34.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.536+0000 7f2b42640800 1 -- 172.21.15.119:0/4083887882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 msgr2=0x561f6ad1e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.536+0000 7f2b42640800 1 --2- 172.21.15.119:0/4083887882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ad1e4d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2b30055040 tx=0x7f2b3004c000 comp rx=0 tx=0).stop 2024-04-23T18:29:34.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.536+0000 7f2b42640800 1 -- 172.21.15.119:0/4083887882 shutdown_connections 2024-04-23T18:29:34.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.536+0000 7f2b42640800 1 --2- 172.21.15.119:0/4083887882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ad1e4d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.536+0000 7f2b42640800 1 -- 172.21.15.119:0/4083887882 >> 172.21.15.119:0/4083887882 conn(0x561f6ac25430 msgr2=0x561f6ad19df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.536+0000 7f2b42640800 1 -- 172.21.15.119:0/4083887882 shutdown_connections 2024-04-23T18:29:34.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.536+0000 7f2b42640800 1 -- 172.21.15.119:0/4083887882 wait complete. 2024-04-23T18:29:34.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.536+0000 7f2b42640800 1 Processor -- start 2024-04-23T18:29:34.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.536+0000 7f2b42640800 1 -- start start 2024-04-23T18:29:34.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.536+0000 7f2b42640800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ad25ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.536+0000 7f2b42640800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561f6ac2b070 con 0x561f6ac298b0 2024-04-23T18:29:34.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.537+0000 7f2b3d2dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ad25ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.537+0000 7f2b3d2dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ad25ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33588/0 (socket says 172.21.15.119:33588) 2024-04-23T18:29:34.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.537+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/1283689665 learned_addr learned my addr 172.21.15.119:0/1283689665 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.537+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/1283689665 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f6aaeaeb0 con 0x561f6ac298b0 2024-04-23T18:29:34.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.537+0000 7f2b3d2dc640 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ad25ce0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2b3005f040 tx=0x7f2b30002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.537+0000 7f2a29e03640 1 -- 172.21.15.119:0/1283689665 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b3006b070 con 0x561f6ac298b0 2024-04-23T18:29:34.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.537+0000 7f2a29e03640 1 -- 172.21.15.119:0/1283689665 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3005d9a0 con 0x561f6ac298b0 2024-04-23T18:29:34.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.537+0000 7f2a29e03640 1 -- 172.21.15.119:0/1283689665 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b30057070 con 0x561f6ac298b0 2024-04-23T18:29:34.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.537+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f6ad26220 con 0x561f6ac298b0 2024-04-23T18:29:34.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.537+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f6ad26740 con 0x561f6ac298b0 2024-04-23T18:29:34.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.538+0000 7f2a29e03640 1 -- 172.21.15.119:0/1283689665 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2b3005dca0 con 0x561f6ac298b0 2024-04-23T18:29:34.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.538+0000 7f2a29e03640 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a24036e60 0x7f2a24039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.538+0000 7f2a29e03640 1 -- 172.21.15.119:0/1283689665 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f2b3008e860 con 0x561f6ac298b0 2024-04-23T18:29:34.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.538+0000 7f2b34adb640 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a24036e60 0x7f2a24039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.538+0000 7f2b42640800 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561f6ac2a210 0x561f6ad2cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.538+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad2d290 con 0x561f6ac2a210 2024-04-23T18:29:34.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.538+0000 7f2b3dadd640 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561f6ac2a210 0x561f6ad2cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.539+0000 7f2b34adb640 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a24036e60 0x7f2a24039320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b28000f60 tx=0x7f2b280012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.539+0000 7f2b3dadd640 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561f6ac2a210 0x561f6ad2cd50 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.539+0000 7f2b3dadd640 1 -- 172.21.15.119:0/1283689665 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ac2a210 2024-04-23T18:29:34.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.539+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad2a320 con 0x561f6ac2a210 2024-04-23T18:29:34.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.539+0000 7f2b3dadd640 1 -- 172.21.15.119:0/1283689665 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ac2a210 2024-04-23T18:29:34.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.539+0000 7f2b42640800 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561f6ad2f5e0 0x561f6ad319d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.539+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad32070 con 0x561f6ad2f5e0 2024-04-23T18:29:34.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.539+0000 7f2b3d2dc640 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561f6ad2f5e0 0x561f6ad319d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.540+0000 7f2b3d2dc640 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561f6ad2f5e0 0x561f6ad319d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.540+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/1283689665 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2b3005a040 con 0x561f6ad2f5e0 2024-04-23T18:29:34.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.540+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad2e590 con 0x561f6ac2a210 2024-04-23T18:29:34.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.540+0000 7f2b3dadd640 1 -- 172.21.15.119:0/1283689665 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ac2a210 2024-04-23T18:29:34.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.540+0000 7f2b42640800 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561f6ad33520 0x561f6ad35970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.540+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad360d0 con 0x561f6ad33520 2024-04-23T18:29:34.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.541+0000 7f2b34adb640 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561f6ad33520 0x561f6ad35970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.541+0000 7f2b34adb640 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561f6ad33520 0x561f6ad35970 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.541+0000 7f2b34adb640 1 -- 172.21.15.119:0/1283689665 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad33520 2024-04-23T18:29:34.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.542+0000 7f2b42640800 1 Processor -- start 2024-04-23T18:29:34.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.542+0000 7f2b42640800 1 -- start start 2024-04-23T18:29:34.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.542+0000 7f2b42640800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad44530 0x561f6ad44950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.542+0000 7f2b42640800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561f6ab1cdf0 con 0x561f6ad44530 2024-04-23T18:29:34.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.542+0000 7f2b3d2dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad44530 0x561f6ad44950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.542+0000 7f2b3d2dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad44530 0x561f6ad44950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33590/0 (socket says 172.21.15.119:33590) 2024-04-23T18:29:34.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.542+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/2502149056 learned_addr learned my addr 172.21.15.119:0/2502149056 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.542+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/2502149056 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f6ad44e90 con 0x561f6ad44530 2024-04-23T18:29:34.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.542+0000 7f2b3d2dc640 1 --2- 172.21.15.119:0/2502149056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad44530 0x561f6ad44950 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2b3008cd30 tx=0x7f2b30078690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.542+0000 7f2a22ffd640 1 -- 172.21.15.119:0/2502149056 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b3005bcc0 con 0x561f6ad44530 2024-04-23T18:29:34.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.543+0000 7f2a22ffd640 1 -- 172.21.15.119:0/2502149056 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b30078730 con 0x561f6ad44530 2024-04-23T18:29:34.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.543+0000 7f2a22ffd640 1 -- 172.21.15.119:0/2502149056 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b3005be60 con 0x561f6ad44530 2024-04-23T18:29:34.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.543+0000 7f2b42640800 1 -- 172.21.15.119:0/2502149056 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f6ad45900 con 0x561f6ad44530 2024-04-23T18:29:34.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.543+0000 7f2b42640800 1 -- 172.21.15.119:0/2502149056 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f6ad45e00 con 0x561f6ad44530 2024-04-23T18:29:34.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.543+0000 7f2a22ffd640 1 -- 172.21.15.119:0/2502149056 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2b30009ad0 con 0x561f6ad44530 2024-04-23T18:29:34.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.543+0000 7f2a22ffd640 1 --2- 172.21.15.119:0/2502149056 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a18036e60 0x7f2a18039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.543+0000 7f2a22ffd640 1 -- 172.21.15.119:0/2502149056 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f2b30085070 con 0x561f6ad44530 2024-04-23T18:29:34.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.543+0000 7f2b34adb640 1 --2- 172.21.15.119:0/2502149056 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a18036e60 0x7f2a18039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.544+0000 7f2b42640800 1 Processor -- start 2024-04-23T18:29:34.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.544+0000 7f2b42640800 1 -- start start 2024-04-23T18:29:34.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.544+0000 7f2b34adb640 1 --2- 172.21.15.119:0/2502149056 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a18036e60 0x7f2a18039320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800bf50 tx=0x7f2b2800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.544+0000 7f2b42640800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 0x561f6ad51a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.544+0000 7f2b42640800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561f6ad1eb90 con 0x561f6ad515e0 2024-04-23T18:29:34.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.544+0000 7f2b3d2dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 0x561f6ad51a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.544+0000 7f2b3d2dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 0x561f6ad51a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33600/0 (socket says 172.21.15.119:33600) 2024-04-23T18:29:34.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.544+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/2850182602 learned_addr learned my addr 172.21.15.119:0/2850182602 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.544+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/2850182602 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f6ad51fd0 con 0x561f6ad515e0 2024-04-23T18:29:34.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.544+0000 7f2b3d2dc640 1 --2- 172.21.15.119:0/2850182602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 0x561f6ad51a00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2b3004b730 tx=0x7f2b3007ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58237d21a3866ab server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.545+0000 7f2a20ff9640 1 -- 172.21.15.119:0/2850182602 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b3007e5a0 con 0x561f6ad515e0 2024-04-23T18:29:34.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.545+0000 7f2a20ff9640 1 -- 172.21.15.119:0/2850182602 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3009d030 con 0x561f6ad515e0 2024-04-23T18:29:34.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.545+0000 7f2a20ff9640 1 -- 172.21.15.119:0/2850182602 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b30079e00 con 0x561f6ad515e0 2024-04-23T18:29:34.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.545+0000 7f2b42640800 1 -- 172.21.15.119:0/2850182602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 msgr2=0x561f6ad51a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.545+0000 7f2b42640800 1 --2- 172.21.15.119:0/2850182602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 0x561f6ad51a00 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2b3004b730 tx=0x7f2b3007ef80 comp rx=0 tx=0).stop 2024-04-23T18:29:34.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.545+0000 7f2b42640800 1 -- 172.21.15.119:0/2850182602 shutdown_connections 2024-04-23T18:29:34.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.545+0000 7f2b42640800 1 --2- 172.21.15.119:0/2850182602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 0x561f6ad51a00 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.545+0000 7f2b42640800 1 -- 172.21.15.119:0/2850182602 >> 172.21.15.119:0/2850182602 conn(0x561f6ad4d940 msgr2=0x561f6ad4b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.545+0000 7f2b42640800 1 -- 172.21.15.119:0/2850182602 shutdown_connections 2024-04-23T18:29:34.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.545+0000 7f2b42640800 1 -- 172.21.15.119:0/2850182602 wait complete. 2024-04-23T18:29:34.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.545+0000 7f2b42640800 1 Processor -- start 2024-04-23T18:29:34.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.545+0000 7f2b42640800 1 -- start start 2024-04-23T18:29:34.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.546+0000 7f2b42640800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 0x561f6ad58a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.546+0000 7f2b42640800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561f6ad52680 con 0x561f6ad515e0 2024-04-23T18:29:34.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.546+0000 7f2b3d2dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 0x561f6ad58a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.546+0000 7f2b3d2dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 0x561f6ad58a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33616/0 (socket says 172.21.15.119:33616) 2024-04-23T18:29:34.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.546+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 learned_addr learned my addr 172.21.15.119:0/4219393756 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.546+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f6ad58f40 con 0x561f6ad515e0 2024-04-23T18:29:34.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.546+0000 7f2b3d2dc640 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 0x561f6ad58a00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2b30052cb0 tx=0x7f2b30054420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.546+0000 7f2a0effd640 1 -- 172.21.15.119:0/4219393756 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b3007e780 con 0x561f6ad515e0 2024-04-23T18:29:34.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.546+0000 7f2a0effd640 1 -- 172.21.15.119:0/4219393756 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b300b1070 con 0x561f6ad515e0 2024-04-23T18:29:34.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.546+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f6ad58f40 con 0x561f6ad515e0 2024-04-23T18:29:34.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.546+0000 7f2a0effd640 1 -- 172.21.15.119:0/4219393756 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b3008b250 con 0x561f6ad515e0 2024-04-23T18:29:34.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.546+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f6ad58f40 con 0x561f6ad515e0 2024-04-23T18:29:34.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.547+0000 7f2a0effd640 1 -- 172.21.15.119:0/4219393756 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2b30054090 con 0x561f6ad515e0 2024-04-23T18:29:34.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.547+0000 7f2a0effd640 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a08036e60 0x7f2a08039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.547+0000 7f2a0effd640 1 -- 172.21.15.119:0/4219393756 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f2b30056170 con 0x561f6ad515e0 2024-04-23T18:29:34.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.547+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b34adb640 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a08036e60 0x7f2a08039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b42640800 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561f6ad64030 0x561f6ad664f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad66c40 con 0x561f6ad64030 2024-04-23T18:29:34.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b3dadd640 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561f6ad64030 0x561f6ad664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b34adb640 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a08036e60 0x7f2a08039320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b28001b60 tx=0x7f2b28010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b3dadd640 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561f6ad64030 0x561f6ad664f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ad64030 2024-04-23T18:29:34.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b42640800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b42640800 20 realm 2024-04-23T18:29:34.588 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67050 con 0x561f6ad64030 2024-04-23T18:29:34.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ad64030 2024-04-23T18:29:34.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b42640800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.548+0000 7f2b42640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:34.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.549+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.549+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad678f0 con 0x561f6ad64030 2024-04-23T18:29:34.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.549+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ad64030 2024-04-23T18:29:34.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.549+0000 7f2b42640800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.549+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.549+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad64030 2024-04-23T18:29:34.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.549+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ad64030 2024-04-23T18:29:34.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.549+0000 7f2b42640800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:34.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.549+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.549+0000 7f2b42640800 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561f6ad689f0 0x561f6ad6ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.549+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad6b320 con 0x561f6ad689f0 2024-04-23T18:29:34.591 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.549+0000 7f2b3d2dc640 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561f6ad689f0 0x561f6ad6ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.549+0000 7f2b3d2dc640 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561f6ad689f0 0x561f6ad6ade0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.550+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.550+0000 7f2b42640800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:34.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.550+0000 7f2b42640800 20 searching for the correct realm 2024-04-23T18:29:34.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.550+0000 7f2b42640800 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561f6ad6d390 0x561f6ad6f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.550+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad6ff20 con 0x561f6ad6d390 2024-04-23T18:29:34.592 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.550+0000 7f2b34adb640 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561f6ad6d390 0x561f6ad6f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.550+0000 7f2b34adb640 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561f6ad6d390 0x561f6ad6f850 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.550+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.550+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad6ff20 con 0x561f6ad689f0 2024-04-23T18:29:34.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.551+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.551+0000 7f2b3d2dc640 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f2b30088020 0x7f2b300a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.551+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad6ff20 con 0x7f2b30088020 2024-04-23T18:29:34.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.551+0000 7f2b3dadd640 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f2b30088020 0x7f2b300a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.551+0000 7f2b3dadd640 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f2b30088020 0x7f2b300a27e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.551+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b3800a4a0 con 0x7f2b30088020 2024-04-23T18:29:34.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.551+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad64030 2024-04-23T18:29:34.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.552+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ad64030 2024-04-23T18:29:34.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.552+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad64030 2024-04-23T18:29:34.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.552+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ad64030 2024-04-23T18:29:34.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.552+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x7f2b30088020 2024-04-23T18:29:34.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.552+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b3800a4a0 con 0x7f2b30088020 2024-04-23T18:29:34.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.552+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x7f2b30088020 2024-04-23T18:29:34.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.552+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2b3800a4a0 con 0x7f2b30088020 2024-04-23T18:29:34.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.552+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad689f0 2024-04-23T18:29:34.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.553+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.553+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad6d390 2024-04-23T18:29:34.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.553+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.553+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad64030 2024-04-23T18:29:34.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.553+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ad64030 2024-04-23T18:29:34.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.553+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x7f2b30088020 2024-04-23T18:29:34.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.553+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b3800a4a0 con 0x7f2b30088020 2024-04-23T18:29:34.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.553+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad64030 2024-04-23T18:29:34.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.553+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ad64030 2024-04-23T18:29:34.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.553+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad689f0 2024-04-23T18:29:34.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.554+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.554+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad6d390 2024-04-23T18:29:34.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.554+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.554+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad6d390 2024-04-23T18:29:34.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.554+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.554+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x7f2b30088020 2024-04-23T18:29:34.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.555+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b3800a4a0 con 0x7f2b30088020 2024-04-23T18:29:34.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.555+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad6d390 2024-04-23T18:29:34.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.555+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.555+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad6d390 2024-04-23T18:29:34.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.555+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.555+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad64030 2024-04-23T18:29:34.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.555+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ad64030 2024-04-23T18:29:34.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.555+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad64030 2024-04-23T18:29:34.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.556+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ad64030 2024-04-23T18:29:34.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.556+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x7f2b30088020 2024-04-23T18:29:34.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.556+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b3800a4a0 con 0x7f2b30088020 2024-04-23T18:29:34.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.556+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad6d390 2024-04-23T18:29:34.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.556+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.556+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad689f0 2024-04-23T18:29:34.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.556+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.556+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad64030 2024-04-23T18:29:34.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.557+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b3800a4a0 con 0x561f6ad64030 2024-04-23T18:29:34.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.557+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x7f2b30088020 2024-04-23T18:29:34.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.557+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b3800a4a0 con 0x7f2b30088020 2024-04-23T18:29:34.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.557+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad6d390 2024-04-23T18:29:34.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.557+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.557+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x7f2b30088020 2024-04-23T18:29:34.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.558+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b3800a4a0 con 0x7f2b30088020 2024-04-23T18:29:34.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.558+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad689f0 2024-04-23T18:29:34.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.558+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.558+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad6d390 2024-04-23T18:29:34.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.558+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.558+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x7f2b30088020 2024-04-23T18:29:34.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.558+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.558+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad64030 2024-04-23T18:29:34.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad67c90 con 0x561f6ad689f0 2024-04-23T18:29:34.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:34.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:34.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:34.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:34.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:34.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:34.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad6bc90 con 0x561f6ad64030 2024-04-23T18:29:34.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad6bc90 con 0x561f6ad64030 2024-04-23T18:29:34.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:34.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.559+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad6bc90 con 0x7f2b30088020 2024-04-23T18:29:34.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b42640800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:34.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b42640800 20 zone default found 2024-04-23T18:29:34.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b42640800 4 Realm: () 2024-04-23T18:29:34.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b42640800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:34.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b42640800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:34.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b42640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:34.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b42640800 20 zonegroup default 2024-04-23T18:29:34.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad6c080 con 0x7f2b30088020 2024-04-23T18:29:34.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b42640800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.560+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad6c4c0 con 0x561f6ad6d390 2024-04-23T18:29:34.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.561+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.561+0000 7f2b42640800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.561+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.561+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad6c8e0 con 0x561f6ad6d390 2024-04-23T18:29:34.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.561+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.561+0000 7f2b42640800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.561+0000 7f2b42640800 20 started sync module instance, tier type = 2024-04-23T18:29:34.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.561+0000 7f2b42640800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:34.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.561+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad71220 con 0x561f6ad689f0 2024-04-23T18:29:34.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.562+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.562+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94692936455696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad71ee0 con 0x561f6ad689f0 2024-04-23T18:29:34.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.562+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad728e0 con 0x561f6ad64030 2024-04-23T18:29:34.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.563+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94692936455696] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.563+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.563+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94692936456752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad72cd0 con 0x561f6ad64030 2024-04-23T18:29:34.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.563+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad736f0 con 0x561f6ad6d390 2024-04-23T18:29:34.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.564+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94692936456752] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.564+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.564+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94692936462816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad73b10 con 0x561f6ad6d390 2024-04-23T18:29:34.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.565+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad74530 con 0x561f6ad689f0 2024-04-23T18:29:34.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.565+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.565+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94692936462816] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.566+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94692936468816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad74d70 con 0x561f6ad689f0 2024-04-23T18:29:34.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.566+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad75730 con 0x561f6ad64030 2024-04-23T18:29:34.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.566+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94692936468816] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.567+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.567+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94692936459248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad75730 con 0x561f6ad64030 2024-04-23T18:29:34.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.567+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad761b0 con 0x7f2b30088020 2024-04-23T18:29:34.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.567+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94692936459248] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.568+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.568+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94692936473792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad75730 con 0x7f2b30088020 2024-04-23T18:29:34.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.568+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad76bc0 con 0x7f2b30088020 2024-04-23T18:29:34.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.569+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94692936473792] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.569+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.569+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94692936471168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad76da0 con 0x7f2b30088020 2024-04-23T18:29:34.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.569+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad775f0 con 0x7f2b30088020 2024-04-23T18:29:34.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.570+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94692936471168] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.570+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.570+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94692936477392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad77460 con 0x7f2b30088020 2024-04-23T18:29:34.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.570+0000 7f2b42640800 20 add_watcher() i=0 2024-04-23T18:29:34.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.570+0000 7f2b42640800 20 add_watcher() i=1 2024-04-23T18:29:34.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.570+0000 7f2b42640800 20 add_watcher() i=2 2024-04-23T18:29:34.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.570+0000 7f2b42640800 20 add_watcher() i=3 2024-04-23T18:29:34.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.570+0000 7f2b42640800 20 add_watcher() i=4 2024-04-23T18:29:34.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.570+0000 7f2b42640800 20 add_watcher() i=5 2024-04-23T18:29:34.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.570+0000 7f2b42640800 20 add_watcher() i=6 2024-04-23T18:29:34.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.571+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94692936477392] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.571+0000 7f2b42640800 20 add_watcher() i=7 2024-04-23T18:29:34.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.571+0000 7f2b42640800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:34.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.571+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad7a9d0 con 0x561f6ad64030 2024-04-23T18:29:34.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.572+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.572+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94692936478448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6ad77e90 con 0x561f6ad64030 2024-04-23T18:29:34.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.573+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94692936478448] v32'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.573+0000 7f29f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:34.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.573+0000 7f2b42640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:34.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.573+0000 7f2b42640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:34.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.573+0000 7f2b42640800 5 note: GC not initialized 2024-04-23T18:29:34.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.573+0000 7f29f27e4640 20 reqs_thread_entry: start 2024-04-23T18:29:34.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.573+0000 7f2b42640800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:34.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.573+0000 7f2b42640800 20 Filter name: none 2024-04-23T18:29:34.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.573+0000 7f2963fff640 20 reqs_thread_entry: start 2024-04-23T18:29:34.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.573+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.573+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adadc60 con 0x561f6ad64030 2024-04-23T18:29:34.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.574+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.574+0000 7f2b42640800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:34.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.574+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adaf1b0 con 0x561f6ad689f0 2024-04-23T18:29:34.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.574+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.574+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.574+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adaf1b0 con 0x561f6ad6d390 2024-04-23T18:29:34.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.574+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.574+0000 7f2b42640800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:34.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.574+0000 7f2b42640800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-23T18:29:34.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.574+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 4.3e 4:7dbf76af:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adaead0 con 0x561f6ad689f0 2024-04-23T18:29:34.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.574+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 4.1 4:81f4b350:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adb3cd0 con 0x561f6ad689f0 2024-04-23T18:29:34.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.574+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:67 4.11 4:891fea53:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adb3cd0 con 0x7f2b30088020 2024-04-23T18:29:34.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 4.21 4:842d5f4d:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adb8e70 con 0x7f2b30088020 2024-04-23T18:29:34.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 4.25 4:a75c3a3c:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbbbb0 con 0x561f6ad6d390 2024-04-23T18:29:34.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:70 4.14 4:28337734:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adb8e70 con 0x561f6ad6d390 2024-04-23T18:29:34.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 4.1c 4:39198531:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adc0dd0 con 0x7f2b30088020 2024-04-23T18:29:34.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 4.1c 4:3a706890:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adc0dd0 con 0x7f2b30088020 2024-04-23T18:29:34.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 4.0 4:03724c23:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adc5f20 con 0x561f6ad6d390 2024-04-23T18:29:34.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:74 4.3d 4:bc4cc370:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adc8860 con 0x561f6ad6d390 2024-04-23T18:29:34.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 4.1e 4:7a26d6dd:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adc0dd0 con 0x7f2b30088020 2024-04-23T18:29:34.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(65 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(69 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(70 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(73 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(67 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(68 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(71 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(74 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(75 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(72 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.575+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbb560 con 0x561f6ad689f0 2024-04-23T18:29:34.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.576+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(76 foo.buckets [call] v32'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.576+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbb560 con 0x561f6ad689f0 2024-04-23T18:29:34.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.577+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(77 foo.buckets [call] v32'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.577+0000 7f2b42640800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.577+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbb560 con 0x561f6ad64030 2024-04-23T18:29:34.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.577+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.578+0000 7f2b42640800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:34.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.578+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbb560 con 0x561f6ad689f0 2024-04-23T18:29:34.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.578+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.578+0000 7f29f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:34.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.579+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94692936478448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbb560 con 0x561f6ad64030 2024-04-23T18:29:34.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.579+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94692936478448] v32'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.579+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94692936455696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbb560 con 0x561f6ad689f0 2024-04-23T18:29:34.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.580+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94692936455696] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.580+0000 7f2b42640800 20 remove_watcher() i=0 2024-04-23T18:29:34.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.580+0000 7f2b42640800 2 removed watcher, disabling cache 2024-04-23T18:29:34.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.580+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94692936456752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbb560 con 0x561f6ad64030 2024-04-23T18:29:34.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.582+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94692936456752] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.582+0000 7f2b42640800 20 remove_watcher() i=1 2024-04-23T18:29:34.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.582+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94692936462816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbb560 con 0x561f6ad6d390 2024-04-23T18:29:34.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.583+0000 7f2b34adb640 1 -- 172.21.15.119:0/4219393756 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94692936462816] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b28009050 con 0x561f6ad6d390 2024-04-23T18:29:34.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.583+0000 7f2b42640800 20 remove_watcher() i=2 2024-04-23T18:29:34.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.583+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94692936468816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbb560 con 0x561f6ad689f0 2024-04-23T18:29:34.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.584+0000 7f2b3d2dc640 1 -- 172.21.15.119:0/4219393756 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94692936468816] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b30094020 con 0x561f6ad689f0 2024-04-23T18:29:34.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.584+0000 7f2b42640800 20 remove_watcher() i=3 2024-04-23T18:29:34.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.584+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94692936459248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbb560 con 0x561f6ad64030 2024-04-23T18:29:34.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.585+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94692936459248] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x561f6ad64030 2024-04-23T18:29:34.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.585+0000 7f2b42640800 20 remove_watcher() i=4 2024-04-23T18:29:34.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.585+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94692936473792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbb560 con 0x7f2b30088020 2024-04-23T18:29:34.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.586+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94692936473792] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.586+0000 7f2b42640800 20 remove_watcher() i=5 2024-04-23T18:29:34.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.586+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94692936471168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbb560 con 0x7f2b30088020 2024-04-23T18:29:34.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.586+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94692936471168] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.586+0000 7f2b42640800 20 remove_watcher() i=6 2024-04-23T18:29:34.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.587+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94692936477392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f6adbb560 con 0x7f2b30088020 2024-04-23T18:29:34.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.587+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94692936477392] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2b38040040 con 0x7f2b30088020 2024-04-23T18:29:34.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.587+0000 7f2b42640800 20 remove_watcher() i=7 2024-04-23T18:29:34.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f2b30088020 msgr2=0x7f2b300a27e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f2b30088020 0x7f2b300a27e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561f6ad64030 msgr2=0x561f6ad664f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561f6ad64030 0x561f6ad664f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561f6ad689f0 msgr2=0x561f6ad6ade0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561f6ad689f0 0x561f6ad6ade0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561f6ad6d390 msgr2=0x561f6ad6f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561f6ad6d390 0x561f6ad6f850 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a08036e60 msgr2=0x7f2a08039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a08036e60 0x7f2a08039320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b28001b60 tx=0x7f2b28010000 comp rx=0 tx=0).stop 2024-04-23T18:29:34.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 msgr2=0x561f6ad58a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 0x561f6ad58a00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2b30052cb0 tx=0x7f2b30054420 comp rx=0 tx=0).stop 2024-04-23T18:29:34.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b3dadd640 1 -- 172.21.15.119:0/4219393756 reap_dead start 2024-04-23T18:29:34.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 shutdown_connections 2024-04-23T18:29:34.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 --2- 172.21.15.119:0/4219393756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad515e0 0x561f6ad58a00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 >> 172.21.15.119:0/4219393756 conn(0x561f6ad4d940 msgr2=0x561f6ad4afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 shutdown_connections 2024-04-23T18:29:34.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/4219393756 wait complete. 2024-04-23T18:29:34.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/2502149056 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a18036e60 msgr2=0x7f2a18039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 --2- 172.21.15.119:0/2502149056 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a18036e60 0x7f2a18039320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800bf50 tx=0x7f2b2800f000 comp rx=0 tx=0).stop 2024-04-23T18:29:34.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/2502149056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad44530 msgr2=0x561f6ad44950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 --2- 172.21.15.119:0/2502149056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad44530 0x561f6ad44950 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2b3008cd30 tx=0x7f2b30078690 comp rx=0 tx=0).stop 2024-04-23T18:29:34.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/2502149056 shutdown_connections 2024-04-23T18:29:34.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 --2- 172.21.15.119:0/2502149056 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a18036e60 0x7f2a18039320 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 --2- 172.21.15.119:0/2502149056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ad44530 0x561f6ad44950 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/2502149056 >> 172.21.15.119:0/2502149056 conn(0x561f6ad385d0 msgr2=0x561f6ad389d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/2502149056 shutdown_connections 2024-04-23T18:29:34.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.588+0000 7f2b42640800 1 -- 172.21.15.119:0/2502149056 wait complete. 2024-04-23T18:29:34.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561f6ad33520 msgr2=0x561f6ad35970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561f6ad33520 0x561f6ad35970 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561f6ac2a210 msgr2=0x561f6ad2cd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561f6ac2a210 0x561f6ad2cd50 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561f6ad2f5e0 msgr2=0x561f6ad319d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561f6ad2f5e0 0x561f6ad319d0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a24036e60 msgr2=0x7f2a24039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f2a24036e60 0x7f2a24039320 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2b28000f60 tx=0x7f2b280012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 msgr2=0x561f6ad25ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 --2- 172.21.15.119:0/1283689665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561f6ac298b0 0x561f6ad25ce0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2b3005f040 tx=0x7f2b30002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b3dadd640 1 -- 172.21.15.119:0/1283689665 reap_dead start 2024-04-23T18:29:34.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 shutdown_connections 2024-04-23T18:29:34.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 >> 172.21.15.119:0/1283689665 conn(0x561f6ac25430 msgr2=0x561f6ad1cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 shutdown_connections 2024-04-23T18:29:34.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.589+0000 7f2b42640800 1 -- 172.21.15.119:0/1283689665 wait complete. 2024-04-23T18:29:34.626 INFO:teuthology.orchestra.run.smithi119.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-04-23T18:29:34.577735Z","last_stats_update":"2024-04-23T18:29:34.576778Z"} 2024-04-23T18:29:34.626 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-04-23T18:29:34.577735Z', 'last_stats_update': '2024-04-23T18:29:34.576778Z'} 2024-04-23T18:29:34.632 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:34.632 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-23T18:29:34.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-23T18:29:34.632 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-04-23T18:29:34.711 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:34.711 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:34.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.719+0000 7f73b9525800 1 Processor -- start 2024-04-23T18:29:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.719+0000 7f73b9525800 1 -- start start 2024-04-23T18:29:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.719+0000 7f73b9525800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564d4c2208b0 0x564d4c220cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.719+0000 7f73b9525800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564d4c0d2560 con 0x564d4c221210 2024-04-23T18:29:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.719+0000 7f73b9525800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x564d4c0c3e20 con 0x564d4c2208b0 2024-04-23T18:29:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.719+0000 7f73b52b7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564d4c2208b0 0x564d4c220cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.719+0000 7f73b52b7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564d4c2208b0 0x564d4c220cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33630/0 (socket says 172.21.15.119:33630) 2024-04-23T18:29:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.719+0000 7f73b52b7640 1 -- 172.21.15.119:0/3421735644 learned_addr learned my addr 172.21.15.119:0/3421735644 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.719+0000 7f73b4ab6640 1 --1- 172.21.15.119:0/3421735644 >> v1:172.21.15.62:6789/0 conn(0x564d4c221210 0x564d4c2216c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40774/0 (socket says 172.21.15.119:40774) 2024-04-23T18:29:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.720+0000 7f73b52b7640 1 -- 172.21.15.119:0/3421735644 >> v1:172.21.15.62:6789/0 conn(0x564d4c221210 legacy=0x564d4c2216c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.720+0000 7f73a7fff640 1 -- 172.21.15.119:0/3421735644 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603264379 0 0) 0x564d4c0d2560 con 0x564d4c221210 2024-04-23T18:29:34.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.720+0000 7f73b52b7640 1 -- 172.21.15.119:0/3421735644 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d4c0d1e60 con 0x564d4c2208b0 2024-04-23T18:29:34.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.721+0000 7f73b52b7640 1 --2- 172.21.15.119:0/3421735644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c220cd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00a520 tx=0x7f73ac01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b167a0cb50670e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.722+0000 7f73a7fff640 1 -- 172.21.15.119:0/3421735644 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73ac057070 con 0x564d4c2208b0 2024-04-23T18:29:34.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.722+0000 7f73a7fff640 1 -- 172.21.15.119:0/3421735644 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac052570 con 0x564d4c2208b0 2024-04-23T18:29:34.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.722+0000 7f73a7fff640 1 -- 172.21.15.119:0/3421735644 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73ac052870 con 0x564d4c2208b0 2024-04-23T18:29:34.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.722+0000 7f73b9525800 1 -- 172.21.15.119:0/3421735644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 msgr2=0x564d4c220cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.722+0000 7f73b9525800 1 --2- 172.21.15.119:0/3421735644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c220cd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00a520 tx=0x7f73ac01d010 comp rx=0 tx=0).stop 2024-04-23T18:29:34.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.722+0000 7f73b9525800 1 -- 172.21.15.119:0/3421735644 shutdown_connections 2024-04-23T18:29:34.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.722+0000 7f73b9525800 1 --2- 172.21.15.119:0/3421735644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c220cd0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.722+0000 7f73b9525800 1 -- 172.21.15.119:0/3421735644 >> 172.21.15.119:0/3421735644 conn(0x564d4c21c430 msgr2=0x564d4c21e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.722+0000 7f73b9525800 1 -- 172.21.15.119:0/3421735644 shutdown_connections 2024-04-23T18:29:34.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.722+0000 7f73b9525800 1 -- 172.21.15.119:0/3421735644 wait complete. 2024-04-23T18:29:34.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.734+0000 7f73b9525800 1 Processor -- start 2024-04-23T18:29:34.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.734+0000 7f73b9525800 1 -- start start 2024-04-23T18:29:34.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.734+0000 7f73b9525800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c315260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.734+0000 7f73b9525800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564d4c16d5d0 con 0x564d4c2208b0 2024-04-23T18:29:34.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.734+0000 7f73b52b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c315260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.734+0000 7f73b52b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c315260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33638/0 (socket says 172.21.15.119:33638) 2024-04-23T18:29:34.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.734+0000 7f73b52b7640 1 -- 172.21.15.119:0/3090639073 learned_addr learned my addr 172.21.15.119:0/3090639073 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.734+0000 7f73b52b7640 1 -- 172.21.15.119:0/3090639073 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d4c0e3860 con 0x564d4c2208b0 2024-04-23T18:29:34.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.735+0000 7f73b52b7640 1 --2- 172.21.15.119:0/3090639073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c315260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f73ac055040 tx=0x7f73ac04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1486c9f768505ec0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.735+0000 7f72a3606640 1 -- 172.21.15.119:0/3090639073 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73ac062070 con 0x564d4c2208b0 2024-04-23T18:29:34.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.735+0000 7f72a3606640 1 -- 172.21.15.119:0/3090639073 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac052720 con 0x564d4c2208b0 2024-04-23T18:29:34.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.735+0000 7f72a3606640 1 -- 172.21.15.119:0/3090639073 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73ac057040 con 0x564d4c2208b0 2024-04-23T18:29:34.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.735+0000 7f73b9525800 1 -- 172.21.15.119:0/3090639073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 msgr2=0x564d4c315260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.735+0000 7f73b9525800 1 --2- 172.21.15.119:0/3090639073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c315260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f73ac055040 tx=0x7f73ac04c000 comp rx=0 tx=0).stop 2024-04-23T18:29:34.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.736+0000 7f73b9525800 1 -- 172.21.15.119:0/3090639073 shutdown_connections 2024-04-23T18:29:34.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.736+0000 7f73b9525800 1 --2- 172.21.15.119:0/3090639073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c315260 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.736+0000 7f73b9525800 1 -- 172.21.15.119:0/3090639073 >> 172.21.15.119:0/3090639073 conn(0x564d4c21c430 msgr2=0x564d4c310b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.736+0000 7f73b9525800 1 -- 172.21.15.119:0/3090639073 shutdown_connections 2024-04-23T18:29:34.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.736+0000 7f73b9525800 1 -- 172.21.15.119:0/3090639073 wait complete. 2024-04-23T18:29:34.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.736+0000 7f73b9525800 1 Processor -- start 2024-04-23T18:29:34.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.736+0000 7f73b9525800 1 -- start start 2024-04-23T18:29:34.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.736+0000 7f73b9525800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c31cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.736+0000 7f73b9525800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564d4c2220d0 con 0x564d4c2208b0 2024-04-23T18:29:34.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.736+0000 7f73b52b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c31cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.736+0000 7f73b52b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c31cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33640/0 (socket says 172.21.15.119:33640) 2024-04-23T18:29:34.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.736+0000 7f73b52b7640 1 -- 172.21.15.119:0/3639519056 learned_addr learned my addr 172.21.15.119:0/3639519056 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.736+0000 7f73b52b7640 1 -- 172.21.15.119:0/3639519056 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d4c0e1eb0 con 0x564d4c2208b0 2024-04-23T18:29:34.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.737+0000 7f73b52b7640 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c31cb10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f73ac000c00 tx=0x7f73ac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.737+0000 7f72a1e03640 1 -- 172.21.15.119:0/3639519056 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73ac057050 con 0x564d4c2208b0 2024-04-23T18:29:34.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.737+0000 7f72a1e03640 1 -- 172.21.15.119:0/3639519056 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac067580 con 0x564d4c2208b0 2024-04-23T18:29:34.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.737+0000 7f72a1e03640 1 -- 172.21.15.119:0/3639519056 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73ac062040 con 0x564d4c2208b0 2024-04-23T18:29:34.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.737+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d4c31d050 con 0x564d4c2208b0 2024-04-23T18:29:34.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.737+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d4c31d570 con 0x564d4c2208b0 2024-04-23T18:29:34.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.738+0000 7f72a1e03640 1 -- 172.21.15.119:0/3639519056 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f73ac067860 con 0x564d4c2208b0 2024-04-23T18:29:34.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.738+0000 7f72a1e03640 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f729c036e60 0x7f729c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.738+0000 7f72a1e03640 1 -- 172.21.15.119:0/3639519056 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f73ac08eb50 con 0x564d4c2208b0 2024-04-23T18:29:34.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.738+0000 7f73b4ab6640 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f729c036e60 0x7f729c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.738+0000 7f73b9525800 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564d4c221210 0x564d4c323b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.738+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c324100 con 0x564d4c221210 2024-04-23T18:29:34.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.738+0000 7f73b5ab8640 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564d4c221210 0x564d4c323b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.738+0000 7f73b4ab6640 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f729c036e60 0x7f729c039320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73a8000c00 tx=0x7f73a80013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.738+0000 7f73b5ab8640 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564d4c221210 0x564d4c323b80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.739+0000 7f73b5ab8640 1 -- 172.21.15.119:0/3639519056 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c221210 2024-04-23T18:29:34.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.739+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c321130 con 0x564d4c221210 2024-04-23T18:29:34.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.739+0000 7f73b5ab8640 1 -- 172.21.15.119:0/3639519056 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c221210 2024-04-23T18:29:34.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.739+0000 7f73b9525800 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564d4c3263d0 0x564d4c3287c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.739+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c328e60 con 0x564d4c3263d0 2024-04-23T18:29:34.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.739+0000 7f73b52b7640 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564d4c3263d0 0x564d4c3287c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.739+0000 7f73b52b7640 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564d4c3263d0 0x564d4c3287c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.739+0000 7f73b52b7640 1 -- 172.21.15.119:0/3639519056 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f73ac064070 con 0x564d4c3263d0 2024-04-23T18:29:34.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.739+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c325380 con 0x564d4c221210 2024-04-23T18:29:34.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.740+0000 7f73b5ab8640 1 -- 172.21.15.119:0/3639519056 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c221210 2024-04-23T18:29:34.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.740+0000 7f73b9525800 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564d4c32a310 0x564d4c32c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.740+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c32cec0 con 0x564d4c32a310 2024-04-23T18:29:34.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.740+0000 7f73b4ab6640 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564d4c32a310 0x564d4c32c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.740+0000 7f73b4ab6640 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564d4c32a310 0x564d4c32c760 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.741+0000 7f73b4ab6640 1 -- 172.21.15.119:0/3639519056 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f73a800f670 con 0x564d4c32a310 2024-04-23T18:29:34.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.741+0000 7f73b9525800 1 Processor -- start 2024-04-23T18:29:34.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.741+0000 7f73b9525800 1 -- start start 2024-04-23T18:29:34.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.741+0000 7f73b9525800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c33b320 0x564d4c33b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.741+0000 7f73b9525800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564d4c113df0 con 0x564d4c33b320 2024-04-23T18:29:34.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.741+0000 7f73b52b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c33b320 0x564d4c33b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.741+0000 7f73b52b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c33b320 0x564d4c33b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33642/0 (socket says 172.21.15.119:33642) 2024-04-23T18:29:34.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.741+0000 7f73b52b7640 1 -- 172.21.15.119:0/4029923393 learned_addr learned my addr 172.21.15.119:0/4029923393 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.742+0000 7f73b52b7640 1 -- 172.21.15.119:0/4029923393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d4c33bc80 con 0x564d4c33b320 2024-04-23T18:29:34.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.742+0000 7f73b52b7640 1 --2- 172.21.15.119:0/4029923393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c33b320 0x564d4c33b740 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f73ac077f80 tx=0x7f73ac05ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.742+0000 7f729affd640 1 -- 172.21.15.119:0/4029923393 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73ac077930 con 0x564d4c33b320 2024-04-23T18:29:34.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.742+0000 7f729affd640 1 -- 172.21.15.119:0/4029923393 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac0065b0 con 0x564d4c33b320 2024-04-23T18:29:34.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.742+0000 7f73b9525800 1 -- 172.21.15.119:0/4029923393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d4c33c6f0 con 0x564d4c33b320 2024-04-23T18:29:34.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.742+0000 7f729affd640 1 -- 172.21.15.119:0/4029923393 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73ac006890 con 0x564d4c33b320 2024-04-23T18:29:34.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.742+0000 7f73b9525800 1 -- 172.21.15.119:0/4029923393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d4c33cbf0 con 0x564d4c33b320 2024-04-23T18:29:34.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.743+0000 7f729affd640 1 -- 172.21.15.119:0/4029923393 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f73ac006a30 con 0x564d4c33b320 2024-04-23T18:29:34.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.743+0000 7f729affd640 1 --2- 172.21.15.119:0/4029923393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7290036e60 0x7f7290039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.743+0000 7f729affd640 1 -- 172.21.15.119:0/4029923393 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f73ac084070 con 0x564d4c33b320 2024-04-23T18:29:34.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.743+0000 7f73b4ab6640 1 --2- 172.21.15.119:0/4029923393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7290036e60 0x7f7290039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.743+0000 7f73b9525800 1 Processor -- start 2024-04-23T18:29:34.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.743+0000 7f73b9525800 1 -- start start 2024-04-23T18:29:34.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.743+0000 7f73b4ab6640 1 --2- 172.21.15.119:0/4029923393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7290036e60 0x7f7290039320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x564d4c321070 tx=0x7f73a8006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.743+0000 7f73b9525800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 0x564d4c348940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.743+0000 7f73b9525800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564d4c315920 con 0x564d4c348520 2024-04-23T18:29:34.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.743+0000 7f73b52b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 0x564d4c348940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.743+0000 7f73b52b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 0x564d4c348940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33654/0 (socket says 172.21.15.119:33654) 2024-04-23T18:29:34.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.743+0000 7f73b52b7640 1 -- 172.21.15.119:0/3220858810 learned_addr learned my addr 172.21.15.119:0/3220858810 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.744+0000 7f73b52b7640 1 -- 172.21.15.119:0/3220858810 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d4c348f10 con 0x564d4c348520 2024-04-23T18:29:34.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.744+0000 7f73b52b7640 1 --2- 172.21.15.119:0/3220858810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 0x564d4c348940 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f73ac050730 tx=0x7f73ac0506a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2683d543983ddad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.744+0000 7f7298ff9640 1 -- 172.21.15.119:0/3220858810 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73ac0990b0 con 0x564d4c348520 2024-04-23T18:29:34.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.744+0000 7f7298ff9640 1 -- 172.21.15.119:0/3220858810 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac07de00 con 0x564d4c348520 2024-04-23T18:29:34.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.744+0000 7f7298ff9640 1 -- 172.21.15.119:0/3220858810 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73ac086370 con 0x564d4c348520 2024-04-23T18:29:34.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.744+0000 7f73b9525800 1 -- 172.21.15.119:0/3220858810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 msgr2=0x564d4c348940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.744+0000 7f73b9525800 1 --2- 172.21.15.119:0/3220858810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 0x564d4c348940 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f73ac050730 tx=0x7f73ac0506a0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.744+0000 7f73b9525800 1 -- 172.21.15.119:0/3220858810 shutdown_connections 2024-04-23T18:29:34.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.744+0000 7f73b9525800 1 --2- 172.21.15.119:0/3220858810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 0x564d4c348940 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.744+0000 7f73b9525800 1 -- 172.21.15.119:0/3220858810 >> 172.21.15.119:0/3220858810 conn(0x564d4c3447f0 msgr2=0x564d4c342850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.745+0000 7f73b9525800 1 -- 172.21.15.119:0/3220858810 shutdown_connections 2024-04-23T18:29:34.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.745+0000 7f73b9525800 1 -- 172.21.15.119:0/3220858810 wait complete. 2024-04-23T18:29:34.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.745+0000 7f73b9525800 1 Processor -- start 2024-04-23T18:29:34.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.745+0000 7f73b9525800 1 -- start start 2024-04-23T18:29:34.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.745+0000 7f73b9525800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 0x564d4c34f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.745+0000 7f73b9525800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564d4c349570 con 0x564d4c348520 2024-04-23T18:29:34.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.745+0000 7f73b52b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 0x564d4c34f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.745+0000 7f73b52b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 0x564d4c34f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33658/0 (socket says 172.21.15.119:33658) 2024-04-23T18:29:34.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.745+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 learned_addr learned my addr 172.21.15.119:0/1209253987 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.745+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d4c34fd50 con 0x564d4c348520 2024-04-23T18:29:34.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.746+0000 7f73b52b7640 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 0x564d4c34f810 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f73ac074fd0 tx=0x7f73ac050e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.746+0000 7f7286ffd640 1 -- 172.21.15.119:0/1209253987 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73ac0b6070 con 0x564d4c348520 2024-04-23T18:29:34.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.746+0000 7f7286ffd640 1 -- 172.21.15.119:0/1209253987 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ac097400 con 0x564d4c348520 2024-04-23T18:29:34.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.746+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d4c34fd50 con 0x564d4c348520 2024-04-23T18:29:34.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.746+0000 7f7286ffd640 1 -- 172.21.15.119:0/1209253987 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73ac0990b0 con 0x564d4c348520 2024-04-23T18:29:34.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.746+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d4c3501f0 con 0x564d4c348520 2024-04-23T18:29:34.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.747+0000 7f7286ffd640 1 -- 172.21.15.119:0/1209253987 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f73ac0ad070 con 0x564d4c348520 2024-04-23T18:29:34.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.747+0000 7f7286ffd640 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7280036e10 0x7f72800392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.747+0000 7f7286ffd640 1 -- 172.21.15.119:0/1209253987 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f73ac0ab020 con 0x564d4c348520 2024-04-23T18:29:34.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.747+0000 7f73b4ab6640 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7280036e10 0x7f72800392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.747+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.747+0000 7f73b4ab6640 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7280036e10 0x7f72800392d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f73a800ffd0 tx=0x7f73a8023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.747+0000 7f73b9525800 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564d4c35b000 0x564d4c35d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.747+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35dc10 con 0x564d4c35b000 2024-04-23T18:29:34.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.747+0000 7f73b5ab8640 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564d4c35b000 0x564d4c35d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b5ab8640 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564d4c35b000 0x564d4c35d4c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c35b000 2024-04-23T18:29:34.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b9525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b9525800 20 realm 2024-04-23T18:29:34.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35e020 con 0x564d4c35b000 2024-04-23T18:29:34.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c35b000 2024-04-23T18:29:34.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b9525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b9525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:34.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35e8f0 con 0x564d4c35b000 2024-04-23T18:29:34.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c35b000 2024-04-23T18:29:34.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b9525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.748+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35b000 2024-04-23T18:29:34.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.749+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c35b000 2024-04-23T18:29:34.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.749+0000 7f73b9525800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:34.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.749+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.749+0000 7f73b9525800 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564d4c35f9f0 0x564d4c361de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.749+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c3623f0 con 0x564d4c35f9f0 2024-04-23T18:29:34.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.749+0000 7f73b52b7640 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564d4c35f9f0 0x564d4c361de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.749+0000 7f73b52b7640 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564d4c35f9f0 0x564d4c361de0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.749+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f73ac0c1070 con 0x564d4c35f9f0 2024-04-23T18:29:34.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.749+0000 7f73b9525800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:34.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.749+0000 7f73b9525800 20 searching for the correct realm 2024-04-23T18:29:34.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.749+0000 7f73b9525800 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564d4c3643a0 0x564d4c366860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.749+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c366f30 con 0x564d4c3643a0 2024-04-23T18:29:34.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.749+0000 7f73b4ab6640 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564d4c3643a0 0x564d4c366860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.750+0000 7f73b4ab6640 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564d4c3643a0 0x564d4c366860 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.750+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.750+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c366f30 con 0x564d4c35f9f0 2024-04-23T18:29:34.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.750+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73ac0c1070 con 0x564d4c35f9f0 2024-04-23T18:29:34.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.750+0000 7f73b52b7640 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f73ac0a3860 0x7f73ac08a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.750+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c366f30 con 0x7f73ac0a3860 2024-04-23T18:29:34.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.751+0000 7f73b5ab8640 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f73ac0a3860 0x7f73ac08a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.751+0000 7f73b5ab8640 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f73ac0a3860 0x7f73ac08a0c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.751+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4a0 con 0x7f73ac0a3860 2024-04-23T18:29:34.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.751+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35b000 2024-04-23T18:29:34.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.751+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c35b000 2024-04-23T18:29:34.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.751+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35b000 2024-04-23T18:29:34.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.752+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c35b000 2024-04-23T18:29:34.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.752+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x7f73ac0a3860 2024-04-23T18:29:34.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.752+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4a0 con 0x7f73ac0a3860 2024-04-23T18:29:34.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.752+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x7f73ac0a3860 2024-04-23T18:29:34.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.752+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f73b000a4a0 con 0x7f73ac0a3860 2024-04-23T18:29:34.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.752+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35f9f0 2024-04-23T18:29:34.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.752+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73ac0c1070 con 0x564d4c35f9f0 2024-04-23T18:29:34.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.752+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c3643a0 2024-04-23T18:29:34.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.753+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.753+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35b000 2024-04-23T18:29:34.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.753+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c35b000 2024-04-23T18:29:34.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.753+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x7f73ac0a3860 2024-04-23T18:29:34.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.753+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4a0 con 0x7f73ac0a3860 2024-04-23T18:29:34.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.753+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35b000 2024-04-23T18:29:34.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.754+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c35b000 2024-04-23T18:29:34.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.754+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35f9f0 2024-04-23T18:29:34.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.754+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f73ac0c1070 con 0x564d4c35f9f0 2024-04-23T18:29:34.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.754+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c3643a0 2024-04-23T18:29:34.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.754+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.754+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c3643a0 2024-04-23T18:29:34.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.754+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.754+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x7f73ac0a3860 2024-04-23T18:29:34.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.755+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4a0 con 0x7f73ac0a3860 2024-04-23T18:29:34.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.755+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c3643a0 2024-04-23T18:29:34.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.755+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.755+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c3643a0 2024-04-23T18:29:34.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.755+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.755+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35b000 2024-04-23T18:29:34.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.755+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c35b000 2024-04-23T18:29:34.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.755+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35b000 2024-04-23T18:29:34.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.756+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c35b000 2024-04-23T18:29:34.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.756+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x7f73ac0a3860 2024-04-23T18:29:34.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.756+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4a0 con 0x7f73ac0a3860 2024-04-23T18:29:34.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.756+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c3643a0 2024-04-23T18:29:34.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.756+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.756+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35f9f0 2024-04-23T18:29:34.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.756+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f73ac0c1070 con 0x564d4c35f9f0 2024-04-23T18:29:34.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.756+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35b000 2024-04-23T18:29:34.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.757+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4a0 con 0x564d4c35b000 2024-04-23T18:29:34.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.757+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x7f73ac0a3860 2024-04-23T18:29:34.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.757+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4a0 con 0x7f73ac0a3860 2024-04-23T18:29:34.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.757+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c3643a0 2024-04-23T18:29:34.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.757+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.757+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x7f73ac0a3860 2024-04-23T18:29:34.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.758+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b000a4a0 con 0x7f73ac0a3860 2024-04-23T18:29:34.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.758+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35f9f0 2024-04-23T18:29:34.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.758+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73ac0c1070 con 0x564d4c35f9f0 2024-04-23T18:29:34.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.758+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c3643a0 2024-04-23T18:29:34.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.758+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.758+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x7f73ac0a3860 2024-04-23T18:29:34.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.758+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.758+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35b000 2024-04-23T18:29:34.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f73b0040040 con 0x564d4c35b000 2024-04-23T18:29:34.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564d4c35ec90 con 0x564d4c35f9f0 2024-04-23T18:29:34.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73ac0d4040 con 0x564d4c35f9f0 2024-04-23T18:29:34.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:34.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:34.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:34.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:34.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:34.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:34.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c362cb0 con 0x564d4c35b000 2024-04-23T18:29:34.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x564d4c35b000 2024-04-23T18:29:34.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c362cb0 con 0x564d4c35b000 2024-04-23T18:29:34.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73b0040040 con 0x564d4c35b000 2024-04-23T18:29:34.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:34.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.759+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c362cb0 con 0x7f73ac0a3860 2024-04-23T18:29:34.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:34.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 20 zone default found 2024-04-23T18:29:34.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 4 Realm: () 2024-04-23T18:29:34.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:34.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:34.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:34.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 20 zonegroup default 2024-04-23T18:29:34.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c3635a0 con 0x7f73ac0a3860 2024-04-23T18:29:34.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c3635a0 con 0x564d4c3643a0 2024-04-23T18:29:34.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c368d90 con 0x564d4c3643a0 2024-04-23T18:29:34.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 20 started sync module instance, tier type = 2024-04-23T18:29:34.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:34.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.760+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c368230 con 0x564d4c35f9f0 2024-04-23T18:29:34.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.761+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73ac0d4040 con 0x564d4c35f9f0 2024-04-23T18:29:34.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.761+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889991112224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c3695e0 con 0x564d4c35f9f0 2024-04-23T18:29:34.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.761+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c369e30 con 0x564d4c35b000 2024-04-23T18:29:34.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.762+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94889991112224] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73ac0d4040 con 0x564d4c35f9f0 2024-04-23T18:29:34.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.763+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x564d4c35b000 2024-04-23T18:29:34.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.763+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889991115056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c369e30 con 0x564d4c35b000 2024-04-23T18:29:34.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.763+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36a920 con 0x564d4c3643a0 2024-04-23T18:29:34.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.764+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94889991115056] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x564d4c35b000 2024-04-23T18:29:34.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.764+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.764+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94889991117184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c369da0 con 0x564d4c3643a0 2024-04-23T18:29:34.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.764+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36b6e0 con 0x564d4c35f9f0 2024-04-23T18:29:34.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.765+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94889991117184] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.765+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73ac0d4040 con 0x564d4c35f9f0 2024-04-23T18:29:34.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.765+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94889991122192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36bad0 con 0x564d4c35f9f0 2024-04-23T18:29:34.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.765+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36c4f0 con 0x564d4c35b000 2024-04-23T18:29:34.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.766+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94889991122192] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73ac0d4040 con 0x564d4c35f9f0 2024-04-23T18:29:34.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.766+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x564d4c35b000 2024-04-23T18:29:34.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.766+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889991127008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36c4b0 con 0x564d4c35b000 2024-04-23T18:29:34.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.766+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36cf40 con 0x7f73ac0a3860 2024-04-23T18:29:34.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.767+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94889991127008] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x564d4c35b000 2024-04-23T18:29:34.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.767+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.767+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94889991129680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36cf40 con 0x7f73ac0a3860 2024-04-23T18:29:34.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.767+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36d950 con 0x7f73ac0a3860 2024-04-23T18:29:34.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.768+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94889991129680] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.768+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.768+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94889991123248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36d950 con 0x7f73ac0a3860 2024-04-23T18:29:34.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.769+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36e360 con 0x7f73ac0a3860 2024-04-23T18:29:34.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.770+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94889991123248] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.770+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.770+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889991132800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36e360 con 0x7f73ac0a3860 2024-04-23T18:29:34.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.770+0000 7f73b9525800 20 add_watcher() i=0 2024-04-23T18:29:34.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.770+0000 7f73b9525800 20 add_watcher() i=1 2024-04-23T18:29:34.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.770+0000 7f73b9525800 20 add_watcher() i=2 2024-04-23T18:29:34.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.770+0000 7f73b9525800 20 add_watcher() i=3 2024-04-23T18:29:34.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.770+0000 7f73b9525800 20 add_watcher() i=4 2024-04-23T18:29:34.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.770+0000 7f73b9525800 20 add_watcher() i=5 2024-04-23T18:29:34.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.770+0000 7f73b9525800 20 add_watcher() i=6 2024-04-23T18:29:34.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.771+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94889991132800] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.771+0000 7f73b9525800 20 add_watcher() i=7 2024-04-23T18:29:34.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.771+0000 7f73b9525800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:34.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.771+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c371680 con 0x564d4c35b000 2024-04-23T18:29:34.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.771+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f73b0040040 con 0x564d4c35b000 2024-04-23T18:29:34.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.771+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94889991135264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36e8f0 con 0x564d4c35b000 2024-04-23T18:29:34.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.772+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94889991135264] v32'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x564d4c35b000 2024-04-23T18:29:34.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.772+0000 7f726bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:34.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.773+0000 7f73b9525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:34.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.773+0000 7f73b9525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:34.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.773+0000 7f73b9525800 5 note: GC not initialized 2024-04-23T18:29:34.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.773+0000 7f726afe5640 20 reqs_thread_entry: start 2024-04-23T18:29:34.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.773+0000 7f73b9525800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:34.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.773+0000 7f73b9525800 20 Filter name: none 2024-04-23T18:29:34.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.773+0000 7f7268fe1640 20 reqs_thread_entry: start 2024-04-23T18:29:34.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.773+0000 7f73b9525800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:34.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.773+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.773+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c3a4ef0 con 0x564d4c35b000 2024-04-23T18:29:34.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f73b0040040 con 0x564d4c35b000 2024-04-23T18:29:34.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:34.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:34.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:34.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:34.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-23T18:29:34.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c3a6fd0 con 0x564d4c35f9f0 2024-04-23T18:29:34.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f73ac0d4040 con 0x564d4c35f9f0 2024-04-23T18:29:34.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:34.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-23T18:29:34.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:34.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 : miss 2024-04-23T18:29:34.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c3a8800 con 0x564d4c3643a0 2024-04-23T18:29:34.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:34.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:34.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:34.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:34.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:34.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 2024-04-23T18:29:34.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-23T18:29:34.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.774+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c3aa3f0 con 0x564d4c35f9f0 2024-04-23T18:29:34.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.775+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(65 foo.buckets [call] v32'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f73ac0d4040 con 0x564d4c35f9f0 2024-04-23T18:29:34.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.775+0000 7f73b9525800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-23T18:29:34.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.775+0000 7f73b9525800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.775+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c3a9f40 con 0x564d4c35f9f0 2024-04-23T18:29:34.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.776+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f73ac0d4040 con 0x564d4c35f9f0 2024-04-23T18:29:34.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.776+0000 7f73b9525800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:34.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.776+0000 7f73b9525800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-23T18:29:34.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.776+0000 7f73b9525800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:34.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.776+0000 7f73b9525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:34.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.776+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c3b03e0 con 0x564d4c35f9f0 2024-04-23T18:29:34.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.777+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f73ac0d4040 con 0x564d4c35f9f0 2024-04-23T18:29:34.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.777+0000 7f73b9525800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-23T18:29:34.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.777+0000 7f73b9525800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:34.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.777+0000 7f73b9525800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-23T18:29:34.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.777+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94889991388912 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564d4c3ad850 con 0x7f73ac0a3860 2024-04-23T18:29:34.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.778+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== watch-notify(notify (1) cookie 94889991123248 notify 137438953474 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7f73b0018c70 con 0x7f73ac0a3860 2024-04-23T18:29:34.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.778+0000 7f7298ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94889991123248 notifier 4476 bl.length()=338 2024-04-23T18:29:34.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.778+0000 7f7298ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-23T18:29:34.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.778+0000 7f7298ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:34.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.778+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(68 notify.6 [notify cookie 94889991388912 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.778+0000 7f7298ff9640 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7278003ea0 con 0x7f73ac0a3860 2024-04-23T18:29:34.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.778+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.778+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== watch-notify(notify_complete (2) cookie 94889991388912 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f73b0046450 con 0x7f73ac0a3860 2024-04-23T18:29:34.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.779+0000 7f726bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:34.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.779+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94889991135264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c370d70 con 0x564d4c35b000 2024-04-23T18:29:34.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.780+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94889991135264] v32'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x564d4c35b000 2024-04-23T18:29:34.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.780+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94889991112224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36e020 con 0x564d4c35f9f0 2024-04-23T18:29:34.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.781+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94889991112224] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73ac0d4040 con 0x564d4c35f9f0 2024-04-23T18:29:34.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.781+0000 7f73b9525800 20 remove_watcher() i=0 2024-04-23T18:29:34.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.781+0000 7f73b9525800 2 removed watcher, disabling cache 2024-04-23T18:29:34.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.781+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94889991115056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36e020 con 0x564d4c35b000 2024-04-23T18:29:34.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.782+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94889991115056] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x564d4c35b000 2024-04-23T18:29:34.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.782+0000 7f73b9525800 20 remove_watcher() i=1 2024-04-23T18:29:34.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.782+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94889991117184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36e020 con 0x564d4c3643a0 2024-04-23T18:29:34.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.783+0000 7f73b4ab6640 1 -- 172.21.15.119:0/1209253987 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94889991117184] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a8037040 con 0x564d4c3643a0 2024-04-23T18:29:34.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.783+0000 7f73b9525800 20 remove_watcher() i=2 2024-04-23T18:29:34.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.783+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94889991122192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c369980 con 0x564d4c35f9f0 2024-04-23T18:29:34.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.784+0000 7f73b52b7640 1 -- 172.21.15.119:0/1209253987 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94889991122192] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73ac0d4040 con 0x564d4c35f9f0 2024-04-23T18:29:34.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.784+0000 7f73b9525800 20 remove_watcher() i=3 2024-04-23T18:29:34.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.784+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94889991127008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36ad10 con 0x564d4c35b000 2024-04-23T18:29:34.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.785+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94889991127008] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x564d4c35b000 2024-04-23T18:29:34.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.785+0000 7f73b9525800 20 remove_watcher() i=4 2024-04-23T18:29:34.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.785+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94889991129680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c369980 con 0x7f73ac0a3860 2024-04-23T18:29:34.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.786+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94889991129680] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.786+0000 7f73b9525800 20 remove_watcher() i=5 2024-04-23T18:29:34.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.786+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94889991123248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c36bfe0 con 0x7f73ac0a3860 2024-04-23T18:29:34.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.787+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94889991123248] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.787+0000 7f73b9525800 20 remove_watcher() i=6 2024-04-23T18:29:34.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.787+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94889991132800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564d4c369980 con 0x7f73ac0a3860 2024-04-23T18:29:34.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94889991132800] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73b0040040 con 0x7f73ac0a3860 2024-04-23T18:29:34.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 20 remove_watcher() i=7 2024-04-23T18:29:34.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f73ac0a3860 msgr2=0x7f73ac08a0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f73ac0a3860 0x7f73ac08a0c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564d4c35b000 msgr2=0x564d4c35d4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564d4c35b000 0x564d4c35d4c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564d4c35f9f0 msgr2=0x564d4c361de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564d4c35f9f0 0x564d4c361de0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564d4c3643a0 msgr2=0x564d4c366860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564d4c3643a0 0x564d4c366860 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7280036e10 msgr2=0x7f72800392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7280036e10 0x7f72800392d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f73a800ffd0 tx=0x7f73a8023040 comp rx=0 tx=0).stop 2024-04-23T18:29:34.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 msgr2=0x564d4c34f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b5ab8640 1 -- 172.21.15.119:0/1209253987 reap_dead start 2024-04-23T18:29:34.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 0x564d4c34f810 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f73ac074fd0 tx=0x7f73ac050e70 comp rx=0 tx=0).stop 2024-04-23T18:29:34.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 shutdown_connections 2024-04-23T18:29:34.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 --2- 172.21.15.119:0/1209253987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c348520 0x564d4c34f810 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 >> 172.21.15.119:0/1209253987 conn(0x564d4c3447f0 msgr2=0x564d4c341e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 shutdown_connections 2024-04-23T18:29:34.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.788+0000 7f73b9525800 1 -- 172.21.15.119:0/1209253987 wait complete. 2024-04-23T18:29:34.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/4029923393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7290036e60 msgr2=0x7f7290039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 --2- 172.21.15.119:0/4029923393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7290036e60 0x7f7290039320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x564d4c321070 tx=0x7f73a8006000 comp rx=0 tx=0).stop 2024-04-23T18:29:34.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/4029923393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c33b320 msgr2=0x564d4c33b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 --2- 172.21.15.119:0/4029923393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c33b320 0x564d4c33b740 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f73ac077f80 tx=0x7f73ac05ce20 comp rx=0 tx=0).stop 2024-04-23T18:29:34.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/4029923393 shutdown_connections 2024-04-23T18:29:34.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 --2- 172.21.15.119:0/4029923393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7290036e60 0x7f7290039320 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 --2- 172.21.15.119:0/4029923393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c33b320 0x564d4c33b740 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/4029923393 >> 172.21.15.119:0/4029923393 conn(0x564d4c32f3c0 msgr2=0x564d4c32f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/4029923393 shutdown_connections 2024-04-23T18:29:34.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/4029923393 wait complete. 2024-04-23T18:29:34.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564d4c32a310 msgr2=0x564d4c32c760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564d4c32a310 0x564d4c32c760 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564d4c221210 msgr2=0x564d4c323b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564d4c221210 0x564d4c323b80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564d4c3263d0 msgr2=0x564d4c3287c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564d4c3263d0 0x564d4c3287c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f729c036e60 msgr2=0x7f729c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f729c036e60 0x7f729c039320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73a8000c00 tx=0x7f73a80013b0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 msgr2=0x564d4c31cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 --2- 172.21.15.119:0/3639519056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564d4c2208b0 0x564d4c31cb10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f73ac000c00 tx=0x7f73ac002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b5ab8640 1 -- 172.21.15.119:0/3639519056 reap_dead start 2024-04-23T18:29:34.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 shutdown_connections 2024-04-23T18:29:34.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 >> 172.21.15.119:0/3639519056 conn(0x564d4c21c430 msgr2=0x564d4c313c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 shutdown_connections 2024-04-23T18:29:34.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.789+0000 7f73b9525800 1 -- 172.21.15.119:0/3639519056 wait complete. 2024-04-23T18:29:34.801 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-23T18:29:34.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-23T18:29:34.801 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-23T18:29:34.892 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:34.892 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:34.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.900+0000 7f03b1f1f800 1 Processor -- start 2024-04-23T18:29:34.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.900+0000 7f03b1f1f800 1 -- start start 2024-04-23T18:29:34.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.901+0000 7f03b1f1f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56030d2bc400 0x56030d2c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.901+0000 7f03b1f1f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56030d16c560 con 0x56030d2ba8c0 2024-04-23T18:29:34.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.901+0000 7f03b1f1f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x56030d15de20 con 0x56030d2bc400 2024-04-23T18:29:34.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.901+0000 7f03ad3c2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56030d2bc400 0x56030d2c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.901+0000 7f03adbc3640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x56030d2ba8c0 0x56030d2bace0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40788/0 (socket says 172.21.15.119:40788) 2024-04-23T18:29:34.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.901+0000 7f03adbc3640 1 -- 172.21.15.119:0/3817352728 learned_addr learned my addr 172.21.15.119:0/3817352728 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:34.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.901+0000 7f03ad3c2640 1 -- 172.21.15.119:0/3817352728 >> v1:172.21.15.62:6789/0 conn(0x56030d2ba8c0 legacy=0x56030d2bace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.901+0000 7f03ad3c2640 1 -- 172.21.15.119:0/3817352728 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030d16be60 con 0x56030d2bc400 2024-04-23T18:29:34.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.901+0000 7f03acbc1640 1 -- 172.21.15.119:0/3817352728 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2766008275 0 0) 0x56030d16c560 con 0x56030d2ba8c0 2024-04-23T18:29:34.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.903+0000 7f03ad3c2640 1 --2- 172.21.15.119:0/3817352728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2bc400 0x56030d2c4f00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f03a400a470 tx=0x7f03a401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c14b11cd49db9e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.903+0000 7f03acbc1640 1 -- 172.21.15.119:0/3817352728 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a4057070 con 0x56030d2bc400 2024-04-23T18:29:34.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.903+0000 7f03acbc1640 1 -- 172.21.15.119:0/3817352728 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a404adc0 con 0x56030d2bc400 2024-04-23T18:29:34.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.903+0000 7f03acbc1640 1 -- 172.21.15.119:0/3817352728 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a4052590 con 0x56030d2bc400 2024-04-23T18:29:34.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.904+0000 7f03b1f1f800 1 -- 172.21.15.119:0/3817352728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2bc400 msgr2=0x56030d2c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.904+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/3817352728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2bc400 0x56030d2c4f00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f03a400a470 tx=0x7f03a401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:34.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.904+0000 7f03b1f1f800 1 -- 172.21.15.119:0/3817352728 shutdown_connections 2024-04-23T18:29:34.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.904+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/3817352728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2bc400 0x56030d2c4f00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.904+0000 7f03b1f1f800 1 -- 172.21.15.119:0/3817352728 >> 172.21.15.119:0/3817352728 conn(0x56030d2b6460 msgr2=0x56030d2b8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.904+0000 7f03b1f1f800 1 -- 172.21.15.119:0/3817352728 shutdown_connections 2024-04-23T18:29:34.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.904+0000 7f03b1f1f800 1 -- 172.21.15.119:0/3817352728 wait complete. 2024-04-23T18:29:34.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.916+0000 7f03b1f1f800 1 Processor -- start 2024-04-23T18:29:34.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.916+0000 7f03b1f1f800 1 -- start start 2024-04-23T18:29:34.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.916+0000 7f03b1f1f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2ba8c0 0x56030d3af610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.916+0000 7f03b1f1f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56030d207600 con 0x56030d2ba8c0 2024-04-23T18:29:34.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.916+0000 7f03adbc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2ba8c0 0x56030d3af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.916+0000 7f03adbc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2ba8c0 0x56030d3af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33676/0 (socket says 172.21.15.119:33676) 2024-04-23T18:29:34.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.916+0000 7f03adbc3640 1 -- 172.21.15.119:0/3138157368 learned_addr learned my addr 172.21.15.119:0/3138157368 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.916+0000 7f03adbc3640 1 -- 172.21.15.119:0/3138157368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030d17d860 con 0x56030d2ba8c0 2024-04-23T18:29:34.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.917+0000 7f03adbc3640 1 --2- 172.21.15.119:0/3138157368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2ba8c0 0x56030d3af610 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f03a000b210 tx=0x7f03a000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32c8d597739e6e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.917+0000 7f029be07640 1 -- 172.21.15.119:0/3138157368 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a0008070 con 0x56030d2ba8c0 2024-04-23T18:29:34.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.917+0000 7f029be07640 1 -- 172.21.15.119:0/3138157368 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a000d500 con 0x56030d2ba8c0 2024-04-23T18:29:34.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.917+0000 7f029be07640 1 -- 172.21.15.119:0/3138157368 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a000d840 con 0x56030d2ba8c0 2024-04-23T18:29:34.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.917+0000 7f03b1f1f800 1 -- 172.21.15.119:0/3138157368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2ba8c0 msgr2=0x56030d3af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.917+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/3138157368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2ba8c0 0x56030d3af610 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f03a000b210 tx=0x7f03a000b6d0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.917+0000 7f03b1f1f800 1 -- 172.21.15.119:0/3138157368 shutdown_connections 2024-04-23T18:29:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.917+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/3138157368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2ba8c0 0x56030d3af610 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.917+0000 7f03b1f1f800 1 -- 172.21.15.119:0/3138157368 >> 172.21.15.119:0/3138157368 conn(0x56030d2b6460 msgr2=0x56030d3aaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.918+0000 7f03b1f1f800 1 -- 172.21.15.119:0/3138157368 shutdown_connections 2024-04-23T18:29:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.918+0000 7f03b1f1f800 1 -- 172.21.15.119:0/3138157368 wait complete. 2024-04-23T18:29:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.918+0000 7f03b1f1f800 1 Processor -- start 2024-04-23T18:29:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.918+0000 7f03b1f1f800 1 -- start start 2024-04-23T18:29:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.918+0000 7f03b1f1f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2ba8c0 0x56030d3b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.918+0000 7f03b1f1f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56030d2c7720 con 0x56030d2ba8c0 2024-04-23T18:29:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.918+0000 7f03adbc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2ba8c0 0x56030d3b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.918+0000 7f03adbc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2ba8c0 0x56030d3b6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33682/0 (socket says 172.21.15.119:33682) 2024-04-23T18:29:34.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.918+0000 7f03adbc3640 1 -- 172.21.15.119:0/1122050615 learned_addr learned my addr 172.21.15.119:0/1122050615 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.918+0000 7f03adbc3640 1 -- 172.21.15.119:0/1122050615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030d17beb0 con 0x56030d2ba8c0 2024-04-23T18:29:34.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.919+0000 7f03adbc3640 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2ba8c0 0x56030d3b6f80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f03a0001e60 tx=0x7f03a0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.919+0000 7f029a604640 1 -- 172.21.15.119:0/1122050615 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a0019870 con 0x56030d2ba8c0 2024-04-23T18:29:34.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.919+0000 7f029a604640 1 -- 172.21.15.119:0/1122050615 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a0019a10 con 0x56030d2ba8c0 2024-04-23T18:29:34.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.919+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56030d3b74c0 con 0x56030d2ba8c0 2024-04-23T18:29:34.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.919+0000 7f029a604640 1 -- 172.21.15.119:0/1122050615 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a0019cf0 con 0x56030d2ba8c0 2024-04-23T18:29:34.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.919+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56030d3b79e0 con 0x56030d2ba8c0 2024-04-23T18:29:34.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.920+0000 7f029a604640 1 -- 172.21.15.119:0/1122050615 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f03a0017040 con 0x56030d2ba8c0 2024-04-23T18:29:34.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.920+0000 7f029a604640 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0294036eb0 0x7f0294039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.920+0000 7f029a604640 1 -- 172.21.15.119:0/1122050615 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f03a0015020 con 0x56030d2ba8c0 2024-04-23T18:29:34.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.920+0000 7f03ad3c2640 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0294036eb0 0x7f0294039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.920+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56030d2bc400 0x56030d3bdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.920+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3be570 con 0x56030d2bc400 2024-04-23T18:29:34.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.920+0000 7f03ae3c4640 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56030d2bc400 0x56030d3bdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.920+0000 7f03ad3c2640 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0294036eb0 0x7f0294039370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f03a4054000 tx=0x7f03a404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.920+0000 7f03ae3c4640 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56030d2bc400 0x56030d3bdff0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.921+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1122050615 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d2bc400 2024-04-23T18:29:34.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.921+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3bb5c0 con 0x56030d2bc400 2024-04-23T18:29:34.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.921+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1122050615 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d2bc400 2024-04-23T18:29:34.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.921+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56030d3c08a0 0x56030d3c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.921+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3c3380 con 0x56030d3c08a0 2024-04-23T18:29:34.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.921+0000 7f03adbc3640 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56030d3c08a0 0x56030d3c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.921+0000 7f03adbc3640 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56030d3c08a0 0x56030d3c2c90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.922+0000 7f03adbc3640 1 -- 172.21.15.119:0/1122050615 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f03a002d070 con 0x56030d3c08a0 2024-04-23T18:29:34.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.922+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3bf850 con 0x56030d2bc400 2024-04-23T18:29:34.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.922+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1122050615 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d2bc400 2024-04-23T18:29:34.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.922+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56030d3c4830 0x56030d3c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.922+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3c73e0 con 0x56030d3c4830 2024-04-23T18:29:34.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.922+0000 7f03ad3c2640 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56030d3c4830 0x56030d3c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.923+0000 7f03ad3c2640 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56030d3c4830 0x56030d3c6c80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.923+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1122050615 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f03a405a040 con 0x56030d3c4830 2024-04-23T18:29:34.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.923+0000 7f03b1f1f800 1 Processor -- start 2024-04-23T18:29:34.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.923+0000 7f03b1f1f800 1 -- start start 2024-04-23T18:29:34.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.923+0000 7f03b1f1f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3d5840 0x56030d3d5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.923+0000 7f03b1f1f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56030d1addf0 con 0x56030d3d5840 2024-04-23T18:29:34.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.924+0000 7f03adbc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3d5840 0x56030d3d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.924+0000 7f03adbc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3d5840 0x56030d3d5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33690/0 (socket says 172.21.15.119:33690) 2024-04-23T18:29:34.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.924+0000 7f03adbc3640 1 -- 172.21.15.119:0/4150180198 learned_addr learned my addr 172.21.15.119:0/4150180198 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.924+0000 7f03adbc3640 1 -- 172.21.15.119:0/4150180198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030d3d61a0 con 0x56030d3d5840 2024-04-23T18:29:34.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.924+0000 7f03adbc3640 1 --2- 172.21.15.119:0/4150180198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3d5840 0x56030d3d5c60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f03a004ba10 tx=0x7f03a004ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.924+0000 7f02937fe640 1 -- 172.21.15.119:0/4150180198 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a000ecf0 con 0x56030d3d5840 2024-04-23T18:29:34.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.924+0000 7f02937fe640 1 -- 172.21.15.119:0/4150180198 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a001c440 con 0x56030d3d5840 2024-04-23T18:29:34.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.924+0000 7f03b1f1f800 1 -- 172.21.15.119:0/4150180198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56030d3d6c10 con 0x56030d3d5840 2024-04-23T18:29:34.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.924+0000 7f02937fe640 1 -- 172.21.15.119:0/4150180198 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a001c720 con 0x56030d3d5840 2024-04-23T18:29:34.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.924+0000 7f03b1f1f800 1 -- 172.21.15.119:0/4150180198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56030d3d7110 con 0x56030d3d5840 2024-04-23T18:29:34.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.925+0000 7f02937fe640 1 -- 172.21.15.119:0/4150180198 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f03a004a0e0 con 0x56030d3d5840 2024-04-23T18:29:34.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.925+0000 7f02937fe640 1 --2- 172.21.15.119:0/4150180198 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0288036eb0 0x7f0288039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.925+0000 7f02937fe640 1 -- 172.21.15.119:0/4150180198 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f03a0027030 con 0x56030d3d5840 2024-04-23T18:29:34.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.925+0000 7f03ad3c2640 1 --2- 172.21.15.119:0/4150180198 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0288036eb0 0x7f0288039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.925+0000 7f03b1f1f800 1 Processor -- start 2024-04-23T18:29:34.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.925+0000 7f03b1f1f800 1 -- start start 2024-04-23T18:29:34.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.926+0000 7f03ad3c2640 1 --2- 172.21.15.119:0/4150180198 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0288036eb0 0x7f0288039370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x56030d3bee50 tx=0x7f03a4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.926+0000 7f03b1f1f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3e2b40 0x56030d3e2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.926+0000 7f03b1f1f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56030d3afd90 con 0x56030d3e2b40 2024-04-23T18:29:34.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.926+0000 7f03adbc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3e2b40 0x56030d3e2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.926+0000 7f03adbc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3e2b40 0x56030d3e2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33700/0 (socket says 172.21.15.119:33700) 2024-04-23T18:29:34.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.926+0000 7f03adbc3640 1 -- 172.21.15.119:0/785073326 learned_addr learned my addr 172.21.15.119:0/785073326 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.926+0000 7f03adbc3640 1 -- 172.21.15.119:0/785073326 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030d3e3530 con 0x56030d3e2b40 2024-04-23T18:29:34.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.926+0000 7f03adbc3640 1 --2- 172.21.15.119:0/785073326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3e2b40 0x56030d3e2f60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f03a000c440 tx=0x7f03a0026b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61f05ea0502423c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.926+0000 7f02917fa640 1 -- 172.21.15.119:0/785073326 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a0045170 con 0x56030d3e2b40 2024-04-23T18:29:34.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.926+0000 7f02917fa640 1 -- 172.21.15.119:0/785073326 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a004a3d0 con 0x56030d3e2b40 2024-04-23T18:29:34.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.926+0000 7f02917fa640 1 -- 172.21.15.119:0/785073326 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a0026430 con 0x56030d3e2b40 2024-04-23T18:29:34.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03b1f1f800 1 -- 172.21.15.119:0/785073326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3e2b40 msgr2=0x56030d3e2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/785073326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3e2b40 0x56030d3e2f60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f03a000c440 tx=0x7f03a0026b80 comp rx=0 tx=0).stop 2024-04-23T18:29:34.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03b1f1f800 1 -- 172.21.15.119:0/785073326 shutdown_connections 2024-04-23T18:29:34.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/785073326 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3e2b40 0x56030d3e2f60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03b1f1f800 1 -- 172.21.15.119:0/785073326 >> 172.21.15.119:0/785073326 conn(0x56030d3deea0 msgr2=0x56030d3dcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03b1f1f800 1 -- 172.21.15.119:0/785073326 shutdown_connections 2024-04-23T18:29:34.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03b1f1f800 1 -- 172.21.15.119:0/785073326 wait complete. 2024-04-23T18:29:34.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03b1f1f800 1 Processor -- start 2024-04-23T18:29:34.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03b1f1f800 1 -- start start 2024-04-23T18:29:34.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03b1f1f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3e2b40 0x56030d3e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03b1f1f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56030d3e3be0 con 0x56030d3e2b40 2024-04-23T18:29:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03adbc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3e2b40 0x56030d3e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03adbc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3e2b40 0x56030d3e9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33706/0 (socket says 172.21.15.119:33706) 2024-04-23T18:29:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.927+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 learned_addr learned my addr 172.21.15.119:0/1289052829 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.928+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56030d3ea520 con 0x56030d3e2b40 2024-04-23T18:29:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.928+0000 7f03adbc3640 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3e2b40 0x56030d3e9fe0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f03a0000fb0 tx=0x7f03a0018ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.928+0000 7f027f7fe640 1 -- 172.21.15.119:0/1289052829 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a0045c80 con 0x56030d3e2b40 2024-04-23T18:29:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.928+0000 7f027f7fe640 1 -- 172.21.15.119:0/1289052829 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a0067030 con 0x56030d3e2b40 2024-04-23T18:29:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.928+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56030d3ea520 con 0x56030d3e2b40 2024-04-23T18:29:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.928+0000 7f027f7fe640 1 -- 172.21.15.119:0/1289052829 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a000f610 con 0x56030d3e2b40 2024-04-23T18:29:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.928+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56030d3ea520 con 0x56030d3e2b40 2024-04-23T18:29:34.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.929+0000 7f027f7fe640 1 -- 172.21.15.119:0/1289052829 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f03a000f7b0 con 0x56030d3e2b40 2024-04-23T18:29:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.929+0000 7f027f7fe640 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0278036eb0 0x7f0278039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.929+0000 7f027f7fe640 1 -- 172.21.15.119:0/1289052829 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f03a005d070 con 0x56030d3e2b40 2024-04-23T18:29:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.929+0000 7f03ad3c2640 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0278036eb0 0x7f0278039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03ad3c2640 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0278036eb0 0x7f0278039370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f03a4000c00 tx=0x7f03a4060040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03b1f1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56030d3f56a0 0x56030d3f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f82b0 con 0x56030d3f56a0 2024-04-23T18:29:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03ae3c4640 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56030d3f56a0 0x56030d3f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03ae3c4640 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56030d3f56a0 0x56030d3f7b60 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d3f56a0 2024-04-23T18:29:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03b1f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03b1f1f800 20 realm 2024-04-23T18:29:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03b1f1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f86c0 con 0x56030d3f56a0 2024-04-23T18:29:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d3f56a0 2024-04-23T18:29:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03b1f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03b1f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03b1f1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.930+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f8f90 con 0x56030d3f56a0 2024-04-23T18:29:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.931+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d3f56a0 2024-04-23T18:29:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.931+0000 7f03b1f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.931+0000 7f03b1f1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.931+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3f56a0 2024-04-23T18:29:34.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.931+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d3f56a0 2024-04-23T18:29:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.931+0000 7f03b1f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.931+0000 7f03b1f1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.931+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56030d3fa090 0x56030d3fc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.931+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3fca90 con 0x56030d3fa090 2024-04-23T18:29:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.931+0000 7f03adbc3640 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56030d3fa090 0x56030d3fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.931+0000 7f03adbc3640 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56030d3fa090 0x56030d3fc480 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.931+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f03a0073070 con 0x56030d3fa090 2024-04-23T18:29:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.932+0000 7f03b1f1f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.932+0000 7f03b1f1f800 20 searching for the correct realm 2024-04-23T18:29:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.932+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56030d3fea40 0x56030d400f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.932+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d4015d0 con 0x56030d3fea40 2024-04-23T18:29:34.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.932+0000 7f03ad3c2640 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56030d3fea40 0x56030d400f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.932+0000 7f03ad3c2640 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56030d3fea40 0x56030d400f00 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.932+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.932+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d4015d0 con 0x56030d3fa090 2024-04-23T18:29:34.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.933+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a0073070 con 0x56030d3fa090 2024-04-23T18:29:34.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.933+0000 7f03adbc3640 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f03a0062be0 0x7f03a0067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:34.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.933+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d4015d0 con 0x7f03a0062be0 2024-04-23T18:29:34.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.933+0000 7f03ae3c4640 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f03a0062be0 0x7f03a0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:34.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.933+0000 7f03ae3c4640 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f03a0062be0 0x7f03a0067560 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:34.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.933+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x7f03a0062be0 2024-04-23T18:29:34.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.933+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3f56a0 2024-04-23T18:29:34.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.934+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d3f56a0 2024-04-23T18:29:34.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.934+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3f56a0 2024-04-23T18:29:34.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.934+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d3f56a0 2024-04-23T18:29:34.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.934+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x7f03a0062be0 2024-04-23T18:29:34.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.934+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x7f03a0062be0 2024-04-23T18:29:34.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.934+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x7f03a0062be0 2024-04-23T18:29:34.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.934+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f03a800a4a0 con 0x7f03a0062be0 2024-04-23T18:29:34.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.935+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3fa090 2024-04-23T18:29:34.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.935+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a0073070 con 0x56030d3fa090 2024-04-23T18:29:34.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.935+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3fea40 2024-04-23T18:29:34.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.935+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.935+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3f56a0 2024-04-23T18:29:34.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.935+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d3f56a0 2024-04-23T18:29:34.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.935+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x7f03a0062be0 2024-04-23T18:29:34.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.935+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x7f03a0062be0 2024-04-23T18:29:34.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.936+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3f56a0 2024-04-23T18:29:34.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.936+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d3f56a0 2024-04-23T18:29:34.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.936+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3fa090 2024-04-23T18:29:34.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.936+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f03a0073070 con 0x56030d3fa090 2024-04-23T18:29:34.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.936+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3fea40 2024-04-23T18:29:34.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.936+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.936+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3fea40 2024-04-23T18:29:34.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.936+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.936+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x7f03a0062be0 2024-04-23T18:29:34.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.937+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x7f03a0062be0 2024-04-23T18:29:34.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.937+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3fea40 2024-04-23T18:29:34.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.937+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.937+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3fea40 2024-04-23T18:29:34.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.937+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.937+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3f56a0 2024-04-23T18:29:34.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.938+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d3f56a0 2024-04-23T18:29:34.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.938+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3f56a0 2024-04-23T18:29:34.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.938+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d3f56a0 2024-04-23T18:29:34.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.938+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x7f03a0062be0 2024-04-23T18:29:34.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.938+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x7f03a0062be0 2024-04-23T18:29:34.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.938+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3fea40 2024-04-23T18:29:34.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.938+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.938+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3fa090 2024-04-23T18:29:34.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.939+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f03a0073070 con 0x56030d3fa090 2024-04-23T18:29:34.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.939+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3f56a0 2024-04-23T18:29:34.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.939+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x56030d3f56a0 2024-04-23T18:29:34.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.939+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x7f03a0062be0 2024-04-23T18:29:34.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.939+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x7f03a0062be0 2024-04-23T18:29:34.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.939+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3fea40 2024-04-23T18:29:34.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.939+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.939+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x7f03a0062be0 2024-04-23T18:29:34.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.940+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a800a4a0 con 0x7f03a0062be0 2024-04-23T18:29:34.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.940+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3fa090 2024-04-23T18:29:34.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.940+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a0073070 con 0x56030d3fa090 2024-04-23T18:29:34.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.940+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3fea40 2024-04-23T18:29:34.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.940+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.940+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x7f03a0062be0 2024-04-23T18:29:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.940+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.940+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3f56a0 2024-04-23T18:29:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f03a8040040 con 0x56030d3f56a0 2024-04-23T18:29:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56030d3f9330 con 0x56030d3fa090 2024-04-23T18:29:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03a0087040 con 0x56030d3fa090 2024-04-23T18:29:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:34.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3fd350 con 0x56030d3f56a0 2024-04-23T18:29:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x56030d3f56a0 2024-04-23T18:29:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3fd350 con 0x56030d3f56a0 2024-04-23T18:29:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f03a8040040 con 0x56030d3f56a0 2024-04-23T18:29:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.941+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3fd350 con 0x7f03a0062be0 2024-04-23T18:29:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03b1f1f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03b1f1f800 20 zone default found 2024-04-23T18:29:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03b1f1f800 4 Realm: () 2024-04-23T18:29:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03b1f1f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03b1f1f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03b1f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03b1f1f800 20 zonegroup default 2024-04-23T18:29:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03b1f1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3fdc40 con 0x7f03a0062be0 2024-04-23T18:29:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03b1f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03b1f1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.942+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d3fdc40 con 0x56030d3fea40 2024-04-23T18:29:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.943+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.943+0000 7f03b1f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.943+0000 7f03b1f1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.943+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d403430 con 0x56030d3fea40 2024-04-23T18:29:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.943+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.943+0000 7f03b1f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.943+0000 7f03b1f1f800 20 started sync module instance, tier type = 2024-04-23T18:29:34.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.943+0000 7f03b1f1f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:34.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.943+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d4028d0 con 0x56030d3fa090 2024-04-23T18:29:34.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.944+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a0087040 con 0x56030d3fa090 2024-04-23T18:29:34.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.944+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94571107197984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d4037d0 con 0x56030d3fa090 2024-04-23T18:29:34.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.944+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d404060 con 0x56030d3f56a0 2024-04-23T18:29:34.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.945+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94571107197984] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a0087040 con 0x56030d3fa090 2024-04-23T18:29:34.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.945+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x56030d3f56a0 2024-04-23T18:29:34.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.945+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94571107200240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d404450 con 0x56030d3f56a0 2024-04-23T18:29:34.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.945+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d404eb0 con 0x56030d3fea40 2024-04-23T18:29:34.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.946+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.946+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94571107207568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d405750 con 0x56030d3fea40 2024-04-23T18:29:34.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.946+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d406230 con 0x56030d3fa090 2024-04-23T18:29:34.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.946+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94571107200240] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x56030d3f56a0 2024-04-23T18:29:34.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.947+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94571107207568] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.947+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a0087040 con 0x56030d3fa090 2024-04-23T18:29:34.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.947+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94571107212608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d406620 con 0x56030d3fa090 2024-04-23T18:29:34.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.947+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d406e70 con 0x56030d3f56a0 2024-04-23T18:29:34.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.948+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94571107212608] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a0087040 con 0x56030d3fa090 2024-04-23T18:29:34.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.948+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x56030d3f56a0 2024-04-23T18:29:34.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.948+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94571107214960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d406f40 con 0x56030d3f56a0 2024-04-23T18:29:34.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.948+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d407900 con 0x7f03a0062be0 2024-04-23T18:29:34.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.949+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94571107214960] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x56030d3f56a0 2024-04-23T18:29:34.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.949+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.950+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94571107219024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d406f40 con 0x7f03a0062be0 2024-04-23T18:29:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.950+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d408310 con 0x7f03a0062be0 2024-04-23T18:29:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.950+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94571107219024] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.951+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.951+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94571107216016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d408510 con 0x7f03a0062be0 2024-04-23T18:29:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.951+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d408d60 con 0x7f03a0062be0 2024-04-23T18:29:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.951+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94571107216016] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.951+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.952+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94571107222080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d408bb0 con 0x7f03a0062be0 2024-04-23T18:29:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.952+0000 7f03b1f1f800 20 add_watcher() i=0 2024-04-23T18:29:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.952+0000 7f03b1f1f800 20 add_watcher() i=1 2024-04-23T18:29:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.952+0000 7f03b1f1f800 20 add_watcher() i=2 2024-04-23T18:29:34.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.952+0000 7f03b1f1f800 20 add_watcher() i=3 2024-04-23T18:29:34.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.952+0000 7f03b1f1f800 20 add_watcher() i=4 2024-04-23T18:29:34.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.952+0000 7f03b1f1f800 20 add_watcher() i=5 2024-04-23T18:29:34.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.952+0000 7f03b1f1f800 20 add_watcher() i=6 2024-04-23T18:29:34.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.952+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94571107222080] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.952+0000 7f03b1f1f800 20 add_watcher() i=7 2024-04-23T18:29:34.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.952+0000 7f03b1f1f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:34.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.952+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d40c120 con 0x56030d3f56a0 2024-04-23T18:29:34.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.953+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f03a8040040 con 0x56030d3f56a0 2024-04-23T18:29:34.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.953+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94571107223136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d4095d0 con 0x56030d3f56a0 2024-04-23T18:29:34.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.954+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94571107223136] v32'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x56030d3f56a0 2024-04-23T18:29:34.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.954+0000 7f025f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:34.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.954+0000 7f03b1f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:34.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.954+0000 7f03b1f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:34.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.954+0000 7f03b1f1f800 5 note: GC not initialized 2024-04-23T18:29:34.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.954+0000 7f025e7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:34.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.954+0000 7f03b1f1f800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:34.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.954+0000 7f03b1f1f800 20 Filter name: none 2024-04-23T18:29:34.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.954+0000 7f01cffff640 20 reqs_thread_entry: start 2024-04-23T18:29:34.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-23T18:29:34.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d43f960 con 0x7f03a0062be0 2024-04-23T18:29:34.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-23T18:29:34.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-23T18:29:34.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-23T18:29:34.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:34.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d43dfa0 con 0x7f03a0062be0 2024-04-23T18:29:34.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:34.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-23T18:29:34.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-23T18:29:34.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-23T18:29:34.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-23T18:29:34.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.955+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d43e870 con 0x7f03a0062be0 2024-04-23T18:29:34.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f03b1f1f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-23T18:29:34.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f03b1f1f800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-23T18:29:34.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f03b1f1f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-23T18:29:34.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94571107443648 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d443400 con 0x7f03a0062be0 2024-04-23T18:29:34.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== watch-notify(notify (1) cookie 94571107219024 notify 137438953475 ret 0) ==== 598+0+0 (crc 0 0 0) 0x56030d43ec10 con 0x7f03a0062be0 2024-04-23T18:29:34.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f02917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94571107219024 notifier 4483 bl.length()=556 2024-04-23T18:29:34.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(65 notify.5 [notify cookie 94571107443648 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f02917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-23T18:29:34.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f02917fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-23T18:29:34.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f02917fa640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0270003ea0 con 0x7f03a0062be0 2024-04-23T18:29:34.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== watch-notify(notify_complete (2) cookie 94571107443648 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56030d43f3b0 con 0x7f03a0062be0 2024-04-23T18:29:34.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.957+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d440f30 con 0x7f03a0062be0 2024-04-23T18:29:34.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.959+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.959+0000 7f03b1f1f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-23T18:29:34.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.959+0000 7f03b1f1f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-23T18:29:34.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.959+0000 7f03b1f1f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-23T18:29:34.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.959+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94571107443568 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56030d443400 con 0x56030d3fea40 2024-04-23T18:29:34.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.959+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== watch-notify(notify (1) cookie 94571107207568 notify 137438953474 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56030d16be60 con 0x56030d3fea40 2024-04-23T18:29:34.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.959+0000 7f02917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94571107207568 notifier 4483 bl.length()=177 2024-04-23T18:29:34.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.959+0000 7f02917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-23T18:29:34.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.959+0000 7f02917fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-23T18:29:34.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.959+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(68 notify.2 [notify cookie 94571107443568 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.959+0000 7f02917fa640 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0270003ea0 con 0x56030d3fea40 2024-04-23T18:29:34.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.959+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== watch-notify(notify_complete (2) cookie 94571107443568 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f03a4052680 con 0x56030d3fea40 2024-04-23T18:29:34.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.959+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.969 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-23T18:29:34.956676Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:34.956664Z","tags":[],"group_ids":[]} 2024-04-23T18:29:34.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.960+0000 7f025f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:34.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.960+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94571107223136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d40bca0 con 0x56030d3f56a0 2024-04-23T18:29:34.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.961+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94571107223136] v32'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x56030d3f56a0 2024-04-23T18:29:34.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.961+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94571107197984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d408660 con 0x56030d3fa090 2024-04-23T18:29:34.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.962+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94571107197984] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a0087040 con 0x56030d3fa090 2024-04-23T18:29:34.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.962+0000 7f03b1f1f800 20 remove_watcher() i=0 2024-04-23T18:29:34.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.962+0000 7f03b1f1f800 2 removed watcher, disabling cache 2024-04-23T18:29:34.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.962+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94571107200240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d408660 con 0x56030d3f56a0 2024-04-23T18:29:34.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.963+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94571107200240] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x56030d3f56a0 2024-04-23T18:29:34.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.963+0000 7f03b1f1f800 20 remove_watcher() i=1 2024-04-23T18:29:34.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.963+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94571107207568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d408660 con 0x56030d3fea40 2024-04-23T18:29:34.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.964+0000 7f03ad3c2640 1 -- 172.21.15.119:0/1289052829 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94571107207568] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a4070070 con 0x56030d3fea40 2024-04-23T18:29:34.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.964+0000 7f03b1f1f800 20 remove_watcher() i=2 2024-04-23T18:29:34.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.964+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94571107212608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d408660 con 0x56030d3fa090 2024-04-23T18:29:34.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.965+0000 7f03adbc3640 1 -- 172.21.15.119:0/1289052829 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94571107212608] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a0087040 con 0x56030d3fa090 2024-04-23T18:29:34.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.965+0000 7f03b1f1f800 20 remove_watcher() i=3 2024-04-23T18:29:34.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.965+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94571107214960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d405d40 con 0x56030d3f56a0 2024-04-23T18:29:34.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.966+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94571107214960] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x56030d3f56a0 2024-04-23T18:29:34.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.966+0000 7f03b1f1f800 20 remove_watcher() i=4 2024-04-23T18:29:34.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.966+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94571107219024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d408660 con 0x7f03a0062be0 2024-04-23T18:29:34.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.967+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94571107219024] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.967+0000 7f03b1f1f800 20 remove_watcher() i=5 2024-04-23T18:29:34.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.967+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94571107216016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d405d40 con 0x7f03a0062be0 2024-04-23T18:29:34.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.969+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94571107216016] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.969+0000 7f03b1f1f800 20 remove_watcher() i=6 2024-04-23T18:29:34.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.969+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94571107222080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56030d408660 con 0x7f03a0062be0 2024-04-23T18:29:34.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94571107222080] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03a8040040 con 0x7f03a0062be0 2024-04-23T18:29:34.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 20 remove_watcher() i=7 2024-04-23T18:29:34.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f03a0062be0 msgr2=0x7f03a0067560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f03a0062be0 0x7f03a0067560 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56030d3f56a0 msgr2=0x56030d3f7b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56030d3f56a0 0x56030d3f7b60 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56030d3fa090 msgr2=0x56030d3fc480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56030d3fa090 0x56030d3fc480 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56030d3fea40 msgr2=0x56030d400f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56030d3fea40 0x56030d400f00 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0278036eb0 msgr2=0x7f0278039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0278036eb0 0x7f0278039370 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f03a4000c00 tx=0x7f03a4060040 comp rx=0 tx=0).stop 2024-04-23T18:29:34.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3e2b40 msgr2=0x56030d3e9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1289052829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3e2b40 0x56030d3e9fe0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f03a0000fb0 tx=0x7f03a0018ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 reap_dead start 2024-04-23T18:29:34.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1289052829 reap_dead start 2024-04-23T18:29:34.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 shutdown_connections 2024-04-23T18:29:34.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 >> 172.21.15.119:0/1289052829 conn(0x56030d3deea0 msgr2=0x56030d3dc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 shutdown_connections 2024-04-23T18:29:34.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.970+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1289052829 wait complete. 2024-04-23T18:29:34.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/4150180198 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0288036eb0 msgr2=0x7f0288039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/4150180198 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0288036eb0 0x7f0288039370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x56030d3bee50 tx=0x7f03a4005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:34.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/4150180198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3d5840 msgr2=0x56030d3d5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/4150180198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3d5840 0x56030d3d5c60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f03a004ba10 tx=0x7f03a004ced0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/4150180198 shutdown_connections 2024-04-23T18:29:34.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/4150180198 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0288036eb0 0x7f0288039370 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/4150180198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d3d5840 0x56030d3d5c60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/4150180198 >> 172.21.15.119:0/4150180198 conn(0x56030d3c98e0 msgr2=0x56030d3c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/4150180198 shutdown_connections 2024-04-23T18:29:34.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/4150180198 wait complete. 2024-04-23T18:29:34.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56030d3c4830 msgr2=0x56030d3c6c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x56030d3c4830 0x56030d3c6c80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56030d2bc400 msgr2=0x56030d3bdff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56030d2bc400 0x56030d3bdff0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56030d3c08a0 msgr2=0x56030d3c2c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56030d3c08a0 0x56030d3c2c90 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0294036eb0 msgr2=0x7f0294039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0294036eb0 0x7f0294039370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f03a4054000 tx=0x7f03a404e000 comp rx=0 tx=0).stop 2024-04-23T18:29:34.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2ba8c0 msgr2=0x56030d3b6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:34.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 --2- 172.21.15.119:0/1122050615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56030d2ba8c0 0x56030d3b6f80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f03a0001e60 tx=0x7f03a0000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:34.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03ae3c4640 1 -- 172.21.15.119:0/1122050615 reap_dead start 2024-04-23T18:29:34.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 shutdown_connections 2024-04-23T18:29:34.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 >> 172.21.15.119:0/1122050615 conn(0x56030d2b6460 msgr2=0x56030d3a97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:34.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 shutdown_connections 2024-04-23T18:29:34.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:34.971+0000 7f03b1f1f800 1 -- 172.21.15.119:0/1122050615 wait complete. 2024-04-23T18:29:34.980 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-23T18:29:34.956676Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:34.956664Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:34.986 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-23T18:29:34.990 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:34.990 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-04-23T18:29:34.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-04-23T18:29:34.990 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-04-23T18:29:35.032 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:35.032 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:35.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.040+0000 7f2305725800 1 Processor -- start 2024-04-23T18:29:35.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.040+0000 7f2305725800 1 -- start start 2024-04-23T18:29:35.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.040+0000 7f2305725800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55672b4d5050 0x55672b564b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.040+0000 7f2305725800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55672b412560 con 0x55672b5650a0 2024-04-23T18:29:35.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.040+0000 7f2305725800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55672b403e20 con 0x55672b4d5050 2024-04-23T18:29:35.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.040+0000 7f23014b7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55672b4d5050 0x55672b564b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.040+0000 7f2300cb6640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55672b5650a0 0x55672b567540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40790/0 (socket says 172.21.15.119:40790) 2024-04-23T18:29:35.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.040+0000 7f2300cb6640 1 -- 172.21.15.119:0/4205009435 learned_addr learned my addr 172.21.15.119:0/4205009435 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:35.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.041+0000 7f23014b7640 1 -- 172.21.15.119:0/4205009435 >> v1:172.21.15.62:6789/0 conn(0x55672b5650a0 legacy=0x55672b567540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.041+0000 7f23014b7640 1 -- 172.21.15.119:0/4205009435 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55672b411e60 con 0x55672b4d5050 2024-04-23T18:29:35.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.041+0000 7f22f3fff640 1 -- 172.21.15.119:0/4205009435 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3686555786 0 0) 0x55672b412560 con 0x55672b5650a0 2024-04-23T18:29:35.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.042+0000 7f23014b7640 1 --2- 172.21.15.119:0/4205009435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b564b00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f22f400a470 tx=0x7f22f401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6593d52f02d45d06 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.043+0000 7f22f3fff640 1 -- 172.21.15.119:0/4205009435 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f4057070 con 0x55672b4d5050 2024-04-23T18:29:35.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.043+0000 7f22f3fff640 1 -- 172.21.15.119:0/4205009435 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f4052570 con 0x55672b4d5050 2024-04-23T18:29:35.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.043+0000 7f22f3fff640 1 -- 172.21.15.119:0/4205009435 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f4052870 con 0x55672b4d5050 2024-04-23T18:29:35.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.043+0000 7f2305725800 1 -- 172.21.15.119:0/4205009435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 msgr2=0x55672b564b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.043+0000 7f2305725800 1 --2- 172.21.15.119:0/4205009435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b564b00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f22f400a470 tx=0x7f22f401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:35.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.043+0000 7f2305725800 1 -- 172.21.15.119:0/4205009435 shutdown_connections 2024-04-23T18:29:35.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.043+0000 7f2305725800 1 --2- 172.21.15.119:0/4205009435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b564b00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.043+0000 7f2305725800 1 -- 172.21.15.119:0/4205009435 >> 172.21.15.119:0/4205009435 conn(0x55672b55c420 msgr2=0x55672b55e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.043+0000 7f2305725800 1 -- 172.21.15.119:0/4205009435 shutdown_connections 2024-04-23T18:29:35.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.043+0000 7f2305725800 1 -- 172.21.15.119:0/4205009435 wait complete. 2024-04-23T18:29:35.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.055+0000 7f2305725800 1 Processor -- start 2024-04-23T18:29:35.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.055+0000 7f2305725800 1 -- start start 2024-04-23T18:29:35.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.055+0000 7f2305725800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b562430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.055+0000 7f2305725800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55672b4ad5b0 con 0x55672b4d5050 2024-04-23T18:29:35.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.055+0000 7f23014b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b562430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.055+0000 7f23014b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b562430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33714/0 (socket says 172.21.15.119:33714) 2024-04-23T18:29:35.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.055+0000 7f23014b7640 1 -- 172.21.15.119:0/1930729039 learned_addr learned my addr 172.21.15.119:0/1930729039 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.055+0000 7f23014b7640 1 -- 172.21.15.119:0/1930729039 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55672b423860 con 0x55672b4d5050 2024-04-23T18:29:35.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.056+0000 7f23014b7640 1 --2- 172.21.15.119:0/1930729039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b562430 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f22f4055040 tx=0x7f22f404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bca3474014ae3b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.056+0000 7f21ef606640 1 -- 172.21.15.119:0/1930729039 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f4057070 con 0x55672b4d5050 2024-04-23T18:29:35.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.056+0000 7f21ef606640 1 -- 172.21.15.119:0/1930729039 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f4063070 con 0x55672b4d5050 2024-04-23T18:29:35.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.056+0000 7f21ef606640 1 -- 172.21.15.119:0/1930729039 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f4052720 con 0x55672b4d5050 2024-04-23T18:29:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.056+0000 7f2305725800 1 -- 172.21.15.119:0/1930729039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 msgr2=0x55672b562430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.056+0000 7f2305725800 1 --2- 172.21.15.119:0/1930729039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b562430 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f22f4055040 tx=0x7f22f404c000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.056+0000 7f2305725800 1 -- 172.21.15.119:0/1930729039 shutdown_connections 2024-04-23T18:29:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.056+0000 7f2305725800 1 --2- 172.21.15.119:0/1930729039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b562430 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.056+0000 7f2305725800 1 -- 172.21.15.119:0/1930729039 >> 172.21.15.119:0/1930729039 conn(0x55672b55c420 msgr2=0x55672b64e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.056+0000 7f2305725800 1 -- 172.21.15.119:0/1930729039 shutdown_connections 2024-04-23T18:29:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.057+0000 7f2305725800 1 -- 172.21.15.119:0/1930729039 wait complete. 2024-04-23T18:29:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.057+0000 7f2305725800 1 Processor -- start 2024-04-23T18:29:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.057+0000 7f2305725800 1 -- start start 2024-04-23T18:29:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.057+0000 7f2305725800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b65caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.057+0000 7f2305725800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55672b569010 con 0x55672b4d5050 2024-04-23T18:29:35.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.057+0000 7f23014b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b65caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.057+0000 7f23014b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b65caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33730/0 (socket says 172.21.15.119:33730) 2024-04-23T18:29:35.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.057+0000 7f23014b7640 1 -- 172.21.15.119:0/3783936388 learned_addr learned my addr 172.21.15.119:0/3783936388 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.058+0000 7f23014b7640 1 -- 172.21.15.119:0/3783936388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55672b421eb0 con 0x55672b4d5050 2024-04-23T18:29:35.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.058+0000 7f23014b7640 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b65caa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f22f4060040 tx=0x7f22f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.058+0000 7f21ede03640 1 -- 172.21.15.119:0/3783936388 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f4052e30 con 0x55672b4d5050 2024-04-23T18:29:35.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.058+0000 7f21ede03640 1 -- 172.21.15.119:0/3783936388 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f406c070 con 0x55672b4d5050 2024-04-23T18:29:35.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.058+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55672b65cfe0 con 0x55672b4d5050 2024-04-23T18:29:35.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.058+0000 7f21ede03640 1 -- 172.21.15.119:0/3783936388 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f405e5f0 con 0x55672b4d5050 2024-04-23T18:29:35.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.058+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55672b65d560 con 0x55672b4d5050 2024-04-23T18:29:35.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.059+0000 7f21ede03640 1 -- 172.21.15.119:0/3783936388 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f22f405e790 con 0x55672b4d5050 2024-04-23T18:29:35.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.059+0000 7f21ede03640 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21e8036e60 0x7f21e8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.059+0000 7f21ede03640 1 -- 172.21.15.119:0/3783936388 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f22f408efb0 con 0x55672b4d5050 2024-04-23T18:29:35.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.059+0000 7f2300cb6640 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21e8036e60 0x7f21e8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.059+0000 7f2305725800 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55672b5650a0 0x55672b663b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.059+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b664090 con 0x55672b5650a0 2024-04-23T18:29:35.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.059+0000 7f2301cb8640 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55672b5650a0 0x55672b663b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.059+0000 7f2300cb6640 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21e8036e60 0x7f21e8039320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22f8000c00 tx=0x7f22f80013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.059+0000 7f2301cb8640 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55672b5650a0 0x55672b663b10 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.060+0000 7f2301cb8640 1 -- 172.21.15.119:0/3783936388 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b5650a0 2024-04-23T18:29:35.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.060+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b6610c0 con 0x55672b5650a0 2024-04-23T18:29:35.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.060+0000 7f2301cb8640 1 -- 172.21.15.119:0/3783936388 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b5650a0 2024-04-23T18:29:35.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.060+0000 7f2305725800 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55672b6663a0 0x55672b668790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.060+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b668e60 con 0x55672b6663a0 2024-04-23T18:29:35.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.060+0000 7f23014b7640 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55672b6663a0 0x55672b668790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.060+0000 7f23014b7640 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55672b6663a0 0x55672b668790 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.061+0000 7f23014b7640 1 -- 172.21.15.119:0/3783936388 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f22f4071990 con 0x55672b6663a0 2024-04-23T18:29:35.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.061+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b665350 con 0x55672b5650a0 2024-04-23T18:29:35.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.061+0000 7f2301cb8640 1 -- 172.21.15.119:0/3783936388 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b5650a0 2024-04-23T18:29:35.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.061+0000 7f2305725800 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55672b66a2a0 0x55672b66c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.061+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b66cef0 con 0x55672b66a2a0 2024-04-23T18:29:35.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.061+0000 7f2300cb6640 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55672b66a2a0 0x55672b66c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.061+0000 7f2300cb6640 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55672b66a2a0 0x55672b66c760 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.062+0000 7f2300cb6640 1 -- 172.21.15.119:0/3783936388 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f22f800f670 con 0x55672b66a2a0 2024-04-23T18:29:35.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.062+0000 7f2305725800 1 Processor -- start 2024-04-23T18:29:35.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.062+0000 7f2305725800 1 -- start start 2024-04-23T18:29:35.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.062+0000 7f2305725800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b67b3a0 0x55672b67b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.062+0000 7f2305725800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55672b453df0 con 0x55672b67b3a0 2024-04-23T18:29:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.062+0000 7f23014b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b67b3a0 0x55672b67b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.062+0000 7f23014b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b67b3a0 0x55672b67b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33738/0 (socket says 172.21.15.119:33738) 2024-04-23T18:29:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.062+0000 7f23014b7640 1 -- 172.21.15.119:0/1264767952 learned_addr learned my addr 172.21.15.119:0/1264767952 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.063+0000 7f23014b7640 1 -- 172.21.15.119:0/1264767952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55672b67bd00 con 0x55672b67b3a0 2024-04-23T18:29:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.063+0000 7f23014b7640 1 --2- 172.21.15.119:0/1264767952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b67b3a0 0x55672b67b7c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f22f40529c0 tx=0x7f22f4066e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.063+0000 7f21e6ffd640 1 -- 172.21.15.119:0/1264767952 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f4073c60 con 0x55672b67b3a0 2024-04-23T18:29:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.063+0000 7f21e6ffd640 1 -- 172.21.15.119:0/1264767952 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f4058040 con 0x55672b67b3a0 2024-04-23T18:29:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.063+0000 7f2305725800 1 -- 172.21.15.119:0/1264767952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55672b67c770 con 0x55672b67b3a0 2024-04-23T18:29:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.063+0000 7f21e6ffd640 1 -- 172.21.15.119:0/1264767952 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f407a3f0 con 0x55672b67b3a0 2024-04-23T18:29:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.063+0000 7f2305725800 1 -- 172.21.15.119:0/1264767952 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55672b67cc70 con 0x55672b67b3a0 2024-04-23T18:29:35.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.064+0000 7f21e6ffd640 1 -- 172.21.15.119:0/1264767952 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f22f4098060 con 0x55672b67b3a0 2024-04-23T18:29:35.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.064+0000 7f21e6ffd640 1 --2- 172.21.15.119:0/1264767952 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21d8036eb0 0x7f21d8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.064+0000 7f21e6ffd640 1 -- 172.21.15.119:0/1264767952 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f22f408a070 con 0x55672b67b3a0 2024-04-23T18:29:35.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.064+0000 7f2300cb6640 1 --2- 172.21.15.119:0/1264767952 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21d8036eb0 0x7f21d8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.064+0000 7f2305725800 1 Processor -- start 2024-04-23T18:29:35.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.064+0000 7f2305725800 1 -- start start 2024-04-23T18:29:35.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.064+0000 7f2300cb6640 1 --2- 172.21.15.119:0/1264767952 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21d8036eb0 0x7f21d8039370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55672b664540 tx=0x7f22f8006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.064+0000 7f2305725800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b6884f0 0x55672b688910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.064+0000 7f2305725800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55672b5609f0 con 0x55672b6884f0 2024-04-23T18:29:35.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.065+0000 7f23014b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b6884f0 0x55672b688910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.065+0000 7f23014b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b6884f0 0x55672b688910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33740/0 (socket says 172.21.15.119:33740) 2024-04-23T18:29:35.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.065+0000 7f23014b7640 1 -- 172.21.15.119:0/1198045959 learned_addr learned my addr 172.21.15.119:0/1198045959 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.065+0000 7f23014b7640 1 -- 172.21.15.119:0/1198045959 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55672b688ee0 con 0x55672b6884f0 2024-04-23T18:29:35.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.065+0000 7f23014b7640 1 --2- 172.21.15.119:0/1198045959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b6884f0 0x55672b688910 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f22f4052970 tx=0x7f22f4087f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377dec547a564a25 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.065+0000 7f21e4ff9640 1 -- 172.21.15.119:0/1198045959 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f40679c0 con 0x55672b6884f0 2024-04-23T18:29:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.065+0000 7f21e4ff9640 1 -- 172.21.15.119:0/1198045959 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f40a9070 con 0x55672b6884f0 2024-04-23T18:29:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.065+0000 7f21e4ff9640 1 -- 172.21.15.119:0/1198045959 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f408dc10 con 0x55672b6884f0 2024-04-23T18:29:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f2305725800 1 -- 172.21.15.119:0/1198045959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b6884f0 msgr2=0x55672b688910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f2305725800 1 --2- 172.21.15.119:0/1198045959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b6884f0 0x55672b688910 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f22f4052970 tx=0x7f22f4087f30 comp rx=0 tx=0).stop 2024-04-23T18:29:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f2305725800 1 -- 172.21.15.119:0/1198045959 shutdown_connections 2024-04-23T18:29:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f2305725800 1 --2- 172.21.15.119:0/1198045959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b6884f0 0x55672b688910 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f2305725800 1 -- 172.21.15.119:0/1198045959 >> 172.21.15.119:0/1198045959 conn(0x55672b684800 msgr2=0x55672b682860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f2305725800 1 -- 172.21.15.119:0/1198045959 shutdown_connections 2024-04-23T18:29:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f2305725800 1 -- 172.21.15.119:0/1198045959 wait complete. 2024-04-23T18:29:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f2305725800 1 Processor -- start 2024-04-23T18:29:35.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f2305725800 1 -- start start 2024-04-23T18:29:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f2305725800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b6884f0 0x55672b68f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f2305725800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55672b689570 con 0x55672b6884f0 2024-04-23T18:29:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f23014b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b6884f0 0x55672b68f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f23014b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b6884f0 0x55672b68f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33754/0 (socket says 172.21.15.119:33754) 2024-04-23T18:29:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.066+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 learned_addr learned my addr 172.21.15.119:0/3361703795 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.067+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55672b68fe10 con 0x55672b6884f0 2024-04-23T18:29:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.067+0000 7f23014b7640 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b6884f0 0x55672b68f8d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f22f4052970 tx=0x7f22f40a2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.067+0000 7f21d6ffd640 1 -- 172.21.15.119:0/3361703795 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f40bc070 con 0x55672b6884f0 2024-04-23T18:29:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.067+0000 7f21d6ffd640 1 -- 172.21.15.119:0/3361703795 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f4066590 con 0x55672b6884f0 2024-04-23T18:29:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.067+0000 7f21d6ffd640 1 -- 172.21.15.119:0/3361703795 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f409a450 con 0x55672b6884f0 2024-04-23T18:29:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.067+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55672b68fe10 con 0x55672b6884f0 2024-04-23T18:29:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.067+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55672b6902b0 con 0x55672b6884f0 2024-04-23T18:29:35.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.068+0000 7f21d6ffd640 1 -- 172.21.15.119:0/3361703795 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f22f40bf070 con 0x55672b6884f0 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.068+0000 7f21d6ffd640 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21cc036eb0 0x7f21cc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.068+0000 7f21d6ffd640 1 -- 172.21.15.119:0/3361703795 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f22f40c2c80 con 0x55672b6884f0 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.068+0000 7f2305725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.068+0000 7f2300cb6640 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21cc036eb0 0x7f21cc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.068+0000 7f2305725800 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55672b69ae00 0x55672b69d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.068+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b69da10 con 0x55672b69ae00 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.068+0000 7f2301cb8640 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55672b69ae00 0x55672b69d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.068+0000 7f2300cb6640 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21cc036eb0 0x7f21cc039370 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55672b66d2f0 tx=0x7f22f8023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.068+0000 7f2301cb8640 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55672b69ae00 0x55672b69d2c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b69ae00 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 20 realm 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b69de70 con 0x55672b69ae00 2024-04-23T18:29:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b69ae00 2024-04-23T18:29:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b69e710 con 0x55672b69ae00 2024-04-23T18:29:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b69ae00 2024-04-23T18:29:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69ae00 2024-04-23T18:29:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b69ae00 2024-04-23T18:29:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:35.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55672b69f810 0x55672b6a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.069+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a2180 con 0x55672b69f810 2024-04-23T18:29:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.070+0000 7f23014b7640 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55672b69f810 0x55672b6a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.070+0000 7f23014b7640 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55672b69f810 0x55672b6a1c00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.070+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.070+0000 7f2305725800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.070+0000 7f2305725800 20 searching for the correct realm 2024-04-23T18:29:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.070+0000 7f2305725800 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55672b6a41d0 0x55672b6a6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.070+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a6d60 con 0x55672b6a41d0 2024-04-23T18:29:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.070+0000 7f2300cb6640 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55672b6a41d0 0x55672b6a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.070+0000 7f2300cb6640 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55672b6a41d0 0x55672b6a6690 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.071+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.071+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a6d60 con 0x55672b69f810 2024-04-23T18:29:35.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.071+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.071+0000 7f23014b7640 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f22f40c1060 0x7f22f40782f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.071+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a6d60 con 0x7f22f40c1060 2024-04-23T18:29:35.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.071+0000 7f2301cb8640 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f22f40c1060 0x7f22f40782f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.072+0000 7f2301cb8640 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f22f40c1060 0x7f22f40782f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.072+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc00a4a0 con 0x7f22f40c1060 2024-04-23T18:29:35.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.072+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69ae00 2024-04-23T18:29:35.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.072+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b69ae00 2024-04-23T18:29:35.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.072+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69ae00 2024-04-23T18:29:35.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.072+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b69ae00 2024-04-23T18:29:35.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.072+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x7f22f40c1060 2024-04-23T18:29:35.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.073+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc00a4a0 con 0x7f22f40c1060 2024-04-23T18:29:35.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.073+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x7f22f40c1060 2024-04-23T18:29:35.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.073+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f22fc00a4a0 con 0x7f22f40c1060 2024-04-23T18:29:35.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.073+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69f810 2024-04-23T18:29:35.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.073+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.073+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b6a41d0 2024-04-23T18:29:35.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.073+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.073+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69ae00 2024-04-23T18:29:35.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.074+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b69ae00 2024-04-23T18:29:35.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.074+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x7f22f40c1060 2024-04-23T18:29:35.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.074+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc00a4a0 con 0x7f22f40c1060 2024-04-23T18:29:35.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.074+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69ae00 2024-04-23T18:29:35.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.074+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b69ae00 2024-04-23T18:29:35.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.074+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69f810 2024-04-23T18:29:35.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.074+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.074+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b6a41d0 2024-04-23T18:29:35.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.075+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.075+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b6a41d0 2024-04-23T18:29:35.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.075+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.075+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x7f22f40c1060 2024-04-23T18:29:35.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.075+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc00a4a0 con 0x7f22f40c1060 2024-04-23T18:29:35.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.075+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b6a41d0 2024-04-23T18:29:35.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.075+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.075+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b6a41d0 2024-04-23T18:29:35.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.076+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.076+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69ae00 2024-04-23T18:29:35.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.076+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b69ae00 2024-04-23T18:29:35.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.076+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69ae00 2024-04-23T18:29:35.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.076+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b69ae00 2024-04-23T18:29:35.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.076+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x7f22f40c1060 2024-04-23T18:29:35.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.077+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc00a4a0 con 0x7f22f40c1060 2024-04-23T18:29:35.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.077+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b6a41d0 2024-04-23T18:29:35.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.077+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.077+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69f810 2024-04-23T18:29:35.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.077+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.077+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69ae00 2024-04-23T18:29:35.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.078+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc00a4a0 con 0x55672b69ae00 2024-04-23T18:29:35.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.078+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x7f22f40c1060 2024-04-23T18:29:35.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.078+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc00a4a0 con 0x7f22f40c1060 2024-04-23T18:29:35.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.078+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b6a41d0 2024-04-23T18:29:35.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.078+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.078+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x7f22f40c1060 2024-04-23T18:29:35.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.079+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc00a4a0 con 0x7f22f40c1060 2024-04-23T18:29:35.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.079+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69f810 2024-04-23T18:29:35.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.079+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.079+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b6a41d0 2024-04-23T18:29:35.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.079+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.079+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x7f22f40c1060 2024-04-23T18:29:35.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.079+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22fc040040 con 0x7f22f40c1060 2024-04-23T18:29:35.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.079+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69ae00 2024-04-23T18:29:35.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f22fc040040 con 0x55672b69ae00 2024-04-23T18:29:35.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55672b69eab0 con 0x55672b69f810 2024-04-23T18:29:35.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:35.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:35.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:35.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:35.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:35.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:35.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a2ad0 con 0x55672b69ae00 2024-04-23T18:29:35.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x55672b69ae00 2024-04-23T18:29:35.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a2ad0 con 0x55672b69ae00 2024-04-23T18:29:35.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f22fc040040 con 0x55672b69ae00 2024-04-23T18:29:35.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:35.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.080+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a2ad0 con 0x7f22f40c1060 2024-04-23T18:29:35.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f22fc040040 con 0x7f22f40c1060 2024-04-23T18:29:35.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2305725800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:35.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2305725800 20 zone default found 2024-04-23T18:29:35.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2305725800 4 Realm: () 2024-04-23T18:29:35.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2305725800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:35.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2305725800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:35.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2305725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:35.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2305725800 20 zonegroup default 2024-04-23T18:29:35.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2305725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a2ec0 con 0x7f22f40c1060 2024-04-23T18:29:35.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x7f22f40c1060 2024-04-23T18:29:35.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2305725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2305725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a3300 con 0x55672b6a41d0 2024-04-23T18:29:35.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.081+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.082+0000 7f2305725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.082+0000 7f2305725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.082+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a8bc0 con 0x55672b6a41d0 2024-04-23T18:29:35.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.082+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.082+0000 7f2305725800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.082+0000 7f2305725800 20 started sync module instance, tier type = 2024-04-23T18:29:35.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.082+0000 7f2305725800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:35.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.082+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a8060 con 0x55672b69f810 2024-04-23T18:29:35.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.083+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.083+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93901598391216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a8f60 con 0x55672b69f810 2024-04-23T18:29:35.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.083+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a97b0 con 0x55672b69ae00 2024-04-23T18:29:35.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.084+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93901598391216] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.084+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x55672b69ae00 2024-04-23T18:29:35.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.084+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93901598397184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a9bd0 con 0x55672b69ae00 2024-04-23T18:29:35.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.084+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6aa590 con 0x55672b6a41d0 2024-04-23T18:29:35.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.085+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93901598397184] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x55672b69ae00 2024-04-23T18:29:35.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.085+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.085+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93901598398240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a9b40 con 0x55672b6a41d0 2024-04-23T18:29:35.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.085+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6ab400 con 0x55672b69f810 2024-04-23T18:29:35.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.086+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93901598398240] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.087+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.087+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93901598402864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6abc50 con 0x55672b69f810 2024-04-23T18:29:35.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.087+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6ac4e0 con 0x55672b69ae00 2024-04-23T18:29:35.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.088+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x55672b69ae00 2024-04-23T18:29:35.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.088+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93901598407760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6ac0d0 con 0x55672b69ae00 2024-04-23T18:29:35.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.088+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6ad490 con 0x7f22f40c1060 2024-04-23T18:29:35.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.088+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93901598402864] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.089+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93901598407760] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x55672b69ae00 2024-04-23T18:29:35.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.089+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x7f22f40c1060 2024-04-23T18:29:35.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.089+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93901598406560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6ad490 con 0x7f22f40c1060 2024-04-23T18:29:35.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.089+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6add30 con 0x7f22f40c1060 2024-04-23T18:29:35.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.090+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(56 notify.6 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x7f22f40c1060 2024-04-23T18:29:35.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.090+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93901598414976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6ad490 con 0x7f22f40c1060 2024-04-23T18:29:35.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.090+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6ae830 con 0x7f22f40c1060 2024-04-23T18:29:35.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.090+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93901598406560] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x7f22f40c1060 2024-04-23T18:29:35.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.091+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93901598414976] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x7f22f40c1060 2024-04-23T18:29:35.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.091+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x7f22f40c1060 2024-04-23T18:29:35.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.091+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93901598417696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6adca0 con 0x7f22f40c1060 2024-04-23T18:29:35.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.091+0000 7f2305725800 20 add_watcher() i=0 2024-04-23T18:29:35.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.091+0000 7f2305725800 20 add_watcher() i=1 2024-04-23T18:29:35.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.091+0000 7f2305725800 20 add_watcher() i=2 2024-04-23T18:29:35.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.091+0000 7f2305725800 20 add_watcher() i=3 2024-04-23T18:29:35.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.091+0000 7f2305725800 20 add_watcher() i=4 2024-04-23T18:29:35.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.091+0000 7f2305725800 20 add_watcher() i=5 2024-04-23T18:29:35.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.091+0000 7f2305725800 20 add_watcher() i=6 2024-04-23T18:29:35.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.091+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93901598417696] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x7f22f40c1060 2024-04-23T18:29:35.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.092+0000 7f2305725800 20 add_watcher() i=7 2024-04-23T18:29:35.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.092+0000 7f2305725800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:35.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.092+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b6b1820 con 0x55672b69ae00 2024-04-23T18:29:35.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.092+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f22fc040040 con 0x55672b69ae00 2024-04-23T18:29:35.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.092+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93901598412656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6aed10 con 0x55672b69ae00 2024-04-23T18:29:35.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.093+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93901598412656] v32'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x55672b69ae00 2024-04-23T18:29:35.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.093+0000 7f21b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:35.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.093+0000 7f2305725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:35.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.093+0000 7f2305725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:35.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.093+0000 7f2305725800 5 note: GC not initialized 2024-04-23T18:29:35.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.093+0000 7f21b67e4640 20 reqs_thread_entry: start 2024-04-23T18:29:35.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.093+0000 7f2305725800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:35.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.094+0000 7f2305725800 20 Filter name: none 2024-04-23T18:29:35.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.094+0000 7f2127fff640 20 reqs_thread_entry: start 2024-04-23T18:29:35.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.094+0000 7f2305725800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.094+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55672b6e4800 con 0x55672b69f810 2024-04-23T18:29:35.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.094+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.094+0000 7f2305725800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:35.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.095+0000 7f21b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:35.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.095+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93901598412656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6e2600 con 0x55672b69ae00 2024-04-23T18:29:35.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.096+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93901598412656] v32'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x55672b69ae00 2024-04-23T18:29:35.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.096+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93901598391216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6e2600 con 0x55672b69f810 2024-04-23T18:29:35.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.097+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93901598391216] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.097+0000 7f2305725800 20 remove_watcher() i=0 2024-04-23T18:29:35.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.097+0000 7f2305725800 2 removed watcher, disabling cache 2024-04-23T18:29:35.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.097+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93901598397184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a7bb0 con 0x55672b69ae00 2024-04-23T18:29:35.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.098+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93901598397184] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x55672b69ae00 2024-04-23T18:29:35.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.098+0000 7f2305725800 20 remove_watcher() i=1 2024-04-23T18:29:35.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.098+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93901598398240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6e2600 con 0x55672b6a41d0 2024-04-23T18:29:35.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.099+0000 7f2300cb6640 1 -- 172.21.15.119:0/3361703795 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93901598398240] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22f8037040 con 0x55672b6a41d0 2024-04-23T18:29:35.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.099+0000 7f2305725800 20 remove_watcher() i=2 2024-04-23T18:29:35.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.099+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93901598402864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a7bb0 con 0x55672b69f810 2024-04-23T18:29:35.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.100+0000 7f23014b7640 1 -- 172.21.15.119:0/3361703795 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93901598402864] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22f40be030 con 0x55672b69f810 2024-04-23T18:29:35.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.100+0000 7f2305725800 20 remove_watcher() i=3 2024-04-23T18:29:35.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.100+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93901598407760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6aa930 con 0x55672b69ae00 2024-04-23T18:29:35.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.101+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93901598407760] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x55672b69ae00 2024-04-23T18:29:35.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.101+0000 7f2305725800 20 remove_watcher() i=4 2024-04-23T18:29:35.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.101+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93901598406560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6a7bb0 con 0x7f22f40c1060 2024-04-23T18:29:35.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.102+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93901598406560] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x7f22f40c1060 2024-04-23T18:29:35.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.102+0000 7f2305725800 20 remove_watcher() i=5 2024-04-23T18:29:35.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.102+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93901598414976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6abc50 con 0x7f22f40c1060 2024-04-23T18:29:35.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.103+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93901598414976] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x7f22f40c1060 2024-04-23T18:29:35.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.103+0000 7f2305725800 20 remove_watcher() i=6 2024-04-23T18:29:35.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.103+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93901598417696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55672b6aa930 con 0x7f22f40c1060 2024-04-23T18:29:35.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93901598417696] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f22fc040040 con 0x7f22f40c1060 2024-04-23T18:29:35.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 20 remove_watcher() i=7 2024-04-23T18:29:35.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f22f40c1060 msgr2=0x7f22f40782f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f22f40c1060 0x7f22f40782f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55672b69ae00 msgr2=0x55672b69d2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55672b69ae00 0x55672b69d2c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55672b69f810 msgr2=0x55672b6a1c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55672b69f810 0x55672b6a1c00 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55672b6a41d0 msgr2=0x55672b6a6690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55672b6a41d0 0x55672b6a6690 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21cc036eb0 msgr2=0x7f21cc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21cc036eb0 0x7f21cc039370 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55672b66d2f0 tx=0x7f22f8023040 comp rx=0 tx=0).stop 2024-04-23T18:29:35.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b6884f0 msgr2=0x55672b68f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 --2- 172.21.15.119:0/3361703795 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b6884f0 0x55672b68f8d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f22f4052970 tx=0x7f22f40a2000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 reap_dead start 2024-04-23T18:29:35.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2301cb8640 1 -- 172.21.15.119:0/3361703795 reap_dead start 2024-04-23T18:29:35.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 shutdown_connections 2024-04-23T18:29:35.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 >> 172.21.15.119:0/3361703795 conn(0x55672b684800 msgr2=0x55672b681e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 shutdown_connections 2024-04-23T18:29:35.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.104+0000 7f2305725800 1 -- 172.21.15.119:0/3361703795 wait complete. 2024-04-23T18:29:35.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/1264767952 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21d8036eb0 msgr2=0x7f21d8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 --2- 172.21.15.119:0/1264767952 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21d8036eb0 0x7f21d8039370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55672b664540 tx=0x7f22f8006000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/1264767952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b67b3a0 msgr2=0x55672b67b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 --2- 172.21.15.119:0/1264767952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b67b3a0 0x55672b67b7c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f22f40529c0 tx=0x7f22f4066e70 comp rx=0 tx=0).stop 2024-04-23T18:29:35.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/1264767952 shutdown_connections 2024-04-23T18:29:35.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 --2- 172.21.15.119:0/1264767952 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21d8036eb0 0x7f21d8039370 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 --2- 172.21.15.119:0/1264767952 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b67b3a0 0x55672b67b7c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/1264767952 >> 172.21.15.119:0/1264767952 conn(0x55672b66f440 msgr2=0x55672b66f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/1264767952 shutdown_connections 2024-04-23T18:29:35.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/1264767952 wait complete. 2024-04-23T18:29:35.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55672b66a2a0 msgr2=0x55672b66c760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55672b66a2a0 0x55672b66c760 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55672b5650a0 msgr2=0x55672b663b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55672b5650a0 0x55672b663b10 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55672b6663a0 msgr2=0x55672b668790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55672b6663a0 0x55672b668790 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21e8036e60 msgr2=0x7f21e8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21e8036e60 0x7f21e8039320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22f8000c00 tx=0x7f22f80013b0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 msgr2=0x55672b65caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 --2- 172.21.15.119:0/3783936388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55672b4d5050 0x55672b65caa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f22f4060040 tx=0x7f22f4002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2301cb8640 1 -- 172.21.15.119:0/3783936388 reap_dead start 2024-04-23T18:29:35.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 shutdown_connections 2024-04-23T18:29:35.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 >> 172.21.15.119:0/3783936388 conn(0x55672b55c420 msgr2=0x55672b560ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 shutdown_connections 2024-04-23T18:29:35.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.105+0000 7f2305725800 1 -- 172.21.15.119:0/3783936388 wait complete. 2024-04-23T18:29:35.112 INFO:teuthology.orchestra.run.smithi119.stdout:{"key":"bucket:myfoo","ver":{"tag":"_Dd0E7-nFWkIJ2kWsd4iNu7K","ver":2},"mtime":"2024-04-23T18:29:34.777295Z","data":{"bucket":{"name":"myfoo","marker":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1","bucket_id":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-04-23T18:29:33.450324Z","linked":false,"has_bucket_info":false}} 2024-04-23T18:29:35.112 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_Dd0E7-nFWkIJ2kWsd4iNu7K', 'ver': 2}, 'mtime': '2024-04-23T18:29:34.777295Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1', 'bucket_id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-04-23T18:29:33.450324Z', 'linked': False, 'has_bucket_info': False}} 2024-04-23T18:29:35.113 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1'] 2024-04-23T18:29:35.113 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1'] 2024-04-23T18:29:35.113 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 2024-04-23T18:29:35.200 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:35.200 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:35.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.208+0000 7f4a70b33800 1 Processor -- start 2024-04-23T18:29:35.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.208+0000 7f4a70b33800 1 -- start start 2024-04-23T18:29:35.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.208+0000 7f4a70b33800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b986573400 0x55b98657bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.208+0000 7f4a70b33800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b986423560 con 0x55b9865718c0 2024-04-23T18:29:35.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.208+0000 7f4a70b33800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55b986414e20 con 0x55b986573400 2024-04-23T18:29:35.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.209+0000 7f4a63ff4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b986573400 0x55b98657bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.209+0000 7f4a6c7f5640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55b9865718c0 0x55b986571ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40798/0 (socket says 172.21.15.119:40798) 2024-04-23T18:29:35.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.209+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/539858295 learned_addr learned my addr 172.21.15.119:0/539858295 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:35.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.209+0000 7f4a63ff4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b986573400 0x55b98657bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33756/0 (socket says 172.21.15.119:33756) 2024-04-23T18:29:35.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.209+0000 7f4a63ff4640 1 -- 172.21.15.119:0/539858295 >> v1:172.21.15.62:6789/0 conn(0x55b9865718c0 legacy=0x55b986571ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.209+0000 7f4a6bff4640 1 -- 172.21.15.119:0/539858295 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720466252 0 0) 0x55b986423560 con 0x55b9865718c0 2024-04-23T18:29:35.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.209+0000 7f4a63ff4640 1 -- 172.21.15.119:0/539858295 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b986422e60 con 0x55b986573400 2024-04-23T18:29:35.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.211+0000 7f4a63ff4640 1 --2- 172.21.15.119:0/539858295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986573400 0x55b98657bf00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400a470 tx=0x7f4a5401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fd2d547163b103 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.211+0000 7f4a6bff4640 1 -- 172.21.15.119:0/539858295 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54057070 con 0x55b986573400 2024-04-23T18:29:35.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.211+0000 7f4a6bff4640 1 -- 172.21.15.119:0/539858295 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a54052440 con 0x55b986573400 2024-04-23T18:29:35.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.211+0000 7f4a6bff4640 1 -- 172.21.15.119:0/539858295 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54052740 con 0x55b986573400 2024-04-23T18:29:35.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.211+0000 7f4a70b33800 1 -- 172.21.15.119:0/539858295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986573400 msgr2=0x55b98657bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.211+0000 7f4a70b33800 1 --2- 172.21.15.119:0/539858295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986573400 0x55b98657bf00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400a470 tx=0x7f4a5401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:35.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.212+0000 7f4a70b33800 1 -- 172.21.15.119:0/539858295 shutdown_connections 2024-04-23T18:29:35.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.212+0000 7f4a70b33800 1 --2- 172.21.15.119:0/539858295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986573400 0x55b98657bf00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.212+0000 7f4a70b33800 1 -- 172.21.15.119:0/539858295 >> 172.21.15.119:0/539858295 conn(0x55b98656d440 msgr2=0x55b98656f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.212+0000 7f4a70b33800 1 -- 172.21.15.119:0/539858295 shutdown_connections 2024-04-23T18:29:35.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.212+0000 7f4a70b33800 1 -- 172.21.15.119:0/539858295 wait complete. 2024-04-23T18:29:35.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.223+0000 7f4a70b33800 1 Processor -- start 2024-04-23T18:29:35.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.223+0000 7f4a70b33800 1 -- start start 2024-04-23T18:29:35.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.223+0000 7f4a70b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9865718c0 0x55b9866664f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.223+0000 7f4a70b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b9864be5d0 con 0x55b9865718c0 2024-04-23T18:29:35.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.224+0000 7f4a6c7f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9865718c0 0x55b9866664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.224+0000 7f4a6c7f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9865718c0 0x55b9866664f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33762/0 (socket says 172.21.15.119:33762) 2024-04-23T18:29:35.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.224+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/2480579165 learned_addr learned my addr 172.21.15.119:0/2480579165 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.224+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/2480579165 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b986434860 con 0x55b9865718c0 2024-04-23T18:29:35.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.224+0000 7f4a6c7f5640 1 --2- 172.21.15.119:0/2480579165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9865718c0 0x55b9866664f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00b210 tx=0x7f4a5c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6109ee5721d715ee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.224+0000 7f495a60c640 1 -- 172.21.15.119:0/2480579165 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c008070 con 0x55b9865718c0 2024-04-23T18:29:35.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.224+0000 7f495a60c640 1 -- 172.21.15.119:0/2480579165 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5c00d500 con 0x55b9865718c0 2024-04-23T18:29:35.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.224+0000 7f495a60c640 1 -- 172.21.15.119:0/2480579165 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c00d840 con 0x55b9865718c0 2024-04-23T18:29:35.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.225+0000 7f4a70b33800 1 -- 172.21.15.119:0/2480579165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9865718c0 msgr2=0x55b9866664f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.225+0000 7f4a70b33800 1 --2- 172.21.15.119:0/2480579165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9865718c0 0x55b9866664f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00b210 tx=0x7f4a5c00b6d0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.225+0000 7f4a70b33800 1 -- 172.21.15.119:0/2480579165 shutdown_connections 2024-04-23T18:29:35.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.225+0000 7f4a70b33800 1 --2- 172.21.15.119:0/2480579165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9865718c0 0x55b9866664f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.225+0000 7f4a70b33800 1 -- 172.21.15.119:0/2480579165 >> 172.21.15.119:0/2480579165 conn(0x55b98656d440 msgr2=0x55b986661e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.225+0000 7f4a70b33800 1 -- 172.21.15.119:0/2480579165 shutdown_connections 2024-04-23T18:29:35.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.225+0000 7f4a70b33800 1 -- 172.21.15.119:0/2480579165 wait complete. 2024-04-23T18:29:35.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.225+0000 7f4a70b33800 1 Processor -- start 2024-04-23T18:29:35.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.225+0000 7f4a70b33800 1 -- start start 2024-04-23T18:29:35.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.225+0000 7f4a70b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9865718c0 0x55b98666de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.225+0000 7f4a70b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b98657e720 con 0x55b9865718c0 2024-04-23T18:29:35.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.226+0000 7f4a6c7f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9865718c0 0x55b98666de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.226+0000 7f4a6c7f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9865718c0 0x55b98666de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33772/0 (socket says 172.21.15.119:33772) 2024-04-23T18:29:35.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.226+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4103571182 learned_addr learned my addr 172.21.15.119:0/4103571182 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.226+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4103571182 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b986432eb0 con 0x55b9865718c0 2024-04-23T18:29:35.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.226+0000 7f4a6c7f5640 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9865718c0 0x55b98666de60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00b210 tx=0x7f4a5c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.226+0000 7f4958e09640 1 -- 172.21.15.119:0/4103571182 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c00f950 con 0x55b9865718c0 2024-04-23T18:29:35.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.226+0000 7f4958e09640 1 -- 172.21.15.119:0/4103571182 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5c00faf0 con 0x55b9865718c0 2024-04-23T18:29:35.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.226+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b98666e3a0 con 0x55b9865718c0 2024-04-23T18:29:35.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.226+0000 7f4958e09640 1 -- 172.21.15.119:0/4103571182 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c00fdd0 con 0x55b9865718c0 2024-04-23T18:29:35.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.226+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b98666e8c0 con 0x55b9865718c0 2024-04-23T18:29:35.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.227+0000 7f4958e09640 1 -- 172.21.15.119:0/4103571182 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4a5c017040 con 0x55b9865718c0 2024-04-23T18:29:35.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.227+0000 7f4958e09640 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4954036eb0 0x7f4954039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.227+0000 7f4958e09640 1 -- 172.21.15.119:0/4103571182 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4a5c015020 con 0x55b9865718c0 2024-04-23T18:29:35.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.227+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b986573400 0x55b986674ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.228+0000 7f4a63ff4640 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4954036eb0 0x7f4954039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.228+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b986675410 con 0x55b986573400 2024-04-23T18:29:35.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.228+0000 7f4a6cff6640 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b986573400 0x55b986674ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.228+0000 7f4a63ff4640 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4954036eb0 0x7f4954039370 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a54054000 tx=0x7f4a5404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.228+0000 7f4a6cff6640 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b986573400 0x55b986674ed0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.228+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4103571182 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b986573400 2024-04-23T18:29:35.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.228+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b986672480 con 0x55b986573400 2024-04-23T18:29:35.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.228+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4103571182 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b986573400 2024-04-23T18:29:35.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.229+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b986677720 0x55b986679b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.229+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b98667a1b0 con 0x55b986677720 2024-04-23T18:29:35.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.229+0000 7f4a6c7f5640 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b986677720 0x55b986679b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.229+0000 7f4a6c7f5640 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b986677720 0x55b986679b10 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.229+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4103571182 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4a5c02d070 con 0x55b986677720 2024-04-23T18:29:35.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.229+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866766d0 con 0x55b986573400 2024-04-23T18:29:35.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.229+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4103571182 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b986573400 2024-04-23T18:29:35.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.229+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b98667b660 0x55b98667dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.229+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b98667e210 con 0x55b98667b660 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.230+0000 7f4a63ff4640 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b98667b660 0x55b98667dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.230+0000 7f4a63ff4640 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b98667b660 0x55b98667dab0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.230+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4103571182 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4a540525f0 con 0x55b98667b660 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.231+0000 7f4a70b33800 1 Processor -- start 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.231+0000 7f4a70b33800 1 -- start start 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.231+0000 7f4a70b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b98668c670 0x55b98668ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.231+0000 7f4a70b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b986464df0 con 0x55b98668c670 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.231+0000 7f4a6c7f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b98668c670 0x55b98668ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.231+0000 7f4a6c7f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b98668c670 0x55b98668ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33784/0 (socket says 172.21.15.119:33784) 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.231+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/2272251315 learned_addr learned my addr 172.21.15.119:0/2272251315 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.231+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/2272251315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b98668cfd0 con 0x55b98668c670 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.231+0000 7f4a6c7f5640 1 --2- 172.21.15.119:0/2272251315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b98668c670 0x55b98668ca90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c04bb30 tx=0x7f4a5c04bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.232+0000 7f4951ffb640 1 -- 172.21.15.119:0/2272251315 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c01a540 con 0x55b98668c670 2024-04-23T18:29:35.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.232+0000 7f4951ffb640 1 -- 172.21.15.119:0/2272251315 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5c01a720 con 0x55b98668c670 2024-04-23T18:29:35.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.232+0000 7f4a70b33800 1 -- 172.21.15.119:0/2272251315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b98668da40 con 0x55b98668c670 2024-04-23T18:29:35.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.232+0000 7f4951ffb640 1 -- 172.21.15.119:0/2272251315 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c01aa00 con 0x55b98668c670 2024-04-23T18:29:35.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.232+0000 7f4a70b33800 1 -- 172.21.15.119:0/2272251315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b98668df40 con 0x55b98668c670 2024-04-23T18:29:35.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.232+0000 7f4951ffb640 1 -- 172.21.15.119:0/2272251315 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4a5c018ab0 con 0x55b98668c670 2024-04-23T18:29:35.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.232+0000 7f4951ffb640 1 --2- 172.21.15.119:0/2272251315 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4944036eb0 0x7f4944039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.232+0000 7f4951ffb640 1 -- 172.21.15.119:0/2272251315 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4a5c03ac30 con 0x55b98668c670 2024-04-23T18:29:35.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.232+0000 7f4a63ff4640 1 --2- 172.21.15.119:0/2272251315 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4944036eb0 0x7f4944039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.233+0000 7f4a70b33800 1 Processor -- start 2024-04-23T18:29:35.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.233+0000 7f4a70b33800 1 -- start start 2024-04-23T18:29:35.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.233+0000 7f4a63ff4640 1 --2- 172.21.15.119:0/2272251315 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4944036eb0 0x7f4944039370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55b9866723c0 tx=0x7f4a54005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.233+0000 7f4a70b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 0x55b986699d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.233+0000 7f4a70b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b986666c70 con 0x55b986699930 2024-04-23T18:29:35.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.233+0000 7f4a6c7f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 0x55b986699d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.233+0000 7f4a6c7f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 0x55b986699d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33796/0 (socket says 172.21.15.119:33796) 2024-04-23T18:29:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.233+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/3055031102 learned_addr learned my addr 172.21.15.119:0/3055031102 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.233+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/3055031102 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b98669a320 con 0x55b986699930 2024-04-23T18:29:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.234+0000 7f4a6c7f5640 1 --2- 172.21.15.119:0/3055031102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 0x55b986699d50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00f690 tx=0x7f4a5c010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89889be129438aa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.234+0000 7f494b7fe640 1 -- 172.21.15.119:0/3055031102 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c05d070 con 0x55b986699930 2024-04-23T18:29:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.234+0000 7f494b7fe640 1 -- 172.21.15.119:0/3055031102 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5c018da0 con 0x55b986699930 2024-04-23T18:29:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.234+0000 7f494b7fe640 1 -- 172.21.15.119:0/3055031102 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c03e070 con 0x55b986699930 2024-04-23T18:29:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.234+0000 7f4a70b33800 1 -- 172.21.15.119:0/3055031102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 msgr2=0x55b986699d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.234+0000 7f4a70b33800 1 --2- 172.21.15.119:0/3055031102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 0x55b986699d50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00f690 tx=0x7f4a5c010f90 comp rx=0 tx=0).stop 2024-04-23T18:29:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.234+0000 7f4a70b33800 1 -- 172.21.15.119:0/3055031102 shutdown_connections 2024-04-23T18:29:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.234+0000 7f4a70b33800 1 --2- 172.21.15.119:0/3055031102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 0x55b986699d50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.234+0000 7f4a70b33800 1 -- 172.21.15.119:0/3055031102 >> 172.21.15.119:0/3055031102 conn(0x55b986695c50 msgr2=0x55b986693cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.234+0000 7f4a70b33800 1 -- 172.21.15.119:0/3055031102 shutdown_connections 2024-04-23T18:29:35.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.234+0000 7f4a70b33800 1 -- 172.21.15.119:0/3055031102 wait complete. 2024-04-23T18:29:35.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.234+0000 7f4a70b33800 1 Processor -- start 2024-04-23T18:29:35.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.235+0000 7f4a70b33800 1 -- start start 2024-04-23T18:29:35.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.235+0000 7f4a70b33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 0x55b9866a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.235+0000 7f4a70b33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b98669a8c0 con 0x55b986699930 2024-04-23T18:29:35.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.235+0000 7f4a6c7f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 0x55b9866a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.235+0000 7f4a6c7f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 0x55b9866a0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33808/0 (socket says 172.21.15.119:33808) 2024-04-23T18:29:35.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.235+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 learned_addr learned my addr 172.21.15.119:0/4028124109 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.235+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9866a11b0 con 0x55b986699930 2024-04-23T18:29:35.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.235+0000 7f4a6c7f5640 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 0x55b9866a0c70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c010fd0 tx=0x7f4a5c02fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.235+0000 7f4949ffb640 1 -- 172.21.15.119:0/4028124109 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c069020 con 0x55b986699930 2024-04-23T18:29:35.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.235+0000 7f4949ffb640 1 -- 172.21.15.119:0/4028124109 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5c05e040 con 0x55b986699930 2024-04-23T18:29:35.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.235+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9866a11b0 con 0x55b986699930 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.236+0000 7f4949ffb640 1 -- 172.21.15.119:0/4028124109 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c05d070 con 0x55b986699930 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.236+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9866a11b0 con 0x55b986699930 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.236+0000 7f4949ffb640 1 -- 172.21.15.119:0/4028124109 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4a5c06c020 con 0x55b986699930 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.236+0000 7f4949ffb640 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f493c036e10 0x7f493c0392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.236+0000 7f4949ffb640 1 -- 172.21.15.119:0/4028124109 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4a5c053030 con 0x55b986699930 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.236+0000 7f4a63ff4640 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f493c036e10 0x7f493c0392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.237+0000 7f4a63ff4640 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f493c036e10 0x7f493c0392d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a54000c00 tx=0x7f4a5404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.237+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.237+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9866ac190 0x55b9866ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.237+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866aeda0 con 0x55b9866ac190 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.237+0000 7f4a6cff6640 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9866ac190 0x55b9866ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.237+0000 7f4a6cff6640 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9866ac190 0x55b9866ae650 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.237+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b9866ac190 2024-04-23T18:29:35.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.237+0000 7f4a70b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.237+0000 7f4a70b33800 20 realm 2024-04-23T18:29:35.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.237+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866af1b0 con 0x55b9866ac190 2024-04-23T18:29:35.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b9866ac190 2024-04-23T18:29:35.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a70b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a70b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:35.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afa80 con 0x55b9866ac190 2024-04-23T18:29:35.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b9866ac190 2024-04-23T18:29:35.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a70b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866ac190 2024-04-23T18:29:35.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b9866ac190 2024-04-23T18:29:35.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a70b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:35.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9866b0b80 0x55b9866b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b3580 con 0x55b9866b0b80 2024-04-23T18:29:35.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a6c7f5640 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9866b0b80 0x55b9866b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.238+0000 7f4a6c7f5640 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9866b0b80 0x55b9866b2f70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.239+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4a5c02d070 con 0x55b9866b0b80 2024-04-23T18:29:35.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.239+0000 7f4a70b33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:35.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.239+0000 7f4a70b33800 20 searching for the correct realm 2024-04-23T18:29:35.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.239+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b9866b5530 0x55b9866b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.239+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b80c0 con 0x55b9866b5530 2024-04-23T18:29:35.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.239+0000 7f4a63ff4640 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b9866b5530 0x55b9866b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.239+0000 7f4a63ff4640 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b9866b5530 0x55b9866b79f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.240+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.240+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b80c0 con 0x55b9866b0b80 2024-04-23T18:29:35.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.240+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02d070 con 0x55b9866b0b80 2024-04-23T18:29:35.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.240+0000 7f4a6c7f5640 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4a5c06e020 0x7f4a5c065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.240+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b80c0 con 0x7f4a5c06e020 2024-04-23T18:29:35.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.240+0000 7f4a6cff6640 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4a5c06e020 0x7f4a5c065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.240+0000 7f4a6cff6640 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4a5c06e020 0x7f4a5c065870 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.241+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6400a4a0 con 0x7f4a5c06e020 2024-04-23T18:29:35.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.241+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866ac190 2024-04-23T18:29:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.241+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b9866ac190 2024-04-23T18:29:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.241+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866ac190 2024-04-23T18:29:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.241+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b9866ac190 2024-04-23T18:29:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.241+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x7f4a5c06e020 2024-04-23T18:29:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.241+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6400a4a0 con 0x7f4a5c06e020 2024-04-23T18:29:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.241+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x7f4a5c06e020 2024-04-23T18:29:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.241+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4a6400a4a0 con 0x7f4a5c06e020 2024-04-23T18:29:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.241+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866b0b80 2024-04-23T18:29:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.242+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02d070 con 0x55b9866b0b80 2024-04-23T18:29:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.242+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866b5530 2024-04-23T18:29:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.242+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.242+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866ac190 2024-04-23T18:29:35.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.242+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b9866ac190 2024-04-23T18:29:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.242+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x7f4a5c06e020 2024-04-23T18:29:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.242+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6400a4a0 con 0x7f4a5c06e020 2024-04-23T18:29:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.242+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866ac190 2024-04-23T18:29:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.243+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b9866ac190 2024-04-23T18:29:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.243+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866b0b80 2024-04-23T18:29:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.243+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4a5c02d070 con 0x55b9866b0b80 2024-04-23T18:29:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.243+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866b5530 2024-04-23T18:29:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.243+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.243+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866b5530 2024-04-23T18:29:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.243+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.243+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x7f4a5c06e020 2024-04-23T18:29:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.244+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6400a4a0 con 0x7f4a5c06e020 2024-04-23T18:29:35.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.244+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866b5530 2024-04-23T18:29:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.244+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.244+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866b5530 2024-04-23T18:29:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.244+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.244+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866ac190 2024-04-23T18:29:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.244+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b9866ac190 2024-04-23T18:29:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.244+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866ac190 2024-04-23T18:29:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.244+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b9866ac190 2024-04-23T18:29:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.244+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x7f4a5c06e020 2024-04-23T18:29:35.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.245+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6400a4a0 con 0x7f4a5c06e020 2024-04-23T18:29:35.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.245+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866b5530 2024-04-23T18:29:35.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.245+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.245+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866b0b80 2024-04-23T18:29:35.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.245+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4a5c02d070 con 0x55b9866b0b80 2024-04-23T18:29:35.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.245+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866ac190 2024-04-23T18:29:35.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.245+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6400a4a0 con 0x55b9866ac190 2024-04-23T18:29:35.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.245+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x7f4a5c06e020 2024-04-23T18:29:35.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.246+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6400a4a0 con 0x7f4a5c06e020 2024-04-23T18:29:35.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.246+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866b5530 2024-04-23T18:29:35.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.246+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.246+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x7f4a5c06e020 2024-04-23T18:29:35.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.247+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6400a4a0 con 0x7f4a5c06e020 2024-04-23T18:29:35.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.247+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866b0b80 2024-04-23T18:29:35.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.247+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02d070 con 0x55b9866b0b80 2024-04-23T18:29:35.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.247+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866b5530 2024-04-23T18:29:35.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.247+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.247+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x7f4a5c06e020 2024-04-23T18:29:35.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.247+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866ac190 2024-04-23T18:29:35.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4a64040040 con 0x55b9866ac190 2024-04-23T18:29:35.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9866afe20 con 0x55b9866b0b80 2024-04-23T18:29:35.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c08a040 con 0x55b9866b0b80 2024-04-23T18:29:35.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a70b33800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:35.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a70b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:35.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a70b33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:35.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a70b33800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:35.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a70b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:35.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a70b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:35.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b3e40 con 0x55b9866ac190 2024-04-23T18:29:35.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x55b9866ac190 2024-04-23T18:29:35.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a70b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b3e40 con 0x55b9866ac190 2024-04-23T18:29:35.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a64040040 con 0x55b9866ac190 2024-04-23T18:29:35.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.248+0000 7f4a70b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:35.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b3e40 con 0x7f4a5c06e020 2024-04-23T18:29:35.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:35.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 20 zone default found 2024-04-23T18:29:35.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 4 Realm: () 2024-04-23T18:29:35.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:35.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:35.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:35.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 20 zonegroup default 2024-04-23T18:29:35.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b4770 con 0x7f4a5c06e020 2024-04-23T18:29:35.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b4770 con 0x55b9866b5530 2024-04-23T18:29:35.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.249+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b9f20 con 0x55b9866b5530 2024-04-23T18:29:35.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.250+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.250+0000 7f4a70b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.250+0000 7f4a70b33800 20 started sync module instance, tier type = 2024-04-23T18:29:35.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.250+0000 7f4a70b33800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:35.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.250+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b93c0 con 0x55b9866b0b80 2024-04-23T18:29:35.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.251+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c08a040 con 0x55b9866b0b80 2024-04-23T18:29:35.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.251+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94255312506640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866ba2c0 con 0x55b9866b0b80 2024-04-23T18:29:35.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.251+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bac80 con 0x55b9866ac190 2024-04-23T18:29:35.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.252+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94255312506640] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c08a040 con 0x55b9866b0b80 2024-04-23T18:29:35.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.252+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x55b9866ac190 2024-04-23T18:29:35.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.252+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94255312512976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bb0a0 con 0x55b9866ac190 2024-04-23T18:29:35.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.252+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bba60 con 0x55b9866b5530 2024-04-23T18:29:35.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.253+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94255312512976] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x55b9866ac190 2024-04-23T18:29:35.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.253+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.253+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94255312514032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bb010 con 0x55b9866b5530 2024-04-23T18:29:35.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.253+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bc920 con 0x55b9866b0b80 2024-04-23T18:29:35.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.254+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94255312514032] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.254+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c08a040 con 0x55b9866b0b80 2024-04-23T18:29:35.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.254+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94255312518736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bd1c0 con 0x55b9866b0b80 2024-04-23T18:29:35.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.254+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bdb80 con 0x55b9866ac190 2024-04-23T18:29:35.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.255+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94255312518736] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c08a040 con 0x55b9866b0b80 2024-04-23T18:29:35.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.256+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x55b9866ac190 2024-04-23T18:29:35.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.256+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94255312522992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bdb80 con 0x55b9866ac190 2024-04-23T18:29:35.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.256+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866be540 con 0x7f4a5c06e020 2024-04-23T18:29:35.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.257+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94255312522992] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x55b9866ac190 2024-04-23T18:29:35.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.257+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.257+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94255312525488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866be540 con 0x7f4a5c06e020 2024-04-23T18:29:35.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.257+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bef00 con 0x7f4a5c06e020 2024-04-23T18:29:35.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.258+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94255312525488] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.258+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.258+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94255312527504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bf0e0 con 0x7f4a5c06e020 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.258+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bf930 con 0x7f4a5c06e020 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.259+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.259+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94255312532160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bfd50 con 0x7f4a5c06e020 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.259+0000 7f4a70b33800 20 add_watcher() i=0 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.259+0000 7f4a70b33800 20 add_watcher() i=1 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.259+0000 7f4a70b33800 20 add_watcher() i=2 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.259+0000 7f4a70b33800 20 add_watcher() i=3 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.259+0000 7f4a70b33800 20 add_watcher() i=4 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.259+0000 7f4a70b33800 20 add_watcher() i=5 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.259+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94255312527504] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.259+0000 7f4a70b33800 20 add_watcher() i=6 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.260+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94255312532160] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.260+0000 7f4a70b33800 20 add_watcher() i=7 2024-04-23T18:29:35.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.260+0000 7f4a70b33800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:35.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.260+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bec30 con 0x55b9866ac190 2024-04-23T18:29:35.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.260+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4a64040040 con 0x55b9866ac190 2024-04-23T18:29:35.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.260+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94255312533472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bec30 con 0x55b9866ac190 2024-04-23T18:29:35.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.261+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94255312533472] v32'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x55b9866ac190 2024-04-23T18:29:35.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.261+0000 7f49227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:35.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.261+0000 7f4a70b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:35.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.261+0000 7f4a70b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:35.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.261+0000 7f4a70b33800 5 note: GC not initialized 2024-04-23T18:29:35.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.262+0000 7f49217e2640 20 reqs_thread_entry: start 2024-04-23T18:29:35.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.262+0000 7f4a70b33800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:35.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.262+0000 7f4a70b33800 20 Filter name: none 2024-04-23T18:29:35.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.262+0000 7f4892ffd640 20 reqs_thread_entry: start 2024-04-23T18:29:35.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.262+0000 7f4a70b33800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-23T18:29:35.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.262+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.262+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866f65b0 con 0x7f4a5c06e020 2024-04-23T18:29:35.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 20 rados_obj.operate() r=0 bl.length=380 2024-04-23T18:29:35.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-23T18:29:35.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-23T18:29:35.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:35.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-23T18:29:35.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866f8690 con 0x55b9866b0b80 2024-04-23T18:29:35.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4a5c08a040 con 0x55b9866b0b80 2024-04-23T18:29:35.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:35.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-23T18:29:35.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:35.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 : miss 2024-04-23T18:29:35.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866fa120 con 0x55b9866b5530 2024-04-23T18:29:35.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:35.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:35.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:35.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.263+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866fea70 con 0x55b9866b0b80 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.264+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(65 foo.buckets [call] v32'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4a5c08a040 con 0x55b9866b0b80 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.264+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b986704990 con 0x55b9866b5530 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.265+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(66 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.265+0000 7f4a70b33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.265+0000 7f4a70b33800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.265+0000 7f4a70b33800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.265+0000 7f4a70b33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1, ofs0, ns] 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.265+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94255312775072 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9866ff350 con 0x7f4a5c06e020 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.266+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== watch-notify(notify (1) cookie 94255312527504 notify 137438953476 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f4a64018c70 con 0x7f4a5c06e020 2024-04-23T18:29:35.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.266+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(67 notify.6 [notify cookie 94255312775072 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.266+0000 7f494affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94255312527504 notifier 4497 bl.length()=752 2024-04-23T18:29:35.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.266+0000 7f494affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:35.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.266+0000 7f494affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:35.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.266+0000 7f494affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:35.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.266+0000 7f494affd640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f48a0003530 con 0x7f4a5c06e020 2024-04-23T18:29:35.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.266+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.267+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== watch-notify(notify_complete (2) cookie 94255312775072 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4a64046450 con 0x7f4a5c06e020 2024-04-23T18:29:35.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.267+0000 7f4a70b33800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): orig_sources= new_sources= 2024-04-23T18:29:35.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.267+0000 7f4a70b33800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): potential sources added=[] removed=[] 2024-04-23T18:29:35.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.267+0000 7f4a70b33800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): orig_dests= new_dests= 2024-04-23T18:29:35.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.267+0000 7f4a70b33800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): potential dests added=[] removed=[] 2024-04-23T18:29:35.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.267+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9867037c0 con 0x7f4a5c06e020 2024-04-23T18:29:35.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.268+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(69 fud.buckets [call] v32'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.268+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b986704320 con 0x55b9866b0b80 2024-04-23T18:29:35.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.269+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f4a5c08a040 con 0x55b9866b0b80 2024-04-23T18:29:35.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.269+0000 7f4a70b33800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-23T18:29:35.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.269+0000 7f4a70b33800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:35.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.269+0000 7f4a70b33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-23T18:29:35.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.269+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94255312761296 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b986704320 con 0x7f4a5c06e020 2024-04-23T18:29:35.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.269+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== watch-notify(notify (1) cookie 94255312527504 notify 137438953477 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f4a640466f0 con 0x7f4a5c06e020 2024-04-23T18:29:35.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.269+0000 7f494affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94255312527504 notifier 4497 bl.length()=314 2024-04-23T18:29:35.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.269+0000 7f494affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-23T18:29:35.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.269+0000 7f494affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:35.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.269+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(71 notify.6 [notify cookie 94255312761296 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.269+0000 7f494affd640 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f48a0003560 con 0x7f4a5c06e020 2024-04-23T18:29:35.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.269+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== watch-notify(notify_complete (2) cookie 94255312761296 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4a640468c0 con 0x7f4a5c06e020 2024-04-23T18:29:35.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.269+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.270+0000 7f49227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:35.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.270+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94255312533472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866fb910 con 0x55b9866ac190 2024-04-23T18:29:35.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.271+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94255312533472] v32'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x55b9866ac190 2024-04-23T18:29:35.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.271+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94255312506640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bf7a0 con 0x55b9866b0b80 2024-04-23T18:29:35.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.272+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94255312506640] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c08a040 con 0x55b9866b0b80 2024-04-23T18:29:35.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.272+0000 7f4a70b33800 20 remove_watcher() i=0 2024-04-23T18:29:35.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.272+0000 7f4a70b33800 2 removed watcher, disabling cache 2024-04-23T18:29:35.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.272+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94255312512976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b8f10 con 0x55b9866ac190 2024-04-23T18:29:35.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.273+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94255312512976] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x55b9866ac190 2024-04-23T18:29:35.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.273+0000 7f4a70b33800 20 remove_watcher() i=1 2024-04-23T18:29:35.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.274+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94255312514032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b8f10 con 0x55b9866b5530 2024-04-23T18:29:35.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.274+0000 7f4a63ff4640 1 -- 172.21.15.119:0/4028124109 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94255312514032] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a54081070 con 0x55b9866b5530 2024-04-23T18:29:35.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.274+0000 7f4a70b33800 20 remove_watcher() i=2 2024-04-23T18:29:35.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.274+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94255312518736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b8f10 con 0x55b9866b0b80 2024-04-23T18:29:35.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.275+0000 7f4a6c7f5640 1 -- 172.21.15.119:0/4028124109 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94255312518736] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c08a040 con 0x55b9866b0b80 2024-04-23T18:29:35.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.275+0000 7f4a70b33800 20 remove_watcher() i=3 2024-04-23T18:29:35.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.275+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94255312522992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b8f10 con 0x55b9866ac190 2024-04-23T18:29:35.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.277+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94255312522992] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x55b9866ac190 2024-04-23T18:29:35.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.277+0000 7f4a70b33800 20 remove_watcher() i=4 2024-04-23T18:29:35.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.277+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94255312525488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b8f10 con 0x7f4a5c06e020 2024-04-23T18:29:35.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.278+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94255312525488] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.278+0000 7f4a70b33800 20 remove_watcher() i=5 2024-04-23T18:29:35.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.278+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94255312527504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866bd8b0 con 0x7f4a5c06e020 2024-04-23T18:29:35.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.279+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94255312527504] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.279+0000 7f4a70b33800 20 remove_watcher() i=6 2024-04-23T18:29:35.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.279+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94255312532160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9866b8f10 con 0x7f4a5c06e020 2024-04-23T18:29:35.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94255312532160] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64040040 con 0x7f4a5c06e020 2024-04-23T18:29:35.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 20 remove_watcher() i=7 2024-04-23T18:29:35.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4a5c06e020 msgr2=0x7f4a5c065870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4a5c06e020 0x7f4a5c065870 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9866ac190 msgr2=0x55b9866ae650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9866ac190 0x55b9866ae650 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9866b0b80 msgr2=0x55b9866b2f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9866b0b80 0x55b9866b2f70 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b9866b5530 msgr2=0x55b9866b79f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b9866b5530 0x55b9866b79f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f493c036e10 msgr2=0x7f493c0392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f493c036e10 0x7f493c0392d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a54000c00 tx=0x7f4a5404f000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 msgr2=0x55b9866a0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 0x55b9866a0c70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c010fd0 tx=0x7f4a5c02fe90 comp rx=0 tx=0).stop 2024-04-23T18:29:35.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4028124109 reap_dead start 2024-04-23T18:29:35.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 shutdown_connections 2024-04-23T18:29:35.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4028124109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b986699930 0x55b9866a0c70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 >> 172.21.15.119:0/4028124109 conn(0x55b986695c50 msgr2=0x55b9866932b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 shutdown_connections 2024-04-23T18:29:35.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/4028124109 wait complete. 2024-04-23T18:29:35.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/2272251315 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4944036eb0 msgr2=0x7f4944039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 --2- 172.21.15.119:0/2272251315 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4944036eb0 0x7f4944039370 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55b9866723c0 tx=0x7f4a54005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/2272251315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b98668c670 msgr2=0x55b98668ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 --2- 172.21.15.119:0/2272251315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b98668c670 0x55b98668ca90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c04bb30 tx=0x7f4a5c04bf80 comp rx=0 tx=0).stop 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/2272251315 shutdown_connections 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 --2- 172.21.15.119:0/2272251315 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4944036eb0 0x7f4944039370 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 --2- 172.21.15.119:0/2272251315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b98668c670 0x55b98668ca90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.280+0000 7f4a70b33800 1 -- 172.21.15.119:0/2272251315 >> 172.21.15.119:0/2272251315 conn(0x55b986680710 msgr2=0x55b986680b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 -- 172.21.15.119:0/2272251315 shutdown_connections 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 -- 172.21.15.119:0/2272251315 wait complete. 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b98667b660 msgr2=0x55b98667dab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b98667b660 0x55b98667dab0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b986573400 msgr2=0x55b986674ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b986573400 0x55b986674ed0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b986677720 msgr2=0x55b986679b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b986677720 0x55b986679b10 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4954036eb0 msgr2=0x7f4954039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4954036eb0 0x7f4954039370 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a54054000 tx=0x7f4a5404e000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9865718c0 msgr2=0x55b98666de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 --2- 172.21.15.119:0/4103571182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9865718c0 0x55b98666de60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00b210 tx=0x7f4a5c000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a6cff6640 1 -- 172.21.15.119:0/4103571182 reap_dead start 2024-04-23T18:29:35.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 shutdown_connections 2024-04-23T18:29:35.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 >> 172.21.15.119:0/4103571182 conn(0x55b98656d440 msgr2=0x55b986660670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 shutdown_connections 2024-04-23T18:29:35.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.281+0000 7f4a70b33800 1 -- 172.21.15.119:0/4103571182 wait complete. 2024-04-23T18:29:35.290 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-23T18:29:35.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-23T18:29:35.291 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-23T18:29:35.335 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:35.335 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:35.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.343+0000 7f611752e800 1 Processor -- start 2024-04-23T18:29:35.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.343+0000 7f611752e800 1 -- start start 2024-04-23T18:29:35.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.343+0000 7f611752e800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55df6e384390 0x55df6e386780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.343+0000 7f611752e800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55df6e231560 con 0x55df6e381440 2024-04-23T18:29:35.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.343+0000 7f611752e800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55df6e222e20 con 0x55df6e384390 2024-04-23T18:29:35.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.343+0000 7f6112a66640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55df6e384390 0x55df6e386780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.343+0000 7f6113267640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55df6e381440 0x55df6e381860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40810/0 (socket says 172.21.15.119:40810) 2024-04-23T18:29:35.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.343+0000 7f6113267640 1 -- 172.21.15.119:0/2550661565 learned_addr learned my addr 172.21.15.119:0/2550661565 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:35.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.344+0000 7f6112a66640 1 -- 172.21.15.119:0/2550661565 >> v1:172.21.15.62:6789/0 conn(0x55df6e381440 legacy=0x55df6e381860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.344+0000 7f6112265640 1 -- 172.21.15.119:0/2550661565 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4092111204 0 0) 0x55df6e231560 con 0x55df6e381440 2024-04-23T18:29:35.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.344+0000 7f6112a66640 1 -- 172.21.15.119:0/2550661565 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df6e230e60 con 0x55df6e384390 2024-04-23T18:29:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.345+0000 7f6112a66640 1 --2- 172.21.15.119:0/2550661565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e384390 0x55df6e386780 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00a470 tx=0x7f60fc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74594c2053c6627c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.346+0000 7f6112265640 1 -- 172.21.15.119:0/2550661565 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60fc057070 con 0x55df6e384390 2024-04-23T18:29:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.346+0000 7f6112265640 1 -- 172.21.15.119:0/2550661565 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60fc052570 con 0x55df6e384390 2024-04-23T18:29:35.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.346+0000 7f6112265640 1 -- 172.21.15.119:0/2550661565 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60fc052870 con 0x55df6e384390 2024-04-23T18:29:35.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.346+0000 7f611752e800 1 -- 172.21.15.119:0/2550661565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e384390 msgr2=0x55df6e386780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.346+0000 7f611752e800 1 --2- 172.21.15.119:0/2550661565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e384390 0x55df6e386780 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00a470 tx=0x7f60fc01ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:35.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.346+0000 7f611752e800 1 -- 172.21.15.119:0/2550661565 shutdown_connections 2024-04-23T18:29:35.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.346+0000 7f611752e800 1 --2- 172.21.15.119:0/2550661565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e384390 0x55df6e386780 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.346+0000 7f611752e800 1 -- 172.21.15.119:0/2550661565 >> 172.21.15.119:0/2550661565 conn(0x55df6e37aba0 msgr2=0x55df6e37cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.346+0000 7f611752e800 1 -- 172.21.15.119:0/2550661565 shutdown_connections 2024-04-23T18:29:35.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.346+0000 7f611752e800 1 -- 172.21.15.119:0/2550661565 wait complete. 2024-04-23T18:29:35.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.358+0000 7f611752e800 1 Processor -- start 2024-04-23T18:29:35.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.358+0000 7f611752e800 1 -- start start 2024-04-23T18:29:35.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.358+0000 7f611752e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e381440 0x55df6e38b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.358+0000 7f611752e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55df6e2cc5b0 con 0x55df6e381440 2024-04-23T18:29:35.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.358+0000 7f6113267640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e381440 0x55df6e38b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.358+0000 7f6113267640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e381440 0x55df6e38b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33820/0 (socket says 172.21.15.119:33820) 2024-04-23T18:29:35.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.358+0000 7f6113267640 1 -- 172.21.15.119:0/784898238 learned_addr learned my addr 172.21.15.119:0/784898238 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.359+0000 7f6113267640 1 -- 172.21.15.119:0/784898238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df6e242860 con 0x55df6e381440 2024-04-23T18:29:35.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.359+0000 7f6113267640 1 --2- 172.21.15.119:0/784898238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e381440 0x55df6e38b920 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f610c00b240 tx=0x7f610c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10541a7fc1e3543 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.359+0000 7f600160a640 1 -- 172.21.15.119:0/784898238 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c008070 con 0x55df6e381440 2024-04-23T18:29:35.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.359+0000 7f600160a640 1 -- 172.21.15.119:0/784898238 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c00d500 con 0x55df6e381440 2024-04-23T18:29:35.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.359+0000 7f600160a640 1 -- 172.21.15.119:0/784898238 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c00d860 con 0x55df6e381440 2024-04-23T18:29:35.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f611752e800 1 -- 172.21.15.119:0/784898238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e381440 msgr2=0x55df6e38b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f611752e800 1 --2- 172.21.15.119:0/784898238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e381440 0x55df6e38b920 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f610c00b240 tx=0x7f610c00b700 comp rx=0 tx=0).stop 2024-04-23T18:29:35.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f611752e800 1 -- 172.21.15.119:0/784898238 shutdown_connections 2024-04-23T18:29:35.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f611752e800 1 --2- 172.21.15.119:0/784898238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e381440 0x55df6e38b920 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f611752e800 1 -- 172.21.15.119:0/784898238 >> 172.21.15.119:0/784898238 conn(0x55df6e37aba0 msgr2=0x55df6e46d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f611752e800 1 -- 172.21.15.119:0/784898238 shutdown_connections 2024-04-23T18:29:35.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f611752e800 1 -- 172.21.15.119:0/784898238 wait complete. 2024-04-23T18:29:35.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f611752e800 1 Processor -- start 2024-04-23T18:29:35.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f611752e800 1 -- start start 2024-04-23T18:29:35.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f611752e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e381440 0x55df6e47bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f611752e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55df6e386fc0 con 0x55df6e381440 2024-04-23T18:29:35.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f6113267640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e381440 0x55df6e47bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f6113267640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e381440 0x55df6e47bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33834/0 (socket says 172.21.15.119:33834) 2024-04-23T18:29:35.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.360+0000 7f6113267640 1 -- 172.21.15.119:0/459252214 learned_addr learned my addr 172.21.15.119:0/459252214 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.361+0000 7f6113267640 1 -- 172.21.15.119:0/459252214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df6e240eb0 con 0x55df6e381440 2024-04-23T18:29:35.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.361+0000 7f6113267640 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e381440 0x55df6e47bb60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x55df6e38af50 tx=0x7f610c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.361+0000 7f5fffe07640 1 -- 172.21.15.119:0/459252214 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c019870 con 0x55df6e381440 2024-04-23T18:29:35.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.361+0000 7f5fffe07640 1 -- 172.21.15.119:0/459252214 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c019a10 con 0x55df6e381440 2024-04-23T18:29:35.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.361+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df6e47c0a0 con 0x55df6e381440 2024-04-23T18:29:35.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.361+0000 7f5fffe07640 1 -- 172.21.15.119:0/459252214 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c019d30 con 0x55df6e381440 2024-04-23T18:29:35.356 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.361+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df6e47c5c0 con 0x55df6e381440 2024-04-23T18:29:35.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.362+0000 7f5fffe07640 1 -- 172.21.15.119:0/459252214 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f610c017040 con 0x55df6e381440 2024-04-23T18:29:35.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.362+0000 7f5fffe07640 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5ff8036eb0 0x7f5ff8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.362+0000 7f5fffe07640 1 -- 172.21.15.119:0/459252214 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f610c015020 con 0x55df6e381440 2024-04-23T18:29:35.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.362+0000 7f6112a66640 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5ff8036eb0 0x7f5ff8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.362+0000 7f611752e800 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55df6e384390 0x55df6e482bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.362+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e483150 con 0x55df6e384390 2024-04-23T18:29:35.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.362+0000 7f6113a68640 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55df6e384390 0x55df6e482bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.363+0000 7f6112a66640 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5ff8036eb0 0x7f5ff8039370 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f60fc054000 tx=0x7f60fc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.363+0000 7f6113a68640 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55df6e384390 0x55df6e482bd0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.363+0000 7f6113a68640 1 -- 172.21.15.119:0/459252214 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e384390 2024-04-23T18:29:35.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.363+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4801a0 con 0x55df6e384390 2024-04-23T18:29:35.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.363+0000 7f6113a68640 1 -- 172.21.15.119:0/459252214 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e384390 2024-04-23T18:29:35.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.363+0000 7f611752e800 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55df6e485480 0x55df6e487870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.363+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e487f10 con 0x55df6e485480 2024-04-23T18:29:35.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.363+0000 7f6113267640 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55df6e485480 0x55df6e487870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.364+0000 7f6113267640 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55df6e485480 0x55df6e487870 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.364+0000 7f6113267640 1 -- 172.21.15.119:0/459252214 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f610c02d070 con 0x55df6e485480 2024-04-23T18:29:35.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.364+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e484430 con 0x55df6e384390 2024-04-23T18:29:35.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.364+0000 7f6113a68640 1 -- 172.21.15.119:0/459252214 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e384390 2024-04-23T18:29:35.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.364+0000 7f611752e800 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55df6e4893c0 0x55df6e48b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.364+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e48bf70 con 0x55df6e4893c0 2024-04-23T18:29:35.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.365+0000 7f6112a66640 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55df6e4893c0 0x55df6e48b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.365+0000 7f6112a66640 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55df6e4893c0 0x55df6e48b810 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.365+0000 7f6112a66640 1 -- 172.21.15.119:0/459252214 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f60fc0528e0 con 0x55df6e4893c0 2024-04-23T18:29:35.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.366+0000 7f611752e800 1 Processor -- start 2024-04-23T18:29:35.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.366+0000 7f611752e800 1 -- start start 2024-04-23T18:29:35.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.366+0000 7f611752e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e49a3b0 0x55df6e49a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.366+0000 7f611752e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55df6e272df0 con 0x55df6e49a3b0 2024-04-23T18:29:35.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.366+0000 7f6113267640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e49a3b0 0x55df6e49a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.366+0000 7f6113267640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e49a3b0 0x55df6e49a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33840/0 (socket says 172.21.15.119:33840) 2024-04-23T18:29:35.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.366+0000 7f6113267640 1 -- 172.21.15.119:0/1138117 learned_addr learned my addr 172.21.15.119:0/1138117 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.366+0000 7f6113267640 1 -- 172.21.15.119:0/1138117 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df6e49ad10 con 0x55df6e49a3b0 2024-04-23T18:29:35.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.366+0000 7f6113267640 1 --2- 172.21.15.119:0/1138117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e49a3b0 0x55df6e49a7d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f610c04ba50 tx=0x7f610c01a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.367+0000 7f5ffd602640 1 -- 172.21.15.119:0/1138117 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c01ae00 con 0x55df6e49a3b0 2024-04-23T18:29:35.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.367+0000 7f5ffd602640 1 -- 172.21.15.119:0/1138117 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c00eb80 con 0x55df6e49a3b0 2024-04-23T18:29:35.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.367+0000 7f611752e800 1 -- 172.21.15.119:0/1138117 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df6e49b780 con 0x55df6e49a3b0 2024-04-23T18:29:35.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.367+0000 7f5ffd602640 1 -- 172.21.15.119:0/1138117 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c00ee60 con 0x55df6e49a3b0 2024-04-23T18:29:35.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.367+0000 7f611752e800 1 -- 172.21.15.119:0/1138117 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df6e49bc80 con 0x55df6e49a3b0 2024-04-23T18:29:35.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.367+0000 7f5ffd602640 1 -- 172.21.15.119:0/1138117 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f610c00f470 con 0x55df6e49a3b0 2024-04-23T18:29:35.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.367+0000 7f5ffd602640 1 --2- 172.21.15.119:0/1138117 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5fec036e60 0x7f5fec039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.367+0000 7f5ffd602640 1 -- 172.21.15.119:0/1138117 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f610c04be00 con 0x55df6e49a3b0 2024-04-23T18:29:35.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.368+0000 7f6112a66640 1 --2- 172.21.15.119:0/1138117 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5fec036e60 0x7f5fec039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.368+0000 7f611752e800 1 Processor -- start 2024-04-23T18:29:35.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.368+0000 7f6112a66640 1 --2- 172.21.15.119:0/1138117 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5fec036e60 0x7f5fec039320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55df6e4800c0 tx=0x7f60fc005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.368+0000 7f611752e800 1 -- start start 2024-04-23T18:29:35.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.368+0000 7f611752e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 0x55df6e4a7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.368+0000 7f611752e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55df6e389fa0 con 0x55df6e4a7510 2024-04-23T18:29:35.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.368+0000 7f6113267640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 0x55df6e4a7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.368+0000 7f6113267640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 0x55df6e4a7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33850/0 (socket says 172.21.15.119:33850) 2024-04-23T18:29:35.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.368+0000 7f6113267640 1 -- 172.21.15.119:0/944058419 learned_addr learned my addr 172.21.15.119:0/944058419 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.368+0000 7f6113267640 1 -- 172.21.15.119:0/944058419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df6e4a7f00 con 0x55df6e4a7510 2024-04-23T18:29:35.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.369+0000 7f6113267640 1 --2- 172.21.15.119:0/944058419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 0x55df6e4a7930 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f610c008fd0 tx=0x7f610c048b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9147fe5b55fab984 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.369+0000 7f5ff6ffd640 1 -- 172.21.15.119:0/944058419 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c01ccd0 con 0x55df6e4a7510 2024-04-23T18:29:35.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.369+0000 7f5ff6ffd640 1 -- 172.21.15.119:0/944058419 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c05c070 con 0x55df6e4a7510 2024-04-23T18:29:35.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.369+0000 7f5ff6ffd640 1 -- 172.21.15.119:0/944058419 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c04a0e0 con 0x55df6e4a7510 2024-04-23T18:29:35.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.369+0000 7f611752e800 1 -- 172.21.15.119:0/944058419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 msgr2=0x55df6e4a7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.369+0000 7f611752e800 1 --2- 172.21.15.119:0/944058419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 0x55df6e4a7930 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f610c008fd0 tx=0x7f610c048b90 comp rx=0 tx=0).stop 2024-04-23T18:29:35.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.369+0000 7f611752e800 1 -- 172.21.15.119:0/944058419 shutdown_connections 2024-04-23T18:29:35.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.369+0000 7f611752e800 1 --2- 172.21.15.119:0/944058419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 0x55df6e4a7930 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.369+0000 7f611752e800 1 -- 172.21.15.119:0/944058419 >> 172.21.15.119:0/944058419 conn(0x55df6e4a37e0 msgr2=0x55df6e4a1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.369+0000 7f611752e800 1 -- 172.21.15.119:0/944058419 shutdown_connections 2024-04-23T18:29:35.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.369+0000 7f611752e800 1 -- 172.21.15.119:0/944058419 wait complete. 2024-04-23T18:29:35.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.369+0000 7f611752e800 1 Processor -- start 2024-04-23T18:29:35.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.369+0000 7f611752e800 1 -- start start 2024-04-23T18:29:35.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.370+0000 7f611752e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 0x55df6e4ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.370+0000 7f611752e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55df6e4a85d0 con 0x55df6e4a7510 2024-04-23T18:29:35.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.370+0000 7f6113267640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 0x55df6e4ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.370+0000 7f6113267640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 0x55df6e4ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33862/0 (socket says 172.21.15.119:33862) 2024-04-23T18:29:35.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.370+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 learned_addr learned my addr 172.21.15.119:0/699643187 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.370+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df6e4aedc0 con 0x55df6e4a7510 2024-04-23T18:29:35.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.370+0000 7f6113267640 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 0x55df6e4ae880 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f610c04f010 tx=0x7f610c022f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.370+0000 7f5ff57fa640 1 -- 172.21.15.119:0/699643187 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c06f070 con 0x55df6e4a7510 2024-04-23T18:29:35.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.370+0000 7f5ff57fa640 1 -- 172.21.15.119:0/699643187 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c048890 con 0x55df6e4a7510 2024-04-23T18:29:35.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.370+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df6e4aedc0 con 0x55df6e4a7510 2024-04-23T18:29:35.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.370+0000 7f5ff57fa640 1 -- 172.21.15.119:0/699643187 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f610c024470 con 0x55df6e4a7510 2024-04-23T18:29:35.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.371+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df6e4aedc0 con 0x55df6e4a7510 2024-04-23T18:29:35.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.371+0000 7f5ff57fa640 1 -- 172.21.15.119:0/699643187 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f610c072070 con 0x55df6e4a7510 2024-04-23T18:29:35.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.371+0000 7f5ff57fa640 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5fdc036ea0 0x7f5fdc039360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.371+0000 7f5ff57fa640 1 -- 172.21.15.119:0/699643187 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f610c075c80 con 0x55df6e4a7510 2024-04-23T18:29:35.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.371+0000 7f6112a66640 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5fdc036ea0 0x7f5fdc039360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.372+0000 7f6112a66640 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5fdc036ea0 0x7f5fdc039360 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f60fc052fd0 tx=0x7f60fc04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.372+0000 7f611752e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.372+0000 7f611752e800 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55df6e4b9f00 0x55df6e4bc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.372+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bcb10 con 0x55df6e4b9f00 2024-04-23T18:29:35.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.372+0000 7f6113a68640 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55df6e4b9f00 0x55df6e4bc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.372+0000 7f6113a68640 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55df6e4b9f00 0x55df6e4bc3c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e4b9f00 2024-04-23T18:29:35.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 20 realm 2024-04-23T18:29:35.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bcf20 con 0x55df6e4b9f00 2024-04-23T18:29:35.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e4b9f00 2024-04-23T18:29:35.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:35.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bd7f0 con 0x55df6e4b9f00 2024-04-23T18:29:35.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e4b9f00 2024-04-23T18:29:35.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4b9f00 2024-04-23T18:29:35.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e4b9f00 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55df6e4be8f0 0x55df6e4c0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c12f0 con 0x55df6e4be8f0 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.373+0000 7f6113267640 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55df6e4be8f0 0x55df6e4c0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.374+0000 7f6113267640 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55df6e4be8f0 0x55df6e4c0ce0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.374+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f610c071030 con 0x55df6e4be8f0 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.374+0000 7f611752e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.374+0000 7f611752e800 20 searching for the correct realm 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.374+0000 7f611752e800 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55df6e4c32c0 0x55df6e4c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.374+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c5e20 con 0x55df6e4c32c0 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.374+0000 7f6112a66640 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55df6e4c32c0 0x55df6e4c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.374+0000 7f6112a66640 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55df6e4c32c0 0x55df6e4c5750 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.375+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.375+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c5e20 con 0x55df6e4be8f0 2024-04-23T18:29:35.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.375+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610c071030 con 0x55df6e4be8f0 2024-04-23T18:29:35.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.375+0000 7f6113267640 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f610c074060 0x7f610c030820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.375+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c5e20 con 0x7f610c074060 2024-04-23T18:29:35.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.375+0000 7f6113a68640 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f610c074060 0x7f610c030820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.375+0000 7f6113a68640 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f610c074060 0x7f610c030820 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.376+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610400a4a0 con 0x7f610c074060 2024-04-23T18:29:35.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.376+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4b9f00 2024-04-23T18:29:35.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.376+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e4b9f00 2024-04-23T18:29:35.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.376+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4b9f00 2024-04-23T18:29:35.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.376+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e4b9f00 2024-04-23T18:29:35.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.376+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x7f610c074060 2024-04-23T18:29:35.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.376+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610400a4a0 con 0x7f610c074060 2024-04-23T18:29:35.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.376+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x7f610c074060 2024-04-23T18:29:35.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.377+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f610400a4a0 con 0x7f610c074060 2024-04-23T18:29:35.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.377+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4be8f0 2024-04-23T18:29:35.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.377+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610c071030 con 0x55df6e4be8f0 2024-04-23T18:29:35.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.377+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4c32c0 2024-04-23T18:29:35.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.377+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.377+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4b9f00 2024-04-23T18:29:35.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.377+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e4b9f00 2024-04-23T18:29:35.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.377+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x7f610c074060 2024-04-23T18:29:35.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.378+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610400a4a0 con 0x7f610c074060 2024-04-23T18:29:35.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.378+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4b9f00 2024-04-23T18:29:35.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.378+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e4b9f00 2024-04-23T18:29:35.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.378+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4be8f0 2024-04-23T18:29:35.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.378+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f610c071030 con 0x55df6e4be8f0 2024-04-23T18:29:35.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.378+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4c32c0 2024-04-23T18:29:35.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.378+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.378+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4c32c0 2024-04-23T18:29:35.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.378+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.379+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x7f610c074060 2024-04-23T18:29:35.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.379+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610400a4a0 con 0x7f610c074060 2024-04-23T18:29:35.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.379+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4c32c0 2024-04-23T18:29:35.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.379+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.379+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4c32c0 2024-04-23T18:29:35.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.379+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.379+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4b9f00 2024-04-23T18:29:35.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.379+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e4b9f00 2024-04-23T18:29:35.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.379+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4b9f00 2024-04-23T18:29:35.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.380+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e4b9f00 2024-04-23T18:29:35.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.380+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x7f610c074060 2024-04-23T18:29:35.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.380+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610400a4a0 con 0x7f610c074060 2024-04-23T18:29:35.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.380+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4c32c0 2024-04-23T18:29:35.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.380+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.380+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4be8f0 2024-04-23T18:29:35.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.380+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f610c071030 con 0x55df6e4be8f0 2024-04-23T18:29:35.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.380+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4b9f00 2024-04-23T18:29:35.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.381+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610400a4a0 con 0x55df6e4b9f00 2024-04-23T18:29:35.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.381+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x7f610c074060 2024-04-23T18:29:35.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.381+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610400a4a0 con 0x7f610c074060 2024-04-23T18:29:35.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.381+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4c32c0 2024-04-23T18:29:35.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.381+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.381+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x7f610c074060 2024-04-23T18:29:35.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.382+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610400a4a0 con 0x7f610c074060 2024-04-23T18:29:35.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.382+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4be8f0 2024-04-23T18:29:35.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.382+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610c071030 con 0x55df6e4be8f0 2024-04-23T18:29:35.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.382+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4c32c0 2024-04-23T18:29:35.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.382+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.382+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x7f610c074060 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.382+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.382+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4b9f00 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4bdb90 con 0x55df6e4be8f0 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c1bb0 con 0x55df6e4b9f00 2024-04-23T18:29:35.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c1bb0 con 0x55df6e4b9f00 2024-04-23T18:29:35.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:35.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.383+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c1bb0 con 0x7f610c074060 2024-04-23T18:29:35.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f611752e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:35.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f611752e800 20 zone default found 2024-04-23T18:29:35.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f611752e800 4 Realm: () 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f611752e800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f611752e800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f611752e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f611752e800 20 zonegroup default 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f611752e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c24e0 con 0x7f610c074060 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f611752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f611752e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c24e0 con 0x55df6e4c32c0 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.384+0000 7f611752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.385+0000 7f611752e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.385+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c7c80 con 0x55df6e4c32c0 2024-04-23T18:29:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.385+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.385+0000 7f611752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.385+0000 7f611752e800 20 started sync module instance, tier type = 2024-04-23T18:29:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.385+0000 7f611752e800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.385+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c7120 con 0x55df6e4be8f0 2024-04-23T18:29:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.386+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.386+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94418116570224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c8020 con 0x55df6e4be8f0 2024-04-23T18:29:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.386+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c89e0 con 0x55df6e4b9f00 2024-04-23T18:29:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.387+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94418116570224] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.387+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.387+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94418116576560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c8e00 con 0x55df6e4b9f00 2024-04-23T18:29:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.387+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c97c0 con 0x55df6e4c32c0 2024-04-23T18:29:35.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.388+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.388+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94418116580112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4ca060 con 0x55df6e4c32c0 2024-04-23T18:29:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.388+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4cab40 con 0x55df6e4be8f0 2024-04-23T18:29:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.388+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94418116576560] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.389+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94418116580112] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.389+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.389+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94418116585040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4caf30 con 0x55df6e4be8f0 2024-04-23T18:29:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.389+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4cb780 con 0x55df6e4b9f00 2024-04-23T18:29:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.390+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.390+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94418116588720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4cbf40 con 0x55df6e4b9f00 2024-04-23T18:29:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.390+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4cca60 con 0x7f610c074060 2024-04-23T18:29:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.390+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94418116585040] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.391+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.391+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94418116592944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4cca20 con 0x7f610c074060 2024-04-23T18:29:35.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.391+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4cd470 con 0x7f610c074060 2024-04-23T18:29:35.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.391+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94418116588720] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.392+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94418116592944] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.392+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.392+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94418116577616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4ccfc0 con 0x7f610c074060 2024-04-23T18:29:35.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.392+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4cd980 con 0x7f610c074060 2024-04-23T18:29:35.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.393+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.393+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94418116577616] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.393+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94418116596944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4cdda0 con 0x7f610c074060 2024-04-23T18:29:35.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.393+0000 7f611752e800 20 add_watcher() i=0 2024-04-23T18:29:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.393+0000 7f611752e800 20 add_watcher() i=1 2024-04-23T18:29:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.393+0000 7f611752e800 20 add_watcher() i=2 2024-04-23T18:29:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.393+0000 7f611752e800 20 add_watcher() i=3 2024-04-23T18:29:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.393+0000 7f611752e800 20 add_watcher() i=4 2024-04-23T18:29:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.393+0000 7f611752e800 20 add_watcher() i=5 2024-04-23T18:29:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.393+0000 7f611752e800 20 add_watcher() i=6 2024-04-23T18:29:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.394+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94418116596944] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.394+0000 7f611752e800 20 add_watcher() i=7 2024-04-23T18:29:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.394+0000 7f611752e800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.394+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4cdda0 con 0x55df6e4b9f00 2024-04-23T18:29:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.394+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.394+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94418116598000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4ce680 con 0x55df6e4b9f00 2024-04-23T18:29:35.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.395+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94418116598000] v32'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.395+0000 7f5fc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.396+0000 7f611752e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.396+0000 7f611752e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.396+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d0cb0 con 0x55df6e4b9f00 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.397+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.397+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4da010 con 0x7f610c074060 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.398+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.398+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4da450 con 0x55df6e4c32c0 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.399+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.399+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4dae70 con 0x55df6e4b9f00 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.399+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'114 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.399+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d9670 con 0x55df6e4be8f0 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.400+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.400+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d9670 con 0x55df6e4c32c0 2024-04-23T18:29:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.401+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.401+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4dbe80 con 0x55df6e4b9f00 2024-04-23T18:29:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.403+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.403+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4dbe80 con 0x7f610c074060 2024-04-23T18:29:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.403+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.403+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4dbe80 con 0x55df6e4be8f0 2024-04-23T18:29:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.405+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.405+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4dbe80 con 0x55df6e4c32c0 2024-04-23T18:29:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.405+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.406+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d8610 con 0x55df6e4be8f0 2024-04-23T18:29:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.406+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.406+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d8610 con 0x7f610c074060 2024-04-23T18:29:35.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.408+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.408+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d8610 con 0x55df6e4be8f0 2024-04-23T18:29:35.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.409+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.409+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7f00 con 0x7f610c074060 2024-04-23T18:29:35.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.410+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.410+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7f00 con 0x55df6e4b9f00 2024-04-23T18:29:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.411+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'115 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.411+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7f00 con 0x55df6e4c32c0 2024-04-23T18:29:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.412+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.412+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7f00 con 0x55df6e4be8f0 2024-04-23T18:29:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.413+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.413+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x55df6e4c32c0 2024-04-23T18:29:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.413+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.414+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x55df6e4b9f00 2024-04-23T18:29:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.415+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.415+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x55df6e4b9f00 2024-04-23T18:29:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.415+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'116 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.415+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x55df6e4c32c0 2024-04-23T18:29:35.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.416+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.416+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x55df6e4be8f0 2024-04-23T18:29:35.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.418+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.418+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x55df6e4c32c0 2024-04-23T18:29:35.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.419+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.419+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x55df6e4c32c0 2024-04-23T18:29:35.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.420+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.420+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x55df6e4c32c0 2024-04-23T18:29:35.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.421+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.421+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x55df6e4c32c0 2024-04-23T18:29:35.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.421+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.422+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x7f610c074060 2024-04-23T18:29:35.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.423+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.423+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x55df6e4c32c0 2024-04-23T18:29:35.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.424+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.424+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x7f610c074060 2024-04-23T18:29:35.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.425+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.425+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x55df6e4c32c0 2024-04-23T18:29:35.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.426+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.426+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x7f610c074060 2024-04-23T18:29:35.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.427+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.427+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4d7eb0 con 0x55df6e4be8f0 2024-04-23T18:29:35.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.428+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.428+0000 7f5fc8fe1640 20 reqs_thread_entry: start 2024-04-23T18:29:35.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.429+0000 7f611752e800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:35.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.429+0000 7f611752e800 20 Filter name: none 2024-04-23T18:29:35.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.429+0000 7f5f427fc640 20 reqs_thread_entry: start 2024-04-23T18:29:35.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.429+0000 7f611752e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-23T18:29:35.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.429+0000 7f611752e800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.429+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e5073b0 con 0x7f610c074060 2024-04-23T18:29:35.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.429+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.429+0000 7f611752e800 20 rados_obj.operate() r=0 bl.length=380 2024-04-23T18:29:35.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.429+0000 7f611752e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-23T18:29:35.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.429+0000 7f611752e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-23T18:29:35.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.429+0000 7f611752e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:35.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.429+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df6e509e20 con 0x7f610c074060 2024-04-23T18:29:35.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.430+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.428 INFO:teuthology.orchestra.run.smithi119.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-23T18:29:35.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.430+0000 7f5fc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:35.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.430+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94418116598000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4b6160 con 0x55df6e4b9f00 2024-04-23T18:29:35.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.431+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94418116598000] v32'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.431+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94418116570224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4cd8f0 con 0x55df6e4be8f0 2024-04-23T18:29:35.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.432+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94418116570224] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.432+0000 7f611752e800 20 remove_watcher() i=0 2024-04-23T18:29:35.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.432+0000 7f611752e800 2 removed watcher, disabling cache 2024-04-23T18:29:35.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.432+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94418116576560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c6c70 con 0x55df6e4b9f00 2024-04-23T18:29:35.442 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-23T18:29:35.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.433+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94418116576560] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.433+0000 7f611752e800 20 remove_watcher() i=1 2024-04-23T18:29:35.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.433+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94418116580112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c6c70 con 0x55df6e4c32c0 2024-04-23T18:29:35.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.434+0000 7f6112a66640 1 -- 172.21.15.119:0/699643187 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94418116580112] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f60fc081070 con 0x55df6e4c32c0 2024-04-23T18:29:35.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.434+0000 7f611752e800 20 remove_watcher() i=2 2024-04-23T18:29:35.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.434+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94418116585040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c6c70 con 0x55df6e4be8f0 2024-04-23T18:29:35.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.435+0000 7f6113267640 1 -- 172.21.15.119:0/699643187 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94418116585040] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f610c089040 con 0x55df6e4be8f0 2024-04-23T18:29:35.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.435+0000 7f611752e800 20 remove_watcher() i=3 2024-04-23T18:29:35.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.435+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94418116588720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4ca650 con 0x55df6e4b9f00 2024-04-23T18:29:35.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.436+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94418116588720] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x55df6e4b9f00 2024-04-23T18:29:35.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.436+0000 7f611752e800 20 remove_watcher() i=4 2024-04-23T18:29:35.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.436+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94418116592944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4c6c70 con 0x7f610c074060 2024-04-23T18:29:35.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.437+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94418116592944] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.438+0000 7f611752e800 20 remove_watcher() i=5 2024-04-23T18:29:35.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.438+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94418116577616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4cb4b0 con 0x7f610c074060 2024-04-23T18:29:35.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.439+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94418116577616] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.439+0000 7f611752e800 20 remove_watcher() i=6 2024-04-23T18:29:35.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.439+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94418116596944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df6e4cc530 con 0x7f610c074060 2024-04-23T18:29:35.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94418116596944] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6104040040 con 0x7f610c074060 2024-04-23T18:29:35.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 20 remove_watcher() i=7 2024-04-23T18:29:35.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f610c074060 msgr2=0x7f610c030820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f610c074060 0x7f610c030820 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55df6e4b9f00 msgr2=0x55df6e4bc3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55df6e4b9f00 0x55df6e4bc3c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55df6e4be8f0 msgr2=0x55df6e4c0ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55df6e4be8f0 0x55df6e4c0ce0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55df6e4c32c0 msgr2=0x55df6e4c5750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55df6e4c32c0 0x55df6e4c5750 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.448 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5fdc036ea0 msgr2=0x7f5fdc039360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5fdc036ea0 0x7f5fdc039360 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f60fc052fd0 tx=0x7f60fc04f000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f6113a68640 1 -- 172.21.15.119:0/699643187 reap_dead start 2024-04-23T18:29:35.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 msgr2=0x55df6e4ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 0x55df6e4ae880 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f610c04f010 tx=0x7f610c022f50 comp rx=0 tx=0).stop 2024-04-23T18:29:35.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 shutdown_connections 2024-04-23T18:29:35.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 --2- 172.21.15.119:0/699643187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e4a7510 0x55df6e4ae880 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 >> 172.21.15.119:0/699643187 conn(0x55df6e4a37e0 msgr2=0x55df6e4a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 shutdown_connections 2024-04-23T18:29:35.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/699643187 wait complete. 2024-04-23T18:29:35.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/1138117 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5fec036e60 msgr2=0x7f5fec039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 --2- 172.21.15.119:0/1138117 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5fec036e60 0x7f5fec039320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55df6e4800c0 tx=0x7f60fc005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:35.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/1138117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e49a3b0 msgr2=0x55df6e49a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 --2- 172.21.15.119:0/1138117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e49a3b0 0x55df6e49a7d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f610c04ba50 tx=0x7f610c01a950 comp rx=0 tx=0).stop 2024-04-23T18:29:35.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/1138117 shutdown_connections 2024-04-23T18:29:35.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 --2- 172.21.15.119:0/1138117 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5fec036e60 0x7f5fec039320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 --2- 172.21.15.119:0/1138117 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e49a3b0 0x55df6e49a7d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/1138117 >> 172.21.15.119:0/1138117 conn(0x55df6e48e450 msgr2=0x55df6e48e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/1138117 shutdown_connections 2024-04-23T18:29:35.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.440+0000 7f611752e800 1 -- 172.21.15.119:0/1138117 wait complete. 2024-04-23T18:29:35.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55df6e4893c0 msgr2=0x55df6e48b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55df6e4893c0 0x55df6e48b810 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55df6e384390 msgr2=0x55df6e482bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55df6e384390 0x55df6e482bd0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55df6e485480 msgr2=0x55df6e487870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55df6e485480 0x55df6e487870 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5ff8036eb0 msgr2=0x7f5ff8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5ff8036eb0 0x7f5ff8039370 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f60fc054000 tx=0x7f60fc04e000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e381440 msgr2=0x55df6e47bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 --2- 172.21.15.119:0/459252214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df6e381440 0x55df6e47bb60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x55df6e38af50 tx=0x7f610c000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f6113a68640 1 -- 172.21.15.119:0/459252214 reap_dead start 2024-04-23T18:29:35.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 shutdown_connections 2024-04-23T18:29:35.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 >> 172.21.15.119:0/459252214 conn(0x55df6e37aba0 msgr2=0x55df6e46d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 shutdown_connections 2024-04-23T18:29:35.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.441+0000 7f611752e800 1 -- 172.21.15.119:0/459252214 wait complete. 2024-04-23T18:29:35.455 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-23T18:29:35.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-23T18:29:35.456 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-04-23T18:29:35.508 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:35.605 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:35.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.516+0000 7f49dbe62800 1 Processor -- start 2024-04-23T18:29:35.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.516+0000 7f49dbe62800 1 -- start start 2024-04-23T18:29:35.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.516+0000 7f49dbe62800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bb7a3983d0 0x55bb7a3a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.516+0000 7f49dbe62800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bb7a248560 con 0x55bb7a396890 2024-04-23T18:29:35.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.516+0000 7f49dbe62800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55bb7a239e20 con 0x55bb7a3983d0 2024-04-23T18:29:35.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.517+0000 7f49d9160640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bb7a3983d0 0x55bb7a3a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.517+0000 7f49d9961640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55bb7a396890 0x55bb7a396cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40822/0 (socket says 172.21.15.119:40822) 2024-04-23T18:29:35.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.517+0000 7f49d9160640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bb7a3983d0 0x55bb7a3a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33870/0 (socket says 172.21.15.119:33870) 2024-04-23T18:29:35.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.517+0000 7f49d9961640 1 -- 172.21.15.119:0/1135345539 learned_addr learned my addr 172.21.15.119:0/1135345539 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:35.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.517+0000 7f49d9160640 1 -- 172.21.15.119:0/1135345539 >> v1:172.21.15.62:6789/0 conn(0x55bb7a396890 legacy=0x55bb7a396cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.517+0000 7f49d9160640 1 -- 172.21.15.119:0/1135345539 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb7a247e60 con 0x55bb7a3983d0 2024-04-23T18:29:35.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.519+0000 7f49d9160640 1 --2- 172.21.15.119:0/1135345539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a3983d0 0x55bb7a3a0ed0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f49d000a470 tx=0x7f49d001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c0ebb5c26612d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.519+0000 7f49d895f640 1 -- 172.21.15.119:0/1135345539 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d0057070 con 0x55bb7a3983d0 2024-04-23T18:29:35.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.519+0000 7f49d895f640 1 -- 172.21.15.119:0/1135345539 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d004adc0 con 0x55bb7a3983d0 2024-04-23T18:29:35.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.519+0000 7f49d895f640 1 -- 172.21.15.119:0/1135345539 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d0052590 con 0x55bb7a3983d0 2024-04-23T18:29:35.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.520+0000 7f49dbe62800 1 -- 172.21.15.119:0/1135345539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a3983d0 msgr2=0x55bb7a3a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.520+0000 7f49dbe62800 1 --2- 172.21.15.119:0/1135345539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a3983d0 0x55bb7a3a0ed0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f49d000a470 tx=0x7f49d001ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:35.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.520+0000 7f49dbe62800 1 -- 172.21.15.119:0/1135345539 shutdown_connections 2024-04-23T18:29:35.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.520+0000 7f49dbe62800 1 --2- 172.21.15.119:0/1135345539 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a3983d0 0x55bb7a3a0ed0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.520+0000 7f49dbe62800 1 -- 172.21.15.119:0/1135345539 >> 172.21.15.119:0/1135345539 conn(0x55bb7a392430 msgr2=0x55bb7a394850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.520+0000 7f49dbe62800 1 -- 172.21.15.119:0/1135345539 shutdown_connections 2024-04-23T18:29:35.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.520+0000 7f49dbe62800 1 -- 172.21.15.119:0/1135345539 wait complete. 2024-04-23T18:29:35.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.532+0000 7f49dbe62800 1 Processor -- start 2024-04-23T18:29:35.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.532+0000 7f49dbe62800 1 -- start start 2024-04-23T18:29:35.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.532+0000 7f49dbe62800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a396890 0x55bb7a48b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.532+0000 7f49dbe62800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bb7a2e35d0 con 0x55bb7a396890 2024-04-23T18:29:35.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.532+0000 7f49d9961640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a396890 0x55bb7a48b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.532+0000 7f49d9961640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a396890 0x55bb7a48b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33886/0 (socket says 172.21.15.119:33886) 2024-04-23T18:29:35.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.532+0000 7f49d9961640 1 -- 172.21.15.119:0/617569101 learned_addr learned my addr 172.21.15.119:0/617569101 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.533+0000 7f49d9961640 1 -- 172.21.15.119:0/617569101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb7a259860 con 0x55bb7a396890 2024-04-23T18:29:35.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.533+0000 7f49d9961640 1 --2- 172.21.15.119:0/617569101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a396890 0x55bb7a48b6e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f49cc001de0 tx=0x7f49cc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa873a097dcc5f5b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.533+0000 7f48c7e07640 1 -- 172.21.15.119:0/617569101 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc012020 con 0x55bb7a396890 2024-04-23T18:29:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.533+0000 7f48c7e07640 1 -- 172.21.15.119:0/617569101 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc00e5a0 con 0x55bb7a396890 2024-04-23T18:29:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.533+0000 7f48c7e07640 1 -- 172.21.15.119:0/617569101 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc00e8c0 con 0x55bb7a396890 2024-04-23T18:29:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49dbe62800 1 -- 172.21.15.119:0/617569101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a396890 msgr2=0x55bb7a48b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49dbe62800 1 --2- 172.21.15.119:0/617569101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a396890 0x55bb7a48b6e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f49cc001de0 tx=0x7f49cc00b6c0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49dbe62800 1 -- 172.21.15.119:0/617569101 shutdown_connections 2024-04-23T18:29:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49dbe62800 1 --2- 172.21.15.119:0/617569101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a396890 0x55bb7a48b6e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49dbe62800 1 -- 172.21.15.119:0/617569101 >> 172.21.15.119:0/617569101 conn(0x55bb7a392430 msgr2=0x55bb7a487000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49dbe62800 1 -- 172.21.15.119:0/617569101 shutdown_connections 2024-04-23T18:29:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49dbe62800 1 -- 172.21.15.119:0/617569101 wait complete. 2024-04-23T18:29:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49dbe62800 1 Processor -- start 2024-04-23T18:29:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49dbe62800 1 -- start start 2024-04-23T18:29:35.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49dbe62800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a396890 0x55bb7a493080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49dbe62800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bb7a3a36f0 con 0x55bb7a396890 2024-04-23T18:29:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49d9961640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a396890 0x55bb7a493080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49d9961640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a396890 0x55bb7a493080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33896/0 (socket says 172.21.15.119:33896) 2024-04-23T18:29:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.534+0000 7f49d9961640 1 -- 172.21.15.119:0/2110436973 learned_addr learned my addr 172.21.15.119:0/2110436973 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.535+0000 7f49d9961640 1 -- 172.21.15.119:0/2110436973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb7a257eb0 con 0x55bb7a396890 2024-04-23T18:29:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.535+0000 7f49d9961640 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a396890 0x55bb7a493080 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c010 tx=0x7f49cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.535+0000 7f48c6604640 1 -- 172.21.15.119:0/2110436973 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc012070 con 0x55bb7a396890 2024-04-23T18:29:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.535+0000 7f48c6604640 1 -- 172.21.15.119:0/2110436973 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc01a7a0 con 0x55bb7a396890 2024-04-23T18:29:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.535+0000 7f48c6604640 1 -- 172.21.15.119:0/2110436973 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc01aa80 con 0x55bb7a396890 2024-04-23T18:29:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.535+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb7a4935c0 con 0x55bb7a396890 2024-04-23T18:29:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.535+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb7a493ae0 con 0x55bb7a396890 2024-04-23T18:29:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.536+0000 7f48c6604640 1 -- 172.21.15.119:0/2110436973 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f49cc015020 con 0x55bb7a396890 2024-04-23T18:29:35.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.536+0000 7f48c6604640 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48c0036eb0 0x7f48c0039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.536+0000 7f48c6604640 1 -- 172.21.15.119:0/2110436973 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f49cc020070 con 0x55bb7a396890 2024-04-23T18:29:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.536+0000 7f49d9160640 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48c0036eb0 0x7f48c0039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.536+0000 7f49dbe62800 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bb7a3983d0 0x55bb7a49a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.536+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a49a5e0 con 0x55bb7a3983d0 2024-04-23T18:29:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.536+0000 7f49da162640 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bb7a3983d0 0x55bb7a49a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.536+0000 7f49d9160640 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48c0036eb0 0x7f48c0039370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49d0054000 tx=0x7f49d004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.536+0000 7f49da162640 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bb7a3983d0 0x55bb7a49a0a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.537+0000 7f49da162640 1 -- 172.21.15.119:0/2110436973 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a3983d0 2024-04-23T18:29:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.537+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a497670 con 0x55bb7a3983d0 2024-04-23T18:29:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.537+0000 7f49da162640 1 -- 172.21.15.119:0/2110436973 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a3983d0 2024-04-23T18:29:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.537+0000 7f49dbe62800 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bb7a49c910 0x55bb7a49ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.537+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a49f3f0 con 0x55bb7a49c910 2024-04-23T18:29:35.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.537+0000 7f49d9961640 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bb7a49c910 0x55bb7a49ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.537+0000 7f49d9961640 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bb7a49c910 0x55bb7a49ed00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.538+0000 7f49d9961640 1 -- 172.21.15.119:0/2110436973 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f49cc02b070 con 0x55bb7a49c910 2024-04-23T18:29:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.538+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a49b8c0 con 0x55bb7a3983d0 2024-04-23T18:29:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.538+0000 7f49da162640 1 -- 172.21.15.119:0/2110436973 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a3983d0 2024-04-23T18:29:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.538+0000 7f49dbe62800 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bb7a4a0850 0x55bb7a4a2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.538+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4a3440 con 0x55bb7a4a0850 2024-04-23T18:29:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.538+0000 7f49d9160640 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bb7a4a0850 0x55bb7a4a2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.538+0000 7f49d9160640 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bb7a4a0850 0x55bb7a4a2ce0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.539+0000 7f49d9160640 1 -- 172.21.15.119:0/2110436973 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4a0850 2024-04-23T18:29:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.539+0000 7f49dbe62800 1 Processor -- start 2024-04-23T18:29:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.539+0000 7f49dbe62800 1 -- start start 2024-04-23T18:29:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.539+0000 7f49dbe62800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4b1840 0x55bb7a4b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.539+0000 7f49dbe62800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bb7a289df0 con 0x55bb7a4b1840 2024-04-23T18:29:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.539+0000 7f49d9961640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4b1840 0x55bb7a4b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.539+0000 7f49d9961640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4b1840 0x55bb7a4b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33912/0 (socket says 172.21.15.119:33912) 2024-04-23T18:29:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.540+0000 7f49d9961640 1 -- 172.21.15.119:0/3579293438 learned_addr learned my addr 172.21.15.119:0/3579293438 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.540+0000 7f49d9961640 1 -- 172.21.15.119:0/3579293438 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb7a4b21a0 con 0x55bb7a4b1840 2024-04-23T18:29:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.540+0000 7f49d9961640 1 --2- 172.21.15.119:0/3579293438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4b1840 0x55bb7a4b1c60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f49cc022530 tx=0x7f49cc016ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.540+0000 7f48bf7fe640 1 -- 172.21.15.119:0/3579293438 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc034070 con 0x55bb7a4b1840 2024-04-23T18:29:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.540+0000 7f48bf7fe640 1 -- 172.21.15.119:0/3579293438 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc044130 con 0x55bb7a4b1840 2024-04-23T18:29:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.540+0000 7f49dbe62800 1 -- 172.21.15.119:0/3579293438 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb7a4b2c10 con 0x55bb7a4b1840 2024-04-23T18:29:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.540+0000 7f48bf7fe640 1 -- 172.21.15.119:0/3579293438 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc044410 con 0x55bb7a4b1840 2024-04-23T18:29:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.540+0000 7f49dbe62800 1 -- 172.21.15.119:0/3579293438 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb7a4b3110 con 0x55bb7a4b1840 2024-04-23T18:29:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.541+0000 7f48bf7fe640 1 -- 172.21.15.119:0/3579293438 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f49cc044680 con 0x55bb7a4b1840 2024-04-23T18:29:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.541+0000 7f48bf7fe640 1 --2- 172.21.15.119:0/3579293438 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48b4036eb0 0x7f48b4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.541+0000 7f48bf7fe640 1 -- 172.21.15.119:0/3579293438 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f49cc02fcc0 con 0x55bb7a4b1840 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.541+0000 7f49d9160640 1 --2- 172.21.15.119:0/3579293438 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48b4036eb0 0x7f48b4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.541+0000 7f49dbe62800 1 Processor -- start 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.541+0000 7f49dbe62800 1 -- start start 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.541+0000 7f49d9160640 1 --2- 172.21.15.119:0/3579293438 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48b4036eb0 0x7f48b4039370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49d0055040 tx=0x7f49d0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.541+0000 7f49dbe62800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 0x55bb7a4bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.541+0000 7f49dbe62800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bb7a48be60 con 0x55bb7a4be9b0 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.542+0000 7f49d9961640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 0x55bb7a4bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.542+0000 7f49d9961640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 0x55bb7a4bedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33920/0 (socket says 172.21.15.119:33920) 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.542+0000 7f49d9961640 1 -- 172.21.15.119:0/4020269087 learned_addr learned my addr 172.21.15.119:0/4020269087 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.542+0000 7f49d9961640 1 -- 172.21.15.119:0/4020269087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb7a4bf3a0 con 0x55bb7a4be9b0 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.542+0000 7f49d9961640 1 --2- 172.21.15.119:0/4020269087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 0x55bb7a4bedd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f49cc01a6f0 tx=0x7f49cc024460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829eadc7f4cda3b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.542+0000 7f48bd7fa640 1 -- 172.21.15.119:0/4020269087 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc024c60 con 0x55bb7a4be9b0 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.542+0000 7f48bd7fa640 1 -- 172.21.15.119:0/4020269087 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc0198c0 con 0x55bb7a4be9b0 2024-04-23T18:29:35.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.542+0000 7f48bd7fa640 1 -- 172.21.15.119:0/4020269087 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc03fc20 con 0x55bb7a4be9b0 2024-04-23T18:29:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49dbe62800 1 -- 172.21.15.119:0/4020269087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 msgr2=0x55bb7a4bedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49dbe62800 1 --2- 172.21.15.119:0/4020269087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 0x55bb7a4bedd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f49cc01a6f0 tx=0x7f49cc024460 comp rx=0 tx=0).stop 2024-04-23T18:29:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49dbe62800 1 -- 172.21.15.119:0/4020269087 shutdown_connections 2024-04-23T18:29:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49dbe62800 1 --2- 172.21.15.119:0/4020269087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 0x55bb7a4bedd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49dbe62800 1 -- 172.21.15.119:0/4020269087 >> 172.21.15.119:0/4020269087 conn(0x55bb7a4bac30 msgr2=0x55bb7a4b8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49dbe62800 1 -- 172.21.15.119:0/4020269087 shutdown_connections 2024-04-23T18:29:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49dbe62800 1 -- 172.21.15.119:0/4020269087 wait complete. 2024-04-23T18:29:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49dbe62800 1 Processor -- start 2024-04-23T18:29:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49dbe62800 1 -- start start 2024-04-23T18:29:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49dbe62800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 0x55bb7a4c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49dbe62800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bb7a4bfa10 con 0x55bb7a4be9b0 2024-04-23T18:29:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49d9961640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 0x55bb7a4c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49d9961640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 0x55bb7a4c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33924/0 (socket says 172.21.15.119:33924) 2024-04-23T18:29:35.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.543+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 learned_addr learned my addr 172.21.15.119:0/1607444110 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.544+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb7a4c6230 con 0x55bb7a4be9b0 2024-04-23T18:29:35.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.544+0000 7f49d9961640 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 0x55bb7a4c5cf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0244a0 tx=0x7f49cc04bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.544+0000 7f48ab7fe640 1 -- 172.21.15.119:0/1607444110 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc024c60 con 0x55bb7a4be9b0 2024-04-23T18:29:35.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.544+0000 7f48ab7fe640 1 -- 172.21.15.119:0/1607444110 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc0227c0 con 0x55bb7a4be9b0 2024-04-23T18:29:35.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.544+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb7a4c6230 con 0x55bb7a4be9b0 2024-04-23T18:29:35.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.544+0000 7f48ab7fe640 1 -- 172.21.15.119:0/1607444110 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc022ae0 con 0x55bb7a4be9b0 2024-04-23T18:29:35.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.544+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb7a4c6230 con 0x55bb7a4be9b0 2024-04-23T18:29:35.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.545+0000 7f48ab7fe640 1 -- 172.21.15.119:0/1607444110 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f49cc064070 con 0x55bb7a4be9b0 2024-04-23T18:29:35.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.545+0000 7f48ab7fe640 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48a4036e60 0x7f48a4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.545+0000 7f48ab7fe640 1 -- 172.21.15.119:0/1607444110 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f49cc068c60 con 0x55bb7a4be9b0 2024-04-23T18:29:35.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.545+0000 7f49d9160640 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48a4036e60 0x7f48a4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.545+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.545+0000 7f49dbe62800 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bb7a4d1480 0x55bb7a4d3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.545+0000 7f49d9160640 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48a4036e60 0x7f48a4039320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49d001ced0 tx=0x7f49d004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.545+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d4090 con 0x55bb7a4d1480 2024-04-23T18:29:35.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.545+0000 7f49da162640 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bb7a4d1480 0x55bb7a4d3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49da162640 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bb7a4d1480 0x55bb7a4d3940 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a4d1480 2024-04-23T18:29:35.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49dbe62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49dbe62800 20 realm 2024-04-23T18:29:35.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d44a0 con 0x55bb7a4d1480 2024-04-23T18:29:35.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a4d1480 2024-04-23T18:29:35.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49dbe62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49dbe62800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d4d70 con 0x55bb7a4d1480 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a4d1480 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49dbe62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.546+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d1480 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.547+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a4d1480 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.547+0000 7f49dbe62800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.547+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.547+0000 7f49dbe62800 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bb7a4d5e70 0x55bb7a4d8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.547+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d8870 con 0x55bb7a4d5e70 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.547+0000 7f49d9961640 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bb7a4d5e70 0x55bb7a4d8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.547+0000 7f49d9961640 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bb7a4d5e70 0x55bb7a4d8260 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.547+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f49cc06d020 con 0x55bb7a4d5e70 2024-04-23T18:29:35.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.547+0000 7f49dbe62800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:35.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.547+0000 7f49dbe62800 20 searching for the correct realm 2024-04-23T18:29:35.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.547+0000 7f49dbe62800 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bb7a4da820 0x55bb7a4dcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.547+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4dd3b0 con 0x55bb7a4da820 2024-04-23T18:29:35.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.547+0000 7f49d9160640 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bb7a4da820 0x55bb7a4dcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.548+0000 7f49d9160640 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bb7a4da820 0x55bb7a4dcce0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.548+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.548+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4dd3b0 con 0x55bb7a4d5e70 2024-04-23T18:29:35.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.548+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc06d020 con 0x55bb7a4d5e70 2024-04-23T18:29:35.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.548+0000 7f49d9961640 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f49cc030c50 0x7f49cc02e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.548+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4dd3b0 con 0x7f49cc030c50 2024-04-23T18:29:35.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.549+0000 7f49da162640 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f49cc030c50 0x7f49cc02e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.549+0000 7f49da162640 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f49cc030c50 0x7f49cc02e480 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.549+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d400a4a0 con 0x7f49cc030c50 2024-04-23T18:29:35.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.549+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d1480 2024-04-23T18:29:35.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.550+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a4d1480 2024-04-23T18:29:35.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.550+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d1480 2024-04-23T18:29:35.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.550+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a4d1480 2024-04-23T18:29:35.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.550+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x7f49cc030c50 2024-04-23T18:29:35.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.550+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d400a4a0 con 0x7f49cc030c50 2024-04-23T18:29:35.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.550+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x7f49cc030c50 2024-04-23T18:29:35.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.550+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f49d400a4a0 con 0x7f49cc030c50 2024-04-23T18:29:35.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.550+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d5e70 2024-04-23T18:29:35.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.551+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc06d020 con 0x55bb7a4d5e70 2024-04-23T18:29:35.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.551+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4da820 2024-04-23T18:29:35.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.551+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.551+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d1480 2024-04-23T18:29:35.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.551+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a4d1480 2024-04-23T18:29:35.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.551+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x7f49cc030c50 2024-04-23T18:29:35.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.551+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d400a4a0 con 0x7f49cc030c50 2024-04-23T18:29:35.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.551+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d1480 2024-04-23T18:29:35.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.552+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a4d1480 2024-04-23T18:29:35.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.552+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d5e70 2024-04-23T18:29:35.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.552+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f49cc06d020 con 0x55bb7a4d5e70 2024-04-23T18:29:35.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.552+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4da820 2024-04-23T18:29:35.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.552+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.552+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4da820 2024-04-23T18:29:35.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.552+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.552+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x7f49cc030c50 2024-04-23T18:29:35.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.552+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d400a4a0 con 0x7f49cc030c50 2024-04-23T18:29:35.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.553+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4da820 2024-04-23T18:29:35.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.553+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.553+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4da820 2024-04-23T18:29:35.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.553+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.553+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d1480 2024-04-23T18:29:35.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.553+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a4d1480 2024-04-23T18:29:35.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.553+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d1480 2024-04-23T18:29:35.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.553+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a4d1480 2024-04-23T18:29:35.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.553+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x7f49cc030c50 2024-04-23T18:29:35.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.554+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d400a4a0 con 0x7f49cc030c50 2024-04-23T18:29:35.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.554+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4da820 2024-04-23T18:29:35.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.554+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.554+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d5e70 2024-04-23T18:29:35.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.554+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f49cc080080 con 0x55bb7a4d5e70 2024-04-23T18:29:35.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.554+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d1480 2024-04-23T18:29:35.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.555+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d400a4a0 con 0x55bb7a4d1480 2024-04-23T18:29:35.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.555+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x7f49cc030c50 2024-04-23T18:29:35.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.555+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d400a4a0 con 0x7f49cc030c50 2024-04-23T18:29:35.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.555+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4da820 2024-04-23T18:29:35.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.555+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.556+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x7f49cc030c50 2024-04-23T18:29:35.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.556+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d400a4a0 con 0x7f49cc030c50 2024-04-23T18:29:35.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.556+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d5e70 2024-04-23T18:29:35.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.556+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc080080 con 0x55bb7a4d5e70 2024-04-23T18:29:35.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.556+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4da820 2024-04-23T18:29:35.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.556+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.556+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x7f49cc030c50 2024-04-23T18:29:35.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.556+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.556+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d1480 2024-04-23T18:29:35.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f49d4040040 con 0x55bb7a4d1480 2024-04-23T18:29:35.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d5110 con 0x55bb7a4d5e70 2024-04-23T18:29:35.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc080080 con 0x55bb7a4d5e70 2024-04-23T18:29:35.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:35.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:35.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:35.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:35.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:35.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:35.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d9130 con 0x55bb7a4d1480 2024-04-23T18:29:35.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x55bb7a4d1480 2024-04-23T18:29:35.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d9130 con 0x55bb7a4d1480 2024-04-23T18:29:35.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49d4040040 con 0x55bb7a4d1480 2024-04-23T18:29:35.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:35.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.557+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d9130 con 0x7f49cc030c50 2024-04-23T18:29:35.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 20 zone default found 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 4 Realm: () 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 20 zonegroup default 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d9a20 con 0x7f49cc030c50 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4d9a20 con 0x55bb7a4da820 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.558+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4df210 con 0x55bb7a4da820 2024-04-23T18:29:35.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.559+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.559+0000 7f49dbe62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.559+0000 7f49dbe62800 20 started sync module instance, tier type = 2024-04-23T18:29:35.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.559+0000 7f49dbe62800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:35.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.559+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4de6b0 con 0x55bb7a4d5e70 2024-04-23T18:29:35.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.560+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc080080 con 0x55bb7a4d5e70 2024-04-23T18:29:35.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.560+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94263699172048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4de310 con 0x55bb7a4d5e70 2024-04-23T18:29:35.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.560+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4dff10 con 0x55bb7a4d1480 2024-04-23T18:29:35.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.561+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94263699172048] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc080080 con 0x55bb7a4d5e70 2024-04-23T18:29:35.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.561+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x55bb7a4d1480 2024-04-23T18:29:35.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.561+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94263699174832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4dfe80 con 0x55bb7a4d1480 2024-04-23T18:29:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.561+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e0930 con 0x55bb7a4da820 2024-04-23T18:29:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.562+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94263699174832] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x55bb7a4d1480 2024-04-23T18:29:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.562+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.562+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94263699175888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4dfdf0 con 0x55bb7a4da820 2024-04-23T18:29:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.562+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e17f0 con 0x55bb7a4d5e70 2024-04-23T18:29:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.563+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc080080 con 0x55bb7a4d5e70 2024-04-23T18:29:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.563+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94263699175888] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.563+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94263699182880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e0dc0 con 0x55bb7a4d5e70 2024-04-23T18:29:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.563+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e24e0 con 0x55bb7a4d1480 2024-04-23T18:29:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.564+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94263699182880] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc080080 con 0x55bb7a4d5e70 2024-04-23T18:29:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.564+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x55bb7a4d1480 2024-04-23T18:29:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.564+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94263699183936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e24e0 con 0x55bb7a4d1480 2024-04-23T18:29:35.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.564+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e2f60 con 0x7f49cc030c50 2024-04-23T18:29:35.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.565+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.565+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94263699188336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e2e90 con 0x7f49cc030c50 2024-04-23T18:29:35.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.565+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e3e70 con 0x7f49cc030c50 2024-04-23T18:29:35.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.565+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94263699183936] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x55bb7a4d1480 2024-04-23T18:29:35.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.566+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(56 notify.6 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.566+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94263699185632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e3e70 con 0x7f49cc030c50 2024-04-23T18:29:35.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.566+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e4830 con 0x7f49cc030c50 2024-04-23T18:29:35.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.566+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94263699188336] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.567+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.567+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94263699185632] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.567+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94263699190528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e4380 con 0x7f49cc030c50 2024-04-23T18:29:35.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.567+0000 7f49dbe62800 20 add_watcher() i=0 2024-04-23T18:29:35.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.567+0000 7f49dbe62800 20 add_watcher() i=1 2024-04-23T18:29:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.567+0000 7f49dbe62800 20 add_watcher() i=2 2024-04-23T18:29:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.567+0000 7f49dbe62800 20 add_watcher() i=3 2024-04-23T18:29:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.567+0000 7f49dbe62800 20 add_watcher() i=4 2024-04-23T18:29:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.567+0000 7f49dbe62800 20 add_watcher() i=5 2024-04-23T18:29:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.567+0000 7f49dbe62800 20 add_watcher() i=6 2024-04-23T18:29:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.568+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94263699190528] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.568+0000 7f49dbe62800 20 add_watcher() i=7 2024-04-23T18:29:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.568+0000 7f49dbe62800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.568+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e7860 con 0x55bb7a4d1480 2024-04-23T18:29:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.568+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f49d4040040 con 0x55bb7a4d1480 2024-04-23T18:29:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.568+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94263699194752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e4d60 con 0x55bb7a4d1480 2024-04-23T18:29:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.569+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94263699194752] v32'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x55bb7a4d1480 2024-04-23T18:29:35.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.570+0000 7f488b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.570+0000 7f49dbe62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.570+0000 7f49dbe62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.570+0000 7f49dbe62800 5 note: GC not initialized 2024-04-23T18:29:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.570+0000 7f488a7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.570+0000 7f49dbe62800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.570+0000 7f49dbe62800 20 Filter name: none 2024-04-23T18:29:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.570+0000 7f47fbfff640 20 reqs_thread_entry: start 2024-04-23T18:29:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.570+0000 7f49dbe62800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-23T18:29:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.570+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.570+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a51aeb0 con 0x7f49cc030c50 2024-04-23T18:29:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49dbe62800 20 rados_obj.operate() r=0 bl.length=380 2024-04-23T18:29:35.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49dbe62800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-23T18:29:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49dbe62800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-23T18:29:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49dbe62800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49dbe62800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-23T18:29:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a51cf90 con 0x55bb7a4d5e70 2024-04-23T18:29:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f49cc080080 con 0x55bb7a4d5e70 2024-04-23T18:29:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49dbe62800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49dbe62800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-23T18:29:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49dbe62800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49dbe62800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 : miss 2024-04-23T18:29:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.571+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a51e9d0 con 0x55bb7a4da820 2024-04-23T18:29:35.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.572+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.572+0000 7f49dbe62800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:35.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.572+0000 7f49dbe62800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:35.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.572+0000 7f49dbe62800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:35.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.572+0000 7f49dbe62800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:35.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.572+0000 7f49dbe62800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:35.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.572+0000 7f49dbe62800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 2024-04-23T18:29:35.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.572+0000 7f49dbe62800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-23T18:29:35.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.572+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a5203a0 con 0x7f49cc030c50 2024-04-23T18:29:35.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.573+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(65 fud.buckets [call] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.573+0000 7f49dbe62800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-23T18:29:35.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.573+0000 7f49dbe62800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.573+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a5207a0 con 0x55bb7a4d5e70 2024-04-23T18:29:35.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.573+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f49cc080080 con 0x55bb7a4d5e70 2024-04-23T18:29:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.573+0000 7f49dbe62800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.573+0000 7f49dbe62800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-23T18:29:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.573+0000 7f49dbe62800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.573+0000 7f49dbe62800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.573+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a526390 con 0x55bb7a4d5e70 2024-04-23T18:29:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.574+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f49cc080080 con 0x55bb7a4d5e70 2024-04-23T18:29:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.574+0000 7f49dbe62800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-23T18:29:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.574+0000 7f49dbe62800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.574+0000 7f49dbe62800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-23T18:29:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.574+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94263699447456 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a523800 con 0x7f49cc030c50 2024-04-23T18:29:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.575+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== watch-notify(notify (1) cookie 94263699185632 notify 137438953478 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7f49d4018b00 con 0x7f49cc030c50 2024-04-23T18:29:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.575+0000 7f48bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94263699185632 notifier 4511 bl.length()=338 2024-04-23T18:29:35.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.575+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(68 notify.6 [notify cookie 94263699447456 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.575+0000 7f48bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.575+0000 7f48bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.575+0000 7f48bd7fa640 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f489c003ea0 con 0x7f49cc030c50 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.575+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== watch-notify(notify_complete (2) cookie 94263699447456 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f49d4046450 con 0x7f49cc030c50 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.575+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.576+0000 7f488b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.576+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94263699194752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a51b8d0 con 0x55bb7a4d1480 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.577+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94263699194752] v32'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x55bb7a4d1480 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.577+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94263699172048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e4380 con 0x55bb7a4d5e70 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.578+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94263699172048] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc080080 con 0x55bb7a4d5e70 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.578+0000 7f49dbe62800 20 remove_watcher() i=0 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.578+0000 7f49dbe62800 2 removed watcher, disabling cache 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.578+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94263699174832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e4380 con 0x55bb7a4d1480 2024-04-23T18:29:35.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.579+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94263699174832] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x55bb7a4d1480 2024-04-23T18:29:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.579+0000 7f49dbe62800 20 remove_watcher() i=1 2024-04-23T18:29:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.579+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94263699175888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4df5b0 con 0x55bb7a4da820 2024-04-23T18:29:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.580+0000 7f49d9160640 1 -- 172.21.15.119:0/1607444110 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94263699175888] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d005a040 con 0x55bb7a4da820 2024-04-23T18:29:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.580+0000 7f49dbe62800 20 remove_watcher() i=2 2024-04-23T18:29:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.580+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94263699182880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e4380 con 0x55bb7a4d5e70 2024-04-23T18:29:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.581+0000 7f49d9961640 1 -- 172.21.15.119:0/1607444110 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94263699182880] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc080080 con 0x55bb7a4d5e70 2024-04-23T18:29:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.581+0000 7f49dbe62800 20 remove_watcher() i=3 2024-04-23T18:29:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.581+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94263699183936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e1520 con 0x55bb7a4d1480 2024-04-23T18:29:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.582+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94263699183936] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x55bb7a4d1480 2024-04-23T18:29:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.582+0000 7f49dbe62800 20 remove_watcher() i=4 2024-04-23T18:29:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.582+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94263699188336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e4380 con 0x7f49cc030c50 2024-04-23T18:29:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.583+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94263699188336] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.583+0000 7f49dbe62800 20 remove_watcher() i=5 2024-04-23T18:29:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.583+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94263699185632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e2a70 con 0x7f49cc030c50 2024-04-23T18:29:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.583+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94263699185632] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.584+0000 7f49dbe62800 20 remove_watcher() i=6 2024-04-23T18:29:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.584+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94263699190528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb7a4e4380 con 0x7f49cc030c50 2024-04-23T18:29:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.584+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94263699190528] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d4040040 con 0x7f49cc030c50 2024-04-23T18:29:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 20 remove_watcher() i=7 2024-04-23T18:29:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f49cc030c50 msgr2=0x7f49cc02e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f49cc030c50 0x7f49cc02e480 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bb7a4d1480 msgr2=0x55bb7a4d3940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bb7a4d1480 0x55bb7a4d3940 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bb7a4d5e70 msgr2=0x55bb7a4d8260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bb7a4d5e70 0x55bb7a4d8260 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bb7a4da820 msgr2=0x55bb7a4dcce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bb7a4da820 0x55bb7a4dcce0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48a4036e60 msgr2=0x7f48a4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48a4036e60 0x7f48a4039320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49d001ced0 tx=0x7f49d004f000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 msgr2=0x55bb7a4c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49da162640 1 -- 172.21.15.119:0/1607444110 reap_dead start 2024-04-23T18:29:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 0x55bb7a4c5cf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f49cc0244a0 tx=0x7f49cc04bf60 comp rx=0 tx=0).stop 2024-04-23T18:29:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 shutdown_connections 2024-04-23T18:29:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 --2- 172.21.15.119:0/1607444110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4be9b0 0x55bb7a4c5cf0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 >> 172.21.15.119:0/1607444110 conn(0x55bb7a4bac30 msgr2=0x55bb7a4b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 shutdown_connections 2024-04-23T18:29:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/1607444110 wait complete. 2024-04-23T18:29:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/3579293438 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48b4036eb0 msgr2=0x7f48b4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 --2- 172.21.15.119:0/3579293438 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48b4036eb0 0x7f48b4039370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49d0055040 tx=0x7f49d0005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:35.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/3579293438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4b1840 msgr2=0x55bb7a4b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 --2- 172.21.15.119:0/3579293438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4b1840 0x55bb7a4b1c60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f49cc022530 tx=0x7f49cc016ea0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/3579293438 shutdown_connections 2024-04-23T18:29:35.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 --2- 172.21.15.119:0/3579293438 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48b4036eb0 0x7f48b4039370 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 --2- 172.21.15.119:0/3579293438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a4b1840 0x55bb7a4b1c60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/3579293438 >> 172.21.15.119:0/3579293438 conn(0x55bb7a4a58e0 msgr2=0x55bb7a4a5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/3579293438 shutdown_connections 2024-04-23T18:29:35.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.585+0000 7f49dbe62800 1 -- 172.21.15.119:0/3579293438 wait complete. 2024-04-23T18:29:35.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bb7a4a0850 msgr2=0x55bb7a4a2ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bb7a4a0850 0x55bb7a4a2ce0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bb7a3983d0 msgr2=0x55bb7a49a0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bb7a3983d0 0x55bb7a49a0a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bb7a49c910 msgr2=0x55bb7a49ed00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bb7a49c910 0x55bb7a49ed00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48c0036eb0 msgr2=0x7f48c0039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f48c0036eb0 0x7f48c0039370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49d0054000 tx=0x7f49d004e000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a396890 msgr2=0x55bb7a493080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 --2- 172.21.15.119:0/2110436973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb7a396890 0x55bb7a493080 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c010 tx=0x7f49cc000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49da162640 1 -- 172.21.15.119:0/2110436973 reap_dead start 2024-04-23T18:29:35.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 shutdown_connections 2024-04-23T18:29:35.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 >> 172.21.15.119:0/2110436973 conn(0x55bb7a392430 msgr2=0x55bb7a485840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 shutdown_connections 2024-04-23T18:29:35.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.586+0000 7f49dbe62800 1 -- 172.21.15.119:0/2110436973 wait complete. 2024-04-23T18:29:35.678 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1'] 2024-04-23T18:29:35.678 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1'] 2024-04-23T18:29:35.678 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 2024-04-23T18:29:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:35.727 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:35.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.735+0000 7fafa39a2800 1 Processor -- start 2024-04-23T18:29:35.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.735+0000 7fafa39a2800 1 -- start start 2024-04-23T18:29:35.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.736+0000 7fafa39a2800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561c95606520 0x561c95608910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.736+0000 7fafa39a2800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561c954b2560 con 0x561c95602a10 2024-04-23T18:29:35.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.736+0000 7fafa39a2800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x561c954a3e20 con 0x561c95606520 2024-04-23T18:29:35.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.736+0000 7fafa0ca7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561c95606520 0x561c95608910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.736+0000 7fafa14a8640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x561c95602a10 0x561c95604e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40834/0 (socket says 172.21.15.119:40834) 2024-04-23T18:29:35.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.736+0000 7fafa0ca7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561c95606520 0x561c95608910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33940/0 (socket says 172.21.15.119:33940) 2024-04-23T18:29:35.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.736+0000 7fafa14a8640 1 -- 172.21.15.119:0/1136434298 learned_addr learned my addr 172.21.15.119:0/1136434298 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:35.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.736+0000 7fafa0ca7640 1 -- 172.21.15.119:0/1136434298 >> v1:172.21.15.62:6789/0 conn(0x561c95602a10 legacy=0x561c95604e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.736+0000 7fafa0ca7640 1 -- 172.21.15.119:0/1136434298 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c954b1e60 con 0x561c95606520 2024-04-23T18:29:35.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.738+0000 7fafa0ca7640 1 --2- 172.21.15.119:0/1136434298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95606520 0x561c95608910 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7faf9800a470 tx=0x7faf9801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a9d9369b40f62e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.738+0000 7faf93fff640 1 -- 172.21.15.119:0/1136434298 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf98057070 con 0x561c95606520 2024-04-23T18:29:35.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.738+0000 7faf93fff640 1 -- 172.21.15.119:0/1136434298 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf98052570 con 0x561c95606520 2024-04-23T18:29:35.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.738+0000 7faf93fff640 1 -- 172.21.15.119:0/1136434298 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf98052870 con 0x561c95606520 2024-04-23T18:29:35.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.739+0000 7fafa39a2800 1 -- 172.21.15.119:0/1136434298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95606520 msgr2=0x561c95608910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.739+0000 7fafa39a2800 1 --2- 172.21.15.119:0/1136434298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95606520 0x561c95608910 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7faf9800a470 tx=0x7faf9801ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:35.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.739+0000 7fafa39a2800 1 -- 172.21.15.119:0/1136434298 shutdown_connections 2024-04-23T18:29:35.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.739+0000 7fafa39a2800 1 --2- 172.21.15.119:0/1136434298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95606520 0x561c95608910 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.739+0000 7fafa39a2800 1 -- 172.21.15.119:0/1136434298 >> 172.21.15.119:0/1136434298 conn(0x561c955fc440 msgr2=0x561c955fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.739+0000 7fafa39a2800 1 -- 172.21.15.119:0/1136434298 shutdown_connections 2024-04-23T18:29:35.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.739+0000 7fafa39a2800 1 -- 172.21.15.119:0/1136434298 wait complete. 2024-04-23T18:29:35.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.751+0000 7fafa39a2800 1 Processor -- start 2024-04-23T18:29:35.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.751+0000 7fafa39a2800 1 -- start start 2024-04-23T18:29:35.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.751+0000 7fafa39a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95602a10 0x561c956f3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.751+0000 7fafa39a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c9554d5d0 con 0x561c95602a10 2024-04-23T18:29:35.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.751+0000 7fafa14a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95602a10 0x561c956f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.751+0000 7fafa14a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95602a10 0x561c956f3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33956/0 (socket says 172.21.15.119:33956) 2024-04-23T18:29:35.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.751+0000 7fafa14a8640 1 -- 172.21.15.119:0/677105670 learned_addr learned my addr 172.21.15.119:0/677105670 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.751+0000 7fafa14a8640 1 -- 172.21.15.119:0/677105670 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c954c3860 con 0x561c95602a10 2024-04-23T18:29:35.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.752+0000 7fafa14a8640 1 --2- 172.21.15.119:0/677105670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95602a10 0x561c956f3290 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faf94001de0 tx=0x7faf9400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d96ae27a8e9f64 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.752+0000 7fae8f606640 1 -- 172.21.15.119:0/677105670 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf94012020 con 0x561c95602a10 2024-04-23T18:29:35.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.752+0000 7fae8f606640 1 -- 172.21.15.119:0/677105670 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf9400e5a0 con 0x561c95602a10 2024-04-23T18:29:35.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.752+0000 7fae8f606640 1 -- 172.21.15.119:0/677105670 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf9400e8c0 con 0x561c95602a10 2024-04-23T18:29:35.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.752+0000 7fafa39a2800 1 -- 172.21.15.119:0/677105670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95602a10 msgr2=0x561c956f3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.752+0000 7fafa39a2800 1 --2- 172.21.15.119:0/677105670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95602a10 0x561c956f3290 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faf94001de0 tx=0x7faf9400b6c0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.752+0000 7fafa39a2800 1 -- 172.21.15.119:0/677105670 shutdown_connections 2024-04-23T18:29:35.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.752+0000 7fafa39a2800 1 --2- 172.21.15.119:0/677105670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95602a10 0x561c956f3290 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.752+0000 7fafa39a2800 1 -- 172.21.15.119:0/677105670 >> 172.21.15.119:0/677105670 conn(0x561c955fc440 msgr2=0x561c956eebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.753+0000 7fafa39a2800 1 -- 172.21.15.119:0/677105670 shutdown_connections 2024-04-23T18:29:35.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.753+0000 7fafa39a2800 1 -- 172.21.15.119:0/677105670 wait complete. 2024-04-23T18:29:35.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.753+0000 7fafa39a2800 1 Processor -- start 2024-04-23T18:29:35.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.753+0000 7fafa39a2800 1 -- start start 2024-04-23T18:29:35.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.753+0000 7fafa39a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95602a10 0x561c956fabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.753+0000 7fafa39a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c95609150 con 0x561c95602a10 2024-04-23T18:29:35.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.753+0000 7fafa14a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95602a10 0x561c956fabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.753+0000 7fafa14a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95602a10 0x561c956fabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33958/0 (socket says 172.21.15.119:33958) 2024-04-23T18:29:35.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.753+0000 7fafa14a8640 1 -- 172.21.15.119:0/2448101188 learned_addr learned my addr 172.21.15.119:0/2448101188 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.753+0000 7fafa14a8640 1 -- 172.21.15.119:0/2448101188 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c954c1eb0 con 0x561c95602a10 2024-04-23T18:29:35.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.754+0000 7fafa14a8640 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95602a10 0x561c956fabf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7faf94001de0 tx=0x7faf94000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.754+0000 7fae8de03640 1 -- 172.21.15.119:0/2448101188 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf94012030 con 0x561c95602a10 2024-04-23T18:29:35.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.754+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c956fb130 con 0x561c95602a10 2024-04-23T18:29:35.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.754+0000 7fae8de03640 1 -- 172.21.15.119:0/2448101188 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf9401a7a0 con 0x561c95602a10 2024-04-23T18:29:35.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.754+0000 7fae8de03640 1 -- 172.21.15.119:0/2448101188 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf9401aac0 con 0x561c95602a10 2024-04-23T18:29:35.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.754+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c956fb650 con 0x561c95602a10 2024-04-23T18:29:35.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.755+0000 7fae8de03640 1 -- 172.21.15.119:0/2448101188 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7faf94015020 con 0x561c95602a10 2024-04-23T18:29:35.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.755+0000 7fae8de03640 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae88036e60 0x7fae88039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.755+0000 7fae8de03640 1 -- 172.21.15.119:0/2448101188 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7faf94020070 con 0x561c95602a10 2024-04-23T18:29:35.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.755+0000 7fafa0ca7640 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae88036e60 0x7fae88039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.755+0000 7fafa39a2800 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561c95606520 0x561c95701c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.755+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c957021a0 con 0x561c95606520 2024-04-23T18:29:35.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.755+0000 7fafa1ca9640 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561c95606520 0x561c95701c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.755+0000 7fafa0ca7640 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae88036e60 0x7fae88039320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faf98054000 tx=0x7faf9804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.756+0000 7fafa1ca9640 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561c95606520 0x561c95701c60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.756+0000 7fafa1ca9640 1 -- 172.21.15.119:0/2448101188 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c95606520 2024-04-23T18:29:35.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.756+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c956ff210 con 0x561c95606520 2024-04-23T18:29:35.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.756+0000 7fafa1ca9640 1 -- 172.21.15.119:0/2448101188 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c95606520 2024-04-23T18:29:35.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.756+0000 7fafa39a2800 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561c95704490 0x561c95706880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.756+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c95706f20 con 0x561c95704490 2024-04-23T18:29:35.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.756+0000 7fafa14a8640 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561c95704490 0x561c95706880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.756+0000 7fafa14a8640 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561c95704490 0x561c95706880 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.757+0000 7fafa14a8640 1 -- 172.21.15.119:0/2448101188 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faf94024980 con 0x561c95704490 2024-04-23T18:29:35.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.757+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c95703440 con 0x561c95606520 2024-04-23T18:29:35.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.757+0000 7fafa1ca9640 1 -- 172.21.15.119:0/2448101188 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c95606520 2024-04-23T18:29:35.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.757+0000 7fafa39a2800 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561c95708380 0x561c9570a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.757+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c9570afb0 con 0x561c95708380 2024-04-23T18:29:35.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.757+0000 7fafa0ca7640 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561c95708380 0x561c9570a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.758+0000 7fafa0ca7640 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561c95708380 0x561c9570a820 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.758+0000 7fafa0ca7640 1 -- 172.21.15.119:0/2448101188 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faf98052940 con 0x561c95708380 2024-04-23T18:29:35.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.758+0000 7fafa39a2800 1 Processor -- start 2024-04-23T18:29:35.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.758+0000 7fafa39a2800 1 -- start start 2024-04-23T18:29:35.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.758+0000 7fafa39a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95719410 0x561c95719830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.758+0000 7fafa39a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c954f3df0 con 0x561c95719410 2024-04-23T18:29:35.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.759+0000 7fafa14a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95719410 0x561c95719830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.759+0000 7fafa14a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95719410 0x561c95719830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33968/0 (socket says 172.21.15.119:33968) 2024-04-23T18:29:35.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.759+0000 7fafa14a8640 1 -- 172.21.15.119:0/1268526706 learned_addr learned my addr 172.21.15.119:0/1268526706 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.759+0000 7fafa14a8640 1 -- 172.21.15.119:0/1268526706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c95719d70 con 0x561c95719410 2024-04-23T18:29:35.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.759+0000 7fafa14a8640 1 --2- 172.21.15.119:0/1268526706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95719410 0x561c95719830 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7faf9400efd0 tx=0x7faf94040e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.759+0000 7fae86ffd640 1 -- 172.21.15.119:0/1268526706 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf9403b070 con 0x561c95719410 2024-04-23T18:29:35.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.759+0000 7fae86ffd640 1 -- 172.21.15.119:0/1268526706 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf9401ad90 con 0x561c95719410 2024-04-23T18:29:35.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.759+0000 7fafa39a2800 1 -- 172.21.15.119:0/1268526706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c9571a7e0 con 0x561c95719410 2024-04-23T18:29:35.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.759+0000 7fae86ffd640 1 -- 172.21.15.119:0/1268526706 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf9400d500 con 0x561c95719410 2024-04-23T18:29:35.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.759+0000 7fafa39a2800 1 -- 172.21.15.119:0/1268526706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c9571ace0 con 0x561c95719410 2024-04-23T18:29:35.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.760+0000 7fae86ffd640 1 -- 172.21.15.119:0/1268526706 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7faf94018c80 con 0x561c95719410 2024-04-23T18:29:35.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.760+0000 7fae86ffd640 1 --2- 172.21.15.119:0/1268526706 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae78036e10 0x7fae780392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.760+0000 7fae86ffd640 1 -- 172.21.15.119:0/1268526706 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7faf94025020 con 0x561c95719410 2024-04-23T18:29:35.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.760+0000 7fafa0ca7640 1 --2- 172.21.15.119:0/1268526706 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae78036e10 0x7fae780392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.760+0000 7fafa39a2800 1 Processor -- start 2024-04-23T18:29:35.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.760+0000 7fafa39a2800 1 -- start start 2024-04-23T18:29:35.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.760+0000 7fafa0ca7640 1 --2- 172.21.15.119:0/1268526706 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae78036e10 0x7fae780392d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x561c956ff150 tx=0x7faf98005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.761+0000 7fafa39a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 0x561c95726970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.761+0000 7fafa39a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c956f3a10 con 0x561c95726550 2024-04-23T18:29:35.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.761+0000 7fafa14a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 0x561c95726970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.761+0000 7fafa14a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 0x561c95726970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33974/0 (socket says 172.21.15.119:33974) 2024-04-23T18:29:35.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.761+0000 7fafa14a8640 1 -- 172.21.15.119:0/4056432427 learned_addr learned my addr 172.21.15.119:0/4056432427 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.761+0000 7fafa14a8640 1 -- 172.21.15.119:0/4056432427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c95726f40 con 0x561c95726550 2024-04-23T18:29:35.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.761+0000 7fafa14a8640 1 --2- 172.21.15.119:0/4056432427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 0x561c95726970 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faf94018fd0 tx=0x7faf9400d6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1964de68f4f8610d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.761+0000 7fae84ff9640 1 -- 172.21.15.119:0/4056432427 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf94044990 con 0x561c95726550 2024-04-23T18:29:35.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.761+0000 7fae84ff9640 1 -- 172.21.15.119:0/4056432427 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf9404b940 con 0x561c95726550 2024-04-23T18:29:35.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.761+0000 7fae84ff9640 1 -- 172.21.15.119:0/4056432427 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf9403f5d0 con 0x561c95726550 2024-04-23T18:29:35.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.762+0000 7fafa39a2800 1 -- 172.21.15.119:0/4056432427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 msgr2=0x561c95726970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.762+0000 7fafa39a2800 1 --2- 172.21.15.119:0/4056432427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 0x561c95726970 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faf94018fd0 tx=0x7faf9400d6a0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.762+0000 7fafa39a2800 1 -- 172.21.15.119:0/4056432427 shutdown_connections 2024-04-23T18:29:35.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.762+0000 7fafa39a2800 1 --2- 172.21.15.119:0/4056432427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 0x561c95726970 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.762+0000 7fafa39a2800 1 -- 172.21.15.119:0/4056432427 >> 172.21.15.119:0/4056432427 conn(0x561c95722870 msgr2=0x561c957208d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.762+0000 7fafa39a2800 1 -- 172.21.15.119:0/4056432427 shutdown_connections 2024-04-23T18:29:35.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.762+0000 7fafa39a2800 1 -- 172.21.15.119:0/4056432427 wait complete. 2024-04-23T18:29:35.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.762+0000 7fafa39a2800 1 Processor -- start 2024-04-23T18:29:35.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.762+0000 7fafa39a2800 1 -- start start 2024-04-23T18:29:35.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.762+0000 7fafa39a2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 0x561c956022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.762+0000 7fafa39a2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c95727660 con 0x561c95726550 2024-04-23T18:29:35.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.762+0000 7fafa14a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 0x561c956022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.763+0000 7fafa14a8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 0x561c956022b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33980/0 (socket says 172.21.15.119:33980) 2024-04-23T18:29:35.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.763+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 learned_addr learned my addr 172.21.15.119:0/4173192769 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.763+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c956027f0 con 0x561c95726550 2024-04-23T18:29:35.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.763+0000 7fafa14a8640 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 0x561c956022b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faf94050ee0 tx=0x7faf9403cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.763+0000 7fae76ffd640 1 -- 172.21.15.119:0/4173192769 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf9406d020 con 0x561c95726550 2024-04-23T18:29:35.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.763+0000 7fae76ffd640 1 -- 172.21.15.119:0/4173192769 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf94041000 con 0x561c95726550 2024-04-23T18:29:35.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.763+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c956027f0 con 0x561c95726550 2024-04-23T18:29:35.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.763+0000 7fae76ffd640 1 -- 172.21.15.119:0/4173192769 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf940412e0 con 0x561c95726550 2024-04-23T18:29:35.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.763+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c956027f0 con 0x561c95726550 2024-04-23T18:29:35.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.764+0000 7fae76ffd640 1 -- 172.21.15.119:0/4173192769 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7faf94070020 con 0x561c95726550 2024-04-23T18:29:35.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.764+0000 7fae76ffd640 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae6c036e10 0x7fae6c0392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.764+0000 7fae76ffd640 1 -- 172.21.15.119:0/4173192769 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7faf9405a070 con 0x561c95726550 2024-04-23T18:29:35.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.764+0000 7fafa0ca7640 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae6c036e10 0x7fae6c0392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.764+0000 7fafa0ca7640 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae6c036e10 0x7fae6c0392d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faf98052fd0 tx=0x7faf9804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.764+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.764+0000 7fafa39a2800 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561c9573b280 0x561c9573d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.765+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c9573de90 con 0x561c9573b280 2024-04-23T18:29:35.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.765+0000 7fafa1ca9640 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561c9573b280 0x561c9573d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.765+0000 7fafa1ca9640 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561c9573b280 0x561c9573d740 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.765+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c9573b280 2024-04-23T18:29:35.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.765+0000 7fafa39a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.765+0000 7fafa39a2800 20 realm 2024-04-23T18:29:35.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.765+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.765+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c9573e2a0 con 0x561c9573b280 2024-04-23T18:29:35.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.765+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c9573b280 2024-04-23T18:29:35.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.765+0000 7fafa39a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.765+0000 7fafa39a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:35.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.765+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.765+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c9573eb70 con 0x561c9573b280 2024-04-23T18:29:35.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c9573b280 2024-04-23T18:29:35.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa39a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573b280 2024-04-23T18:29:35.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c9573b280 2024-04-23T18:29:35.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa39a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:35.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa39a2800 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561c9573fc70 0x561c95742060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c95742670 con 0x561c9573fc70 2024-04-23T18:29:35.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa14a8640 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561c9573fc70 0x561c95742060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa14a8640 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561c9573fc70 0x561c95742060 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faf94024980 con 0x561c9573fc70 2024-04-23T18:29:35.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa39a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:35.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa39a2800 20 searching for the correct realm 2024-04-23T18:29:35.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa39a2800 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561c957445b0 0x561c95746a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.766+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c957470f0 con 0x561c957445b0 2024-04-23T18:29:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.767+0000 7fafa0ca7640 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561c957445b0 0x561c95746a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.767+0000 7fafa0ca7640 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561c957445b0 0x561c95746a70 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.767+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.767+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c957470f0 con 0x561c9573fc70 2024-04-23T18:29:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.767+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf94024980 con 0x561c9573fc70 2024-04-23T18:29:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.767+0000 7fafa14a8640 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7faf94072020 0x7faf94036470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.767+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c957470f0 con 0x7faf94072020 2024-04-23T18:29:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.768+0000 7fafa1ca9640 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7faf94072020 0x7faf94036470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.768+0000 7fafa1ca9640 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7faf94072020 0x7faf94036470 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.768+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c00a4a0 con 0x7faf94072020 2024-04-23T18:29:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.768+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573b280 2024-04-23T18:29:35.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.769+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c9573b280 2024-04-23T18:29:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.769+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573b280 2024-04-23T18:29:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.769+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c9573b280 2024-04-23T18:29:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.769+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x7faf94072020 2024-04-23T18:29:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.769+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c00a4a0 con 0x7faf94072020 2024-04-23T18:29:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.769+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x7faf94072020 2024-04-23T18:29:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.769+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faf9c00a4a0 con 0x7faf94072020 2024-04-23T18:29:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.769+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573fc70 2024-04-23T18:29:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.769+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf94024980 con 0x561c9573fc70 2024-04-23T18:29:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.770+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c957445b0 2024-04-23T18:29:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.770+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.770+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573b280 2024-04-23T18:29:35.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.770+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c9573b280 2024-04-23T18:29:35.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.770+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x7faf94072020 2024-04-23T18:29:35.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.770+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c00a4a0 con 0x7faf94072020 2024-04-23T18:29:35.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.770+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573b280 2024-04-23T18:29:35.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.770+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c9573b280 2024-04-23T18:29:35.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.770+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573fc70 2024-04-23T18:29:35.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.771+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faf94024980 con 0x561c9573fc70 2024-04-23T18:29:35.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.771+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c957445b0 2024-04-23T18:29:35.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.771+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.771+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c957445b0 2024-04-23T18:29:35.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.771+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.771+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x7faf94072020 2024-04-23T18:29:35.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.771+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c00a4a0 con 0x7faf94072020 2024-04-23T18:29:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.771+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c957445b0 2024-04-23T18:29:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.772+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.772+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c957445b0 2024-04-23T18:29:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.772+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.772+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573b280 2024-04-23T18:29:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.772+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c9573b280 2024-04-23T18:29:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.772+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573b280 2024-04-23T18:29:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.772+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c9573b280 2024-04-23T18:29:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.772+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x7faf94072020 2024-04-23T18:29:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.773+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c00a4a0 con 0x7faf94072020 2024-04-23T18:29:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.773+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c957445b0 2024-04-23T18:29:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.773+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.773+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573fc70 2024-04-23T18:29:35.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.773+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faf94024980 con 0x561c9573fc70 2024-04-23T18:29:35.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.773+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573b280 2024-04-23T18:29:35.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.773+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c00a4a0 con 0x561c9573b280 2024-04-23T18:29:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.774+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x7faf94072020 2024-04-23T18:29:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.774+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c00a4a0 con 0x7faf94072020 2024-04-23T18:29:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.774+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c957445b0 2024-04-23T18:29:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.774+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.774+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x7faf94072020 2024-04-23T18:29:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.774+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c00a4a0 con 0x7faf94072020 2024-04-23T18:29:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.774+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573fc70 2024-04-23T18:29:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.775+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf94024980 con 0x561c9573fc70 2024-04-23T18:29:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.775+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c957445b0 2024-04-23T18:29:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.775+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.775+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x7faf94072020 2024-04-23T18:29:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.775+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.775+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573b280 2024-04-23T18:29:35.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faf9c040040 con 0x561c9573b280 2024-04-23T18:29:35.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c9573ef10 con 0x561c9573fc70 2024-04-23T18:29:35.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf9408b040 con 0x561c9573fc70 2024-04-23T18:29:35.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:35.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:35.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:35.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:35.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:35.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:35.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c95742ec0 con 0x561c9573b280 2024-04-23T18:29:35.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x561c9573b280 2024-04-23T18:29:35.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c95742ec0 con 0x561c9573b280 2024-04-23T18:29:35.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf9c040040 con 0x561c9573b280 2024-04-23T18:29:35.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:35.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.776+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c95742ec0 con 0x7faf94072020 2024-04-23T18:29:35.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:35.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 20 zone default found 2024-04-23T18:29:35.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 4 Realm: () 2024-04-23T18:29:35.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:35.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:35.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:35.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 20 zonegroup default 2024-04-23T18:29:35.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c957437b0 con 0x7faf94072020 2024-04-23T18:29:35.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c957437b0 con 0x561c957445b0 2024-04-23T18:29:35.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c95748f50 con 0x561c957445b0 2024-04-23T18:29:35.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 20 started sync module instance, tier type = 2024-04-23T18:29:35.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:35.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.777+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c957483f0 con 0x561c9573fc70 2024-04-23T18:29:35.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.778+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9408b040 con 0x561c9573fc70 2024-04-23T18:29:35.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.778+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94680766515216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c95748050 con 0x561c9573fc70 2024-04-23T18:29:35.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.778+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c95749c50 con 0x561c9573b280 2024-04-23T18:29:35.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.779+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94680766515216] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9408b040 con 0x561c9573fc70 2024-04-23T18:29:35.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.779+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x561c9573b280 2024-04-23T18:29:35.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.779+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94680766518480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574a040 con 0x561c9573b280 2024-04-23T18:29:35.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.779+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574aa40 con 0x561c957445b0 2024-04-23T18:29:35.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.780+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94680766518480] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x561c9573b280 2024-04-23T18:29:35.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.780+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.780+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94680766519600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574ae30 con 0x561c957445b0 2024-04-23T18:29:35.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.781+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574b850 con 0x561c9573fc70 2024-04-23T18:29:35.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.781+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9408b040 con 0x561c9573fc70 2024-04-23T18:29:35.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.782+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94680766528576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574c510 con 0x561c9573fc70 2024-04-23T18:29:35.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.782+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94680766519600] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.782+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574cf10 con 0x561c9573b280 2024-04-23T18:29:35.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.782+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x561c9573b280 2024-04-23T18:29:35.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.783+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94680766522704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574d330 con 0x561c9573b280 2024-04-23T18:29:35.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.783+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574dd30 con 0x7faf94072020 2024-04-23T18:29:35.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.783+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94680766528576] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9408b040 con 0x561c9573fc70 2024-04-23T18:29:35.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.783+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.783+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94680766529632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574dcf0 con 0x7faf94072020 2024-04-23T18:29:35.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.784+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574e740 con 0x7faf94072020 2024-04-23T18:29:35.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.784+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94680766522704] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x561c9573b280 2024-04-23T18:29:35.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.784+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94680766529632] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.785+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.785+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94680766535744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574dc60 con 0x7faf94072020 2024-04-23T18:29:35.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.785+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574ebf0 con 0x7faf94072020 2024-04-23T18:29:35.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.786+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94680766535744] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.786+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.786+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94680766538384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574eb60 con 0x7faf94072020 2024-04-23T18:29:35.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.786+0000 7fafa39a2800 20 add_watcher() i=0 2024-04-23T18:29:35.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.786+0000 7fafa39a2800 20 add_watcher() i=1 2024-04-23T18:29:35.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.786+0000 7fafa39a2800 20 add_watcher() i=2 2024-04-23T18:29:35.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.786+0000 7fafa39a2800 20 add_watcher() i=3 2024-04-23T18:29:35.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.786+0000 7fafa39a2800 20 add_watcher() i=4 2024-04-23T18:29:35.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.786+0000 7fafa39a2800 20 add_watcher() i=5 2024-04-23T18:29:35.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.786+0000 7fafa39a2800 20 add_watcher() i=6 2024-04-23T18:29:35.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.787+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94680766538384] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.787+0000 7fafa39a2800 20 add_watcher() i=7 2024-04-23T18:29:35.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.787+0000 7fafa39a2800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:35.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.787+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c95751f90 con 0x561c9573b280 2024-04-23T18:29:35.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.787+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faf9c040040 con 0x561c9573b280 2024-04-23T18:29:35.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.787+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94680766539904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9574f450 con 0x561c9573b280 2024-04-23T18:29:35.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.788+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94680766539904] v32'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x561c9573b280 2024-04-23T18:29:35.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.788+0000 7fae577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:35.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.788+0000 7fafa39a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:35.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.788+0000 7fafa39a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:35.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.788+0000 7fafa39a2800 5 note: GC not initialized 2024-04-23T18:29:35.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.788+0000 7fae567e4640 20 reqs_thread_entry: start 2024-04-23T18:29:35.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.788+0000 7fafa39a2800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:35.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 20 Filter name: none 2024-04-23T18:29:35.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fadc7fff640 20 reqs_thread_entry: start 2024-04-23T18:29:35.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:35.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c957857a0 con 0x561c9573b280 2024-04-23T18:29:35.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7faf9c040040 con 0x561c9573b280 2024-04-23T18:29:35.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:35.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:35.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:35.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:35.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-23T18:29:35.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c95787880 con 0x561c9573fc70 2024-04-23T18:29:35.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7faf9408b040 con 0x561c9573fc70 2024-04-23T18:29:35.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:35.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-23T18:29:35.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:35.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 : miss 2024-04-23T18:29:35.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.789+0000 7fafa39a2800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.790+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c95789140 con 0x561c957445b0 2024-04-23T18:29:35.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.790+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.790+0000 7fafa39a2800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:35.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.790+0000 7fafa39a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:35.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.790+0000 7fafa39a2800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:35.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.790+0000 7fafa39a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:35.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.790+0000 7fafa39a2800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:35.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.790+0000 7fafa39a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 2024-04-23T18:29:35.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.790+0000 7fafa39a2800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-23T18:29:35.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.790+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c9578df00 con 0x7faf94072020 2024-04-23T18:29:35.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.791+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(65 fud.buckets [call] v32'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.791+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c95793d70 con 0x561c957445b0 2024-04-23T18:29:35.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.792+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(66 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.792+0000 7fafa39a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:35.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.792+0000 7fafa39a2800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:35.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.792+0000 7fafa39a2800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:35.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.792+0000 7fafa39a2800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1, ofs0, ns] 2024-04-23T18:29:35.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.792+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94680766781616 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c9578e7e0 con 0x7faf94072020 2024-04-23T18:29:35.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== watch-notify(notify (1) cookie 94680766535744 notify 137438953479 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7faf9c018cb0 con 0x7faf94072020 2024-04-23T18:29:35.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(67 notify.6 [notify cookie 94680766781616 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fae84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94680766535744 notifier 4518 bl.length()=752 2024-04-23T18:29:35.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fae84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:35.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fae84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:35.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fae84ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:35.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fae84ff9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fae64003ea0 con 0x7faf94072020 2024-04-23T18:29:35.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== watch-notify(notify_complete (2) cookie 94680766781616 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7faf9c046450 con 0x7faf94072020 2024-04-23T18:29:35.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fafa39a2800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): orig_sources= new_sources= 2024-04-23T18:29:35.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fafa39a2800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): potential sources added=[] removed=[] 2024-04-23T18:29:35.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fafa39a2800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): orig_dests= new_dests= 2024-04-23T18:29:35.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fafa39a2800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): potential dests added=[] removed=[] 2024-04-23T18:29:35.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.793+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c95792c10 con 0x561c9573fc70 2024-04-23T18:29:35.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.794+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(69 foo.buckets [call] v32'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7faf9408b040 con 0x561c9573fc70 2024-04-23T18:29:35.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.794+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c95793770 con 0x561c9573fc70 2024-04-23T18:29:35.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.795+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7faf9408b040 con 0x561c9573fc70 2024-04-23T18:29:35.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.795+0000 7fafa39a2800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-23T18:29:35.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.795+0000 7fafa39a2800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:35.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.795+0000 7fafa39a2800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-23T18:29:35.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.795+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94680766768064 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c95786c90 con 0x7faf94072020 2024-04-23T18:29:35.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.795+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== watch-notify(notify (1) cookie 94680766535744 notify 137438953480 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7faf9c0466f0 con 0x7faf94072020 2024-04-23T18:29:35.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.795+0000 7fae84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94680766535744 notifier 4518 bl.length()=314 2024-04-23T18:29:35.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.795+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(71 notify.6 [notify cookie 94680766768064 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.795+0000 7fae84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-23T18:29:35.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.796+0000 7fae84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:35.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.796+0000 7fae84ff9640 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fae64003ea0 con 0x7faf94072020 2024-04-23T18:29:35.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.796+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== watch-notify(notify_complete (2) cookie 94680766768064 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7faf9c046990 con 0x7faf94072020 2024-04-23T18:29:35.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.796+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.797+0000 7fae577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:35.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.797+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94680766539904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c957899d0 con 0x561c9573b280 2024-04-23T18:29:35.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.797+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94680766539904] v32'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x561c9573b280 2024-04-23T18:29:35.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.797+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94680766515216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c957899d0 con 0x561c9573fc70 2024-04-23T18:29:35.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.798+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94680766515216] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9408b040 con 0x561c9573fc70 2024-04-23T18:29:35.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.798+0000 7fafa39a2800 20 remove_watcher() i=0 2024-04-23T18:29:35.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.798+0000 7fafa39a2800 2 removed watcher, disabling cache 2024-04-23T18:29:35.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.798+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94680766518480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c957899d0 con 0x561c9573b280 2024-04-23T18:29:35.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.799+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94680766518480] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x561c9573b280 2024-04-23T18:29:35.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.799+0000 7fafa39a2800 20 remove_watcher() i=1 2024-04-23T18:29:35.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.799+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94680766519600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c957899d0 con 0x561c957445b0 2024-04-23T18:29:35.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.800+0000 7fafa0ca7640 1 -- 172.21.15.119:0/4173192769 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94680766519600] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf98081070 con 0x561c957445b0 2024-04-23T18:29:35.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.800+0000 7fafa39a2800 20 remove_watcher() i=2 2024-04-23T18:29:35.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.800+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94680766528576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c95749980 con 0x561c9573fc70 2024-04-23T18:29:35.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.801+0000 7fafa14a8640 1 -- 172.21.15.119:0/4173192769 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94680766528576] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9408b040 con 0x561c9573fc70 2024-04-23T18:29:35.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.801+0000 7fafa39a2800 20 remove_watcher() i=3 2024-04-23T18:29:35.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.801+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94680766522704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c95749980 con 0x561c9573b280 2024-04-23T18:29:35.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.803+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94680766522704] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x561c9573b280 2024-04-23T18:29:35.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.803+0000 7fafa39a2800 20 remove_watcher() i=4 2024-04-23T18:29:35.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.803+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94680766529632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c95749980 con 0x7faf94072020 2024-04-23T18:29:35.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.804+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94680766529632] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.804+0000 7fafa39a2800 20 remove_watcher() i=5 2024-04-23T18:29:35.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.804+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94680766535744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c957899d0 con 0x7faf94072020 2024-04-23T18:29:35.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.804+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94680766535744] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.804+0000 7fafa39a2800 20 remove_watcher() i=6 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.804+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94680766538384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c95749980 con 0x7faf94072020 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.805+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94680766538384] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf9c040040 con 0x7faf94072020 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.805+0000 7fafa39a2800 20 remove_watcher() i=7 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7faf94072020 msgr2=0x7faf94036470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7faf94072020 0x7faf94036470 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561c9573b280 msgr2=0x561c9573d740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561c9573b280 0x561c9573d740 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561c9573fc70 msgr2=0x561c95742060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561c9573fc70 0x561c95742060 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561c957445b0 msgr2=0x561c95746a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561c957445b0 0x561c95746a70 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae6c036e10 msgr2=0x7fae6c0392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae6c036e10 0x7fae6c0392d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faf98052fd0 tx=0x7faf9804f000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 msgr2=0x561c956022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa1ca9640 1 -- 172.21.15.119:0/4173192769 reap_dead start 2024-04-23T18:29:35.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 0x561c956022b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faf94050ee0 tx=0x7faf9403cf40 comp rx=0 tx=0).stop 2024-04-23T18:29:35.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 shutdown_connections 2024-04-23T18:29:35.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/4173192769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95726550 0x561c956022b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 >> 172.21.15.119:0/4173192769 conn(0x561c95722870 msgr2=0x561c9571fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 shutdown_connections 2024-04-23T18:29:35.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/4173192769 wait complete. 2024-04-23T18:29:35.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/1268526706 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae78036e10 msgr2=0x7fae780392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/1268526706 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae78036e10 0x7fae780392d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x561c956ff150 tx=0x7faf98005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:35.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/1268526706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95719410 msgr2=0x561c95719830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/1268526706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95719410 0x561c95719830 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7faf9400efd0 tx=0x7faf94040e10 comp rx=0 tx=0).stop 2024-04-23T18:29:35.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/1268526706 shutdown_connections 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/1268526706 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae78036e10 0x7fae780392d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/1268526706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95719410 0x561c95719830 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/1268526706 >> 172.21.15.119:0/1268526706 conn(0x561c9570d4b0 msgr2=0x561c9570d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/1268526706 shutdown_connections 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/1268526706 wait complete. 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561c95708380 msgr2=0x561c9570a820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561c95708380 0x561c9570a820 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561c95606520 msgr2=0x561c95701c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561c95606520 0x561c95701c60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561c95704490 msgr2=0x561c95706880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.806+0000 7fafa39a2800 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561c95704490 0x561c95706880 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.807+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae88036e60 msgr2=0x7fae88039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.807+0000 7fafa39a2800 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fae88036e60 0x7fae88039320 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faf98054000 tx=0x7faf9804e000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.807+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95602a10 msgr2=0x561c956fabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.807+0000 7fafa39a2800 1 --2- 172.21.15.119:0/2448101188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c95602a10 0x561c956fabf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7faf94001de0 tx=0x7faf94000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.807+0000 7fafa1ca9640 1 -- 172.21.15.119:0/2448101188 reap_dead start 2024-04-23T18:29:35.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.807+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 shutdown_connections 2024-04-23T18:29:35.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.807+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 >> 172.21.15.119:0/2448101188 conn(0x561c955fc440 msgr2=0x561c956ed410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.807+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 shutdown_connections 2024-04-23T18:29:35.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.807+0000 7fafa39a2800 1 -- 172.21.15.119:0/2448101188 wait complete. 2024-04-23T18:29:35.816 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-23T18:29:35.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-23T18:29:35.816 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-23T18:29:35.860 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:35.860 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:35.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.868+0000 7f47e181f800 1 Processor -- start 2024-04-23T18:29:35.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.868+0000 7f47e181f800 1 -- start start 2024-04-23T18:29:35.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.868+0000 7f47e181f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560dda821f70 0x560dda822390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.868+0000 7f47e181f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560dda6d2560 con 0x560dda8231d0 2024-04-23T18:29:35.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.868+0000 7f47e181f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x560dda6c3e20 con 0x560dda821f70 2024-04-23T18:29:35.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.868+0000 7f47df325640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560dda821f70 0x560dda822390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.868+0000 7f47deb24640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x560dda8231d0 0x560dda823650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40850/0 (socket says 172.21.15.119:40850) 2024-04-23T18:29:35.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.868+0000 7f47deb24640 1 -- 172.21.15.119:0/3886754612 learned_addr learned my addr 172.21.15.119:0/3886754612 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:35.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.868+0000 7f47df325640 1 -- 172.21.15.119:0/3886754612 >> v1:172.21.15.62:6789/0 conn(0x560dda8231d0 legacy=0x560dda823650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.862 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.868+0000 7f47df325640 1 -- 172.21.15.119:0/3886754612 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dda6d1e60 con 0x560dda821f70 2024-04-23T18:29:35.863 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.870+0000 7f47df325640 1 --2- 172.21.15.119:0/3886754612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda822390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f47d000a470 tx=0x7f47d001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df821a4e2f1eb8f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.870+0000 7f47de323640 1 -- 172.21.15.119:0/3886754612 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d0057070 con 0x560dda821f70 2024-04-23T18:29:35.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.870+0000 7f47de323640 1 -- 172.21.15.119:0/3886754612 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d0052570 con 0x560dda821f70 2024-04-23T18:29:35.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.870+0000 7f47de323640 1 -- 172.21.15.119:0/3886754612 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d0052870 con 0x560dda821f70 2024-04-23T18:29:35.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.871+0000 7f47e181f800 1 -- 172.21.15.119:0/3886754612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 msgr2=0x560dda822390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.871+0000 7f47e181f800 1 --2- 172.21.15.119:0/3886754612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda822390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f47d000a470 tx=0x7f47d001ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:35.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.871+0000 7f47e181f800 1 -- 172.21.15.119:0/3886754612 shutdown_connections 2024-04-23T18:29:35.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.871+0000 7f47e181f800 1 --2- 172.21.15.119:0/3886754612 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda822390 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.871+0000 7f47e181f800 1 -- 172.21.15.119:0/3886754612 >> 172.21.15.119:0/3886754612 conn(0x560dda81d530 msgr2=0x560dda81f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.871+0000 7f47e181f800 1 -- 172.21.15.119:0/3886754612 shutdown_connections 2024-04-23T18:29:35.864 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.871+0000 7f47e181f800 1 -- 172.21.15.119:0/3886754612 wait complete. 2024-04-23T18:29:35.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.882+0000 7f47e181f800 1 Processor -- start 2024-04-23T18:29:35.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.883+0000 7f47e181f800 1 -- start start 2024-04-23T18:29:35.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.883+0000 7f47e181f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda913650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.883+0000 7f47e181f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560dda76d5b0 con 0x560dda821f70 2024-04-23T18:29:35.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.883+0000 7f47df325640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda913650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.883+0000 7f47df325640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda913650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33990/0 (socket says 172.21.15.119:33990) 2024-04-23T18:29:35.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.883+0000 7f47df325640 1 -- 172.21.15.119:0/3921364183 learned_addr learned my addr 172.21.15.119:0/3921364183 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.883+0000 7f47df325640 1 -- 172.21.15.119:0/3921364183 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dda6e3860 con 0x560dda821f70 2024-04-23T18:29:35.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.883+0000 7f47df325640 1 --2- 172.21.15.119:0/3921364183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda913650 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f47d0055040 tx=0x7f47d004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f73e981e809a97 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.883+0000 7f46cd60a640 1 -- 172.21.15.119:0/3921364183 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d0057070 con 0x560dda821f70 2024-04-23T18:29:35.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.884+0000 7f46cd60a640 1 -- 172.21.15.119:0/3921364183 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d0063070 con 0x560dda821f70 2024-04-23T18:29:35.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.884+0000 7f46cd60a640 1 -- 172.21.15.119:0/3921364183 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d0052720 con 0x560dda821f70 2024-04-23T18:29:35.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.884+0000 7f47e181f800 1 -- 172.21.15.119:0/3921364183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 msgr2=0x560dda913650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.884+0000 7f47e181f800 1 --2- 172.21.15.119:0/3921364183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda913650 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f47d0055040 tx=0x7f47d004c000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.884+0000 7f47e181f800 1 -- 172.21.15.119:0/3921364183 shutdown_connections 2024-04-23T18:29:35.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.884+0000 7f47e181f800 1 --2- 172.21.15.119:0/3921364183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda913650 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.884+0000 7f47e181f800 1 -- 172.21.15.119:0/3921364183 >> 172.21.15.119:0/3921364183 conn(0x560dda81d530 msgr2=0x560dda90ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.884+0000 7f47e181f800 1 -- 172.21.15.119:0/3921364183 shutdown_connections 2024-04-23T18:29:35.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.884+0000 7f47e181f800 1 -- 172.21.15.119:0/3921364183 wait complete. 2024-04-23T18:29:35.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.885+0000 7f47e181f800 1 Processor -- start 2024-04-23T18:29:35.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.885+0000 7f47e181f800 1 -- start start 2024-04-23T18:29:35.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.885+0000 7f47e181f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda796f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.885+0000 7f47e181f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560dda82b640 con 0x560dda821f70 2024-04-23T18:29:35.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.885+0000 7f47df325640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda796f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.885+0000 7f47df325640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda796f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:33998/0 (socket says 172.21.15.119:33998) 2024-04-23T18:29:35.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.885+0000 7f47df325640 1 -- 172.21.15.119:0/1445175483 learned_addr learned my addr 172.21.15.119:0/1445175483 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.885+0000 7f47df325640 1 -- 172.21.15.119:0/1445175483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dda6e1eb0 con 0x560dda821f70 2024-04-23T18:29:35.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.885+0000 7f47df325640 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda796f40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f47d0055040 tx=0x7f47d0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.886+0000 7f46cbe07640 1 -- 172.21.15.119:0/1445175483 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d0052cd0 con 0x560dda821f70 2024-04-23T18:29:35.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.886+0000 7f46cbe07640 1 -- 172.21.15.119:0/1445175483 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d006c070 con 0x560dda821f70 2024-04-23T18:29:35.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.886+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560dda795630 con 0x560dda821f70 2024-04-23T18:29:35.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.886+0000 7f46cbe07640 1 -- 172.21.15.119:0/1445175483 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d005e480 con 0x560dda821f70 2024-04-23T18:29:35.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.886+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dda795bb0 con 0x560dda821f70 2024-04-23T18:29:35.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.886+0000 7f46cbe07640 1 -- 172.21.15.119:0/1445175483 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f47d005e620 con 0x560dda821f70 2024-04-23T18:29:35.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.887+0000 7f46cbe07640 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46c4036e60 0x7f46c4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.887+0000 7f46cbe07640 1 -- 172.21.15.119:0/1445175483 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f47d008eee0 con 0x560dda821f70 2024-04-23T18:29:35.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.887+0000 7f47deb24640 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46c4036e60 0x7f46c4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.887+0000 7f47e181f800 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560dda8231d0 0x560dda924240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.887+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda924780 con 0x560dda8231d0 2024-04-23T18:29:35.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.887+0000 7f47dfb26640 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560dda8231d0 0x560dda924240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.887+0000 7f47deb24640 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46c4036e60 0x7f46c4039320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f47d4000f60 tx=0x7f47d40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.887+0000 7f47dfb26640 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560dda8231d0 0x560dda924240 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.887+0000 7f47dfb26640 1 -- 172.21.15.119:0/1445175483 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda8231d0 2024-04-23T18:29:35.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.887+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda924b60 con 0x560dda8231d0 2024-04-23T18:29:35.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.888+0000 7f47dfb26640 1 -- 172.21.15.119:0/1445175483 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda8231d0 2024-04-23T18:29:35.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.888+0000 7f47e181f800 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560dda926970 0x560dda928d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.888+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda929400 con 0x560dda926970 2024-04-23T18:29:35.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.888+0000 7f47df325640 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560dda926970 0x560dda928d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.888+0000 7f47df325640 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560dda926970 0x560dda928d60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.888+0000 7f47df325640 1 -- 172.21.15.119:0/1445175483 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f47d00717f0 con 0x560dda926970 2024-04-23T18:29:35.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.888+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda925920 con 0x560dda8231d0 2024-04-23T18:29:35.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.889+0000 7f47dfb26640 1 -- 172.21.15.119:0/1445175483 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda8231d0 2024-04-23T18:29:35.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.889+0000 7f47e181f800 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560dda92a8b0 0x560dda92cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.889+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda92d460 con 0x560dda92a8b0 2024-04-23T18:29:35.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.889+0000 7f47deb24640 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560dda92a8b0 0x560dda92cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.889+0000 7f47deb24640 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560dda92a8b0 0x560dda92cd00 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.890+0000 7f47deb24640 1 -- 172.21.15.119:0/1445175483 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f47d4009050 con 0x560dda92a8b0 2024-04-23T18:29:35.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.890+0000 7f47e181f800 1 Processor -- start 2024-04-23T18:29:35.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.890+0000 7f47e181f800 1 -- start start 2024-04-23T18:29:35.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.890+0000 7f47e181f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda93b8c0 0x560dda93bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.890+0000 7f47e181f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560dda713df0 con 0x560dda93b8c0 2024-04-23T18:29:35.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.890+0000 7f47df325640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda93b8c0 0x560dda93bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.890+0000 7f47df325640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda93b8c0 0x560dda93bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34008/0 (socket says 172.21.15.119:34008) 2024-04-23T18:29:35.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.890+0000 7f47df325640 1 -- 172.21.15.119:0/1703529453 learned_addr learned my addr 172.21.15.119:0/1703529453 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.891+0000 7f47df325640 1 -- 172.21.15.119:0/1703529453 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dda93c220 con 0x560dda93b8c0 2024-04-23T18:29:35.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.891+0000 7f47df325640 1 --2- 172.21.15.119:0/1703529453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda93b8c0 0x560dda93bce0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f47d008d310 tx=0x7f47d0068f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.891+0000 7f46c9602640 1 -- 172.21.15.119:0/1703529453 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d0073c00 con 0x560dda93b8c0 2024-04-23T18:29:35.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.891+0000 7f46c9602640 1 -- 172.21.15.119:0/1703529453 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d0058040 con 0x560dda93b8c0 2024-04-23T18:29:35.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.891+0000 7f46c9602640 1 -- 172.21.15.119:0/1703529453 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d0066560 con 0x560dda93b8c0 2024-04-23T18:29:35.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.891+0000 7f47e181f800 1 -- 172.21.15.119:0/1703529453 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560dda93cc90 con 0x560dda93b8c0 2024-04-23T18:29:35.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.891+0000 7f47e181f800 1 -- 172.21.15.119:0/1703529453 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dda93d190 con 0x560dda93b8c0 2024-04-23T18:29:35.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.892+0000 7f46c9602640 1 -- 172.21.15.119:0/1703529453 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f47d0066700 con 0x560dda93b8c0 2024-04-23T18:29:35.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.892+0000 7f46c9602640 1 --2- 172.21.15.119:0/1703529453 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46b8036e60 0x7f46b8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.892+0000 7f46c9602640 1 -- 172.21.15.119:0/1703529453 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f47d008b050 con 0x560dda93b8c0 2024-04-23T18:29:35.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.892+0000 7f47deb24640 1 --2- 172.21.15.119:0/1703529453 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46b8036e60 0x7f46b8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.892+0000 7f47e181f800 1 Processor -- start 2024-04-23T18:29:35.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.892+0000 7f47e181f800 1 -- start start 2024-04-23T18:29:35.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.892+0000 7f47deb24640 1 --2- 172.21.15.119:0/1703529453 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46b8036e60 0x7f46b8039320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f47d400bf50 tx=0x7f47d400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.892+0000 7f47e181f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 0x560dda948e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.892+0000 7f47e181f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560dda913d10 con 0x560dda948a30 2024-04-23T18:29:35.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.893+0000 7f47df325640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 0x560dda948e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.893+0000 7f47df325640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 0x560dda948e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34024/0 (socket says 172.21.15.119:34024) 2024-04-23T18:29:35.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.893+0000 7f47df325640 1 -- 172.21.15.119:0/142447852 learned_addr learned my addr 172.21.15.119:0/142447852 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.893+0000 7f47df325640 1 -- 172.21.15.119:0/142447852 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dda949420 con 0x560dda948a30 2024-04-23T18:29:35.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.893+0000 7f47df325640 1 --2- 172.21.15.119:0/142447852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 0x560dda948e50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f47d0076fd0 tx=0x7f47d009cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba739c4c0e68de69 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.893+0000 7f46c2ffd640 1 -- 172.21.15.119:0/142447852 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d007a9b0 con 0x560dda948a30 2024-04-23T18:29:35.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.893+0000 7f46c2ffd640 1 -- 172.21.15.119:0/142447852 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d00ad070 con 0x560dda948a30 2024-04-23T18:29:35.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.893+0000 7f46c2ffd640 1 -- 172.21.15.119:0/142447852 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d00731f0 con 0x560dda948a30 2024-04-23T18:29:35.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47e181f800 1 -- 172.21.15.119:0/142447852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 msgr2=0x560dda948e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47e181f800 1 --2- 172.21.15.119:0/142447852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 0x560dda948e50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f47d0076fd0 tx=0x7f47d009cd80 comp rx=0 tx=0).stop 2024-04-23T18:29:35.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47e181f800 1 -- 172.21.15.119:0/142447852 shutdown_connections 2024-04-23T18:29:35.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47e181f800 1 --2- 172.21.15.119:0/142447852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 0x560dda948e50 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47e181f800 1 -- 172.21.15.119:0/142447852 >> 172.21.15.119:0/142447852 conn(0x560dda944d90 msgr2=0x560dda942df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47e181f800 1 -- 172.21.15.119:0/142447852 shutdown_connections 2024-04-23T18:29:35.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47e181f800 1 -- 172.21.15.119:0/142447852 wait complete. 2024-04-23T18:29:35.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47e181f800 1 Processor -- start 2024-04-23T18:29:35.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47e181f800 1 -- start start 2024-04-23T18:29:35.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47e181f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 0x560dda94fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47e181f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560dda949ad0 con 0x560dda948a30 2024-04-23T18:29:35.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47df325640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 0x560dda94fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47df325640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 0x560dda94fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34032/0 (socket says 172.21.15.119:34032) 2024-04-23T18:29:35.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.894+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 learned_addr learned my addr 172.21.15.119:0/2756469690 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:35.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.895+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dda950360 con 0x560dda948a30 2024-04-23T18:29:35.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.895+0000 7f47df325640 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 0x560dda94fe20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f47d007f010 tx=0x7f47d009aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.895+0000 7f46c17fa640 1 -- 172.21.15.119:0/2756469690 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d009c700 con 0x560dda948a30 2024-04-23T18:29:35.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.895+0000 7f46c17fa640 1 -- 172.21.15.119:0/2756469690 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d00a1070 con 0x560dda948a30 2024-04-23T18:29:35.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.895+0000 7f46c17fa640 1 -- 172.21.15.119:0/2756469690 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47d007a3f0 con 0x560dda948a30 2024-04-23T18:29:35.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.895+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560dda950360 con 0x560dda948a30 2024-04-23T18:29:35.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.895+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dda950360 con 0x560dda948a30 2024-04-23T18:29:35.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.896+0000 7f46c17fa640 1 -- 172.21.15.119:0/2756469690 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f47d007a590 con 0x560dda948a30 2024-04-23T18:29:35.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.896+0000 7f46c17fa640 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46a8036e60 0x7f46a8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.896+0000 7f46c17fa640 1 -- 172.21.15.119:0/2756469690 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f47d00bdc40 con 0x560dda948a30 2024-04-23T18:29:35.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.896+0000 7f47deb24640 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46a8036e60 0x7f46a8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.897+0000 7f47deb24640 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46a8036e60 0x7f46a8039320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f47d4001b60 tx=0x7f47d4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.897+0000 7f47e181f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.897+0000 7f47e181f800 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560dda95b4a0 0x560dda95d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.897+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda95e0b0 con 0x560dda95b4a0 2024-04-23T18:29:35.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.897+0000 7f47dfb26640 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560dda95b4a0 0x560dda95d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.897+0000 7f47dfb26640 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560dda95b4a0 0x560dda95d960 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.897+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda95b4a0 2024-04-23T18:29:35.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.897+0000 7f47e181f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.897+0000 7f47e181f800 20 realm 2024-04-23T18:29:35.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.897+0000 7f47e181f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.897+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda95e4c0 con 0x560dda95b4a0 2024-04-23T18:29:35.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.897+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda95b4a0 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47e181f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47e181f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47e181f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda95ed90 con 0x560dda95b4a0 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda95b4a0 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47e181f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47e181f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95b4a0 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda95b4a0 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47e181f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47e181f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47e181f800 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560dda95fe90 0x560dda962280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda962890 con 0x560dda95fe90 2024-04-23T18:29:35.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47df325640 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560dda95fe90 0x560dda962280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.898+0000 7f47df325640 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560dda95fe90 0x560dda962280 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.899+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f47d00c2020 con 0x560dda95fe90 2024-04-23T18:29:35.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.899+0000 7f47e181f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:35.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.899+0000 7f47e181f800 20 searching for the correct realm 2024-04-23T18:29:35.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.899+0000 7f47e181f800 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560dda964840 0x560dda966d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.899+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda9673d0 con 0x560dda964840 2024-04-23T18:29:35.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.899+0000 7f47deb24640 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560dda964840 0x560dda966d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.899+0000 7f47deb24640 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560dda964840 0x560dda966d00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.899+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.899+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda9673d0 con 0x560dda95fe90 2024-04-23T18:29:35.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.900+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d00c2020 con 0x560dda95fe90 2024-04-23T18:29:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.900+0000 7f47df325640 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f47d004f620 0x7f47d00c0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.900+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda9673d0 con 0x7f47d004f620 2024-04-23T18:29:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.900+0000 7f47dfb26640 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f47d004f620 0x7f47d00c0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.900+0000 7f47dfb26640 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f47d004f620 0x7f47d00c0920 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.901+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d800a4a0 con 0x7f47d004f620 2024-04-23T18:29:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.901+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95b4a0 2024-04-23T18:29:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.901+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda95b4a0 2024-04-23T18:29:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.901+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95b4a0 2024-04-23T18:29:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.901+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda95b4a0 2024-04-23T18:29:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.901+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x7f47d004f620 2024-04-23T18:29:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.901+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d800a4a0 con 0x7f47d004f620 2024-04-23T18:29:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.901+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x7f47d004f620 2024-04-23T18:29:35.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.902+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f47d800a4a0 con 0x7f47d004f620 2024-04-23T18:29:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.902+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95fe90 2024-04-23T18:29:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.902+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d00c2020 con 0x560dda95fe90 2024-04-23T18:29:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.902+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda964840 2024-04-23T18:29:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.902+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.902+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95b4a0 2024-04-23T18:29:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.902+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda95b4a0 2024-04-23T18:29:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.902+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x7f47d004f620 2024-04-23T18:29:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.903+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d800a4a0 con 0x7f47d004f620 2024-04-23T18:29:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.903+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95b4a0 2024-04-23T18:29:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.903+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda95b4a0 2024-04-23T18:29:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.903+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95fe90 2024-04-23T18:29:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.903+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f47d00c2020 con 0x560dda95fe90 2024-04-23T18:29:35.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.903+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda964840 2024-04-23T18:29:35.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.903+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.903+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda964840 2024-04-23T18:29:35.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.904+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.904+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x7f47d004f620 2024-04-23T18:29:35.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.904+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d800a4a0 con 0x7f47d004f620 2024-04-23T18:29:35.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.904+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda964840 2024-04-23T18:29:35.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.905+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.905+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda964840 2024-04-23T18:29:35.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.905+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.905+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95b4a0 2024-04-23T18:29:35.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.905+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda95b4a0 2024-04-23T18:29:35.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.905+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95b4a0 2024-04-23T18:29:35.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.905+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda95b4a0 2024-04-23T18:29:35.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.905+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x7f47d004f620 2024-04-23T18:29:35.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.905+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d800a4a0 con 0x7f47d004f620 2024-04-23T18:29:35.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.905+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda964840 2024-04-23T18:29:35.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.906+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.906+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95fe90 2024-04-23T18:29:35.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.906+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f47d00c2020 con 0x560dda95fe90 2024-04-23T18:29:35.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.906+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95b4a0 2024-04-23T18:29:35.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.906+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d800a4a0 con 0x560dda95b4a0 2024-04-23T18:29:35.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.906+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x7f47d004f620 2024-04-23T18:29:35.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.906+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d800a4a0 con 0x7f47d004f620 2024-04-23T18:29:35.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.906+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda964840 2024-04-23T18:29:35.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.907+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.907+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x7f47d004f620 2024-04-23T18:29:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.907+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d800a4a0 con 0x7f47d004f620 2024-04-23T18:29:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.907+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95fe90 2024-04-23T18:29:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.907+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d00c2020 con 0x560dda95fe90 2024-04-23T18:29:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.907+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda964840 2024-04-23T18:29:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.907+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.907+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x7f47d004f620 2024-04-23T18:29:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95b4a0 2024-04-23T18:29:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dda95f130 con 0x560dda95fe90 2024-04-23T18:29:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47e181f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:35.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47e181f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47e181f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47e181f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47e181f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47e181f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47e181f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda963150 con 0x560dda95b4a0 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47e181f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47e181f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.908+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda963150 con 0x560dda95b4a0 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda963150 con 0x7f47d004f620 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 20 zone default found 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 4 Realm: () 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 20 zonegroup default 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda9639f0 con 0x7f47d004f620 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.909+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda9639f0 con 0x560dda964840 2024-04-23T18:29:35.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.910+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.910+0000 7f47e181f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.910+0000 7f47e181f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.910+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda969230 con 0x560dda964840 2024-04-23T18:29:35.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.910+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.910+0000 7f47e181f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:35.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.910+0000 7f47e181f800 20 started sync module instance, tier type = 2024-04-23T18:29:35.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.910+0000 7f47e181f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:35.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.910+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda9686d0 con 0x560dda95fe90 2024-04-23T18:29:35.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.911+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.911+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94617501860384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda9695d0 con 0x560dda95fe90 2024-04-23T18:29:35.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.911+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda969ec0 con 0x560dda95b4a0 2024-04-23T18:29:35.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.912+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94617501860384] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.912+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.912+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94617501866352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96a2b0 con 0x560dda95b4a0 2024-04-23T18:29:35.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.912+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96ad30 con 0x560dda964840 2024-04-23T18:29:35.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.914+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94617501866352] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.914+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.914+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94617501870112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96b120 con 0x560dda964840 2024-04-23T18:29:35.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.914+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96bb70 con 0x560dda95fe90 2024-04-23T18:29:35.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.915+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94617501870112] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.915+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.915+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94617501862640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96c410 con 0x560dda95fe90 2024-04-23T18:29:35.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.915+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96cdd0 con 0x560dda95b4a0 2024-04-23T18:29:35.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.916+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94617501862640] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.916+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.916+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94617501876544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96cdd0 con 0x560dda95b4a0 2024-04-23T18:29:35.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.916+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96d790 con 0x7f47d004f620 2024-04-23T18:29:35.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.917+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.917+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94617501881056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96dbb0 con 0x7f47d004f620 2024-04-23T18:29:35.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.917+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96e690 con 0x7f47d004f620 2024-04-23T18:29:35.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.917+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94617501876544] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.918+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94617501881056] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.918+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.918+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94617501878560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96d700 con 0x7f47d004f620 2024-04-23T18:29:35.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.918+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96ed20 con 0x7f47d004f620 2024-04-23T18:29:35.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.919+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94617501878560] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.921+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.921+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94617501884832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96ed20 con 0x7f47d004f620 2024-04-23T18:29:35.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.921+0000 7f47e181f800 20 add_watcher() i=0 2024-04-23T18:29:35.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.921+0000 7f47e181f800 20 add_watcher() i=1 2024-04-23T18:29:35.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.921+0000 7f47e181f800 20 add_watcher() i=2 2024-04-23T18:29:35.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.921+0000 7f47e181f800 20 add_watcher() i=3 2024-04-23T18:29:35.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.921+0000 7f47e181f800 20 add_watcher() i=4 2024-04-23T18:29:35.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.921+0000 7f47e181f800 20 add_watcher() i=5 2024-04-23T18:29:35.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.921+0000 7f47e181f800 20 add_watcher() i=6 2024-04-23T18:29:35.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.922+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94617501884832] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.922+0000 7f47e181f800 20 add_watcher() i=7 2024-04-23T18:29:35.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.922+0000 7f47e181f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:35.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.922+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda971ec0 con 0x560dda95b4a0 2024-04-23T18:29:35.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.922+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.922+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94617501886576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96f140 con 0x560dda95b4a0 2024-04-23T18:29:35.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.923+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94617501886576] v32'122 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.923+0000 7f4695fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:35.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.923+0000 7f47e181f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:35.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.923+0000 7f47e181f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:35.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.924+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda971790 con 0x560dda95b4a0 2024-04-23T18:29:35.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.925+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.925+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97b180 con 0x7f47d004f620 2024-04-23T18:29:35.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.926+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.926+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97b6f0 con 0x560dda964840 2024-04-23T18:29:35.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.927+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.927+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97bf40 con 0x560dda95b4a0 2024-04-23T18:29:35.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.928+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'123 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.928+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97a880 con 0x560dda95fe90 2024-04-23T18:29:35.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.929+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.929+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97a880 con 0x560dda964840 2024-04-23T18:29:35.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.929+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.929+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97cb30 con 0x560dda95b4a0 2024-04-23T18:29:35.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.931+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.931+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97d0f0 con 0x7f47d004f620 2024-04-23T18:29:35.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.932+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.932+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97d0f0 con 0x560dda95fe90 2024-04-23T18:29:35.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.933+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.933+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97d5a0 con 0x560dda964840 2024-04-23T18:29:35.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.934+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.934+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97d5a0 con 0x560dda95fe90 2024-04-23T18:29:35.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.935+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.935+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97d5a0 con 0x7f47d004f620 2024-04-23T18:29:35.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.936+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.936+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97d550 con 0x560dda95fe90 2024-04-23T18:29:35.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.937+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.937+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97d550 con 0x7f47d004f620 2024-04-23T18:29:35.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.938+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.938+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda97d380 con 0x560dda95b4a0 2024-04-23T18:29:35.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.939+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'124 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.939+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x560dda964840 2024-04-23T18:29:35.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.940+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.940+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x560dda95fe90 2024-04-23T18:29:35.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.941+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.941+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x560dda964840 2024-04-23T18:29:35.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.942+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.942+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x560dda95b4a0 2024-04-23T18:29:35.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.943+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.943+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x560dda95b4a0 2024-04-23T18:29:35.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.944+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'125 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.944+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x560dda964840 2024-04-23T18:29:35.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.945+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.945+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x560dda95fe90 2024-04-23T18:29:35.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.946+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.946+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979780 con 0x560dda964840 2024-04-23T18:29:35.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.947+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.947+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x560dda964840 2024-04-23T18:29:35.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.948+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.948+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x560dda964840 2024-04-23T18:29:35.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.949+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.949+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x560dda964840 2024-04-23T18:29:35.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.950+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.950+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x7f47d004f620 2024-04-23T18:29:35.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.951+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.951+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x560dda964840 2024-04-23T18:29:35.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.952+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.952+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x7f47d004f620 2024-04-23T18:29:35.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.953+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.953+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x560dda964840 2024-04-23T18:29:35.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.954+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.954+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x7f47d004f620 2024-04-23T18:29:35.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.955+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.955+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda979740 con 0x560dda95fe90 2024-04-23T18:29:35.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.957+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.957+0000 7f4694fe1640 20 reqs_thread_entry: start 2024-04-23T18:29:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.957+0000 7f47e181f800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.957+0000 7f47e181f800 20 Filter name: none 2024-04-23T18:29:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.957+0000 7f460e7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.957+0000 7f47e181f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-23T18:29:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.957+0000 7f47e181f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.957+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda9a8670 con 0x7f47d004f620 2024-04-23T18:29:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.958+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.958+0000 7f47e181f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-23T18:29:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.958+0000 7f47e181f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-23T18:29:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.958+0000 7f47e181f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-23T18:29:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.958+0000 7f47e181f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.958+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda9ab0c0 con 0x7f47d004f620 2024-04-23T18:29:35.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.958+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.958+0000 7f47e181f800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-23T18:29:35.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.958+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda9a90a0 con 0x7f47d004f620 2024-04-23T18:29:35.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.959+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.959+0000 7f47e181f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-23T18:29:35.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.959+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94617502129072 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda9ab6b0 con 0x560dda964840 2024-04-23T18:29:35.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.959+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== watch-notify(notify (1) cookie 94617501870112 notify 137438953475 ret 0) ==== 212+0+0 (crc 0 0 0) 0x560dda979d70 con 0x560dda964840 2024-04-23T18:29:35.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.959+0000 7f46c2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94617501870112 notifier 4525 bl.length()=170 2024-04-23T18:29:35.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.959+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(97 notify.2 [notify cookie 94617502129072 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.959+0000 7f46c2ffd640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f46a4003d60 con 0x560dda964840 2024-04-23T18:29:35.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.960+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 28 ==== watch-notify(notify_complete (2) cookie 94617502129072 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560dda97ac20 con 0x560dda964840 2024-04-23T18:29:35.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.960+0000 7f47e181f800 10 removing email index: 2024-04-23T18:29:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.960+0000 7f47e181f800 10 removing user buckets index 2024-04-23T18:29:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.960+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.960+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda9a8ba0 con 0x7f47d004f620 2024-04-23T18:29:35.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.961+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(99 fud.buckets [delete] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.961+0000 7f47e181f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-23T18:29:35.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.961+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94617502134528 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda9aabc0 con 0x7f47d004f620 2024-04-23T18:29:35.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.961+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== watch-notify(notify (1) cookie 94617501878560 notify 137438953481 ret 0) ==== 202+0+0 (crc 0 0 0) 0x560dda97a1a0 con 0x7f47d004f620 2024-04-23T18:29:35.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.961+0000 7f46c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94617501878560 notifier 4525 bl.length()=160 2024-04-23T18:29:35.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.961+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== osd_op_reply(100 notify.6 [notify cookie 94617502134528 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.961+0000 7f46c27fc640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f46140032c0 con 0x7f47d004f620 2024-04-23T18:29:35.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.962+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 31 ==== watch-notify(notify_complete (2) cookie 94617502134528 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560dda9713e0 con 0x7f47d004f620 2024-04-23T18:29:35.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.962+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 32 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.962+0000 7f47e181f800 10 removing user index: fud 2024-04-23T18:29:35.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.962+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda9ad650 con 0x7f47d004f620 2024-04-23T18:29:35.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.963+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 33 ==== osd_op_reply(102 fud [call,call,delete] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.963+0000 7f47e181f800 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-23T18:29:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.963+0000 7f47e181f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-23T18:29:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.963+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94617502134528 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dda9aa060 con 0x7f47d004f620 2024-04-23T18:29:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.963+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 34 ==== watch-notify(notify (1) cookie 94617501881056 notify 137438953482 ret 0) ==== 194+0+0 (crc 0 0 0) 0x560dda9713e0 con 0x7f47d004f620 2024-04-23T18:29:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.963+0000 7f46c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94617501881056 notifier 4525 bl.length()=152 2024-04-23T18:29:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.963+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 35 ==== osd_op_reply(103 notify.5 [notify cookie 94617502134528 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.963+0000 7f46c27fc640 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4614003260 con 0x7f47d004f620 2024-04-23T18:29:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.963+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x7f47d004f620 2024-04-23T18:29:35.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.963+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 37 ==== watch-notify(notify_complete (2) cookie 94617502134528 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560dda971210 con 0x7f47d004f620 2024-04-23T18:29:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.964+0000 7f4695fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.964+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94617501886576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda9776c0 con 0x560dda95b4a0 2024-04-23T18:29:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.965+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94617501886576] v32'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.965+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94617501860384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96e870 con 0x560dda95fe90 2024-04-23T18:29:35.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.966+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94617501860384] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.966+0000 7f47e181f800 20 remove_watcher() i=0 2024-04-23T18:29:35.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.966+0000 7f47e181f800 2 removed watcher, disabling cache 2024-04-23T18:29:35.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.966+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94617501866352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96e870 con 0x560dda95b4a0 2024-04-23T18:29:35.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.967+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94617501866352] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8040040 con 0x560dda95b4a0 2024-04-23T18:29:35.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.967+0000 7f47e181f800 20 remove_watcher() i=1 2024-04-23T18:29:35.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.967+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94617501870112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda969970 con 0x560dda964840 2024-04-23T18:29:35.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.968+0000 7f47deb24640 1 -- 172.21.15.119:0/2756469690 <== osd.3 v2:172.21.15.119:6809/3910610681 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94617501870112] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d4009050 con 0x560dda964840 2024-04-23T18:29:35.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.968+0000 7f47e181f800 20 remove_watcher() i=2 2024-04-23T18:29:35.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.968+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94617501862640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96e870 con 0x560dda95fe90 2024-04-23T18:29:35.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.969+0000 7f47df325640 1 -- 172.21.15.119:0/2756469690 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94617501862640] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d00d7040 con 0x560dda95fe90 2024-04-23T18:29:35.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.969+0000 7f47e181f800 20 remove_watcher() i=3 2024-04-23T18:29:35.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.969+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94617501876544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96a820 con 0x560dda95b4a0 2024-04-23T18:29:35.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.970+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94617501876544] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8055040 con 0x560dda95b4a0 2024-04-23T18:29:35.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.970+0000 7f47e181f800 20 remove_watcher() i=4 2024-04-23T18:29:35.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.970+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94617501881056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda969970 con 0x7f47d004f620 2024-04-23T18:29:35.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.971+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94617501881056] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8055040 con 0x7f47d004f620 2024-04-23T18:29:35.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.971+0000 7f47e181f800 20 remove_watcher() i=5 2024-04-23T18:29:35.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.971+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94617501878560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96e870 con 0x7f47d004f620 2024-04-23T18:29:35.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.972+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94617501878560] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8055040 con 0x7f47d004f620 2024-04-23T18:29:35.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.972+0000 7f47e181f800 20 remove_watcher() i=6 2024-04-23T18:29:35.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.972+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94617501884832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dda96c140 con 0x7f47d004f620 2024-04-23T18:29:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 <== osd.0 v2:172.21.15.62:6800/2641588406 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94617501884832] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47d8055040 con 0x7f47d004f620 2024-04-23T18:29:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47e181f800 20 remove_watcher() i=7 2024-04-23T18:29:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f47d004f620 msgr2=0x7f47d00c0920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47e181f800 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f47d004f620 0x7f47d00c0920 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560dda95b4a0 msgr2=0x560dda95d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47e181f800 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560dda95b4a0 0x560dda95d960 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560dda95fe90 msgr2=0x560dda962280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47e181f800 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560dda95fe90 0x560dda962280 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560dda964840 msgr2=0x560dda966d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47e181f800 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560dda964840 0x560dda966d00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46a8036e60 msgr2=0x7f46a8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47e181f800 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46a8036e60 0x7f46a8039320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f47d4001b60 tx=0x7f47d4010000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47dfb26640 1 -- 172.21.15.119:0/2756469690 reap_dead start 2024-04-23T18:29:35.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 msgr2=0x560dda94fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.973+0000 7f47e181f800 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 0x560dda94fe20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f47d007f010 tx=0x7f47d009aed0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 shutdown_connections 2024-04-23T18:29:35.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 --2- 172.21.15.119:0/2756469690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda948a30 0x560dda94fe20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 >> 172.21.15.119:0/2756469690 conn(0x560dda944d90 msgr2=0x560dda9423f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 shutdown_connections 2024-04-23T18:29:35.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/2756469690 wait complete. 2024-04-23T18:29:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/1703529453 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46b8036e60 msgr2=0x7f46b8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 --2- 172.21.15.119:0/1703529453 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46b8036e60 0x7f46b8039320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f47d400bf50 tx=0x7f47d400f000 comp rx=0 tx=0).stop 2024-04-23T18:29:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/1703529453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda93b8c0 msgr2=0x560dda93bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 --2- 172.21.15.119:0/1703529453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda93b8c0 0x560dda93bce0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f47d008d310 tx=0x7f47d0068f10 comp rx=0 tx=0).stop 2024-04-23T18:29:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/1703529453 shutdown_connections 2024-04-23T18:29:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 --2- 172.21.15.119:0/1703529453 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46b8036e60 0x7f46b8039320 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 --2- 172.21.15.119:0/1703529453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda93b8c0 0x560dda93bce0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/1703529453 >> 172.21.15.119:0/1703529453 conn(0x560dda92f960 msgr2=0x560dda92fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/1703529453 shutdown_connections 2024-04-23T18:29:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/1703529453 wait complete. 2024-04-23T18:29:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560dda92a8b0 msgr2=0x560dda92cd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560dda92a8b0 0x560dda92cd00 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560dda8231d0 msgr2=0x560dda924240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560dda8231d0 0x560dda924240 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560dda926970 msgr2=0x560dda928d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560dda926970 0x560dda928d60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46c4036e60 msgr2=0x7f46c4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f46c4036e60 0x7f46c4039320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f47d4000f60 tx=0x7f47d40012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 msgr2=0x560dda796f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47e181f800 1 --2- 172.21.15.119:0/1445175483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560dda821f70 0x560dda796f40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f47d0055040 tx=0x7f47d0002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.974+0000 7f47dfb26640 1 -- 172.21.15.119:0/1445175483 reap_dead start 2024-04-23T18:29:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.975+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 shutdown_connections 2024-04-23T18:29:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.975+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 >> 172.21.15.119:0/1445175483 conn(0x560dda81d530 msgr2=0x560dda912040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.975+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 shutdown_connections 2024-04-23T18:29:35.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:35.975+0000 7f47e181f800 1 -- 172.21.15.119:0/1445175483 wait complete. 2024-04-23T18:29:35.975 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-23T18:29:35.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-23T18:29:35.975 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-23T18:29:36.067 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:36.067 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:36.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.075+0000 7f75dff46800 1 Processor -- start 2024-04-23T18:29:36.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.075+0000 7f75dff46800 1 -- start start 2024-04-23T18:29:36.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.076+0000 7f75dff46800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558c66a3f210 0x558c66a416d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.076+0000 7f75dff46800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558c668eb560 con 0x558c669adfd0 2024-04-23T18:29:36.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.076+0000 7f75dff46800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x558c668dce20 con 0x558c66a3f210 2024-04-23T18:29:36.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.076+0000 7f75dd244640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558c66a3f210 0x558c66a416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.076+0000 7f75dda45640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x558c669adfd0 0x558c66a3dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40860/0 (socket says 172.21.15.119:40860) 2024-04-23T18:29:36.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.076+0000 7f75dda45640 1 -- 172.21.15.119:0/3378864731 learned_addr learned my addr 172.21.15.119:0/3378864731 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:36.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.076+0000 7f75dd244640 1 -- 172.21.15.119:0/3378864731 >> v1:172.21.15.62:6789/0 conn(0x558c669adfd0 legacy=0x558c66a3dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.076+0000 7f75dd244640 1 -- 172.21.15.119:0/3378864731 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c668eae60 con 0x558c66a3f210 2024-04-23T18:29:36.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.078+0000 7f75dd244640 1 --2- 172.21.15.119:0/3378864731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66a3f210 0x558c66a416d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f75d400a470 tx=0x7f75d401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c6344e10127036 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.078+0000 7f75dca43640 1 -- 172.21.15.119:0/3378864731 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4057070 con 0x558c66a3f210 2024-04-23T18:29:36.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.078+0000 7f75dca43640 1 -- 172.21.15.119:0/3378864731 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d4052570 con 0x558c66a3f210 2024-04-23T18:29:36.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.078+0000 7f75dca43640 1 -- 172.21.15.119:0/3378864731 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4052870 con 0x558c66a3f210 2024-04-23T18:29:36.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.079+0000 7f75dff46800 1 -- 172.21.15.119:0/3378864731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66a3f210 msgr2=0x558c66a416d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.079+0000 7f75dff46800 1 --2- 172.21.15.119:0/3378864731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66a3f210 0x558c66a416d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f75d400a470 tx=0x7f75d401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:36.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.079+0000 7f75dff46800 1 -- 172.21.15.119:0/3378864731 shutdown_connections 2024-04-23T18:29:36.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.079+0000 7f75dff46800 1 --2- 172.21.15.119:0/3378864731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66a3f210 0x558c66a416d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.079+0000 7f75dff46800 1 -- 172.21.15.119:0/3378864731 >> 172.21.15.119:0/3378864731 conn(0x558c66a353c0 msgr2=0x558c66a377e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.079+0000 7f75dff46800 1 -- 172.21.15.119:0/3378864731 shutdown_connections 2024-04-23T18:29:36.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.079+0000 7f75dff46800 1 -- 172.21.15.119:0/3378864731 wait complete. 2024-04-23T18:29:36.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.090+0000 7f75dff46800 1 Processor -- start 2024-04-23T18:29:36.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.090+0000 7f75dff46800 1 -- start start 2024-04-23T18:29:36.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.090+0000 7f75dff46800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c669adfd0 0x558c66b2c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.090+0000 7f75dff46800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558c66986550 con 0x558c669adfd0 2024-04-23T18:29:36.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.091+0000 7f75dda45640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c669adfd0 0x558c66b2c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.091+0000 7f75dda45640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c669adfd0 0x558c66b2c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34050/0 (socket says 172.21.15.119:34050) 2024-04-23T18:29:36.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.091+0000 7f75dda45640 1 -- 172.21.15.119:0/3122169165 learned_addr learned my addr 172.21.15.119:0/3122169165 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.091+0000 7f75dda45640 1 -- 172.21.15.119:0/3122169165 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c668fc860 con 0x558c669adfd0 2024-04-23T18:29:36.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.091+0000 7f75dda45640 1 --2- 172.21.15.119:0/3122169165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c669adfd0 0x558c66b2c1e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f75d0001d50 tx=0x7f75d000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7846e8bd0e7aa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.091+0000 7f74cbe07640 1 -- 172.21.15.119:0/3122169165 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d0013030 con 0x558c669adfd0 2024-04-23T18:29:36.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.091+0000 7f74cbe07640 1 -- 172.21.15.119:0/3122169165 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d000e470 con 0x558c669adfd0 2024-04-23T18:29:36.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.091+0000 7f74cbe07640 1 -- 172.21.15.119:0/3122169165 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d000e810 con 0x558c669adfd0 2024-04-23T18:29:36.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.092+0000 7f75dff46800 1 -- 172.21.15.119:0/3122169165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c669adfd0 msgr2=0x558c66b2c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.092+0000 7f75dff46800 1 --2- 172.21.15.119:0/3122169165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c669adfd0 0x558c66b2c1e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f75d0001d50 tx=0x7f75d000b6c0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.092+0000 7f75dff46800 1 -- 172.21.15.119:0/3122169165 shutdown_connections 2024-04-23T18:29:36.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.092+0000 7f75dff46800 1 --2- 172.21.15.119:0/3122169165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c669adfd0 0x558c66b2c1e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.092+0000 7f75dff46800 1 -- 172.21.15.119:0/3122169165 >> 172.21.15.119:0/3122169165 conn(0x558c66a353c0 msgr2=0x558c66b27b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.092+0000 7f75dff46800 1 -- 172.21.15.119:0/3122169165 shutdown_connections 2024-04-23T18:29:36.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.092+0000 7f75dff46800 1 -- 172.21.15.119:0/3122169165 wait complete. 2024-04-23T18:29:36.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.093+0000 7f75dff46800 1 Processor -- start 2024-04-23T18:29:36.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.093+0000 7f75dff46800 1 -- start start 2024-04-23T18:29:36.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.093+0000 7f75dff46800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c669adfd0 0x558c66a3b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.093+0000 7f75dff46800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558c66a42080 con 0x558c669adfd0 2024-04-23T18:29:36.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.093+0000 7f75dda45640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c669adfd0 0x558c66a3b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.093+0000 7f75dda45640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c669adfd0 0x558c66a3b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34054/0 (socket says 172.21.15.119:34054) 2024-04-23T18:29:36.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.093+0000 7f75dda45640 1 -- 172.21.15.119:0/1193065290 learned_addr learned my addr 172.21.15.119:0/1193065290 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.093+0000 7f75dda45640 1 -- 172.21.15.119:0/1193065290 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c668faeb0 con 0x558c669adfd0 2024-04-23T18:29:36.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.093+0000 7f75dda45640 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c669adfd0 0x558c66a3b3f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x558c66b2cf70 tx=0x7f75d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.093+0000 7f74ca604640 1 -- 172.21.15.119:0/1193065290 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d0027070 con 0x558c669adfd0 2024-04-23T18:29:36.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.093+0000 7f74ca604640 1 -- 172.21.15.119:0/1193065290 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d0019900 con 0x558c669adfd0 2024-04-23T18:29:36.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.094+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c66a39ae0 con 0x558c669adfd0 2024-04-23T18:29:36.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.094+0000 7f74ca604640 1 -- 172.21.15.119:0/1193065290 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d0019c40 con 0x558c669adfd0 2024-04-23T18:29:36.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.094+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c66a3a000 con 0x558c669adfd0 2024-04-23T18:29:36.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.094+0000 7f74ca604640 1 -- 172.21.15.119:0/1193065290 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f75d002a070 con 0x558c669adfd0 2024-04-23T18:29:36.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.095+0000 7f74ca604640 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74c4036e60 0x7f74c4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.095+0000 7f74ca604640 1 -- 172.21.15.119:0/1193065290 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f75d001f070 con 0x558c669adfd0 2024-04-23T18:29:36.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.095+0000 7f75dd244640 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74c4036e60 0x7f74c4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.095+0000 7f75dff46800 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558c66a3f210 0x558c66b3cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.095+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b3d480 con 0x558c66a3f210 2024-04-23T18:29:36.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.095+0000 7f75de246640 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558c66a3f210 0x558c66b3cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.095+0000 7f75dd244640 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74c4036e60 0x7f74c4039320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f75d4054000 tx=0x7f75d404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.095+0000 7f75de246640 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558c66a3f210 0x558c66b3cf40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.095+0000 7f75de246640 1 -- 172.21.15.119:0/1193065290 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66a3f210 2024-04-23T18:29:36.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.095+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b3dcd0 con 0x558c66a3f210 2024-04-23T18:29:36.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.096+0000 7f75de246640 1 -- 172.21.15.119:0/1193065290 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66a3f210 2024-04-23T18:29:36.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.096+0000 7f75dff46800 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558c66b3f700 0x558c66b41b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.096+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b422c0 con 0x558c66b3f700 2024-04-23T18:29:36.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.096+0000 7f75dda45640 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558c66b3f700 0x558c66b41b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.096+0000 7f75dda45640 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558c66b3f700 0x558c66b41b30 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.096+0000 7f75dda45640 1 -- 172.21.15.119:0/1193065290 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f75d0029030 con 0x558c66b3f700 2024-04-23T18:29:36.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.096+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b3e550 con 0x558c66a3f210 2024-04-23T18:29:36.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.097+0000 7f75de246640 1 -- 172.21.15.119:0/1193065290 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66a3f210 2024-04-23T18:29:36.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.097+0000 7f75dff46800 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558c66b43770 0x558c66b45c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.097+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b46360 con 0x558c66b43770 2024-04-23T18:29:36.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.097+0000 7f75dd244640 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558c66b43770 0x558c66b45c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.097+0000 7f75dd244640 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558c66b43770 0x558c66b45c00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.098+0000 7f75dd244640 1 -- 172.21.15.119:0/1193065290 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f75d4052980 con 0x558c66b43770 2024-04-23T18:29:36.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.098+0000 7f75dff46800 1 Processor -- start 2024-04-23T18:29:36.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.098+0000 7f75dff46800 1 -- start start 2024-04-23T18:29:36.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.098+0000 7f75dff46800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b54790 0x558c66b54bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.098+0000 7f75dff46800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558c66a3b930 con 0x558c66b54790 2024-04-23T18:29:36.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.098+0000 7f75dda45640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b54790 0x558c66b54bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.098+0000 7f75dda45640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b54790 0x558c66b54bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34060/0 (socket says 172.21.15.119:34060) 2024-04-23T18:29:36.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.098+0000 7f75dda45640 1 -- 172.21.15.119:0/1156424700 learned_addr learned my addr 172.21.15.119:0/1156424700 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.098+0000 7f75dda45640 1 -- 172.21.15.119:0/1156424700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c66b550f0 con 0x558c66b54790 2024-04-23T18:29:36.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.099+0000 7f75dda45640 1 --2- 172.21.15.119:0/1156424700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b54790 0x558c66b54bb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f75d004b220 tx=0x7f75d0044c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.099+0000 7f74c37fe640 1 -- 172.21.15.119:0/1156424700 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d003f6c0 con 0x558c66b54790 2024-04-23T18:29:36.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.099+0000 7f74c37fe640 1 -- 172.21.15.119:0/1156424700 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d003a070 con 0x558c66b54790 2024-04-23T18:29:36.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.099+0000 7f75dff46800 1 -- 172.21.15.119:0/1156424700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c66b55b60 con 0x558c66b54790 2024-04-23T18:29:36.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.099+0000 7f74c37fe640 1 -- 172.21.15.119:0/1156424700 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d003f860 con 0x558c66b54790 2024-04-23T18:29:36.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.099+0000 7f75dff46800 1 -- 172.21.15.119:0/1156424700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c66b56060 con 0x558c66b54790 2024-04-23T18:29:36.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.100+0000 7f74c37fe640 1 -- 172.21.15.119:0/1156424700 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f75d0016070 con 0x558c66b54790 2024-04-23T18:29:36.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.100+0000 7f74c37fe640 1 --2- 172.21.15.119:0/1156424700 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74b8036eb0 0x7f74b8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.100+0000 7f74c37fe640 1 -- 172.21.15.119:0/1156424700 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f75d0014070 con 0x558c66b54790 2024-04-23T18:29:36.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.100+0000 7f75dd244640 1 --2- 172.21.15.119:0/1156424700 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74b8036eb0 0x7f74b8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.100+0000 7f75dff46800 1 Processor -- start 2024-04-23T18:29:36.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.100+0000 7f75dff46800 1 -- start start 2024-04-23T18:29:36.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.100+0000 7f75dd244640 1 --2- 172.21.15.119:0/1156424700 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74b8036eb0 0x7f74b8039370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x558c66a3a3f0 tx=0x7f75d4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.100+0000 7f75dff46800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 0x558c66b61ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.100+0000 7f75dff46800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558c6692cdf0 con 0x558c66b618c0 2024-04-23T18:29:36.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.100+0000 7f75dda45640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 0x558c66b61ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.100+0000 7f75dda45640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 0x558c66b61ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34072/0 (socket says 172.21.15.119:34072) 2024-04-23T18:29:36.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.100+0000 7f75dda45640 1 -- 172.21.15.119:0/1559365395 learned_addr learned my addr 172.21.15.119:0/1559365395 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.101+0000 7f75dda45640 1 -- 172.21.15.119:0/1559365395 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c66b622b0 con 0x558c66b618c0 2024-04-23T18:29:36.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.101+0000 7f75dda45640 1 --2- 172.21.15.119:0/1559365395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 0x558c66b61ce0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f75d004e030 tx=0x7f75d00262a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbca20c7b737a639 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.101+0000 7f74c17fa640 1 -- 172.21.15.119:0/1559365395 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d002cdf0 con 0x558c66b618c0 2024-04-23T18:29:36.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.101+0000 7f74c17fa640 1 -- 172.21.15.119:0/1559365395 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d004c370 con 0x558c66b618c0 2024-04-23T18:29:36.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.101+0000 7f74c17fa640 1 -- 172.21.15.119:0/1559365395 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d002b3b0 con 0x558c66b618c0 2024-04-23T18:29:36.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.101+0000 7f75dff46800 1 -- 172.21.15.119:0/1559365395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 msgr2=0x558c66b61ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.101+0000 7f75dff46800 1 --2- 172.21.15.119:0/1559365395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 0x558c66b61ce0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f75d004e030 tx=0x7f75d00262a0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.101+0000 7f75dff46800 1 -- 172.21.15.119:0/1559365395 shutdown_connections 2024-04-23T18:29:36.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.101+0000 7f75dff46800 1 --2- 172.21.15.119:0/1559365395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 0x558c66b61ce0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.101+0000 7f75dff46800 1 -- 172.21.15.119:0/1559365395 >> 172.21.15.119:0/1559365395 conn(0x558c66b5dc20 msgr2=0x558c66b5bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.102+0000 7f75dff46800 1 -- 172.21.15.119:0/1559365395 shutdown_connections 2024-04-23T18:29:36.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.102+0000 7f75dff46800 1 -- 172.21.15.119:0/1559365395 wait complete. 2024-04-23T18:29:36.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.102+0000 7f75dff46800 1 Processor -- start 2024-04-23T18:29:36.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.102+0000 7f75dff46800 1 -- start start 2024-04-23T18:29:36.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.102+0000 7f75dff46800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 0x558c66b68b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.102+0000 7f75dff46800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558c66b627e0 con 0x558c66b618c0 2024-04-23T18:29:36.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.102+0000 7f75dda45640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 0x558c66b68b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.102+0000 7f75dda45640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 0x558c66b68b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34082/0 (socket says 172.21.15.119:34082) 2024-04-23T18:29:36.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.102+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 learned_addr learned my addr 172.21.15.119:0/2046884646 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.102+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c66b69080 con 0x558c66b618c0 2024-04-23T18:29:36.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.103+0000 7f75dda45640 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 0x558c66b68b40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f75d0051040 tx=0x7f75d003df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.103+0000 7f74af7fe640 1 -- 172.21.15.119:0/2046884646 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d0070020 con 0x558c66b618c0 2024-04-23T18:29:36.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.103+0000 7f74af7fe640 1 -- 172.21.15.119:0/2046884646 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d002cdf0 con 0x558c66b618c0 2024-04-23T18:29:36.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.103+0000 7f74af7fe640 1 -- 172.21.15.119:0/2046884646 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d0066040 con 0x558c66b618c0 2024-04-23T18:29:36.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.103+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c66b69080 con 0x558c66b618c0 2024-04-23T18:29:36.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.103+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c66b69080 con 0x558c66b618c0 2024-04-23T18:29:36.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.104+0000 7f74af7fe640 1 -- 172.21.15.119:0/2046884646 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f75d005f020 con 0x558c66b618c0 2024-04-23T18:29:36.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.104+0000 7f74af7fe640 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74a8036eb0 0x7f74a8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.104+0000 7f74af7fe640 1 -- 172.21.15.119:0/2046884646 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f75d00378b0 con 0x558c66b618c0 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.104+0000 7f75dd244640 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74a8036eb0 0x7f74a8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.104+0000 7f75dd244640 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74a8036eb0 0x7f74a8039370 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f75d401ced0 tx=0x7f75d404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.104+0000 7f75dff46800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.104+0000 7f75dff46800 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558c66b742b0 0x558c66b76770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.104+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b76ec0 con 0x558c66b742b0 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75de246640 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558c66b742b0 0x558c66b76770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75de246640 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558c66b742b0 0x558c66b76770 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66b742b0 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75dff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75dff46800 20 realm 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75dff46800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b772d0 con 0x558c66b742b0 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66b742b0 2024-04-23T18:29:36.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75dff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75dff46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:36.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75dff46800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77ba0 con 0x558c66b742b0 2024-04-23T18:29:36.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66b742b0 2024-04-23T18:29:36.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75dff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.105+0000 7f75dff46800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.106+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b742b0 2024-04-23T18:29:36.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.106+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66b742b0 2024-04-23T18:29:36.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.106+0000 7f75dff46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:36.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.106+0000 7f75dff46800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.106+0000 7f75dff46800 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558c66b78ca0 0x558c66b7b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.106+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b7b6a0 con 0x558c66b78ca0 2024-04-23T18:29:36.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.106+0000 7f75dda45640 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558c66b78ca0 0x558c66b7b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.106+0000 7f75dda45640 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558c66b78ca0 0x558c66b7b090 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.106+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f75d0072020 con 0x558c66b78ca0 2024-04-23T18:29:36.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.106+0000 7f75dff46800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:36.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.106+0000 7f75dff46800 20 searching for the correct realm 2024-04-23T18:29:36.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.106+0000 7f75dff46800 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558c66b7d5e0 0x558c66b7faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.106+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b80120 con 0x558c66b7d5e0 2024-04-23T18:29:36.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.107+0000 7f75dd244640 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558c66b7d5e0 0x558c66b7faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.107+0000 7f75dd244640 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558c66b7d5e0 0x558c66b7faa0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.107+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.107+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b80120 con 0x558c66b78ca0 2024-04-23T18:29:36.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.107+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d0072020 con 0x558c66b78ca0 2024-04-23T18:29:36.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.107+0000 7f75dda45640 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f75d0075020 0x7f75d00118f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.107+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b80120 con 0x7f75d0075020 2024-04-23T18:29:36.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.108+0000 7f75de246640 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f75d0075020 0x7f75d00118f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.108+0000 7f75de246640 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f75d0075020 0x7f75d00118f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.108+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d800a4a0 con 0x7f75d0075020 2024-04-23T18:29:36.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.108+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b742b0 2024-04-23T18:29:36.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.109+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66b742b0 2024-04-23T18:29:36.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.109+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b742b0 2024-04-23T18:29:36.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.109+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66b742b0 2024-04-23T18:29:36.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.109+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x7f75d0075020 2024-04-23T18:29:36.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.109+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d800a4a0 con 0x7f75d0075020 2024-04-23T18:29:36.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.109+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x7f75d0075020 2024-04-23T18:29:36.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.109+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f75d800a4a0 con 0x7f75d0075020 2024-04-23T18:29:36.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.109+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b78ca0 2024-04-23T18:29:36.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.109+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d0072020 con 0x558c66b78ca0 2024-04-23T18:29:36.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.109+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b7d5e0 2024-04-23T18:29:36.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.110+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.110+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b742b0 2024-04-23T18:29:36.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.110+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66b742b0 2024-04-23T18:29:36.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.110+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x7f75d0075020 2024-04-23T18:29:36.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.110+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d800a4a0 con 0x7f75d0075020 2024-04-23T18:29:36.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.110+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b742b0 2024-04-23T18:29:36.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.110+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66b742b0 2024-04-23T18:29:36.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.110+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b78ca0 2024-04-23T18:29:36.116 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.111+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f75d0072020 con 0x558c66b78ca0 2024-04-23T18:29:36.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.111+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b7d5e0 2024-04-23T18:29:36.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.111+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.111+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b7d5e0 2024-04-23T18:29:36.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.111+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.111+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x7f75d0075020 2024-04-23T18:29:36.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.111+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d800a4a0 con 0x7f75d0075020 2024-04-23T18:29:36.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.111+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b7d5e0 2024-04-23T18:29:36.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.112+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.112+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b7d5e0 2024-04-23T18:29:36.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.112+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.112+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b742b0 2024-04-23T18:29:36.117 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.112+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66b742b0 2024-04-23T18:29:36.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.112+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b742b0 2024-04-23T18:29:36.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.112+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66b742b0 2024-04-23T18:29:36.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.112+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x7f75d0075020 2024-04-23T18:29:36.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.112+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d800a4a0 con 0x7f75d0075020 2024-04-23T18:29:36.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.112+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b7d5e0 2024-04-23T18:29:36.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.113+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.113+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b78ca0 2024-04-23T18:29:36.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.113+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f75d0072020 con 0x558c66b78ca0 2024-04-23T18:29:36.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.113+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b742b0 2024-04-23T18:29:36.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.113+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d800a4a0 con 0x558c66b742b0 2024-04-23T18:29:36.118 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.113+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x7f75d0075020 2024-04-23T18:29:36.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.114+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d800a4a0 con 0x7f75d0075020 2024-04-23T18:29:36.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.114+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b7d5e0 2024-04-23T18:29:36.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.114+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.114+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x7f75d0075020 2024-04-23T18:29:36.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.114+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d800a4a0 con 0x7f75d0075020 2024-04-23T18:29:36.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.114+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b78ca0 2024-04-23T18:29:36.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.115+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d0072020 con 0x558c66b78ca0 2024-04-23T18:29:36.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.115+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b7d5e0 2024-04-23T18:29:36.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.115+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.115+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x7f75d0075020 2024-04-23T18:29:36.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.115+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.115+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b742b0 2024-04-23T18:29:36.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.115+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f75d8040040 con 0x558c66b742b0 2024-04-23T18:29:36.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.115+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558c66b77f40 con 0x558c66b78ca0 2024-04-23T18:29:36.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75d008d040 con 0x558c66b78ca0 2024-04-23T18:29:36.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:36.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:36.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:36.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:36.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:36.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:36.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b7bef0 con 0x558c66b742b0 2024-04-23T18:29:36.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x558c66b742b0 2024-04-23T18:29:36.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b7bef0 con 0x558c66b742b0 2024-04-23T18:29:36.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75d8040040 con 0x558c66b742b0 2024-04-23T18:29:36.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:36.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b7bef0 con 0x7f75d0075020 2024-04-23T18:29:36.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.116+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:36.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 20 zone default found 2024-04-23T18:29:36.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 4 Realm: () 2024-04-23T18:29:36.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:36.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:36.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:36.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 20 zonegroup default 2024-04-23T18:29:36.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b7c7e0 con 0x7f75d0075020 2024-04-23T18:29:36.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b7c7e0 con 0x558c66b7d5e0 2024-04-23T18:29:36.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b81f80 con 0x558c66b7d5e0 2024-04-23T18:29:36.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 20 started sync module instance, tier type = 2024-04-23T18:29:36.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:36.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.117+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b81420 con 0x558c66b78ca0 2024-04-23T18:29:36.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.118+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d008d040 con 0x558c66b78ca0 2024-04-23T18:29:36.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.118+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94061507123216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b827d0 con 0x558c66b78ca0 2024-04-23T18:29:36.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.118+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b83020 con 0x558c66b742b0 2024-04-23T18:29:36.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.119+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94061507123216] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d008d040 con 0x558c66b78ca0 2024-04-23T18:29:36.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.120+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x558c66b742b0 2024-04-23T18:29:36.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.120+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94061507126048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b83020 con 0x558c66b742b0 2024-04-23T18:29:36.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.120+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b83a40 con 0x558c66b7d5e0 2024-04-23T18:29:36.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.121+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94061507126048] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x558c66b742b0 2024-04-23T18:29:36.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.121+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.121+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94061507128176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b82f90 con 0x558c66b7d5e0 2024-04-23T18:29:36.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.121+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b84900 con 0x558c66b78ca0 2024-04-23T18:29:36.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.122+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94061507128176] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.122+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d008d040 con 0x558c66b78ca0 2024-04-23T18:29:36.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.122+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94061507134544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b84d20 con 0x558c66b78ca0 2024-04-23T18:29:36.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.122+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b856e0 con 0x558c66b742b0 2024-04-23T18:29:36.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.123+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x558c66b742b0 2024-04-23T18:29:36.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.123+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94061507138096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b85b00 con 0x558c66b742b0 2024-04-23T18:29:36.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.123+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b86580 con 0x7f75d0075020 2024-04-23T18:29:36.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.123+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94061507134544] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d008d040 con 0x558c66b78ca0 2024-04-23T18:29:36.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.124+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.124+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94061507141744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b86540 con 0x7f75d0075020 2024-04-23T18:29:36.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.124+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b86fc0 con 0x7f75d0075020 2024-04-23T18:29:36.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.124+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94061507138096] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x558c66b742b0 2024-04-23T18:29:36.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.125+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(56 notify.6 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.125+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94061507139152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b86fc0 con 0x7f75d0075020 2024-04-23T18:29:36.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.125+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94061507141744] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.125+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b879c0 con 0x7f75d0075020 2024-04-23T18:29:36.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.126+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94061507139152] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.126+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.126+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94061507135600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b86b10 con 0x7f75d0075020 2024-04-23T18:29:36.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.126+0000 7f75dff46800 20 add_watcher() i=0 2024-04-23T18:29:36.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.126+0000 7f75dff46800 20 add_watcher() i=1 2024-04-23T18:29:36.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.126+0000 7f75dff46800 20 add_watcher() i=2 2024-04-23T18:29:36.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.126+0000 7f75dff46800 20 add_watcher() i=3 2024-04-23T18:29:36.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.126+0000 7f75dff46800 20 add_watcher() i=4 2024-04-23T18:29:36.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.126+0000 7f75dff46800 20 add_watcher() i=5 2024-04-23T18:29:36.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.126+0000 7f75dff46800 20 add_watcher() i=6 2024-04-23T18:29:36.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.127+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94061507135600] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.127+0000 7f75dff46800 20 add_watcher() i=7 2024-04-23T18:29:36.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.127+0000 7f75dff46800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:36.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.127+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66b86fa0 con 0x558c66b742b0 2024-04-23T18:29:36.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.127+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f75d8040040 con 0x558c66b742b0 2024-04-23T18:29:36.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.127+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94061507146960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b88290 con 0x558c66b742b0 2024-04-23T18:29:36.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.128+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94061507146960] v32'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x558c66b742b0 2024-04-23T18:29:36.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.128+0000 7f748f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:36.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.128+0000 7f75dff46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:36.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.128+0000 7f75dff46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:36.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.128+0000 7f75dff46800 5 note: GC not initialized 2024-04-23T18:29:36.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f748e7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:36.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f75dff46800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:36.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f75dff46800 20 Filter name: none 2024-04-23T18:29:36.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f73fffff640 20 reqs_thread_entry: start 2024-04-23T18:29:36.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f75dff46800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-23T18:29:36.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f75dff46800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66bbe280 con 0x7f75d0075020 2024-04-23T18:29:36.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f75dff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f75dff46800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f75dff46800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f75dff46800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f75dff46800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66bbc810 con 0x7f75d0075020 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.129+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.130+0000 7f75dff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.130+0000 7f75dff46800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.130+0000 7f75dff46800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.130+0000 7f75dff46800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.130+0000 7f75dff46800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.130+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66bc0fc0 con 0x7f75d0075020 2024-04-23T18:29:36.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.131+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v32'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.131+0000 7f75dff46800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-23T18:29:36.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.131+0000 7f75dff46800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-23T18:29:36.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.131+0000 7f75dff46800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-23T18:29:36.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.131+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94061507381632 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66bc1af0 con 0x558c66b78ca0 2024-04-23T18:29:36.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.131+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== watch-notify(notify (1) cookie 94061507134544 notify 137438953484 ret 0) ==== 652+0+0 (crc 0 0 0) 0x558c66b55b60 con 0x558c66b78ca0 2024-04-23T18:29:36.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.131+0000 7f74c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94061507134544 notifier 4532 bl.length()=610 2024-04-23T18:29:36.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.131+0000 7f74c17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-23T18:29:36.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.131+0000 7f74c17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-23T18:29:36.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.131+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(65 notify.3 [notify cookie 94061507381632 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f75d008d040 con 0x558c66b78ca0 2024-04-23T18:29:36.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.131+0000 7f74c17fa640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f74a0003ea0 con 0x558c66b78ca0 2024-04-23T18:29:36.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.131+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== watch-notify(notify_complete (2) cookie 94061507381632 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558c66b550f0 con 0x558c66b78ca0 2024-04-23T18:29:36.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.132+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d008d040 con 0x558c66b78ca0 2024-04-23T18:29:36.140 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.132+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66bc0950 con 0x7f75d0075020 2024-04-23T18:29:36.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.133+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v32'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.133+0000 7f75dff46800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-23T18:29:36.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.133+0000 7f75dff46800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-23T18:29:36.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.133+0000 7f75dff46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-23T18:29:36.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.133+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94061507381536 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558c66bc1f20 con 0x558c66b7d5e0 2024-04-23T18:29:36.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.133+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== watch-notify(notify (1) cookie 94061507128176 notify 137438953476 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7f75d408a040 con 0x558c66b7d5e0 2024-04-23T18:29:36.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.133+0000 7f74c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94061507128176 notifier 4532 bl.length()=192 2024-04-23T18:29:36.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.133+0000 7f74c17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-23T18:29:36.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.133+0000 7f74c17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-23T18:29:36.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.133+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(68 notify.2 [notify cookie 94061507381536 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.133+0000 7f74c17fa640 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f74a0003ea0 con 0x558c66b7d5e0 2024-04-23T18:29:36.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.133+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.141 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.133+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== watch-notify(notify_complete (2) cookie 94061507381536 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558c668eae60 con 0x558c66b7d5e0 2024-04-23T18:29:36.142 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-23T18:29:36.130956Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:36.130943Z","tags":[],"group_ids":[]} 2024-04-23T18:29:36.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.134+0000 7f748f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:36.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.134+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94061507146960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66bbcfe0 con 0x558c66b742b0 2024-04-23T18:29:36.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.135+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94061507146960] v32'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x558c66b742b0 2024-04-23T18:29:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.135+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94061507123216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b874d0 con 0x558c66b78ca0 2024-04-23T18:29:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.136+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94061507123216] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d008d040 con 0x558c66b78ca0 2024-04-23T18:29:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.136+0000 7f75dff46800 20 remove_watcher() i=0 2024-04-23T18:29:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.136+0000 7f75dff46800 2 removed watcher, disabling cache 2024-04-23T18:29:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.136+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94061507126048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b874d0 con 0x558c66b742b0 2024-04-23T18:29:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.137+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94061507126048] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x558c66b742b0 2024-04-23T18:29:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.137+0000 7f75dff46800 20 remove_watcher() i=1 2024-04-23T18:29:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.137+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94061507128176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b874d0 con 0x558c66b7d5e0 2024-04-23T18:29:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.138+0000 7f75dd244640 1 -- 172.21.15.119:0/2046884646 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94061507128176] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d4081070 con 0x558c66b7d5e0 2024-04-23T18:29:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.138+0000 7f75dff46800 20 remove_watcher() i=2 2024-04-23T18:29:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.138+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94061507134544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b82b70 con 0x558c66b78ca0 2024-04-23T18:29:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.139+0000 7f75dda45640 1 -- 172.21.15.119:0/2046884646 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94061507134544] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d008d040 con 0x558c66b78ca0 2024-04-23T18:29:36.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.139+0000 7f75dff46800 20 remove_watcher() i=3 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.139+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94061507138096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b874d0 con 0x558c66b742b0 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.140+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94061507138096] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x558c66b742b0 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.140+0000 7f75dff46800 20 remove_watcher() i=4 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.140+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94061507141744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b84450 con 0x7f75d0075020 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.141+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94061507141744] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.141+0000 7f75dff46800 20 remove_watcher() i=5 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.141+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94061507139152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b82b70 con 0x7f75d0075020 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.142+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94061507139152] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.142+0000 7f75dff46800 20 remove_watcher() i=6 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.142+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94061507135600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558c66b874d0 con 0x7f75d0075020 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94061507135600] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75d8040040 con 0x7f75d0075020 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 20 remove_watcher() i=7 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f75d0075020 msgr2=0x7f75d00118f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f75d0075020 0x7f75d00118f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558c66b742b0 msgr2=0x558c66b76770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558c66b742b0 0x558c66b76770 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558c66b78ca0 msgr2=0x558c66b7b090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558c66b78ca0 0x558c66b7b090 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558c66b7d5e0 msgr2=0x558c66b7faa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558c66b7d5e0 0x558c66b7faa0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74a8036eb0 msgr2=0x7f74a8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74a8036eb0 0x7f74a8039370 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f75d401ced0 tx=0x7f75d404f000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 msgr2=0x558c66b68b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75de246640 1 -- 172.21.15.119:0/2046884646 reap_dead start 2024-04-23T18:29:36.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 0x558c66b68b40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f75d0051040 tx=0x7f75d003df10 comp rx=0 tx=0).stop 2024-04-23T18:29:36.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 shutdown_connections 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 --2- 172.21.15.119:0/2046884646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b618c0 0x558c66b68b40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 >> 172.21.15.119:0/2046884646 conn(0x558c66b5dc20 msgr2=0x558c66b5b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 shutdown_connections 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.143+0000 7f75dff46800 1 -- 172.21.15.119:0/2046884646 wait complete. 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1156424700 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74b8036eb0 msgr2=0x7f74b8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 --2- 172.21.15.119:0/1156424700 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74b8036eb0 0x7f74b8039370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x558c66a3a3f0 tx=0x7f75d4005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1156424700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b54790 msgr2=0x558c66b54bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 --2- 172.21.15.119:0/1156424700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b54790 0x558c66b54bb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f75d004b220 tx=0x7f75d0044c20 comp rx=0 tx=0).stop 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1156424700 shutdown_connections 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 --2- 172.21.15.119:0/1156424700 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74b8036eb0 0x7f74b8039370 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 --2- 172.21.15.119:0/1156424700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c66b54790 0x558c66b54bb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1156424700 >> 172.21.15.119:0/1156424700 conn(0x558c66b48830 msgr2=0x558c66b48c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1156424700 shutdown_connections 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1156424700 wait complete. 2024-04-23T18:29:36.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558c66b43770 msgr2=0x558c66b45c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558c66b43770 0x558c66b45c00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558c66a3f210 msgr2=0x558c66b3cf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558c66a3f210 0x558c66b3cf40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558c66b3f700 msgr2=0x558c66b41b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558c66b3f700 0x558c66b41b30 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74c4036e60 msgr2=0x7f74c4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f74c4036e60 0x7f74c4039320 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f75d4054000 tx=0x7f75d404e000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c669adfd0 msgr2=0x558c66a3b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 --2- 172.21.15.119:0/1193065290 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558c669adfd0 0x558c66a3b3f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x558c66b2cf70 tx=0x7f75d0000bc0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75de246640 1 -- 172.21.15.119:0/1193065290 reap_dead start 2024-04-23T18:29:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 shutdown_connections 2024-04-23T18:29:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 >> 172.21.15.119:0/1193065290 conn(0x558c66a353c0 msgr2=0x558c66b26380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 shutdown_connections 2024-04-23T18:29:36.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.144+0000 7f75dff46800 1 -- 172.21.15.119:0/1193065290 wait complete. 2024-04-23T18:29:36.153 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-23T18:29:36.130956Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:36.130943Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:36.153 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-23T18:29:36.153 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-23T18:29:36.153 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-04-23T18:29:36.200 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:36.200 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:36.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.208+0000 7f4b4772c800 1 Processor -- start 2024-04-23T18:29:36.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.208+0000 7f4b4772c800 1 -- start start 2024-04-23T18:29:36.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.208+0000 7f4b4772c800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x562a3c12c8b0 0x562a3c12ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.208+0000 7f4b4772c800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562a3bfde560 con 0x562a3c12d210 2024-04-23T18:29:36.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.208+0000 7f4b4772c800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x562a3bfcfe20 con 0x562a3c12c8b0 2024-04-23T18:29:36.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.208+0000 7f4b43464640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x562a3c12c8b0 0x562a3c12ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.209+0000 7f4b42c63640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x562a3c12d210 0x562a3c12d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40862/0 (socket says 172.21.15.119:40862) 2024-04-23T18:29:36.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.209+0000 7f4b42c63640 1 -- 172.21.15.119:0/4034597960 learned_addr learned my addr 172.21.15.119:0/4034597960 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:36.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.209+0000 7f4b43464640 1 -- 172.21.15.119:0/4034597960 >> v1:172.21.15.62:6789/0 conn(0x562a3c12d210 legacy=0x562a3c12d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.209+0000 7f4b43464640 1 -- 172.21.15.119:0/4034597960 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3bfdde60 con 0x562a3c12c8b0 2024-04-23T18:29:36.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.211+0000 7f4b43464640 1 --2- 172.21.15.119:0/4034597960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12c8b0 0x562a3c12ccd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800a470 tx=0x7f4b3801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea0ce4d040f671a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.211+0000 7f4b42462640 1 -- 172.21.15.119:0/4034597960 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38057070 con 0x562a3c12c8b0 2024-04-23T18:29:36.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.211+0000 7f4b42462640 1 -- 172.21.15.119:0/4034597960 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3804adc0 con 0x562a3c12c8b0 2024-04-23T18:29:36.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.211+0000 7f4b42462640 1 -- 172.21.15.119:0/4034597960 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38052590 con 0x562a3c12c8b0 2024-04-23T18:29:36.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.211+0000 7f4b4772c800 1 -- 172.21.15.119:0/4034597960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12c8b0 msgr2=0x562a3c12ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.211+0000 7f4b4772c800 1 --2- 172.21.15.119:0/4034597960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12c8b0 0x562a3c12ccd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800a470 tx=0x7f4b3801ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:36.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.211+0000 7f4b4772c800 1 -- 172.21.15.119:0/4034597960 shutdown_connections 2024-04-23T18:29:36.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.211+0000 7f4b4772c800 1 --2- 172.21.15.119:0/4034597960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12c8b0 0x562a3c12ccd0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.211+0000 7f4b4772c800 1 -- 172.21.15.119:0/4034597960 >> 172.21.15.119:0/4034597960 conn(0x562a3c128430 msgr2=0x562a3c12a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.211+0000 7f4b4772c800 1 -- 172.21.15.119:0/4034597960 shutdown_connections 2024-04-23T18:29:36.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.211+0000 7f4b4772c800 1 -- 172.21.15.119:0/4034597960 wait complete. 2024-04-23T18:29:36.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.223+0000 7f4b4772c800 1 Processor -- start 2024-04-23T18:29:36.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.223+0000 7f4b4772c800 1 -- start start 2024-04-23T18:29:36.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.223+0000 7f4b4772c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12d210 0x562a3c2215e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.223+0000 7f4b4772c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562a3c0795d0 con 0x562a3c12d210 2024-04-23T18:29:36.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.223+0000 7f4b43464640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12d210 0x562a3c2215e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.223+0000 7f4b43464640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12d210 0x562a3c2215e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34096/0 (socket says 172.21.15.119:34096) 2024-04-23T18:29:36.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.223+0000 7f4b43464640 1 -- 172.21.15.119:0/2334110012 learned_addr learned my addr 172.21.15.119:0/2334110012 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.224+0000 7f4b43464640 1 -- 172.21.15.119:0/2334110012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3bfef860 con 0x562a3c12d210 2024-04-23T18:29:36.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.224+0000 7f4b43464640 1 --2- 172.21.15.119:0/2334110012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12d210 0x562a3c2215e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4b38055040 tx=0x7f4b3804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206f8c57750fbab7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.224+0000 7f4a3160a640 1 -- 172.21.15.119:0/2334110012 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38057040 con 0x562a3c12d210 2024-04-23T18:29:36.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.224+0000 7f4a3160a640 1 -- 172.21.15.119:0/2334110012 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3800a270 con 0x562a3c12d210 2024-04-23T18:29:36.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.224+0000 7f4a3160a640 1 -- 172.21.15.119:0/2334110012 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b3805d5a0 con 0x562a3c12d210 2024-04-23T18:29:36.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b4772c800 1 -- 172.21.15.119:0/2334110012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12d210 msgr2=0x562a3c2215e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2334110012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12d210 0x562a3c2215e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4b38055040 tx=0x7f4b3804c000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b4772c800 1 -- 172.21.15.119:0/2334110012 shutdown_connections 2024-04-23T18:29:36.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2334110012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12d210 0x562a3c2215e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b4772c800 1 -- 172.21.15.119:0/2334110012 >> 172.21.15.119:0/2334110012 conn(0x562a3c128430 msgr2=0x562a3c21ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b4772c800 1 -- 172.21.15.119:0/2334110012 shutdown_connections 2024-04-23T18:29:36.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b4772c800 1 -- 172.21.15.119:0/2334110012 wait complete. 2024-04-23T18:29:36.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b4772c800 1 Processor -- start 2024-04-23T18:29:36.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b4772c800 1 -- start start 2024-04-23T18:29:36.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b4772c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12d210 0x562a3c228de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b4772c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562a3c12e070 con 0x562a3c12d210 2024-04-23T18:29:36.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b43464640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12d210 0x562a3c228de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b43464640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12d210 0x562a3c228de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34112/0 (socket says 172.21.15.119:34112) 2024-04-23T18:29:36.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.225+0000 7f4b43464640 1 -- 172.21.15.119:0/166297620 learned_addr learned my addr 172.21.15.119:0/166297620 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.226+0000 7f4b43464640 1 -- 172.21.15.119:0/166297620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3bfedeb0 con 0x562a3c12d210 2024-04-23T18:29:36.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.226+0000 7f4b43464640 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12d210 0x562a3c228de0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4b38000c00 tx=0x7f4b38002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.226+0000 7f4a2fe07640 1 -- 172.21.15.119:0/166297620 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38057050 con 0x562a3c12d210 2024-04-23T18:29:36.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.226+0000 7f4a2fe07640 1 -- 172.21.15.119:0/166297620 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3805da20 con 0x562a3c12d210 2024-04-23T18:29:36.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.226+0000 7f4a2fe07640 1 -- 172.21.15.119:0/166297620 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b3805dd00 con 0x562a3c12d210 2024-04-23T18:29:36.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.226+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a3c229320 con 0x562a3c12d210 2024-04-23T18:29:36.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.226+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a3c229840 con 0x562a3c12d210 2024-04-23T18:29:36.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.227+0000 7f4a2fe07640 1 -- 172.21.15.119:0/166297620 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4b38065040 con 0x562a3c12d210 2024-04-23T18:29:36.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.227+0000 7f4a2fe07640 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a28036e60 0x7f4a28039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.227+0000 7f4a2fe07640 1 -- 172.21.15.119:0/166297620 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4b38063020 con 0x562a3c12d210 2024-04-23T18:29:36.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.227+0000 7f4b42c63640 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a28036e60 0x7f4a28039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.227+0000 7f4b4772c800 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562a3c22dcd0 0x562a3c230140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.227+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c230760 con 0x562a3c22dcd0 2024-04-23T18:29:36.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.227+0000 7f4b43c65640 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562a3c22dcd0 0x562a3c230140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.227+0000 7f4b42c63640 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a28036e60 0x7f4a28039320 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4b34000f60 tx=0x7f4b340012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.228+0000 7f4b43c65640 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562a3c22dcd0 0x562a3c230140 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.228+0000 7f4b43c65640 1 -- 172.21.15.119:0/166297620 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c22dcd0 2024-04-23T18:29:36.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.228+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c22d420 con 0x562a3c22dcd0 2024-04-23T18:29:36.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.228+0000 7f4b43c65640 1 -- 172.21.15.119:0/166297620 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c22dcd0 2024-04-23T18:29:36.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.228+0000 7f4b4772c800 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562a3c232ab0 0x562a3c234ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.228+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c235540 con 0x562a3c232ab0 2024-04-23T18:29:36.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.228+0000 7f4b43464640 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562a3c232ab0 0x562a3c234ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.229+0000 7f4b43464640 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562a3c232ab0 0x562a3c234ea0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.229+0000 7f4b43464640 1 -- 172.21.15.119:0/166297620 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4b3805a040 con 0x562a3c232ab0 2024-04-23T18:29:36.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.229+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c231a60 con 0x562a3c22dcd0 2024-04-23T18:29:36.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.229+0000 7f4b43c65640 1 -- 172.21.15.119:0/166297620 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c22dcd0 2024-04-23T18:29:36.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.229+0000 7f4b4772c800 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562a3c2369f0 0x562a3c238e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.229+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2395c0 con 0x562a3c2369f0 2024-04-23T18:29:36.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.229+0000 7f4b42c63640 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562a3c2369f0 0x562a3c238e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.230+0000 7f4b42c63640 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562a3c2369f0 0x562a3c238e60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.230+0000 7f4b42c63640 1 -- 172.21.15.119:0/166297620 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c2369f0 2024-04-23T18:29:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.230+0000 7f4b4772c800 1 Processor -- start 2024-04-23T18:29:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.231+0000 7f4b4772c800 1 -- start start 2024-04-23T18:29:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.231+0000 7f4b4772c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c2479f0 0x562a3c247e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.231+0000 7f4b4772c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562a3c01fdf0 con 0x562a3c2479f0 2024-04-23T18:29:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.231+0000 7f4b43464640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c2479f0 0x562a3c247e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.231+0000 7f4b43464640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c2479f0 0x562a3c247e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34116/0 (socket says 172.21.15.119:34116) 2024-04-23T18:29:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.231+0000 7f4b43464640 1 -- 172.21.15.119:0/2066610684 learned_addr learned my addr 172.21.15.119:0/2066610684 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.231+0000 7f4b43464640 1 -- 172.21.15.119:0/2066610684 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3c248350 con 0x562a3c2479f0 2024-04-23T18:29:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.231+0000 7f4b43464640 1 --2- 172.21.15.119:0/2066610684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c2479f0 0x562a3c247e10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4b3808ce40 tx=0x7f4b3807b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.231+0000 7f4a2d602640 1 -- 172.21.15.119:0/2066610684 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b380663a0 con 0x562a3c2479f0 2024-04-23T18:29:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.231+0000 7f4a2d602640 1 -- 172.21.15.119:0/2066610684 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b38066540 con 0x562a3c2479f0 2024-04-23T18:29:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.231+0000 7f4b4772c800 1 -- 172.21.15.119:0/2066610684 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a3c248dc0 con 0x562a3c2479f0 2024-04-23T18:29:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.231+0000 7f4a2d602640 1 -- 172.21.15.119:0/2066610684 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b3808ebb0 con 0x562a3c2479f0 2024-04-23T18:29:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.231+0000 7f4b4772c800 1 -- 172.21.15.119:0/2066610684 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a3c2492c0 con 0x562a3c2479f0 2024-04-23T18:29:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.232+0000 7f4a2d602640 1 -- 172.21.15.119:0/2066610684 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4b38077bc0 con 0x562a3c2479f0 2024-04-23T18:29:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.232+0000 7f4a2d602640 1 --2- 172.21.15.119:0/2066610684 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a1c036e60 0x7f4a1c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.232+0000 7f4a2d602640 1 -- 172.21.15.119:0/2066610684 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4b38083030 con 0x562a3c2479f0 2024-04-23T18:29:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.232+0000 7f4b42c63640 1 --2- 172.21.15.119:0/2066610684 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a1c036e60 0x7f4a1c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.233+0000 7f4b4772c800 1 Processor -- start 2024-04-23T18:29:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.233+0000 7f4b4772c800 1 -- start start 2024-04-23T18:29:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.233+0000 7f4b42c63640 1 --2- 172.21.15.119:0/2066610684 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a1c036e60 0x7f4a1c039320 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400bf50 tx=0x7f4b3400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.233+0000 7f4b4772c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c254ba0 0x562a3c254fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.233+0000 7f4b4772c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562a3c221ca0 con 0x562a3c254ba0 2024-04-23T18:29:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.233+0000 7f4b43464640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c254ba0 0x562a3c254fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.233+0000 7f4b43464640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c254ba0 0x562a3c254fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34118/0 (socket says 172.21.15.119:34118) 2024-04-23T18:29:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.233+0000 7f4b43464640 1 -- 172.21.15.119:0/3154013604 learned_addr learned my addr 172.21.15.119:0/3154013604 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.233+0000 7f4b43464640 1 -- 172.21.15.119:0/3154013604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3c255590 con 0x562a3c254ba0 2024-04-23T18:29:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.233+0000 7f4b43464640 1 --2- 172.21.15.119:0/3154013604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c254ba0 0x562a3c254fc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4b38067a10 tx=0x7f4b38067780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56738e821f8e882 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.233+0000 7f4a26ffd640 1 -- 172.21.15.119:0/3154013604 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38067dc0 con 0x562a3c254ba0 2024-04-23T18:29:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.234+0000 7f4a26ffd640 1 -- 172.21.15.119:0/3154013604 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b380a7070 con 0x562a3c254ba0 2024-04-23T18:29:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.234+0000 7f4a26ffd640 1 -- 172.21.15.119:0/3154013604 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38078a60 con 0x562a3c254ba0 2024-04-23T18:29:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.234+0000 7f4b4772c800 1 -- 172.21.15.119:0/3154013604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c254ba0 msgr2=0x562a3c254fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.234+0000 7f4b4772c800 1 --2- 172.21.15.119:0/3154013604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c254ba0 0x562a3c254fc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4b38067a10 tx=0x7f4b38067780 comp rx=0 tx=0).stop 2024-04-23T18:29:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.234+0000 7f4b4772c800 1 -- 172.21.15.119:0/3154013604 shutdown_connections 2024-04-23T18:29:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.234+0000 7f4b4772c800 1 --2- 172.21.15.119:0/3154013604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c254ba0 0x562a3c254fc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.234+0000 7f4b4772c800 1 -- 172.21.15.119:0/3154013604 >> 172.21.15.119:0/3154013604 conn(0x562a3c250f00 msgr2=0x562a3c24ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.234+0000 7f4b4772c800 1 -- 172.21.15.119:0/3154013604 shutdown_connections 2024-04-23T18:29:36.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.234+0000 7f4b4772c800 1 -- 172.21.15.119:0/3154013604 wait complete. 2024-04-23T18:29:36.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.234+0000 7f4b4772c800 1 Processor -- start 2024-04-23T18:29:36.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.234+0000 7f4b4772c800 1 -- start start 2024-04-23T18:29:36.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.235+0000 7f4b4772c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c254ba0 0x562a3c25bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.235+0000 7f4b4772c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x562a3c255c40 con 0x562a3c254ba0 2024-04-23T18:29:36.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.235+0000 7f4b43464640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c254ba0 0x562a3c25bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.235+0000 7f4b43464640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c254ba0 0x562a3c25bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34120/0 (socket says 172.21.15.119:34120) 2024-04-23T18:29:36.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.235+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 learned_addr learned my addr 172.21.15.119:0/2509765611 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.235+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3c25c500 con 0x562a3c254ba0 2024-04-23T18:29:36.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.235+0000 7f4b43464640 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c254ba0 0x562a3c25bfc0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4b38067b20 tx=0x7f4b3806cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.235+0000 7f4a257fa640 1 -- 172.21.15.119:0/2509765611 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38071800 con 0x562a3c254ba0 2024-04-23T18:29:36.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.235+0000 7f4a257fa640 1 -- 172.21.15.119:0/2509765611 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b38078a60 con 0x562a3c254ba0 2024-04-23T18:29:36.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.235+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a3c25c500 con 0x562a3c254ba0 2024-04-23T18:29:36.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.235+0000 7f4a257fa640 1 -- 172.21.15.119:0/2509765611 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38066a00 con 0x562a3c254ba0 2024-04-23T18:29:36.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.235+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a3c25c500 con 0x562a3c254ba0 2024-04-23T18:29:36.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.236+0000 7f4a257fa640 1 -- 172.21.15.119:0/2509765611 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4b380a0070 con 0x562a3c254ba0 2024-04-23T18:29:36.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.236+0000 7f4a257fa640 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a0c036e60 0x7f4a0c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.236+0000 7f4a257fa640 1 -- 172.21.15.119:0/2509765611 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4b380b1070 con 0x562a3c254ba0 2024-04-23T18:29:36.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.236+0000 7f4b42c63640 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a0c036e60 0x7f4a0c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.237+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.237+0000 7f4b42c63640 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a0c036e60 0x7f4a0c039320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4b34001b60 tx=0x7f4b34010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.237+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562a3c267610 0x562a3c269ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.237+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26a220 con 0x562a3c267610 2024-04-23T18:29:36.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.237+0000 7f4b43c65640 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562a3c267610 0x562a3c269ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.237+0000 7f4b43c65640 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562a3c267610 0x562a3c269ad0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.237+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c267610 2024-04-23T18:29:36.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.237+0000 7f4b4772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.237+0000 7f4b4772c800 20 realm 2024-04-23T18:29:36.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.237+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.237+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26a630 con 0x562a3c267610 2024-04-23T18:29:36.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c267610 2024-04-23T18:29:36.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b4772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b4772c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:36.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26af00 con 0x562a3c267610 2024-04-23T18:29:36.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c267610 2024-04-23T18:29:36.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b4772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c267610 2024-04-23T18:29:36.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c267610 2024-04-23T18:29:36.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b4772c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:36.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562a3c26c000 0x562a3c26e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26ea00 con 0x562a3c26c000 2024-04-23T18:29:36.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b43464640 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562a3c26c000 0x562a3c26e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.238+0000 7f4b43464640 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562a3c26c000 0x562a3c26e3f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.239+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4b38094020 con 0x562a3c26c000 2024-04-23T18:29:36.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.239+0000 7f4b4772c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:36.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.239+0000 7f4b4772c800 20 searching for the correct realm 2024-04-23T18:29:36.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.239+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562a3c270940 0x562a3c272e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.239+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c273480 con 0x562a3c270940 2024-04-23T18:29:36.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.239+0000 7f4b42c63640 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562a3c270940 0x562a3c272e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.239+0000 7f4b42c63640 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562a3c270940 0x562a3c272e00 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.239+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.239+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c273480 con 0x562a3c26c000 2024-04-23T18:29:36.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.240+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b38094020 con 0x562a3c26c000 2024-04-23T18:29:36.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.240+0000 7f4b43464640 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4b380b4030 0x7f4b3808e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.240+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c273480 con 0x7f4b380b4030 2024-04-23T18:29:36.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.240+0000 7f4b43c65640 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4b380b4030 0x7f4b3808e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.240+0000 7f4b43c65640 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4b380b4030 0x7f4b3808e400 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.241+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x7f4b380b4030 2024-04-23T18:29:36.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.241+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c267610 2024-04-23T18:29:36.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.241+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c267610 2024-04-23T18:29:36.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.241+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c267610 2024-04-23T18:29:36.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.241+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c267610 2024-04-23T18:29:36.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.241+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x7f4b380b4030 2024-04-23T18:29:36.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.241+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x7f4b380b4030 2024-04-23T18:29:36.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.241+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x7f4b380b4030 2024-04-23T18:29:36.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.242+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x7f4b380b4030 2024-04-23T18:29:36.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.242+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c26c000 2024-04-23T18:29:36.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.242+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b38094020 con 0x562a3c26c000 2024-04-23T18:29:36.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.242+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c270940 2024-04-23T18:29:36.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.242+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.242+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c267610 2024-04-23T18:29:36.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.242+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c267610 2024-04-23T18:29:36.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.242+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x7f4b380b4030 2024-04-23T18:29:36.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.243+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x7f4b380b4030 2024-04-23T18:29:36.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.243+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c267610 2024-04-23T18:29:36.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.243+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c267610 2024-04-23T18:29:36.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.243+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c26c000 2024-04-23T18:29:36.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.243+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4b38094020 con 0x562a3c26c000 2024-04-23T18:29:36.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.243+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c270940 2024-04-23T18:29:36.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.243+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.243+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c270940 2024-04-23T18:29:36.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.243+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.243+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x7f4b380b4030 2024-04-23T18:29:36.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.244+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x7f4b380b4030 2024-04-23T18:29:36.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.244+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c270940 2024-04-23T18:29:36.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.244+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.244+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c270940 2024-04-23T18:29:36.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.244+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.244+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c267610 2024-04-23T18:29:36.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.244+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c267610 2024-04-23T18:29:36.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.244+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c267610 2024-04-23T18:29:36.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.245+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c267610 2024-04-23T18:29:36.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.245+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x7f4b380b4030 2024-04-23T18:29:36.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.245+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x7f4b380b4030 2024-04-23T18:29:36.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.245+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c270940 2024-04-23T18:29:36.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.245+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.245+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c26c000 2024-04-23T18:29:36.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.245+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4b38094020 con 0x562a3c26c000 2024-04-23T18:29:36.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.245+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c267610 2024-04-23T18:29:36.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.246+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x562a3c267610 2024-04-23T18:29:36.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.246+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x7f4b380b4030 2024-04-23T18:29:36.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.246+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x7f4b380b4030 2024-04-23T18:29:36.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.246+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c270940 2024-04-23T18:29:36.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.246+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.246+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x7f4b380b4030 2024-04-23T18:29:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.247+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c00a4a0 con 0x7f4b380b4030 2024-04-23T18:29:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.247+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c26c000 2024-04-23T18:29:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.247+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b38094020 con 0x562a3c26c000 2024-04-23T18:29:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.247+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c270940 2024-04-23T18:29:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.247+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.247+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x7f4b380b4030 2024-04-23T18:29:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.247+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.247+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c267610 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26b2a0 con 0x562a3c26c000 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b380cb040 con 0x562a3c26c000 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b4772c800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b4772c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b4772c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b4772c800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b4772c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b4772c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26f250 con 0x562a3c267610 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b4772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26f250 con 0x562a3c267610 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b4772c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.248+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26f250 con 0x7f4b380b4030 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 20 zone default found 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 4 Realm: () 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 20 zonegroup default 2024-04-23T18:29:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26fb80 con 0x7f4b380b4030 2024-04-23T18:29:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c26fb80 con 0x562a3c270940 2024-04-23T18:29:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.249+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2752e0 con 0x562a3c270940 2024-04-23T18:29:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.250+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.250+0000 7f4b4772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.250+0000 7f4b4772c800 20 started sync module instance, tier type = 2024-04-23T18:29:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.250+0000 7f4b4772c800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.250+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c274780 con 0x562a3c26c000 2024-04-23T18:29:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.251+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b380cb040 con 0x562a3c26c000 2024-04-23T18:29:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.251+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94739397823392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2743e0 con 0x562a3c26c000 2024-04-23T18:29:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.251+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c276040 con 0x562a3c267610 2024-04-23T18:29:36.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.252+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94739397823392] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b380cb040 con 0x562a3c26c000 2024-04-23T18:29:36.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.252+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.252+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94739397826176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c276430 con 0x562a3c267610 2024-04-23T18:29:36.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.252+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c276e90 con 0x562a3c270940 2024-04-23T18:29:36.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.253+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.253+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94739397830976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c277730 con 0x562a3c270940 2024-04-23T18:29:36.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.253+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c278230 con 0x562a3c26c000 2024-04-23T18:29:36.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.253+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94739397826176] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.254+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94739397830976] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.254+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b380cb040 con 0x562a3c26c000 2024-04-23T18:29:36.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.254+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94739397836064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c278620 con 0x562a3c26c000 2024-04-23T18:29:36.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.254+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c278e70 con 0x562a3c267610 2024-04-23T18:29:36.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.255+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94739397836064] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b380cb040 con 0x562a3c26c000 2024-04-23T18:29:36.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.255+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.255+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94739397838368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c279260 con 0x562a3c267610 2024-04-23T18:29:36.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.255+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c279ab0 con 0x7f4b380b4030 2024-04-23T18:29:36.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.256+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94739397838368] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.256+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.256+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94739397841200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c279a00 con 0x7f4b380b4030 2024-04-23T18:29:36.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.256+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c27a290 con 0x7f4b380b4030 2024-04-23T18:29:36.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.257+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94739397841200] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.257+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.257+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94739397842256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c27a470 con 0x7f4b380b4030 2024-04-23T18:29:36.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.257+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c27acc0 con 0x7f4b380b4030 2024-04-23T18:29:36.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.258+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94739397842256] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.258+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.258+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94739397846128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c27ad40 con 0x7f4b380b4030 2024-04-23T18:29:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.258+0000 7f4b4772c800 20 add_watcher() i=0 2024-04-23T18:29:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.258+0000 7f4b4772c800 20 add_watcher() i=1 2024-04-23T18:29:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.258+0000 7f4b4772c800 20 add_watcher() i=2 2024-04-23T18:29:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.258+0000 7f4b4772c800 20 add_watcher() i=3 2024-04-23T18:29:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.258+0000 7f4b4772c800 20 add_watcher() i=4 2024-04-23T18:29:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.258+0000 7f4b4772c800 20 add_watcher() i=5 2024-04-23T18:29:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.258+0000 7f4b4772c800 20 add_watcher() i=6 2024-04-23T18:29:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.259+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94739397846128] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.259+0000 7f4b4772c800 20 add_watcher() i=7 2024-04-23T18:29:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.259+0000 7f4b4772c800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.259+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c27e020 con 0x562a3c267610 2024-04-23T18:29:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.260+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.260+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94739397847552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c27b2d0 con 0x562a3c267610 2024-04-23T18:29:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.261+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94739397847552] v32'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.261+0000 7f49f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.261+0000 7f4b4772c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.261+0000 7f4b4772c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.261+0000 7f4b4772c800 5 note: GC not initialized 2024-04-23T18:29:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.261+0000 7f49f8fe1640 20 reqs_thread_entry: start 2024-04-23T18:29:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.261+0000 7f4b4772c800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.261+0000 7f4b4772c800 20 Filter name: none 2024-04-23T18:29:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.261+0000 7f49727fc640 20 reqs_thread_entry: start 2024-04-23T18:29:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.261+0000 7f4b4772c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-23T18:29:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.261+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.261+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2b1900 con 0x7f4b380b4030 2024-04-23T18:29:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.262+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.262+0000 7f4b4772c800 20 rados_obj.operate() r=0 bl.length=419 2024-04-23T18:29:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.262+0000 7f4b4772c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-23T18:29:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.262+0000 7f4b4772c800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-23T18:29:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.262+0000 7f4b4772c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.262+0000 7f4b4772c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-23T18:29:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.262+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.262+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2b1350 con 0x562a3c26c000 2024-04-23T18:29:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4b380cb040 con 0x562a3c26c000 2024-04-23T18:29:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-23T18:29:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 : miss 2024-04-23T18:29:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2b50b0 con 0x562a3c270940 2024-04-23T18:29:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 2024-04-23T18:29:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-04-23T18:29:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.263+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2b9cd0 con 0x562a3c26c000 2024-04-23T18:29:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.265+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(65 foo.buckets [call] v32'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4b380cb040 con 0x562a3c26c000 2024-04-23T18:29:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.265+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 8.18 8:1e45715a:root::.bucket.meta.testx%3amyfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2bd5e0 con 0x562a3c267610 2024-04-23T18:29:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.266+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [create,call,writefull 0~412,setxattr (203)] v32'12 uv12 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.266+0000 7f4b4772c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x7 2024-04-23T18:29:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.266+0000 7f4b4772c800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.266+0000 7f4b4772c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-23T18:29:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.266+0000 7f4b4772c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1, ofs0, ns] 2024-04-23T18:29:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.266+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94739398112272 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2bd030 con 0x7f4b380b4030 2024-04-23T18:29:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.266+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== watch-notify(notify (1) cookie 94739397841200 notify 137438953483 ret 0) ==== 889+0+0 (crc 0 0 0) 0x562a3c2bd980 con 0x7f4b380b4030 2024-04-23T18:29:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.266+0000 7f4a26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 94739397841200 notifier 4539 bl.length()=847 2024-04-23T18:29:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.266+0000 7f4a26ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x7 2024-04-23T18:29:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.266+0000 7f4a26ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.266+0000 7f4a26ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-04-23T18:29:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.266+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(67 notify.5 [notify cookie 94739398112272 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.266+0000 7f4a26ffd640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4a08003ea0 con 0x7f4b380b4030 2024-04-23T18:29:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.267+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.267+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== watch-notify(notify_complete (2) cookie 94739398112272 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a3c2b9b20 con 0x7f4b380b4030 2024-04-23T18:29:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.267+0000 7f4b4772c800 20 handle_bi_update(): bucket=testx:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): orig_sources= new_sources= 2024-04-23T18:29:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.267+0000 7f4b4772c800 20 handle_bi_update(): bucket=testx:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): potential sources added=[] removed=[] 2024-04-23T18:29:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.267+0000 7f4b4772c800 20 handle_bi_update(): bucket=testx:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): orig_dests= new_dests= 2024-04-23T18:29:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.267+0000 7f4b4772c800 20 handle_bi_update(): bucket=testx:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): potential dests added=[] removed=[] 2024-04-23T18:29:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.267+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2bd130 con 0x562a3c267610 2024-04-23T18:29:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.268+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v32'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.268+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2bd130 con 0x562a3c267610 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.269+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.269+0000 7f4b4772c800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.269+0000 7f4b4772c800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.269+0000 7f4b4772c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.269+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94739398118528 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2bd0a0 con 0x562a3c267610 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.269+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== watch-notify(notify (1) cookie 94739397838368 notify 137438953489 ret 0) ==== 390+0+0 (crc 0 0 0) 0x562a3c2bd4d0 con 0x562a3c267610 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.269+0000 7f4a267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94739397838368 notifier 4539 bl.length()=348 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.269+0000 7f4a267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.269+0000 7f4a267fc640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.269+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(71 notify.4 [notify cookie 94739398118528 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.269+0000 7f4a267fc640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4978003400 con 0x562a3c267610 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.270+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify_complete (2) cookie 94739398118528 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a3c2bc420 con 0x562a3c267610 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.270+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.270+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2bd130 con 0x562a3c26c000 2024-04-23T18:29:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.271+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(73 myfoo [call,delete] v32'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f4b380cb040 con 0x562a3c26c000 2024-04-23T18:29:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.271+0000 7f4b4772c800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-23T18:29:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.271+0000 7f4b4772c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-23T18:29:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.271+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94739398118528 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2bd0a0 con 0x7f4b380b4030 2024-04-23T18:29:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.271+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== watch-notify(notify (1) cookie 94739397842256 notify 137438953484 ret 0) ==== 191+0+0 (crc 0 0 0) 0x562a3c2bc420 con 0x7f4b380b4030 2024-04-23T18:29:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.271+0000 7f4a26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94739397842256 notifier 4539 bl.length()=149 2024-04-23T18:29:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.271+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(74 notify.6 [notify cookie 94739398118528 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.271+0000 7f4a26ffd640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4a08003ea0 con 0x7f4b380b4030 2024-04-23T18:29:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.271+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.271+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== watch-notify(notify_complete (2) cookie 94739398118528 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a3c2b9b20 con 0x7f4b380b4030 2024-04-23T18:29:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.271+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:76 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2bd130 con 0x562a3c270940 2024-04-23T18:29:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.272+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(76 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.272+0000 7f4b4772c800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 from cache 2024-04-23T18:29:36.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.272+0000 7f4b4772c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1, ofs0, ns] 2024-04-23T18:29:36.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.272+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94739398118528 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2b3530 con 0x7f4b380b4030 2024-04-23T18:29:36.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.273+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== watch-notify(notify (1) cookie 94739397842256 notify 137438953485 ret 0) ==== 248+0+0 (crc 0 0 0) 0x562a3c2b9b20 con 0x7f4b380b4030 2024-04-23T18:29:36.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.273+0000 7f4a267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94739397842256 notifier 4539 bl.length()=206 2024-04-23T18:29:36.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.273+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(77 notify.6 [notify cookie 94739398118528 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.273+0000 7f4a267fc640 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4978003400 con 0x7f4b380b4030 2024-04-23T18:29:36.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.273+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== watch-notify(notify_complete (2) cookie 94739398118528 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4b3c046790 con 0x7f4b380b4030 2024-04-23T18:29:36.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.273+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.274+0000 7f49f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:36.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.274+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94739397847552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c2b57e0 con 0x562a3c267610 2024-04-23T18:29:36.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.275+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94739397847552] v32'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.275+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94739397823392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c27aa00 con 0x562a3c26c000 2024-04-23T18:29:36.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.276+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94739397823392] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b380cb040 con 0x562a3c26c000 2024-04-23T18:29:36.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.276+0000 7f4b4772c800 20 remove_watcher() i=0 2024-04-23T18:29:36.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.276+0000 7f4b4772c800 2 removed watcher, disabling cache 2024-04-23T18:29:36.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.276+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94739397826176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c27aa00 con 0x562a3c267610 2024-04-23T18:29:36.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.277+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94739397826176] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.277+0000 7f4b4772c800 20 remove_watcher() i=1 2024-04-23T18:29:36.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.277+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94739397830976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c27aa00 con 0x562a3c270940 2024-04-23T18:29:36.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.278+0000 7f4b42c63640 1 -- 172.21.15.119:0/2509765611 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94739397830976] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b34009050 con 0x562a3c270940 2024-04-23T18:29:36.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.278+0000 7f4b4772c800 20 remove_watcher() i=2 2024-04-23T18:29:36.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.278+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94739397836064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c27aa00 con 0x562a3c26c000 2024-04-23T18:29:36.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.279+0000 7f4b43464640 1 -- 172.21.15.119:0/2509765611 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94739397836064] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b380cb040 con 0x562a3c26c000 2024-04-23T18:29:36.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.279+0000 7f4b4772c800 20 remove_watcher() i=3 2024-04-23T18:29:36.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.279+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94739397838368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c277d20 con 0x562a3c267610 2024-04-23T18:29:36.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.281+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94739397838368] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x562a3c267610 2024-04-23T18:29:36.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.281+0000 7f4b4772c800 20 remove_watcher() i=4 2024-04-23T18:29:36.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.281+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94739397841200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c27aa00 con 0x7f4b380b4030 2024-04-23T18:29:36.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.282+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 31 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94739397841200] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.282+0000 7f4b4772c800 20 remove_watcher() i=5 2024-04-23T18:29:36.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.282+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94739397842256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c277d20 con 0x7f4b380b4030 2024-04-23T18:29:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.283+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 32 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94739397842256] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.283+0000 7f4b4772c800 20 remove_watcher() i=6 2024-04-23T18:29:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.283+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94739397846128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a3c27aa00 con 0x7f4b380b4030 2024-04-23T18:29:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 <== osd.0 v2:172.21.15.62:6800/2641588406 33 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94739397846128] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c040040 con 0x7f4b380b4030 2024-04-23T18:29:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 20 remove_watcher() i=7 2024-04-23T18:29:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4b380b4030 msgr2=0x7f4b3808e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4b380b4030 0x7f4b3808e400 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562a3c267610 msgr2=0x562a3c269ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562a3c267610 0x562a3c269ad0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562a3c26c000 msgr2=0x562a3c26e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562a3c26c000 0x562a3c26e3f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562a3c270940 msgr2=0x562a3c272e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x562a3c270940 0x562a3c272e00 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a0c036e60 msgr2=0x7f4a0c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a0c036e60 0x7f4a0c039320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4b34001b60 tx=0x7f4b34010000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c254ba0 msgr2=0x562a3c25bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2509765611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c254ba0 0x562a3c25bfc0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4b38067b20 tx=0x7f4b3806cf20 comp rx=0 tx=0).stop 2024-04-23T18:29:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 reap_dead start 2024-04-23T18:29:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b43c65640 1 -- 172.21.15.119:0/2509765611 reap_dead start 2024-04-23T18:29:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 shutdown_connections 2024-04-23T18:29:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 >> 172.21.15.119:0/2509765611 conn(0x562a3c250f00 msgr2=0x562a3c24e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 shutdown_connections 2024-04-23T18:29:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.284+0000 7f4b4772c800 1 -- 172.21.15.119:0/2509765611 wait complete. 2024-04-23T18:29:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/2066610684 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a1c036e60 msgr2=0x7f4a1c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2066610684 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a1c036e60 0x7f4a1c039320 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400bf50 tx=0x7f4b3400f000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/2066610684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c2479f0 msgr2=0x562a3c247e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2066610684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c2479f0 0x562a3c247e10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4b3808ce40 tx=0x7f4b3807b310 comp rx=0 tx=0).stop 2024-04-23T18:29:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/2066610684 shutdown_connections 2024-04-23T18:29:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2066610684 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a1c036e60 0x7f4a1c039320 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 --2- 172.21.15.119:0/2066610684 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c2479f0 0x562a3c247e10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/2066610684 >> 172.21.15.119:0/2066610684 conn(0x562a3c23ba90 msgr2=0x562a3c23be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/2066610684 shutdown_connections 2024-04-23T18:29:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/2066610684 wait complete. 2024-04-23T18:29:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562a3c2369f0 msgr2=0x562a3c238e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x562a3c2369f0 0x562a3c238e60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562a3c22dcd0 msgr2=0x562a3c230140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x562a3c22dcd0 0x562a3c230140 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562a3c232ab0 msgr2=0x562a3c234ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x562a3c232ab0 0x562a3c234ea0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a28036e60 msgr2=0x7f4a28039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4a28036e60 0x7f4a28039320 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4b34000f60 tx=0x7f4b340012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12d210 msgr2=0x562a3c228de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 --2- 172.21.15.119:0/166297620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x562a3c12d210 0x562a3c228de0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4b38000c00 tx=0x7f4b38002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b43c65640 1 -- 172.21.15.119:0/166297620 reap_dead start 2024-04-23T18:29:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 shutdown_connections 2024-04-23T18:29:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 >> 172.21.15.119:0/166297620 conn(0x562a3c128430 msgr2=0x562a3c21ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 shutdown_connections 2024-04-23T18:29:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.285+0000 7f4b4772c800 1 -- 172.21.15.119:0/166297620 wait complete. 2024-04-23T18:29:36.295 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-04-23T18:29:36.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-04-23T18:29:36.295 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-04-23T18:29:36.336 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:36.336 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:36.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.345+0000 7f5d06c40800 1 Processor -- start 2024-04-23T18:29:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.345+0000 7f5d06c40800 1 -- start start 2024-04-23T18:29:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.345+0000 7f5d06c40800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564ed2b6a360 0x564ed2b6a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.345+0000 7f5d06c40800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564ed2a1b560 con 0x564ed2b6b0e0 2024-04-23T18:29:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.345+0000 7f5d06c40800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x564ed2a0ce20 con 0x564ed2b6a360 2024-04-23T18:29:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.345+0000 7f5d018dc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564ed2b6a360 0x564ed2b6a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.345+0000 7f5d010db640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x564ed2b6b0e0 0x564ed2b6b590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:40878/0 (socket says 172.21.15.119:40878) 2024-04-23T18:29:36.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.345+0000 7f5d010db640 1 -- 172.21.15.119:0/3282731572 learned_addr learned my addr 172.21.15.119:0/3282731572 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:36.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.345+0000 7f5d018dc640 1 -- 172.21.15.119:0/3282731572 >> v1:172.21.15.62:6789/0 conn(0x564ed2b6b0e0 legacy=0x564ed2b6b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.345+0000 7f5d018dc640 1 -- 172.21.15.119:0/3282731572 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed2a1ae60 con 0x564ed2b6a360 2024-04-23T18:29:36.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.347+0000 7f5d018dc640 1 --2- 172.21.15.119:0/3282731572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2b6a780 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400a470 tx=0x7f5cf401ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4eb46cb314066b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.347+0000 7f5d008da640 1 -- 172.21.15.119:0/3282731572 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf4057070 con 0x564ed2b6a360 2024-04-23T18:29:36.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.348+0000 7f5d008da640 1 -- 172.21.15.119:0/3282731572 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf404ad80 con 0x564ed2b6a360 2024-04-23T18:29:36.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.348+0000 7f5d008da640 1 -- 172.21.15.119:0/3282731572 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf4052590 con 0x564ed2b6a360 2024-04-23T18:29:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.348+0000 7f5d06c40800 1 -- 172.21.15.119:0/3282731572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 msgr2=0x564ed2b6a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.348+0000 7f5d06c40800 1 --2- 172.21.15.119:0/3282731572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2b6a780 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400a470 tx=0x7f5cf401ce50 comp rx=0 tx=0).stop 2024-04-23T18:29:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.348+0000 7f5d06c40800 1 -- 172.21.15.119:0/3282731572 shutdown_connections 2024-04-23T18:29:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.348+0000 7f5d06c40800 1 --2- 172.21.15.119:0/3282731572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2b6a780 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.348+0000 7f5d06c40800 1 -- 172.21.15.119:0/3282731572 >> 172.21.15.119:0/3282731572 conn(0x564ed2b64ba0 msgr2=0x564ed2b66fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.348+0000 7f5d06c40800 1 -- 172.21.15.119:0/3282731572 shutdown_connections 2024-04-23T18:29:36.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.348+0000 7f5d06c40800 1 -- 172.21.15.119:0/3282731572 wait complete. 2024-04-23T18:29:36.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.360+0000 7f5d06c40800 1 Processor -- start 2024-04-23T18:29:36.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.360+0000 7f5d06c40800 1 -- start start 2024-04-23T18:29:36.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.360+0000 7f5d06c40800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2c5b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.360+0000 7f5d06c40800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564ed2ab65b0 con 0x564ed2b6a360 2024-04-23T18:29:36.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.360+0000 7f5d018dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2c5b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.360+0000 7f5d018dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2c5b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34140/0 (socket says 172.21.15.119:34140) 2024-04-23T18:29:36.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.360+0000 7f5d018dc640 1 -- 172.21.15.119:0/2256526034 learned_addr learned my addr 172.21.15.119:0/2256526034 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.361+0000 7f5d018dc640 1 -- 172.21.15.119:0/2256526034 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed2a2c860 con 0x564ed2b6a360 2024-04-23T18:29:36.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.361+0000 7f5d018dc640 1 --2- 172.21.15.119:0/2256526034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2c5b620 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4055040 tx=0x7f5cf404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca3e267c43d26b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.361+0000 7f5befe07640 1 -- 172.21.15.119:0/2256526034 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf4057040 con 0x564ed2b6a360 2024-04-23T18:29:36.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.361+0000 7f5befe07640 1 -- 172.21.15.119:0/2256526034 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf4063070 con 0x564ed2b6a360 2024-04-23T18:29:36.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.361+0000 7f5befe07640 1 -- 172.21.15.119:0/2256526034 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf405d470 con 0x564ed2b6a360 2024-04-23T18:29:36.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d06c40800 1 -- 172.21.15.119:0/2256526034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 msgr2=0x564ed2c5b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2256526034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2c5b620 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4055040 tx=0x7f5cf404c000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d06c40800 1 -- 172.21.15.119:0/2256526034 shutdown_connections 2024-04-23T18:29:36.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2256526034 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2c5b620 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d06c40800 1 -- 172.21.15.119:0/2256526034 >> 172.21.15.119:0/2256526034 conn(0x564ed2b64ba0 msgr2=0x564ed2c56f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d06c40800 1 -- 172.21.15.119:0/2256526034 shutdown_connections 2024-04-23T18:29:36.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d06c40800 1 -- 172.21.15.119:0/2256526034 wait complete. 2024-04-23T18:29:36.358 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d06c40800 1 Processor -- start 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d06c40800 1 -- start start 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d06c40800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2c62e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d06c40800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564ed2b735e0 con 0x564ed2b6a360 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d018dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2c62e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d018dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2c62e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34150/0 (socket says 172.21.15.119:34150) 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.362+0000 7f5d018dc640 1 -- 172.21.15.119:0/185145756 learned_addr learned my addr 172.21.15.119:0/185145756 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.363+0000 7f5d018dc640 1 -- 172.21.15.119:0/185145756 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed2a2aeb0 con 0x564ed2b6a360 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.363+0000 7f5d018dc640 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2c62e20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4000c00 tx=0x7f5cf4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.363+0000 7f5bee604640 1 -- 172.21.15.119:0/185145756 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf406c070 con 0x564ed2b6a360 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.363+0000 7f5bee604640 1 -- 172.21.15.119:0/185145756 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf405d8f0 con 0x564ed2b6a360 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.363+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ed2c63360 con 0x564ed2b6a360 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.363+0000 7f5bee604640 1 -- 172.21.15.119:0/185145756 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf4057070 con 0x564ed2b6a360 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.363+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed2c63880 con 0x564ed2b6a360 2024-04-23T18:29:36.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.364+0000 7f5bee604640 1 -- 172.21.15.119:0/185145756 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5cf405dbf0 con 0x564ed2b6a360 2024-04-23T18:29:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.364+0000 7f5bee604640 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5be8036e60 0x7f5be8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.364+0000 7f5bee604640 1 -- 172.21.15.119:0/185145756 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5cf408ec40 con 0x564ed2b6a360 2024-04-23T18:29:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.364+0000 7f5d010db640 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5be8036e60 0x7f5be8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.364+0000 7f5d06c40800 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ed2b6b0e0 0x564ed2c69e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.364+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2c6a410 con 0x564ed2b6b0e0 2024-04-23T18:29:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.364+0000 7f5d020dd640 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ed2b6b0e0 0x564ed2c69e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.364+0000 7f5d010db640 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5be8036e60 0x7f5be8039320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8000f60 tx=0x7f5cf80012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.364+0000 7f5d020dd640 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ed2b6b0e0 0x564ed2c69e90 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.365+0000 7f5d020dd640 1 -- 172.21.15.119:0/185145756 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2b6b0e0 2024-04-23T18:29:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.365+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2c67440 con 0x564ed2b6b0e0 2024-04-23T18:29:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.365+0000 7f5d020dd640 1 -- 172.21.15.119:0/185145756 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2b6b0e0 2024-04-23T18:29:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.365+0000 7f5d06c40800 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ed2c6c770 0x564ed2c6eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.360 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.365+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2c6f200 con 0x564ed2c6c770 2024-04-23T18:29:36.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.365+0000 7f5d018dc640 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ed2c6c770 0x564ed2c6eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.365+0000 7f5d018dc640 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ed2c6c770 0x564ed2c6eb60 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.366+0000 7f5d018dc640 1 -- 172.21.15.119:0/185145756 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5cf405a040 con 0x564ed2c6c770 2024-04-23T18:29:36.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.366+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2c6b720 con 0x564ed2b6b0e0 2024-04-23T18:29:36.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.366+0000 7f5d020dd640 1 -- 172.21.15.119:0/185145756 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2b6b0e0 2024-04-23T18:29:36.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.366+0000 7f5d06c40800 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564ed2c706b0 0x564ed2c72b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.366+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2c73260 con 0x564ed2c706b0 2024-04-23T18:29:36.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.366+0000 7f5d010db640 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564ed2c706b0 0x564ed2c72b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.366+0000 7f5d010db640 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564ed2c706b0 0x564ed2c72b00 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.367+0000 7f5d010db640 1 -- 172.21.15.119:0/185145756 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2c706b0 2024-04-23T18:29:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.367+0000 7f5d06c40800 1 Processor -- start 2024-04-23T18:29:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.367+0000 7f5d06c40800 1 -- start start 2024-04-23T18:29:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.367+0000 7f5d06c40800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c83380 0x564ed2c85770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.367+0000 7f5d06c40800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564ed2a5cdf0 con 0x564ed2c83380 2024-04-23T18:29:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.367+0000 7f5d018dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c83380 0x564ed2c85770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.367+0000 7f5d018dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c83380 0x564ed2c85770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34156/0 (socket says 172.21.15.119:34156) 2024-04-23T18:29:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.367+0000 7f5d018dc640 1 -- 172.21.15.119:0/2371277997 learned_addr learned my addr 172.21.15.119:0/2371277997 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.368+0000 7f5d018dc640 1 -- 172.21.15.119:0/2371277997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed2b69d00 con 0x564ed2c83380 2024-04-23T18:29:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.368+0000 7f5d018dc640 1 --2- 172.21.15.119:0/2371277997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c83380 0x564ed2c85770 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5cf408d070 tx=0x7f5cf405e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.368+0000 7f5be77fe640 1 -- 172.21.15.119:0/2371277997 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf405b550 con 0x564ed2c83380 2024-04-23T18:29:36.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.368+0000 7f5be77fe640 1 -- 172.21.15.119:0/2371277997 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf4093070 con 0x564ed2c83380 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.368+0000 7f5d06c40800 1 -- 172.21.15.119:0/2371277997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ed2c85cb0 con 0x564ed2c83380 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.368+0000 7f5be77fe640 1 -- 172.21.15.119:0/2371277997 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf4079cf0 con 0x564ed2c83380 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.368+0000 7f5d06c40800 1 -- 172.21.15.119:0/2371277997 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed2c86150 con 0x564ed2c83380 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.369+0000 7f5be77fe640 1 -- 172.21.15.119:0/2371277997 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5cf4009770 con 0x564ed2c83380 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.369+0000 7f5be77fe640 1 --2- 172.21.15.119:0/2371277997 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5bdc036e60 0x7f5bdc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.369+0000 7f5be77fe640 1 -- 172.21.15.119:0/2371277997 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5cf408a070 con 0x564ed2c83380 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.369+0000 7f5d010db640 1 --2- 172.21.15.119:0/2371277997 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5bdc036e60 0x7f5bdc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.369+0000 7f5d06c40800 1 Processor -- start 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.369+0000 7f5d06c40800 1 -- start start 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.369+0000 7f5d010db640 1 --2- 172.21.15.119:0/2371277997 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5bdc036e60 0x7f5bdc039320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800bf50 tx=0x7f5cf800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.369+0000 7f5d06c40800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c8f890 0x564ed2c8fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.369+0000 7f5d06c40800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564ed2c5bce0 con 0x564ed2c8f890 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.370+0000 7f5d018dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c8f890 0x564ed2c8fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.370+0000 7f5d018dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c8f890 0x564ed2c8fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34172/0 (socket says 172.21.15.119:34172) 2024-04-23T18:29:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.370+0000 7f5d018dc640 1 -- 172.21.15.119:0/4012748069 learned_addr learned my addr 172.21.15.119:0/4012748069 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.370+0000 7f5d018dc640 1 -- 172.21.15.119:0/4012748069 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed2c90280 con 0x564ed2c8f890 2024-04-23T18:29:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.370+0000 7f5d018dc640 1 --2- 172.21.15.119:0/4012748069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c8f890 0x564ed2c8fcb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400a010 tx=0x7f5cf4009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b1cb51f6701295 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.370+0000 7f5be57fa640 1 -- 172.21.15.119:0/4012748069 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf4083700 con 0x564ed2c8f890 2024-04-23T18:29:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.370+0000 7f5be57fa640 1 -- 172.21.15.119:0/4012748069 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf40a8070 con 0x564ed2c8f890 2024-04-23T18:29:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.370+0000 7f5be57fa640 1 -- 172.21.15.119:0/4012748069 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf4072830 con 0x564ed2c8f890 2024-04-23T18:29:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d06c40800 1 -- 172.21.15.119:0/4012748069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c8f890 msgr2=0x564ed2c8fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d06c40800 1 --2- 172.21.15.119:0/4012748069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c8f890 0x564ed2c8fcb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400a010 tx=0x7f5cf4009a60 comp rx=0 tx=0).stop 2024-04-23T18:29:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d06c40800 1 -- 172.21.15.119:0/4012748069 shutdown_connections 2024-04-23T18:29:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d06c40800 1 --2- 172.21.15.119:0/4012748069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c8f890 0x564ed2c8fcb0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d06c40800 1 -- 172.21.15.119:0/4012748069 >> 172.21.15.119:0/4012748069 conn(0x564ed2c8bbf0 msgr2=0x564ed2c89c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d06c40800 1 -- 172.21.15.119:0/4012748069 shutdown_connections 2024-04-23T18:29:36.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d06c40800 1 -- 172.21.15.119:0/4012748069 wait complete. 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d06c40800 1 Processor -- start 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d06c40800 1 -- start start 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d06c40800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c8f890 0x564ed2c82cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d06c40800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564ed2c90930 con 0x564ed2c8f890 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d018dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c8f890 0x564ed2c82cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d018dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c8f890 0x564ed2c82cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:34178/0 (socket says 172.21.15.119:34178) 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 learned_addr learned my addr 172.21.15.119:0/2786202107 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.371+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed2c813b0 con 0x564ed2c8f890 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.372+0000 7f5d018dc640 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c8f890 0x564ed2c82cc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5cf405bfd0 tx=0x7f5cf405cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.372+0000 7f5bd37fe640 1 -- 172.21.15.119:0/2786202107 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40bd070 con 0x564ed2c8f890 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.372+0000 7f5bd37fe640 1 -- 172.21.15.119:0/2786202107 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf4072a40 con 0x564ed2c8f890 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.372+0000 7f5bd37fe640 1 -- 172.21.15.119:0/2786202107 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf4072830 con 0x564ed2c8f890 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.372+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ed2c813b0 con 0x564ed2c8f890 2024-04-23T18:29:36.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.372+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed2c813b0 con 0x564ed2c8f890 2024-04-23T18:29:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.373+0000 7f5bd37fe640 1 -- 172.21.15.119:0/2786202107 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5cf40c0070 con 0x564ed2c8f890 2024-04-23T18:29:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.373+0000 7f5bd37fe640 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5bcc036e60 0x7f5bcc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.373+0000 7f5bd37fe640 1 -- 172.21.15.119:0/2786202107 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5cf40b4030 con 0x564ed2c8f890 2024-04-23T18:29:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.373+0000 7f5d06c40800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.373+0000 7f5d010db640 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5bcc036e60 0x7f5bcc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.373+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ed2ca4600 0x564ed2ca6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.373+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca7210 con 0x564ed2ca4600 2024-04-23T18:29:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.373+0000 7f5d020dd640 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ed2ca4600 0x564ed2ca6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.373+0000 7f5d010db640 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5bcc036e60 0x7f5bcc039320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8001b60 tx=0x7f5cf8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d020dd640 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ed2ca4600 0x564ed2ca6ac0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2ca4600 2024-04-23T18:29:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 20 realm 2024-04-23T18:29:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca7620 con 0x564ed2ca4600 2024-04-23T18:29:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2ca4600 2024-04-23T18:29:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca7ec0 con 0x564ed2ca4600 2024-04-23T18:29:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2ca4600 2024-04-23T18:29:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca4600 2024-04-23T18:29:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2ca4600 2024-04-23T18:29:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.374+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ed2ca8fc0 0x564ed2cab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.375+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cab8f0 con 0x564ed2ca8fc0 2024-04-23T18:29:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.375+0000 7f5d018dc640 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ed2ca8fc0 0x564ed2cab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.375+0000 7f5d018dc640 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ed2ca8fc0 0x564ed2cab3b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.375+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5cf40bf030 con 0x564ed2ca8fc0 2024-04-23T18:29:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.375+0000 7f5d06c40800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.375+0000 7f5d06c40800 20 searching for the correct realm 2024-04-23T18:29:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.375+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564ed2cad970 0x564ed2cafe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.375+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb0500 con 0x564ed2cad970 2024-04-23T18:29:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.375+0000 7f5d010db640 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564ed2cad970 0x564ed2cafe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.375+0000 7f5d010db640 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564ed2cad970 0x564ed2cafe30 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.376+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.376+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb0500 con 0x564ed2ca8fc0 2024-04-23T18:29:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.376+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf40bf030 con 0x564ed2ca8fc0 2024-04-23T18:29:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.376+0000 7f5d018dc640 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5cf40c2060 0x7f5cf4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.376+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb0500 con 0x7f5cf40c2060 2024-04-23T18:29:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.376+0000 7f5d020dd640 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5cf40c2060 0x7f5cf4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.377+0000 7f5d020dd640 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5cf40c2060 0x7f5cf4068930 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.377+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x7f5cf40c2060 2024-04-23T18:29:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.377+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca4600 2024-04-23T18:29:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.377+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2ca4600 2024-04-23T18:29:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.377+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca4600 2024-04-23T18:29:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.377+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2ca4600 2024-04-23T18:29:36.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.377+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x7f5cf40c2060 2024-04-23T18:29:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.377+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x7f5cf40c2060 2024-04-23T18:29:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.377+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x7f5cf40c2060 2024-04-23T18:29:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.378+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x7f5cf40c2060 2024-04-23T18:29:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.378+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca8fc0 2024-04-23T18:29:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.378+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf40bf030 con 0x564ed2ca8fc0 2024-04-23T18:29:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.378+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2cad970 2024-04-23T18:29:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.378+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.378+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca4600 2024-04-23T18:29:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.378+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2ca4600 2024-04-23T18:29:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.378+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x7f5cf40c2060 2024-04-23T18:29:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.379+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x7f5cf40c2060 2024-04-23T18:29:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.379+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca4600 2024-04-23T18:29:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.379+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2ca4600 2024-04-23T18:29:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.379+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca8fc0 2024-04-23T18:29:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.379+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5cf40bf030 con 0x564ed2ca8fc0 2024-04-23T18:29:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.379+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2cad970 2024-04-23T18:29:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.379+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.379+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2cad970 2024-04-23T18:29:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.379+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.379+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x7f5cf40c2060 2024-04-23T18:29:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.380+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x7f5cf40c2060 2024-04-23T18:29:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.380+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2cad970 2024-04-23T18:29:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.380+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.380+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2cad970 2024-04-23T18:29:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.380+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.380+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca4600 2024-04-23T18:29:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.380+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2ca4600 2024-04-23T18:29:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.380+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca4600 2024-04-23T18:29:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.381+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2ca4600 2024-04-23T18:29:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.381+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x7f5cf40c2060 2024-04-23T18:29:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.381+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x7f5cf40c2060 2024-04-23T18:29:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.381+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2cad970 2024-04-23T18:29:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.381+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.381+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca8fc0 2024-04-23T18:29:36.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.382+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5cf40bf030 con 0x564ed2ca8fc0 2024-04-23T18:29:36.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.382+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca4600 2024-04-23T18:29:36.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.382+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x564ed2ca4600 2024-04-23T18:29:36.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.382+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x7f5cf40c2060 2024-04-23T18:29:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.382+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x7f5cf40c2060 2024-04-23T18:29:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.382+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2cad970 2024-04-23T18:29:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.382+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.383+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x7f5cf40c2060 2024-04-23T18:29:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.383+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc00a4a0 con 0x7f5cf40c2060 2024-04-23T18:29:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.383+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca8fc0 2024-04-23T18:29:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.383+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf40bf030 con 0x564ed2ca8fc0 2024-04-23T18:29:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.383+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2cad970 2024-04-23T18:29:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.383+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.383+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x7f5cf40c2060 2024-04-23T18:29:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.384+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc040040 con 0x7f5cf40c2060 2024-04-23T18:29:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.384+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca4600 2024-04-23T18:29:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.384+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5cfc040040 con 0x564ed2ca4600 2024-04-23T18:29:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.384+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ca8260 con 0x564ed2ca8fc0 2024-04-23T18:29:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf40d8040 con 0x564ed2ca8fc0 2024-04-23T18:29:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cac270 con 0x564ed2ca4600 2024-04-23T18:29:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x564ed2ca4600 2024-04-23T18:29:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cac270 con 0x564ed2ca4600 2024-04-23T18:29:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cfc040040 con 0x564ed2ca4600 2024-04-23T18:29:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cac270 con 0x7f5cf40c2060 2024-04-23T18:29:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5cfc040040 con 0x7f5cf40c2060 2024-04-23T18:29:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:36.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 zone default found 2024-04-23T18:29:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 4 Realm: () 2024-04-23T18:29:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 zonegroup default 2024-04-23T18:29:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.385+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cac660 con 0x7f5cf40c2060 2024-04-23T18:29:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.386+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x7f5cf40c2060 2024-04-23T18:29:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.386+0000 7f5d06c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.386+0000 7f5d06c40800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.386+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cacaa0 con 0x564ed2cad970 2024-04-23T18:29:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.386+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.386+0000 7f5d06c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.386+0000 7f5d06c40800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.386+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cacee0 con 0x564ed2cad970 2024-04-23T18:29:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.386+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.386+0000 7f5d06c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.386+0000 7f5d06c40800 20 started sync module instance, tier type = 2024-04-23T18:29:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.386+0000 7f5d06c40800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.386+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb1800 con 0x564ed2ca8fc0 2024-04-23T18:29:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.387+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40d8040 con 0x564ed2ca8fc0 2024-04-23T18:29:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.387+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94896543964144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb24c0 con 0x564ed2ca8fc0 2024-04-23T18:29:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.387+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb2e80 con 0x564ed2ca4600 2024-04-23T18:29:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.388+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94896543964144] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40d8040 con 0x564ed2ca8fc0 2024-04-23T18:29:36.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.388+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x564ed2ca4600 2024-04-23T18:29:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.389+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94896543968176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb24c0 con 0x564ed2ca4600 2024-04-23T18:29:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.389+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb3920 con 0x564ed2cad970 2024-04-23T18:29:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.390+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.390+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94896543970320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb41c0 con 0x564ed2cad970 2024-04-23T18:29:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.390+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb4ca0 con 0x564ed2ca8fc0 2024-04-23T18:29:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.390+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94896543968176] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x564ed2ca4600 2024-04-23T18:29:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.391+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94896543970320] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.391+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40d8040 con 0x564ed2ca8fc0 2024-04-23T18:29:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.391+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94896543972624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb2010 con 0x564ed2ca8fc0 2024-04-23T18:29:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.391+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb5540 con 0x564ed2ca4600 2024-04-23T18:29:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.392+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94896543972624] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40d8040 con 0x564ed2ca8fc0 2024-04-23T18:29:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.392+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x564ed2ca4600 2024-04-23T18:29:36.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.392+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94896543975344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb5540 con 0x564ed2ca4600 2024-04-23T18:29:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.392+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb5f00 con 0x7f5cf40c2060 2024-04-23T18:29:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.393+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94896543975344] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x564ed2ca4600 2024-04-23T18:29:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.393+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x7f5cf40c2060 2024-04-23T18:29:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.393+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94896543980592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb5540 con 0x7f5cf40c2060 2024-04-23T18:29:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.393+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb6910 con 0x7f5cf40c2060 2024-04-23T18:29:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.394+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94896543980592] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x7f5cf40c2060 2024-04-23T18:29:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.394+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x7f5cf40c2060 2024-04-23T18:29:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.394+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94896543977616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb6af0 con 0x7f5cf40c2060 2024-04-23T18:29:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.394+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb7340 con 0x7f5cf40c2060 2024-04-23T18:29:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.395+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94896543977616] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x7f5cf40c2060 2024-04-23T18:29:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.395+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x7f5cf40c2060 2024-04-23T18:29:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.395+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94896543983648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb71f0 con 0x7f5cf40c2060 2024-04-23T18:29:36.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.395+0000 7f5d06c40800 20 add_watcher() i=0 2024-04-23T18:29:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.395+0000 7f5d06c40800 20 add_watcher() i=1 2024-04-23T18:29:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.395+0000 7f5d06c40800 20 add_watcher() i=2 2024-04-23T18:29:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.395+0000 7f5d06c40800 20 add_watcher() i=3 2024-04-23T18:29:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.395+0000 7f5d06c40800 20 add_watcher() i=4 2024-04-23T18:29:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.395+0000 7f5d06c40800 20 add_watcher() i=5 2024-04-23T18:29:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.395+0000 7f5d06c40800 20 add_watcher() i=6 2024-04-23T18:29:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.396+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94896543983648] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x7f5cf40c2060 2024-04-23T18:29:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.396+0000 7f5d06c40800 20 add_watcher() i=7 2024-04-23T18:29:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.396+0000 7f5d06c40800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.396+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cba760 con 0x564ed2ca4600 2024-04-23T18:29:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.396+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5cfc040040 con 0x564ed2ca4600 2024-04-23T18:29:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.396+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94896543984768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb7be0 con 0x564ed2ca4600 2024-04-23T18:29:36.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.397+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94896543984768] v32'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x564ed2ca4600 2024-04-23T18:29:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.397+0000 7f5bb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.397+0000 7f5d06c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.397+0000 7f5d06c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.397+0000 7f5d06c40800 5 note: GC not initialized 2024-04-23T18:29:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.398+0000 7f5bb27fc640 20 reqs_thread_entry: start 2024-04-23T18:29:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.398+0000 7f5d06c40800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.398+0000 7f5d06c40800 20 Filter name: none 2024-04-23T18:29:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.398+0000 7f5b23fff640 20 reqs_thread_entry: start 2024-04-23T18:29:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.398+0000 7f5d06c40800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.398+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ed2ced9d0 con 0x564ed2ca4600 2024-04-23T18:29:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.398+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f5cfc040040 con 0x564ed2ca4600 2024-04-23T18:29:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.398+0000 7f5d06c40800 20 rados_obj.operate() r=0 bl.length=193 2024-04-23T18:29:36.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.399+0000 7f5bb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.399+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94896543984768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cba0a0 con 0x564ed2ca4600 2024-04-23T18:29:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.400+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94896543984768] v32'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x564ed2ca4600 2024-04-23T18:29:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.400+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94896543964144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb6c40 con 0x564ed2ca8fc0 2024-04-23T18:29:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.401+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94896543964144] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40d8040 con 0x564ed2ca8fc0 2024-04-23T18:29:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.401+0000 7f5d06c40800 20 remove_watcher() i=0 2024-04-23T18:29:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.401+0000 7f5d06c40800 2 removed watcher, disabling cache 2024-04-23T18:29:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.401+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94896543968176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb1bf0 con 0x564ed2ca4600 2024-04-23T18:29:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.402+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94896543968176] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x564ed2ca4600 2024-04-23T18:29:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.402+0000 7f5d06c40800 20 remove_watcher() i=1 2024-04-23T18:29:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.402+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94896543970320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb1bf0 con 0x564ed2cad970 2024-04-23T18:29:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.403+0000 7f5d010db640 1 -- 172.21.15.119:0/2786202107 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94896543970320] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf8009050 con 0x564ed2cad970 2024-04-23T18:29:36.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.403+0000 7f5d06c40800 20 remove_watcher() i=2 2024-04-23T18:29:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.403+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94896543972624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb2bb0 con 0x564ed2ca8fc0 2024-04-23T18:29:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.404+0000 7f5d018dc640 1 -- 172.21.15.119:0/2786202107 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94896543972624] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40d8040 con 0x564ed2ca8fc0 2024-04-23T18:29:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.404+0000 7f5d06c40800 20 remove_watcher() i=3 2024-04-23T18:29:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.404+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94896543975344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb2bb0 con 0x564ed2ca4600 2024-04-23T18:29:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.405+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94896543975344] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x564ed2ca4600 2024-04-23T18:29:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.405+0000 7f5d06c40800 20 remove_watcher() i=4 2024-04-23T18:29:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.405+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94896543980592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb2bb0 con 0x7f5cf40c2060 2024-04-23T18:29:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.406+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94896543980592] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x7f5cf40c2060 2024-04-23T18:29:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.406+0000 7f5d06c40800 20 remove_watcher() i=5 2024-04-23T18:29:36.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.406+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94896543977616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb5c30 con 0x7f5cf40c2060 2024-04-23T18:29:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.407+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94896543977616] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x7f5cf40c2060 2024-04-23T18:29:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.407+0000 7f5d06c40800 20 remove_watcher() i=6 2024-04-23T18:29:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.407+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94896543983648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ed2cb5c30 con 0x7f5cf40c2060 2024-04-23T18:29:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.408+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94896543983648] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc040040 con 0x7f5cf40c2060 2024-04-23T18:29:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.408+0000 7f5d06c40800 20 remove_watcher() i=7 2024-04-23T18:29:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5cf40c2060 msgr2=0x7f5cf4068930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5cf40c2060 0x7f5cf4068930 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ed2ca4600 msgr2=0x564ed2ca6ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ed2ca4600 0x564ed2ca6ac0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ed2ca8fc0 msgr2=0x564ed2cab3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ed2ca8fc0 0x564ed2cab3b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564ed2cad970 msgr2=0x564ed2cafe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564ed2cad970 0x564ed2cafe30 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5bcc036e60 msgr2=0x7f5bcc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5bcc036e60 0x7f5bcc039320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8001b60 tx=0x7f5cf8010000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c8f890 msgr2=0x564ed2c82cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2786202107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c8f890 0x564ed2c82cc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5cf405bfd0 tx=0x7f5cf405cf20 comp rx=0 tx=0).stop 2024-04-23T18:29:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 reap_dead start 2024-04-23T18:29:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d020dd640 1 -- 172.21.15.119:0/2786202107 reap_dead start 2024-04-23T18:29:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 shutdown_connections 2024-04-23T18:29:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 >> 172.21.15.119:0/2786202107 conn(0x564ed2c8bbf0 msgr2=0x564ed2c89250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 shutdown_connections 2024-04-23T18:29:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2786202107 wait complete. 2024-04-23T18:29:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2371277997 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5bdc036e60 msgr2=0x7f5bdc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2371277997 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5bdc036e60 0x7f5bdc039320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5cf800bf50 tx=0x7f5cf800f000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2371277997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c83380 msgr2=0x564ed2c85770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2371277997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c83380 0x564ed2c85770 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5cf408d070 tx=0x7f5cf405e5d0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2371277997 shutdown_connections 2024-04-23T18:29:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2371277997 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5bdc036e60 0x7f5bdc039320 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 --2- 172.21.15.119:0/2371277997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2c83380 0x564ed2c85770 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2371277997 >> 172.21.15.119:0/2371277997 conn(0x564ed2c75760 msgr2=0x564ed2c75b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2371277997 shutdown_connections 2024-04-23T18:29:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/2371277997 wait complete. 2024-04-23T18:29:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564ed2c706b0 msgr2=0x564ed2c72b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564ed2c706b0 0x564ed2c72b00 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ed2b6b0e0 msgr2=0x564ed2c69e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.409+0000 7f5d06c40800 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ed2b6b0e0 0x564ed2c69e90 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.410+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ed2c6c770 msgr2=0x564ed2c6eb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.410+0000 7f5d06c40800 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ed2c6c770 0x564ed2c6eb60 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.410+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5be8036e60 msgr2=0x7f5be8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.410+0000 7f5d06c40800 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5be8036e60 0x7f5be8039320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8000f60 tx=0x7f5cf80012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.410+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 msgr2=0x564ed2c62e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.410+0000 7f5d06c40800 1 --2- 172.21.15.119:0/185145756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ed2b6a360 0x564ed2c62e20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4000c00 tx=0x7f5cf4002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.410+0000 7f5d020dd640 1 -- 172.21.15.119:0/185145756 reap_dead start 2024-04-23T18:29:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.410+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 shutdown_connections 2024-04-23T18:29:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.410+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 >> 172.21.15.119:0/185145756 conn(0x564ed2b64ba0 msgr2=0x564ed2c557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.410+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 shutdown_connections 2024-04-23T18:29:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.410+0000 7f5d06c40800 1 -- 172.21.15.119:0/185145756 wait complete. 2024-04-23T18:29:36.417 INFO:teuthology.orchestra.run.smithi119.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"lwSRb7PpS0av3ws1lHFIOJWr","ver":2},"mtime":"2024-04-23T18:29:36.269206Z","data":{"bucket":{"name":"myfoo","marker":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1","bucket_id":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-04-23T18:29:33.450324Z","linked":true,"has_bucket_info":false}} 2024-04-23T18:29:36.417 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'lwSRb7PpS0av3ws1lHFIOJWr', 'ver': 2}, 'mtime': '2024-04-23T18:29:36.269206Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1', 'bucket_id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-04-23T18:29:33.450324Z', 'linked': True, 'has_bucket_info': False}} 2024-04-23T18:29:36.418 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-23T18:29:36.418 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-23T18:29:36.418 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-04-23T18:29:36.502 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:36.502 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:36.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.510+0000 7f710f336800 1 Processor -- start 2024-04-23T18:29:36.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.510+0000 7f710f336800 1 -- start start 2024-04-23T18:29:36.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.510+0000 7f710f336800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558ef99e6e80 0x558ef99e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.510+0000 7f710f336800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558ef9898560 con 0x558ef99e80e0 2024-04-23T18:29:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.510+0000 7f710f336800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x558ef9889e20 con 0x558ef99e6e80 2024-04-23T18:29:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.511+0000 7f710b0cc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558ef99e6e80 0x558ef99e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.511+0000 7f710a8cb640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x558ef99e80e0 0x558ef99e8560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:47482/0 (socket says 172.21.15.119:47482) 2024-04-23T18:29:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.511+0000 7f710a8cb640 1 -- 172.21.15.119:0/2450753875 learned_addr learned my addr 172.21.15.119:0/2450753875 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.511+0000 7f710b0cc640 1 -- 172.21.15.119:0/2450753875 >> v1:172.21.15.62:6789/0 conn(0x558ef99e80e0 legacy=0x558ef99e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.511+0000 7f710b0cc640 1 -- 172.21.15.119:0/2450753875 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef9897e60 con 0x558ef99e6e80 2024-04-23T18:29:36.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.513+0000 7f710b0cc640 1 --2- 172.21.15.119:0/2450753875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef99e72a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f710400a470 tx=0x7f710401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3bac4b926bc51e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.513+0000 7f710a0ca640 1 -- 172.21.15.119:0/2450753875 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104057070 con 0x558ef99e6e80 2024-04-23T18:29:36.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.513+0000 7f710a0ca640 1 -- 172.21.15.119:0/2450753875 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7104052570 con 0x558ef99e6e80 2024-04-23T18:29:36.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.513+0000 7f710a0ca640 1 -- 172.21.15.119:0/2450753875 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104052870 con 0x558ef99e6e80 2024-04-23T18:29:36.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.513+0000 7f710f336800 1 -- 172.21.15.119:0/2450753875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 msgr2=0x558ef99e72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.513+0000 7f710f336800 1 --2- 172.21.15.119:0/2450753875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef99e72a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f710400a470 tx=0x7f710401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:36.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.513+0000 7f710f336800 1 -- 172.21.15.119:0/2450753875 shutdown_connections 2024-04-23T18:29:36.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.513+0000 7f710f336800 1 --2- 172.21.15.119:0/2450753875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef99e72a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.513+0000 7f710f336800 1 -- 172.21.15.119:0/2450753875 >> 172.21.15.119:0/2450753875 conn(0x558ef99e2440 msgr2=0x558ef99e4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.513+0000 7f710f336800 1 -- 172.21.15.119:0/2450753875 shutdown_connections 2024-04-23T18:29:36.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.513+0000 7f710f336800 1 -- 172.21.15.119:0/2450753875 wait complete. 2024-04-23T18:29:36.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.525+0000 7f710f336800 1 Processor -- start 2024-04-23T18:29:36.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.525+0000 7f710f336800 1 -- start start 2024-04-23T18:29:36.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.525+0000 7f710f336800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef9ad8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.525+0000 7f710f336800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558ef99335d0 con 0x558ef99e6e80 2024-04-23T18:29:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.525+0000 7f710b0cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef9ad8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.525+0000 7f710b0cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef9ad8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:48998/0 (socket says 172.21.15.119:48998) 2024-04-23T18:29:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.525+0000 7f710b0cc640 1 -- 172.21.15.119:0/2256713116 learned_addr learned my addr 172.21.15.119:0/2256713116 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.526+0000 7f710b0cc640 1 -- 172.21.15.119:0/2256713116 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef98a9860 con 0x558ef99e6e80 2024-04-23T18:29:36.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.526+0000 7f710b0cc640 1 --2- 172.21.15.119:0/2256713116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef9ad8570 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7104055040 tx=0x7f710404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a57aeda7bd4c485 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.530+0000 7f6ff960a640 1 -- 172.21.15.119:0/2256713116 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104057070 con 0x558ef99e6e80 2024-04-23T18:29:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.530+0000 7f6ff960a640 1 -- 172.21.15.119:0/2256713116 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7104063070 con 0x558ef99e6e80 2024-04-23T18:29:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.530+0000 7f6ff960a640 1 -- 172.21.15.119:0/2256713116 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104052720 con 0x558ef99e6e80 2024-04-23T18:29:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.530+0000 7f710f336800 1 -- 172.21.15.119:0/2256713116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 msgr2=0x558ef9ad8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.530+0000 7f710f336800 1 --2- 172.21.15.119:0/2256713116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef9ad8570 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7104055040 tx=0x7f710404c000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.530+0000 7f710f336800 1 -- 172.21.15.119:0/2256713116 shutdown_connections 2024-04-23T18:29:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.530+0000 7f710f336800 1 --2- 172.21.15.119:0/2256713116 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef9ad8570 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.530+0000 7f710f336800 1 -- 172.21.15.119:0/2256713116 >> 172.21.15.119:0/2256713116 conn(0x558ef99e2440 msgr2=0x558ef9ad3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.530+0000 7f710f336800 1 -- 172.21.15.119:0/2256713116 shutdown_connections 2024-04-23T18:29:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.530+0000 7f710f336800 1 -- 172.21.15.119:0/2256713116 wait complete. 2024-04-23T18:29:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.531+0000 7f710f336800 1 Processor -- start 2024-04-23T18:29:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.531+0000 7f710f336800 1 -- start start 2024-04-23T18:29:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.531+0000 7f710f336800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef9add550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.531+0000 7f710f336800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558ef99f0550 con 0x558ef99e6e80 2024-04-23T18:29:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.531+0000 7f710b0cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef9add550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.531+0000 7f710b0cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef9add550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49012/0 (socket says 172.21.15.119:49012) 2024-04-23T18:29:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.531+0000 7f710b0cc640 1 -- 172.21.15.119:0/1777472514 learned_addr learned my addr 172.21.15.119:0/1777472514 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.531+0000 7f710b0cc640 1 -- 172.21.15.119:0/1777472514 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef98a7eb0 con 0x558ef99e6e80 2024-04-23T18:29:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.531+0000 7f710b0cc640 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef9add550 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7104055040 tx=0x7f7104002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.532+0000 7f6ff7e07640 1 -- 172.21.15.119:0/1777472514 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104052b70 con 0x558ef99e6e80 2024-04-23T18:29:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.532+0000 7f6ff7e07640 1 -- 172.21.15.119:0/1777472514 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710406c070 con 0x558ef99e6e80 2024-04-23T18:29:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.532+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ef9adbc40 con 0x558ef99e6e80 2024-04-23T18:29:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.532+0000 7f6ff7e07640 1 -- 172.21.15.119:0/1777472514 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104052e40 con 0x558ef99e6e80 2024-04-23T18:29:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.532+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ef9adc1c0 con 0x558ef99e6e80 2024-04-23T18:29:36.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.532+0000 7f6ff7e07640 1 -- 172.21.15.119:0/1777472514 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f710405e480 con 0x558ef99e6e80 2024-04-23T18:29:36.541 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.533+0000 7f6ff7e07640 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6ff0036eb0 0x7f6ff0039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.533+0000 7f6ff7e07640 1 -- 172.21.15.119:0/1777472514 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f710408edc0 con 0x558ef99e6e80 2024-04-23T18:29:36.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.533+0000 7f710a8cb640 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6ff0036eb0 0x7f6ff0039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.533+0000 7f710f336800 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558ef99e80e0 0x558ef9aea310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.533+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9aea850 con 0x558ef99e80e0 2024-04-23T18:29:36.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.533+0000 7f710b8cd640 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558ef99e80e0 0x558ef9aea310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.533+0000 7f710a8cb640 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6ff0036eb0 0x7f6ff0039370 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f70f4000f60 tx=0x7f70f40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.533+0000 7f710b8cd640 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558ef99e80e0 0x558ef9aea310 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.533+0000 7f710b8cd640 1 -- 172.21.15.119:0/1777472514 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef99e80e0 2024-04-23T18:29:36.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.533+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9aeb0a0 con 0x558ef99e80e0 2024-04-23T18:29:36.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.534+0000 7f710b8cd640 1 -- 172.21.15.119:0/1777472514 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef99e80e0 2024-04-23T18:29:36.542 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.534+0000 7f710f336800 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558ef9aecad0 0x558ef9aeef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.534+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9aef6d0 con 0x558ef9aecad0 2024-04-23T18:29:36.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.534+0000 7f710b0cc640 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558ef9aecad0 0x558ef9aeef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.534+0000 7f710b0cc640 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558ef9aecad0 0x558ef9aeef40 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.534+0000 7f710b0cc640 1 -- 172.21.15.119:0/1777472514 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7104009d10 con 0x558ef9aecad0 2024-04-23T18:29:36.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.534+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9aeb920 con 0x558ef99e80e0 2024-04-23T18:29:36.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.535+0000 7f710b8cd640 1 -- 172.21.15.119:0/1777472514 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef99e80e0 2024-04-23T18:29:36.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.535+0000 7f710f336800 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558ef9af0b80 0x558ef9af2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.535+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9af3750 con 0x558ef9af0b80 2024-04-23T18:29:36.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.535+0000 7f710a8cb640 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558ef9af0b80 0x558ef9af2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.535+0000 7f710a8cb640 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558ef9af0b80 0x558ef9af2ff0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.536+0000 7f710a8cb640 1 -- 172.21.15.119:0/1777472514 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9af0b80 2024-04-23T18:29:36.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.536+0000 7f710f336800 1 Processor -- start 2024-04-23T18:29:36.543 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.536+0000 7f710f336800 1 -- start start 2024-04-23T18:29:36.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.536+0000 7f710f336800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b01bb0 0x558ef9b01fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.536+0000 7f710f336800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558ef9adda90 con 0x558ef9b01bb0 2024-04-23T18:29:36.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.536+0000 7f710b0cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b01bb0 0x558ef9b01fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.536+0000 7f710b0cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b01bb0 0x558ef9b01fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49028/0 (socket says 172.21.15.119:49028) 2024-04-23T18:29:36.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.536+0000 7f710b0cc640 1 -- 172.21.15.119:0/263227951 learned_addr learned my addr 172.21.15.119:0/263227951 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.536+0000 7f710b0cc640 1 -- 172.21.15.119:0/263227951 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef9b02510 con 0x558ef9b01bb0 2024-04-23T18:29:36.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.537+0000 7f710b0cc640 1 --2- 172.21.15.119:0/263227951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b01bb0 0x558ef9b01fd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f710405efd0 tx=0x7f7104066440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.537+0000 7f6ff5602640 1 -- 172.21.15.119:0/263227951 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104081040 con 0x558ef9b01bb0 2024-04-23T18:29:36.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.537+0000 7f6ff5602640 1 -- 172.21.15.119:0/263227951 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7104058040 con 0x558ef9b01bb0 2024-04-23T18:29:36.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.537+0000 7f6ff5602640 1 -- 172.21.15.119:0/263227951 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104079bc0 con 0x558ef9b01bb0 2024-04-23T18:29:36.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.537+0000 7f710f336800 1 -- 172.21.15.119:0/263227951 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ef9b02f80 con 0x558ef9b01bb0 2024-04-23T18:29:36.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.537+0000 7f710f336800 1 -- 172.21.15.119:0/263227951 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ef9b03480 con 0x558ef9b01bb0 2024-04-23T18:29:36.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.538+0000 7f6ff5602640 1 -- 172.21.15.119:0/263227951 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7104073b50 con 0x558ef9b01bb0 2024-04-23T18:29:36.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.538+0000 7f6ff5602640 1 --2- 172.21.15.119:0/263227951 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fe4036eb0 0x7f6fe4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.538+0000 7f6ff5602640 1 -- 172.21.15.119:0/263227951 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f710409a9e0 con 0x558ef9b01bb0 2024-04-23T18:29:36.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.538+0000 7f710a8cb640 1 --2- 172.21.15.119:0/263227951 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fe4036eb0 0x7f6fe4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.538+0000 7f710f336800 1 Processor -- start 2024-04-23T18:29:36.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.538+0000 7f710f336800 1 -- start start 2024-04-23T18:29:36.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.538+0000 7f710a8cb640 1 --2- 172.21.15.119:0/263227951 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fe4036eb0 0x7f6fe4039370 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f70f400bf50 tx=0x7f70f400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.538+0000 7f710f336800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 0x558ef9b0f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.538+0000 7f710f336800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558ef98d9df0 con 0x558ef9b0eca0 2024-04-23T18:29:36.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.538+0000 7f710b0cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 0x558ef9b0f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.539+0000 7f710b0cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 0x558ef9b0f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49040/0 (socket says 172.21.15.119:49040) 2024-04-23T18:29:36.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.539+0000 7f710b0cc640 1 -- 172.21.15.119:0/4183441615 learned_addr learned my addr 172.21.15.119:0/4183441615 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.539+0000 7f710b0cc640 1 -- 172.21.15.119:0/4183441615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef9b0f690 con 0x558ef9b0eca0 2024-04-23T18:29:36.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.539+0000 7f710b0cc640 1 --2- 172.21.15.119:0/4183441615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 0x558ef9b0f0c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f710408d470 tx=0x7f7104071470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe4a90a5a9c818 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.539+0000 7f6feeffd640 1 -- 172.21.15.119:0/4183441615 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71040a9020 con 0x558ef9b0eca0 2024-04-23T18:29:36.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.539+0000 7f6feeffd640 1 -- 172.21.15.119:0/4183441615 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7104066800 con 0x558ef9b0eca0 2024-04-23T18:29:36.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.539+0000 7f6feeffd640 1 -- 172.21.15.119:0/4183441615 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104067b00 con 0x558ef9b0eca0 2024-04-23T18:29:36.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.539+0000 7f710f336800 1 -- 172.21.15.119:0/4183441615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 msgr2=0x558ef9b0f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.539+0000 7f710f336800 1 --2- 172.21.15.119:0/4183441615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 0x558ef9b0f0c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f710408d470 tx=0x7f7104071470 comp rx=0 tx=0).stop 2024-04-23T18:29:36.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.539+0000 7f710f336800 1 -- 172.21.15.119:0/4183441615 shutdown_connections 2024-04-23T18:29:36.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.539+0000 7f710f336800 1 --2- 172.21.15.119:0/4183441615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 0x558ef9b0f0c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.539+0000 7f710f336800 1 -- 172.21.15.119:0/4183441615 >> 172.21.15.119:0/4183441615 conn(0x558ef9b0b000 msgr2=0x558ef9b09060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.540+0000 7f710f336800 1 -- 172.21.15.119:0/4183441615 shutdown_connections 2024-04-23T18:29:36.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.540+0000 7f710f336800 1 -- 172.21.15.119:0/4183441615 wait complete. 2024-04-23T18:29:36.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.540+0000 7f710f336800 1 Processor -- start 2024-04-23T18:29:36.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.540+0000 7f710f336800 1 -- start start 2024-04-23T18:29:36.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.540+0000 7f710f336800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 0x558ef9b15e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.540+0000 7f710f336800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558ef9b0fbc0 con 0x558ef9b0eca0 2024-04-23T18:29:36.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.540+0000 7f710b0cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 0x558ef9b15e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.540+0000 7f710b0cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 0x558ef9b15e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49052/0 (socket says 172.21.15.119:49052) 2024-04-23T18:29:36.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.540+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 learned_addr learned my addr 172.21.15.119:0/1878993443 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.540+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ef9b163d0 con 0x558ef9b0eca0 2024-04-23T18:29:36.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.541+0000 7f710b0cc640 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 0x558ef9b15e90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f710408dfd0 tx=0x7f7104098ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.541+0000 7f6fed7fa640 1 -- 172.21.15.119:0/1878993443 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104071860 con 0x558ef9b0eca0 2024-04-23T18:29:36.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.541+0000 7f6fed7fa640 1 -- 172.21.15.119:0/1878993443 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71040730c0 con 0x558ef9b0eca0 2024-04-23T18:29:36.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.541+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ef9b163d0 con 0x558ef9b0eca0 2024-04-23T18:29:36.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.541+0000 7f6fed7fa640 1 -- 172.21.15.119:0/1878993443 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7104073460 con 0x558ef9b0eca0 2024-04-23T18:29:36.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.541+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ef9b163d0 con 0x558ef9b0eca0 2024-04-23T18:29:36.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.541+0000 7f6fed7fa640 1 -- 172.21.15.119:0/1878993443 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f71040ac020 con 0x558ef9b0eca0 2024-04-23T18:29:36.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.542+0000 7f6fed7fa640 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fd4036e60 0x7f6fd4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.542+0000 7f6fed7fa640 1 -- 172.21.15.119:0/1878993443 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f71040b6070 con 0x558ef9b0eca0 2024-04-23T18:29:36.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.542+0000 7f710a8cb640 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fd4036e60 0x7f6fd4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.542+0000 7f710a8cb640 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fd4036e60 0x7f6fd4039320 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f70f4001b60 tx=0x7f70f4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.542+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.542+0000 7f710f336800 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558ef9b214c0 0x558ef9b23980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.542+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b240d0 con 0x558ef9b214c0 2024-04-23T18:29:36.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.542+0000 7f710b8cd640 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558ef9b214c0 0x558ef9b23980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710b8cd640 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558ef9b214c0 0x558ef9b23980 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef9b214c0 2024-04-23T18:29:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710f336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710f336800 20 realm 2024-04-23T18:29:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b244e0 con 0x558ef9b214c0 2024-04-23T18:29:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef9b214c0 2024-04-23T18:29:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710f336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710f336800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b24db0 con 0x558ef9b214c0 2024-04-23T18:29:36.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef9b214c0 2024-04-23T18:29:36.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710f336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b214c0 2024-04-23T18:29:36.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.543+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef9b214c0 2024-04-23T18:29:36.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.544+0000 7f710f336800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:36.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.544+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.544+0000 7f710f336800 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558ef9b25eb0 0x558ef9b282a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.544+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b288b0 con 0x558ef9b25eb0 2024-04-23T18:29:36.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.544+0000 7f710b0cc640 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558ef9b25eb0 0x558ef9b282a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.544+0000 7f710b0cc640 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558ef9b25eb0 0x558ef9b282a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.544+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.544+0000 7f710f336800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:36.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.544+0000 7f710f336800 20 searching for the correct realm 2024-04-23T18:29:36.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.544+0000 7f710f336800 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558ef9b2a840 0x558ef9b2cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.544+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b2d3d0 con 0x558ef9b2a840 2024-04-23T18:29:36.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.544+0000 7f710a8cb640 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558ef9b2a840 0x558ef9b2cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.545+0000 7f710a8cb640 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558ef9b2a840 0x558ef9b2cd00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.545+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.545+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b2d3d0 con 0x558ef9b25eb0 2024-04-23T18:29:36.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.545+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.545+0000 7f710b0cc640 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f71040b9030 0x7f710409a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.545+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b2d3d0 con 0x7f71040b9030 2024-04-23T18:29:36.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.545+0000 7f710b8cd640 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f71040b9030 0x7f710409a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.546+0000 7f710b8cd640 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f71040b9030 0x7f710409a390 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.546+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc00a4a0 con 0x7f71040b9030 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.546+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b214c0 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.546+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef9b214c0 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.546+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b214c0 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.546+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef9b214c0 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.546+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x7f71040b9030 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.547+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc00a4a0 con 0x7f71040b9030 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.547+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x7f71040b9030 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.547+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f70fc00a4a0 con 0x7f71040b9030 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.547+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b25eb0 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.547+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.547+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b2a840 2024-04-23T18:29:36.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.547+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.547+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b214c0 2024-04-23T18:29:36.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.547+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef9b214c0 2024-04-23T18:29:36.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.547+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x7f71040b9030 2024-04-23T18:29:36.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.548+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc00a4a0 con 0x7f71040b9030 2024-04-23T18:29:36.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.548+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b214c0 2024-04-23T18:29:36.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.548+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef9b214c0 2024-04-23T18:29:36.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.548+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b25eb0 2024-04-23T18:29:36.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.548+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.548+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b2a840 2024-04-23T18:29:36.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.548+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.548+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b2a840 2024-04-23T18:29:36.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.549+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.549+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x7f71040b9030 2024-04-23T18:29:36.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.549+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc00a4a0 con 0x7f71040b9030 2024-04-23T18:29:36.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.549+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b2a840 2024-04-23T18:29:36.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.549+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.549+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b2a840 2024-04-23T18:29:36.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.549+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.549+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b214c0 2024-04-23T18:29:36.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.550+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef9b214c0 2024-04-23T18:29:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.550+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b214c0 2024-04-23T18:29:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.550+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef9b214c0 2024-04-23T18:29:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.550+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x7f71040b9030 2024-04-23T18:29:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.550+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc00a4a0 con 0x7f71040b9030 2024-04-23T18:29:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.550+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b2a840 2024-04-23T18:29:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.550+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.550+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b25eb0 2024-04-23T18:29:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.551+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.551+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b214c0 2024-04-23T18:29:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.551+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc00a4a0 con 0x558ef9b214c0 2024-04-23T18:29:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.551+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x7f71040b9030 2024-04-23T18:29:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.551+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc00a4a0 con 0x7f71040b9030 2024-04-23T18:29:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.551+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b2a840 2024-04-23T18:29:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.551+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.551+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x7f71040b9030 2024-04-23T18:29:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.552+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc00a4a0 con 0x7f71040b9030 2024-04-23T18:29:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.552+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b25eb0 2024-04-23T18:29:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.552+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.552+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b2a840 2024-04-23T18:29:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.552+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.552+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x7f71040b9030 2024-04-23T18:29:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.552+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.552+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b214c0 2024-04-23T18:29:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b25150 con 0x558ef9b25eb0 2024-04-23T18:29:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b29170 con 0x558ef9b214c0 2024-04-23T18:29:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b29170 con 0x558ef9b214c0 2024-04-23T18:29:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.553+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b29170 con 0x7f71040b9030 2024-04-23T18:29:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 20 zone default found 2024-04-23T18:29:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 4 Realm: () 2024-04-23T18:29:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 20 zonegroup default 2024-04-23T18:29:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b29a10 con 0x7f71040b9030 2024-04-23T18:29:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b29a10 con 0x558ef9b2a840 2024-04-23T18:29:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b2f230 con 0x558ef9b2a840 2024-04-23T18:29:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 20 started sync module instance, tier type = 2024-04-23T18:29:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.554+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b2e6d0 con 0x558ef9b25eb0 2024-04-23T18:29:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.555+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.555+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94072562967072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b2f5d0 con 0x558ef9b25eb0 2024-04-23T18:29:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.556+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b2ff90 con 0x558ef9b214c0 2024-04-23T18:29:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.556+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94072562967072] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.557+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.557+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94072562973408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b303b0 con 0x558ef9b214c0 2024-04-23T18:29:36.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.557+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b30d70 con 0x558ef9b2a840 2024-04-23T18:29:36.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.558+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.558+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94072562976960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b31610 con 0x558ef9b2a840 2024-04-23T18:29:36.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.558+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b320b0 con 0x558ef9b25eb0 2024-04-23T18:29:36.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.559+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94072562973408] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.559+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94072562976960] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.559+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.559+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94072562981760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b324a0 con 0x558ef9b25eb0 2024-04-23T18:29:36.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.559+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b32d30 con 0x558ef9b214c0 2024-04-23T18:29:36.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.560+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94072562981760] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.560+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.560+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94072562974464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b32950 con 0x558ef9b214c0 2024-04-23T18:29:36.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.560+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b33760 con 0x7f71040b9030 2024-04-23T18:29:36.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.561+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94072562974464] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.562+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.562+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94072562987664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b32950 con 0x7f71040b9030 2024-04-23T18:29:36.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.562+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b34170 con 0x7f71040b9030 2024-04-23T18:29:36.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.563+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(56 notify.6 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.563+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94072562990272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b34590 con 0x7f71040b9030 2024-04-23T18:29:36.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.563+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b35090 con 0x7f71040b9030 2024-04-23T18:29:36.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.563+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94072562987664] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94072562994048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b35050 con 0x7f71040b9030 2024-04-23T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710f336800 20 add_watcher() i=0 2024-04-23T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710f336800 20 add_watcher() i=1 2024-04-23T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710f336800 20 add_watcher() i=2 2024-04-23T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710f336800 20 add_watcher() i=3 2024-04-23T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710f336800 20 add_watcher() i=4 2024-04-23T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710f336800 20 add_watcher() i=5 2024-04-23T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94072562990272] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710f336800 20 add_watcher() i=6 2024-04-23T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94072562994048] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710f336800 20 add_watcher() i=7 2024-04-23T18:29:36.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710f336800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:36.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.564+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b340e0 con 0x558ef9b214c0 2024-04-23T18:29:36.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.565+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.565+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94072562984096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b340e0 con 0x558ef9b214c0 2024-04-23T18:29:36.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.566+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94072562984096] v32'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.566+0000 7f6fc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:36.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.566+0000 7f710f336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:36.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.566+0000 7f710f336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:36.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.566+0000 7f710f336800 5 note: GC not initialized 2024-04-23T18:29:36.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.566+0000 7f6fc0fe1640 20 reqs_thread_entry: start 2024-04-23T18:29:36.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.566+0000 7f710f336800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:36.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.566+0000 7f710f336800 20 Filter name: none 2024-04-23T18:29:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.566+0000 7f6f3a7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.566+0000 7f710f336800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.566+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.566+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b6b690 con 0x558ef9b214c0 2024-04-23T18:29:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710f336800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710f336800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710f336800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710f336800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710f336800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-04-23T18:29:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b6b1b0 con 0x558ef9b214c0 2024-04-23T18:29:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710f336800 20 rados_obj.operate() r=0 bl.length=193 2024-04-23T18:29:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710f336800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-04-23T18:29:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710f336800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-23T18:29:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710f336800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 : miss 2024-04-23T18:29:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710f336800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.567+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 8.18 8:1e45715a:root::.bucket.meta.testx%3amyfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b6ef50 con 0x558ef9b214c0 2024-04-23T18:29:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.568+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv12 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.568+0000 7f710f336800 20 rados_obj.operate() r=0 bl.length=412 2024-04-23T18:29:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.568+0000 7f710f336800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.568+0000 7f710f336800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.568+0000 7f710f336800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.568+0000 7f710f336800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-23T18:29:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.568+0000 7f710f336800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 2024-04-23T18:29:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.568+0000 7f710f336800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-23T18:29:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.568+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b73570 con 0x558ef9b214c0 2024-04-23T18:29:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.569+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v32'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.569+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b76e80 con 0x558ef9b2a840 2024-04-23T18:29:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.570+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(66 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [create,call,writefull 0~379,setxattr (123)] v32'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.570+0000 7f710f336800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x7 2024-04-23T18:29:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.570+0000 7f710f336800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.570+0000 7f710f336800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.570+0000 7f710f336800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1, ofs0, ns] 2024-04-23T18:29:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.570+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94072563256352 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b76980 con 0x7f71040b9030 2024-04-23T18:29:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.570+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== watch-notify(notify (1) cookie 94072562990272 notify 137438953486 ret 0) ==== 770+0+0 (crc 0 0 0) 0x558ef9b6f340 con 0x7f71040b9030 2024-04-23T18:29:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.571+0000 7f6feeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94072562990272 notifier 4553 bl.length()=728 2024-04-23T18:29:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.571+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(67 notify.6 [notify cookie 94072563256352 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.571+0000 7f6feeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x7 2024-04-23T18:29:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.571+0000 7f6feeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.571+0000 7f6feeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.571+0000 7f6feeffd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6fd0003ea0 con 0x7f71040b9030 2024-04-23T18:29:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.571+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.571+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== watch-notify(notify_complete (2) cookie 94072563256352 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558ef9b6d4b0 con 0x7f71040b9030 2024-04-23T18:29:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.571+0000 7f710f336800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): orig_sources= new_sources= 2024-04-23T18:29:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.571+0000 7f710f336800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): potential sources added=[] removed=[] 2024-04-23T18:29:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.571+0000 7f710f336800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): orig_dests= new_dests= 2024-04-23T18:29:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.571+0000 7f710f336800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): potential dests added=[] removed=[] 2024-04-23T18:29:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.571+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b76960 con 0x558ef9b25eb0 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.573+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(69 foo.buckets [call] v32'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.573+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b76960 con 0x558ef9b25eb0 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.574+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.574+0000 7f710f336800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.574+0000 7f710f336800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.574+0000 7f710f336800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.574+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94072563262640 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b77510 con 0x7f71040b9030 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.574+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== watch-notify(notify (1) cookie 94072562990272 notify 137438953487 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f70fc0515d0 con 0x7f71040b9030 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.574+0000 7f6feeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94072562990272 notifier 4553 bl.length()=314 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.574+0000 7f6feeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.574+0000 7f6feeffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.574+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(71 notify.6 [notify cookie 94072563262640 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.574+0000 7f6feeffd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6fd0003ea0 con 0x7f71040b9030 2024-04-23T18:29:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.575+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.575+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== watch-notify(notify_complete (2) cookie 94072563262640 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f70fc0517a0 con 0x7f71040b9030 2024-04-23T18:29:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.575+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b76960 con 0x558ef9b214c0 2024-04-23T18:29:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.576+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(73 testx/myfoo [call,delete] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.576+0000 7f710f336800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-04-23T18:29:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.576+0000 7f710f336800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-23T18:29:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.576+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94072563262640 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b73c10 con 0x558ef9b214c0 2024-04-23T18:29:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.576+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify (1) cookie 94072562974464 notify 137438953490 ret 0) ==== 197+0+0 (crc 0 0 0) 0x7f70fc0517a0 con 0x558ef9b214c0 2024-04-23T18:29:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.576+0000 7f6fee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94072562974464 notifier 4553 bl.length()=155 2024-04-23T18:29:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.576+0000 7f6fee7fc640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6f400032c0 con 0x558ef9b214c0 2024-04-23T18:29:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.576+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(74 notify.4 [notify cookie 94072563262640 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.576+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.576+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== watch-notify(notify_complete (2) cookie 94072563262640 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f70fc051b70 con 0x558ef9b214c0 2024-04-23T18:29:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.576+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 8.18 8:1e45715a:root::.bucket.meta.testx%3amyfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b76960 con 0x558ef9b214c0 2024-04-23T18:29:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.577+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call,delete] v32'13 uv13 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.577+0000 7f710f336800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 from cache 2024-04-23T18:29:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.577+0000 7f710f336800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1, ofs0, ns] 2024-04-23T18:29:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.577+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 94072563262640 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b768d0 con 0x7f71040b9030 2024-04-23T18:29:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.578+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== watch-notify(notify (1) cookie 94072562987664 notify 137438953488 ret 0) ==== 254+0+0 (crc 0 0 0) 0x7f70fc051b70 con 0x7f71040b9030 2024-04-23T18:29:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.578+0000 7f6feeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94072562987664 notifier 4553 bl.length()=212 2024-04-23T18:29:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.578+0000 7f6feeffd640 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6fd0003ea0 con 0x7f71040b9030 2024-04-23T18:29:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.578+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(77 notify.5 [notify cookie 94072563262640 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.578+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.578+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== watch-notify(notify_complete (2) cookie 94072563262640 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f70fc051da0 con 0x7f71040b9030 2024-04-23T18:29:36.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.579+0000 7f6fc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:36.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.579+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94072562984096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b53f40 con 0x558ef9b214c0 2024-04-23T18:29:36.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.580+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94072562984096] v32'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.580+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94072562967072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b53f40 con 0x558ef9b25eb0 2024-04-23T18:29:36.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.581+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94072562967072] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.593 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.581+0000 7f710f336800 20 remove_watcher() i=0 2024-04-23T18:29:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.581+0000 7f710f336800 2 removed watcher, disabling cache 2024-04-23T18:29:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.581+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94072562973408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b53f40 con 0x558ef9b214c0 2024-04-23T18:29:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.582+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94072562973408] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.582+0000 7f710f336800 20 remove_watcher() i=1 2024-04-23T18:29:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.582+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94072562976960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b53f40 con 0x558ef9b2a840 2024-04-23T18:29:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.583+0000 7f710a8cb640 1 -- 172.21.15.119:0/1878993443 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94072562976960] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f4009050 con 0x558ef9b2a840 2024-04-23T18:29:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.583+0000 7f710f336800 20 remove_watcher() i=2 2024-04-23T18:29:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.583+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94072562981760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b2fae0 con 0x558ef9b25eb0 2024-04-23T18:29:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.584+0000 7f710b0cc640 1 -- 172.21.15.119:0/1878993443 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94072562981760] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71040bf020 con 0x558ef9b25eb0 2024-04-23T18:29:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.584+0000 7f710f336800 20 remove_watcher() i=3 2024-04-23T18:29:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.584+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94072562974464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b31b80 con 0x558ef9b214c0 2024-04-23T18:29:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.585+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94072562974464] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x558ef9b214c0 2024-04-23T18:29:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.585+0000 7f710f336800 20 remove_watcher() i=4 2024-04-23T18:29:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.585+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94072562987664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b31b80 con 0x7f71040b9030 2024-04-23T18:29:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.586+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94072562987664] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.586+0000 7f710f336800 20 remove_watcher() i=5 2024-04-23T18:29:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.586+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94072562990272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b33290 con 0x7f71040b9030 2024-04-23T18:29:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.587+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 31 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94072562990272] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.587+0000 7f710f336800 20 remove_watcher() i=6 2024-04-23T18:29:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.587+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94072562994048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ef9b31b80 con 0x7f71040b9030 2024-04-23T18:29:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.588+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 <== osd.0 v2:172.21.15.62:6800/2641588406 32 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94072562994048] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70fc040040 con 0x7f71040b9030 2024-04-23T18:29:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.588+0000 7f710f336800 20 remove_watcher() i=7 2024-04-23T18:29:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.588+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f71040b9030 msgr2=0x7f710409a390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.588+0000 7f710f336800 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f71040b9030 0x7f710409a390 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.588+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558ef9b214c0 msgr2=0x558ef9b23980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.588+0000 7f710f336800 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558ef9b214c0 0x558ef9b23980 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.588+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558ef9b25eb0 msgr2=0x558ef9b282a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.588+0000 7f710f336800 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558ef9b25eb0 0x558ef9b282a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.588+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558ef9b2a840 msgr2=0x558ef9b2cd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.588+0000 7f710f336800 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558ef9b2a840 0x558ef9b2cd00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fd4036e60 msgr2=0x7f6fd4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fd4036e60 0x7f6fd4039320 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f70f4001b60 tx=0x7f70f4010000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 msgr2=0x558ef9b15e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710b8cd640 1 -- 172.21.15.119:0/1878993443 reap_dead start 2024-04-23T18:29:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 0x558ef9b15e90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f710408dfd0 tx=0x7f7104098ee0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 shutdown_connections 2024-04-23T18:29:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 --2- 172.21.15.119:0/1878993443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b0eca0 0x558ef9b15e90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 >> 172.21.15.119:0/1878993443 conn(0x558ef9b0b000 msgr2=0x558ef9b08660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 shutdown_connections 2024-04-23T18:29:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/1878993443 wait complete. 2024-04-23T18:29:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/263227951 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fe4036eb0 msgr2=0x7f6fe4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 --2- 172.21.15.119:0/263227951 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fe4036eb0 0x7f6fe4039370 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f70f400bf50 tx=0x7f70f400f000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/263227951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b01bb0 msgr2=0x558ef9b01fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 --2- 172.21.15.119:0/263227951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b01bb0 0x558ef9b01fd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f710405efd0 tx=0x7f7104066440 comp rx=0 tx=0).stop 2024-04-23T18:29:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/263227951 shutdown_connections 2024-04-23T18:29:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 --2- 172.21.15.119:0/263227951 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6fe4036eb0 0x7f6fe4039370 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 --2- 172.21.15.119:0/263227951 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef9b01bb0 0x558ef9b01fd0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/263227951 >> 172.21.15.119:0/263227951 conn(0x558ef9af5c50 msgr2=0x558ef9af6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/263227951 shutdown_connections 2024-04-23T18:29:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/263227951 wait complete. 2024-04-23T18:29:36.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558ef9af0b80 msgr2=0x558ef9af2ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558ef9af0b80 0x558ef9af2ff0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558ef99e80e0 msgr2=0x558ef9aea310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.589+0000 7f710f336800 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558ef99e80e0 0x558ef9aea310 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.590+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558ef9aecad0 msgr2=0x558ef9aeef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.590+0000 7f710f336800 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558ef9aecad0 0x558ef9aeef40 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.590+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6ff0036eb0 msgr2=0x7f6ff0039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.590+0000 7f710f336800 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6ff0036eb0 0x7f6ff0039370 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f70f4000f60 tx=0x7f70f40012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.590+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 msgr2=0x558ef9add550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.590+0000 7f710f336800 1 --2- 172.21.15.119:0/1777472514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558ef99e6e80 0x558ef9add550 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7104055040 tx=0x7f7104002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.590+0000 7f710b8cd640 1 -- 172.21.15.119:0/1777472514 reap_dead start 2024-04-23T18:29:36.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.590+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 shutdown_connections 2024-04-23T18:29:36.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.590+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 >> 172.21.15.119:0/1777472514 conn(0x558ef99e2440 msgr2=0x558ef9ad2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.590+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 shutdown_connections 2024-04-23T18:29:36.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.590+0000 7f710f336800 1 -- 172.21.15.119:0/1777472514 wait complete. 2024-04-23T18:29:36.599 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-23T18:29:36.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-23T18:29:36.599 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-04-23T18:29:36.644 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:36.644 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:36.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.652+0000 7f3b4a928800 1 Processor -- start 2024-04-23T18:29:36.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.652+0000 7f3b4a928800 1 -- start start 2024-04-23T18:29:36.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.652+0000 7f3b4a928800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558f998e7a80 0x558f998e9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.652+0000 7f3b4a928800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558f99797560 con 0x558f998ea3b0 2024-04-23T18:29:36.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.652+0000 7f3b4a928800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x558f99788e20 con 0x558f998e7a80 2024-04-23T18:29:36.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.652+0000 7f3b465a7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558f998e7a80 0x558f998e9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.653+0000 7f3b3dda6640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x558f998ea3b0 0x558f998ec7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:47486/0 (socket says 172.21.15.119:47486) 2024-04-23T18:29:36.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.653+0000 7f3b3dda6640 1 -- 172.21.15.119:0/3634380438 learned_addr learned my addr 172.21.15.119:0/3634380438 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:36.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.653+0000 7f3b465a7640 1 -- 172.21.15.119:0/3634380438 >> v1:172.21.15.62:6789/0 conn(0x558f998ea3b0 legacy=0x558f998ec7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.653+0000 7f3b45da6640 1 -- 172.21.15.119:0/3634380438 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665279216 0 0) 0x558f99797560 con 0x558f998ea3b0 2024-04-23T18:29:36.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.653+0000 7f3b465a7640 1 -- 172.21.15.119:0/3634380438 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f99796e60 con 0x558f998e7a80 2024-04-23T18:29:36.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.655+0000 7f3b465a7640 1 --2- 172.21.15.119:0/3634380438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f998e9e70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800a470 tx=0x7f3b3801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1c6edeacf58e8b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.655+0000 7f3b45da6640 1 -- 172.21.15.119:0/3634380438 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b38057070 con 0x558f998e7a80 2024-04-23T18:29:36.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.655+0000 7f3b45da6640 1 -- 172.21.15.119:0/3634380438 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b38052570 con 0x558f998e7a80 2024-04-23T18:29:36.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.655+0000 7f3b45da6640 1 -- 172.21.15.119:0/3634380438 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b38052870 con 0x558f998e7a80 2024-04-23T18:29:36.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.655+0000 7f3b4a928800 1 -- 172.21.15.119:0/3634380438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 msgr2=0x558f998e9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.655+0000 7f3b4a928800 1 --2- 172.21.15.119:0/3634380438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f998e9e70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800a470 tx=0x7f3b3801ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:36.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.655+0000 7f3b4a928800 1 -- 172.21.15.119:0/3634380438 shutdown_connections 2024-04-23T18:29:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.655+0000 7f3b4a928800 1 --2- 172.21.15.119:0/3634380438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f998e9e70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.655+0000 7f3b4a928800 1 -- 172.21.15.119:0/3634380438 >> 172.21.15.119:0/3634380438 conn(0x558f998e1430 msgr2=0x558f998e3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.655+0000 7f3b4a928800 1 -- 172.21.15.119:0/3634380438 shutdown_connections 2024-04-23T18:29:36.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.655+0000 7f3b4a928800 1 -- 172.21.15.119:0/3634380438 wait complete. 2024-04-23T18:29:36.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.667+0000 7f3b4a928800 1 Processor -- start 2024-04-23T18:29:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.667+0000 7f3b4a928800 1 -- start start 2024-04-23T18:29:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.667+0000 7f3b4a928800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f998e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.667+0000 7f3b4a928800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558f998325d0 con 0x558f998e7a80 2024-04-23T18:29:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.667+0000 7f3b465a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f998e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.667+0000 7f3b465a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f998e73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49070/0 (socket says 172.21.15.119:49070) 2024-04-23T18:29:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.667+0000 7f3b465a7640 1 -- 172.21.15.119:0/1599082529 learned_addr learned my addr 172.21.15.119:0/1599082529 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.668+0000 7f3b465a7640 1 -- 172.21.15.119:0/1599082529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f997a8860 con 0x558f998e7a80 2024-04-23T18:29:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.668+0000 7f3b465a7640 1 --2- 172.21.15.119:0/1599082529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f998e73c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3b38055040 tx=0x7f3b3804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66419cd42239826a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.668+0000 7f3a34608640 1 -- 172.21.15.119:0/1599082529 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b38063070 con 0x558f998e7a80 2024-04-23T18:29:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.668+0000 7f3a34608640 1 -- 172.21.15.119:0/1599082529 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b38058040 con 0x558f998e7a80 2024-04-23T18:29:36.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.668+0000 7f3a34608640 1 -- 172.21.15.119:0/1599082529 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b38057070 con 0x558f998e7a80 2024-04-23T18:29:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.669+0000 7f3b4a928800 1 -- 172.21.15.119:0/1599082529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 msgr2=0x558f998e73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.669+0000 7f3b4a928800 1 --2- 172.21.15.119:0/1599082529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f998e73c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3b38055040 tx=0x7f3b3804c000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.669+0000 7f3b4a928800 1 -- 172.21.15.119:0/1599082529 shutdown_connections 2024-04-23T18:29:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.669+0000 7f3b4a928800 1 --2- 172.21.15.119:0/1599082529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f998e73c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.669+0000 7f3b4a928800 1 -- 172.21.15.119:0/1599082529 >> 172.21.15.119:0/1599082529 conn(0x558f998e1430 msgr2=0x558f999d3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.669+0000 7f3b4a928800 1 -- 172.21.15.119:0/1599082529 shutdown_connections 2024-04-23T18:29:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.669+0000 7f3b4a928800 1 -- 172.21.15.119:0/1599082529 wait complete. 2024-04-23T18:29:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.669+0000 7f3b4a928800 1 Processor -- start 2024-04-23T18:29:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.669+0000 7f3b4a928800 1 -- start start 2024-04-23T18:29:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.669+0000 7f3b4a928800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f999e1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.669+0000 7f3b4a928800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558f998f01d0 con 0x558f998e7a80 2024-04-23T18:29:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.669+0000 7f3b465a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f999e1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.670+0000 7f3b465a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f999e1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49080/0 (socket says 172.21.15.119:49080) 2024-04-23T18:29:36.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.670+0000 7f3b465a7640 1 -- 172.21.15.119:0/2164366385 learned_addr learned my addr 172.21.15.119:0/2164366385 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.670+0000 7f3b465a7640 1 -- 172.21.15.119:0/2164366385 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f997a6eb0 con 0x558f998e7a80 2024-04-23T18:29:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.670+0000 7f3b465a7640 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f999e1950 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3b38005870 tx=0x7f3b38002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.670+0000 7f3a32e05640 1 -- 172.21.15.119:0/2164366385 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b38063030 con 0x558f998e7a80 2024-04-23T18:29:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.670+0000 7f3a32e05640 1 -- 172.21.15.119:0/2164366385 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b38052cb0 con 0x558f998e7a80 2024-04-23T18:29:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.670+0000 7f3a32e05640 1 -- 172.21.15.119:0/2164366385 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b3805e480 con 0x558f998e7a80 2024-04-23T18:29:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.670+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f999e1e90 con 0x558f998e7a80 2024-04-23T18:29:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.670+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f999e23b0 con 0x558f998e7a80 2024-04-23T18:29:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.671+0000 7f3a32e05640 1 -- 172.21.15.119:0/2164366385 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3b3805e620 con 0x558f998e7a80 2024-04-23T18:29:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.671+0000 7f3a32e05640 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a2c036e60 0x7f3a2c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.671+0000 7f3a32e05640 1 -- 172.21.15.119:0/2164366385 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3b38064070 con 0x558f998e7a80 2024-04-23T18:29:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.671+0000 7f3b3dda6640 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a2c036e60 0x7f3a2c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.671+0000 7f3b4a928800 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f998ea3b0 0x558f999e89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.671+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f999e8f00 con 0x558f998ea3b0 2024-04-23T18:29:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.671+0000 7f3b46da8640 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f998ea3b0 0x558f999e89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.672+0000 7f3b3dda6640 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a2c036e60 0x7f3a2c039320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b30000c00 tx=0x7f3b300013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.672+0000 7f3b46da8640 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f998ea3b0 0x558f999e89c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.672+0000 7f3b46da8640 1 -- 172.21.15.119:0/2164366385 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f998ea3b0 2024-04-23T18:29:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.672+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f999e5f50 con 0x558f998ea3b0 2024-04-23T18:29:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.672+0000 7f3b46da8640 1 -- 172.21.15.119:0/2164366385 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f998ea3b0 2024-04-23T18:29:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.672+0000 7f3b4a928800 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f999eb210 0x558f999ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.672+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f999edc60 con 0x558f999eb210 2024-04-23T18:29:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.672+0000 7f3b465a7640 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f999eb210 0x558f999ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.673+0000 7f3b465a7640 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f999eb210 0x558f999ed600 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.673+0000 7f3b465a7640 1 -- 172.21.15.119:0/2164366385 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3b38070020 con 0x558f999eb210 2024-04-23T18:29:36.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.673+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f999ea1c0 con 0x558f998ea3b0 2024-04-23T18:29:36.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.673+0000 7f3b46da8640 1 -- 172.21.15.119:0/2164366385 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f998ea3b0 2024-04-23T18:29:36.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.673+0000 7f3b4a928800 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558f999ef110 0x558f999f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.673+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f999f1cc0 con 0x558f999ef110 2024-04-23T18:29:36.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.673+0000 7f3b3dda6640 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558f999ef110 0x558f999f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.674+0000 7f3b3dda6640 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558f999ef110 0x558f999f1560 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.674+0000 7f3b3dda6640 1 -- 172.21.15.119:0/2164366385 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3b3000f670 con 0x558f999ef110 2024-04-23T18:29:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.674+0000 7f3b4a928800 1 Processor -- start 2024-04-23T18:29:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.675+0000 7f3b4a928800 1 -- start start 2024-04-23T18:29:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.675+0000 7f3b4a928800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a00120 0x558f99a00540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.675+0000 7f3b4a928800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558f997d8df0 con 0x558f99a00120 2024-04-23T18:29:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.675+0000 7f3b465a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a00120 0x558f99a00540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.675+0000 7f3b465a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a00120 0x558f99a00540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49082/0 (socket says 172.21.15.119:49082) 2024-04-23T18:29:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.675+0000 7f3b465a7640 1 -- 172.21.15.119:0/230961493 learned_addr learned my addr 172.21.15.119:0/230961493 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.675+0000 7f3b465a7640 1 -- 172.21.15.119:0/230961493 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f99a00a80 con 0x558f99a00120 2024-04-23T18:29:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.675+0000 7f3b465a7640 1 --2- 172.21.15.119:0/230961493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a00120 0x558f99a00540 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3b3808d2c0 tx=0x7f3b38069f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.675+0000 7f3a2bfff640 1 -- 172.21.15.119:0/230961493 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b3805c700 con 0x558f99a00120 2024-04-23T18:29:36.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.675+0000 7f3a2bfff640 1 -- 172.21.15.119:0/230961493 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3805c8a0 con 0x558f99a00120 2024-04-23T18:29:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.675+0000 7f3b4a928800 1 -- 172.21.15.119:0/230961493 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f99a014f0 con 0x558f99a00120 2024-04-23T18:29:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.675+0000 7f3a2bfff640 1 -- 172.21.15.119:0/230961493 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b380725b0 con 0x558f99a00120 2024-04-23T18:29:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.675+0000 7f3b4a928800 1 -- 172.21.15.119:0/230961493 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f99a014f0 con 0x558f99a00120 2024-04-23T18:29:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.676+0000 7f3a2bfff640 1 -- 172.21.15.119:0/230961493 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3b38097020 con 0x558f99a00120 2024-04-23T18:29:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.676+0000 7f3a2bfff640 1 --2- 172.21.15.119:0/230961493 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a20036e60 0x7f3a20039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.676+0000 7f3a2bfff640 1 -- 172.21.15.119:0/230961493 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3b3808a030 con 0x558f99a00120 2024-04-23T18:29:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.676+0000 7f3b3dda6640 1 --2- 172.21.15.119:0/230961493 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a20036e60 0x7f3a20039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.677+0000 7f3b4a928800 1 Processor -- start 2024-04-23T18:29:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.677+0000 7f3b4a928800 1 -- start start 2024-04-23T18:29:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.677+0000 7f3b3dda6640 1 --2- 172.21.15.119:0/230961493 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a20036e60 0x7f3a20039320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x558f999e5eb0 tx=0x7f3b30006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.677+0000 7f3b4a928800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 0x558f99a0d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.677+0000 7f3b4a928800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558f998e5980 con 0x558f99a0d0c0 2024-04-23T18:29:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.677+0000 7f3b465a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 0x558f99a0d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.677+0000 7f3b465a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 0x558f99a0d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49096/0 (socket says 172.21.15.119:49096) 2024-04-23T18:29:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.677+0000 7f3b465a7640 1 -- 172.21.15.119:0/3242789914 learned_addr learned my addr 172.21.15.119:0/3242789914 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.677+0000 7f3b465a7640 1 -- 172.21.15.119:0/3242789914 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f99a0dab0 con 0x558f99a0d0c0 2024-04-23T18:29:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.677+0000 7f3b465a7640 1 --2- 172.21.15.119:0/3242789914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 0x558f99a0d4e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3b38075fd0 tx=0x7f3b380811a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8e6dd597625dfc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.677+0000 7f3a29ffb640 1 -- 172.21.15.119:0/3242789914 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b3805d3e0 con 0x558f99a0d0c0 2024-04-23T18:29:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.677+0000 7f3a29ffb640 1 -- 172.21.15.119:0/3242789914 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b380a8070 con 0x558f99a0d0c0 2024-04-23T18:29:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.677+0000 7f3a29ffb640 1 -- 172.21.15.119:0/3242789914 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b3804b100 con 0x558f99a0d0c0 2024-04-23T18:29:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.678+0000 7f3b4a928800 1 -- 172.21.15.119:0/3242789914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 msgr2=0x558f99a0d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.678+0000 7f3b4a928800 1 --2- 172.21.15.119:0/3242789914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 0x558f99a0d4e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3b38075fd0 tx=0x7f3b380811a0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.678+0000 7f3b4a928800 1 -- 172.21.15.119:0/3242789914 shutdown_connections 2024-04-23T18:29:36.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.678+0000 7f3b4a928800 1 --2- 172.21.15.119:0/3242789914 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 0x558f99a0d4e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.678+0000 7f3b4a928800 1 -- 172.21.15.119:0/3242789914 >> 172.21.15.119:0/3242789914 conn(0x558f99a09390 msgr2=0x558f99a073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.678+0000 7f3b4a928800 1 -- 172.21.15.119:0/3242789914 shutdown_connections 2024-04-23T18:29:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.678+0000 7f3b4a928800 1 -- 172.21.15.119:0/3242789914 wait complete. 2024-04-23T18:29:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.678+0000 7f3b4a928800 1 Processor -- start 2024-04-23T18:29:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.678+0000 7f3b4a928800 1 -- start start 2024-04-23T18:29:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.678+0000 7f3b4a928800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 0x558f99a14470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.678+0000 7f3b4a928800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558f99a0e110 con 0x558f99a0d0c0 2024-04-23T18:29:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.679+0000 7f3b465a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 0x558f99a14470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.679+0000 7f3b465a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 0x558f99a14470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49102/0 (socket says 172.21.15.119:49102) 2024-04-23T18:29:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.679+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 learned_addr learned my addr 172.21.15.119:0/1576105924 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.679+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f99a149b0 con 0x558f99a0d0c0 2024-04-23T18:29:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.679+0000 7f3b465a7640 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 0x558f99a14470 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3b3807f8a0 tx=0x7f3b38071ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.679+0000 7f3a17fff640 1 -- 172.21.15.119:0/1576105924 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b380bb070 con 0x558f99a0d0c0 2024-04-23T18:29:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.679+0000 7f3a17fff640 1 -- 172.21.15.119:0/1576105924 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b38082db0 con 0x558f99a0d0c0 2024-04-23T18:29:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.679+0000 7f3a17fff640 1 -- 172.21.15.119:0/1576105924 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b3805d8b0 con 0x558f99a0d0c0 2024-04-23T18:29:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.679+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558f99a149b0 con 0x558f99a0d0c0 2024-04-23T18:29:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.679+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f99a149b0 con 0x558f99a0d0c0 2024-04-23T18:29:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.680+0000 7f3a17fff640 1 -- 172.21.15.119:0/1576105924 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3b380be070 con 0x558f99a0d0c0 2024-04-23T18:29:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.680+0000 7f3a17fff640 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a10036e60 0x7f3a10039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.680+0000 7f3a17fff640 1 -- 172.21.15.119:0/1576105924 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3b380c1c80 con 0x558f99a0d0c0 2024-04-23T18:29:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.680+0000 7f3b3dda6640 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a10036e60 0x7f3a10039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.681+0000 7f3b3dda6640 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a10036e60 0x7f3a10039320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000ffd0 tx=0x7f3b30023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.681+0000 7f3b4a928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.681+0000 7f3b4a928800 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f99a1fa80 0x558f99a21f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.681+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a22690 con 0x558f99a1fa80 2024-04-23T18:29:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.681+0000 7f3b46da8640 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f99a1fa80 0x558f99a21f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.681+0000 7f3b46da8640 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f99a1fa80 0x558f99a21f40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.681+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f99a1fa80 2024-04-23T18:29:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.681+0000 7f3b4a928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.681+0000 7f3b4a928800 20 realm 2024-04-23T18:29:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.681+0000 7f3b4a928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.681+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a22aa0 con 0x558f99a1fa80 2024-04-23T18:29:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f99a1fa80 2024-04-23T18:29:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b4a928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b4a928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:36.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b4a928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23370 con 0x558f99a1fa80 2024-04-23T18:29:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f99a1fa80 2024-04-23T18:29:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b4a928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b4a928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a1fa80 2024-04-23T18:29:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f99a1fa80 2024-04-23T18:29:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b4a928800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b4a928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b4a928800 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f99a24470 0x558f99a26860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a26e70 con 0x558f99a24470 2024-04-23T18:29:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b465a7640 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f99a24470 0x558f99a26860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.682+0000 7f3b465a7640 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f99a24470 0x558f99a26860 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.683+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.683+0000 7f3b4a928800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.683+0000 7f3b4a928800 20 searching for the correct realm 2024-04-23T18:29:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.683+0000 7f3b4a928800 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558f99a28e50 0x558f99a2b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.683+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a2b9e0 con 0x558f99a28e50 2024-04-23T18:29:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.683+0000 7f3b3dda6640 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558f99a28e50 0x558f99a2b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.683+0000 7f3b3dda6640 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558f99a28e50 0x558f99a2b310 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.683+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.684+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a2b9e0 con 0x558f99a24470 2024-04-23T18:29:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.684+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.684+0000 7f3b465a7640 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3b380c0060 0x7f3b380ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.684+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a2b9e0 con 0x7f3b380c0060 2024-04-23T18:29:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.684+0000 7f3b46da8640 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3b380c0060 0x7f3b380ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.684+0000 7f3b46da8640 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3b380c0060 0x7f3b380ca7a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.685+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4000a4a0 con 0x7f3b380c0060 2024-04-23T18:29:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.685+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a1fa80 2024-04-23T18:29:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.685+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f99a1fa80 2024-04-23T18:29:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.685+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a1fa80 2024-04-23T18:29:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.685+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f99a1fa80 2024-04-23T18:29:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.685+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x7f3b380c0060 2024-04-23T18:29:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.685+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4000a4a0 con 0x7f3b380c0060 2024-04-23T18:29:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.685+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x7f3b380c0060 2024-04-23T18:29:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.686+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3b4000a4a0 con 0x7f3b380c0060 2024-04-23T18:29:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.686+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a24470 2024-04-23T18:29:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.686+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.686+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a28e50 2024-04-23T18:29:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.686+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.686+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a1fa80 2024-04-23T18:29:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.686+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f99a1fa80 2024-04-23T18:29:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.686+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x7f3b380c0060 2024-04-23T18:29:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.687+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4000a4a0 con 0x7f3b380c0060 2024-04-23T18:29:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.687+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a1fa80 2024-04-23T18:29:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.687+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f99a1fa80 2024-04-23T18:29:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.687+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a24470 2024-04-23T18:29:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.687+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.687+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a28e50 2024-04-23T18:29:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.687+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.687+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a28e50 2024-04-23T18:29:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.687+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.687+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x7f3b380c0060 2024-04-23T18:29:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.688+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4000a4a0 con 0x7f3b380c0060 2024-04-23T18:29:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.688+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a28e50 2024-04-23T18:29:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.688+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.688+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a28e50 2024-04-23T18:29:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.688+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.688+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a1fa80 2024-04-23T18:29:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.689+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f99a1fa80 2024-04-23T18:29:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.689+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a1fa80 2024-04-23T18:29:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.689+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f99a1fa80 2024-04-23T18:29:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.689+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x7f3b380c0060 2024-04-23T18:29:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.689+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4000a4a0 con 0x7f3b380c0060 2024-04-23T18:29:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.689+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a28e50 2024-04-23T18:29:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.689+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.689+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a24470 2024-04-23T18:29:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.690+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.690+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a1fa80 2024-04-23T18:29:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.690+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4000a4a0 con 0x558f99a1fa80 2024-04-23T18:29:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.690+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x7f3b380c0060 2024-04-23T18:29:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.690+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4000a4a0 con 0x7f3b380c0060 2024-04-23T18:29:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.690+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a28e50 2024-04-23T18:29:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.690+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.690+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x7f3b380c0060 2024-04-23T18:29:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.691+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b4000a4a0 con 0x7f3b380c0060 2024-04-23T18:29:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.691+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a24470 2024-04-23T18:29:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.691+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.691+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a28e50 2024-04-23T18:29:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.691+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.691+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x7f3b380c0060 2024-04-23T18:29:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.692+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.692+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a1fa80 2024-04-23T18:29:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.692+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.692+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558f99a23710 con 0x558f99a24470 2024-04-23T18:29:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.692+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.692+0000 7f3b4a928800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.692+0000 7f3b4a928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.692+0000 7f3b4a928800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.692+0000 7f3b4a928800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.692+0000 7f3b4a928800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.692+0000 7f3b4a928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.692+0000 7f3b4a928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.692+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a27280 con 0x558f99a1fa80 2024-04-23T18:29:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a27280 con 0x558f99a1fa80 2024-04-23T18:29:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a27280 con 0x7f3b380c0060 2024-04-23T18:29:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 20 zone default found 2024-04-23T18:29:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 4 Realm: () 2024-04-23T18:29:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:36.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 20 zonegroup default 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a27bb0 con 0x7f3b380c0060 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.693+0000 7f3b4a928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.694+0000 7f3b4a928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.694+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a27bb0 con 0x558f99a28e50 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.694+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.694+0000 7f3b4a928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.694+0000 7f3b4a928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.694+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a2d840 con 0x558f99a28e50 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.694+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.694+0000 7f3b4a928800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.694+0000 7f3b4a928800 20 started sync module instance, tier type = 2024-04-23T18:29:36.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.694+0000 7f3b4a928800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.694+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a2cce0 con 0x558f99a24470 2024-04-23T18:29:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.695+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.695+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94075246268672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a2e090 con 0x558f99a24470 2024-04-23T18:29:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.695+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a2e8e0 con 0x558f99a1fa80 2024-04-23T18:29:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.696+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94075246268672] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.696+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.696+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94075246271456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a2e920 con 0x558f99a1fa80 2024-04-23T18:29:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.696+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a2f430 con 0x558f99a28e50 2024-04-23T18:29:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.698+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.698+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94075246276320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a2fcd0 con 0x558f99a28e50 2024-04-23T18:29:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.698+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a307d0 con 0x558f99a24470 2024-04-23T18:29:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.698+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94075246271456] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.699+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.699+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94075246276320] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.699+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94075246273584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a31070 con 0x558f99a24470 2024-04-23T18:29:36.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.699+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a2f820 con 0x558f99a1fa80 2024-04-23T18:29:36.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.700+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.700+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94075246286208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a31e50 con 0x558f99a1fa80 2024-04-23T18:29:36.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.700+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a32700 con 0x7f3b380c0060 2024-04-23T18:29:36.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.700+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94075246273584] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.701+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.701+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94075246283712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a32300 con 0x7f3b380c0060 2024-04-23T18:29:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.701+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a33140 con 0x7f3b380c0060 2024-04-23T18:29:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.701+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94075246286208] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.702+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(56 notify.6 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.702+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94075246287264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a33140 con 0x7f3b380c0060 2024-04-23T18:29:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.702+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a33b40 con 0x7f3b380c0060 2024-04-23T18:29:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.702+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94075246283712] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.703+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94075246287264] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.703+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.703+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94075246288416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a32c90 con 0x7f3b380c0060 2024-04-23T18:29:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.703+0000 7f3b4a928800 20 add_watcher() i=0 2024-04-23T18:29:36.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.703+0000 7f3b4a928800 20 add_watcher() i=1 2024-04-23T18:29:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.703+0000 7f3b4a928800 20 add_watcher() i=2 2024-04-23T18:29:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.703+0000 7f3b4a928800 20 add_watcher() i=3 2024-04-23T18:29:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.703+0000 7f3b4a928800 20 add_watcher() i=4 2024-04-23T18:29:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.703+0000 7f3b4a928800 20 add_watcher() i=5 2024-04-23T18:29:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.703+0000 7f3b4a928800 20 add_watcher() i=6 2024-04-23T18:29:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.704+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94075246288416] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.704+0000 7f3b4a928800 20 add_watcher() i=7 2024-04-23T18:29:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.704+0000 7f3b4a928800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.704+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a36c40 con 0x558f99a1fa80 2024-04-23T18:29:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.704+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.704+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94075246294608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a340c0 con 0x558f99a1fa80 2024-04-23T18:29:36.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.705+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94075246294608] v32'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.705+0000 7f39fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.705+0000 7f3b4a928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.705+0000 7f3b4a928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.705+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3f5f0 con 0x558f99a1fa80 2024-04-23T18:29:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.706+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.706+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3fc40 con 0x7f3b380c0060 2024-04-23T18:29:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.708+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.708+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a400a0 con 0x558f99a28e50 2024-04-23T18:29:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.709+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.709+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a40ac0 con 0x558f99a1fa80 2024-04-23T18:29:36.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.709+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'136 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.710+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3b2c0 con 0x558f99a24470 2024-04-23T18:29:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.711+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.711+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3b2c0 con 0x558f99a28e50 2024-04-23T18:29:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.712+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.712+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a41620 con 0x558f99a1fa80 2024-04-23T18:29:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.713+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.713+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a41ad0 con 0x7f3b380c0060 2024-04-23T18:29:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.714+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.714+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a41ad0 con 0x558f99a24470 2024-04-23T18:29:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.715+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.715+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a41ad0 con 0x558f99a28e50 2024-04-23T18:29:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.716+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.716+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3dff0 con 0x558f99a24470 2024-04-23T18:29:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.717+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.717+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3e0a0 con 0x7f3b380c0060 2024-04-23T18:29:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.718+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.718+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3e0a0 con 0x558f99a24470 2024-04-23T18:29:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.719+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.719+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a41620 con 0x7f3b380c0060 2024-04-23T18:29:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.721+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.721+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a416b0 con 0x558f99a1fa80 2024-04-23T18:29:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.722+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'137 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.722+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3e950 con 0x558f99a28e50 2024-04-23T18:29:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.723+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.723+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3e9e0 con 0x558f99a24470 2024-04-23T18:29:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.724+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.724+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3e9e0 con 0x558f99a28e50 2024-04-23T18:29:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.725+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.725+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3ea70 con 0x558f99a1fa80 2024-04-23T18:29:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.726+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.726+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3ea70 con 0x558f99a1fa80 2024-04-23T18:29:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.727+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'138 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.727+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3ea70 con 0x558f99a28e50 2024-04-23T18:29:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.728+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.728+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3ea70 con 0x558f99a24470 2024-04-23T18:29:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.729+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.729+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3ea70 con 0x558f99a28e50 2024-04-23T18:29:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.730+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.730+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3ea70 con 0x558f99a28e50 2024-04-23T18:29:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.731+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.731+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3ea70 con 0x558f99a28e50 2024-04-23T18:29:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.732+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.732+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3ea70 con 0x558f99a28e50 2024-04-23T18:29:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.733+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.733+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3ea70 con 0x7f3b380c0060 2024-04-23T18:29:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.734+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.734+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3e9e0 con 0x558f99a28e50 2024-04-23T18:29:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.735+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.735+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3e9e0 con 0x7f3b380c0060 2024-04-23T18:29:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.737+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.737+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3e9e0 con 0x558f99a28e50 2024-04-23T18:29:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.738+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.738+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3e9e0 con 0x7f3b380c0060 2024-04-23T18:29:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.739+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.739+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a3e9e0 con 0x558f99a24470 2024-04-23T18:29:36.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.740+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.741+0000 7f39777fe640 20 reqs_thread_entry: start 2024-04-23T18:29:36.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.741+0000 7f3b4a928800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:36.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.741+0000 7f3b4a928800 20 Filter name: none 2024-04-23T18:29:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.741+0000 7f39757fa640 20 reqs_thread_entry: start 2024-04-23T18:29:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.741+0000 7f3b4a928800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-23T18:29:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.741+0000 7f3b4a928800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.741+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a6d750 con 0x7f3b380c0060 2024-04-23T18:29:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.741+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.741+0000 7f3b4a928800 20 rados_obj.operate() r=0 bl.length=419 2024-04-23T18:29:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.741+0000 7f3b4a928800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-23T18:29:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.741+0000 7f3b4a928800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-23T18:29:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.741+0000 7f3b4a928800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.741+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a6d130 con 0x558f99a1fa80 2024-04-23T18:29:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.742+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.742+0000 7f3b4a928800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-23T18:29:36.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.742+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a6d130 con 0x7f3b380c0060 2024-04-23T18:29:36.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.743+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.743+0000 7f3b4a928800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-23T18:29:36.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.743+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94075246537936 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a705b0 con 0x558f99a28e50 2024-04-23T18:29:36.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.743+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== watch-notify(notify (1) cookie 94075246276320 notify 137438953477 ret 0) ==== 212+0+0 (crc 0 0 0) 0x558f99a3e620 con 0x558f99a28e50 2024-04-23T18:29:36.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.743+0000 7f3a29ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94075246276320 notifier 4560 bl.length()=170 2024-04-23T18:29:36.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.743+0000 7f3a29ffb640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3a0c003d60 con 0x558f99a28e50 2024-04-23T18:29:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.743+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(97 notify.2 [notify cookie 94075246537936 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.743+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.743+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 29 ==== watch-notify(notify_complete (2) cookie 94075246537936 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558f99a3ac40 con 0x558f99a28e50 2024-04-23T18:29:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.743+0000 7f3b4a928800 10 removing email index: 2024-04-23T18:29:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.743+0000 7f3b4a928800 10 removing user buckets index 2024-04-23T18:29:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.743+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a6e170 con 0x558f99a1fa80 2024-04-23T18:29:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.744+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v32'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.744+0000 7f3b4a928800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-04-23T18:29:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.744+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94075246537936 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a705b0 con 0x558f99a1fa80 2024-04-23T18:29:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.745+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== watch-notify(notify (1) cookie 94075246286208 notify 137438953491 ret 0) ==== 217+0+0 (crc 0 0 0) 0x558f99a3b8f0 con 0x558f99a1fa80 2024-04-23T18:29:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.745+0000 7f3a297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94075246286208 notifier 4560 bl.length()=175 2024-04-23T18:29:36.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.745+0000 7f3a297fa640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f397c0032c0 con 0x558f99a1fa80 2024-04-23T18:29:36.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.745+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(100 notify.4 [notify cookie 94075246537936 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.745+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.745+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== watch-notify(notify_complete (2) cookie 94075246537936 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558f99a3f180 con 0x558f99a1fa80 2024-04-23T18:29:36.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.745+0000 7f3b4a928800 10 removing user index: testx$tenanteduser 2024-04-23T18:29:36.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.745+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a721b0 con 0x7f3b380c0060 2024-04-23T18:29:36.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.746+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v32'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.746+0000 7f3b4a928800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-04-23T18:29:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.746+0000 7f3b4a928800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-23T18:29:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.746+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94075246526080 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558f99a6c750 con 0x558f99a24470 2024-04-23T18:29:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.746+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== watch-notify(notify (1) cookie 94075246273584 notify 137438953485 ret 0) ==== 209+0+0 (crc 0 0 0) 0x558f99a42790 con 0x558f99a24470 2024-04-23T18:29:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.746+0000 7f3a29ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94075246273584 notifier 4560 bl.length()=167 2024-04-23T18:29:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.746+0000 7f3a29ffb640 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3a0c003d60 con 0x558f99a24470 2024-04-23T18:29:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.746+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(103 notify.3 [notify cookie 94075246526080 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.747+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.747+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== watch-notify(notify_complete (2) cookie 94075246526080 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558f999e23b0 con 0x558f99a24470 2024-04-23T18:29:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.747+0000 7f39fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.747+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94075246294608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f999cf590 con 0x558f99a1fa80 2024-04-23T18:29:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.748+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94075246294608] v32'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.748+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94075246268672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f999cf590 con 0x558f99a24470 2024-04-23T18:29:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.749+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94075246268672] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.749+0000 7f3b4a928800 20 remove_watcher() i=0 2024-04-23T18:29:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.749+0000 7f3b4a928800 2 removed watcher, disabling cache 2024-04-23T18:29:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.749+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94075246271456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f999cf590 con 0x558f99a1fa80 2024-04-23T18:29:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.751+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94075246271456] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.751+0000 7f3b4a928800 20 remove_watcher() i=1 2024-04-23T18:29:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.751+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94075246276320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f999cf590 con 0x558f99a28e50 2024-04-23T18:29:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.752+0000 7f3b3dda6640 1 -- 172.21.15.119:0/1576105924 <== osd.3 v2:172.21.15.119:6809/3910610681 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94075246276320] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b30037040 con 0x558f99a28e50 2024-04-23T18:29:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.752+0000 7f3b4a928800 20 remove_watcher() i=2 2024-04-23T18:29:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.752+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94075246273584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f999cf590 con 0x558f99a24470 2024-04-23T18:29:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.753+0000 7f3b465a7640 1 -- 172.21.15.119:0/1576105924 <== osd.2 v2:172.21.15.119:6800/2624052101 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94075246273584] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b380bd030 con 0x558f99a24470 2024-04-23T18:29:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.753+0000 7f3b4a928800 20 remove_watcher() i=3 2024-04-23T18:29:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.753+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94075246286208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f999cf590 con 0x558f99a1fa80 2024-04-23T18:29:36.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.754+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.1 v2:172.21.15.119:6808/2736386629 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94075246286208] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x558f99a1fa80 2024-04-23T18:29:36.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.754+0000 7f3b4a928800 20 remove_watcher() i=4 2024-04-23T18:29:36.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.754+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94075246283712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f999cf590 con 0x7f3b380c0060 2024-04-23T18:29:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.755+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94075246283712] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.755+0000 7f3b4a928800 20 remove_watcher() i=5 2024-04-23T18:29:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.755+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94075246287264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a30bc0 con 0x7f3b380c0060 2024-04-23T18:29:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.756+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94075246287264] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.756+0000 7f3b4a928800 20 remove_watcher() i=6 2024-04-23T18:29:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.756+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94075246288416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558f99a30bc0 con 0x7f3b380c0060 2024-04-23T18:29:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94075246288416] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b40040040 con 0x7f3b380c0060 2024-04-23T18:29:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 20 remove_watcher() i=7 2024-04-23T18:29:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3b380c0060 msgr2=0x7f3b380ca7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3b380c0060 0x7f3b380ca7a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f99a1fa80 msgr2=0x558f99a21f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f99a1fa80 0x558f99a21f40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f99a24470 msgr2=0x558f99a26860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f99a24470 0x558f99a26860 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558f99a28e50 msgr2=0x558f99a2b310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558f99a28e50 0x558f99a2b310 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a10036e60 msgr2=0x7f3a10039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a10036e60 0x7f3a10039320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3b3000ffd0 tx=0x7f3b30023040 comp rx=0 tx=0).stop 2024-04-23T18:29:36.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b46da8640 1 -- 172.21.15.119:0/1576105924 reap_dead start 2024-04-23T18:29:36.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 msgr2=0x558f99a14470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 0x558f99a14470 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3b3807f8a0 tx=0x7f3b38071ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 shutdown_connections 2024-04-23T18:29:36.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 --2- 172.21.15.119:0/1576105924 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a0d0c0 0x558f99a14470 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 >> 172.21.15.119:0/1576105924 conn(0x558f99a09390 msgr2=0x558f99a069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 shutdown_connections 2024-04-23T18:29:36.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/1576105924 wait complete. 2024-04-23T18:29:36.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/230961493 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a20036e60 msgr2=0x7f3a20039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 --2- 172.21.15.119:0/230961493 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a20036e60 0x7f3a20039320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x558f999e5eb0 tx=0x7f3b30006000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/230961493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a00120 msgr2=0x558f99a00540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 --2- 172.21.15.119:0/230961493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a00120 0x558f99a00540 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3b3808d2c0 tx=0x7f3b38069f40 comp rx=0 tx=0).stop 2024-04-23T18:29:36.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/230961493 shutdown_connections 2024-04-23T18:29:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 --2- 172.21.15.119:0/230961493 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a20036e60 0x7f3a20039320 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 --2- 172.21.15.119:0/230961493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f99a00120 0x558f99a00540 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/230961493 >> 172.21.15.119:0/230961493 conn(0x558f999f41c0 msgr2=0x558f999f45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/230961493 shutdown_connections 2024-04-23T18:29:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.757+0000 7f3b4a928800 1 -- 172.21.15.119:0/230961493 wait complete. 2024-04-23T18:29:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558f999ef110 msgr2=0x558f999f1560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558f999ef110 0x558f999f1560 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f998ea3b0 msgr2=0x558f999e89c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558f998ea3b0 0x558f999e89c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f999eb210 msgr2=0x558f999ed600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558f999eb210 0x558f999ed600 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a2c036e60 msgr2=0x7f3a2c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3a2c036e60 0x7f3a2c039320 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b30000c00 tx=0x7f3b300013b0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 msgr2=0x558f999e1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 --2- 172.21.15.119:0/2164366385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558f998e7a80 0x558f999e1950 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3b38005870 tx=0x7f3b38002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b46da8640 1 -- 172.21.15.119:0/2164366385 reap_dead start 2024-04-23T18:29:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 shutdown_connections 2024-04-23T18:29:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 >> 172.21.15.119:0/2164366385 conn(0x558f998e1430 msgr2=0x558f999d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 shutdown_connections 2024-04-23T18:29:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.758+0000 7f3b4a928800 1 -- 172.21.15.119:0/2164366385 wait complete. 2024-04-23T18:29:36.764 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-23T18:29:36.768 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-04-23T18:29:36.811 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:36.811 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-23T18:29:36.811 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-23T18:29:36.811 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-04-23T18:29:36.856 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:36.856 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:36.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.864+0000 7f4d73216800 1 Processor -- start 2024-04-23T18:29:36.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.864+0000 7f4d73216800 1 -- start start 2024-04-23T18:29:36.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.864+0000 7f4d73216800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5607bb015e80 0x5607bb0162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.864+0000 7f4d73216800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5607baec7560 con 0x5607bb0170e0 2024-04-23T18:29:36.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.864+0000 7f4d73216800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5607baeb8e20 con 0x5607bb015e80 2024-04-23T18:29:36.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.865+0000 7f4d6e884640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5607bb015e80 0x5607bb0162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.865+0000 7f4d67fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5607bb0170e0 0x5607bb017560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:47494/0 (socket says 172.21.15.119:47494) 2024-04-23T18:29:36.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.865+0000 7f4d67fff640 1 -- 172.21.15.119:0/1733023676 learned_addr learned my addr 172.21.15.119:0/1733023676 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:36.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.865+0000 7f4d6e884640 1 -- 172.21.15.119:0/1733023676 >> v1:172.21.15.62:6789/0 conn(0x5607bb0170e0 legacy=0x5607bb017560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.865+0000 7f4d6e884640 1 -- 172.21.15.119:0/1733023676 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607baec6e60 con 0x5607bb015e80 2024-04-23T18:29:36.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.867+0000 7f4d6e884640 1 --2- 172.21.15.119:0/1733023676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607bb0162a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000a470 tx=0x7f4d6001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfe0a4516b0e6f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.867+0000 7f4d6e083640 1 -- 172.21.15.119:0/1733023676 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d60057070 con 0x5607bb015e80 2024-04-23T18:29:36.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.867+0000 7f4d6e083640 1 -- 172.21.15.119:0/1733023676 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d60052570 con 0x5607bb015e80 2024-04-23T18:29:36.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.867+0000 7f4d6e083640 1 -- 172.21.15.119:0/1733023676 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d60052870 con 0x5607bb015e80 2024-04-23T18:29:36.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.868+0000 7f4d73216800 1 -- 172.21.15.119:0/1733023676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 msgr2=0x5607bb0162a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.868+0000 7f4d73216800 1 --2- 172.21.15.119:0/1733023676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607bb0162a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000a470 tx=0x7f4d6001ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:36.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.868+0000 7f4d73216800 1 -- 172.21.15.119:0/1733023676 shutdown_connections 2024-04-23T18:29:36.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.868+0000 7f4d73216800 1 --2- 172.21.15.119:0/1733023676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607bb0162a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.868+0000 7f4d73216800 1 -- 172.21.15.119:0/1733023676 >> 172.21.15.119:0/1733023676 conn(0x5607bb011440 msgr2=0x5607bb013860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.868+0000 7f4d73216800 1 -- 172.21.15.119:0/1733023676 shutdown_connections 2024-04-23T18:29:36.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.868+0000 7f4d73216800 1 -- 172.21.15.119:0/1733023676 wait complete. 2024-04-23T18:29:36.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.879+0000 7f4d73216800 1 Processor -- start 2024-04-23T18:29:36.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.879+0000 7f4d73216800 1 -- start start 2024-04-23T18:29:36.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.879+0000 7f4d73216800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607baf89e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.879+0000 7f4d73216800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5607baf625d0 con 0x5607bb015e80 2024-04-23T18:29:36.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.880+0000 7f4d6e884640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607baf89e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.880+0000 7f4d6e884640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607baf89e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49124/0 (socket says 172.21.15.119:49124) 2024-04-23T18:29:36.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.880+0000 7f4d6e884640 1 -- 172.21.15.119:0/1212018799 learned_addr learned my addr 172.21.15.119:0/1212018799 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.880+0000 7f4d6e884640 1 -- 172.21.15.119:0/1212018799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607baed8860 con 0x5607bb015e80 2024-04-23T18:29:36.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.880+0000 7f4d6e884640 1 --2- 172.21.15.119:0/1212018799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607baf89e80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4d60055040 tx=0x7f4d6004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defcb4a945826ab7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.880+0000 7f4c5ce09640 1 -- 172.21.15.119:0/1212018799 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d60057070 con 0x5607bb015e80 2024-04-23T18:29:36.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.880+0000 7f4c5ce09640 1 -- 172.21.15.119:0/1212018799 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d60063070 con 0x5607bb015e80 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.880+0000 7f4c5ce09640 1 -- 172.21.15.119:0/1212018799 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d60052720 con 0x5607bb015e80 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.881+0000 7f4d73216800 1 -- 172.21.15.119:0/1212018799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 msgr2=0x5607baf89e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.881+0000 7f4d73216800 1 --2- 172.21.15.119:0/1212018799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607baf89e80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4d60055040 tx=0x7f4d6004c000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.881+0000 7f4d73216800 1 -- 172.21.15.119:0/1212018799 shutdown_connections 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.881+0000 7f4d73216800 1 --2- 172.21.15.119:0/1212018799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607baf89e80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.881+0000 7f4d73216800 1 -- 172.21.15.119:0/1212018799 >> 172.21.15.119:0/1212018799 conn(0x5607bb011440 msgr2=0x5607bb102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.881+0000 7f4d73216800 1 -- 172.21.15.119:0/1212018799 shutdown_connections 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.881+0000 7f4d73216800 1 -- 172.21.15.119:0/1212018799 wait complete. 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.881+0000 7f4d73216800 1 Processor -- start 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.881+0000 7f4d73216800 1 -- start start 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.881+0000 7f4d73216800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607bb111ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.882+0000 7f4d73216800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5607bb01f550 con 0x5607bb015e80 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.882+0000 7f4d6e884640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607bb111ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.882+0000 7f4d6e884640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607bb111ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49132/0 (socket says 172.21.15.119:49132) 2024-04-23T18:29:36.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.882+0000 7f4d6e884640 1 -- 172.21.15.119:0/1666670407 learned_addr learned my addr 172.21.15.119:0/1666670407 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.882+0000 7f4d6e884640 1 -- 172.21.15.119:0/1666670407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607baed6eb0 con 0x5607bb015e80 2024-04-23T18:29:36.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.882+0000 7f4d6e884640 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607bb111ff0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4d60000c00 tx=0x7f4d60002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.882+0000 7f4c5b606640 1 -- 172.21.15.119:0/1666670407 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d60052c50 con 0x5607bb015e80 2024-04-23T18:29:36.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.882+0000 7f4c5b606640 1 -- 172.21.15.119:0/1666670407 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6006c070 con 0x5607bb015e80 2024-04-23T18:29:36.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.882+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607bb112530 con 0x5607bb015e80 2024-04-23T18:29:36.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.882+0000 7f4c5b606640 1 -- 172.21.15.119:0/1666670407 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d6005e480 con 0x5607bb015e80 2024-04-23T18:29:36.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.882+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607bb112a50 con 0x5607bb015e80 2024-04-23T18:29:36.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.883+0000 7f4c5b606640 1 -- 172.21.15.119:0/1666670407 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4d60077060 con 0x5607bb015e80 2024-04-23T18:29:36.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.883+0000 7f4c5b606640 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c54036e60 0x7f4c54039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.883+0000 7f4c5b606640 1 -- 172.21.15.119:0/1666670407 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4d6008e990 con 0x5607bb015e80 2024-04-23T18:29:36.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.883+0000 7f4d67fff640 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c54036e60 0x7f4c54039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.883+0000 7f4d73216800 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5607bb0170e0 0x5607bb119060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.883+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1195e0 con 0x5607bb0170e0 2024-04-23T18:29:36.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.884+0000 7f4d6f085640 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5607bb0170e0 0x5607bb119060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.884+0000 7f4d67fff640 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c54036e60 0x7f4c54039320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d58000f60 tx=0x7f4d580012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.884+0000 7f4d6f085640 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5607bb0170e0 0x5607bb119060 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.884+0000 7f4d6f085640 1 -- 172.21.15.119:0/1666670407 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb0170e0 2024-04-23T18:29:36.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.884+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb116610 con 0x5607bb0170e0 2024-04-23T18:29:36.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.884+0000 7f4d6f085640 1 -- 172.21.15.119:0/1666670407 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb0170e0 2024-04-23T18:29:36.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.884+0000 7f4d73216800 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5607bb11b910 0x5607bb11dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.884+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb11e3a0 con 0x5607bb11b910 2024-04-23T18:29:36.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.885+0000 7f4d6e884640 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5607bb11b910 0x5607bb11dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.885+0000 7f4d6e884640 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5607bb11b910 0x5607bb11dd00 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.883 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.885+0000 7f4d6e884640 1 -- 172.21.15.119:0/1666670407 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4d60079450 con 0x5607bb11b910 2024-04-23T18:29:36.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.885+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb11a8c0 con 0x5607bb0170e0 2024-04-23T18:29:36.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.885+0000 7f4d6f085640 1 -- 172.21.15.119:0/1666670407 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb0170e0 2024-04-23T18:29:36.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.885+0000 7f4d73216800 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5607bb11f850 0x5607bb121ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.885+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb122400 con 0x5607bb11f850 2024-04-23T18:29:36.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.886+0000 7f4d67fff640 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5607bb11f850 0x5607bb121ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.886+0000 7f4d67fff640 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5607bb11f850 0x5607bb121ca0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.886+0000 7f4d67fff640 1 -- 172.21.15.119:0/1666670407 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb11f850 2024-04-23T18:29:36.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.887+0000 7f4d73216800 1 Processor -- start 2024-04-23T18:29:36.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.887+0000 7f4d73216800 1 -- start start 2024-04-23T18:29:36.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.887+0000 7f4d73216800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb130860 0x5607bb130c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.887+0000 7f4d73216800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5607baf08df0 con 0x5607bb130860 2024-04-23T18:29:36.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.887+0000 7f4d6e884640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb130860 0x5607bb130c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.887+0000 7f4d6e884640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb130860 0x5607bb130c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49146/0 (socket says 172.21.15.119:49146) 2024-04-23T18:29:36.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.887+0000 7f4d6e884640 1 -- 172.21.15.119:0/2332883059 learned_addr learned my addr 172.21.15.119:0/2332883059 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.887+0000 7f4d6e884640 1 -- 172.21.15.119:0/2332883059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607bb1311c0 con 0x5607bb130860 2024-04-23T18:29:36.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.887+0000 7f4d6e884640 1 --2- 172.21.15.119:0/2332883059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb130860 0x5607bb130c80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4d6008cd80 tx=0x7f4d60068510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.888+0000 7f4c58e01640 1 -- 172.21.15.119:0/2332883059 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d6006f4f0 con 0x5607bb130860 2024-04-23T18:29:36.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.888+0000 7f4c58e01640 1 -- 172.21.15.119:0/2332883059 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d60093070 con 0x5607bb130860 2024-04-23T18:29:36.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.888+0000 7f4c58e01640 1 -- 172.21.15.119:0/2332883059 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d60069c00 con 0x5607bb130860 2024-04-23T18:29:36.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.888+0000 7f4d73216800 1 -- 172.21.15.119:0/2332883059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607bb131c30 con 0x5607bb130860 2024-04-23T18:29:36.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.888+0000 7f4d73216800 1 -- 172.21.15.119:0/2332883059 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607bb132130 con 0x5607bb130860 2024-04-23T18:29:36.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.888+0000 7f4c58e01640 1 -- 172.21.15.119:0/2332883059 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4d6006e030 con 0x5607bb130860 2024-04-23T18:29:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.888+0000 7f4c58e01640 1 --2- 172.21.15.119:0/2332883059 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c48036e60 0x7f4c48039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.889+0000 7f4c58e01640 1 -- 172.21.15.119:0/2332883059 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4d6008b050 con 0x5607bb130860 2024-04-23T18:29:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.889+0000 7f4d67fff640 1 --2- 172.21.15.119:0/2332883059 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c48036e60 0x7f4c48039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.889+0000 7f4d73216800 1 Processor -- start 2024-04-23T18:29:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.889+0000 7f4d73216800 1 -- start start 2024-04-23T18:29:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.889+0000 7f4d67fff640 1 --2- 172.21.15.119:0/2332883059 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c48036e60 0x7f4c48039320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800bf50 tx=0x7f4d5800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.889+0000 7f4d73216800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 0x5607bb13de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.889+0000 7f4d73216800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5607bb10d740 con 0x5607bb13da10 2024-04-23T18:29:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.889+0000 7f4d6e884640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 0x5607bb13de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.889+0000 7f4d6e884640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 0x5607bb13de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49160/0 (socket says 172.21.15.119:49160) 2024-04-23T18:29:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.889+0000 7f4d6e884640 1 -- 172.21.15.119:0/2517309854 learned_addr learned my addr 172.21.15.119:0/2517309854 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.889+0000 7f4d6e884640 1 -- 172.21.15.119:0/2517309854 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607bb13e400 con 0x5607bb13da10 2024-04-23T18:29:36.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.890+0000 7f4d6e884640 1 --2- 172.21.15.119:0/2517309854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 0x5607bb13de30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4d6006ffd0 tx=0x7f4d600691e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e986eef5900576 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.890+0000 7f4c527fc640 1 -- 172.21.15.119:0/2517309854 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d6008e700 con 0x5607bb13da10 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.890+0000 7f4c527fc640 1 -- 172.21.15.119:0/2517309854 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d60058040 con 0x5607bb13da10 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.890+0000 7f4c527fc640 1 -- 172.21.15.119:0/2517309854 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d6005e620 con 0x5607bb13da10 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.890+0000 7f4d73216800 1 -- 172.21.15.119:0/2517309854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 msgr2=0x5607bb13de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.890+0000 7f4d73216800 1 --2- 172.21.15.119:0/2517309854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 0x5607bb13de30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4d6006ffd0 tx=0x7f4d600691e0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.890+0000 7f4d73216800 1 -- 172.21.15.119:0/2517309854 shutdown_connections 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.890+0000 7f4d73216800 1 --2- 172.21.15.119:0/2517309854 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 0x5607bb13de30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.890+0000 7f4d73216800 1 -- 172.21.15.119:0/2517309854 >> 172.21.15.119:0/2517309854 conn(0x5607bb139ce0 msgr2=0x5607bb137d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.890+0000 7f4d73216800 1 -- 172.21.15.119:0/2517309854 shutdown_connections 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.890+0000 7f4d73216800 1 -- 172.21.15.119:0/2517309854 wait complete. 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.890+0000 7f4d73216800 1 Processor -- start 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.891+0000 7f4d73216800 1 -- start start 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.891+0000 7f4d73216800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 0x5607bb144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.891+0000 7f4d73216800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5607bb13ea60 con 0x5607bb13da10 2024-04-23T18:29:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.891+0000 7f4d6e884640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 0x5607bb144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.891+0000 7f4d6e884640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 0x5607bb144d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49168/0 (socket says 172.21.15.119:49168) 2024-04-23T18:29:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.891+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 learned_addr learned my addr 172.21.15.119:0/1589887008 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.891+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607bb145290 con 0x5607bb13da10 2024-04-23T18:29:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.891+0000 7f4d6e884640 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 0x5607bb144d50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4d6008cc80 tx=0x7f4d6006df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.892+0000 7f4c50ff9640 1 -- 172.21.15.119:0/1589887008 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d600bb070 con 0x5607bb13da10 2024-04-23T18:29:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.892+0000 7f4c50ff9640 1 -- 172.21.15.119:0/1589887008 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6008b250 con 0x5607bb13da10 2024-04-23T18:29:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.892+0000 7f4c50ff9640 1 -- 172.21.15.119:0/1589887008 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d6008b530 con 0x5607bb13da10 2024-04-23T18:29:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.892+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607bb145290 con 0x5607bb13da10 2024-04-23T18:29:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.892+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607bb145290 con 0x5607bb13da10 2024-04-23T18:29:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.892+0000 7f4c50ff9640 1 -- 172.21.15.119:0/1589887008 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4d600be070 con 0x5607bb13da10 2024-04-23T18:29:36.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.892+0000 7f4c50ff9640 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c38036dc0 0x7f4c38039280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.893+0000 7f4c50ff9640 1 -- 172.21.15.119:0/1589887008 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4d600b2030 con 0x5607bb13da10 2024-04-23T18:29:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.893+0000 7f4d67fff640 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c38036dc0 0x7f4c38039280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.893+0000 7f4d73216800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.893+0000 7f4d73216800 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5607bb150530 0x5607bb1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.893+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb153140 con 0x5607bb150530 2024-04-23T18:29:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.893+0000 7f4d67fff640 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c38036dc0 0x7f4c38039280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4d58001b60 tx=0x7f4d58010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.893+0000 7f4d6f085640 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5607bb150530 0x5607bb1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.893+0000 7f4d6f085640 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5607bb150530 0x5607bb1529f0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb150530 2024-04-23T18:29:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 20 realm 2024-04-23T18:29:36.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb153550 con 0x5607bb150530 2024-04-23T18:29:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb150530 2024-04-23T18:29:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb153e20 con 0x5607bb150530 2024-04-23T18:29:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb150530 2024-04-23T18:29:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb150530 2024-04-23T18:29:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb150530 2024-04-23T18:29:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:36.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5607bb154f20 0x5607bb157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb157920 con 0x5607bb154f20 2024-04-23T18:29:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.894+0000 7f4d6e884640 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5607bb154f20 0x5607bb157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.895+0000 7f4d6e884640 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5607bb154f20 0x5607bb157310 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.895+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.895+0000 7f4d73216800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.895+0000 7f4d73216800 20 searching for the correct realm 2024-04-23T18:29:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.895+0000 7f4d73216800 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5607bb1598b0 0x5607bb15bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.895+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb15c440 con 0x5607bb1598b0 2024-04-23T18:29:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.895+0000 7f4d67fff640 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5607bb1598b0 0x5607bb15bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.895+0000 7f4d67fff640 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5607bb1598b0 0x5607bb15bd70 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.908 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.896+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.896+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb15c440 con 0x5607bb154f20 2024-04-23T18:29:36.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.896+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.896+0000 7f4d6e884640 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4d600c0060 0x7f4d60058950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:36.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.896+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb15c440 con 0x7f4d600c0060 2024-04-23T18:29:36.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.896+0000 7f4d6f085640 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4d600c0060 0x7f4d60058950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:36.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.896+0000 7f4d6f085640 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4d600c0060 0x7f4d60058950 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:36.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.897+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6800a4a0 con 0x7f4d600c0060 2024-04-23T18:29:36.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.897+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb150530 2024-04-23T18:29:36.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.897+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb150530 2024-04-23T18:29:36.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.897+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb150530 2024-04-23T18:29:36.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.897+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb150530 2024-04-23T18:29:36.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.897+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x7f4d600c0060 2024-04-23T18:29:36.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.897+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6800a4a0 con 0x7f4d600c0060 2024-04-23T18:29:36.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.897+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x7f4d600c0060 2024-04-23T18:29:36.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.898+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4d6800a4a0 con 0x7f4d600c0060 2024-04-23T18:29:36.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.898+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb154f20 2024-04-23T18:29:36.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.898+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.898+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb1598b0 2024-04-23T18:29:36.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.898+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.898+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb150530 2024-04-23T18:29:36.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.898+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb150530 2024-04-23T18:29:36.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.898+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x7f4d600c0060 2024-04-23T18:29:36.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.899+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6800a4a0 con 0x7f4d600c0060 2024-04-23T18:29:36.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.899+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb150530 2024-04-23T18:29:36.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.899+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb150530 2024-04-23T18:29:36.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.899+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb154f20 2024-04-23T18:29:36.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.899+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.899+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb1598b0 2024-04-23T18:29:36.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.899+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.899+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb1598b0 2024-04-23T18:29:36.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.899+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.899+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x7f4d600c0060 2024-04-23T18:29:36.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.900+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6800a4a0 con 0x7f4d600c0060 2024-04-23T18:29:36.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.900+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb1598b0 2024-04-23T18:29:36.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.900+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.900+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb1598b0 2024-04-23T18:29:36.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.900+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.900+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb150530 2024-04-23T18:29:36.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.900+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb150530 2024-04-23T18:29:36.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.900+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb150530 2024-04-23T18:29:36.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.901+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb150530 2024-04-23T18:29:36.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.901+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x7f4d600c0060 2024-04-23T18:29:36.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.901+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6800a4a0 con 0x7f4d600c0060 2024-04-23T18:29:36.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.901+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb1598b0 2024-04-23T18:29:36.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.901+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.901+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb154f20 2024-04-23T18:29:36.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.901+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.901+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb150530 2024-04-23T18:29:36.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.902+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6800a4a0 con 0x5607bb150530 2024-04-23T18:29:36.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.902+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x7f4d600c0060 2024-04-23T18:29:36.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.902+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6800a4a0 con 0x7f4d600c0060 2024-04-23T18:29:36.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.902+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb1598b0 2024-04-23T18:29:36.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.902+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.902+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x7f4d600c0060 2024-04-23T18:29:36.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.903+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d6800a4a0 con 0x7f4d600c0060 2024-04-23T18:29:36.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.903+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb154f20 2024-04-23T18:29:36.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.903+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.903+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb1598b0 2024-04-23T18:29:36.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.903+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.903+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x7f4d600c0060 2024-04-23T18:29:36.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.903+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.903+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb150530 2024-04-23T18:29:36.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1541c0 con 0x5607bb154f20 2024-04-23T18:29:36.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:36.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:36.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:36.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:36.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:36.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:36.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1581e0 con 0x5607bb150530 2024-04-23T18:29:36.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1581e0 con 0x5607bb150530 2024-04-23T18:29:36.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:36.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.904+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1581e0 con 0x7f4d600c0060 2024-04-23T18:29:36.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d73216800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:36.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d73216800 20 zone default found 2024-04-23T18:29:36.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d73216800 4 Realm: () 2024-04-23T18:29:36.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d73216800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:36.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d73216800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:36.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d73216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:36.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d73216800 20 zonegroup default 2024-04-23T18:29:36.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d73216800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb158ad0 con 0x7f4d600c0060 2024-04-23T18:29:36.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d73216800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d73216800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb158ad0 con 0x5607bb1598b0 2024-04-23T18:29:36.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.905+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.906+0000 7f4d73216800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.906+0000 7f4d73216800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.906+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb15e2a0 con 0x5607bb1598b0 2024-04-23T18:29:36.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.906+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.906+0000 7f4d73216800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:36.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.906+0000 7f4d73216800 20 started sync module instance, tier type = 2024-04-23T18:29:36.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.906+0000 7f4d73216800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:36.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.906+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb15d740 con 0x5607bb154f20 2024-04-23T18:29:36.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.907+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.907+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94591203529360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb15e640 con 0x5607bb154f20 2024-04-23T18:29:36.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.907+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb15f000 con 0x5607bb150530 2024-04-23T18:29:36.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.908+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94591203529360] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.908+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.908+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94591203535696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb15f420 con 0x5607bb150530 2024-04-23T18:29:36.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.908+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb15fde0 con 0x5607bb1598b0 2024-04-23T18:29:36.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.909+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.910+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94591203539248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb160680 con 0x5607bb1598b0 2024-04-23T18:29:36.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.910+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb161160 con 0x5607bb154f20 2024-04-23T18:29:36.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.910+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94591203535696] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.911+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94591203539248] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.911+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.911+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94591203541456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb15ef70 con 0x5607bb154f20 2024-04-23T18:29:36.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.911+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb161a00 con 0x5607bb150530 2024-04-23T18:29:36.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.912+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.912+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94591203546448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb161970 con 0x5607bb150530 2024-04-23T18:29:36.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.912+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1629b0 con 0x7f4d600c0060 2024-04-23T18:29:36.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.912+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94591203541456] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.913+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94591203546448] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.913+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.913+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94591203544176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1624c0 con 0x7f4d600c0060 2024-04-23T18:29:36.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.913+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1624c0 con 0x7f4d600c0060 2024-04-23T18:29:36.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.914+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94591203544176] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.914+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.914+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94591203548576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb163040 con 0x7f4d600c0060 2024-04-23T18:29:36.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.914+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb163890 con 0x7f4d600c0060 2024-04-23T18:29:36.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.915+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94591203548576] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.915+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.915+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94591203552624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb163740 con 0x7f4d600c0060 2024-04-23T18:29:36.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.915+0000 7f4d73216800 20 add_watcher() i=0 2024-04-23T18:29:36.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.915+0000 7f4d73216800 20 add_watcher() i=1 2024-04-23T18:29:36.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.915+0000 7f4d73216800 20 add_watcher() i=2 2024-04-23T18:29:36.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.915+0000 7f4d73216800 20 add_watcher() i=3 2024-04-23T18:29:36.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.915+0000 7f4d73216800 20 add_watcher() i=4 2024-04-23T18:29:36.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.915+0000 7f4d73216800 20 add_watcher() i=5 2024-04-23T18:29:36.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.915+0000 7f4d73216800 20 add_watcher() i=6 2024-04-23T18:29:36.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.916+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94591203552624] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.916+0000 7f4d73216800 20 add_watcher() i=7 2024-04-23T18:29:36.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.916+0000 7f4d73216800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:36.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.916+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb166c80 con 0x5607bb150530 2024-04-23T18:29:36.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.917+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.917+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94591203553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb164130 con 0x5607bb150530 2024-04-23T18:29:36.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.917+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94591203553744] v32'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.918+0000 7f4c257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:36.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.918+0000 7f4d73216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:36.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.918+0000 7f4d73216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:36.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.918+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb166aa0 con 0x5607bb150530 2024-04-23T18:29:36.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.919+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.919+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb16ff50 con 0x7f4d600c0060 2024-04-23T18:29:36.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.920+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.920+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1703b0 con 0x5607bb1598b0 2024-04-23T18:29:36.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.921+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.921+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb170dd0 con 0x5607bb150530 2024-04-23T18:29:36.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.922+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'141 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.922+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb16f4e0 con 0x5607bb154f20 2024-04-23T18:29:36.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.923+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.923+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb16f4e0 con 0x5607bb1598b0 2024-04-23T18:29:36.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.924+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.924+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb171930 con 0x5607bb150530 2024-04-23T18:29:36.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.925+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.925+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb171de0 con 0x7f4d600c0060 2024-04-23T18:29:36.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.926+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.926+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb171de0 con 0x5607bb154f20 2024-04-23T18:29:36.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.927+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.927+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb171e70 con 0x5607bb1598b0 2024-04-23T18:29:36.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.928+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.928+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb172400 con 0x5607bb154f20 2024-04-23T18:29:36.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.929+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.929+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1723e0 con 0x7f4d600c0060 2024-04-23T18:29:36.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.930+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.930+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1723b0 con 0x5607bb154f20 2024-04-23T18:29:36.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.931+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.931+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1723b0 con 0x7f4d600c0060 2024-04-23T18:29:36.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.932+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'33 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.932+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1722d0 con 0x5607bb150530 2024-04-23T18:29:36.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.933+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'142 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.933+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1722d0 con 0x5607bb1598b0 2024-04-23T18:29:36.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.934+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.934+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb172900 con 0x5607bb154f20 2024-04-23T18:29:36.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.935+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.935+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb16ee60 con 0x5607bb1598b0 2024-04-23T18:29:36.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.936+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.936+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb16ee60 con 0x5607bb150530 2024-04-23T18:29:36.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.937+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.937+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1728e0 con 0x5607bb150530 2024-04-23T18:29:36.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.938+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'143 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.938+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1728e0 con 0x5607bb1598b0 2024-04-23T18:29:36.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.939+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.939+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1728e0 con 0x5607bb154f20 2024-04-23T18:29:36.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.940+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.940+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1728e0 con 0x5607bb1598b0 2024-04-23T18:29:36.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.941+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.941+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1728e0 con 0x5607bb1598b0 2024-04-23T18:29:36.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.942+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.942+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1728e0 con 0x5607bb1598b0 2024-04-23T18:29:36.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.943+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.943+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1728e0 con 0x5607bb1598b0 2024-04-23T18:29:36.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.944+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.944+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1728e0 con 0x7f4d600c0060 2024-04-23T18:29:36.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.945+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.945+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1728e0 con 0x5607bb1598b0 2024-04-23T18:29:36.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.946+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.946+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1728e0 con 0x7f4d600c0060 2024-04-23T18:29:36.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.947+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.947+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1728e0 con 0x5607bb1598b0 2024-04-23T18:29:36.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.948+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.948+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1728e0 con 0x7f4d600c0060 2024-04-23T18:29:36.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.949+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.949+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1728e0 con 0x5607bb154f20 2024-04-23T18:29:36.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.951+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.951+0000 7f4b9ffff640 20 reqs_thread_entry: start 2024-04-23T18:29:36.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.951+0000 7f4d73216800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:36.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.951+0000 7f4d73216800 20 Filter name: none 2024-04-23T18:29:36.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.951+0000 7f4b9dffb640 20 reqs_thread_entry: start 2024-04-23T18:29:36.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.951+0000 7f4d73216800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-23T18:29:36.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.951+0000 7f4d73216800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.951+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb19d790 con 0x5607bb154f20 2024-04-23T18:29:36.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:36.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-23T18:29:36.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:36.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 : miss 2024-04-23T18:29:36.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 20 rados->read ofs=0 len=0 2024-04-23T18:29:36.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:95 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb19f250 con 0x5607bb1598b0 2024-04-23T18:29:36.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(95 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:36.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:36.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:36.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:36.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:36.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 2024-04-23T18:29:36.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 20 get_obj_state: octx=0x7f4d6800aaf0 obj=myfoo:four state=0x5607bb1a0538 s->prefetch_data=0 2024-04-23T18:29:36.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:96 3.es0 3:73cb5b94:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1a1360 con 0x5607bb154f20 2024-04-23T18:29:36.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(96 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 10 manifest: total_size = 4 2024-04-23T18:29:36.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 20 get_obj_state: setting s->obj_tag to b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.18209134558240723304 2024-04-23T18:29:36.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 20 get_obj_state: octx=0x7f4d6800aaf0 obj=myfoo:four state=0x5607bb1a0538 s->prefetch_data=0 2024-04-23T18:29:36.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 20 prepare_atomic_modification: state is not atomic. state=0x5607bb1a0538 2024-04-23T18:29:36.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 20 bucket index object: :.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6 2024-04-23T18:29:36.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.952+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:97 4.1c 4:39198531:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1a5cc0 con 0x7f4d600c0060 2024-04-23T18:29:36.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.954+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(97 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.954+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:98 3.es0 3:73cb5b94:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1a5cc0 con 0x5607bb154f20 2024-04-23T18:29:36.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.955+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(98 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1_four [call] v32'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.955+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:99 4.1c 4:39198531:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1a6750 con 0x7f4d600c0060 2024-04-23T18:29:36.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.956+0000 7f4c257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:36.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.956+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94591203553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1a6750 con 0x5607bb150530 2024-04-23T18:29:36.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.956+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(99 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.956+0000 7f4c527fc640 20 handle_completion(): completion ok for obj=four 2024-04-23T18:29:36.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.957+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94591203553744] v32'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.957+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94591203529360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1a6750 con 0x5607bb154f20 2024-04-23T18:29:36.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.958+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94591203529360] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.958+0000 7f4d73216800 20 remove_watcher() i=0 2024-04-23T18:29:36.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.958+0000 7f4d73216800 2 removed watcher, disabling cache 2024-04-23T18:29:36.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.958+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94591203535696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1a6750 con 0x5607bb150530 2024-04-23T18:29:36.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.959+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94591203535696] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.959+0000 7f4d73216800 20 remove_watcher() i=1 2024-04-23T18:29:36.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.959+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94591203539248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1a6750 con 0x5607bb1598b0 2024-04-23T18:29:36.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.960+0000 7f4d67fff640 1 -- 172.21.15.119:0/1589887008 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94591203539248] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d58009050 con 0x5607bb1598b0 2024-04-23T18:29:36.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.960+0000 7f4d73216800 20 remove_watcher() i=2 2024-04-23T18:29:36.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.960+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94591203541456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1a6750 con 0x5607bb154f20 2024-04-23T18:29:36.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.961+0000 7f4d6e884640 1 -- 172.21.15.119:0/1589887008 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94591203541456] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d600bd030 con 0x5607bb154f20 2024-04-23T18:29:36.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.961+0000 7f4d73216800 20 remove_watcher() i=3 2024-04-23T18:29:36.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.961+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94591203546448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1a6750 con 0x5607bb150530 2024-04-23T18:29:36.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.962+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94591203546448] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x5607bb150530 2024-04-23T18:29:36.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.962+0000 7f4d73216800 20 remove_watcher() i=4 2024-04-23T18:29:36.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.962+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94591203544176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1a6750 con 0x7f4d600c0060 2024-04-23T18:29:36.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.963+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94591203544176] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.963+0000 7f4d73216800 20 remove_watcher() i=5 2024-04-23T18:29:36.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.963+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94591203548576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1a6750 con 0x7f4d600c0060 2024-04-23T18:29:36.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.964+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94591203548576] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.964+0000 7f4d73216800 20 remove_watcher() i=6 2024-04-23T18:29:36.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.964+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94591203552624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5607bb1601d0 con 0x7f4d600c0060 2024-04-23T18:29:36.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94591203552624] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d68040040 con 0x7f4d600c0060 2024-04-23T18:29:36.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 20 remove_watcher() i=7 2024-04-23T18:29:36.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4d600c0060 msgr2=0x7f4d60058950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4d600c0060 0x7f4d60058950 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5607bb150530 msgr2=0x5607bb1529f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5607bb150530 0x5607bb1529f0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5607bb154f20 msgr2=0x5607bb157310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5607bb154f20 0x5607bb157310 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5607bb1598b0 msgr2=0x5607bb15bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5607bb1598b0 0x5607bb15bd70 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c38036dc0 msgr2=0x7f4c38039280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c38036dc0 0x7f4c38039280 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4d58001b60 tx=0x7f4d58010000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 msgr2=0x5607bb144d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d6f085640 1 -- 172.21.15.119:0/1589887008 reap_dead start 2024-04-23T18:29:36.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 0x5607bb144d50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4d6008cc80 tx=0x7f4d6006df00 comp rx=0 tx=0).stop 2024-04-23T18:29:36.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 shutdown_connections 2024-04-23T18:29:36.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 --2- 172.21.15.119:0/1589887008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb13da10 0x5607bb144d50 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 >> 172.21.15.119:0/1589887008 conn(0x5607bb139ce0 msgr2=0x5607bb137340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.965+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 shutdown_connections 2024-04-23T18:29:36.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/1589887008 wait complete. 2024-04-23T18:29:36.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/2332883059 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c48036e60 msgr2=0x7f4c48039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 --2- 172.21.15.119:0/2332883059 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c48036e60 0x7f4c48039320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800bf50 tx=0x7f4d5800f000 comp rx=0 tx=0).stop 2024-04-23T18:29:36.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/2332883059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb130860 msgr2=0x5607bb130c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 --2- 172.21.15.119:0/2332883059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb130860 0x5607bb130c80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4d6008cd80 tx=0x7f4d60068510 comp rx=0 tx=0).stop 2024-04-23T18:29:36.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/2332883059 shutdown_connections 2024-04-23T18:29:36.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 --2- 172.21.15.119:0/2332883059 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c48036e60 0x7f4c48039320 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 --2- 172.21.15.119:0/2332883059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb130860 0x5607bb130c80 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/2332883059 >> 172.21.15.119:0/2332883059 conn(0x5607bb124900 msgr2=0x5607bb124d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/2332883059 shutdown_connections 2024-04-23T18:29:36.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/2332883059 wait complete. 2024-04-23T18:29:36.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5607bb11f850 msgr2=0x5607bb121ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5607bb11f850 0x5607bb121ca0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5607bb0170e0 msgr2=0x5607bb119060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5607bb0170e0 0x5607bb119060 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5607bb11b910 msgr2=0x5607bb11dd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5607bb11b910 0x5607bb11dd00 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c54036e60 msgr2=0x7f4c54039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4c54036e60 0x7f4c54039320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4d58000f60 tx=0x7f4d580012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 msgr2=0x5607bb111ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:36.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 --2- 172.21.15.119:0/1666670407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5607bb015e80 0x5607bb111ff0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4d60000c00 tx=0x7f4d60002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:36.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d6f085640 1 -- 172.21.15.119:0/1666670407 reap_dead start 2024-04-23T18:29:36.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 shutdown_connections 2024-04-23T18:29:36.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 >> 172.21.15.119:0/1666670407 conn(0x5607bb011440 msgr2=0x5607bb101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:36.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 shutdown_connections 2024-04-23T18:29:36.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:36.966+0000 7f4d73216800 1 -- 172.21.15.119:0/1666670407 wait complete. 2024-04-23T18:29:36.967 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-23T18:29:36.967 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-23T18:29:36.967 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-23T18:29:37.009 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:37.010 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.018+0000 7f382ae1f800 1 Processor -- start 2024-04-23T18:29:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.018+0000 7f382ae1f800 1 -- start start 2024-04-23T18:29:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.018+0000 7f382ae1f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559e145f6870 0x559e145f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.018+0000 7f382ae1f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e144a8560 con 0x559e145f71d0 2024-04-23T18:29:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.018+0000 7f382ae1f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x559e14499e20 con 0x559e145f6870 2024-04-23T18:29:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.018+0000 7f382891e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559e145f6870 0x559e145f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.018+0000 7f3823fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x559e145f71d0 0x559e145f7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:47506/0 (socket says 172.21.15.119:47506) 2024-04-23T18:29:37.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.018+0000 7f3823fff640 1 -- 172.21.15.119:0/3117230509 learned_addr learned my addr 172.21.15.119:0/3117230509 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:37.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.018+0000 7f382891e640 1 -- 172.21.15.119:0/3117230509 >> v1:172.21.15.62:6789/0 conn(0x559e145f71d0 legacy=0x559e145f7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.018+0000 7f382891e640 1 -- 172.21.15.119:0/3117230509 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e144a7e60 con 0x559e145f6870 2024-04-23T18:29:37.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.020+0000 7f382891e640 1 --2- 172.21.15.119:0/3117230509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e145f6c90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f381400a470 tx=0x7f381401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2518fce302a1ebf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.020+0000 7f38237fe640 1 -- 172.21.15.119:0/3117230509 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3814057070 con 0x559e145f6870 2024-04-23T18:29:37.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.020+0000 7f38237fe640 1 -- 172.21.15.119:0/3117230509 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381404adc0 con 0x559e145f6870 2024-04-23T18:29:37.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.020+0000 7f38237fe640 1 -- 172.21.15.119:0/3117230509 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3814052590 con 0x559e145f6870 2024-04-23T18:29:37.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.021+0000 7f382ae1f800 1 -- 172.21.15.119:0/3117230509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 msgr2=0x559e145f6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.021+0000 7f382ae1f800 1 --2- 172.21.15.119:0/3117230509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e145f6c90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f381400a470 tx=0x7f381401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:37.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.021+0000 7f382ae1f800 1 -- 172.21.15.119:0/3117230509 shutdown_connections 2024-04-23T18:29:37.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.021+0000 7f382ae1f800 1 --2- 172.21.15.119:0/3117230509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e145f6c90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.021+0000 7f382ae1f800 1 -- 172.21.15.119:0/3117230509 >> 172.21.15.119:0/3117230509 conn(0x559e145f2410 msgr2=0x559e145f4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.021+0000 7f382ae1f800 1 -- 172.21.15.119:0/3117230509 shutdown_connections 2024-04-23T18:29:37.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.021+0000 7f382ae1f800 1 -- 172.21.15.119:0/3117230509 wait complete. 2024-04-23T18:29:37.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.032+0000 7f382ae1f800 1 Processor -- start 2024-04-23T18:29:37.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.033+0000 7f382ae1f800 1 -- start start 2024-04-23T18:29:37.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.033+0000 7f382ae1f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e146eb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.033+0000 7f382ae1f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559e145435b0 con 0x559e145f6870 2024-04-23T18:29:37.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.033+0000 7f382891e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e146eb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.033+0000 7f382891e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e146eb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49186/0 (socket says 172.21.15.119:49186) 2024-04-23T18:29:37.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.033+0000 7f382891e640 1 -- 172.21.15.119:0/1991768413 learned_addr learned my addr 172.21.15.119:0/1991768413 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.033+0000 7f382891e640 1 -- 172.21.15.119:0/1991768413 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e144b9860 con 0x559e145f6870 2024-04-23T18:29:37.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.033+0000 7f382891e640 1 --2- 172.21.15.119:0/1991768413 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e146eb4a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3814055040 tx=0x7f381404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3464f1e0cdb59f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.033+0000 7f3715e13640 1 -- 172.21.15.119:0/1991768413 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3814057040 con 0x559e145f6870 2024-04-23T18:29:37.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.034+0000 7f3715e13640 1 -- 172.21.15.119:0/1991768413 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3814062070 con 0x559e145f6870 2024-04-23T18:29:37.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.034+0000 7f3715e13640 1 -- 172.21.15.119:0/1991768413 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f381405d470 con 0x559e145f6870 2024-04-23T18:29:37.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.034+0000 7f382ae1f800 1 -- 172.21.15.119:0/1991768413 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 msgr2=0x559e146eb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.034+0000 7f382ae1f800 1 --2- 172.21.15.119:0/1991768413 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e146eb4a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3814055040 tx=0x7f381404c000 comp rx=0 tx=0).stop 2024-04-23T18:29:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.034+0000 7f382ae1f800 1 -- 172.21.15.119:0/1991768413 shutdown_connections 2024-04-23T18:29:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.034+0000 7f382ae1f800 1 --2- 172.21.15.119:0/1991768413 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e146eb4a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.034+0000 7f382ae1f800 1 -- 172.21.15.119:0/1991768413 >> 172.21.15.119:0/1991768413 conn(0x559e145f2410 msgr2=0x559e146e6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.034+0000 7f382ae1f800 1 -- 172.21.15.119:0/1991768413 shutdown_connections 2024-04-23T18:29:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.034+0000 7f382ae1f800 1 -- 172.21.15.119:0/1991768413 wait complete. 2024-04-23T18:29:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.035+0000 7f382ae1f800 1 Processor -- start 2024-04-23T18:29:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.035+0000 7f382ae1f800 1 -- start start 2024-04-23T18:29:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.035+0000 7f382ae1f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e146f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.035+0000 7f382ae1f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559e145f8030 con 0x559e145f6870 2024-04-23T18:29:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.035+0000 7f382891e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e146f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.035+0000 7f382891e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e146f2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49188/0 (socket says 172.21.15.119:49188) 2024-04-23T18:29:37.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.035+0000 7f382891e640 1 -- 172.21.15.119:0/329676864 learned_addr learned my addr 172.21.15.119:0/329676864 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.035+0000 7f382891e640 1 -- 172.21.15.119:0/329676864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e144b7eb0 con 0x559e145f6870 2024-04-23T18:29:37.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.036+0000 7f382891e640 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e146f2d50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f381401ce60 tx=0x7f3814002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.036+0000 7f370ffff640 1 -- 172.21.15.119:0/329676864 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f381406b070 con 0x559e145f6870 2024-04-23T18:29:37.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.036+0000 7f370ffff640 1 -- 172.21.15.119:0/329676864 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381405d970 con 0x559e145f6870 2024-04-23T18:29:37.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.036+0000 7f370ffff640 1 -- 172.21.15.119:0/329676864 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3814057070 con 0x559e145f6870 2024-04-23T18:29:37.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.036+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e146f3290 con 0x559e145f6870 2024-04-23T18:29:37.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.036+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e146f37b0 con 0x559e145f6870 2024-04-23T18:29:37.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.036+0000 7f370ffff640 1 -- 172.21.15.119:0/329676864 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f381405dc90 con 0x559e145f6870 2024-04-23T18:29:37.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.037+0000 7f370ffff640 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3710036e60 0x7f3710039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.037+0000 7f370ffff640 1 -- 172.21.15.119:0/329676864 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f381408e830 con 0x559e145f6870 2024-04-23T18:29:37.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.037+0000 7f3823fff640 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3710036e60 0x7f3710039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.037+0000 7f382ae1f800 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e145f71d0 0x559e146f9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.037+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e146fa340 con 0x559e145f71d0 2024-04-23T18:29:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.037+0000 7f382911f640 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e145f71d0 0x559e146f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.037+0000 7f3823fff640 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3710036e60 0x7f3710039320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f381c000f60 tx=0x7f381c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.037+0000 7f382911f640 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e145f71d0 0x559e146f9dc0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.037+0000 7f382911f640 1 -- 172.21.15.119:0/329676864 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f382400a4a0 con 0x559e145f71d0 2024-04-23T18:29:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.037+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e146f7390 con 0x559e145f71d0 2024-04-23T18:29:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.038+0000 7f382911f640 1 -- 172.21.15.119:0/329676864 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f382400a4a0 con 0x559e145f71d0 2024-04-23T18:29:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.038+0000 7f382ae1f800 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e146fc670 0x559e146fea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.038+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e146ff100 con 0x559e146fc670 2024-04-23T18:29:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.038+0000 7f382891e640 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e146fc670 0x559e146fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.038+0000 7f382891e640 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e146fc670 0x559e146fea60 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.038+0000 7f382891e640 1 -- 172.21.15.119:0/329676864 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f381405a040 con 0x559e146fc670 2024-04-23T18:29:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.039+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e146fb620 con 0x559e145f71d0 2024-04-23T18:29:37.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.039+0000 7f382911f640 1 -- 172.21.15.119:0/329676864 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f382400a4a0 con 0x559e145f71d0 2024-04-23T18:29:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.039+0000 7f382ae1f800 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559e147005b0 0x559e14702a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.039+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14703180 con 0x559e147005b0 2024-04-23T18:29:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.039+0000 7f3823fff640 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559e147005b0 0x559e14702a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.039+0000 7f3823fff640 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559e147005b0 0x559e14702a20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.040+0000 7f3823fff640 1 -- 172.21.15.119:0/329676864 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f381c009050 con 0x559e147005b0 2024-04-23T18:29:37.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.040+0000 7f382ae1f800 1 Processor -- start 2024-04-23T18:29:37.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.040+0000 7f382ae1f800 1 -- start start 2024-04-23T18:29:37.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.040+0000 7f382ae1f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e147115b0 0x559e147119d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.040+0000 7f382ae1f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559e144e9df0 con 0x559e147115b0 2024-04-23T18:29:37.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.040+0000 7f382891e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e147115b0 0x559e147119d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.040+0000 7f382891e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e147115b0 0x559e147119d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49200/0 (socket says 172.21.15.119:49200) 2024-04-23T18:29:37.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.040+0000 7f382891e640 1 -- 172.21.15.119:0/3289424212 learned_addr learned my addr 172.21.15.119:0/3289424212 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.040+0000 7f382891e640 1 -- 172.21.15.119:0/3289424212 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e14711f10 con 0x559e147115b0 2024-04-23T18:29:37.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.041+0000 7f382891e640 1 --2- 172.21.15.119:0/3289424212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e147115b0 0x559e147119d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f381408cc20 tx=0x7f3814072de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.041+0000 7f370d7fa640 1 -- 172.21.15.119:0/3289424212 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f381408eb90 con 0x559e147115b0 2024-04-23T18:29:37.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.041+0000 7f370d7fa640 1 -- 172.21.15.119:0/3289424212 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381408ed30 con 0x559e147115b0 2024-04-23T18:29:37.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.041+0000 7f382ae1f800 1 -- 172.21.15.119:0/3289424212 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e14712980 con 0x559e147115b0 2024-04-23T18:29:37.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.041+0000 7f370d7fa640 1 -- 172.21.15.119:0/3289424212 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3814009540 con 0x559e147115b0 2024-04-23T18:29:37.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.041+0000 7f382ae1f800 1 -- 172.21.15.119:0/3289424212 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e14712e80 con 0x559e147115b0 2024-04-23T18:29:37.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.042+0000 7f370d7fa640 1 -- 172.21.15.119:0/3289424212 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f38140096e0 con 0x559e147115b0 2024-04-23T18:29:37.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.042+0000 7f370d7fa640 1 --2- 172.21.15.119:0/3289424212 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3700036e60 0x7f3700039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.042+0000 7f370d7fa640 1 -- 172.21.15.119:0/3289424212 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3814089030 con 0x559e147115b0 2024-04-23T18:29:37.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.042+0000 7f3823fff640 1 --2- 172.21.15.119:0/3289424212 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3700036e60 0x7f3700039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.042+0000 7f382ae1f800 1 Processor -- start 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.042+0000 7f382ae1f800 1 -- start start 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.042+0000 7f3823fff640 1 --2- 172.21.15.119:0/3289424212 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3700036e60 0x7f3700039320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f381c00bf50 tx=0x7f381c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.042+0000 7f382ae1f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e1471e760 0x559e1471eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.042+0000 7f382ae1f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559e146ebb60 con 0x559e1471e760 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.042+0000 7f382891e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e1471e760 0x559e1471eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.042+0000 7f382891e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e1471e760 0x559e1471eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49212/0 (socket says 172.21.15.119:49212) 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.042+0000 7f382891e640 1 -- 172.21.15.119:0/976499752 learned_addr learned my addr 172.21.15.119:0/976499752 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.043+0000 7f382891e640 1 -- 172.21.15.119:0/976499752 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e1471f130 con 0x559e1471e760 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.043+0000 7f382891e640 1 --2- 172.21.15.119:0/976499752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e1471e760 0x559e1471eb60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f381408cc80 tx=0x7f381406e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da97d42ee183081 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.043+0000 7f3706ffd640 1 -- 172.21.15.119:0/976499752 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38140aa070 con 0x559e1471e760 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.043+0000 7f3706ffd640 1 -- 172.21.15.119:0/976499752 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f381408b710 con 0x559e1471e760 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.043+0000 7f3706ffd640 1 -- 172.21.15.119:0/976499752 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3814067700 con 0x559e1471e760 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.043+0000 7f382ae1f800 1 -- 172.21.15.119:0/976499752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e1471e760 msgr2=0x559e1471eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.043+0000 7f382ae1f800 1 --2- 172.21.15.119:0/976499752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e1471e760 0x559e1471eb60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f381408cc80 tx=0x7f381406e720 comp rx=0 tx=0).stop 2024-04-23T18:29:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.043+0000 7f382ae1f800 1 -- 172.21.15.119:0/976499752 shutdown_connections 2024-04-23T18:29:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.043+0000 7f382ae1f800 1 --2- 172.21.15.119:0/976499752 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e1471e760 0x559e1471eb60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.043+0000 7f382ae1f800 1 -- 172.21.15.119:0/976499752 >> 172.21.15.119:0/976499752 conn(0x559e1471aa30 msgr2=0x559e14718a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.043+0000 7f382ae1f800 1 -- 172.21.15.119:0/976499752 shutdown_connections 2024-04-23T18:29:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.043+0000 7f382ae1f800 1 -- 172.21.15.119:0/976499752 wait complete. 2024-04-23T18:29:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.044+0000 7f382ae1f800 1 Processor -- start 2024-04-23T18:29:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.044+0000 7f382ae1f800 1 -- start start 2024-04-23T18:29:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.044+0000 7f382ae1f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e1471e760 0x559e14725ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.044+0000 7f382ae1f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559e1471f820 con 0x559e1471e760 2024-04-23T18:29:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.044+0000 7f382891e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e1471e760 0x559e14725ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.044+0000 7f382891e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e1471e760 0x559e14725ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49220/0 (socket says 172.21.15.119:49220) 2024-04-23T18:29:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.044+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 learned_addr learned my addr 172.21.15.119:0/953682007 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.044+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e147260e0 con 0x559e1471e760 2024-04-23T18:29:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.045+0000 7f382891e640 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e1471e760 0x559e14725ba0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f381400a430 tx=0x7f3814002d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.045+0000 7f37057fa640 1 -- 172.21.15.119:0/953682007 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38140b5070 con 0x559e1471e760 2024-04-23T18:29:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.045+0000 7f37057fa640 1 -- 172.21.15.119:0/953682007 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38140675d0 con 0x559e1471e760 2024-04-23T18:29:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.045+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e147260e0 con 0x559e1471e760 2024-04-23T18:29:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.045+0000 7f37057fa640 1 -- 172.21.15.119:0/953682007 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38140aa040 con 0x559e1471e760 2024-04-23T18:29:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.045+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e147260e0 con 0x559e1471e760 2024-04-23T18:29:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.045+0000 7f37057fa640 1 -- 172.21.15.119:0/953682007 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f38140b8070 con 0x559e1471e760 2024-04-23T18:29:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.046+0000 7f37057fa640 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36f0036e10 0x7f36f00392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.046+0000 7f37057fa640 1 -- 172.21.15.119:0/953682007 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f38140a2070 con 0x559e1471e760 2024-04-23T18:29:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.046+0000 7f3823fff640 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36f0036e10 0x7f36f00392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.046+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.046+0000 7f382ae1f800 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e14731280 0x559e14733740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.046+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14733e90 con 0x559e14731280 2024-04-23T18:29:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.046+0000 7f382911f640 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e14731280 0x559e14733740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.046+0000 7f3823fff640 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36f0036e10 0x7f36f00392d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f381c001b60 tx=0x7f381c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.046+0000 7f382911f640 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e14731280 0x559e14733740 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f382400a4a0 con 0x559e14731280 2024-04-23T18:29:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 20 realm 2024-04-23T18:29:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e147342a0 con 0x559e14731280 2024-04-23T18:29:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f382400a4a0 con 0x559e14731280 2024-04-23T18:29:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14734b70 con 0x559e14731280 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f382400a4a0 con 0x559e14731280 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14731280 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f382400a4a0 con 0x559e14731280 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e14735a40 0x559e14737e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14738570 con 0x559e14735a40 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.047+0000 7f382891e640 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e14735a40 0x559e14737e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.048+0000 7f382891e640 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e14735a40 0x559e14737e30 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.048+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f38140c1070 con 0x559e14735a40 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.048+0000 7f382ae1f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:37.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.048+0000 7f382ae1f800 20 searching for the correct realm 2024-04-23T18:29:37.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.048+0000 7f382ae1f800 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559e1473a5d0 0x559e1473ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.048+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e1473d140 con 0x559e1473a5d0 2024-04-23T18:29:37.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.048+0000 7f3823fff640 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559e1473a5d0 0x559e1473ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.048+0000 7f3823fff640 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559e1473a5d0 0x559e1473ca70 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.049+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.049+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e1473d140 con 0x559e14735a40 2024-04-23T18:29:37.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.049+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38140c1070 con 0x559e14735a40 2024-04-23T18:29:37.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.049+0000 7f382891e640 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f38140ba070 0x7f3814076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.049+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e1473d140 con 0x7f38140ba070 2024-04-23T18:29:37.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.049+0000 7f382911f640 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f38140ba070 0x7f3814076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.049+0000 7f382911f640 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f38140ba070 0x7f3814076a10 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.050+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382400a4a0 con 0x7f38140ba070 2024-04-23T18:29:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.050+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14731280 2024-04-23T18:29:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.050+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382400a4a0 con 0x559e14731280 2024-04-23T18:29:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.050+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14731280 2024-04-23T18:29:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.050+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382400a4a0 con 0x559e14731280 2024-04-23T18:29:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.050+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x7f38140ba070 2024-04-23T18:29:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.050+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382400a4a0 con 0x7f38140ba070 2024-04-23T18:29:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.050+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x7f38140ba070 2024-04-23T18:29:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.051+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f382400a4a0 con 0x7f38140ba070 2024-04-23T18:29:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.051+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14735a40 2024-04-23T18:29:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.051+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38140c1070 con 0x559e14735a40 2024-04-23T18:29:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.051+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e1473a5d0 2024-04-23T18:29:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.051+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.051+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14731280 2024-04-23T18:29:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.051+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382400a4a0 con 0x559e14731280 2024-04-23T18:29:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.051+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x7f38140ba070 2024-04-23T18:29:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.052+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382400a4a0 con 0x7f38140ba070 2024-04-23T18:29:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.052+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14731280 2024-04-23T18:29:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.052+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382400a4a0 con 0x559e14731280 2024-04-23T18:29:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.052+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14735a40 2024-04-23T18:29:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.052+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f38140c1070 con 0x559e14735a40 2024-04-23T18:29:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.052+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e1473a5d0 2024-04-23T18:29:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.052+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.052+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e1473a5d0 2024-04-23T18:29:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.053+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.053+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x7f38140ba070 2024-04-23T18:29:37.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.053+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382400a4a0 con 0x7f38140ba070 2024-04-23T18:29:37.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.053+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e1473a5d0 2024-04-23T18:29:37.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.053+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.053+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e1473a5d0 2024-04-23T18:29:37.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.053+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.053+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14731280 2024-04-23T18:29:37.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.054+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382400a4a0 con 0x559e14731280 2024-04-23T18:29:37.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.054+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14731280 2024-04-23T18:29:37.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.054+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f382400a4a0 con 0x559e14731280 2024-04-23T18:29:37.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.054+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x7f38140ba070 2024-04-23T18:29:37.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.054+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382400a4a0 con 0x7f38140ba070 2024-04-23T18:29:37.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.054+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e1473a5d0 2024-04-23T18:29:37.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.054+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.054+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14735a40 2024-04-23T18:29:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.055+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f38140c1070 con 0x559e14735a40 2024-04-23T18:29:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.055+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14731280 2024-04-23T18:29:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.055+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382400a4a0 con 0x559e14731280 2024-04-23T18:29:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.055+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x7f38140ba070 2024-04-23T18:29:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.055+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382400a4a0 con 0x7f38140ba070 2024-04-23T18:29:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.055+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e1473a5d0 2024-04-23T18:29:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.055+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.055+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x7f38140ba070 2024-04-23T18:29:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.056+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f382400a4a0 con 0x7f38140ba070 2024-04-23T18:29:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.056+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14735a40 2024-04-23T18:29:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.056+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38140c1070 con 0x559e14735a40 2024-04-23T18:29:37.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.056+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e1473a5d0 2024-04-23T18:29:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.056+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.056+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x7f38140ba070 2024-04-23T18:29:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.056+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.056+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14731280 2024-04-23T18:29:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3824040040 con 0x559e14731280 2024-04-23T18:29:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559e14734f10 con 0x559e14735a40 2024-04-23T18:29:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38140d4040 con 0x559e14735a40 2024-04-23T18:29:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:37.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:37.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14738ef0 con 0x559e14731280 2024-04-23T18:29:37.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3824040040 con 0x559e14731280 2024-04-23T18:29:37.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14738ef0 con 0x559e14731280 2024-04-23T18:29:37.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3824040040 con 0x559e14731280 2024-04-23T18:29:37.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:37.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.057+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14738ec0 con 0x7f38140ba070 2024-04-23T18:29:37.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.058+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.058+0000 7f382ae1f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.058+0000 7f382ae1f800 20 zone default found 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.058+0000 7f382ae1f800 4 Realm: () 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.058+0000 7f382ae1f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.058+0000 7f382ae1f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.058+0000 7f382ae1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.058+0000 7f382ae1f800 20 zonegroup default 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.058+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.058+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e147392e0 con 0x7f38140ba070 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.058+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.059+0000 7f382ae1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.059+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.059+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14739720 con 0x559e1473a5d0 2024-04-23T18:29:37.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.059+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.059+0000 7f382ae1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.059+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.059+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e1473efa0 con 0x559e1473a5d0 2024-04-23T18:29:37.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.059+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.059+0000 7f382ae1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.059+0000 7f382ae1f800 20 started sync module instance, tier type = 2024-04-23T18:29:37.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.059+0000 7f382ae1f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:37.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.059+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e1473e440 con 0x559e14735a40 2024-04-23T18:29:37.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.060+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38140d4040 con 0x559e14735a40 2024-04-23T18:29:37.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.060+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94137436331920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e1473f340 con 0x559e14735a40 2024-04-23T18:29:37.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.060+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e1473fb90 con 0x559e14731280 2024-04-23T18:29:37.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.061+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94137436331920] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38140d4040 con 0x559e14735a40 2024-04-23T18:29:37.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.061+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x559e14731280 2024-04-23T18:29:37.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.061+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94137436337888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e1473ffb0 con 0x559e14731280 2024-04-23T18:29:37.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.061+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e14740800 con 0x559e1473a5d0 2024-04-23T18:29:37.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.062+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.062+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94137436340656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e147410e0 con 0x559e1473a5d0 2024-04-23T18:29:37.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.063+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e14741bd0 con 0x559e14735a40 2024-04-23T18:29:37.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.063+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94137436337888] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x559e14731280 2024-04-23T18:29:37.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.064+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38140d4040 con 0x559e14735a40 2024-04-23T18:29:37.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.064+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94137436338944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e14742470 con 0x559e14735a40 2024-04-23T18:29:37.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.064+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e14742e30 con 0x559e14731280 2024-04-23T18:29:37.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.064+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94137436340656] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.065+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x559e14731280 2024-04-23T18:29:37.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.065+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94137436343280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e14742e30 con 0x559e14731280 2024-04-23T18:29:37.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.065+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94137436338944] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38140d4040 con 0x559e14735a40 2024-04-23T18:29:37.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.065+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e14741fc0 con 0x7f38140ba070 2024-04-23T18:29:37.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.066+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94137436343280] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x559e14731280 2024-04-23T18:29:37.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.066+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.066+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94137436350848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e14742da0 con 0x7f38140ba070 2024-04-23T18:29:37.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.066+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e14743ca0 con 0x7f38140ba070 2024-04-23T18:29:37.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.067+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(56 notify.6 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.067+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94137436354544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e147440c0 con 0x7f38140ba070 2024-04-23T18:29:37.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.067+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e14744ba0 con 0x7f38140ba070 2024-04-23T18:29:37.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.067+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94137436350848] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.068+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(58 notify.7 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.068+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94137436354544] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.068+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94137436358320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e14743340 con 0x7f38140ba070 2024-04-23T18:29:37.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.068+0000 7f382ae1f800 20 add_watcher() i=0 2024-04-23T18:29:37.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.068+0000 7f382ae1f800 20 add_watcher() i=1 2024-04-23T18:29:37.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.068+0000 7f382ae1f800 20 add_watcher() i=2 2024-04-23T18:29:37.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.068+0000 7f382ae1f800 20 add_watcher() i=3 2024-04-23T18:29:37.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.068+0000 7f382ae1f800 20 add_watcher() i=4 2024-04-23T18:29:37.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.068+0000 7f382ae1f800 20 add_watcher() i=5 2024-04-23T18:29:37.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.068+0000 7f382ae1f800 20 add_watcher() i=6 2024-04-23T18:29:37.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.069+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94137436358320] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.069+0000 7f382ae1f800 20 add_watcher() i=7 2024-04-23T18:29:37.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.069+0000 7f382ae1f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:37.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.069+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14747bd0 con 0x559e14731280 2024-04-23T18:29:37.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.069+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3824040040 con 0x559e14731280 2024-04-23T18:29:37.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.069+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94137436355600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e14745080 con 0x559e14731280 2024-04-23T18:29:37.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.070+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94137436355600] v32'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3824040040 con 0x559e14731280 2024-04-23T18:29:37.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.070+0000 7f36ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:37.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.070+0000 7f382ae1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:37.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.070+0000 7f382ae1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:37.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.070+0000 7f382ae1f800 5 note: GC not initialized 2024-04-23T18:29:37.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.071+0000 7f36dcfe1640 20 reqs_thread_entry: start 2024-04-23T18:29:37.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.071+0000 7f382ae1f800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:37.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.071+0000 7f382ae1f800 20 Filter name: none 2024-04-23T18:29:37.087 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.071+0000 7f36567fc640 20 reqs_thread_entry: start 2024-04-23T18:29:37.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.071+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.071+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e1477b000 con 0x559e14735a40 2024-04-23T18:29:37.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.071+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f38140d4040 con 0x559e14735a40 2024-04-23T18:29:37.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.071+0000 7f382ae1f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:37.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.071+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.071+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:63 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e1477b930 con 0x559e1473a5d0 2024-04-23T18:29:37.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(63 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:37.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-23T18:29:37.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e1477b420 con 0x559e14735a40 2024-04-23T18:29:37.088 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f38140d4040 con 0x559e14735a40 2024-04-23T18:29:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:65 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e1477d4b0 con 0x559e1473a5d0 2024-04-23T18:29:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(65 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-23T18:29:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 4.3e 4:7dbf76af:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e1477cee0 con 0x559e14735a40 2024-04-23T18:29:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 4.1 4:81f4b350:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14781e00 con 0x559e14735a40 2024-04-23T18:29:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 4.11 4:891fea53:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14784900 con 0x7f38140ba070 2024-04-23T18:29:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 4.21 4:842d5f4d:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14787170 con 0x7f38140ba070 2024-04-23T18:29:37.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:70 4.25 4:a75c3a3c:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14789d00 con 0x559e1473a5d0 2024-04-23T18:29:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 4.14 4:28337734:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e1478cba0 con 0x559e1473a5d0 2024-04-23T18:29:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 4.1c 4:39198531:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e1478f700 con 0x7f38140ba070 2024-04-23T18:29:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.072+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 4.1c 4:3a706890:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14791f70 con 0x7f38140ba070 2024-04-23T18:29:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:74 4.0 4:03724c23:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14794de0 con 0x559e1473a5d0 2024-04-23T18:29:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:75 4.3d 4:bc4cc370:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e14797c20 con 0x559e1473a5d0 2024-04-23T18:29:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 4.1e 4:7a26d6dd:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559e1479a630 con 0x7f38140ba070 2024-04-23T18:29:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f38140db040 con 0x559e14735a40 2024-04-23T18:29:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(66 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f38140db040 con 0x559e14735a40 2024-04-23T18:29:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(69 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(70 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(72 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.6 [call out=124b] v0'0 uv6 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(71 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(68 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(74 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(75 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(76 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.073+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(73 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.074+0000 7f36ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:37.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.074+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94137436355600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e1479a630 con 0x559e14731280 2024-04-23T18:29:37.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.075+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94137436355600] v32'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3824040040 con 0x559e14731280 2024-04-23T18:29:37.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.075+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94137436331920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e1479a630 con 0x559e14735a40 2024-04-23T18:29:37.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.076+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94137436331920] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38140db040 con 0x559e14735a40 2024-04-23T18:29:37.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.076+0000 7f382ae1f800 20 remove_watcher() i=0 2024-04-23T18:29:37.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.076+0000 7f382ae1f800 2 removed watcher, disabling cache 2024-04-23T18:29:37.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.076+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94137436337888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e1479a630 con 0x559e14731280 2024-04-23T18:29:37.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.077+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94137436337888] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x559e14731280 2024-04-23T18:29:37.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.077+0000 7f382ae1f800 20 remove_watcher() i=1 2024-04-23T18:29:37.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.077+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94137436340656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e1479a630 con 0x559e1473a5d0 2024-04-23T18:29:37.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.078+0000 7f3823fff640 1 -- 172.21.15.119:0/953682007 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94137436340656] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f381c009050 con 0x559e1473a5d0 2024-04-23T18:29:37.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.078+0000 7f382ae1f800 20 remove_watcher() i=2 2024-04-23T18:29:37.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.078+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94137436338944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e1479a630 con 0x559e14735a40 2024-04-23T18:29:37.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.079+0000 7f382891e640 1 -- 172.21.15.119:0/953682007 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94137436338944] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38140db040 con 0x559e14735a40 2024-04-23T18:29:37.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.079+0000 7f382ae1f800 20 remove_watcher() i=3 2024-04-23T18:29:37.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.079+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94137436343280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e1479a630 con 0x559e14731280 2024-04-23T18:29:37.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.080+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94137436343280] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x559e14731280 2024-04-23T18:29:37.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.080+0000 7f382ae1f800 20 remove_watcher() i=4 2024-04-23T18:29:37.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.080+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94137436350848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e1479a630 con 0x7f38140ba070 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.081+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94137436350848] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.081+0000 7f382ae1f800 20 remove_watcher() i=5 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.081+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94137436354544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e1478cba0 con 0x7f38140ba070 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.082+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94137436354544] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.082+0000 7f382ae1f800 20 remove_watcher() i=6 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.082+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94137436358320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559e1478cba0 con 0x7f38140ba070 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94137436358320] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3824040040 con 0x7f38140ba070 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 20 remove_watcher() i=7 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f38140ba070 msgr2=0x7f3814076a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f38140ba070 0x7f3814076a10 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e14731280 msgr2=0x559e14733740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e14731280 0x559e14733740 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e14735a40 msgr2=0x559e14737e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e14735a40 0x559e14737e30 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559e1473a5d0 msgr2=0x559e1473ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559e1473a5d0 0x559e1473ca70 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36f0036e10 msgr2=0x7f36f00392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f36f0036e10 0x7f36f00392d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f381c001b60 tx=0x7f381c010000 comp rx=0 tx=0).stop 2024-04-23T18:29:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e1471e760 msgr2=0x559e14725ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 --2- 172.21.15.119:0/953682007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e1471e760 0x559e14725ba0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f381400a430 tx=0x7f3814002d50 comp rx=0 tx=0).stop 2024-04-23T18:29:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 reap_dead start 2024-04-23T18:29:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382911f640 1 -- 172.21.15.119:0/953682007 reap_dead start 2024-04-23T18:29:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 shutdown_connections 2024-04-23T18:29:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 >> 172.21.15.119:0/953682007 conn(0x559e1471aa30 msgr2=0x559e14718090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 shutdown_connections 2024-04-23T18:29:37.094 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.083+0000 7f382ae1f800 1 -- 172.21.15.119:0/953682007 wait complete. 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/3289424212 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3700036e60 msgr2=0x7f3700039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 --2- 172.21.15.119:0/3289424212 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3700036e60 0x7f3700039320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f381c00bf50 tx=0x7f381c00f000 comp rx=0 tx=0).stop 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/3289424212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e147115b0 msgr2=0x559e147119d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 --2- 172.21.15.119:0/3289424212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e147115b0 0x559e147119d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f381408cc20 tx=0x7f3814072de0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/3289424212 shutdown_connections 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 --2- 172.21.15.119:0/3289424212 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3700036e60 0x7f3700039320 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 --2- 172.21.15.119:0/3289424212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e147115b0 0x559e147119d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/3289424212 >> 172.21.15.119:0/3289424212 conn(0x559e14705650 msgr2=0x559e14705a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/3289424212 shutdown_connections 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/3289424212 wait complete. 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559e147005b0 msgr2=0x559e14702a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559e147005b0 0x559e14702a20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e145f71d0 msgr2=0x559e146f9dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e145f71d0 0x559e146f9dc0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e146fc670 msgr2=0x559e146fea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e146fc670 0x559e146fea60 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3710036e60 msgr2=0x7f3710039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3710036e60 0x7f3710039320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f381c000f60 tx=0x7f381c0012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 msgr2=0x559e146f2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 --2- 172.21.15.119:0/329676864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e145f6870 0x559e146f2d50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f381401ce60 tx=0x7f3814002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382911f640 1 -- 172.21.15.119:0/329676864 reap_dead start 2024-04-23T18:29:37.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 shutdown_connections 2024-04-23T18:29:37.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 >> 172.21.15.119:0/329676864 conn(0x559e145f2410 msgr2=0x559e146e5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 shutdown_connections 2024-04-23T18:29:37.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.084+0000 7f382ae1f800 1 -- 172.21.15.119:0/329676864 wait complete. 2024-04-23T18:29:37.097 INFO:teuthology.orchestra.run.smithi119.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"4f165054-0d30-4e3c-af82-245e56f34813","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1","marker":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-23T18:29:36.570151Z","creation_time":"2024-04-23T18:29:33.450324Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-23T18:29:37.097 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4f165054-0d30-4e3c-af82-245e56f34813', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1', 'marker': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-23T18:29:36.570151Z', 'creation_time': '2024-04-23T18:29:33.450324Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-23T18:29:37.097 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-04-23T18:29:37.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-04-23T18:29:37.098 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-04-23T18:29:37.179 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:37.179 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.188+0000 7fb1adb2b800 1 Processor -- start 2024-04-23T18:29:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.188+0000 7fb1adb2b800 1 -- start start 2024-04-23T18:29:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.188+0000 7fb1adb2b800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b9c1c73020 0x55b9c1d02b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.188+0000 7fb1adb2b800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b9c1bb0560 con 0x55b9c1d03080 2024-04-23T18:29:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.188+0000 7fb1adb2b800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55b9c1ba1e20 con 0x55b9c1c73020 2024-04-23T18:29:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.188+0000 7fb1a98ef640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b9c1c73020 0x55b9c1d02b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.188+0000 7fb1a98ef640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b9c1c73020 0x55b9c1d02b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49228/0 (socket says 172.21.15.119:49228) 2024-04-23T18:29:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.188+0000 7fb1a10ee640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55b9c1d03080 0x55b9c1d05540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:47516/0 (socket says 172.21.15.119:47516) 2024-04-23T18:29:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.188+0000 7fb1a98ef640 1 -- 172.21.15.119:0/4053859984 learned_addr learned my addr 172.21.15.119:0/4053859984 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.188+0000 7fb1a98ef640 1 -- 172.21.15.119:0/4053859984 >> v1:172.21.15.62:6789/0 conn(0x55b9c1d03080 legacy=0x55b9c1d05540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.188+0000 7fb1a98ef640 1 -- 172.21.15.119:0/4053859984 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9c1bafe60 con 0x55b9c1c73020 2024-04-23T18:29:37.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.190+0000 7fb1a98ef640 1 --2- 172.21.15.119:0/4053859984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1d02b10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00a520 tx=0x7fb19c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be5d2054ae7f4c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.190+0000 7fb1a90ee640 1 -- 172.21.15.119:0/4053859984 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c057070 con 0x55b9c1c73020 2024-04-23T18:29:37.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.190+0000 7fb1a90ee640 1 -- 172.21.15.119:0/4053859984 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c052570 con 0x55b9c1c73020 2024-04-23T18:29:37.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.190+0000 7fb1a90ee640 1 -- 172.21.15.119:0/4053859984 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c04ae60 con 0x55b9c1c73020 2024-04-23T18:29:37.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.191+0000 7fb1adb2b800 1 -- 172.21.15.119:0/4053859984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 msgr2=0x55b9c1d02b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.191+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/4053859984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1d02b10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00a520 tx=0x7fb19c01d010 comp rx=0 tx=0).stop 2024-04-23T18:29:37.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.191+0000 7fb1adb2b800 1 -- 172.21.15.119:0/4053859984 shutdown_connections 2024-04-23T18:29:37.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.191+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/4053859984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1d02b10 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.191+0000 7fb1adb2b800 1 -- 172.21.15.119:0/4053859984 >> 172.21.15.119:0/4053859984 conn(0x55b9c1cfa410 msgr2=0x55b9c1cfc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.191+0000 7fb1adb2b800 1 -- 172.21.15.119:0/4053859984 shutdown_connections 2024-04-23T18:29:37.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.191+0000 7fb1adb2b800 1 -- 172.21.15.119:0/4053859984 wait complete. 2024-04-23T18:29:37.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.202+0000 7fb1adb2b800 1 Processor -- start 2024-04-23T18:29:37.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.203+0000 7fb1adb2b800 1 -- start start 2024-04-23T18:29:37.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.203+0000 7fb1adb2b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1d00440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.203+0000 7fb1adb2b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b9c1c4b5a0 con 0x55b9c1c73020 2024-04-23T18:29:37.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.203+0000 7fb1a98ef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1d00440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.203+0000 7fb1a98ef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1d00440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49232/0 (socket says 172.21.15.119:49232) 2024-04-23T18:29:37.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.203+0000 7fb1a98ef640 1 -- 172.21.15.119:0/2264811393 learned_addr learned my addr 172.21.15.119:0/2264811393 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.203+0000 7fb1a98ef640 1 -- 172.21.15.119:0/2264811393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9c1bc1860 con 0x55b9c1c73020 2024-04-23T18:29:37.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.203+0000 7fb1a98ef640 1 --2- 172.21.15.119:0/2264811393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1d00440 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb19c01d050 tx=0x7fb19c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23938da64a238bc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.204+0000 7fb097e07640 1 -- 172.21.15.119:0/2264811393 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c057040 con 0x55b9c1c73020 2024-04-23T18:29:37.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.204+0000 7fb097e07640 1 -- 172.21.15.119:0/2264811393 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c052720 con 0x55b9c1c73020 2024-04-23T18:29:37.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.204+0000 7fb097e07640 1 -- 172.21.15.119:0/2264811393 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c052a40 con 0x55b9c1c73020 2024-04-23T18:29:37.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.204+0000 7fb1adb2b800 1 -- 172.21.15.119:0/2264811393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 msgr2=0x55b9c1d00440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.204+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/2264811393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1d00440 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb19c01d050 tx=0x7fb19c04c000 comp rx=0 tx=0).stop 2024-04-23T18:29:37.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.204+0000 7fb1adb2b800 1 -- 172.21.15.119:0/2264811393 shutdown_connections 2024-04-23T18:29:37.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.204+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/2264811393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1d00440 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.204+0000 7fb1adb2b800 1 -- 172.21.15.119:0/2264811393 >> 172.21.15.119:0/2264811393 conn(0x55b9c1cfa410 msgr2=0x55b9c1decab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.204+0000 7fb1adb2b800 1 -- 172.21.15.119:0/2264811393 shutdown_connections 2024-04-23T18:29:37.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.204+0000 7fb1adb2b800 1 -- 172.21.15.119:0/2264811393 wait complete. 2024-04-23T18:29:37.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.205+0000 7fb1adb2b800 1 Processor -- start 2024-04-23T18:29:37.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.205+0000 7fb1adb2b800 1 -- start start 2024-04-23T18:29:37.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.205+0000 7fb1adb2b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1dfac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.205+0000 7fb1adb2b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b9c1d07070 con 0x55b9c1c73020 2024-04-23T18:29:37.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.205+0000 7fb1a98ef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1dfac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.205+0000 7fb1a98ef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1dfac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49240/0 (socket says 172.21.15.119:49240) 2024-04-23T18:29:37.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.205+0000 7fb1a98ef640 1 -- 172.21.15.119:0/3242517725 learned_addr learned my addr 172.21.15.119:0/3242517725 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.205+0000 7fb1a98ef640 1 -- 172.21.15.119:0/3242517725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9c1bbfeb0 con 0x55b9c1c73020 2024-04-23T18:29:37.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.205+0000 7fb1a98ef640 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1dfac20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb19c01cfe0 tx=0x7fb19c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.206+0000 7fb096604640 1 -- 172.21.15.119:0/3242517725 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c073070 con 0x55b9c1c73020 2024-04-23T18:29:37.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.206+0000 7fb096604640 1 -- 172.21.15.119:0/3242517725 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c05d440 con 0x55b9c1c73020 2024-04-23T18:29:37.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.206+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9c1dfb160 con 0x55b9c1c73020 2024-04-23T18:29:37.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.206+0000 7fb096604640 1 -- 172.21.15.119:0/3242517725 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c057070 con 0x55b9c1c73020 2024-04-23T18:29:37.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.206+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9c1dfb680 con 0x55b9c1c73020 2024-04-23T18:29:37.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.206+0000 7fb096604640 1 -- 172.21.15.119:0/3242517725 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb19c076070 con 0x55b9c1c73020 2024-04-23T18:29:37.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.207+0000 7fb096604640 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb090036e60 0x7fb090039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.207+0000 7fb096604640 1 -- 172.21.15.119:0/3242517725 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb19c08e390 con 0x55b9c1c73020 2024-04-23T18:29:37.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.207+0000 7fb1a10ee640 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb090036e60 0x7fb090039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.207+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9c1d03080 0x55b9c1e01c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.207+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e02210 con 0x55b9c1d03080 2024-04-23T18:29:37.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.207+0000 7fb1aa0f0640 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9c1d03080 0x55b9c1e01c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.207+0000 7fb1a10ee640 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb090036e60 0x7fb090039320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb194000f60 tx=0x7fb194001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.207+0000 7fb1aa0f0640 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9c1d03080 0x55b9c1e01c90 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.207+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/3242517725 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1d03080 2024-04-23T18:29:37.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.207+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1dff260 con 0x55b9c1d03080 2024-04-23T18:29:37.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.208+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/3242517725 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1d03080 2024-04-23T18:29:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.208+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9c1e04560 0x55b9c1e06950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.208+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e07040 con 0x55b9c1e04560 2024-04-23T18:29:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.208+0000 7fb1a98ef640 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9c1e04560 0x55b9c1e06950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.208+0000 7fb1a98ef640 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9c1e04560 0x55b9c1e06950 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.208+0000 7fb1a98ef640 1 -- 172.21.15.119:0/3242517725 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e04560 2024-04-23T18:29:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.208+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e03510 con 0x55b9c1d03080 2024-04-23T18:29:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.209+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/3242517725 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1d03080 2024-04-23T18:29:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.209+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b9c1e084a0 0x55b9c1e0a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.209+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e0b0c0 con 0x55b9c1e084a0 2024-04-23T18:29:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.209+0000 7fb1a10ee640 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b9c1e084a0 0x55b9c1e0a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.209+0000 7fb1a10ee640 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b9c1e084a0 0x55b9c1e0a930 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.210+0000 7fb1a10ee640 1 -- 172.21.15.119:0/3242517725 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb19400f690 con 0x55b9c1e084a0 2024-04-23T18:29:37.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.210+0000 7fb1adb2b800 1 Processor -- start 2024-04-23T18:29:37.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.210+0000 7fb1adb2b800 1 -- start start 2024-04-23T18:29:37.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.210+0000 7fb1adb2b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e19520 0x55b9c1e19940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.210+0000 7fb1adb2b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b9c1bf1df0 con 0x55b9c1e19520 2024-04-23T18:29:37.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.210+0000 7fb1a98ef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e19520 0x55b9c1e19940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.210+0000 7fb1a98ef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e19520 0x55b9c1e19940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49246/0 (socket says 172.21.15.119:49246) 2024-04-23T18:29:37.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.210+0000 7fb1a98ef640 1 -- 172.21.15.119:0/69780104 learned_addr learned my addr 172.21.15.119:0/69780104 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.211+0000 7fb1a98ef640 1 -- 172.21.15.119:0/69780104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9c1e19e80 con 0x55b9c1e19520 2024-04-23T18:29:37.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.211+0000 7fb1a98ef640 1 --2- 172.21.15.119:0/69780104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e19520 0x55b9c1e19940 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb19c005910 tx=0x7fb19c076420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.211+0000 7fb08f7fe640 1 -- 172.21.15.119:0/69780104 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c08b2e0 con 0x55b9c1e19520 2024-04-23T18:29:37.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.211+0000 7fb08f7fe640 1 -- 172.21.15.119:0/69780104 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c08caf0 con 0x55b9c1e19520 2024-04-23T18:29:37.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.211+0000 7fb1adb2b800 1 -- 172.21.15.119:0/69780104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9c1e1a8f0 con 0x55b9c1e19520 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.211+0000 7fb08f7fe640 1 -- 172.21.15.119:0/69780104 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c08cdd0 con 0x55b9c1e19520 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.211+0000 7fb1adb2b800 1 -- 172.21.15.119:0/69780104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9c1e1adf0 con 0x55b9c1e19520 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.212+0000 7fb08f7fe640 1 -- 172.21.15.119:0/69780104 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb19c077a50 con 0x55b9c1e19520 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.212+0000 7fb08f7fe640 1 --2- 172.21.15.119:0/69780104 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb084036e60 0x7fb084039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.212+0000 7fb08f7fe640 1 -- 172.21.15.119:0/69780104 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb19c0532f0 con 0x55b9c1e19520 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.212+0000 7fb1a10ee640 1 --2- 172.21.15.119:0/69780104 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb084036e60 0x7fb084039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.212+0000 7fb1adb2b800 1 Processor -- start 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.212+0000 7fb1adb2b800 1 -- start start 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.212+0000 7fb1a10ee640 1 --2- 172.21.15.119:0/69780104 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb084036e60 0x7fb084039320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55b9c1e02b10 tx=0x7fb19400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.212+0000 7fb1adb2b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 0x55b9c1e26ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.212+0000 7fb1adb2b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b9c1cfea00 con 0x55b9c1e266d0 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.212+0000 7fb1a98ef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 0x55b9c1e26ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.212+0000 7fb1a98ef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 0x55b9c1e26ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49252/0 (socket says 172.21.15.119:49252) 2024-04-23T18:29:37.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.212+0000 7fb1a98ef640 1 -- 172.21.15.119:0/2550558430 learned_addr learned my addr 172.21.15.119:0/2550558430 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.213+0000 7fb1a98ef640 1 -- 172.21.15.119:0/2550558430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9c1e27080 con 0x55b9c1e266d0 2024-04-23T18:29:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.213+0000 7fb1a98ef640 1 --2- 172.21.15.119:0/2550558430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 0x55b9c1e26ab0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb19c069010 tx=0x7fb19c081380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28fc92c11856540 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.213+0000 7fb08d7fa640 1 -- 172.21.15.119:0/2550558430 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c05b340 con 0x55b9c1e266d0 2024-04-23T18:29:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.213+0000 7fb08d7fa640 1 -- 172.21.15.119:0/2550558430 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c081560 con 0x55b9c1e266d0 2024-04-23T18:29:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.213+0000 7fb08d7fa640 1 -- 172.21.15.119:0/2550558430 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c077d40 con 0x55b9c1e266d0 2024-04-23T18:29:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.213+0000 7fb1adb2b800 1 -- 172.21.15.119:0/2550558430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 msgr2=0x55b9c1e26ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.213+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/2550558430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 0x55b9c1e26ab0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb19c069010 tx=0x7fb19c081380 comp rx=0 tx=0).stop 2024-04-23T18:29:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.213+0000 7fb1adb2b800 1 -- 172.21.15.119:0/2550558430 shutdown_connections 2024-04-23T18:29:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.214+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/2550558430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 0x55b9c1e26ab0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.214+0000 7fb1adb2b800 1 -- 172.21.15.119:0/2550558430 >> 172.21.15.119:0/2550558430 conn(0x55b9c1e229a0 msgr2=0x55b9c1e20a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.214+0000 7fb1adb2b800 1 -- 172.21.15.119:0/2550558430 shutdown_connections 2024-04-23T18:29:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.214+0000 7fb1adb2b800 1 -- 172.21.15.119:0/2550558430 wait complete. 2024-04-23T18:29:37.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.214+0000 7fb1adb2b800 1 Processor -- start 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.214+0000 7fb1adb2b800 1 -- start start 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.214+0000 7fb1adb2b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 0x55b9c1e2d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.214+0000 7fb1adb2b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b9c1e27790 con 0x55b9c1e266d0 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.214+0000 7fb1a98ef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 0x55b9c1e2d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.214+0000 7fb1a98ef640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 0x55b9c1e2d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49256/0 (socket says 172.21.15.119:49256) 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.214+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 learned_addr learned my addr 172.21.15.119:0/323579122 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.214+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9c1e2df00 con 0x55b9c1e266d0 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.215+0000 7fb1a98ef640 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 0x55b9c1e2d9c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb19c08b510 tx=0x7fb19c053020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.215+0000 7fb07b7fe640 1 -- 172.21.15.119:0/323579122 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c072aa0 con 0x55b9c1e266d0 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.215+0000 7fb07b7fe640 1 -- 172.21.15.119:0/323579122 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c0ac070 con 0x55b9c1e266d0 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.215+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9c1e2df00 con 0x55b9c1e266d0 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.215+0000 7fb07b7fe640 1 -- 172.21.15.119:0/323579122 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c072db0 con 0x55b9c1e266d0 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.215+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9c1e2df00 con 0x55b9c1e266d0 2024-04-23T18:29:37.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.215+0000 7fb07b7fe640 1 -- 172.21.15.119:0/323579122 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb19c0773b0 con 0x55b9c1e266d0 2024-04-23T18:29:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.216+0000 7fb07b7fe640 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb074036eb0 0x7fb074039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.216+0000 7fb07b7fe640 1 -- 172.21.15.119:0/323579122 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb19c09d1b0 con 0x55b9c1e266d0 2024-04-23T18:29:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.216+0000 7fb1a10ee640 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb074036eb0 0x7fb074039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.216+0000 7fb1adb2b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.216+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9c1e38ef0 0x55b9c1e3b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.216+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3bb00 con 0x55b9c1e38ef0 2024-04-23T18:29:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.216+0000 7fb1aa0f0640 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9c1e38ef0 0x55b9c1e3b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.216+0000 7fb1a10ee640 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb074036eb0 0x7fb074039370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55b9c1e0b4c0 tx=0x7fb194010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.216+0000 7fb1aa0f0640 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9c1e38ef0 0x55b9c1e3b3b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1e38ef0 2024-04-23T18:29:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 20 realm 2024-04-23T18:29:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3bf10 con 0x55b9c1e38ef0 2024-04-23T18:29:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1e38ef0 2024-04-23T18:29:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3c7e0 con 0x55b9c1e38ef0 2024-04-23T18:29:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1e38ef0 2024-04-23T18:29:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e38ef0 2024-04-23T18:29:37.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1e38ef0 2024-04-23T18:29:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9c1e3d670 0x55b9c1e3fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e401a0 con 0x55b9c1e3d670 2024-04-23T18:29:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.217+0000 7fb1a98ef640 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9c1e3d670 0x55b9c1e3fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.218+0000 7fb1a98ef640 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9c1e3d670 0x55b9c1e3fa60 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.218+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.218+0000 7fb1adb2b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.218+0000 7fb1adb2b800 20 searching for the correct realm 2024-04-23T18:29:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.218+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b9c1e42240 0x55b9c1e44700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.218+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e44dd0 con 0x55b9c1e42240 2024-04-23T18:29:37.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.218+0000 7fb1a10ee640 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b9c1e42240 0x55b9c1e44700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.218+0000 7fb1a10ee640 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b9c1e42240 0x55b9c1e44700 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.219+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.219+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e44dd0 con 0x55b9c1e3d670 2024-04-23T18:29:37.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.219+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.219+0000 7fb1a98ef640 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb19c078060 0x7fb19c05b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.219+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e44dd0 con 0x7fb19c078060 2024-04-23T18:29:37.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.219+0000 7fb1aa0f0640 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb19c078060 0x7fb19c05b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.220+0000 7fb1aa0f0640 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb19c078060 0x7fb19c05b9d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.220+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb19c078060 2024-04-23T18:29:37.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.220+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e38ef0 2024-04-23T18:29:37.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.220+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1e38ef0 2024-04-23T18:29:37.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.220+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e38ef0 2024-04-23T18:29:37.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.220+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1e38ef0 2024-04-23T18:29:37.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.220+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x7fb19c078060 2024-04-23T18:29:37.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.220+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb19c078060 2024-04-23T18:29:37.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.221+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x7fb19c078060 2024-04-23T18:29:37.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.221+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb19c078060 2024-04-23T18:29:37.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.221+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e3d670 2024-04-23T18:29:37.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.221+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.221+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e42240 2024-04-23T18:29:37.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.221+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.221+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e38ef0 2024-04-23T18:29:37.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.221+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1e38ef0 2024-04-23T18:29:37.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.221+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x7fb19c078060 2024-04-23T18:29:37.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.222+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb19c078060 2024-04-23T18:29:37.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.222+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e38ef0 2024-04-23T18:29:37.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.222+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1e38ef0 2024-04-23T18:29:37.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.222+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e3d670 2024-04-23T18:29:37.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.222+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.222+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e42240 2024-04-23T18:29:37.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.222+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.222+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e42240 2024-04-23T18:29:37.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.223+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.223+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x7fb19c078060 2024-04-23T18:29:37.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.223+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb19c078060 2024-04-23T18:29:37.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.223+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e42240 2024-04-23T18:29:37.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.223+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.223+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e42240 2024-04-23T18:29:37.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.223+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.223+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e38ef0 2024-04-23T18:29:37.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.224+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1e38ef0 2024-04-23T18:29:37.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.224+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e38ef0 2024-04-23T18:29:37.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.224+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1e38ef0 2024-04-23T18:29:37.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.224+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x7fb19c078060 2024-04-23T18:29:37.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.224+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb19c078060 2024-04-23T18:29:37.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.224+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e42240 2024-04-23T18:29:37.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.225+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.225+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e3d670 2024-04-23T18:29:37.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.225+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.225+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e38ef0 2024-04-23T18:29:37.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.225+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x55b9c1e38ef0 2024-04-23T18:29:37.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.225+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x7fb19c078060 2024-04-23T18:29:37.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.225+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb19c078060 2024-04-23T18:29:37.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.225+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e42240 2024-04-23T18:29:37.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.226+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.226+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x7fb19c078060 2024-04-23T18:29:37.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.226+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a400a4a0 con 0x7fb19c078060 2024-04-23T18:29:37.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.226+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e3d670 2024-04-23T18:29:37.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.226+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.226+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e42240 2024-04-23T18:29:37.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.226+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.226+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x7fb19c078060 2024-04-23T18:29:37.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e38ef0 2024-04-23T18:29:37.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e3cb80 con 0x55b9c1e3d670 2024-04-23T18:29:37.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1adb2b800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:37.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1adb2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:37.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1adb2b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:37.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1adb2b800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:37.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1adb2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:37.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1adb2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:37.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1adb2b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e40b40 con 0x55b9c1e38ef0 2024-04-23T18:29:37.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1adb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1adb2b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.227+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e40b40 con 0x55b9c1e38ef0 2024-04-23T18:29:37.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:37.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e40af0 con 0x7fb19c078060 2024-04-23T18:29:37.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:37.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 20 zone default found 2024-04-23T18:29:37.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 4 Realm: () 2024-04-23T18:29:37.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:37.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:37.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:37.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 20 zonegroup default 2024-04-23T18:29:37.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e40f30 con 0x7fb19c078060 2024-04-23T18:29:37.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.228+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e41370 con 0x55b9c1e42240 2024-04-23T18:29:37.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.229+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.229+0000 7fb1adb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.229+0000 7fb1adb2b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.229+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e46c30 con 0x55b9c1e42240 2024-04-23T18:29:37.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.229+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.229+0000 7fb1adb2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.229+0000 7fb1adb2b800 20 started sync module instance, tier type = 2024-04-23T18:29:37.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.229+0000 7fb1adb2b800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:37.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.229+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e460d0 con 0x55b9c1e3d670 2024-04-23T18:29:37.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.230+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.230+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94256310279200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e46fd0 con 0x55b9c1e3d670 2024-04-23T18:29:37.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.230+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e47820 con 0x55b9c1e38ef0 2024-04-23T18:29:37.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.231+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94256310279200] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.231+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.231+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94256310285168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e47c40 con 0x55b9c1e38ef0 2024-04-23T18:29:37.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.231+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e48600 con 0x55b9c1e42240 2024-04-23T18:29:37.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.232+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.232+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94256310288720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e48e50 con 0x55b9c1e42240 2024-04-23T18:29:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.232+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94256310285168] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.232+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e477d0 con 0x55b9c1e3d670 2024-04-23T18:29:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.233+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.233+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94256310293872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49f40 con 0x55b9c1e3d670 2024-04-23T18:29:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.233+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e4aa60 con 0x55b9c1e38ef0 2024-04-23T18:29:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.233+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94256310288720] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.234+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.234+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94256310293872] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.234+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94256310297904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e489a0 con 0x55b9c1e38ef0 2024-04-23T18:29:37.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.235+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e4b340 con 0x7fb19c078060 2024-04-23T18:29:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.235+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94256310297904] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.236+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.236+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94256310294992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e4b280 con 0x7fb19c078060 2024-04-23T18:29:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.236+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e4bd50 con 0x7fb19c078060 2024-04-23T18:29:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.237+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94256310294992] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.237+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.237+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94256310300592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e4bd50 con 0x7fb19c078060 2024-04-23T18:29:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.237+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e4c710 con 0x7fb19c078060 2024-04-23T18:29:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.238+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94256310300592] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.238+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.238+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94256310303360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e4c710 con 0x7fb19c078060 2024-04-23T18:29:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.238+0000 7fb1adb2b800 20 add_watcher() i=0 2024-04-23T18:29:37.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.238+0000 7fb1adb2b800 20 add_watcher() i=1 2024-04-23T18:29:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.238+0000 7fb1adb2b800 20 add_watcher() i=2 2024-04-23T18:29:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.238+0000 7fb1adb2b800 20 add_watcher() i=3 2024-04-23T18:29:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.238+0000 7fb1adb2b800 20 add_watcher() i=4 2024-04-23T18:29:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.238+0000 7fb1adb2b800 20 add_watcher() i=5 2024-04-23T18:29:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.238+0000 7fb1adb2b800 20 add_watcher() i=6 2024-04-23T18:29:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.239+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94256310303360] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.239+0000 7fb1adb2b800 20 add_watcher() i=7 2024-04-23T18:29:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.239+0000 7fb1adb2b800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.239+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e4fb10 con 0x55b9c1e38ef0 2024-04-23T18:29:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.239+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.239+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94256310305840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e4d000 con 0x55b9c1e38ef0 2024-04-23T18:29:37.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.240+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94256310305840] v32'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.240+0000 7fb05b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:37.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.240+0000 7fb1adb2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:37.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.240+0000 7fb1adb2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:37.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.240+0000 7fb1adb2b800 5 note: GC not initialized 2024-04-23T18:29:37.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.240+0000 7fb05a7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:37.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.241+0000 7fb1adb2b800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:37.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.241+0000 7fb1adb2b800 20 Filter name: none 2024-04-23T18:29:37.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.241+0000 7fafcbfff640 20 reqs_thread_entry: start 2024-04-23T18:29:37.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.241+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e82780 con 0x7fb19c078060 2024-04-23T18:29:37.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.241+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(62 [pgnls start_epoch 32 out=254b] v32'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.241+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x7fb19c078060 2024-04-23T18:29:37.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.242+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(63 [pgnls start_epoch 32 out=131b] v32'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.242+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e42240 2024-04-23T18:29:37.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.242+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.242+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x7fb19c078060 2024-04-23T18:29:37.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.242+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(65 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.242+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.243+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(66 [pgnls start_epoch 32 out=335b] v32'147 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.243+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e3d670 2024-04-23T18:29:37.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.243+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(67 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.243+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49f40 con 0x55b9c1e42240 2024-04-23T18:29:37.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.243+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(68 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.243+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49f40 con 0x55b9c1e42240 2024-04-23T18:29:37.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.243+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(69 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.243+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49f40 con 0x55b9c1e42240 2024-04-23T18:29:37.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.244+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(70 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.244+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49f40 con 0x55b9c1e3d670 2024-04-23T18:29:37.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.244+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(71 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.244+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49f40 con 0x55b9c1e3d670 2024-04-23T18:29:37.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.244+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(72 [pgnls start_epoch 32 out=336b] v32'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.244+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49f40 con 0x55b9c1e42240 2024-04-23T18:29:37.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.244+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=131b] v32'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.244+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49f40 con 0x55b9c1e42240 2024-04-23T18:29:37.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.245+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=254b] v32'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.245+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49f40 con 0x55b9c1e42240 2024-04-23T18:29:37.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.245+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(75 [pgnls start_epoch 32 out=90b] v32'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.245+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49f40 con 0x55b9c1e38ef0 2024-04-23T18:29:37.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.245+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(76 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.245+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e42240 2024-04-23T18:29:37.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.246+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.246+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.246+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(78 [pgnls start_epoch 32 out=254b] v32'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.246+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e42240 2024-04-23T18:29:37.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.246+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(79 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.246+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e42240 2024-04-23T18:29:37.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.246+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(80 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.246+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.247+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(81 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.247+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e3d670 2024-04-23T18:29:37.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.247+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(82 [pgnls start_epoch 32 out=276b] v32'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.247+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e3d670 2024-04-23T18:29:37.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.247+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(83 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.247+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.247+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(84 [pgnls start_epoch 32 out=295b] v32'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.247+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x7fb19c078060 2024-04-23T18:29:37.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.248+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(85 [pgnls start_epoch 32 out=172b] v32'29 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.248+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e3d670 2024-04-23T18:29:37.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.248+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(86 [pgnls start_epoch 32 out=213b] v32'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.248+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x7fb19c078060 2024-04-23T18:29:37.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.249+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(87 [pgnls start_epoch 32 out=172b] v32'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.249+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e42240 2024-04-23T18:29:37.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.249+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(88 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.249+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e42240 2024-04-23T18:29:37.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.249+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(89 [pgnls start_epoch 32 out=90b] v32'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.249+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e42240 2024-04-23T18:29:37.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.250+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(90 [pgnls start_epoch 32 out=90b] v32'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.250+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.250+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(91 [pgnls start_epoch 32 out=131b] v32'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.250+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x55b9c1e3d670 2024-04-23T18:29:37.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.250+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(92 [pgnls start_epoch 32 out=295b] v32'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.250+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb1a4045040 con 0x7fb19c078060 2024-04-23T18:29:37.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.251+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(93 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.259 INFO:teuthology.orchestra.run.smithi119.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-04-23T18:29:37.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.253+0000 7fb05b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:37.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.253+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94256310305840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49f40 con 0x55b9c1e38ef0 2024-04-23T18:29:37.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.254+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94256310305840] v32'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.254+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94256310279200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e80c70 con 0x55b9c1e3d670 2024-04-23T18:29:37.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.254+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94256310279200] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.255+0000 7fb1adb2b800 20 remove_watcher() i=0 2024-04-23T18:29:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.255+0000 7fb1adb2b800 2 removed watcher, disabling cache 2024-04-23T18:29:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.255+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94256310285168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49f40 con 0x55b9c1e38ef0 2024-04-23T18:29:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.256+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94256310285168] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.256+0000 7fb1adb2b800 20 remove_watcher() i=1 2024-04-23T18:29:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.256+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94256310288720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49f40 con 0x55b9c1e42240 2024-04-23T18:29:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.257+0000 7fb1a10ee640 1 -- 172.21.15.119:0/323579122 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94256310288720] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb194037040 con 0x55b9c1e42240 2024-04-23T18:29:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.257+0000 7fb1adb2b800 20 remove_watcher() i=2 2024-04-23T18:29:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.257+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94256310293872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e47370 con 0x55b9c1e3d670 2024-04-23T18:29:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.258+0000 7fb1a98ef640 1 -- 172.21.15.119:0/323579122 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94256310293872] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c075030 con 0x55b9c1e3d670 2024-04-23T18:29:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.258+0000 7fb1adb2b800 20 remove_watcher() i=3 2024-04-23T18:29:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.258+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94256310297904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e48150 con 0x55b9c1e38ef0 2024-04-23T18:29:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.259+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94256310297904] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x55b9c1e38ef0 2024-04-23T18:29:37.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.259+0000 7fb1adb2b800 20 remove_watcher() i=4 2024-04-23T18:29:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.259+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94256310294992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e49570 con 0x7fb19c078060 2024-04-23T18:29:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.260+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94256310294992] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.260+0000 7fb1adb2b800 20 remove_watcher() i=5 2024-04-23T18:29:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.260+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94256310300592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e47370 con 0x7fb19c078060 2024-04-23T18:29:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.261+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94256310300592] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.261+0000 7fb1adb2b800 20 remove_watcher() i=6 2024-04-23T18:29:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.261+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94256310303360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9c1e4a530 con 0x7fb19c078060 2024-04-23T18:29:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.262+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94256310303360] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a4040040 con 0x7fb19c078060 2024-04-23T18:29:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.262+0000 7fb1adb2b800 20 remove_watcher() i=7 2024-04-23T18:29:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb19c078060 msgr2=0x7fb19c05b9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb19c078060 0x7fb19c05b9d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9c1e38ef0 msgr2=0x55b9c1e3b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9c1e38ef0 0x55b9c1e3b3b0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9c1e3d670 msgr2=0x55b9c1e3fa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9c1e3d670 0x55b9c1e3fa60 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b9c1e42240 msgr2=0x55b9c1e44700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b9c1e42240 0x55b9c1e44700 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb074036eb0 msgr2=0x7fb074039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb074036eb0 0x7fb074039370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55b9c1e0b4c0 tx=0x7fb194010000 comp rx=0 tx=0).stop 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 msgr2=0x55b9c1e2d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/323579122 reap_dead start 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 0x55b9c1e2d9c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb19c08b510 tx=0x7fb19c053020 comp rx=0 tx=0).stop 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 shutdown_connections 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/323579122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e266d0 0x55b9c1e2d9c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 >> 172.21.15.119:0/323579122 conn(0x55b9c1e229a0 msgr2=0x55b9c1e20000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 shutdown_connections 2024-04-23T18:29:37.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/323579122 wait complete. 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/69780104 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb084036e60 msgr2=0x7fb084039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/69780104 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb084036e60 0x7fb084039320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55b9c1e02b10 tx=0x7fb19400f000 comp rx=0 tx=0).stop 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/69780104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e19520 msgr2=0x55b9c1e19940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/69780104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e19520 0x55b9c1e19940 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb19c005910 tx=0x7fb19c076420 comp rx=0 tx=0).stop 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/69780104 shutdown_connections 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/69780104 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb084036e60 0x7fb084039320 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/69780104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1e19520 0x55b9c1e19940 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/69780104 >> 172.21.15.119:0/69780104 conn(0x55b9c1e0d5c0 msgr2=0x55b9c1e0d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/69780104 shutdown_connections 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/69780104 wait complete. 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b9c1e084a0 msgr2=0x55b9c1e0a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.263+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b9c1e084a0 0x55b9c1e0a930 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.264+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9c1d03080 msgr2=0x55b9c1e01c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.264+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b9c1d03080 0x55b9c1e01c90 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.264+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9c1e04560 msgr2=0x55b9c1e06950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.264+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b9c1e04560 0x55b9c1e06950 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.264+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb090036e60 msgr2=0x7fb090039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.264+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb090036e60 0x7fb090039320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb194000f60 tx=0x7fb194001370 comp rx=0 tx=0).stop 2024-04-23T18:29:37.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.264+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 msgr2=0x55b9c1dfac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.264+0000 7fb1adb2b800 1 --2- 172.21.15.119:0/3242517725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b9c1c73020 0x55b9c1dfac20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb19c01cfe0 tx=0x7fb19c003020 comp rx=0 tx=0).stop 2024-04-23T18:29:37.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.264+0000 7fb1aa0f0640 1 -- 172.21.15.119:0/3242517725 reap_dead start 2024-04-23T18:29:37.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.264+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 shutdown_connections 2024-04-23T18:29:37.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.264+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 >> 172.21.15.119:0/3242517725 conn(0x55b9c1cfa410 msgr2=0x55b9c1dec680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.264+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 shutdown_connections 2024-04-23T18:29:37.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.264+0000 7fb1adb2b800 1 -- 172.21.15.119:0/3242517725 wait complete. 2024-04-23T18:29:37.271 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-04-23T18:29:37.271 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-23T18:29:37.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-23T18:29:37.271 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-23T18:29:37.349 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:37.350 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:37.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.358+0000 7f0a8052b800 1 Processor -- start 2024-04-23T18:29:37.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.358+0000 7f0a8052b800 1 -- start start 2024-04-23T18:29:37.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.358+0000 7f0a8052b800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560c97877870 0x560c97877c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.358+0000 7f0a8052b800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560c97729560 con 0x560c978781d0 2024-04-23T18:29:37.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.358+0000 7f0a8052b800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x560c9771ae20 con 0x560c97877870 2024-04-23T18:29:37.351 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.358+0000 7f0a7c159640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560c97877870 0x560c97877c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.358+0000 7f0a7b958640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x560c978781d0 0x560c97878680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:47530/0 (socket says 172.21.15.119:47530) 2024-04-23T18:29:37.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.358+0000 7f0a7b958640 1 -- 172.21.15.119:0/4192911974 learned_addr learned my addr 172.21.15.119:0/4192911974 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:37.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.359+0000 7f0a7c159640 1 -- 172.21.15.119:0/4192911974 >> v1:172.21.15.62:6789/0 conn(0x560c978781d0 legacy=0x560c97878680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.352 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.359+0000 7f0a7c159640 1 -- 172.21.15.119:0/4192911974 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c97728e60 con 0x560c97877870 2024-04-23T18:29:37.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.360+0000 7f0a7c159640 1 --2- 172.21.15.119:0/4192911974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c97877c90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000a470 tx=0x7f0a7001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b8fd778f2e2886 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.361+0000 7f0a7b157640 1 -- 172.21.15.119:0/4192911974 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a70057070 con 0x560c97877870 2024-04-23T18:29:37.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.361+0000 7f0a7b157640 1 -- 172.21.15.119:0/4192911974 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7004adc0 con 0x560c97877870 2024-04-23T18:29:37.353 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.361+0000 7f0a7b157640 1 -- 172.21.15.119:0/4192911974 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a70052590 con 0x560c97877870 2024-04-23T18:29:37.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.361+0000 7f0a8052b800 1 -- 172.21.15.119:0/4192911974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 msgr2=0x560c97877c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.361+0000 7f0a8052b800 1 --2- 172.21.15.119:0/4192911974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c97877c90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000a470 tx=0x7f0a7001ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:37.354 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.361+0000 7f0a8052b800 1 -- 172.21.15.119:0/4192911974 shutdown_connections 2024-04-23T18:29:37.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.361+0000 7f0a8052b800 1 --2- 172.21.15.119:0/4192911974 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c97877c90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.361+0000 7f0a8052b800 1 -- 172.21.15.119:0/4192911974 >> 172.21.15.119:0/4192911974 conn(0x560c97873410 msgr2=0x560c97875830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.361+0000 7f0a8052b800 1 -- 172.21.15.119:0/4192911974 shutdown_connections 2024-04-23T18:29:37.355 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.361+0000 7f0a8052b800 1 -- 172.21.15.119:0/4192911974 wait complete. 2024-04-23T18:29:37.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.373+0000 7f0a8052b800 1 Processor -- start 2024-04-23T18:29:37.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.373+0000 7f0a8052b800 1 -- start start 2024-04-23T18:29:37.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.373+0000 7f0a8052b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c9796c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.373+0000 7f0a8052b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560c977c45b0 con 0x560c97877870 2024-04-23T18:29:37.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.373+0000 7f0a7c159640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c9796c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.373+0000 7f0a7c159640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c9796c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49284/0 (socket says 172.21.15.119:49284) 2024-04-23T18:29:37.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.373+0000 7f0a7c159640 1 -- 172.21.15.119:0/4257212218 learned_addr learned my addr 172.21.15.119:0/4257212218 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.374+0000 7f0a7c159640 1 -- 172.21.15.119:0/4257212218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9773a860 con 0x560c97877870 2024-04-23T18:29:37.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.374+0000 7f0a7c159640 1 --2- 172.21.15.119:0/4257212218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c9796c4a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0a70055040 tx=0x7f0a7004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39d242f74f41d5f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.374+0000 7f096a60c640 1 -- 172.21.15.119:0/4257212218 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a70057040 con 0x560c97877870 2024-04-23T18:29:37.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.374+0000 7f096a60c640 1 -- 172.21.15.119:0/4257212218 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a70062070 con 0x560c97877870 2024-04-23T18:29:37.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.374+0000 7f096a60c640 1 -- 172.21.15.119:0/4257212218 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a7005d470 con 0x560c97877870 2024-04-23T18:29:37.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a8052b800 1 -- 172.21.15.119:0/4257212218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 msgr2=0x560c9796c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a8052b800 1 --2- 172.21.15.119:0/4257212218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c9796c4a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0a70055040 tx=0x7f0a7004c000 comp rx=0 tx=0).stop 2024-04-23T18:29:37.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a8052b800 1 -- 172.21.15.119:0/4257212218 shutdown_connections 2024-04-23T18:29:37.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a8052b800 1 --2- 172.21.15.119:0/4257212218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c9796c4a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a8052b800 1 -- 172.21.15.119:0/4257212218 >> 172.21.15.119:0/4257212218 conn(0x560c97873410 msgr2=0x560c97967dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a8052b800 1 -- 172.21.15.119:0/4257212218 shutdown_connections 2024-04-23T18:29:37.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a8052b800 1 -- 172.21.15.119:0/4257212218 wait complete. 2024-04-23T18:29:37.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a8052b800 1 Processor -- start 2024-04-23T18:29:37.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a8052b800 1 -- start start 2024-04-23T18:29:37.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a8052b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c97973d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a8052b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560c97879030 con 0x560c97877870 2024-04-23T18:29:37.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a7c159640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c97973d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a7c159640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c97973d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49288/0 (socket says 172.21.15.119:49288) 2024-04-23T18:29:37.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.375+0000 7f0a7c159640 1 -- 172.21.15.119:0/2012015474 learned_addr learned my addr 172.21.15.119:0/2012015474 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.376+0000 7f0a7c159640 1 -- 172.21.15.119:0/2012015474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c97738eb0 con 0x560c97877870 2024-04-23T18:29:37.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.376+0000 7f0a7c159640 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c97973d50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0a7001ce60 tx=0x7f0a70002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.376+0000 7f0968e09640 1 -- 172.21.15.119:0/2012015474 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a7006b070 con 0x560c97877870 2024-04-23T18:29:37.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.376+0000 7f0968e09640 1 -- 172.21.15.119:0/2012015474 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7005d970 con 0x560c97877870 2024-04-23T18:29:37.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.376+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c97974290 con 0x560c97877870 2024-04-23T18:29:37.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.376+0000 7f0968e09640 1 -- 172.21.15.119:0/2012015474 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a70057070 con 0x560c97877870 2024-04-23T18:29:37.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.376+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c979747b0 con 0x560c97877870 2024-04-23T18:29:37.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.377+0000 7f0968e09640 1 -- 172.21.15.119:0/2012015474 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0a7005dc90 con 0x560c97877870 2024-04-23T18:29:37.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.377+0000 7f0968e09640 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0964036eb0 0x7f0964039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.377+0000 7f0968e09640 1 -- 172.21.15.119:0/2012015474 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0a7008e7a0 con 0x560c97877870 2024-04-23T18:29:37.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.377+0000 7f0a7b958640 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0964036eb0 0x7f0964039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.377+0000 7f0a8052b800 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560c978781d0 0x560c9797adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.377+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c9797b300 con 0x560c978781d0 2024-04-23T18:29:37.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.377+0000 7f0a7c95a640 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560c978781d0 0x560c9797adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.378+0000 7f0a7b958640 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0964036eb0 0x7f0964039370 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c000f60 tx=0x7f0a6c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.378+0000 7f0a7c95a640 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560c978781d0 0x560c9797adc0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.378+0000 7f0a7c95a640 1 -- 172.21.15.119:0/2012015474 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c978781d0 2024-04-23T18:29:37.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.378+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c97978390 con 0x560c978781d0 2024-04-23T18:29:37.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.378+0000 7f0a7c95a640 1 -- 172.21.15.119:0/2012015474 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c978781d0 2024-04-23T18:29:37.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.378+0000 7f0a8052b800 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560c9797d610 0x560c9797fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.378+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979800a0 con 0x560c9797d610 2024-04-23T18:29:37.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.378+0000 7f0a7c159640 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560c9797d610 0x560c9797fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.379+0000 7f0a7c159640 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560c9797d610 0x560c9797fa00 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.379+0000 7f0a7c159640 1 -- 172.21.15.119:0/2012015474 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0a7005a040 con 0x560c9797d610 2024-04-23T18:29:37.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.379+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c9797c5c0 con 0x560c978781d0 2024-04-23T18:29:37.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.379+0000 7f0a7c95a640 1 -- 172.21.15.119:0/2012015474 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c978781d0 2024-04-23T18:29:37.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.379+0000 7f0a8052b800 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560c97981550 0x560c979839a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.379+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c97984100 con 0x560c97981550 2024-04-23T18:29:37.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.380+0000 7f0a7b958640 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560c97981550 0x560c979839a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.380+0000 7f0a7b958640 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560c97981550 0x560c979839a0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.380+0000 7f0a7b958640 1 -- 172.21.15.119:0/2012015474 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0a6c009050 con 0x560c97981550 2024-04-23T18:29:37.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.380+0000 7f0a8052b800 1 Processor -- start 2024-04-23T18:29:37.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.381+0000 7f0a8052b800 1 -- start start 2024-04-23T18:29:37.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.381+0000 7f0a8052b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97992560 0x560c97992980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.381+0000 7f0a8052b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560c9776adf0 con 0x560c97992560 2024-04-23T18:29:37.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.381+0000 7f0a7c159640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97992560 0x560c97992980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.381+0000 7f0a7c159640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97992560 0x560c97992980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49302/0 (socket says 172.21.15.119:49302) 2024-04-23T18:29:37.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.381+0000 7f0a7c159640 1 -- 172.21.15.119:0/185259444 learned_addr learned my addr 172.21.15.119:0/185259444 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.381+0000 7f0a7c159640 1 -- 172.21.15.119:0/185259444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c97992ec0 con 0x560c97992560 2024-04-23T18:29:37.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.381+0000 7f0a7c159640 1 --2- 172.21.15.119:0/185259444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97992560 0x560c97992980 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0a7008cbd0 tx=0x7f0a70072dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.381+0000 7f0961ffb640 1 -- 172.21.15.119:0/185259444 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a7008ea80 con 0x560c97992560 2024-04-23T18:29:37.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.381+0000 7f0961ffb640 1 -- 172.21.15.119:0/185259444 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7008ec20 con 0x560c97992560 2024-04-23T18:29:37.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.381+0000 7f0a8052b800 1 -- 172.21.15.119:0/185259444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c97993930 con 0x560c97992560 2024-04-23T18:29:37.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.381+0000 7f0961ffb640 1 -- 172.21.15.119:0/185259444 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a7008e050 con 0x560c97992560 2024-04-23T18:29:37.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.382+0000 7f0a8052b800 1 -- 172.21.15.119:0/185259444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c97993e30 con 0x560c97992560 2024-04-23T18:29:37.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.382+0000 7f0961ffb640 1 -- 172.21.15.119:0/185259444 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0a7008e1f0 con 0x560c97992560 2024-04-23T18:29:37.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.382+0000 7f0961ffb640 1 --2- 172.21.15.119:0/185259444 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0954036eb0 0x7f0954039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.382+0000 7f0961ffb640 1 -- 172.21.15.119:0/185259444 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0a70089030 con 0x560c97992560 2024-04-23T18:29:37.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.382+0000 7f0a7b958640 1 --2- 172.21.15.119:0/185259444 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0954036eb0 0x7f0954039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.383+0000 7f0a8052b800 1 Processor -- start 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.383+0000 7f0a8052b800 1 -- start start 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.383+0000 7f0a7b958640 1 --2- 172.21.15.119:0/185259444 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0954036eb0 0x7f0954039370 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00bf50 tx=0x7f0a6c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.383+0000 7f0a8052b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c9799f6c0 0x560c9799fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.383+0000 7f0a8052b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560c9796cb60 con 0x560c9799f6c0 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.383+0000 7f0a7c159640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c9799f6c0 0x560c9799fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.383+0000 7f0a7c159640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c9799f6c0 0x560c9799fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49306/0 (socket says 172.21.15.119:49306) 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.383+0000 7f0a7c159640 1 -- 172.21.15.119:0/108283701 learned_addr learned my addr 172.21.15.119:0/108283701 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.383+0000 7f0a7c159640 1 -- 172.21.15.119:0/108283701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c979a00b0 con 0x560c9799f6c0 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.383+0000 7f0a7c159640 1 --2- 172.21.15.119:0/108283701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c9799f6c0 0x560c9799fae0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0a70090040 tx=0x7f0a7008b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb236811b6bde5a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.383+0000 7f095b7fe640 1 -- 172.21.15.119:0/108283701 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a70009410 con 0x560c9799f6c0 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.383+0000 7f095b7fe640 1 -- 172.21.15.119:0/108283701 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a700675d0 con 0x560c9799f6c0 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.384+0000 7f095b7fe640 1 -- 172.21.15.119:0/108283701 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a700095b0 con 0x560c9799f6c0 2024-04-23T18:29:37.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.384+0000 7f0a8052b800 1 -- 172.21.15.119:0/108283701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c9799f6c0 msgr2=0x560c9799fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.384+0000 7f0a8052b800 1 --2- 172.21.15.119:0/108283701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c9799f6c0 0x560c9799fae0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0a70090040 tx=0x7f0a7008b380 comp rx=0 tx=0).stop 2024-04-23T18:29:37.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.384+0000 7f0a8052b800 1 -- 172.21.15.119:0/108283701 shutdown_connections 2024-04-23T18:29:37.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.384+0000 7f0a8052b800 1 --2- 172.21.15.119:0/108283701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c9799f6c0 0x560c9799fae0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.384+0000 7f0a8052b800 1 -- 172.21.15.119:0/108283701 >> 172.21.15.119:0/108283701 conn(0x560c9799ba20 msgr2=0x560c97999a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.384+0000 7f0a8052b800 1 -- 172.21.15.119:0/108283701 shutdown_connections 2024-04-23T18:29:37.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.384+0000 7f0a8052b800 1 -- 172.21.15.119:0/108283701 wait complete. 2024-04-23T18:29:37.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.384+0000 7f0a8052b800 1 Processor -- start 2024-04-23T18:29:37.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.384+0000 7f0a8052b800 1 -- start start 2024-04-23T18:29:37.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.384+0000 7f0a8052b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c9799f6c0 0x560c979a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.384+0000 7f0a8052b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560c979a0760 con 0x560c9799f6c0 2024-04-23T18:29:37.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.385+0000 7f0a7c159640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c9799f6c0 0x560c979a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.385+0000 7f0a7c159640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c9799f6c0 0x560c979a6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49322/0 (socket says 172.21.15.119:49322) 2024-04-23T18:29:37.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.385+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 learned_addr learned my addr 172.21.15.119:0/582751908 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.385+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c979a6fc0 con 0x560c9799f6c0 2024-04-23T18:29:37.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.385+0000 7f0a7c159640 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c9799f6c0 0x560c979a6a80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0a70067f90 tx=0x7f0a70063fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.385+0000 7f0959ffb640 1 -- 172.21.15.119:0/582751908 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a7007b190 con 0x560c9799f6c0 2024-04-23T18:29:37.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.385+0000 7f0959ffb640 1 -- 172.21.15.119:0/582751908 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a70074b30 con 0x560c9799f6c0 2024-04-23T18:29:37.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.385+0000 7f0959ffb640 1 -- 172.21.15.119:0/582751908 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a70074e50 con 0x560c9799f6c0 2024-04-23T18:29:37.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.385+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c979a6fc0 con 0x560c9799f6c0 2024-04-23T18:29:37.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.385+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c979a6fc0 con 0x560c9799f6c0 2024-04-23T18:29:37.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.386+0000 7f0959ffb640 1 -- 172.21.15.119:0/582751908 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0a700720c0 con 0x560c9799f6c0 2024-04-23T18:29:37.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.386+0000 7f0959ffb640 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f094c036eb0 0x7f094c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.386+0000 7f0959ffb640 1 -- 172.21.15.119:0/582751908 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0a700a2070 con 0x560c9799f6c0 2024-04-23T18:29:37.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.386+0000 7f0a7b958640 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f094c036eb0 0x7f094c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.387+0000 7f0a7b958640 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f094c036eb0 0x7f094c039370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c001b60 tx=0x7f0a6c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.387+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.387+0000 7f0a8052b800 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560c979b2190 0x560c979b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.387+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979b4da0 con 0x560c979b2190 2024-04-23T18:29:37.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.387+0000 7f0a7c95a640 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560c979b2190 0x560c979b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.387+0000 7f0a7c95a640 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560c979b2190 0x560c979b4650 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.387+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c979b2190 2024-04-23T18:29:37.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.387+0000 7f0a8052b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.387+0000 7f0a8052b800 20 realm 2024-04-23T18:29:37.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.387+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.387+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979b51b0 con 0x560c979b2190 2024-04-23T18:29:37.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c979b2190 2024-04-23T18:29:37.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a8052b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a8052b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:37.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5a80 con 0x560c979b2190 2024-04-23T18:29:37.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c979b2190 2024-04-23T18:29:37.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a8052b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b2190 2024-04-23T18:29:37.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c979b2190 2024-04-23T18:29:37.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a8052b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:37.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a8052b800 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560c979b6b80 0x560c979b8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979b9580 con 0x560c979b6b80 2024-04-23T18:29:37.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a7c159640 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560c979b6b80 0x560c979b8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.388+0000 7f0a7c159640 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560c979b6b80 0x560c979b8f70 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.389+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.389+0000 7f0a8052b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:37.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.389+0000 7f0a8052b800 20 searching for the correct realm 2024-04-23T18:29:37.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.389+0000 7f0a8052b800 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560c979bb530 0x560c979bd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.389+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979be0c0 con 0x560c979bb530 2024-04-23T18:29:37.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.389+0000 7f0a7b958640 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560c979bb530 0x560c979bd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.389+0000 7f0a7b958640 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560c979bb530 0x560c979bd9f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.389+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.389+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979be0c0 con 0x560c979b6b80 2024-04-23T18:29:37.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.390+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.390+0000 7f0a7c159640 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f0a700b0040 0x7f0a700513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.390+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979be0c0 con 0x7f0a700b0040 2024-04-23T18:29:37.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.390+0000 7f0a7c95a640 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f0a700b0040 0x7f0a700513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.390+0000 7f0a7c95a640 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f0a700b0040 0x7f0a700513a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.391+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7400a4a0 con 0x7f0a700b0040 2024-04-23T18:29:37.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.391+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b2190 2024-04-23T18:29:37.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.391+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c979b2190 2024-04-23T18:29:37.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.391+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b2190 2024-04-23T18:29:37.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.391+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c979b2190 2024-04-23T18:29:37.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.391+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x7f0a700b0040 2024-04-23T18:29:37.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.391+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7400a4a0 con 0x7f0a700b0040 2024-04-23T18:29:37.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.391+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x7f0a700b0040 2024-04-23T18:29:37.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.392+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0a7400a4a0 con 0x7f0a700b0040 2024-04-23T18:29:37.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.392+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b6b80 2024-04-23T18:29:37.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.392+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.392+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979bb530 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.392+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.392+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b2190 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.392+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c979b2190 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.392+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x7f0a700b0040 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.393+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7400a4a0 con 0x7f0a700b0040 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.393+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b2190 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.393+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c979b2190 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.393+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b6b80 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.393+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.393+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979bb530 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.393+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.393+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979bb530 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.394+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.394+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x7f0a700b0040 2024-04-23T18:29:37.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.394+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7400a4a0 con 0x7f0a700b0040 2024-04-23T18:29:37.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.394+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979bb530 2024-04-23T18:29:37.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.394+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.394+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979bb530 2024-04-23T18:29:37.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.395+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.395+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b2190 2024-04-23T18:29:37.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.395+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c979b2190 2024-04-23T18:29:37.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.395+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b2190 2024-04-23T18:29:37.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.395+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c979b2190 2024-04-23T18:29:37.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.395+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x7f0a700b0040 2024-04-23T18:29:37.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.395+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7400a4a0 con 0x7f0a700b0040 2024-04-23T18:29:37.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.395+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979bb530 2024-04-23T18:29:37.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.395+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.396+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b6b80 2024-04-23T18:29:37.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.396+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.396+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b2190 2024-04-23T18:29:37.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.396+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7400a4a0 con 0x560c979b2190 2024-04-23T18:29:37.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.396+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x7f0a700b0040 2024-04-23T18:29:37.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.396+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7400a4a0 con 0x7f0a700b0040 2024-04-23T18:29:37.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.396+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979bb530 2024-04-23T18:29:37.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.397+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.397+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x7f0a700b0040 2024-04-23T18:29:37.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.397+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7400a4a0 con 0x7f0a700b0040 2024-04-23T18:29:37.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.397+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b6b80 2024-04-23T18:29:37.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.397+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.397+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979bb530 2024-04-23T18:29:37.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.397+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.397+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x7f0a700b0040 2024-04-23T18:29:37.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b2190 2024-04-23T18:29:37.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c979b5e20 con 0x560c979b6b80 2024-04-23T18:29:37.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a8052b800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:37.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a8052b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:37.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a8052b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:37.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a8052b800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:37.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a8052b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:37.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a8052b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:37.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979b9e40 con 0x560c979b2190 2024-04-23T18:29:37.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a8052b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.398+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979b9e40 con 0x560c979b2190 2024-04-23T18:29:37.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:37.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979b9e40 con 0x7f0a700b0040 2024-04-23T18:29:37.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:37.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 20 zone default found 2024-04-23T18:29:37.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 4 Realm: () 2024-04-23T18:29:37.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:37.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:37.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:37.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 20 zonegroup default 2024-04-23T18:29:37.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979ba6e0 con 0x7f0a700b0040 2024-04-23T18:29:37.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979ba6e0 con 0x560c979bb530 2024-04-23T18:29:37.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.399+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.400+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979bff20 con 0x560c979bb530 2024-04-23T18:29:37.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.400+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.400+0000 7f0a8052b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.400+0000 7f0a8052b800 20 started sync module instance, tier type = 2024-04-23T18:29:37.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.400+0000 7f0a8052b800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:37.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.400+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979bf3c0 con 0x560c979b6b80 2024-04-23T18:29:37.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.401+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.401+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94612083175184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c02c0 con 0x560c979b6b80 2024-04-23T18:29:37.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.401+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c0b50 con 0x560c979b2190 2024-04-23T18:29:37.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.402+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94612083175184] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.402+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.402+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94612083177440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c0f40 con 0x560c979b2190 2024-04-23T18:29:37.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.402+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c19a0 con 0x560c979bb530 2024-04-23T18:29:37.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.403+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.403+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94612083184768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c2240 con 0x560c979bb530 2024-04-23T18:29:37.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.403+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c2d20 con 0x560c979b6b80 2024-04-23T18:29:37.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.403+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94612083177440] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.404+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94612083184768] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.404+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.404+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94612083189808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c3110 con 0x560c979b6b80 2024-04-23T18:29:37.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.404+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c3960 con 0x560c979b2190 2024-04-23T18:29:37.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.405+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.405+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94612083192592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c3dd0 con 0x560c979b2190 2024-04-23T18:29:37.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.405+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94612083189808] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.405+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c48f0 con 0x7f0a700b0040 2024-04-23T18:29:37.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.406+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94612083192592] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.406+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.406+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94612083196864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c48b0 con 0x7f0a700b0040 2024-04-23T18:29:37.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.406+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c5190 con 0x7f0a700b0040 2024-04-23T18:29:37.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.407+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(56 notify.6 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.407+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94612083199120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c48b0 con 0x7f0a700b0040 2024-04-23T18:29:37.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.407+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c5ce0 con 0x7f0a700b0040 2024-04-23T18:29:37.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.408+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94612083196864] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.408+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94612083199120] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.408+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.408+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94612083201968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c5ca0 con 0x7f0a700b0040 2024-04-23T18:29:37.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.408+0000 7f0a8052b800 20 add_watcher() i=0 2024-04-23T18:29:37.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.408+0000 7f0a8052b800 20 add_watcher() i=1 2024-04-23T18:29:37.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.408+0000 7f0a8052b800 20 add_watcher() i=2 2024-04-23T18:29:37.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.408+0000 7f0a8052b800 20 add_watcher() i=3 2024-04-23T18:29:37.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.408+0000 7f0a8052b800 20 add_watcher() i=4 2024-04-23T18:29:37.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.408+0000 7f0a8052b800 20 add_watcher() i=5 2024-04-23T18:29:37.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.408+0000 7f0a8052b800 20 add_watcher() i=6 2024-04-23T18:29:37.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.409+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94612083201968] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.409+0000 7f0a8052b800 20 add_watcher() i=7 2024-04-23T18:29:37.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.409+0000 7f0a8052b800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:37.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.409+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979c50b0 con 0x560c979b2190 2024-04-23T18:29:37.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.409+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.409+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94612083181152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979c50b0 con 0x560c979b2190 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.411+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94612083181152] v32'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.411+0000 7f09327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.411+0000 7f0a8052b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.411+0000 7f0a8052b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.411+0000 7f0a8052b800 5 note: GC not initialized 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.411+0000 7f09317e2640 20 reqs_thread_entry: start 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.411+0000 7f0a8052b800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.411+0000 7f0a8052b800 20 Filter name: none 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.411+0000 7f08a2ffd640 20 reqs_thread_entry: start 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.411+0000 7f0a8052b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.411+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.411+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979fc370 con 0x560c979b2190 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:37.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:37.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:37.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:37.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979fbe90 con 0x560c979b6b80 2024-04-23T18:29:37.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 20 disabling bucket name=myfoo 2024-04-23T18:29:37.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-23T18:29:37.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979fcde0 con 0x560c979b6b80 2024-04-23T18:29:37.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:37.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-23T18:29:37.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:37.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 : miss 2024-04-23T18:29:37.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.412+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:65 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c979fe6c0 con 0x560c979bb530 2024-04-23T18:29:37.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.413+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(65 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.413+0000 7f0a8052b800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:37.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.413+0000 7f0a8052b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:37.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.413+0000 7f0a8052b800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:37.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.413+0000 7f0a8052b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:37.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.413+0000 7f0a8052b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:37.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.413+0000 7f0a8052b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 2024-04-23T18:29:37.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.413+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c97a07790 con 0x560c979bb530 2024-04-23T18:29:37.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.414+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(66 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.414+0000 7f0a8052b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:37.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.414+0000 7f0a8052b800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:37.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.414+0000 7f0a8052b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:37.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.414+0000 7f0a8052b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1, ofs0, ns] 2024-04-23T18:29:37.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.414+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94612083452224 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c97a03210 con 0x7f0a700b0040 2024-04-23T18:29:37.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.414+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== watch-notify(notify (1) cookie 94612083199120 notify 137438953489 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f0a74018bf0 con 0x7f0a700b0040 2024-04-23T18:29:37.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.414+0000 7f095b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94612083199120 notifier 4588 bl.length()=752 2024-04-23T18:29:37.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.414+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(67 notify.6 [notify cookie 94612083452224 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.414+0000 7f095b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:37.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.414+0000 7f095b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:37.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.414+0000 7f095b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:37.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.414+0000 7f095b7fe640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0940003ea0 con 0x7f0a700b0040 2024-04-23T18:29:37.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.415+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.415+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== watch-notify(notify_complete (2) cookie 94612083452224 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0a74046450 con 0x7f0a700b0040 2024-04-23T18:29:37.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.415+0000 7f0a8052b800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): orig_sources= new_sources= 2024-04-23T18:29:37.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.415+0000 7f0a8052b800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): potential sources added=[] removed=[] 2024-04-23T18:29:37.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.415+0000 7f0a8052b800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): orig_dests= new_dests= 2024-04-23T18:29:37.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.415+0000 7f0a8052b800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): potential dests added=[] removed=[] 2024-04-23T18:29:37.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.415+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c97a063e0 con 0x560c979b2190 2024-04-23T18:29:37.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.416+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.416+0000 7f0a8052b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:37.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.416+0000 7f0a8052b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:37.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.416+0000 7f0a8052b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:37.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.416+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94612083468736 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c97a063e0 con 0x560c979b2190 2024-04-23T18:29:37.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.416+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify (1) cookie 94612083192592 notify 137438953492 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f0a74046450 con 0x560c979b2190 2024-04-23T18:29:37.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.416+0000 7f095b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94612083192592 notifier 4588 bl.length()=567 2024-04-23T18:29:37.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.416+0000 7f095b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:37.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.416+0000 7f095b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:37.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.416+0000 7f095b7fe640 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0940003ea0 con 0x560c979b2190 2024-04-23T18:29:37.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.416+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(70 notify.4 [notify cookie 94612083468736 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.417+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== watch-notify(notify_complete (2) cookie 94612083468736 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0a74046890 con 0x560c979b2190 2024-04-23T18:29:37.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.417+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.426 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:37.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.417+0000 7f09327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:37.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.417+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94612083181152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979e4af0 con 0x560c979b2190 2024-04-23T18:29:37.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.418+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94612083181152] v32'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.418+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94612083175184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979e4af0 con 0x560c979b6b80 2024-04-23T18:29:37.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.419+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94612083175184] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.419+0000 7f0a8052b800 20 remove_watcher() i=0 2024-04-23T18:29:37.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.419+0000 7f0a8052b800 2 removed watcher, disabling cache 2024-04-23T18:29:37.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.419+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94612083177440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979e4af0 con 0x560c979b2190 2024-04-23T18:29:37.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.420+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94612083177440] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.420+0000 7f0a8052b800 20 remove_watcher() i=1 2024-04-23T18:29:37.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.420+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94612083184768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979e4af0 con 0x560c979bb530 2024-04-23T18:29:37.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.421+0000 7f0a7b958640 1 -- 172.21.15.119:0/582751908 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94612083184768] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6c009050 con 0x560c979bb530 2024-04-23T18:29:37.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.421+0000 7f0a8052b800 20 remove_watcher() i=2 2024-04-23T18:29:37.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.421+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94612083189808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979e4af0 con 0x560c979b6b80 2024-04-23T18:29:37.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.422+0000 7f0a7c159640 1 -- 172.21.15.119:0/582751908 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94612083189808] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700bf020 con 0x560c979b6b80 2024-04-23T18:29:37.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.422+0000 7f0a8052b800 20 remove_watcher() i=3 2024-04-23T18:29:37.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.422+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94612083192592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979e4af0 con 0x560c979b2190 2024-04-23T18:29:37.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.423+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94612083192592] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x560c979b2190 2024-04-23T18:29:37.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.423+0000 7f0a8052b800 20 remove_watcher() i=4 2024-04-23T18:29:37.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.423+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94612083196864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979e4af0 con 0x7f0a700b0040 2024-04-23T18:29:37.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.424+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94612083196864] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.424+0000 7f0a8052b800 20 remove_watcher() i=5 2024-04-23T18:29:37.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.424+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94612083199120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979e4af0 con 0x7f0a700b0040 2024-04-23T18:29:37.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.425+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94612083199120] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.425+0000 7f0a8052b800 20 remove_watcher() i=6 2024-04-23T18:29:37.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.425+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94612083201968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c979e4af0 con 0x7f0a700b0040 2024-04-23T18:29:37.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.426+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94612083201968] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a74040040 con 0x7f0a700b0040 2024-04-23T18:29:37.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.426+0000 7f0a8052b800 20 remove_watcher() i=7 2024-04-23T18:29:37.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.426+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f0a700b0040 msgr2=0x7f0a700513a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.426+0000 7f0a8052b800 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f0a700b0040 0x7f0a700513a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560c979b2190 msgr2=0x560c979b4650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560c979b2190 0x560c979b4650 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560c979b6b80 msgr2=0x560c979b8f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560c979b6b80 0x560c979b8f70 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560c979bb530 msgr2=0x560c979bd9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560c979bb530 0x560c979bd9f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f094c036eb0 msgr2=0x7f094c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f094c036eb0 0x7f094c039370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c001b60 tx=0x7f0a6c010000 comp rx=0 tx=0).stop 2024-04-23T18:29:37.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c9799f6c0 msgr2=0x560c979a6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 --2- 172.21.15.119:0/582751908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c9799f6c0 0x560c979a6a80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0a70067f90 tx=0x7f0a70063fc0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 reap_dead start 2024-04-23T18:29:37.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a7c95a640 1 -- 172.21.15.119:0/582751908 reap_dead start 2024-04-23T18:29:37.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 shutdown_connections 2024-04-23T18:29:37.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 >> 172.21.15.119:0/582751908 conn(0x560c9799ba20 msgr2=0x560c97999080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 shutdown_connections 2024-04-23T18:29:37.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/582751908 wait complete. 2024-04-23T18:29:37.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/185259444 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0954036eb0 msgr2=0x7f0954039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 --2- 172.21.15.119:0/185259444 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0954036eb0 0x7f0954039370 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00bf50 tx=0x7f0a6c00f000 comp rx=0 tx=0).stop 2024-04-23T18:29:37.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/185259444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97992560 msgr2=0x560c97992980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 --2- 172.21.15.119:0/185259444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97992560 0x560c97992980 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0a7008cbd0 tx=0x7f0a70072dc0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/185259444 shutdown_connections 2024-04-23T18:29:37.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 --2- 172.21.15.119:0/185259444 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0954036eb0 0x7f0954039370 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 --2- 172.21.15.119:0/185259444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97992560 0x560c97992980 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/185259444 >> 172.21.15.119:0/185259444 conn(0x560c97986600 msgr2=0x560c97986a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/185259444 shutdown_connections 2024-04-23T18:29:37.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/185259444 wait complete. 2024-04-23T18:29:37.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560c97981550 msgr2=0x560c979839a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560c97981550 0x560c979839a0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560c978781d0 msgr2=0x560c9797adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560c978781d0 0x560c9797adc0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560c9797d610 msgr2=0x560c9797fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.427+0000 7f0a8052b800 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560c9797d610 0x560c9797fa00 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.428+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0964036eb0 msgr2=0x7f0964039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.428+0000 7f0a8052b800 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0964036eb0 0x7f0964039370 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c000f60 tx=0x7f0a6c0012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.428+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 msgr2=0x560c97973d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.428+0000 7f0a8052b800 1 --2- 172.21.15.119:0/2012015474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560c97877870 0x560c97973d50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0a7001ce60 tx=0x7f0a70002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.428+0000 7f0a7c95a640 1 -- 172.21.15.119:0/2012015474 reap_dead start 2024-04-23T18:29:37.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.428+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 shutdown_connections 2024-04-23T18:29:37.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.428+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 >> 172.21.15.119:0/2012015474 conn(0x560c97873410 msgr2=0x560c97966680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.428+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 shutdown_connections 2024-04-23T18:29:37.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.428+0000 7f0a8052b800 1 -- 172.21.15.119:0/2012015474 wait complete. 2024-04-23T18:29:37.438 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:37.440 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-23T18:29:37.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-23T18:29:37.441 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-23T18:29:37.483 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:37.483 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:37.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.491+0000 7f754df33800 1 Processor -- start 2024-04-23T18:29:37.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.491+0000 7f754df33800 1 -- start start 2024-04-23T18:29:37.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.491+0000 7f754df33800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f73ad18500 0x55f73ad1a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.491+0000 7f754df33800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f73abc4560 con 0x55f73ad149f0 2024-04-23T18:29:37.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.491+0000 7f754df33800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55f73abb5e20 con 0x55f73ad18500 2024-04-23T18:29:37.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.492+0000 7f75414f1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f73ad18500 0x55f73ad1a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.492+0000 7f75414f1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f73ad18500 0x55f73ad1a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49324/0 (socket says 172.21.15.119:49324) 2024-04-23T18:29:37.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.492+0000 7f75414f1640 1 -- 172.21.15.119:0/2849041605 learned_addr learned my addr 172.21.15.119:0/2849041605 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.492+0000 7f75414f1640 1 -- 172.21.15.119:0/2849041605 >> v1:172.21.15.62:6789/0 conn(0x55f73ad149f0 legacy=0x55f73ad16de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.492+0000 7f75414f1640 1 -- 172.21.15.119:0/2849041605 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73abc3e60 con 0x55f73ad18500 2024-04-23T18:29:37.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.494+0000 7f75414f1640 1 --2- 172.21.15.119:0/2849041605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad18500 0x55f73ad1a8f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f753400a520 tx=0x7f753401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bb3d0380592c07 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.494+0000 7f75494f1640 1 -- 172.21.15.119:0/2849041605 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7534057070 con 0x55f73ad18500 2024-04-23T18:29:37.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.494+0000 7f75494f1640 1 -- 172.21.15.119:0/2849041605 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7534052570 con 0x55f73ad18500 2024-04-23T18:29:37.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.494+0000 7f75494f1640 1 -- 172.21.15.119:0/2849041605 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f753404ae60 con 0x55f73ad18500 2024-04-23T18:29:37.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.495+0000 7f754df33800 1 -- 172.21.15.119:0/2849041605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad18500 msgr2=0x55f73ad1a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.495+0000 7f754df33800 1 --2- 172.21.15.119:0/2849041605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad18500 0x55f73ad1a8f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f753400a520 tx=0x7f753401d010 comp rx=0 tx=0).stop 2024-04-23T18:29:37.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.495+0000 7f754df33800 1 -- 172.21.15.119:0/2849041605 shutdown_connections 2024-04-23T18:29:37.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.495+0000 7f754df33800 1 --2- 172.21.15.119:0/2849041605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad18500 0x55f73ad1a8f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.495+0000 7f754df33800 1 -- 172.21.15.119:0/2849041605 >> 172.21.15.119:0/2849041605 conn(0x55f73ad0e420 msgr2=0x55f73ad10840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.495+0000 7f754df33800 1 -- 172.21.15.119:0/2849041605 shutdown_connections 2024-04-23T18:29:37.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.495+0000 7f754df33800 1 -- 172.21.15.119:0/2849041605 wait complete. 2024-04-23T18:29:37.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.508+0000 7f754df33800 1 Processor -- start 2024-04-23T18:29:37.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.508+0000 7f754df33800 1 -- start start 2024-04-23T18:29:37.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.508+0000 7f754df33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad149f0 0x55f73ae051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.508+0000 7f754df33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f73ac5f5b0 con 0x55f73ad149f0 2024-04-23T18:29:37.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.509+0000 7f7549cf2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad149f0 0x55f73ae051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.509+0000 7f7549cf2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad149f0 0x55f73ae051f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49332/0 (socket says 172.21.15.119:49332) 2024-04-23T18:29:37.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.509+0000 7f7549cf2640 1 -- 172.21.15.119:0/2086450493 learned_addr learned my addr 172.21.15.119:0/2086450493 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.509+0000 7f7549cf2640 1 -- 172.21.15.119:0/2086450493 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73abd5860 con 0x55f73ad149f0 2024-04-23T18:29:37.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.509+0000 7f7549cf2640 1 --2- 172.21.15.119:0/2086450493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad149f0 0x55f73ae051f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f753c001d20 tx=0x7f753c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde9cbad88d2c0e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.509+0000 7f7437e07640 1 -- 172.21.15.119:0/2086450493 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f753c00f400 con 0x55f73ad149f0 2024-04-23T18:29:37.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.509+0000 7f7437e07640 1 -- 172.21.15.119:0/2086450493 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753c00f5a0 con 0x55f73ad149f0 2024-04-23T18:29:37.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.509+0000 7f7437e07640 1 -- 172.21.15.119:0/2086450493 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f753c00f7d0 con 0x55f73ad149f0 2024-04-23T18:29:37.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.510+0000 7f754df33800 1 -- 172.21.15.119:0/2086450493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad149f0 msgr2=0x55f73ae051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.510+0000 7f754df33800 1 --2- 172.21.15.119:0/2086450493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad149f0 0x55f73ae051f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f753c001d20 tx=0x7f753c00b5b0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.510+0000 7f754df33800 1 -- 172.21.15.119:0/2086450493 shutdown_connections 2024-04-23T18:29:37.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.510+0000 7f754df33800 1 --2- 172.21.15.119:0/2086450493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad149f0 0x55f73ae051f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.510+0000 7f754df33800 1 -- 172.21.15.119:0/2086450493 >> 172.21.15.119:0/2086450493 conn(0x55f73ad0e420 msgr2=0x55f73ae00b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.510+0000 7f754df33800 1 -- 172.21.15.119:0/2086450493 shutdown_connections 2024-04-23T18:29:37.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.510+0000 7f754df33800 1 -- 172.21.15.119:0/2086450493 wait complete. 2024-04-23T18:29:37.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.510+0000 7f754df33800 1 Processor -- start 2024-04-23T18:29:37.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.510+0000 7f754df33800 1 -- start start 2024-04-23T18:29:37.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.510+0000 7f754df33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad149f0 0x55f73ae0cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.510+0000 7f754df33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f73ad1b130 con 0x55f73ad149f0 2024-04-23T18:29:37.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.511+0000 7f7549cf2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad149f0 0x55f73ae0cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.511+0000 7f7549cf2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad149f0 0x55f73ae0cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49342/0 (socket says 172.21.15.119:49342) 2024-04-23T18:29:37.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.511+0000 7f7549cf2640 1 -- 172.21.15.119:0/968939681 learned_addr learned my addr 172.21.15.119:0/968939681 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.511+0000 7f7549cf2640 1 -- 172.21.15.119:0/968939681 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73abd3eb0 con 0x55f73ad149f0 2024-04-23T18:29:37.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.511+0000 7f7549cf2640 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad149f0 0x55f73ae0cbc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55f73ae05f80 tx=0x7f753c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.511+0000 7f7436604640 1 -- 172.21.15.119:0/968939681 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f753c01a690 con 0x55f73ad149f0 2024-04-23T18:29:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.511+0000 7f7436604640 1 -- 172.21.15.119:0/968939681 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753c01a830 con 0x55f73ad149f0 2024-04-23T18:29:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.511+0000 7f7436604640 1 -- 172.21.15.119:0/968939681 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f753c01ab30 con 0x55f73ad149f0 2024-04-23T18:29:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.511+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f73ae0d100 con 0x55f73ad149f0 2024-04-23T18:29:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.511+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f73ae0d680 con 0x55f73ad149f0 2024-04-23T18:29:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.512+0000 7f7436604640 1 -- 172.21.15.119:0/968939681 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f753c017070 con 0x55f73ad149f0 2024-04-23T18:29:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.512+0000 7f7436604640 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7430036e60 0x7f7430039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.512+0000 7f7436604640 1 -- 172.21.15.119:0/968939681 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f753c015020 con 0x55f73ad149f0 2024-04-23T18:29:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.512+0000 7f75414f1640 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7430036e60 0x7f7430039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.512+0000 7f754df33800 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f73ad18500 0x55f73ae13be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.512+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae14160 con 0x55f73ad18500 2024-04-23T18:29:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.513+0000 7f754a4f3640 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f73ad18500 0x55f73ae13be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.513+0000 7f75414f1640 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7430036e60 0x7f7430039320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7534054000 tx=0x7f753404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.513+0000 7f754a4f3640 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f73ad18500 0x55f73ae13be0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.513+0000 7f754a4f3640 1 -- 172.21.15.119:0/968939681 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ad18500 2024-04-23T18:29:37.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.513+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae111b0 con 0x55f73ad18500 2024-04-23T18:29:37.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.513+0000 7f754a4f3640 1 -- 172.21.15.119:0/968939681 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ad18500 2024-04-23T18:29:37.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.513+0000 7f754df33800 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f73ae164b0 0x55f73ae188a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.513+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae18f90 con 0x55f73ae164b0 2024-04-23T18:29:37.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.513+0000 7f7549cf2640 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f73ae164b0 0x55f73ae188a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.514+0000 7f7549cf2640 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f73ae164b0 0x55f73ae188a0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.514+0000 7f7549cf2640 1 -- 172.21.15.119:0/968939681 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f753c02e070 con 0x55f73ae164b0 2024-04-23T18:29:37.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.514+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae15460 con 0x55f73ad18500 2024-04-23T18:29:37.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.514+0000 7f754a4f3640 1 -- 172.21.15.119:0/968939681 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ad18500 2024-04-23T18:29:37.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.514+0000 7f754df33800 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f73ae1a440 0x55f73ae1c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.514+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae1cff0 con 0x55f73ae1a440 2024-04-23T18:29:37.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.515+0000 7f75414f1640 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f73ae1a440 0x55f73ae1c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.515+0000 7f75414f1640 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f73ae1a440 0x55f73ae1c890 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.515+0000 7f75414f1640 1 -- 172.21.15.119:0/968939681 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f753405a040 con 0x55f73ae1a440 2024-04-23T18:29:37.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.516+0000 7f754df33800 1 Processor -- start 2024-04-23T18:29:37.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.516+0000 7f754df33800 1 -- start start 2024-04-23T18:29:37.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.516+0000 7f754df33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad14590 0x55f73ad12a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.516+0000 7f754df33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f73ac05df0 con 0x55f73ad14590 2024-04-23T18:29:37.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.516+0000 7f7549cf2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad14590 0x55f73ad12a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.516+0000 7f7549cf2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad14590 0x55f73ad12a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49348/0 (socket says 172.21.15.119:49348) 2024-04-23T18:29:37.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.516+0000 7f7549cf2640 1 -- 172.21.15.119:0/2301095529 learned_addr learned my addr 172.21.15.119:0/2301095529 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.516+0000 7f7549cf2640 1 -- 172.21.15.119:0/2301095529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73ad12f40 con 0x55f73ad14590 2024-04-23T18:29:37.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.516+0000 7f7549cf2640 1 --2- 172.21.15.119:0/2301095529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad14590 0x55f73ad12a00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f753c04b8d0 tx=0x7f753c017ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.516+0000 7f742f7fe640 1 -- 172.21.15.119:0/2301095529 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f753c045300 con 0x55f73ad14590 2024-04-23T18:29:37.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.516+0000 7f742f7fe640 1 -- 172.21.15.119:0/2301095529 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753c045660 con 0x55f73ad14590 2024-04-23T18:29:37.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.517+0000 7f754df33800 1 -- 172.21.15.119:0/2301095529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f73ad131d0 con 0x55f73ad14590 2024-04-23T18:29:37.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.517+0000 7f742f7fe640 1 -- 172.21.15.119:0/2301095529 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f753c045980 con 0x55f73ad14590 2024-04-23T18:29:37.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.517+0000 7f754df33800 1 -- 172.21.15.119:0/2301095529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f73ad13610 con 0x55f73ad14590 2024-04-23T18:29:37.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.517+0000 7f742f7fe640 1 -- 172.21.15.119:0/2301095529 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f753c00e070 con 0x55f73ad14590 2024-04-23T18:29:37.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.517+0000 7f742f7fe640 1 --2- 172.21.15.119:0/2301095529 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7424036e60 0x7f7424039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.517+0000 7f742f7fe640 1 -- 172.21.15.119:0/2301095529 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f753c037020 con 0x55f73ad14590 2024-04-23T18:29:37.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.517+0000 7f75414f1640 1 --2- 172.21.15.119:0/2301095529 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7424036e60 0x7f7424039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.518+0000 7f754df33800 1 Processor -- start 2024-04-23T18:29:37.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.518+0000 7f75414f1640 1 --2- 172.21.15.119:0/2301095529 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7424036e60 0x7f7424039320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55f73ae14a60 tx=0x7f7534005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.518+0000 7f754df33800 1 -- start start 2024-04-23T18:29:37.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.518+0000 7f754df33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ae3a690 0x55f73ae3aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.518+0000 7f754df33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f73ae05970 con 0x55f73ae3a690 2024-04-23T18:29:37.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.518+0000 7f7549cf2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ae3a690 0x55f73ae3aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.518+0000 7f7549cf2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ae3a690 0x55f73ae3aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49354/0 (socket says 172.21.15.119:49354) 2024-04-23T18:29:37.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.518+0000 7f7549cf2640 1 -- 172.21.15.119:0/124475657 learned_addr learned my addr 172.21.15.119:0/124475657 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.518+0000 7f7549cf2640 1 -- 172.21.15.119:0/124475657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73ae3b080 con 0x55f73ae3a690 2024-04-23T18:29:37.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.518+0000 7f7549cf2640 1 --2- 172.21.15.119:0/124475657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ae3a690 0x55f73ae3aab0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f753c008fd0 tx=0x7f753c03cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5033b3cc23f4b5d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.519+0000 7f742d7fa640 1 -- 172.21.15.119:0/124475657 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f753c04dc90 con 0x55f73ae3a690 2024-04-23T18:29:37.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.519+0000 7f742d7fa640 1 -- 172.21.15.119:0/124475657 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753c05e030 con 0x55f73ae3a690 2024-04-23T18:29:37.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.519+0000 7f742d7fa640 1 -- 172.21.15.119:0/124475657 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f753c04d790 con 0x55f73ae3a690 2024-04-23T18:29:37.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.519+0000 7f754df33800 1 -- 172.21.15.119:0/124475657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ae3a690 msgr2=0x55f73ae3aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.519+0000 7f754df33800 1 --2- 172.21.15.119:0/124475657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ae3a690 0x55f73ae3aab0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f753c008fd0 tx=0x7f753c03cb20 comp rx=0 tx=0).stop 2024-04-23T18:29:37.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.519+0000 7f754df33800 1 -- 172.21.15.119:0/124475657 shutdown_connections 2024-04-23T18:29:37.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.519+0000 7f754df33800 1 --2- 172.21.15.119:0/124475657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ae3a690 0x55f73ae3aab0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.519+0000 7f754df33800 1 -- 172.21.15.119:0/124475657 >> 172.21.15.119:0/124475657 conn(0x55f73ae36960 msgr2=0x55f73ae349c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.519+0000 7f754df33800 1 -- 172.21.15.119:0/124475657 shutdown_connections 2024-04-23T18:29:37.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.519+0000 7f754df33800 1 -- 172.21.15.119:0/124475657 wait complete. 2024-04-23T18:29:37.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.520+0000 7f754df33800 1 Processor -- start 2024-04-23T18:29:37.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.520+0000 7f754df33800 1 -- start start 2024-04-23T18:29:37.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.520+0000 7f754df33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ae3a690 0x55f73ae41940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.520+0000 7f754df33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f73ae3b6e0 con 0x55f73ae3a690 2024-04-23T18:29:37.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.520+0000 7f7549cf2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ae3a690 0x55f73ae41940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.520+0000 7f7549cf2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ae3a690 0x55f73ae41940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:49362/0 (socket says 172.21.15.119:49362) 2024-04-23T18:29:37.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.520+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 learned_addr learned my addr 172.21.15.119:0/2962005966 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:37.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.520+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73ae41e80 con 0x55f73ae3a690 2024-04-23T18:29:37.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.520+0000 7f7549cf2640 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ae3a690 0x55f73ae41940 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f753c049610 tx=0x7f753c019eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.521+0000 7f741b7fe640 1 -- 172.21.15.119:0/2962005966 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f753c027b50 con 0x55f73ae3a690 2024-04-23T18:29:37.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.521+0000 7f741b7fe640 1 -- 172.21.15.119:0/2962005966 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753c027cf0 con 0x55f73ae3a690 2024-04-23T18:29:37.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.521+0000 7f741b7fe640 1 -- 172.21.15.119:0/2962005966 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f753c049070 con 0x55f73ae3a690 2024-04-23T18:29:37.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.521+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f73ae41e80 con 0x55f73ae3a690 2024-04-23T18:29:37.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.521+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f73ae41e80 con 0x55f73ae3a690 2024-04-23T18:29:37.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.522+0000 7f741b7fe640 1 -- 172.21.15.119:0/2962005966 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f753c075060 con 0x55f73ae3a690 2024-04-23T18:29:37.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.522+0000 7f741b7fe640 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7414036e60 0x7f7414039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.522+0000 7f741b7fe640 1 -- 172.21.15.119:0/2962005966 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f753c06b070 con 0x55f73ae3a690 2024-04-23T18:29:37.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.522+0000 7f75414f1640 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7414036e60 0x7f7414039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.522+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.522+0000 7f754df33800 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f73ae4d120 0x55f73ae4f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.522+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae4fd30 con 0x55f73ae4d120 2024-04-23T18:29:37.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.522+0000 7f75414f1640 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7414036e60 0x7f7414039320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55f73ae1d3f0 tx=0x7f753404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.522+0000 7f754a4f3640 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f73ae4d120 0x55f73ae4f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754a4f3640 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f73ae4d120 0x55f73ae4f5e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ae4d120 2024-04-23T18:29:37.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754df33800 20 realm 2024-04-23T18:29:37.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50140 con 0x55f73ae4d120 2024-04-23T18:29:37.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ae4d120 2024-04-23T18:29:37.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754df33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:37.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50560 con 0x55f73ae4d120 2024-04-23T18:29:37.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ae4d120 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.523+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae4d120 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.524+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ae4d120 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.524+0000 7f754df33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.524+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.524+0000 7f754df33800 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f73ae51820 0x55f73ae53c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.524+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae54300 con 0x55f73ae51820 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.524+0000 7f7549cf2640 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f73ae51820 0x55f73ae53c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.524+0000 7f7549cf2640 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f73ae51820 0x55f73ae53c10 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.524+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.524+0000 7f754df33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.524+0000 7f754df33800 20 searching for the correct realm 2024-04-23T18:29:37.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.524+0000 7f754df33800 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f73ae562d0 0x55f73ae58790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.524+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae58e60 con 0x55f73ae562d0 2024-04-23T18:29:37.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.524+0000 7f75414f1640 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f73ae562d0 0x55f73ae58790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.525+0000 7f75414f1640 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f73ae562d0 0x55f73ae58790 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.525+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.525+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae58e60 con 0x55f73ae51820 2024-04-23T18:29:37.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.525+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.525+0000 7f7549cf2640 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f753c03dc50 0x7f753c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:37.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.525+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae58e60 con 0x7f753c03dc50 2024-04-23T18:29:37.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.525+0000 7f754a4f3640 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f753c03dc50 0x7f753c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:37.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.526+0000 7f754a4f3640 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f753c03dc50 0x7f753c06e870 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:37.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.526+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754400a4a0 con 0x7f753c03dc50 2024-04-23T18:29:37.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.526+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae4d120 2024-04-23T18:29:37.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.526+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ae4d120 2024-04-23T18:29:37.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.526+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae4d120 2024-04-23T18:29:37.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.527+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ae4d120 2024-04-23T18:29:37.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.527+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x7f753c03dc50 2024-04-23T18:29:37.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.527+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754400a4a0 con 0x7f753c03dc50 2024-04-23T18:29:37.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.527+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x7f753c03dc50 2024-04-23T18:29:37.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.527+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f754400a4a0 con 0x7f753c03dc50 2024-04-23T18:29:37.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.527+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae51820 2024-04-23T18:29:37.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.527+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.527+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae562d0 2024-04-23T18:29:37.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.528+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.528+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae4d120 2024-04-23T18:29:37.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.528+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ae4d120 2024-04-23T18:29:37.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.528+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x7f753c03dc50 2024-04-23T18:29:37.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.528+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754400a4a0 con 0x7f753c03dc50 2024-04-23T18:29:37.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.528+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae4d120 2024-04-23T18:29:37.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.528+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ae4d120 2024-04-23T18:29:37.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.529+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae51820 2024-04-23T18:29:37.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.529+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.529+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae562d0 2024-04-23T18:29:37.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.529+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.529+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae562d0 2024-04-23T18:29:37.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.529+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.529+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x7f753c03dc50 2024-04-23T18:29:37.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.530+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754400a4a0 con 0x7f753c03dc50 2024-04-23T18:29:37.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.530+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae562d0 2024-04-23T18:29:37.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.530+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.530+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae562d0 2024-04-23T18:29:37.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.530+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.530+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae4d120 2024-04-23T18:29:37.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.530+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ae4d120 2024-04-23T18:29:37.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.530+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae4d120 2024-04-23T18:29:37.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.531+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ae4d120 2024-04-23T18:29:37.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.531+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x7f753c03dc50 2024-04-23T18:29:37.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.531+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754400a4a0 con 0x7f753c03dc50 2024-04-23T18:29:37.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.531+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae562d0 2024-04-23T18:29:37.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.531+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.531+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae51820 2024-04-23T18:29:37.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.531+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.531+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae4d120 2024-04-23T18:29:37.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.532+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754400a4a0 con 0x55f73ae4d120 2024-04-23T18:29:37.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.532+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x7f753c03dc50 2024-04-23T18:29:37.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.532+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754400a4a0 con 0x7f753c03dc50 2024-04-23T18:29:37.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.532+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae562d0 2024-04-23T18:29:37.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.532+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.532+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x7f753c03dc50 2024-04-23T18:29:37.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.533+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f754400a4a0 con 0x7f753c03dc50 2024-04-23T18:29:37.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.533+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae51820 2024-04-23T18:29:37.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.533+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.533+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae562d0 2024-04-23T18:29:37.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.533+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.533+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x7f753c03dc50 2024-04-23T18:29:37.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae4d120 2024-04-23T18:29:37.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae50e00 con 0x55f73ae51820 2024-04-23T18:29:37.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754df33800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:37.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754df33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:37.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754df33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:37.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754df33800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:37.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754df33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:37.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754df33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:37.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae54bc0 con 0x55f73ae4d120 2024-04-23T18:29:37.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.534+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae54bc0 con 0x55f73ae4d120 2024-04-23T18:29:37.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:37.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae54bc0 con 0x7f753c03dc50 2024-04-23T18:29:37.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:37.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 20 zone default found 2024-04-23T18:29:37.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 4 Realm: () 2024-04-23T18:29:37.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:37.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:37.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:37.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 20 zonegroup default 2024-04-23T18:29:37.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae554b0 con 0x7f753c03dc50 2024-04-23T18:29:37.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae554b0 con 0x55f73ae562d0 2024-04-23T18:29:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.535+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.536+0000 7f754df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.536+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.536+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5acc0 con 0x55f73ae562d0 2024-04-23T18:29:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.536+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.536+0000 7f754df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.536+0000 7f754df33800 20 started sync module instance, tier type = 2024-04-23T18:29:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.536+0000 7f754df33800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.536+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5a160 con 0x55f73ae51820 2024-04-23T18:29:37.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.537+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(44 notify.0 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.537+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94520333409456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5b060 con 0x55f73ae51820 2024-04-23T18:29:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.537+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5b8f0 con 0x55f73ae4d120 2024-04-23T18:29:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.538+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94520333409456] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.538+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.538+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94520333411664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5bce0 con 0x55f73ae4d120 2024-04-23T18:29:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.538+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5c710 con 0x55f73ae562d0 2024-04-23T18:29:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.539+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94520333411664] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.539+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.539+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94520333419040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5cb30 con 0x55f73ae562d0 2024-04-23T18:29:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.539+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5d560 con 0x55f73ae51820 2024-04-23T18:29:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.540+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94520333419040] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.540+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(50 notify.3 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.540+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94520333422704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5d980 con 0x55f73ae51820 2024-04-23T18:29:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.540+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5e3a0 con 0x55f73ae4d120 2024-04-23T18:29:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.541+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.541+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94520333422704] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.541+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94520333415424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5e360 con 0x55f73ae4d120 2024-04-23T18:29:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.541+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5edb0 con 0x7f753c03dc50 2024-04-23T18:29:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.542+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94520333415424] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.543+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(54 notify.5 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.543+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94520333426320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5edb0 con 0x7f753c03dc50 2024-04-23T18:29:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.543+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5f7c0 con 0x7f753c03dc50 2024-04-23T18:29:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.544+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94520333426320] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.544+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(56 notify.6 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.544+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94520333428992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5f9a0 con 0x7f753c03dc50 2024-04-23T18:29:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.544+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae601f0 con 0x7f753c03dc50 2024-04-23T18:29:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.545+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94520333428992] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.545+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(58 notify.7 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.545+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94520333432528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae60040 con 0x7f753c03dc50 2024-04-23T18:29:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.545+0000 7f754df33800 20 add_watcher() i=0 2024-04-23T18:29:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.545+0000 7f754df33800 20 add_watcher() i=1 2024-04-23T18:29:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.545+0000 7f754df33800 20 add_watcher() i=2 2024-04-23T18:29:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.545+0000 7f754df33800 20 add_watcher() i=3 2024-04-23T18:29:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.545+0000 7f754df33800 20 add_watcher() i=4 2024-04-23T18:29:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.545+0000 7f754df33800 20 add_watcher() i=5 2024-04-23T18:29:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.545+0000 7f754df33800 20 add_watcher() i=6 2024-04-23T18:29:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.546+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94520333432528] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.546+0000 7f754df33800 20 add_watcher() i=7 2024-04-23T18:29:37.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.546+0000 7f754df33800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:37.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.546+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae63550 con 0x55f73ae4d120 2024-04-23T18:29:37.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.546+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.546+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94520333433584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae60a00 con 0x55f73ae4d120 2024-04-23T18:29:37.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.547+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94520333433584] v32'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.547+0000 7f73fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:37.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.547+0000 7f754df33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:37.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.547+0000 7f754df33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:37.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.547+0000 7f754df33800 5 note: GC not initialized 2024-04-23T18:29:37.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.547+0000 7f73fa7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:37.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.548+0000 7f754df33800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:37.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.548+0000 7f754df33800 20 Filter name: none 2024-04-23T18:29:37.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.548+0000 7f736bfff640 20 reqs_thread_entry: start 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.548+0000 7f754df33800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.548+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.548+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae96d30 con 0x55f73ae4d120 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.548+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.548+0000 7f754df33800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.548+0000 7f754df33800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.548+0000 7f754df33800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.548+0000 7f754df33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.548+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae997c0 con 0x55f73ae51820 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 20 enabling bucket name=myfoo 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae977a0 con 0x55f73ae51820 2024-04-23T18:29:37.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:37.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-23T18:29:37.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:37.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 : miss 2024-04-23T18:29:37.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:37.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:65 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae9a0c0 con 0x55f73ae562d0 2024-04-23T18:29:37.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(65 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:37.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:37.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:37.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.549+0000 7f754df33800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.550+0000 7f754df33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 2024-04-23T18:29:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.550+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 8.b 8:d79c5613:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73aea2140 con 0x55f73ae562d0 2024-04-23T18:29:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.551+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(66 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.551+0000 7f754df33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.551+0000 7f754df33800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.551+0000 7f754df33800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.551+0000 7f754df33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1, ofs0, ns] 2024-04-23T18:29:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.551+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94520333674480 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae9c710 con 0x7f753c03dc50 2024-04-23T18:29:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.551+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== watch-notify(notify (1) cookie 94520333428992 notify 137438953490 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f7544018c90 con 0x7f753c03dc50 2024-04-23T18:29:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.551+0000 7f742d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94520333428992 notifier 4595 bl.length()=752 2024-04-23T18:29:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.551+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(67 notify.6 [notify cookie 94520333674480 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.551+0000 7f742d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 info.flags=0x17 2024-04-23T18:29:37.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.551+0000 7f742d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1 to cache LRU end 2024-04-23T18:29:37.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.551+0000 7f742d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:37.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.551+0000 7f742d7fa640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f740c003ea0 con 0x7f753c03dc50 2024-04-23T18:29:37.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.552+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== watch-notify(notify_complete (2) cookie 94520333674480 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7544046450 con 0x7f753c03dc50 2024-04-23T18:29:37.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.552+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.552+0000 7f754df33800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): orig_sources= new_sources= 2024-04-23T18:29:37.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.552+0000 7f754df33800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): potential sources added=[] removed=[] 2024-04-23T18:29:37.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.552+0000 7f754df33800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): orig_dests= new_dests= 2024-04-23T18:29:37.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.552+0000 7f754df33800 20 handle_bi_update(): bucket=:myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1]): potential dests added=[] removed=[] 2024-04-23T18:29:37.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.552+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae9af20 con 0x55f73ae4d120 2024-04-23T18:29:37.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.553+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.553+0000 7f754df33800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:37.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.553+0000 7f754df33800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:37.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.553+0000 7f754df33800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:37.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.553+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94520333674480 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae9af20 con 0x55f73ae4d120 2024-04-23T18:29:37.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.553+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify (1) cookie 94520333415424 notify 137438953493 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f7544046450 con 0x55f73ae4d120 2024-04-23T18:29:37.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.553+0000 7f742d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94520333415424 notifier 4595 bl.length()=567 2024-04-23T18:29:37.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.553+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(70 notify.4 [notify cookie 94520333674480 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.553+0000 7f742d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:37.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.553+0000 7f742d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:37.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.553+0000 7f742d7fa640 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f740c003ea0 con 0x55f73ae4d120 2024-04-23T18:29:37.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.553+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.553+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify_complete (2) cookie 94520333674480 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7544046820 con 0x55f73ae4d120 2024-04-23T18:29:37.562 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:37.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.554+0000 7f73fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:37.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.554+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94520333433584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae9b9b0 con 0x55f73ae4d120 2024-04-23T18:29:37.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.555+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94520333433584] v32'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.555+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94520333409456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5faf0 con 0x55f73ae51820 2024-04-23T18:29:37.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.556+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94520333409456] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.556+0000 7f754df33800 20 remove_watcher() i=0 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.556+0000 7f754df33800 2 removed watcher, disabling cache 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.556+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94520333411664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5faf0 con 0x55f73ae4d120 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.557+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94520333411664] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.557+0000 7f754df33800 20 remove_watcher() i=1 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.557+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94520333419040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5a550 con 0x55f73ae562d0 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.558+0000 7f75414f1640 1 -- 172.21.15.119:0/2962005966 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94520333419040] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f753407f070 con 0x55f73ae562d0 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.558+0000 7f754df33800 20 remove_watcher() i=2 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.558+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94520333422704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5faf0 con 0x55f73ae51820 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.559+0000 7f7549cf2640 1 -- 172.21.15.119:0/2962005966 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94520333422704] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f753c080040 con 0x55f73ae51820 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.559+0000 7f754df33800 20 remove_watcher() i=3 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.559+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94520333415424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5a550 con 0x55f73ae4d120 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.560+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94520333415424] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x55f73ae4d120 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.560+0000 7f754df33800 20 remove_watcher() i=4 2024-04-23T18:29:37.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.560+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94520333426320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5faf0 con 0x7f753c03dc50 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.561+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94520333426320] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.561+0000 7f754df33800 20 remove_watcher() i=5 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.561+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94520333428992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5b400 con 0x7f753c03dc50 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.563+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94520333428992] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.563+0000 7f754df33800 20 remove_watcher() i=6 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.563+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94520333432528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f73ae5a550 con 0x7f753c03dc50 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.563+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94520333432528] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7544040040 con 0x7f753c03dc50 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 20 remove_watcher() i=7 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f753c03dc50 msgr2=0x7f753c06e870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f753c03dc50 0x7f753c06e870 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f73ae4d120 msgr2=0x55f73ae4f5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f73ae4d120 0x55f73ae4f5e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f73ae51820 msgr2=0x55f73ae53c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f73ae51820 0x55f73ae53c10 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f73ae562d0 msgr2=0x55f73ae58790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f73ae562d0 0x55f73ae58790 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7414036e60 msgr2=0x7f7414039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7414036e60 0x7f7414039320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55f73ae1d3f0 tx=0x7f753404f000 comp rx=0 tx=0).stop 2024-04-23T18:29:37.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ae3a690 msgr2=0x55f73ae41940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 --2- 172.21.15.119:0/2962005966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ae3a690 0x55f73ae41940 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f753c049610 tx=0x7f753c019eb0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 reap_dead start 2024-04-23T18:29:37.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754a4f3640 1 -- 172.21.15.119:0/2962005966 reap_dead start 2024-04-23T18:29:37.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 shutdown_connections 2024-04-23T18:29:37.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 >> 172.21.15.119:0/2962005966 conn(0x55f73ae36960 msgr2=0x55f73ae33fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 shutdown_connections 2024-04-23T18:29:37.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2962005966 wait complete. 2024-04-23T18:29:37.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2301095529 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7424036e60 msgr2=0x7f7424039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 --2- 172.21.15.119:0/2301095529 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7424036e60 0x7f7424039320 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55f73ae14a60 tx=0x7f7534005ac0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2301095529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad14590 msgr2=0x55f73ad12a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 --2- 172.21.15.119:0/2301095529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad14590 0x55f73ad12a00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f753c04b8d0 tx=0x7f753c017ab0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2301095529 shutdown_connections 2024-04-23T18:29:37.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 --2- 172.21.15.119:0/2301095529 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7424036e60 0x7f7424039320 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 --2- 172.21.15.119:0/2301095529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad14590 0x55f73ad12a00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2301095529 >> 172.21.15.119:0/2301095529 conn(0x55f73ae1f4f0 msgr2=0x55f73ae1f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2301095529 shutdown_connections 2024-04-23T18:29:37.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.564+0000 7f754df33800 1 -- 172.21.15.119:0/2301095529 wait complete. 2024-04-23T18:29:37.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f73ae1a440 msgr2=0x55f73ae1c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f73ae1a440 0x55f73ae1c890 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f73ad18500 msgr2=0x55f73ae13be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f73ad18500 0x55f73ae13be0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f73ae164b0 msgr2=0x55f73ae188a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f73ae164b0 0x55f73ae188a0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7430036e60 msgr2=0x7f7430039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7430036e60 0x7f7430039320 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7534054000 tx=0x7f753404e000 comp rx=0 tx=0).stop 2024-04-23T18:29:37.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad149f0 msgr2=0x55f73ae0cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:37.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 --2- 172.21.15.119:0/968939681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f73ad149f0 0x55f73ae0cbc0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55f73ae05f80 tx=0x7f753c000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:37.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754a4f3640 1 -- 172.21.15.119:0/968939681 reap_dead start 2024-04-23T18:29:37.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 shutdown_connections 2024-04-23T18:29:37.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 >> 172.21.15.119:0/968939681 conn(0x55f73ad0e420 msgr2=0x55f73adff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:37.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 shutdown_connections 2024-04-23T18:29:37.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:37.565+0000 7f754df33800 1 -- 172.21.15.119:0/968939681 wait complete. 2024-04-23T18:29:37.573 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:37.579 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-23T18:29:37.832 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-04-23T18:29:37.839 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:52.840 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-23T18:29:52.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-23T18:29:52.840 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-23T18:29:52.889 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:52.889 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:52.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.897+0000 7fc06ac13800 1 Processor -- start 2024-04-23T18:29:52.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.897+0000 7fc06ac13800 1 -- start start 2024-04-23T18:29:52.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.897+0000 7fc06ac13800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561d94ede2f0 0x561d94ee06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.897+0000 7fc06ac13800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d94d8b560 con 0x561d94ed9e60 2024-04-23T18:29:52.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.897+0000 7fc06ac13800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x561d94d7ce20 con 0x561d94ede2f0 2024-04-23T18:29:52.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.898+0000 7fc065b46640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561d94ede2f0 0x561d94ee06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.898+0000 7fc066347640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x561d94ed9e60 0x561d94eda280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:43604/0 (socket says 172.21.15.119:43604) 2024-04-23T18:29:52.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.898+0000 7fc066347640 1 -- 172.21.15.119:0/4013126992 learned_addr learned my addr 172.21.15.119:0/4013126992 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:52.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.898+0000 7fc065b46640 1 -- 172.21.15.119:0/4013126992 >> v1:172.21.15.62:6789/0 conn(0x561d94ed9e60 legacy=0x561d94eda280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:52.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.898+0000 7fc065b46640 1 -- 172.21.15.119:0/4013126992 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d94d8ae60 con 0x561d94ede2f0 2024-04-23T18:29:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.900+0000 7fc065b46640 1 --2- 172.21.15.119:0/4013126992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ede2f0 0x561d94ee06e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00a470 tx=0x7fc05c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d8d70594b8baae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.900+0000 7fc065345640 1 -- 172.21.15.119:0/4013126992 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc05c057070 con 0x561d94ede2f0 2024-04-23T18:29:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.900+0000 7fc065345640 1 -- 172.21.15.119:0/4013126992 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05c052570 con 0x561d94ede2f0 2024-04-23T18:29:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.900+0000 7fc065345640 1 -- 172.21.15.119:0/4013126992 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc05c052870 con 0x561d94ede2f0 2024-04-23T18:29:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.901+0000 7fc06ac13800 1 -- 172.21.15.119:0/4013126992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ede2f0 msgr2=0x561d94ee06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.901+0000 7fc06ac13800 1 --2- 172.21.15.119:0/4013126992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ede2f0 0x561d94ee06e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00a470 tx=0x7fc05c01ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.901+0000 7fc06ac13800 1 -- 172.21.15.119:0/4013126992 shutdown_connections 2024-04-23T18:29:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.901+0000 7fc06ac13800 1 --2- 172.21.15.119:0/4013126992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ede2f0 0x561d94ee06e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:52.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.901+0000 7fc06ac13800 1 -- 172.21.15.119:0/4013126992 >> 172.21.15.119:0/4013126992 conn(0x561d94ed5420 msgr2=0x561d94ed7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:52.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.901+0000 7fc06ac13800 1 -- 172.21.15.119:0/4013126992 shutdown_connections 2024-04-23T18:29:52.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.901+0000 7fc06ac13800 1 -- 172.21.15.119:0/4013126992 wait complete. 2024-04-23T18:29:52.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.916+0000 7fc06ac13800 1 Processor -- start 2024-04-23T18:29:52.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.916+0000 7fc06ac13800 1 -- start start 2024-04-23T18:29:52.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.916+0000 7fc06ac13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ed9e60 0x561d94ee3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.916+0000 7fc06ac13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561d94e265b0 con 0x561d94ed9e60 2024-04-23T18:29:52.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.916+0000 7fc066347640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ed9e60 0x561d94ee3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.916+0000 7fc066347640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ed9e60 0x561d94ee3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35920/0 (socket says 172.21.15.119:35920) 2024-04-23T18:29:52.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.916+0000 7fc066347640 1 -- 172.21.15.119:0/2821249811 learned_addr learned my addr 172.21.15.119:0/2821249811 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:52.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.916+0000 7fc066347640 1 -- 172.21.15.119:0/2821249811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d94d9c860 con 0x561d94ed9e60 2024-04-23T18:29:52.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.917+0000 7fc066347640 1 --2- 172.21.15.119:0/2821249811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ed9e60 0x561d94ee3860 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc0580017a0 tx=0x7fc058001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81af9b7dd9567b58 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.917+0000 7fbf54608640 1 -- 172.21.15.119:0/2821249811 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc058016070 con 0x561d94ed9e60 2024-04-23T18:29:52.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.917+0000 7fbf54608640 1 -- 172.21.15.119:0/2821249811 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc058004520 con 0x561d94ed9e60 2024-04-23T18:29:52.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.917+0000 7fbf54608640 1 -- 172.21.15.119:0/2821249811 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc058004820 con 0x561d94ed9e60 2024-04-23T18:29:52.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.917+0000 7fc06ac13800 1 -- 172.21.15.119:0/2821249811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ed9e60 msgr2=0x561d94ee3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:52.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.917+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2821249811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ed9e60 0x561d94ee3860 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc0580017a0 tx=0x7fc058001c60 comp rx=0 tx=0).stop 2024-04-23T18:29:52.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.918+0000 7fc06ac13800 1 -- 172.21.15.119:0/2821249811 shutdown_connections 2024-04-23T18:29:52.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.918+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2821249811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ed9e60 0x561d94ee3860 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:52.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.918+0000 7fc06ac13800 1 -- 172.21.15.119:0/2821249811 >> 172.21.15.119:0/2821249811 conn(0x561d94ed5420 msgr2=0x561d94fc7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:52.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.918+0000 7fc06ac13800 1 -- 172.21.15.119:0/2821249811 shutdown_connections 2024-04-23T18:29:52.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.918+0000 7fc06ac13800 1 -- 172.21.15.119:0/2821249811 wait complete. 2024-04-23T18:29:52.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.918+0000 7fc06ac13800 1 Processor -- start 2024-04-23T18:29:52.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.918+0000 7fc06ac13800 1 -- start start 2024-04-23T18:29:52.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.918+0000 7fc06ac13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ed9e60 0x561d94fd5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.918+0000 7fc06ac13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561d94ee0fb0 con 0x561d94ed9e60 2024-04-23T18:29:52.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.919+0000 7fc066347640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ed9e60 0x561d94fd5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.919+0000 7fc066347640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ed9e60 0x561d94fd5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35926/0 (socket says 172.21.15.119:35926) 2024-04-23T18:29:52.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.919+0000 7fc066347640 1 -- 172.21.15.119:0/2456923900 learned_addr learned my addr 172.21.15.119:0/2456923900 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:52.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.919+0000 7fc066347640 1 -- 172.21.15.119:0/2456923900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d94d9aeb0 con 0x561d94ed9e60 2024-04-23T18:29:52.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.919+0000 7fc066347640 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ed9e60 0x561d94fd5db0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc058014040 tx=0x7fc058001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.919+0000 7fbf52e05640 1 -- 172.21.15.119:0/2456923900 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc058020070 con 0x561d94ed9e60 2024-04-23T18:29:52.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.919+0000 7fbf52e05640 1 -- 172.21.15.119:0/2456923900 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc058011550 con 0x561d94ed9e60 2024-04-23T18:29:52.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.919+0000 7fbf52e05640 1 -- 172.21.15.119:0/2456923900 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc058016040 con 0x561d94ed9e60 2024-04-23T18:29:52.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.919+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d94fd62f0 con 0x561d94ed9e60 2024-04-23T18:29:52.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.919+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d94fd6870 con 0x561d94ed9e60 2024-04-23T18:29:52.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.920+0000 7fbf52e05640 1 -- 172.21.15.119:0/2456923900 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc058023070 con 0x561d94ed9e60 2024-04-23T18:29:52.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.920+0000 7fbf52e05640 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf4c036e60 0x7fbf4c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.921+0000 7fbf52e05640 1 -- 172.21.15.119:0/2456923900 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fc05804c560 con 0x561d94ed9e60 2024-04-23T18:29:52.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.921+0000 7fc065b46640 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf4c036e60 0x7fbf4c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.921+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561d94ede2f0 0x561d94fdce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.921+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d94fdd3a0 con 0x561d94ede2f0 2024-04-23T18:29:52.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.921+0000 7fc066b48640 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561d94ede2f0 0x561d94fdce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.921+0000 7fc065b46640 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf4c036e60 0x7fbf4c039320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc05c054000 tx=0x7fc05c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.921+0000 7fc066b48640 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561d94ede2f0 0x561d94fdce20 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.922+0000 7fc066b48640 1 -- 172.21.15.119:0/2456923900 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0600083e0 con 0x561d94ede2f0 2024-04-23T18:29:52.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.922+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d94fda3d0 con 0x561d94ede2f0 2024-04-23T18:29:52.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.922+0000 7fc066b48640 1 -- 172.21.15.119:0/2456923900 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc0600083e0 con 0x561d94ede2f0 2024-04-23T18:29:52.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.922+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561d94fdf6d0 0x561d94fe1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.922+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d94fe21b0 con 0x561d94fdf6d0 2024-04-23T18:29:52.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.922+0000 7fc066347640 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561d94fdf6d0 0x561d94fe1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.922+0000 7fc066347640 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561d94fdf6d0 0x561d94fe1ac0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.923+0000 7fc066347640 1 -- 172.21.15.119:0/2456923900 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc05802c070 con 0x561d94fdf6d0 2024-04-23T18:29:52.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.923+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d94fde680 con 0x561d94ede2f0 2024-04-23T18:29:52.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.923+0000 7fc066b48640 1 -- 172.21.15.119:0/2456923900 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc0600083e0 con 0x561d94ede2f0 2024-04-23T18:29:52.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.923+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561d94fe3660 0x561d94fe5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.923+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d94fe6220 con 0x561d94fe3660 2024-04-23T18:29:52.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.923+0000 7fc065b46640 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561d94fe3660 0x561d94fe5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.924+0000 7fc065b46640 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561d94fe3660 0x561d94fe5a90 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.924+0000 7fc065b46640 1 -- 172.21.15.119:0/2456923900 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc05c052940 con 0x561d94fe3660 2024-04-23T18:29:52.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.924+0000 7fc06ac13800 1 Processor -- start 2024-04-23T18:29:52.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.925+0000 7fc06ac13800 1 -- start start 2024-04-23T18:29:52.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.925+0000 7fc06ac13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ff4610 0x561d94ff4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.925+0000 7fc06ac13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561d94dccdf0 con 0x561d94ff4610 2024-04-23T18:29:52.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.925+0000 7fc066347640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ff4610 0x561d94ff4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.925+0000 7fc066347640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ff4610 0x561d94ff4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35928/0 (socket says 172.21.15.119:35928) 2024-04-23T18:29:52.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.925+0000 7fc066347640 1 -- 172.21.15.119:0/1099778730 learned_addr learned my addr 172.21.15.119:0/1099778730 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:52.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.925+0000 7fc066347640 1 -- 172.21.15.119:0/1099778730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d94ff4f70 con 0x561d94ff4610 2024-04-23T18:29:52.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.925+0000 7fc066347640 1 --2- 172.21.15.119:0/1099778730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ff4610 0x561d94ff4a30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc058000f80 tx=0x7fc05801bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.926+0000 7fbf4bfff640 1 -- 172.21.15.119:0/1099778730 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc058011870 con 0x561d94ff4610 2024-04-23T18:29:52.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.926+0000 7fbf4bfff640 1 -- 172.21.15.119:0/1099778730 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc058011a10 con 0x561d94ff4610 2024-04-23T18:29:52.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.926+0000 7fbf4bfff640 1 -- 172.21.15.119:0/1099778730 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc058011d10 con 0x561d94ff4610 2024-04-23T18:29:52.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.926+0000 7fc06ac13800 1 -- 172.21.15.119:0/1099778730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d94ff59e0 con 0x561d94ff4610 2024-04-23T18:29:52.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.926+0000 7fc06ac13800 1 -- 172.21.15.119:0/1099778730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d94ff5ee0 con 0x561d94ff4610 2024-04-23T18:29:52.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.926+0000 7fbf4bfff640 1 -- 172.21.15.119:0/1099778730 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc058043e70 con 0x561d94ff4610 2024-04-23T18:29:52.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.927+0000 7fbf4bfff640 1 --2- 172.21.15.119:0/1099778730 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf40036e60 0x7fbf40039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.927+0000 7fbf4bfff640 1 -- 172.21.15.119:0/1099778730 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fc058038d60 con 0x561d94ff4610 2024-04-23T18:29:52.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.927+0000 7fc065b46640 1 --2- 172.21.15.119:0/1099778730 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf40036e60 0x7fbf40039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.927+0000 7fc06ac13800 1 Processor -- start 2024-04-23T18:29:52.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.927+0000 7fc06ac13800 1 -- start start 2024-04-23T18:29:52.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.927+0000 7fc065b46640 1 --2- 172.21.15.119:0/1099778730 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf40036e60 0x7fbf40039320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x561d94fdd870 tx=0x7fc05c005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.927+0000 7fc06ac13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 0x561d95001bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.927+0000 7fc06ac13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561d94ee1ee0 con 0x561d95001790 2024-04-23T18:29:52.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.928+0000 7fc066347640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 0x561d95001bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.928+0000 7fc066347640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 0x561d95001bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35938/0 (socket says 172.21.15.119:35938) 2024-04-23T18:29:52.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.928+0000 7fc066347640 1 -- 172.21.15.119:0/2044101243 learned_addr learned my addr 172.21.15.119:0/2044101243 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:52.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.928+0000 7fc066347640 1 -- 172.21.15.119:0/2044101243 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d95002180 con 0x561d95001790 2024-04-23T18:29:52.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.928+0000 7fc066347640 1 --2- 172.21.15.119:0/2044101243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 0x561d95001bb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc058015fd0 tx=0x7fc05802fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f66aad99d3432d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.928+0000 7fbf49ffb640 1 -- 172.21.15.119:0/2044101243 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc05804c880 con 0x561d95001790 2024-04-23T18:29:52.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.928+0000 7fbf49ffb640 1 -- 172.21.15.119:0/2044101243 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc058055070 con 0x561d95001790 2024-04-23T18:29:52.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.928+0000 7fbf49ffb640 1 -- 172.21.15.119:0/2044101243 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc058025ba0 con 0x561d95001790 2024-04-23T18:29:52.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.929+0000 7fc06ac13800 1 -- 172.21.15.119:0/2044101243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 msgr2=0x561d95001bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:52.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.929+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2044101243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 0x561d95001bb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc058015fd0 tx=0x7fc05802fb50 comp rx=0 tx=0).stop 2024-04-23T18:29:52.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.929+0000 7fc06ac13800 1 -- 172.21.15.119:0/2044101243 shutdown_connections 2024-04-23T18:29:52.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.929+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2044101243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 0x561d95001bb0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:52.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.929+0000 7fc06ac13800 1 -- 172.21.15.119:0/2044101243 >> 172.21.15.119:0/2044101243 conn(0x561d94ffdaf0 msgr2=0x561d94ffbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:52.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.929+0000 7fc06ac13800 1 -- 172.21.15.119:0/2044101243 shutdown_connections 2024-04-23T18:29:52.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.929+0000 7fc06ac13800 1 -- 172.21.15.119:0/2044101243 wait complete. 2024-04-23T18:29:52.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.929+0000 7fc06ac13800 1 Processor -- start 2024-04-23T18:29:52.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.929+0000 7fc06ac13800 1 -- start start 2024-04-23T18:29:52.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.929+0000 7fc06ac13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 0x561d95008b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.929+0000 7fc06ac13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561d95002830 con 0x561d95001790 2024-04-23T18:29:52.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.930+0000 7fc066347640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 0x561d95008b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.930+0000 7fc066347640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 0x561d95008b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35944/0 (socket says 172.21.15.119:35944) 2024-04-23T18:29:52.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.930+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 learned_addr learned my addr 172.21.15.119:0/2253713098 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:52.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.930+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d950090d0 con 0x561d95001790 2024-04-23T18:29:52.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.930+0000 7fc066347640 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 0x561d95008b90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc05800b0b0 tx=0x7fc058025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.930+0000 7fbf37fff640 1 -- 172.21.15.119:0/2253713098 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc05802fc60 con 0x561d95001790 2024-04-23T18:29:52.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.930+0000 7fbf37fff640 1 -- 172.21.15.119:0/2253713098 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc058025820 con 0x561d95001790 2024-04-23T18:29:52.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.930+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d950090d0 con 0x561d95001790 2024-04-23T18:29:52.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.931+0000 7fbf37fff640 1 -- 172.21.15.119:0/2253713098 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc058045800 con 0x561d95001790 2024-04-23T18:29:52.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.931+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d950090d0 con 0x561d95001790 2024-04-23T18:29:52.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.931+0000 7fbf37fff640 1 -- 172.21.15.119:0/2253713098 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc0580459c0 con 0x561d95001790 2024-04-23T18:29:52.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.932+0000 7fbf37fff640 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf30036e60 0x7fbf30039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.932+0000 7fbf37fff640 1 -- 172.21.15.119:0/2253713098 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fc058063110 con 0x561d95001790 2024-04-23T18:29:52.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.932+0000 7fc065b46640 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf30036e60 0x7fbf30039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.932+0000 7fc06ac13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:52.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.932+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561d950142e0 0x561d950167a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.932+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95016ef0 con 0x561d950142e0 2024-04-23T18:29:52.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.932+0000 7fc066b48640 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561d950142e0 0x561d950167a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.932+0000 7fc065b46640 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf30036e60 0x7fbf30039320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc05c052fd0 tx=0x7fc05c04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.932+0000 7fc066b48640 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561d950142e0 0x561d950167a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0600083e0 con 0x561d950142e0 2024-04-23T18:29:52.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc06ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:52.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc06ac13800 20 realm 2024-04-23T18:29:52.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc06ac13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:52.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95017300 con 0x561d950142e0 2024-04-23T18:29:52.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0600083e0 con 0x561d950142e0 2024-04-23T18:29:52.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc06ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:52.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc06ac13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:52.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc06ac13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:52.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d950142e0 2024-04-23T18:29:52.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc0600083e0 con 0x561d950142e0 2024-04-23T18:29:52.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc06ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:52.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc06ac13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:52.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95017f70 con 0x561d950142e0 2024-04-23T18:29:52.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc0600083e0 con 0x561d950142e0 2024-04-23T18:29:52.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.933+0000 7fc06ac13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:52.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.934+0000 7fc06ac13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:52.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.934+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561d95018930 0x561d9501ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.934+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d9501b260 con 0x561d95018930 2024-04-23T18:29:52.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.934+0000 7fc066347640 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561d95018930 0x561d9501ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.934+0000 7fc066347640 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561d95018930 0x561d9501ad20 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.934+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc05803e070 con 0x561d95018930 2024-04-23T18:29:52.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.934+0000 7fc06ac13800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:52.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.934+0000 7fc06ac13800 20 searching for the correct realm 2024-04-23T18:29:52.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.934+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561d9501d340 0x561d9501f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.934+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9501fed0 con 0x561d9501d340 2024-04-23T18:29:52.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.934+0000 7fc065b46640 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561d9501d340 0x561d9501f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.935+0000 7fc065b46640 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561d9501d340 0x561d9501f800 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.935+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.935+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9501fed0 con 0x561d95018930 2024-04-23T18:29:52.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.935+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05803e070 con 0x561d95018930 2024-04-23T18:29:52.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.935+0000 7fc066347640 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc058025070 0x7fc058036350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:52.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.935+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d9501fed0 con 0x7fc058025070 2024-04-23T18:29:52.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.936+0000 7fc066b48640 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc058025070 0x7fc058036350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:52.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.936+0000 7fc066b48640 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc058025070 0x7fc058036350 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:52.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.936+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0600083e0 con 0x7fc058025070 2024-04-23T18:29:52.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.936+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d950142e0 2024-04-23T18:29:52.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.937+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc0600083e0 con 0x561d950142e0 2024-04-23T18:29:52.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.937+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d950142e0 2024-04-23T18:29:52.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.937+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc060026040 con 0x561d950142e0 2024-04-23T18:29:52.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.937+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x7fc058025070 2024-04-23T18:29:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.937+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc060026040 con 0x7fc058025070 2024-04-23T18:29:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.937+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x7fc058025070 2024-04-23T18:29:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.938+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc060026040 con 0x7fc058025070 2024-04-23T18:29:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.938+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d95018930 2024-04-23T18:29:52.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.938+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05803e070 con 0x561d95018930 2024-04-23T18:29:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.938+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d9501d340 2024-04-23T18:29:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.938+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.938+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d950142e0 2024-04-23T18:29:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.938+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc060026040 con 0x561d950142e0 2024-04-23T18:29:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.938+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x7fc058025070 2024-04-23T18:29:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.939+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc060026040 con 0x7fc058025070 2024-04-23T18:29:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.939+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d950142e0 2024-04-23T18:29:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.939+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc060026040 con 0x561d950142e0 2024-04-23T18:29:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.939+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d95018930 2024-04-23T18:29:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.939+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc05803e070 con 0x561d95018930 2024-04-23T18:29:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.939+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d9501d340 2024-04-23T18:29:52.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.939+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.939+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d9501d340 2024-04-23T18:29:52.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.940+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.940+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x7fc058025070 2024-04-23T18:29:52.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.940+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc060026040 con 0x7fc058025070 2024-04-23T18:29:52.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.940+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d9501d340 2024-04-23T18:29:52.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.940+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.940+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d9501d340 2024-04-23T18:29:52.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.941+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.941+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d950142e0 2024-04-23T18:29:52.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.941+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc060026040 con 0x561d950142e0 2024-04-23T18:29:52.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.941+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d950142e0 2024-04-23T18:29:52.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.941+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc060026040 con 0x561d950142e0 2024-04-23T18:29:52.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.941+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x7fc058025070 2024-04-23T18:29:52.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.941+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc060026040 con 0x7fc058025070 2024-04-23T18:29:52.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.941+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d9501d340 2024-04-23T18:29:52.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.942+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.942+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d95018930 2024-04-23T18:29:52.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.942+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc05803e070 con 0x561d95018930 2024-04-23T18:29:52.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.942+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d950142e0 2024-04-23T18:29:52.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.942+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc060026040 con 0x561d950142e0 2024-04-23T18:29:52.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.942+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d95018930 2024-04-23T18:29:52.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.942+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05803e070 con 0x561d95018930 2024-04-23T18:29:52.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.942+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d9501d340 2024-04-23T18:29:52.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.943+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.943+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x7fc058025070 2024-04-23T18:29:52.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.943+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc060026040 con 0x7fc058025070 2024-04-23T18:29:52.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.943+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d95018930 2024-04-23T18:29:52.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.943+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.943+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d9501d340 2024-04-23T18:29:52.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.944+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.944+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x7fc058025070 2024-04-23T18:29:52.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.944+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc060026040 con 0x7fc058025070 2024-04-23T18:29:52.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.944+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d950142e0 2024-04-23T18:29:52.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.944+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc060026040 con 0x561d950142e0 2024-04-23T18:29:52.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.944+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561d95017bd0 con 0x561d95018930 2024-04-23T18:29:52.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:52.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:52.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:52.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:52.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:52.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:52.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:52.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d9501bc00 con 0x561d950142e0 2024-04-23T18:29:52.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc060026040 con 0x561d950142e0 2024-04-23T18:29:52.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:52.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:52.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d9501bff0 con 0x561d950142e0 2024-04-23T18:29:52.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc060026040 con 0x561d950142e0 2024-04-23T18:29:52.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:52.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:52.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d9501bff0 con 0x7fc058025070 2024-04-23T18:29:52.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.945+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:52.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 20 zone default found 2024-04-23T18:29:52.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 4 Realm: () 2024-04-23T18:29:52.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:52.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:52.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:52.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 20 zonegroup default 2024-04-23T18:29:52.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:52.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d9501c410 con 0x561d95018930 2024-04-23T18:29:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95021d30 con 0x561d9501d340 2024-04-23T18:29:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 20 rados->read ofs=0 len=0 2024-04-23T18:29:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950220d0 con 0x561d9501d340 2024-04-23T18:29:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 20 started sync module instance, tier type = 2024-04-23T18:29:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:52.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.946+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950211d0 con 0x561d95018930 2024-04-23T18:29:52.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.947+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.947+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94685053982192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95020e30 con 0x561d95018930 2024-04-23T18:29:52.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.947+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95022dd0 con 0x561d950142e0 2024-04-23T18:29:52.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.949+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94685053982192] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.949+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.949+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94685053986416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950231c0 con 0x561d950142e0 2024-04-23T18:29:52.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.949+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95023c10 con 0x561d9501d340 2024-04-23T18:29:52.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.950+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94685053986416] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.951+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.951+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94685053990656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95024030 con 0x561d9501d340 2024-04-23T18:29:52.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.951+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95024a30 con 0x561d95018930 2024-04-23T18:29:52.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.952+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94685053990656] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.952+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.952+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94685053987664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95024e20 con 0x561d95018930 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.952+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950258a0 con 0x561d950142e0 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.953+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94685053987664] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.953+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.953+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94685053997968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95025860 con 0x561d950142e0 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.953+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950262b0 con 0x7fc058025070 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.954+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94685053997968] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.955+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.955+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94685053994304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950262b0 con 0x7fc058025070 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.955+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95026cc0 con 0x7fc058025070 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.956+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94685053994304] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.957+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.957+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94685054001120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95026cc0 con 0x7fc058025070 2024-04-23T18:29:52.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.957+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95027680 con 0x7fc058025070 2024-04-23T18:29:52.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.958+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94685054001120] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.959+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.959+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94685054003216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95027860 con 0x7fc058025070 2024-04-23T18:29:52.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.959+0000 7fc06ac13800 20 add_watcher() i=0 2024-04-23T18:29:52.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.959+0000 7fc06ac13800 20 add_watcher() i=1 2024-04-23T18:29:52.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.959+0000 7fc06ac13800 20 add_watcher() i=2 2024-04-23T18:29:52.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.959+0000 7fc06ac13800 20 add_watcher() i=3 2024-04-23T18:29:52.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.959+0000 7fc06ac13800 20 add_watcher() i=4 2024-04-23T18:29:52.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.959+0000 7fc06ac13800 20 add_watcher() i=5 2024-04-23T18:29:52.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.959+0000 7fc06ac13800 20 add_watcher() i=6 2024-04-23T18:29:52.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.960+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94685054003216] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.960+0000 7fc06ac13800 20 add_watcher() i=7 2024-04-23T18:29:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.960+0000 7fc06ac13800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.960+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d9502a9e0 con 0x561d950142e0 2024-04-23T18:29:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.960+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.960+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94685054018416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95027780 con 0x561d950142e0 2024-04-23T18:29:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.961+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94685054018416] v34'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.961+0000 7fbf1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.961+0000 7fc06ac13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.961+0000 7fc06ac13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.961+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95029a50 con 0x561d950142e0 2024-04-23T18:29:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.963+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.963+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950299c0 con 0x7fc058025070 2024-04-23T18:29:52.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.964+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.964+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95033dd0 con 0x561d9501d340 2024-04-23T18:29:52.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.965+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.965+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95034640 con 0x561d950142e0 2024-04-23T18:29:52.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.966+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'154 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.966+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95034a00 con 0x561d95018930 2024-04-23T18:29:52.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.967+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.967+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95034a00 con 0x561d9501d340 2024-04-23T18:29:52.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.968+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.968+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035480 con 0x561d950142e0 2024-04-23T18:29:52.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.969+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.969+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035480 con 0x7fc058025070 2024-04-23T18:29:52.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.970+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.970+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035480 con 0x561d95018930 2024-04-23T18:29:52.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.972+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.972+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035510 con 0x561d9501d340 2024-04-23T18:29:52.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.973+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.973+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950359c0 con 0x561d95018930 2024-04-23T18:29:52.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.974+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'45 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.974+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950359c0 con 0x7fc058025070 2024-04-23T18:29:52.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.975+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.975+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950359c0 con 0x561d95018930 2024-04-23T18:29:52.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.976+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.976+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035a00 con 0x7fc058025070 2024-04-23T18:29:52.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.977+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.977+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035af0 con 0x561d950142e0 2024-04-23T18:29:52.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.979+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'155 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.979+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035af0 con 0x561d9501d340 2024-04-23T18:29:52.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.980+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.980+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95036100 con 0x561d95018930 2024-04-23T18:29:52.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.981+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.981+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950360e0 con 0x561d9501d340 2024-04-23T18:29:52.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.982+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.982+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950360e0 con 0x561d950142e0 2024-04-23T18:29:52.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.983+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.983+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950360e0 con 0x561d950142e0 2024-04-23T18:29:52.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.984+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'156 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.984+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950360e0 con 0x561d9501d340 2024-04-23T18:29:52.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.985+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.977 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.985+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950360e0 con 0x561d95018930 2024-04-23T18:29:52.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.986+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.978 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.986+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035f10 con 0x561d9501d340 2024-04-23T18:29:52.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.987+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.987+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035f10 con 0x561d9501d340 2024-04-23T18:29:52.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.988+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.988+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035f10 con 0x561d9501d340 2024-04-23T18:29:52.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.989+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.989+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035f10 con 0x561d9501d340 2024-04-23T18:29:52.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.990+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.990+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035f10 con 0x7fc058025070 2024-04-23T18:29:52.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.991+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.991+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035f10 con 0x561d9501d340 2024-04-23T18:29:52.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.992+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.992+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035f10 con 0x7fc058025070 2024-04-23T18:29:52.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.993+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.993+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035f10 con 0x561d9501d340 2024-04-23T18:29:52.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.994+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.994+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035f10 con 0x7fc058025070 2024-04-23T18:29:52.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.995+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.995+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95035f10 con 0x561d95018930 2024-04-23T18:29:52.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.997+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.997+0000 7fbe977fe640 20 reqs_thread_entry: start 2024-04-23T18:29:52.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.997+0000 7fc06ac13800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:52.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.997+0000 7fc06ac13800 20 Filter name: none 2024-04-23T18:29:52.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.997+0000 7fbe957fa640 20 reqs_thread_entry: start 2024-04-23T18:29:52.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.997+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d950142e0 2024-04-23T18:29:52.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.997+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.997+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d950142e0 2024-04-23T18:29:52.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.998+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.998+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d950142e0 2024-04-23T18:29:52.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.998+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.998+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x7fc058025070 2024-04-23T18:29:52.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.999+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.999+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x7fc058025070 2024-04-23T18:29:52.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.999+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.999+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x7fc058025070 2024-04-23T18:29:52.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.999+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:52.992 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:52.999+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:52.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.000+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.000+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d9501d340 2024-04-23T18:29:52.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.000+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.000+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:52.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.000+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.000+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d950142e0 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.001+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.001+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d950142e0 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.001+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.001+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d950142e0 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.001+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.001+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d95018930 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.001+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.001+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d95018930 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.002+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.002+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d95018930 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.002+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.002+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.002+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.002+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d9501d340 2024-04-23T18:29:52.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.003+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.003+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:52.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.003+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:52.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.003+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d950142e0 2024-04-23T18:29:53.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.003+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.003+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d950142e0 2024-04-23T18:29:53.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.003+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.003+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d950142e0 2024-04-23T18:29:53.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.004+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.004+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x7fc058025070 2024-04-23T18:29:53.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.004+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.004+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x7fc058025070 2024-04-23T18:29:53.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.005+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.005+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x7fc058025070 2024-04-23T18:29:53.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.005+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.005+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d95018930 2024-04-23T18:29:53.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.005+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.005+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d95018930 2024-04-23T18:29:53.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.005+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.005+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d95018930 2024-04-23T18:29:53.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.006+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.006+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:53.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.006+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.006+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d9501d340 2024-04-23T18:29:53.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.006+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.006+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:53.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.006+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.006+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d95018930 2024-04-23T18:29:53.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.007+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.007+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d95018930 2024-04-23T18:29:53.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.007+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.007+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d95018930 2024-04-23T18:29:53.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.007+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.007+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x7fc058025070 2024-04-23T18:29:53.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.008+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.008+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x7fc058025070 2024-04-23T18:29:53.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.008+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.008+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x7fc058025070 2024-04-23T18:29:53.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.008+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.008+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d95018930 2024-04-23T18:29:53.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.008+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.008+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d95018930 2024-04-23T18:29:53.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.009+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.009+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d95018930 2024-04-23T18:29:53.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.009+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.009+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x7fc058025070 2024-04-23T18:29:53.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.009+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.009+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x7fc058025070 2024-04-23T18:29:53.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.010+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.010+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x7fc058025070 2024-04-23T18:29:53.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.010+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.010+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d950142e0 2024-04-23T18:29:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.010+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.010+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d950142e0 2024-04-23T18:29:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.011+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.011+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d950142e0 2024-04-23T18:29:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.011+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.011+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.011+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.011+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d9501d340 2024-04-23T18:29:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.011+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.011+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.012+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.012+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d95018930 2024-04-23T18:29:53.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.012+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.012+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d95018930 2024-04-23T18:29:53.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.012+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.012+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d95018930 2024-04-23T18:29:53.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.012+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.012+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:53.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.013+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.013+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d9501d340 2024-04-23T18:29:53.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.013+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.013+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.013+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.013+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d950142e0 2024-04-23T18:29:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.013+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.013+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d950142e0 2024-04-23T18:29:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.014+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.014+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d950142e0 2024-04-23T18:29:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.014+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.014+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d950142e0 2024-04-23T18:29:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.014+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.014+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d950142e0 2024-04-23T18:29:53.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.014+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.014+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d950142e0 2024-04-23T18:29:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.014+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.015+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.015+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.015+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d9501d340 2024-04-23T18:29:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.015+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.015+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.015+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.015+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d95018930 2024-04-23T18:29:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.016+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.016+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d95018930 2024-04-23T18:29:53.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.016+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.016+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d95018930 2024-04-23T18:29:53.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.016+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.016+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:53.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.016+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.016+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d9501d340 2024-04-23T18:29:53.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.017+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.017+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:53.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.017+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.017+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.017+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.017+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950607e0 con 0x561d9501d340 2024-04-23T18:29:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.017+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.017+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d950617f0 con 0x561d9501d340 2024-04-23T18:29:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.018+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 49 ==== osd_op_reply(165 gc.23 [call out=1701b] v0'0 uv24 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.018+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x561d9501d340 2024-04-23T18:29:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.018+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.018+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95060e80 con 0x561d9501d340 2024-04-23T18:29:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.018+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.018+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x561d9501d340 2024-04-23T18:29:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.018+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.020 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.018+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x561d9501d340 2024-04-23T18:29:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.019+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.019+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95060e80 con 0x561d9501d340 2024-04-23T18:29:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.019+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.019+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x561d9501d340 2024-04-23T18:29:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.019+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.019+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x7fc058025070 2024-04-23T18:29:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.019+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.020+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95060e80 con 0x7fc058025070 2024-04-23T18:29:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.020+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.020+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x7fc058025070 2024-04-23T18:29:53.021 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.020+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.020+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x561d9501d340 2024-04-23T18:29:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.020+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.020+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95060e80 con 0x561d9501d340 2024-04-23T18:29:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.021+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.021+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x561d9501d340 2024-04-23T18:29:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.021+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.021+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x7fc058025070 2024-04-23T18:29:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.021+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.022 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.021+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95060e80 con 0x7fc058025070 2024-04-23T18:29:53.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.022+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.022+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x7fc058025070 2024-04-23T18:29:53.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.022+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.022+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x561d9501d340 2024-04-23T18:29:53.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.022+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.022+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95060e80 con 0x561d9501d340 2024-04-23T18:29:53.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.022+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.022+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x561d9501d340 2024-04-23T18:29:53.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.023+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.023+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x7fc058025070 2024-04-23T18:29:53.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.023+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.023+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95060e80 con 0x7fc058025070 2024-04-23T18:29:53.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.023+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.024+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x7fc058025070 2024-04-23T18:29:53.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.024+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.024+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x561d95018930 2024-04-23T18:29:53.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.024+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.024+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95060e80 con 0x561d95018930 2024-04-23T18:29:53.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.024+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.024+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561d95061e90 con 0x561d95018930 2024-04-23T18:29:53.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.025+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.025+0000 7fbf1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:53.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.025+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94685054018416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d94fc3b90 con 0x561d950142e0 2024-04-23T18:29:53.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.026+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94685054018416] v34'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.026+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94685053982192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d9502a370 con 0x561d95018930 2024-04-23T18:29:53.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.027+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94685053982192] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.027+0000 7fc06ac13800 20 remove_watcher() i=0 2024-04-23T18:29:53.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.027+0000 7fc06ac13800 2 removed watcher, disabling cache 2024-04-23T18:29:53.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.027+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94685053986416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d950215f0 con 0x561d950142e0 2024-04-23T18:29:53.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.029+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94685053986416] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.029+0000 7fc06ac13800 20 remove_watcher() i=1 2024-04-23T18:29:53.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.029+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94685053990656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95022670 con 0x561d9501d340 2024-04-23T18:29:53.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.030+0000 7fc065b46640 1 -- 172.21.15.119:0/2253713098 <== osd.3 v2:172.21.15.119:6809/3910610681 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94685053990656] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc05c081070 con 0x561d9501d340 2024-04-23T18:29:53.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.030+0000 7fc06ac13800 20 remove_watcher() i=2 2024-04-23T18:29:53.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.030+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94685053987664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95022670 con 0x561d95018930 2024-04-23T18:29:53.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.031+0000 7fc066347640 1 -- 172.21.15.119:0/2253713098 <== osd.2 v2:172.21.15.119:6800/2624052101 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94685053987664] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc058088040 con 0x561d95018930 2024-04-23T18:29:53.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.031+0000 7fc06ac13800 20 remove_watcher() i=3 2024-04-23T18:29:53.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.031+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94685053997968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95022670 con 0x561d950142e0 2024-04-23T18:29:53.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.032+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.1 v2:172.21.15.119:6808/2736386629 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94685053997968] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x561d950142e0 2024-04-23T18:29:53.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.032+0000 7fc06ac13800 20 remove_watcher() i=4 2024-04-23T18:29:53.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.032+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94685053994304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95022670 con 0x7fc058025070 2024-04-23T18:29:53.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.033+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94685053994304] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.033+0000 7fc06ac13800 20 remove_watcher() i=5 2024-04-23T18:29:53.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.033+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94685054001120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95024540 con 0x7fc058025070 2024-04-23T18:29:53.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.034+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94685054001120] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.034+0000 7fc06ac13800 20 remove_watcher() i=6 2024-04-23T18:29:53.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.034+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94685054003216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561d95025fe0 con 0x7fc058025070 2024-04-23T18:29:53.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 <== osd.0 v2:172.21.15.62:6800/2641588406 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94685054003216] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc060036040 con 0x7fc058025070 2024-04-23T18:29:53.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc06ac13800 20 remove_watcher() i=7 2024-04-23T18:29:53.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc058025070 msgr2=0x7fc058036350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc058025070 0x7fc058036350 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561d950142e0 msgr2=0x561d950167a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561d950142e0 0x561d950167a0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561d95018930 msgr2=0x561d9501ad20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561d95018930 0x561d9501ad20 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561d9501d340 msgr2=0x561d9501f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561d9501d340 0x561d9501f800 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf30036e60 msgr2=0x7fbf30039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf30036e60 0x7fbf30039320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc05c052fd0 tx=0x7fc05c04f000 comp rx=0 tx=0).stop 2024-04-23T18:29:53.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 msgr2=0x561d95008b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 0x561d95008b90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc05800b0b0 tx=0x7fc058025000 comp rx=0 tx=0).stop 2024-04-23T18:29:53.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.035+0000 7fc066b48640 1 -- 172.21.15.119:0/2253713098 reap_dead start 2024-04-23T18:29:53.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 shutdown_connections 2024-04-23T18:29:53.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2253713098 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d95001790 0x561d95008b90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 >> 172.21.15.119:0/2253713098 conn(0x561d94ffdaf0 msgr2=0x561d94ffb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 shutdown_connections 2024-04-23T18:29:53.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/2253713098 wait complete. 2024-04-23T18:29:53.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/1099778730 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf40036e60 msgr2=0x7fbf40039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 --2- 172.21.15.119:0/1099778730 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf40036e60 0x7fbf40039320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x561d94fdd870 tx=0x7fc05c005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:53.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/1099778730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ff4610 msgr2=0x561d94ff4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 --2- 172.21.15.119:0/1099778730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ff4610 0x561d94ff4a30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc058000f80 tx=0x7fc05801bdc0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/1099778730 shutdown_connections 2024-04-23T18:29:53.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 --2- 172.21.15.119:0/1099778730 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf40036e60 0x7fbf40039320 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 --2- 172.21.15.119:0/1099778730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ff4610 0x561d94ff4a30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/1099778730 >> 172.21.15.119:0/1099778730 conn(0x561d94fe86b0 msgr2=0x561d94fe8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/1099778730 shutdown_connections 2024-04-23T18:29:53.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/1099778730 wait complete. 2024-04-23T18:29:53.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561d94fe3660 msgr2=0x561d94fe5a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561d94fe3660 0x561d94fe5a90 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561d94ede2f0 msgr2=0x561d94fdce20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561d94ede2f0 0x561d94fdce20 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561d94fdf6d0 msgr2=0x561d94fe1ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561d94fdf6d0 0x561d94fe1ac0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf4c036e60 msgr2=0x7fbf4c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbf4c036e60 0x7fbf4c039320 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc05c054000 tx=0x7fc05c04e000 comp rx=0 tx=0).stop 2024-04-23T18:29:53.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ed9e60 msgr2=0x561d94fd5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 --2- 172.21.15.119:0/2456923900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d94ed9e60 0x561d94fd5db0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc058014040 tx=0x7fc058001250 comp rx=0 tx=0).stop 2024-04-23T18:29:53.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc066b48640 1 -- 172.21.15.119:0/2456923900 reap_dead start 2024-04-23T18:29:53.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 shutdown_connections 2024-04-23T18:29:53.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 >> 172.21.15.119:0/2456923900 conn(0x561d94ed5420 msgr2=0x561d94fc76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 shutdown_connections 2024-04-23T18:29:53.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.036+0000 7fc06ac13800 1 -- 172.21.15.119:0/2456923900 wait complete. 2024-04-23T18:29:53.038 INFO:teuthology.orchestra.run.smithi119.stdout:[{"tag":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.8040203591276444993\u0000","time":"2024-04-23T18:29:52.846419+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_7","key":"","instance":""}]}] 2024-04-23T18:29:53.039 DEBUG:tasks.util.rgw: json result: [{'tag': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.8040203591276444993\x00', 'time': '2024-04-23T18:29:52.846419+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_7', 'key': '', 'instance': ''}]}] 2024-04-23T18:29:53.039 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-04-23T18:29:53.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-04-23T18:29:53.039 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-04-23T18:29:53.079 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:53.079 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:53.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.087+0000 7f6dade08800 1 Processor -- start 2024-04-23T18:29:53.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.087+0000 7f6dade08800 1 -- start start 2024-04-23T18:29:53.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.088+0000 7f6dade08800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5604c33a3860 0x5604c33a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.088+0000 7f6dade08800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5604c3255560 con 0x5604c33a41c0 2024-04-23T18:29:53.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.088+0000 7f6dade08800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5604c3246e20 con 0x5604c33a3860 2024-04-23T18:29:53.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.088+0000 7f6dab907640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5604c33a3860 0x5604c33a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.088+0000 7f6dab106640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5604c33a41c0 0x5604c33a4670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:43610/0 (socket says 172.21.15.119:43610) 2024-04-23T18:29:53.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.088+0000 7f6dab106640 1 -- 172.21.15.119:0/2010914782 learned_addr learned my addr 172.21.15.119:0/2010914782 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:53.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.088+0000 7f6dab907640 1 -- 172.21.15.119:0/2010914782 >> v1:172.21.15.62:6789/0 conn(0x5604c33a41c0 legacy=0x5604c33a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.088+0000 7f6dab907640 1 -- 172.21.15.119:0/2010914782 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c3254e60 con 0x5604c33a3860 2024-04-23T18:29:53.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.090+0000 7f6dab907640 1 --2- 172.21.15.119:0/2010914782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c33a3c80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00a470 tx=0x7f6d9c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32459a9a263c3561 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.090+0000 7f6daa905640 1 -- 172.21.15.119:0/2010914782 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c057070 con 0x5604c33a3860 2024-04-23T18:29:53.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.090+0000 7f6daa905640 1 -- 172.21.15.119:0/2010914782 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9c04adc0 con 0x5604c33a3860 2024-04-23T18:29:53.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.090+0000 7f6daa905640 1 -- 172.21.15.119:0/2010914782 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c052590 con 0x5604c33a3860 2024-04-23T18:29:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.091+0000 7f6dade08800 1 -- 172.21.15.119:0/2010914782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 msgr2=0x5604c33a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.091+0000 7f6dade08800 1 --2- 172.21.15.119:0/2010914782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c33a3c80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00a470 tx=0x7f6d9c01ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.091+0000 7f6dade08800 1 -- 172.21.15.119:0/2010914782 shutdown_connections 2024-04-23T18:29:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.091+0000 7f6dade08800 1 --2- 172.21.15.119:0/2010914782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c33a3c80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.091+0000 7f6dade08800 1 -- 172.21.15.119:0/2010914782 >> 172.21.15.119:0/2010914782 conn(0x5604c339f400 msgr2=0x5604c33a1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.091+0000 7f6dade08800 1 -- 172.21.15.119:0/2010914782 shutdown_connections 2024-04-23T18:29:53.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.091+0000 7f6dade08800 1 -- 172.21.15.119:0/2010914782 wait complete. 2024-04-23T18:29:53.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.102+0000 7f6dade08800 1 Processor -- start 2024-04-23T18:29:53.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.102+0000 7f6dade08800 1 -- start start 2024-04-23T18:29:53.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.102+0000 7f6dade08800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c3498450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.102+0000 7f6dade08800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5604c32f05a0 con 0x5604c33a3860 2024-04-23T18:29:53.095 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.103+0000 7f6dab907640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c3498450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.103+0000 7f6dab907640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c3498450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35968/0 (socket says 172.21.15.119:35968) 2024-04-23T18:29:53.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.103+0000 7f6dab907640 1 -- 172.21.15.119:0/3176413504 learned_addr learned my addr 172.21.15.119:0/3176413504 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.096 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.103+0000 7f6dab907640 1 -- 172.21.15.119:0/3176413504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c3266860 con 0x5604c33a3860 2024-04-23T18:29:53.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.103+0000 7f6dab907640 1 --2- 172.21.15.119:0/3176413504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c3498450 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c055040 tx=0x7f6d9c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaacb213350ef558 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.103+0000 7f6c99e0b640 1 -- 172.21.15.119:0/3176413504 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c057040 con 0x5604c33a3860 2024-04-23T18:29:53.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.103+0000 7f6c99e0b640 1 -- 172.21.15.119:0/3176413504 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9c062070 con 0x5604c33a3860 2024-04-23T18:29:53.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.104+0000 7f6c99e0b640 1 -- 172.21.15.119:0/3176413504 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c05d470 con 0x5604c33a3860 2024-04-23T18:29:53.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.104+0000 7f6dade08800 1 -- 172.21.15.119:0/3176413504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 msgr2=0x5604c3498450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.104+0000 7f6dade08800 1 --2- 172.21.15.119:0/3176413504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c3498450 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c055040 tx=0x7f6d9c04c000 comp rx=0 tx=0).stop 2024-04-23T18:29:53.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.104+0000 7f6dade08800 1 -- 172.21.15.119:0/3176413504 shutdown_connections 2024-04-23T18:29:53.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.104+0000 7f6dade08800 1 --2- 172.21.15.119:0/3176413504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c3498450 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.104+0000 7f6dade08800 1 -- 172.21.15.119:0/3176413504 >> 172.21.15.119:0/3176413504 conn(0x5604c339f400 msgr2=0x5604c3493d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.104+0000 7f6dade08800 1 -- 172.21.15.119:0/3176413504 shutdown_connections 2024-04-23T18:29:53.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.104+0000 7f6dade08800 1 -- 172.21.15.119:0/3176413504 wait complete. 2024-04-23T18:29:53.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.105+0000 7f6dade08800 1 Processor -- start 2024-04-23T18:29:53.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.105+0000 7f6dade08800 1 -- start start 2024-04-23T18:29:53.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.105+0000 7f6dade08800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c349fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.105+0000 7f6dade08800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5604c33a5020 con 0x5604c33a3860 2024-04-23T18:29:53.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.105+0000 7f6dab907640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c349fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.105+0000 7f6dab907640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c349fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35970/0 (socket says 172.21.15.119:35970) 2024-04-23T18:29:53.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.105+0000 7f6dab907640 1 -- 172.21.15.119:0/2345381087 learned_addr learned my addr 172.21.15.119:0/2345381087 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.105+0000 7f6dab907640 1 -- 172.21.15.119:0/2345381087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c3264eb0 con 0x5604c33a3860 2024-04-23T18:29:53.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.106+0000 7f6dab907640 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c349fc50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c05f040 tx=0x7f6d9c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.106+0000 7f6c93fff640 1 -- 172.21.15.119:0/2345381087 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c06b070 con 0x5604c33a3860 2024-04-23T18:29:53.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.106+0000 7f6c93fff640 1 -- 172.21.15.119:0/2345381087 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9c05d960 con 0x5604c33a3860 2024-04-23T18:29:53.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.106+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604c34a0190 con 0x5604c33a3860 2024-04-23T18:29:53.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.106+0000 7f6c93fff640 1 -- 172.21.15.119:0/2345381087 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c057070 con 0x5604c33a3860 2024-04-23T18:29:53.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.106+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c34a06b0 con 0x5604c33a3860 2024-04-23T18:29:53.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.107+0000 7f6c93fff640 1 -- 172.21.15.119:0/2345381087 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6d9c05dc80 con 0x5604c33a3860 2024-04-23T18:29:53.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.107+0000 7f6c93fff640 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c94036e60 0x7f6c94039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.107+0000 7f6c93fff640 1 -- 172.21.15.119:0/2345381087 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f6d9c08eaa0 con 0x5604c33a3860 2024-04-23T18:29:53.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.107+0000 7f6dab106640 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c94036e60 0x7f6c94039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.107+0000 7f6dade08800 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5604c33a41c0 0x5604c34a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.107+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34a7200 con 0x5604c33a41c0 2024-04-23T18:29:53.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.107+0000 7f6dac108640 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5604c33a41c0 0x5604c34a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.107+0000 7f6dab106640 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c94036e60 0x7f6c94039320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6da0000f60 tx=0x7f6da00012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.107+0000 7f6dac108640 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5604c33a41c0 0x5604c34a6cc0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.108+0000 7f6dac108640 1 -- 172.21.15.119:0/2345381087 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c33a41c0 2024-04-23T18:29:53.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.108+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34a4290 con 0x5604c33a41c0 2024-04-23T18:29:53.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.108+0000 7f6dac108640 1 -- 172.21.15.119:0/2345381087 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c33a41c0 2024-04-23T18:29:53.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.108+0000 7f6dade08800 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5604c34a9550 0x5604c34ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.108+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34abfe0 con 0x5604c34a9550 2024-04-23T18:29:53.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.108+0000 7f6dab907640 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5604c34a9550 0x5604c34ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.108+0000 7f6dab907640 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5604c34a9550 0x5604c34ab940 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.109+0000 7f6dab907640 1 -- 172.21.15.119:0/2345381087 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d9c05a040 con 0x5604c34a9550 2024-04-23T18:29:53.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.109+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34a8500 con 0x5604c33a41c0 2024-04-23T18:29:53.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.109+0000 7f6dac108640 1 -- 172.21.15.119:0/2345381087 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c33a41c0 2024-04-23T18:29:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.109+0000 7f6dade08800 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5604c34ad490 0x5604c34af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.109+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34b0040 con 0x5604c34ad490 2024-04-23T18:29:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.109+0000 7f6dab106640 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5604c34ad490 0x5604c34af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.110+0000 7f6dab106640 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5604c34ad490 0x5604c34af8e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.110+0000 7f6dab106640 1 -- 172.21.15.119:0/2345381087 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34ad490 2024-04-23T18:29:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.110+0000 7f6dade08800 1 Processor -- start 2024-04-23T18:29:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.110+0000 7f6dade08800 1 -- start start 2024-04-23T18:29:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.111+0000 7f6dade08800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34be4a0 0x5604c34be8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.111+0000 7f6dade08800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5604c3296df0 con 0x5604c34be4a0 2024-04-23T18:29:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.111+0000 7f6dab907640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34be4a0 0x5604c34be8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.111+0000 7f6dab907640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34be4a0 0x5604c34be8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35986/0 (socket says 172.21.15.119:35986) 2024-04-23T18:29:53.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.111+0000 7f6dab907640 1 -- 172.21.15.119:0/862347009 learned_addr learned my addr 172.21.15.119:0/862347009 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.111+0000 7f6dab907640 1 -- 172.21.15.119:0/862347009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c34bee00 con 0x5604c34be4a0 2024-04-23T18:29:53.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.111+0000 7f6dab907640 1 --2- 172.21.15.119:0/862347009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34be4a0 0x5604c34be8c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c08cde0 tx=0x7f6d9c0783a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.111+0000 7f6c917fa640 1 -- 172.21.15.119:0/862347009 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c086120 con 0x5604c34be4a0 2024-04-23T18:29:53.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.111+0000 7f6c917fa640 1 -- 172.21.15.119:0/862347009 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9c066bb0 con 0x5604c34be4a0 2024-04-23T18:29:53.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.111+0000 7f6dade08800 1 -- 172.21.15.119:0/862347009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604c34bf870 con 0x5604c34be4a0 2024-04-23T18:29:53.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.111+0000 7f6c917fa640 1 -- 172.21.15.119:0/862347009 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c086b50 con 0x5604c34be4a0 2024-04-23T18:29:53.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.111+0000 7f6dade08800 1 -- 172.21.15.119:0/862347009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c34bfd70 con 0x5604c34be4a0 2024-04-23T18:29:53.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.112+0000 7f6c917fa640 1 -- 172.21.15.119:0/862347009 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6d9c086cf0 con 0x5604c34be4a0 2024-04-23T18:29:53.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.112+0000 7f6c917fa640 1 --2- 172.21.15.119:0/862347009 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c84036e60 0x7f6c84039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.112+0000 7f6c917fa640 1 -- 172.21.15.119:0/862347009 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f6d9c080070 con 0x5604c34be4a0 2024-04-23T18:29:53.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.112+0000 7f6dab106640 1 --2- 172.21.15.119:0/862347009 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c84036e60 0x7f6c84039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.113+0000 7f6dade08800 1 Processor -- start 2024-04-23T18:29:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.113+0000 7f6dade08800 1 -- start start 2024-04-23T18:29:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.113+0000 7f6dab106640 1 --2- 172.21.15.119:0/862347009 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c84036e60 0x7f6c84039320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6da000bf50 tx=0x7f6da000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.113+0000 7f6dade08800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 0x5604c34cba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.113+0000 7f6dade08800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5604c3498b10 con 0x5604c34cb620 2024-04-23T18:29:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.113+0000 7f6dab907640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 0x5604c34cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.113+0000 7f6dab907640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 0x5604c34cba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35990/0 (socket says 172.21.15.119:35990) 2024-04-23T18:29:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.113+0000 7f6dab907640 1 -- 172.21.15.119:0/2149402879 learned_addr learned my addr 172.21.15.119:0/2149402879 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.113+0000 7f6dab907640 1 -- 172.21.15.119:0/2149402879 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c34cc010 con 0x5604c34cb620 2024-04-23T18:29:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.113+0000 7f6dab907640 1 --2- 172.21.15.119:0/2149402879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 0x5604c34cba40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c081f10 tx=0x7f6d9c08b2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7543298643ab94e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.114+0000 7f6c8affd640 1 -- 172.21.15.119:0/2149402879 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c072c00 con 0x5604c34cb620 2024-04-23T18:29:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.114+0000 7f6c8affd640 1 -- 172.21.15.119:0/2149402879 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9c0a8070 con 0x5604c34cb620 2024-04-23T18:29:53.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.114+0000 7f6c8affd640 1 -- 172.21.15.119:0/2149402879 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c0851f0 con 0x5604c34cb620 2024-04-23T18:29:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.114+0000 7f6dade08800 1 -- 172.21.15.119:0/2149402879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 msgr2=0x5604c34cba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.114+0000 7f6dade08800 1 --2- 172.21.15.119:0/2149402879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 0x5604c34cba40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c081f10 tx=0x7f6d9c08b2d0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.114+0000 7f6dade08800 1 -- 172.21.15.119:0/2149402879 shutdown_connections 2024-04-23T18:29:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.114+0000 7f6dade08800 1 --2- 172.21.15.119:0/2149402879 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 0x5604c34cba40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.114+0000 7f6dade08800 1 -- 172.21.15.119:0/2149402879 >> 172.21.15.119:0/2149402879 conn(0x5604c34c78f0 msgr2=0x5604c34c5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.114+0000 7f6dade08800 1 -- 172.21.15.119:0/2149402879 shutdown_connections 2024-04-23T18:29:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.114+0000 7f6dade08800 1 -- 172.21.15.119:0/2149402879 wait complete. 2024-04-23T18:29:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.114+0000 7f6dade08800 1 Processor -- start 2024-04-23T18:29:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.114+0000 7f6dade08800 1 -- start start 2024-04-23T18:29:53.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.115+0000 7f6dade08800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 0x5604c34d2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.115+0000 7f6dade08800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5604c34cc670 con 0x5604c34cb620 2024-04-23T18:29:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.115+0000 7f6dab907640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 0x5604c34d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.115+0000 7f6dab907640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 0x5604c34d2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36004/0 (socket says 172.21.15.119:36004) 2024-04-23T18:29:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.115+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 learned_addr learned my addr 172.21.15.119:0/3442245904 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.115+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c34d2ea0 con 0x5604c34cb620 2024-04-23T18:29:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.115+0000 7f6dab907640 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 0x5604c34d2960 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c08d020 tx=0x7f6d9c081ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.115+0000 7f6c897fa640 1 -- 172.21.15.119:0/3442245904 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c0bb070 con 0x5604c34cb620 2024-04-23T18:29:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.116+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5604c34d2ea0 con 0x5604c34cb620 2024-04-23T18:29:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.116+0000 7f6c897fa640 1 -- 172.21.15.119:0/3442245904 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9c078a70 con 0x5604c34cb620 2024-04-23T18:29:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.116+0000 7f6c897fa640 1 -- 172.21.15.119:0/3442245904 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d9c073b40 con 0x5604c34cb620 2024-04-23T18:29:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.116+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c34d2ea0 con 0x5604c34cb620 2024-04-23T18:29:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.116+0000 7f6c897fa640 1 -- 172.21.15.119:0/3442245904 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6d9c0be070 con 0x5604c34cb620 2024-04-23T18:29:53.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.116+0000 7f6c897fa640 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c74036e60 0x7f6c74039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.117+0000 7f6c897fa640 1 -- 172.21.15.119:0/3442245904 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f6d9c09e070 con 0x5604c34cb620 2024-04-23T18:29:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.117+0000 7f6dab106640 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c74036e60 0x7f6c74039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.117+0000 7f6dade08800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.117+0000 7f6dab106640 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c74036e60 0x7f6c74039320 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6da0001b60 tx=0x7f6da0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.117+0000 7f6dade08800 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5604c34de000 0x5604c34e04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.117+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e0c10 con 0x5604c34de000 2024-04-23T18:29:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.117+0000 7f6dac108640 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5604c34de000 0x5604c34e04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.117+0000 7f6dac108640 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5604c34de000 0x5604c34e04c0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c34de000 2024-04-23T18:29:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 20 realm 2024-04-23T18:29:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1020 con 0x5604c34de000 2024-04-23T18:29:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c34de000 2024-04-23T18:29:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e18f0 con 0x5604c34de000 2024-04-23T18:29:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c34de000 2024-04-23T18:29:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34de000 2024-04-23T18:29:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c34de000 2024-04-23T18:29:53.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.118+0000 7f6dade08800 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5604c34e29f0 0x5604c34e4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.119+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e53f0 con 0x5604c34e29f0 2024-04-23T18:29:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.119+0000 7f6dab907640 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5604c34e29f0 0x5604c34e4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.119+0000 7f6dab907640 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5604c34e29f0 0x5604c34e4de0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.119+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d9c0bd030 con 0x5604c34e29f0 2024-04-23T18:29:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.119+0000 7f6dade08800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.119+0000 7f6dade08800 20 searching for the correct realm 2024-04-23T18:29:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.119+0000 7f6dade08800 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5604c34e7380 0x5604c34e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.119+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e9f10 con 0x5604c34e7380 2024-04-23T18:29:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.119+0000 7f6dab106640 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5604c34e7380 0x5604c34e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.130 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.119+0000 7f6dab106640 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5604c34e7380 0x5604c34e9840 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.120+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.120+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e9f10 con 0x5604c34e29f0 2024-04-23T18:29:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.120+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c0bd030 con 0x5604c34e29f0 2024-04-23T18:29:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.120+0000 7f6dab907640 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f6d9c0c0060 0x7f6d9c089950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.120+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e9f10 con 0x7f6d9c0c0060 2024-04-23T18:29:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.120+0000 7f6dac108640 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f6d9c0c0060 0x7f6d9c089950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.121+0000 7f6dac108640 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f6d9c0c0060 0x7f6d9c089950 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.121+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da400a4a0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.121+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34de000 2024-04-23T18:29:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.121+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c34de000 2024-04-23T18:29:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.121+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34de000 2024-04-23T18:29:53.131 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.122+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c34de000 2024-04-23T18:29:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.122+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x7f6d9c0c0060 2024-04-23T18:29:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.122+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da400a4a0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.122+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x7f6d9c0c0060 2024-04-23T18:29:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.122+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6da400a4a0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.122+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e29f0 2024-04-23T18:29:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.122+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c0bd030 con 0x5604c34e29f0 2024-04-23T18:29:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.122+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e7380 2024-04-23T18:29:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.123+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.123+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34de000 2024-04-23T18:29:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.123+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c34de000 2024-04-23T18:29:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.123+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x7f6d9c0c0060 2024-04-23T18:29:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.123+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da400a4a0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.132 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.123+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34de000 2024-04-23T18:29:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.123+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c34de000 2024-04-23T18:29:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.123+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e29f0 2024-04-23T18:29:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.124+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d9c0bd030 con 0x5604c34e29f0 2024-04-23T18:29:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.124+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e7380 2024-04-23T18:29:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.124+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.124+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e7380 2024-04-23T18:29:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.124+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.124+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x7f6d9c0c0060 2024-04-23T18:29:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.125+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da400a4a0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.125+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e7380 2024-04-23T18:29:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.125+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.125+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e7380 2024-04-23T18:29:53.133 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.125+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.125+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34de000 2024-04-23T18:29:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.125+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c34de000 2024-04-23T18:29:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.125+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34de000 2024-04-23T18:29:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.125+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c34de000 2024-04-23T18:29:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.125+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x7f6d9c0c0060 2024-04-23T18:29:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.126+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da400a4a0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.126+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e7380 2024-04-23T18:29:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.126+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.126+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e29f0 2024-04-23T18:29:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.127+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d9c0bd030 con 0x5604c34e29f0 2024-04-23T18:29:53.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.127+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34de000 2024-04-23T18:29:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.127+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da400a4a0 con 0x5604c34de000 2024-04-23T18:29:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.127+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e29f0 2024-04-23T18:29:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.127+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c0bd030 con 0x5604c34e29f0 2024-04-23T18:29:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.127+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e7380 2024-04-23T18:29:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.127+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.127+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x7f6d9c0c0060 2024-04-23T18:29:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.128+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da400a4a0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.128+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e29f0 2024-04-23T18:29:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.128+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.128+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e7380 2024-04-23T18:29:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.128+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.128+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x7f6d9c0c0060 2024-04-23T18:29:53.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.128+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6da400a4a0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.128+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34de000 2024-04-23T18:29:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e1c90 con 0x5604c34e29f0 2024-04-23T18:29:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dade08800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dade08800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dade08800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dade08800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dade08800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dade08800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dade08800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e5cb0 con 0x5604c34de000 2024-04-23T18:29:53.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dade08800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dade08800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e60a0 con 0x5604c34de000 2024-04-23T18:29:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dade08800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.129+0000 7f6dade08800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34e60a0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dade08800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dade08800 20 zone default found 2024-04-23T18:29:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dade08800 4 Realm: () 2024-04-23T18:29:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dade08800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:53.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dade08800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:53.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dade08800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:53.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dade08800 20 zonegroup default 2024-04-23T18:29:53.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dade08800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ea390 con 0x5604c34e29f0 2024-04-23T18:29:53.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dade08800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dade08800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ec110 con 0x5604c34e7380 2024-04-23T18:29:53.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.130+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.131+0000 7f6dade08800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.131+0000 7f6dade08800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.131+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ec4b0 con 0x5604c34e7380 2024-04-23T18:29:53.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.131+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.131+0000 7f6dade08800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.131+0000 7f6dade08800 20 started sync module instance, tier type = 2024-04-23T18:29:53.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.131+0000 7f6dade08800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:53.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.131+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34eb5b0 con 0x5604c34e29f0 2024-04-23T18:29:53.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.132+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.132+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94578456574368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ecd00 con 0x5604c34e29f0 2024-04-23T18:29:53.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.132+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ed550 con 0x5604c34de000 2024-04-23T18:29:53.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.133+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94578456574368] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.133+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.133+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94578456578128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ed1a0 con 0x5604c34de000 2024-04-23T18:29:53.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.133+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34edca0 con 0x5604c34e7380 2024-04-23T18:29:53.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.134+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.134+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94578456582032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ee570 con 0x5604c34e7380 2024-04-23T18:29:53.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.134+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ef060 con 0x5604c34e29f0 2024-04-23T18:29:53.144 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.134+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94578456578128] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.135+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.135+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94578456587056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ef450 con 0x5604c34e29f0 2024-04-23T18:29:53.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.135+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34efe90 con 0x5604c34de000 2024-04-23T18:29:53.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.135+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94578456582032] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.136+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.136+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94578456590688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34efe50 con 0x5604c34de000 2024-04-23T18:29:53.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.136+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34f08a0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.137+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94578456587056] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.138+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94578456590688] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.138+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.138+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94578456584384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34f03f0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.138+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34f1140 con 0x7f6d9c0c0060 2024-04-23T18:29:53.145 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.139+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94578456584384] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.139+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.139+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94578456579184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34f0f20 con 0x7f6d9c0c0060 2024-04-23T18:29:53.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.139+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34f1770 con 0x7f6d9c0c0060 2024-04-23T18:29:53.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.140+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(58 notify.7 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.140+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94578456579184] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.140+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94578456596736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34f19d0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.140+0000 7f6dade08800 20 add_watcher() i=0 2024-04-23T18:29:53.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.140+0000 7f6dade08800 20 add_watcher() i=1 2024-04-23T18:29:53.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.140+0000 7f6dade08800 20 add_watcher() i=2 2024-04-23T18:29:53.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.140+0000 7f6dade08800 20 add_watcher() i=3 2024-04-23T18:29:53.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.140+0000 7f6dade08800 20 add_watcher() i=4 2024-04-23T18:29:53.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.140+0000 7f6dade08800 20 add_watcher() i=5 2024-04-23T18:29:53.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.140+0000 7f6dade08800 20 add_watcher() i=6 2024-04-23T18:29:53.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.141+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94578456596736] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.141+0000 7f6dade08800 20 add_watcher() i=7 2024-04-23T18:29:53.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.141+0000 7f6dade08800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:53.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.141+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c34f4ac0 con 0x5604c34de000 2024-04-23T18:29:53.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.141+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.141+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94578456597792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34f1df0 con 0x5604c34de000 2024-04-23T18:29:53.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.142+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94578456597792] v34'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.142+0000 7f6c61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:53.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.142+0000 7f6dade08800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:53.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.142+0000 7f6dade08800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:53.147 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.143+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34f4530 con 0x5604c34de000 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.144+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.144+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34fdeb0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.145+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.145+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34fe2b0 con 0x5604c34e7380 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.146+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.146+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34febc0 con 0x5604c34de000 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.147+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'159 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.147+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34fefa0 con 0x5604c34e29f0 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.148+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.148+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ff030 con 0x5604c34e7380 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.149+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.149+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ffa50 con 0x5604c34de000 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.150+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.150+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34fffc0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.151+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.151+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34fd350 con 0x5604c34e29f0 2024-04-23T18:29:53.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.153+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.153+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34fd350 con 0x5604c34e7380 2024-04-23T18:29:53.150 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.153+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.153+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34fd440 con 0x5604c34e29f0 2024-04-23T18:29:53.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.154+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'48 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.155+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c3500780 con 0x7f6d9c0c0060 2024-04-23T18:29:53.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.156+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.156+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35005b0 con 0x5604c34e29f0 2024-04-23T18:29:53.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.156+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.157+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35005b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.158+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.158+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35005b0 con 0x5604c34de000 2024-04-23T18:29:53.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.159+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'160 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.159+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35005b0 con 0x5604c34e7380 2024-04-23T18:29:53.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.160+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.153 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.160+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35005b0 con 0x5604c34e29f0 2024-04-23T18:29:53.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.161+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.161+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35005b0 con 0x5604c34e7380 2024-04-23T18:29:53.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.162+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.162+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35005b0 con 0x5604c34de000 2024-04-23T18:29:53.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.164+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.164+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35005b0 con 0x5604c34de000 2024-04-23T18:29:53.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.165+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'161 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.165+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35005b0 con 0x5604c34e7380 2024-04-23T18:29:53.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.166+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.166+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c3500970 con 0x5604c34e29f0 2024-04-23T18:29:53.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.167+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.167+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c3500970 con 0x5604c34e7380 2024-04-23T18:29:53.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.168+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.160 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.168+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c3500970 con 0x5604c34e7380 2024-04-23T18:29:53.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.169+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.169+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34fd420 con 0x5604c34e7380 2024-04-23T18:29:53.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.170+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.170+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34fd420 con 0x5604c34e7380 2024-04-23T18:29:53.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.171+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.171+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34fd420 con 0x7f6d9c0c0060 2024-04-23T18:29:53.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.172+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.172+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c3500970 con 0x5604c34e7380 2024-04-23T18:29:53.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.173+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.173+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c3500970 con 0x7f6d9c0c0060 2024-04-23T18:29:53.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.174+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'33 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.174+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c3500970 con 0x5604c34e7380 2024-04-23T18:29:53.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.176+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.176+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c3500970 con 0x7f6d9c0c0060 2024-04-23T18:29:53.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.177+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.177+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c3500970 con 0x5604c34e29f0 2024-04-23T18:29:53.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.178+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.178+0000 7f6c60fe1640 20 reqs_thread_entry: start 2024-04-23T18:29:53.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.178+0000 7f6dade08800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:53.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.178+0000 7f6dade08800 20 Filter name: none 2024-04-23T18:29:53.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.178+0000 7f6bda7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:53.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.178+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-04-23T18:29:53.171 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.178+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:94 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.179+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(94 gc.17 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.179+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:95 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.179+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(95 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.179+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.179+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:96 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352b850 con 0x5604c34e7380 2024-04-23T18:29:53.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.180+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 28 ==== osd_op_reply(96 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.180+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:97 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.180+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 29 ==== osd_op_reply(97 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.180+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.180+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:98 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.180+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 30 ==== osd_op_reply(98 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.180+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.180+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:99 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.181+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 31 ==== osd_op_reply(99 gc.17 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.181+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-04-23T18:29:53.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.181+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:100 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34de000 2024-04-23T18:29:53.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.182+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(100 gc.18 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.182+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:101 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34de000 2024-04-23T18:29:53.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.182+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(101 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.182+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.182+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:102 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352b850 con 0x5604c34de000 2024-04-23T18:29:53.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.183+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(102 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.183+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:103 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34de000 2024-04-23T18:29:53.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.183+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(103 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.183+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.183+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:104 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34de000 2024-04-23T18:29:53.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.183+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(104 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.183+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.177 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.183+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:105 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34de000 2024-04-23T18:29:53.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.184+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(105 gc.18 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.184+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-04-23T18:29:53.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.184+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:106 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34de000 2024-04-23T18:29:53.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.185+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(106 gc.19 [call] v34'162 uv162 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.185+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:107 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34de000 2024-04-23T18:29:53.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.186+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 34 ==== osd_op_reply(107 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.186+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.186+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:108 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352b850 con 0x5604c34de000 2024-04-23T18:29:53.179 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.186+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 35 ==== osd_op_reply(108 gc.19 [call out=24b] v0'0 uv162 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.186+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:109 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34de000 2024-04-23T18:29:53.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.186+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 36 ==== osd_op_reply(109 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.186+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.186+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:110 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34de000 2024-04-23T18:29:53.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.186+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 37 ==== osd_op_reply(110 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.186+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.180 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.186+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:111 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34de000 2024-04-23T18:29:53.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.187+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 38 ==== osd_op_reply(111 gc.19 [call] v34'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.187+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-04-23T18:29:53.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.187+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:112 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.189+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 32 ==== osd_op_reply(112 gc.20 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.189+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:113 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.189+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 33 ==== osd_op_reply(113 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.189+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.189+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:114 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352b850 con 0x5604c34e7380 2024-04-23T18:29:53.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.189+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 34 ==== osd_op_reply(114 gc.20 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.189+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:115 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.189+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 35 ==== osd_op_reply(115 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.189+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.189+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:116 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.190+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 36 ==== osd_op_reply(116 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.190+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.190+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:117 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.191+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 37 ==== osd_op_reply(117 gc.20 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.191+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-04-23T18:29:53.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.191+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:118 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e29f0 2024-04-23T18:29:53.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.192+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(118 gc.21 [call] v34'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.192+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:119 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e29f0 2024-04-23T18:29:53.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.192+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(119 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.192+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.192+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:120 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352b850 con 0x5604c34e29f0 2024-04-23T18:29:53.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.192+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== osd_op_reply(120 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.192+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:121 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e29f0 2024-04-23T18:29:53.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.192+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 24 ==== osd_op_reply(121 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.192+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.192+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:122 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e29f0 2024-04-23T18:29:53.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.193+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 25 ==== osd_op_reply(122 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.193+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.193+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:123 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e29f0 2024-04-23T18:29:53.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.193+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 26 ==== osd_op_reply(123 gc.21 [call] v34'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.193+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-04-23T18:29:53.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.193+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:124 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.194+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 38 ==== osd_op_reply(124 gc.22 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.194+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:125 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.195+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 39 ==== osd_op_reply(125 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.195+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.195+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:126 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352b850 con 0x5604c34e7380 2024-04-23T18:29:53.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.195+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 40 ==== osd_op_reply(126 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.195+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:127 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.195+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 41 ==== osd_op_reply(127 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.195+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.195+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:128 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.196+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 42 ==== osd_op_reply(128 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.196+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.196+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:129 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.197+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 43 ==== osd_op_reply(129 gc.22 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.197+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-04-23T18:29:53.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.197+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:130 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.197+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 44 ==== osd_op_reply(130 gc.23 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.197+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:131 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.198+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 45 ==== osd_op_reply(131 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.198+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.198+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:132 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352b850 con 0x5604c34e7380 2024-04-23T18:29:53.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.198+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 46 ==== osd_op_reply(132 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.198+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:133 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.198+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 47 ==== osd_op_reply(133 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.198+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.198+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:134 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352c860 con 0x5604c34e7380 2024-04-23T18:29:53.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.198+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 48 ==== osd_op_reply(134 gc.23 [call out=1701b] v0'0 uv27 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-23T18:29:53.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 20 garbage collection: RGWGC::process iterating over entry tag='b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.8040203591276444993', time=2024-04-23T18:29:52.846419+0000, chain.objs.size()=7 2024-04-23T18:29:53.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_1 2024-04-23T18:29:53.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:135 3.9s0 3:91a6e018:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352ab50 con 0x5604c34e7380 2024-04-23T18:29:53.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_2 2024-04-23T18:29:53.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:136 3.2as0 3:57c9ec4b:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352ab50 con 0x5604c34de000 2024-04-23T18:29:53.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_3 2024-04-23T18:29:53.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:137 3.12s0 3:48ef2331:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c3532110 con 0x5604c34e29f0 2024-04-23T18:29:53.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_4 2024-04-23T18:29:53.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:138 3.37s0 3:ec8bfaf7:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c3534a70 con 0x5604c34de000 2024-04-23T18:29:53.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_5 2024-04-23T18:29:53.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:139 3.1bs0 3:dbf6d322:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35372e0 con 0x5604c34e7380 2024-04-23T18:29:53.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_6 2024-04-23T18:29:53.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:140 3.15s0 3:a817bc04:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c3539b50 con 0x5604c34e29f0 2024-04-23T18:29:53.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_7 2024-04-23T18:29:53.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.199+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:141 3.28s0 3:1774fe62:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c353c4e0 con 0x5604c34e7380 2024-04-23T18:29:53.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.203+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 49 ==== osd_op_reply(135 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_1 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.204+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 39 ==== osd_op_reply(136 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_2 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.206+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 50 ==== osd_op_reply(139 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_5 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.206+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 40 ==== osd_op_reply(138 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_4 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.206+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 27 ==== osd_op_reply(137 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_3 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.206+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 51 ==== osd_op_reply(141 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_7 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.207+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 28 ==== osd_op_reply(140 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1__shadow_.Y8wNA1mv4SVkvBlmjMuOHMzVbhUHqIO_6 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.207+0000 7f6dade08800 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-23T18:29:53.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.207+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:142 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c353c4e0 con 0x5604c34e7380 2024-04-23T18:29:53.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.212+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 52 ==== osd_op_reply(142 gc.23 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.212+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:143 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c353c4e0 con 0x5604c34e7380 2024-04-23T18:29:53.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.214+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 53 ==== osd_op_reply(143 gc.23 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.214+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-04-23T18:29:53.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.214+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:144 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c353c4e0 con 0x5604c34e7380 2024-04-23T18:29:53.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.215+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 54 ==== osd_op_reply(144 gc.24 [call] v34'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.215+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:145 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.215+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 55 ==== osd_op_reply(145 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.215+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.215+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:146 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.215+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 56 ==== osd_op_reply(146 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.215+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:147 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.215+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 57 ==== osd_op_reply(147 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.215+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.215+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:148 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.216+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 58 ==== osd_op_reply(148 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.216+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.216+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:149 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.217+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 59 ==== osd_op_reply(149 gc.24 [call] v34'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.217+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-04-23T18:29:53.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.217+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:150 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.218+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 60 ==== osd_op_reply(150 gc.25 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.218+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:151 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.218+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 61 ==== osd_op_reply(151 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.218+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.218+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:152 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.218+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 62 ==== osd_op_reply(152 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.218+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:153 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.218+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 63 ==== osd_op_reply(153 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.218+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.218+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:154 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.218+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 64 ==== osd_op_reply(154 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.218+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.218+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:155 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.219+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 65 ==== osd_op_reply(155 gc.25 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.219+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-04-23T18:29:53.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.219+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:156 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.221+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(156 gc.26 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.221+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:157 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.221+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(157 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.221+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.221+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:158 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35335b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.221+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(158 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.221+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:159 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.222+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(159 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.222+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.222+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:160 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.222+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(160 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.222+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.222+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:161 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.224+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(161 gc.26 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.224+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-04-23T18:29:53.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.224+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:162 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.225+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 66 ==== osd_op_reply(162 gc.27 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.225+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:163 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.225+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 67 ==== osd_op_reply(163 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.225+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.225+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:164 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.225+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 68 ==== osd_op_reply(164 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.225+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:165 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.225+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 69 ==== osd_op_reply(165 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.226+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.226+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:166 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.226+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 70 ==== osd_op_reply(166 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.226+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.226+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:167 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.227+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 71 ==== osd_op_reply(167 gc.27 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.227+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-04-23T18:29:53.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.227+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:168 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.228+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(168 gc.28 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.228+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:169 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.228+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== osd_op_reply(169 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.228+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.228+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:170 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35335b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.229+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 31 ==== osd_op_reply(170 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.229+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:171 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.229+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 32 ==== osd_op_reply(171 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.229+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.229+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:172 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.229+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 33 ==== osd_op_reply(172 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.229+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.229+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:173 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.230+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 34 ==== osd_op_reply(173 gc.28 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.230+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-04-23T18:29:53.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.230+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:174 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.231+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 72 ==== osd_op_reply(174 gc.29 [call] v34'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.231+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:175 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.232+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 73 ==== osd_op_reply(175 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.232+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.232+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:176 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.232+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 74 ==== osd_op_reply(176 gc.29 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.232+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:177 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.232+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 75 ==== osd_op_reply(177 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.232+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.232+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:178 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.233+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 76 ==== osd_op_reply(178 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.233+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.233+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:179 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.234+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 77 ==== osd_op_reply(179 gc.29 [call] v34'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.234+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-04-23T18:29:53.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.234+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:180 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.235+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 35 ==== osd_op_reply(180 gc.30 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.235+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:181 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.235+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 36 ==== osd_op_reply(181 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.235+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.235+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:182 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.235+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 37 ==== osd_op_reply(182 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.235+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:183 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.236+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 38 ==== osd_op_reply(183 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.236+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.236+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.236+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 39 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.236+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.236+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.237+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 40 ==== osd_op_reply(185 gc.30 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.237+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-04-23T18:29:53.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.237+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:186 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e29f0 2024-04-23T18:29:53.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.238+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 29 ==== osd_op_reply(186 gc.31 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.238+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e29f0 2024-04-23T18:29:53.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.238+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 30 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.238+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.238+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e29f0 2024-04-23T18:29:53.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.239+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 31 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.239+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e29f0 2024-04-23T18:29:53.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.239+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 32 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.239+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.239+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:190 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e29f0 2024-04-23T18:29:53.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.239+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 33 ==== osd_op_reply(190 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.239+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.239+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:191 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e29f0 2024-04-23T18:29:53.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.240+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 34 ==== osd_op_reply(191 gc.31 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.240+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-04-23T18:29:53.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.240+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:192 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34de000 2024-04-23T18:29:53.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.241+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 41 ==== osd_op_reply(192 gc.0 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.241+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:193 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34de000 2024-04-23T18:29:53.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.241+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 42 ==== osd_op_reply(193 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.241+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.241+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:194 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34de000 2024-04-23T18:29:53.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.241+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 43 ==== osd_op_reply(194 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.241+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:195 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34de000 2024-04-23T18:29:53.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.242+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 44 ==== osd_op_reply(195 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.242+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.242+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:196 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34de000 2024-04-23T18:29:53.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.242+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 45 ==== osd_op_reply(196 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.242+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.242+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:197 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34de000 2024-04-23T18:29:53.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.243+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 46 ==== osd_op_reply(197 gc.0 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.243+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-04-23T18:29:53.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.243+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:198 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.244+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 41 ==== osd_op_reply(198 gc.1 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.244+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:199 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.244+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 42 ==== osd_op_reply(199 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.244+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.244+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:200 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.245+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 43 ==== osd_op_reply(200 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.245+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:201 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.245+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 44 ==== osd_op_reply(201 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.245+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.245+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:202 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.245+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 45 ==== osd_op_reply(202 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.245+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.245+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:203 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x7f6d9c0c0060 2024-04-23T18:29:53.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.246+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 46 ==== osd_op_reply(203 gc.1 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.246+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-04-23T18:29:53.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.246+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:204 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.247+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 78 ==== osd_op_reply(204 gc.2 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.247+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:205 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.247+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 79 ==== osd_op_reply(205 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.247+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.247+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:206 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.248+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 80 ==== osd_op_reply(206 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.248+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:207 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.248+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 81 ==== osd_op_reply(207 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.248+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.248+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:208 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.248+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 82 ==== osd_op_reply(208 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.248+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.248+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:209 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e7380 2024-04-23T18:29:53.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.249+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 83 ==== osd_op_reply(209 gc.2 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.249+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-04-23T18:29:53.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.249+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:210 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34de000 2024-04-23T18:29:53.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.250+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 47 ==== osd_op_reply(210 gc.3 [call] v34'164 uv164 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.250+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:211 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34de000 2024-04-23T18:29:53.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.250+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 48 ==== osd_op_reply(211 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.250+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.250+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:212 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34de000 2024-04-23T18:29:53.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.251+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 49 ==== osd_op_reply(212 gc.3 [call out=24b] v0'0 uv164 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.251+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:213 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34de000 2024-04-23T18:29:53.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.251+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 50 ==== osd_op_reply(213 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.251+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.251+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:214 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34de000 2024-04-23T18:29:53.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.251+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 51 ==== osd_op_reply(214 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.251+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.251+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:215 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34de000 2024-04-23T18:29:53.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.252+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 52 ==== osd_op_reply(215 gc.3 [call] v34'165 uv165 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.252+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-04-23T18:29:53.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.252+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:216 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e29f0 2024-04-23T18:29:53.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.253+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 35 ==== osd_op_reply(216 gc.4 [call] v34'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.253+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:217 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e29f0 2024-04-23T18:29:53.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.254+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 36 ==== osd_op_reply(217 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.254+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.254+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:218 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c352a530 con 0x5604c34e29f0 2024-04-23T18:29:53.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.254+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 37 ==== osd_op_reply(218 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.254+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:219 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.254+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 38 ==== osd_op_reply(219 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.254+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.254+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:220 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.254+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 39 ==== osd_op_reply(220 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.254+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.254+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:221 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.255+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 40 ==== osd_op_reply(221 gc.4 [call] v34'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.255+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-04-23T18:29:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.255+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:222 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.256+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 84 ==== osd_op_reply(222 gc.5 [call] v34'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.256+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:223 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.257+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 85 ==== osd_op_reply(223 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.257+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.257+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:224 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35334a0 con 0x5604c34e7380 2024-04-23T18:29:53.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.257+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 86 ==== osd_op_reply(224 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.257+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:225 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.257+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 87 ==== osd_op_reply(225 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.257+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.257+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:226 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.257+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 88 ==== osd_op_reply(226 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.257+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.257+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:227 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.258+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 89 ==== osd_op_reply(227 gc.5 [call] v34'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.258+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-04-23T18:29:53.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.258+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:228 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34de000 2024-04-23T18:29:53.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.260+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 53 ==== osd_op_reply(228 gc.6 [call] v34'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.260+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:229 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34de000 2024-04-23T18:29:53.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.260+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 54 ==== osd_op_reply(229 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.260+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.260+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:230 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35334a0 con 0x5604c34de000 2024-04-23T18:29:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.260+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 55 ==== osd_op_reply(230 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.260+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:231 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34de000 2024-04-23T18:29:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.260+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 56 ==== osd_op_reply(231 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.260+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.260+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:232 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34de000 2024-04-23T18:29:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.260+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 57 ==== osd_op_reply(232 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.260+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.260+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:233 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34de000 2024-04-23T18:29:53.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.261+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 58 ==== osd_op_reply(233 gc.6 [call] v34'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.262+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-04-23T18:29:53.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.262+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:234 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.262+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 47 ==== osd_op_reply(234 gc.7 [call] v34'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.262+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:235 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.263+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 48 ==== osd_op_reply(235 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.263+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.263+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:236 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35334a0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.263+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 49 ==== osd_op_reply(236 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.263+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:237 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.263+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 50 ==== osd_op_reply(237 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.263+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.263+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:238 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.263+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 51 ==== osd_op_reply(238 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.263+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.264+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:239 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.264+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 52 ==== osd_op_reply(239 gc.7 [call] v34'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.264+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-04-23T18:29:53.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.264+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:240 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.266+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 41 ==== osd_op_reply(240 gc.8 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.266+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:241 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.266+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 42 ==== osd_op_reply(241 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.266+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.266+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:242 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35334a0 con 0x5604c34e29f0 2024-04-23T18:29:53.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.266+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 43 ==== osd_op_reply(242 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.266+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:243 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.266+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 44 ==== osd_op_reply(243 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.266+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.266+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:244 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.266+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 45 ==== osd_op_reply(244 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.266+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.266+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:245 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.267+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 46 ==== osd_op_reply(245 gc.8 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.267+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-04-23T18:29:53.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.267+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:246 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.268+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 90 ==== osd_op_reply(246 gc.9 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.268+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:247 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.268+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 91 ==== osd_op_reply(247 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.268+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.268+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:248 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35334a0 con 0x5604c34e7380 2024-04-23T18:29:53.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.269+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 92 ==== osd_op_reply(248 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.269+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:249 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.269+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 93 ==== osd_op_reply(249 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.269+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.269+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:250 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.269+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 94 ==== osd_op_reply(250 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.269+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.269+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:251 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.270+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 95 ==== osd_op_reply(251 gc.9 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.270+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-04-23T18:29:53.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.270+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:252 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.271+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 47 ==== osd_op_reply(252 gc.10 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.271+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:253 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.271+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 48 ==== osd_op_reply(253 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.271+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.271+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:254 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35334a0 con 0x5604c34e29f0 2024-04-23T18:29:53.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.272+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 49 ==== osd_op_reply(254 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.272+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:255 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.272+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 50 ==== osd_op_reply(255 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.272+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.272+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:256 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.272+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 51 ==== osd_op_reply(256 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.272+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.272+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:257 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.273+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 52 ==== osd_op_reply(257 gc.10 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.273+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-04-23T18:29:53.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.273+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:258 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.274+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 53 ==== osd_op_reply(258 gc.11 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.274+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:259 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.274+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 54 ==== osd_op_reply(259 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.274+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.274+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:260 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35334a0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.275+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 55 ==== osd_op_reply(260 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.275+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:261 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.275+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 56 ==== osd_op_reply(261 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.275+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.275+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:262 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.275+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 57 ==== osd_op_reply(262 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.275+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.275+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:263 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.276+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 58 ==== osd_op_reply(263 gc.11 [call] v34'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.276+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-04-23T18:29:53.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.276+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:264 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.277+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 53 ==== osd_op_reply(264 gc.12 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.277+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:265 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.277+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 54 ==== osd_op_reply(265 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.277+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.277+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:266 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35334a0 con 0x5604c34e29f0 2024-04-23T18:29:53.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.278+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 55 ==== osd_op_reply(266 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.278+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:267 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.278+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 56 ==== osd_op_reply(267 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.278+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.278+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:268 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.278+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 57 ==== osd_op_reply(268 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.278+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.278+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:269 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.279+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 58 ==== osd_op_reply(269 gc.12 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.279+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-04-23T18:29:53.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.279+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:270 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.280+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 59 ==== osd_op_reply(270 gc.13 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.280+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:271 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.281+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 60 ==== osd_op_reply(271 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.281+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.281+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:272 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35334a0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.281+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 61 ==== osd_op_reply(272 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.281+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:273 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.281+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 62 ==== osd_op_reply(273 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.281+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.281+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:274 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.281+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 63 ==== osd_op_reply(274 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.281+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.281+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:275 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x7f6d9c0c0060 2024-04-23T18:29:53.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.282+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 64 ==== osd_op_reply(275 gc.13 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.282+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-04-23T18:29:53.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.283+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:276 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34de000 2024-04-23T18:29:53.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.284+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 59 ==== osd_op_reply(276 gc.14 [call] v34'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.284+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:277 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34de000 2024-04-23T18:29:53.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.284+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 60 ==== osd_op_reply(277 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.284+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.284+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:278 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35334a0 con 0x5604c34de000 2024-04-23T18:29:53.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.284+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 61 ==== osd_op_reply(278 gc.14 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.284+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:279 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34de000 2024-04-23T18:29:53.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.284+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 62 ==== osd_op_reply(279 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.284+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.284+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:280 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34de000 2024-04-23T18:29:53.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.284+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 63 ==== osd_op_reply(280 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.284+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.285+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:281 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34de000 2024-04-23T18:29:53.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.285+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 64 ==== osd_op_reply(281 gc.14 [call] v34'167 uv167 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.285+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-04-23T18:29:53.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.285+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:282 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.286+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 96 ==== osd_op_reply(282 gc.15 [call] v34'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.286+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:283 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.287+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 97 ==== osd_op_reply(283 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.287+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.287+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:284 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35334a0 con 0x5604c34e7380 2024-04-23T18:29:53.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.287+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 98 ==== osd_op_reply(284 gc.15 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.287+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:285 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.287+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 99 ==== osd_op_reply(285 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.287+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.287+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:286 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.287+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 100 ==== osd_op_reply(286 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.287+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.287+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:287 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e7380 2024-04-23T18:29:53.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.288+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 101 ==== osd_op_reply(287 gc.15 [call] v34'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.288+0000 7f6dade08800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-04-23T18:29:53.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.288+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:288 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.289+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 59 ==== osd_op_reply(288 gc.16 [call] v34'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.289+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:289 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.290+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 60 ==== osd_op_reply(289 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.290+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.290+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:290 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35334a0 con 0x5604c34e29f0 2024-04-23T18:29:53.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.290+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 61 ==== osd_op_reply(290 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.290+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:291 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.290+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 62 ==== osd_op_reply(291 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.290+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:29:53.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.290+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:292 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.290+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 63 ==== osd_op_reply(292 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.290+0000 7f6dade08800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:29:53.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.290+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:293 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c35344b0 con 0x5604c34e29f0 2024-04-23T18:29:53.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.291+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 64 ==== osd_op_reply(293 gc.16 [call] v34'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.292+0000 7f6c61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:53.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.292+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94578456597792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c3529d80 con 0x5604c34de000 2024-04-23T18:29:53.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.293+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94578456597792] v34'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.293+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94578456574368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34f1520 con 0x5604c34e29f0 2024-04-23T18:29:53.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.294+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 65 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94578456574368] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.294+0000 7f6dade08800 20 remove_watcher() i=0 2024-04-23T18:29:53.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.294+0000 7f6dade08800 2 removed watcher, disabling cache 2024-04-23T18:29:53.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.294+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94578456578128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34f1520 con 0x5604c34de000 2024-04-23T18:29:53.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.295+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94578456578128] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.295+0000 7f6dade08800 20 remove_watcher() i=1 2024-04-23T18:29:53.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.295+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94578456582032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ec850 con 0x5604c34e7380 2024-04-23T18:29:53.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.296+0000 7f6dab106640 1 -- 172.21.15.119:0/3442245904 <== osd.3 v2:172.21.15.119:6809/3910610681 102 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94578456582032] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da0009050 con 0x5604c34e7380 2024-04-23T18:29:53.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.296+0000 7f6dade08800 20 remove_watcher() i=2 2024-04-23T18:29:53.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.296+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94578456587056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34f1520 con 0x5604c34e29f0 2024-04-23T18:29:53.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.297+0000 7f6dab907640 1 -- 172.21.15.119:0/3442245904 <== osd.2 v2:172.21.15.119:6800/2624052101 66 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94578456587056] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d9c0d4040 con 0x5604c34e29f0 2024-04-23T18:29:53.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.297+0000 7f6dade08800 20 remove_watcher() i=3 2024-04-23T18:29:53.289 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.297+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94578456590688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ed790 con 0x5604c34de000 2024-04-23T18:29:53.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.298+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.1 v2:172.21.15.119:6808/2736386629 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94578456590688] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x5604c34de000 2024-04-23T18:29:53.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.298+0000 7f6dade08800 20 remove_watcher() i=4 2024-04-23T18:29:53.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.298+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94578456584384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ec850 con 0x7f6d9c0c0060 2024-04-23T18:29:53.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.299+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 65 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94578456584384] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.299+0000 7f6dade08800 20 remove_watcher() i=5 2024-04-23T18:29:53.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.299+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94578456579184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34f1520 con 0x7f6d9c0c0060 2024-04-23T18:29:53.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.300+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 66 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94578456579184] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.300+0000 7f6dade08800 20 remove_watcher() i=6 2024-04-23T18:29:53.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.300+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94578456596736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5604c34ed790 con 0x7f6d9c0c0060 2024-04-23T18:29:53.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 <== osd.0 v2:172.21.15.62:6800/2641588406 67 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94578456596736] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6da4040080 con 0x7f6d9c0c0060 2024-04-23T18:29:53.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 20 remove_watcher() i=7 2024-04-23T18:29:53.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f6d9c0c0060 msgr2=0x7f6d9c089950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f6d9c0c0060 0x7f6d9c089950 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5604c34de000 msgr2=0x5604c34e04c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5604c34de000 0x5604c34e04c0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5604c34e29f0 msgr2=0x5604c34e4de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5604c34e29f0 0x5604c34e4de0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5604c34e7380 msgr2=0x5604c34e9840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5604c34e7380 0x5604c34e9840 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c74036e60 msgr2=0x7f6c74039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c74036e60 0x7f6c74039320 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6da0001b60 tx=0x7f6da0010000 comp rx=0 tx=0).stop 2024-04-23T18:29:53.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 msgr2=0x5604c34d2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dac108640 1 -- 172.21.15.119:0/3442245904 reap_dead start 2024-04-23T18:29:53.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 0x5604c34d2960 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c08d020 tx=0x7f6d9c081ea0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 shutdown_connections 2024-04-23T18:29:53.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 --2- 172.21.15.119:0/3442245904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34cb620 0x5604c34d2960 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 >> 172.21.15.119:0/3442245904 conn(0x5604c34c78f0 msgr2=0x5604c34c4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 shutdown_connections 2024-04-23T18:29:53.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.302+0000 7f6dade08800 1 -- 172.21.15.119:0/3442245904 wait complete. 2024-04-23T18:29:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/862347009 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c84036e60 msgr2=0x7f6c84039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 --2- 172.21.15.119:0/862347009 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c84036e60 0x7f6c84039320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6da000bf50 tx=0x7f6da000f000 comp rx=0 tx=0).stop 2024-04-23T18:29:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/862347009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34be4a0 msgr2=0x5604c34be8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 --2- 172.21.15.119:0/862347009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34be4a0 0x5604c34be8c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c08cde0 tx=0x7f6d9c0783a0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/862347009 shutdown_connections 2024-04-23T18:29:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 --2- 172.21.15.119:0/862347009 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c84036e60 0x7f6c84039320 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 --2- 172.21.15.119:0/862347009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c34be4a0 0x5604c34be8c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/862347009 >> 172.21.15.119:0/862347009 conn(0x5604c34b2540 msgr2=0x5604c34b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/862347009 shutdown_connections 2024-04-23T18:29:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/862347009 wait complete. 2024-04-23T18:29:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5604c34ad490 msgr2=0x5604c34af8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5604c34ad490 0x5604c34af8e0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5604c33a41c0 msgr2=0x5604c34a6cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5604c33a41c0 0x5604c34a6cc0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5604c34a9550 msgr2=0x5604c34ab940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5604c34a9550 0x5604c34ab940 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c94036e60 msgr2=0x7f6c94039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c94036e60 0x7f6c94039320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6da0000f60 tx=0x7f6da00012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 msgr2=0x5604c349fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 --2- 172.21.15.119:0/2345381087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5604c33a3860 0x5604c349fc50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c05f040 tx=0x7f6d9c002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dac108640 1 -- 172.21.15.119:0/2345381087 reap_dead start 2024-04-23T18:29:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 shutdown_connections 2024-04-23T18:29:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 >> 172.21.15.119:0/2345381087 conn(0x5604c339f400 msgr2=0x5604c34925f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 shutdown_connections 2024-04-23T18:29:53.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.303+0000 7f6dade08800 1 -- 172.21.15.119:0/2345381087 wait complete. 2024-04-23T18:29:53.303 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-23T18:29:53.303 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-23T18:29:53.304 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-23T18:29:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:53.385 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:53.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.393+0000 7f19a3b36800 1 Processor -- start 2024-04-23T18:29:53.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.393+0000 7f19a3b36800 1 -- start start 2024-04-23T18:29:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.393+0000 7f19a3b36800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560cb0c993a0 0x560cb0c9b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.393+0000 7f19a3b36800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560cb0b45560 con 0x560cb0c94f60 2024-04-23T18:29:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.393+0000 7f19a3b36800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x560cb0b36e20 con 0x560cb0c993a0 2024-04-23T18:29:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.394+0000 7f199f0cb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560cb0c993a0 0x560cb0c9b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.394+0000 7f199f8cc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x560cb0c94f60 0x560cb0c95380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:43612/0 (socket says 172.21.15.119:43612) 2024-04-23T18:29:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.394+0000 7f199f0cb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560cb0c993a0 0x560cb0c9b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36014/0 (socket says 172.21.15.119:36014) 2024-04-23T18:29:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.394+0000 7f199f8cc640 1 -- 172.21.15.119:0/1499285272 learned_addr learned my addr 172.21.15.119:0/1499285272 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.394+0000 7f199f0cb640 1 -- 172.21.15.119:0/1499285272 >> v1:172.21.15.62:6789/0 conn(0x560cb0c94f60 legacy=0x560cb0c95380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.394+0000 7f199f0cb640 1 -- 172.21.15.119:0/1499285272 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb0b44e60 con 0x560cb0c993a0 2024-04-23T18:29:53.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.396+0000 7f199f0cb640 1 --2- 172.21.15.119:0/1499285272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c993a0 0x560cb0c9b790 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f199400a470 tx=0x7f199401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a25b14f98a1f012 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.396+0000 7f199e8ca640 1 -- 172.21.15.119:0/1499285272 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1994057070 con 0x560cb0c993a0 2024-04-23T18:29:53.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.396+0000 7f199e8ca640 1 -- 172.21.15.119:0/1499285272 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1994052570 con 0x560cb0c993a0 2024-04-23T18:29:53.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.396+0000 7f199e8ca640 1 -- 172.21.15.119:0/1499285272 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1994052870 con 0x560cb0c993a0 2024-04-23T18:29:53.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.397+0000 7f19a3b36800 1 -- 172.21.15.119:0/1499285272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c993a0 msgr2=0x560cb0c9b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.397+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1499285272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c993a0 0x560cb0c9b790 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f199400a470 tx=0x7f199401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:53.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.397+0000 7f19a3b36800 1 -- 172.21.15.119:0/1499285272 shutdown_connections 2024-04-23T18:29:53.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.397+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1499285272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c993a0 0x560cb0c9b790 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.397+0000 7f19a3b36800 1 -- 172.21.15.119:0/1499285272 >> 172.21.15.119:0/1499285272 conn(0x560cb0c90540 msgr2=0x560cb0c92960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.397+0000 7f19a3b36800 1 -- 172.21.15.119:0/1499285272 shutdown_connections 2024-04-23T18:29:53.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.397+0000 7f19a3b36800 1 -- 172.21.15.119:0/1499285272 wait complete. 2024-04-23T18:29:53.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.408+0000 7f19a3b36800 1 Processor -- start 2024-04-23T18:29:53.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.408+0000 7f19a3b36800 1 -- start start 2024-04-23T18:29:53.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.408+0000 7f19a3b36800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c94f60 0x560cb0d86130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.408+0000 7f19a3b36800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560cb0be05b0 con 0x560cb0c94f60 2024-04-23T18:29:53.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.409+0000 7f199f8cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c94f60 0x560cb0d86130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.409+0000 7f199f8cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c94f60 0x560cb0d86130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36030/0 (socket says 172.21.15.119:36030) 2024-04-23T18:29:53.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.409+0000 7f199f8cc640 1 -- 172.21.15.119:0/1075067649 learned_addr learned my addr 172.21.15.119:0/1075067649 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.409+0000 7f199f8cc640 1 -- 172.21.15.119:0/1075067649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb0b56860 con 0x560cb0c94f60 2024-04-23T18:29:53.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.409+0000 7f199f8cc640 1 --2- 172.21.15.119:0/1075067649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c94f60 0x560cb0d86130 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1990001d80 tx=0x7f1990001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98684c8d6d7b689 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.409+0000 7f188de0b640 1 -- 172.21.15.119:0/1075067649 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1990013030 con 0x560cb0c94f60 2024-04-23T18:29:53.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.409+0000 7f188de0b640 1 -- 172.21.15.119:0/1075067649 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f199000e470 con 0x560cb0c94f60 2024-04-23T18:29:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.409+0000 7f188de0b640 1 -- 172.21.15.119:0/1075067649 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f199000e810 con 0x560cb0c94f60 2024-04-23T18:29:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.410+0000 7f19a3b36800 1 -- 172.21.15.119:0/1075067649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c94f60 msgr2=0x560cb0d86130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.410+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1075067649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c94f60 0x560cb0d86130 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1990001d80 tx=0x7f1990001e70 comp rx=0 tx=0).stop 2024-04-23T18:29:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.410+0000 7f19a3b36800 1 -- 172.21.15.119:0/1075067649 shutdown_connections 2024-04-23T18:29:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.410+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1075067649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c94f60 0x560cb0d86130 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.410+0000 7f19a3b36800 1 -- 172.21.15.119:0/1075067649 >> 172.21.15.119:0/1075067649 conn(0x560cb0c90540 msgr2=0x560cb0d81a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.410+0000 7f19a3b36800 1 -- 172.21.15.119:0/1075067649 shutdown_connections 2024-04-23T18:29:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.410+0000 7f19a3b36800 1 -- 172.21.15.119:0/1075067649 wait complete. 2024-04-23T18:29:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.410+0000 7f19a3b36800 1 Processor -- start 2024-04-23T18:29:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.410+0000 7f19a3b36800 1 -- start start 2024-04-23T18:29:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.411+0000 7f19a3b36800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c94f60 0x560cb0d8dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.411+0000 7f19a3b36800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560cb0c9c060 con 0x560cb0c94f60 2024-04-23T18:29:53.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.411+0000 7f199f8cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c94f60 0x560cb0d8dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.411+0000 7f199f8cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c94f60 0x560cb0d8dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36040/0 (socket says 172.21.15.119:36040) 2024-04-23T18:29:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.411+0000 7f199f8cc640 1 -- 172.21.15.119:0/694477172 learned_addr learned my addr 172.21.15.119:0/694477172 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.411+0000 7f199f8cc640 1 -- 172.21.15.119:0/694477172 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb0b54eb0 con 0x560cb0c94f60 2024-04-23T18:29:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.411+0000 7f199f8cc640 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c94f60 0x560cb0d8dac0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1990004000 tx=0x7f1990000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.411+0000 7f1887fff640 1 -- 172.21.15.119:0/694477172 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1990027070 con 0x560cb0c94f60 2024-04-23T18:29:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.411+0000 7f1887fff640 1 -- 172.21.15.119:0/694477172 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1990019900 con 0x560cb0c94f60 2024-04-23T18:29:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.411+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560cb0d8e000 con 0x560cb0c94f60 2024-04-23T18:29:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.412+0000 7f1887fff640 1 -- 172.21.15.119:0/694477172 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1990019c60 con 0x560cb0c94f60 2024-04-23T18:29:53.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.412+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cb0d8e520 con 0x560cb0c94f60 2024-04-23T18:29:53.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.412+0000 7f1887fff640 1 -- 172.21.15.119:0/694477172 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f199002a070 con 0x560cb0c94f60 2024-04-23T18:29:53.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.413+0000 7f1887fff640 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1888036e60 0x7f1888039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.413+0000 7f1887fff640 1 -- 172.21.15.119:0/694477172 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f199001f070 con 0x560cb0c94f60 2024-04-23T18:29:53.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.413+0000 7f199f0cb640 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1888036e60 0x7f1888039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.413+0000 7f19a3b36800 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560cb0c993a0 0x560cb0d94b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.413+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0d950c0 con 0x560cb0c993a0 2024-04-23T18:29:53.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.413+0000 7f19a00cd640 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560cb0c993a0 0x560cb0d94b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.413+0000 7f199f0cb640 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1888036e60 0x7f1888039320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1994054000 tx=0x7f199404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.413+0000 7f19a00cd640 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560cb0c993a0 0x560cb0d94b30 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.413+0000 7f19a00cd640 1 -- 172.21.15.119:0/694477172 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0c993a0 2024-04-23T18:29:53.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.413+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0d92100 con 0x560cb0c993a0 2024-04-23T18:29:53.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.414+0000 7f19a00cd640 1 -- 172.21.15.119:0/694477172 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0c993a0 2024-04-23T18:29:53.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.414+0000 7f19a3b36800 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560cb0d97410 0x560cb0d99800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.414+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0d99ea0 con 0x560cb0d97410 2024-04-23T18:29:53.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.414+0000 7f199f8cc640 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560cb0d97410 0x560cb0d99800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.414+0000 7f199f8cc640 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560cb0d97410 0x560cb0d99800 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.414+0000 7f199f8cc640 1 -- 172.21.15.119:0/694477172 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1990029030 con 0x560cb0d97410 2024-04-23T18:29:53.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.414+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0d96390 con 0x560cb0c993a0 2024-04-23T18:29:53.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.415+0000 7f19a00cd640 1 -- 172.21.15.119:0/694477172 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0c993a0 2024-04-23T18:29:53.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.415+0000 7f19a3b36800 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560cb0d9b300 0x560cb0d9d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.415+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0d9ded0 con 0x560cb0d9b300 2024-04-23T18:29:53.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.415+0000 7f199f0cb640 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560cb0d9b300 0x560cb0d9d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.415+0000 7f199f0cb640 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560cb0d9b300 0x560cb0d9d770 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.416+0000 7f199f0cb640 1 -- 172.21.15.119:0/694477172 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1994052980 con 0x560cb0d9b300 2024-04-23T18:29:53.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.416+0000 7f19a3b36800 1 Processor -- start 2024-04-23T18:29:53.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.416+0000 7f19a3b36800 1 -- start start 2024-04-23T18:29:53.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.416+0000 7f19a3b36800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0dac330 0x560cb0dac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.416+0000 7f19a3b36800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560cb0b86df0 con 0x560cb0dac330 2024-04-23T18:29:53.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.416+0000 7f199f8cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0dac330 0x560cb0dac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.416+0000 7f199f8cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0dac330 0x560cb0dac750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36056/0 (socket says 172.21.15.119:36056) 2024-04-23T18:29:53.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.416+0000 7f199f8cc640 1 -- 172.21.15.119:0/3854614749 learned_addr learned my addr 172.21.15.119:0/3854614749 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.416+0000 7f199f8cc640 1 -- 172.21.15.119:0/3854614749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb0dacc90 con 0x560cb0dac330 2024-04-23T18:29:53.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.417+0000 7f199f8cc640 1 --2- 172.21.15.119:0/3854614749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0dac330 0x560cb0dac750 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1990016fd0 tx=0x7f199002a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.417+0000 7f18857fa640 1 -- 172.21.15.119:0/3854614749 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1990039070 con 0x560cb0dac330 2024-04-23T18:29:53.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.417+0000 7f18857fa640 1 -- 172.21.15.119:0/3854614749 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1990044a40 con 0x560cb0dac330 2024-04-23T18:29:53.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.417+0000 7f18857fa640 1 -- 172.21.15.119:0/3854614749 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1990044d20 con 0x560cb0dac330 2024-04-23T18:29:53.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.417+0000 7f19a3b36800 1 -- 172.21.15.119:0/3854614749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560cb0dad700 con 0x560cb0dac330 2024-04-23T18:29:53.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.417+0000 7f19a3b36800 1 -- 172.21.15.119:0/3854614749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cb0dadc00 con 0x560cb0dac330 2024-04-23T18:29:53.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.418+0000 7f18857fa640 1 -- 172.21.15.119:0/3854614749 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1990016070 con 0x560cb0dac330 2024-04-23T18:29:53.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.418+0000 7f18857fa640 1 --2- 172.21.15.119:0/3854614749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1878036e60 0x7f1878039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.418+0000 7f18857fa640 1 -- 172.21.15.119:0/3854614749 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f1990014070 con 0x560cb0dac330 2024-04-23T18:29:53.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.418+0000 7f199f0cb640 1 --2- 172.21.15.119:0/3854614749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1878036e60 0x7f1878039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.418+0000 7f19a3b36800 1 Processor -- start 2024-04-23T18:29:53.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.418+0000 7f19a3b36800 1 -- start start 2024-04-23T18:29:53.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.418+0000 7f199f0cb640 1 --2- 172.21.15.119:0/3854614749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1878036e60 0x7f1878039320 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x560cb0d92020 tx=0x7f1994005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.418+0000 7f19a3b36800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 0x560cb0c0a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.418+0000 7f19a3b36800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560cb0d868b0 con 0x560cb0c0a560 2024-04-23T18:29:53.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.419+0000 7f199f8cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 0x560cb0c0a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.419+0000 7f199f8cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 0x560cb0c0a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36068/0 (socket says 172.21.15.119:36068) 2024-04-23T18:29:53.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.419+0000 7f199f8cc640 1 -- 172.21.15.119:0/2290580965 learned_addr learned my addr 172.21.15.119:0/2290580965 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.419+0000 7f199f8cc640 1 -- 172.21.15.119:0/2290580965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb0c08d50 con 0x560cb0c0a560 2024-04-23T18:29:53.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.419+0000 7f199f8cc640 1 --2- 172.21.15.119:0/2290580965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 0x560cb0c0a980 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f199003d000 tx=0x7f199002c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e5ec957288a3de server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.419+0000 7f187effd640 1 -- 172.21.15.119:0/2290580965 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f199000cbf0 con 0x560cb0c0a560 2024-04-23T18:29:53.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.419+0000 7f187effd640 1 -- 172.21.15.119:0/2290580965 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1990051070 con 0x560cb0c0a560 2024-04-23T18:29:53.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.419+0000 7f187effd640 1 -- 172.21.15.119:0/2290580965 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f199002a6b0 con 0x560cb0c0a560 2024-04-23T18:29:53.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.419+0000 7f19a3b36800 1 -- 172.21.15.119:0/2290580965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 msgr2=0x560cb0c0a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.419+0000 7f19a3b36800 1 --2- 172.21.15.119:0/2290580965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 0x560cb0c0a980 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f199003d000 tx=0x7f199002c500 comp rx=0 tx=0).stop 2024-04-23T18:29:53.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.419+0000 7f19a3b36800 1 -- 172.21.15.119:0/2290580965 shutdown_connections 2024-04-23T18:29:53.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.419+0000 7f19a3b36800 1 --2- 172.21.15.119:0/2290580965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 0x560cb0c0a980 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.420+0000 7f19a3b36800 1 -- 172.21.15.119:0/2290580965 >> 172.21.15.119:0/2290580965 conn(0x560cb0db5810 msgr2=0x560cb0db3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.420+0000 7f19a3b36800 1 -- 172.21.15.119:0/2290580965 shutdown_connections 2024-04-23T18:29:53.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.420+0000 7f19a3b36800 1 -- 172.21.15.119:0/2290580965 wait complete. 2024-04-23T18:29:53.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.420+0000 7f19a3b36800 1 Processor -- start 2024-04-23T18:29:53.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.420+0000 7f19a3b36800 1 -- start start 2024-04-23T18:29:53.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.420+0000 7f19a3b36800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 0x560cb0dc2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.420+0000 7f19a3b36800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560cb0c09160 con 0x560cb0c0a560 2024-04-23T18:29:53.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.420+0000 7f199f8cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 0x560cb0dc2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.420+0000 7f199f8cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 0x560cb0dc2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36070/0 (socket says 172.21.15.119:36070) 2024-04-23T18:29:53.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.420+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 learned_addr learned my addr 172.21.15.119:0/1109351205 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.421+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cb0dc3090 con 0x560cb0c0a560 2024-04-23T18:29:53.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.421+0000 7f199f8cc640 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 0x560cb0dc2b50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f199000dfd0 tx=0x7f1990037f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.421+0000 7f187d7fa640 1 -- 172.21.15.119:0/1109351205 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f199006f020 con 0x560cb0c0a560 2024-04-23T18:29:53.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.421+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560cb0dc3090 con 0x560cb0c0a560 2024-04-23T18:29:53.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.421+0000 7f187d7fa640 1 -- 172.21.15.119:0/1109351205 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f199000ccc0 con 0x560cb0c0a560 2024-04-23T18:29:53.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.421+0000 7f187d7fa640 1 -- 172.21.15.119:0/1109351205 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1990065040 con 0x560cb0c0a560 2024-04-23T18:29:53.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.421+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cb0dc3090 con 0x560cb0c0a560 2024-04-23T18:29:53.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.422+0000 7f187d7fa640 1 -- 172.21.15.119:0/1109351205 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1990072020 con 0x560cb0c0a560 2024-04-23T18:29:53.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.422+0000 7f187d7fa640 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1868036e60 0x7f1868039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.422+0000 7f187d7fa640 1 -- 172.21.15.119:0/1109351205 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f1990075d10 con 0x560cb0c0a560 2024-04-23T18:29:53.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.422+0000 7f19a3b36800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.422+0000 7f199f0cb640 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1868036e60 0x7f1868039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.422+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560cb0dce250 0x560cb0dd0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.422+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd0e60 con 0x560cb0dce250 2024-04-23T18:29:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.422+0000 7f19a00cd640 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560cb0dce250 0x560cb0dd0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.422+0000 7f199f0cb640 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1868036e60 0x7f1868039320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f199401ced0 tx=0x7f199404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.422+0000 7f19a00cd640 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560cb0dce250 0x560cb0dd0710 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 20 realm 2024-04-23T18:29:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1270 con 0x560cb0dce250 2024-04-23T18:29:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1b10 con 0x560cb0dce250 2024-04-23T18:29:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dce250 2024-04-23T18:29:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560cb0dd2c10 0x560cb0dd5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.423+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd5540 con 0x560cb0dd2c10 2024-04-23T18:29:53.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.424+0000 7f199f8cc640 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560cb0dd2c10 0x560cb0dd5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.424+0000 7f199f8cc640 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560cb0dd2c10 0x560cb0dd5000 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.424+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1990068040 con 0x560cb0dd2c10 2024-04-23T18:29:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.424+0000 7f19a3b36800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.424+0000 7f19a3b36800 20 searching for the correct realm 2024-04-23T18:29:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.424+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560cb0dd75c0 0x560cb0dd9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.424+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dda150 con 0x560cb0dd75c0 2024-04-23T18:29:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.424+0000 7f199f0cb640 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560cb0dd75c0 0x560cb0dd9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.424+0000 7f199f0cb640 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560cb0dd75c0 0x560cb0dd9a80 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.425+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.425+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dda150 con 0x560cb0dd2c10 2024-04-23T18:29:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.425+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1990068040 con 0x560cb0dd2c10 2024-04-23T18:29:53.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.425+0000 7f199f8cc640 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1990074020 0x7f199003e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.425+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dda150 con 0x7f1990074020 2024-04-23T18:29:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.425+0000 7f19a00cd640 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1990074020 0x7f199003e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.426+0000 7f19a00cd640 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1990074020 0x7f199003e450 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.426+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199800a4a0 con 0x7f1990074020 2024-04-23T18:29:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.426+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dce250 2024-04-23T18:29:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.427+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.427+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dce250 2024-04-23T18:29:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.427+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.427+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x7f1990074020 2024-04-23T18:29:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.427+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199800a4a0 con 0x7f1990074020 2024-04-23T18:29:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.427+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x7f1990074020 2024-04-23T18:29:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.427+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f199800a4a0 con 0x7f1990074020 2024-04-23T18:29:53.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.427+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd2c10 2024-04-23T18:29:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.428+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1990068040 con 0x560cb0dd2c10 2024-04-23T18:29:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.428+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd75c0 2024-04-23T18:29:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.428+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.428+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dce250 2024-04-23T18:29:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.428+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.428+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x7f1990074020 2024-04-23T18:29:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.428+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199800a4a0 con 0x7f1990074020 2024-04-23T18:29:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.428+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dce250 2024-04-23T18:29:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.429+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.429+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd2c10 2024-04-23T18:29:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.429+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1990068040 con 0x560cb0dd2c10 2024-04-23T18:29:53.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.429+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd75c0 2024-04-23T18:29:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.429+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.429+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd75c0 2024-04-23T18:29:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.429+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.429+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x7f1990074020 2024-04-23T18:29:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.430+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199800a4a0 con 0x7f1990074020 2024-04-23T18:29:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.430+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd75c0 2024-04-23T18:29:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.430+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.430+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd75c0 2024-04-23T18:29:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.430+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.430+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dce250 2024-04-23T18:29:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.430+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.430+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dce250 2024-04-23T18:29:53.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.430+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.430+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x7f1990074020 2024-04-23T18:29:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.431+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199800a4a0 con 0x7f1990074020 2024-04-23T18:29:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.431+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd75c0 2024-04-23T18:29:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.431+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.431+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd2c10 2024-04-23T18:29:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.431+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1990068040 con 0x560cb0dd2c10 2024-04-23T18:29:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.431+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dce250 2024-04-23T18:29:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.431+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199800a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.431+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd2c10 2024-04-23T18:29:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.432+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1990068040 con 0x560cb0dd2c10 2024-04-23T18:29:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.432+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd75c0 2024-04-23T18:29:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.432+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.432+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x7f1990074020 2024-04-23T18:29:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.432+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199800a4a0 con 0x7f1990074020 2024-04-23T18:29:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.432+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd2c10 2024-04-23T18:29:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.432+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.433+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd75c0 2024-04-23T18:29:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.433+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.433+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x7f1990074020 2024-04-23T18:29:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.433+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199800a4a0 con 0x7f1990074020 2024-04-23T18:29:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.433+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dce250 2024-04-23T18:29:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.433+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.433+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd1eb0 con 0x560cb0dd2c10 2024-04-23T18:29:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:53.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd5ec0 con 0x560cb0dce250 2024-04-23T18:29:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd62b0 con 0x560cb0dce250 2024-04-23T18:29:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:53.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.434+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd62b0 con 0x7f1990074020 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 20 zone default found 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 4 Realm: () 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 20 zonegroup default 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dd66d0 con 0x560cb0dd2c10 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddbfb0 con 0x560cb0dd75c0 2024-04-23T18:29:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddc350 con 0x560cb0dd75c0 2024-04-23T18:29:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 20 started sync module instance, tier type = 2024-04-23T18:29:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.435+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddb450 con 0x560cb0dd2c10 2024-04-23T18:29:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.436+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.436+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94612506917248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddb450 con 0x560cb0dd2c10 2024-04-23T18:29:53.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.436+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddcd50 con 0x560cb0dce250 2024-04-23T18:29:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.438+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94612506917248] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.438+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.438+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94612506921056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddb450 con 0x560cb0dce250 2024-04-23T18:29:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.438+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddd810 con 0x560cb0dd75c0 2024-04-23T18:29:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.439+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94612506921056] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.439+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.439+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94612506914720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddb3c0 con 0x560cb0dd75c0 2024-04-23T18:29:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.439+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dde6d0 con 0x560cb0dd2c10 2024-04-23T18:29:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.440+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94612506914720] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.440+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.440+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94612506927648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddeaf0 con 0x560cb0dd2c10 2024-04-23T18:29:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.440+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddf4b0 con 0x560cb0dce250 2024-04-23T18:29:53.446 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.441+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94612506927648] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.442+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.442+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94612506929184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddf4b0 con 0x560cb0dce250 2024-04-23T18:29:53.447 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.442+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddfe70 con 0x7f1990074020 2024-04-23T18:29:53.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.443+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.443+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94612506933696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddfde0 con 0x7f1990074020 2024-04-23T18:29:53.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.443+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0de0e20 con 0x7f1990074020 2024-04-23T18:29:53.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.443+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94612506929184] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.444+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94612506933696] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.444+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.444+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94612506931200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0de0e20 con 0x7f1990074020 2024-04-23T18:29:53.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.444+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0de16c0 con 0x7f1990074020 2024-04-23T18:29:53.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.445+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94612506931200] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.445+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.445+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94612506937600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0de0e20 con 0x7f1990074020 2024-04-23T18:29:53.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.445+0000 7f19a3b36800 20 add_watcher() i=0 2024-04-23T18:29:53.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.445+0000 7f19a3b36800 20 add_watcher() i=1 2024-04-23T18:29:53.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.445+0000 7f19a3b36800 20 add_watcher() i=2 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.445+0000 7f19a3b36800 20 add_watcher() i=3 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.445+0000 7f19a3b36800 20 add_watcher() i=4 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.445+0000 7f19a3b36800 20 add_watcher() i=5 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.445+0000 7f19a3b36800 20 add_watcher() i=6 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.446+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94612506937600] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.446+0000 7f19a3b36800 20 add_watcher() i=7 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.446+0000 7f19a3b36800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.446+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0de46f0 con 0x560cb0dce250 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.446+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.446+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94612506939920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0de1bf0 con 0x560cb0dce250 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.447+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94612506939920] v34'169 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.448+0000 7f1855fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.448+0000 7f19a3b36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:53.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.448+0000 7f19a3b36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:53.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.448+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ded030 con 0x560cb0dce250 2024-04-23T18:29:53.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.449+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.449+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ded5a0 con 0x7f1990074020 2024-04-23T18:29:53.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.450+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.450+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ded9a0 con 0x560cb0dd75c0 2024-04-23T18:29:53.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.451+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.451+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dee290 con 0x560cb0dce250 2024-04-23T18:29:53.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.452+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'170 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.452+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dee800 con 0x560cb0dd2c10 2024-04-23T18:29:53.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.453+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.453+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dee800 con 0x560cb0dd75c0 2024-04-23T18:29:53.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.454+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.454+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0def220 con 0x560cb0dce250 2024-04-23T18:29:53.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.455+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.455+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0def2b0 con 0x7f1990074020 2024-04-23T18:29:53.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.456+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.456+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0def2b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.457+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.457+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0def2b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.458+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.458+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0def8e0 con 0x560cb0dd2c10 2024-04-23T18:29:53.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.459+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.459+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0def860 con 0x7f1990074020 2024-04-23T18:29:53.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.460+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.460+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0def860 con 0x560cb0dd2c10 2024-04-23T18:29:53.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.461+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.461+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0def860 con 0x7f1990074020 2024-04-23T18:29:53.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.462+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.462+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0def860 con 0x560cb0dce250 2024-04-23T18:29:53.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.463+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'171 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.463+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0def860 con 0x560cb0dd75c0 2024-04-23T18:29:53.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.464+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'50 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.464+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defeb0 con 0x560cb0dd2c10 2024-04-23T18:29:53.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.465+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.465+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x560cb0dd75c0 2024-04-23T18:29:53.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.466+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.466+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x560cb0dce250 2024-04-23T18:29:53.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.467+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.467+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x560cb0dce250 2024-04-23T18:29:53.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.468+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'172 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.468+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x560cb0dd75c0 2024-04-23T18:29:53.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.469+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'51 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.469+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x560cb0dd2c10 2024-04-23T18:29:53.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.470+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.470+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x560cb0dd75c0 2024-04-23T18:29:53.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.471+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.471+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x560cb0dd75c0 2024-04-23T18:29:53.466 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.471+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.471+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x560cb0dd75c0 2024-04-23T18:29:53.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.472+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.472+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x560cb0dd75c0 2024-04-23T18:29:53.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.473+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.467 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.473+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x7f1990074020 2024-04-23T18:29:53.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.475+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.475+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x560cb0dd75c0 2024-04-23T18:29:53.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.476+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.468 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.476+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x7f1990074020 2024-04-23T18:29:53.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.477+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'39 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.469 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.477+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x560cb0dd75c0 2024-04-23T18:29:53.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.478+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'52 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.478+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x7f1990074020 2024-04-23T18:29:53.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.479+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.479+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0defe70 con 0x560cb0dd2c10 2024-04-23T18:29:53.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.480+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.480+0000 7f1854fe1640 20 reqs_thread_entry: start 2024-04-23T18:29:53.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.480+0000 7f19a3b36800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:53.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.480+0000 7f19a3b36800 20 Filter name: none 2024-04-23T18:29:53.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.480+0000 7f17ce7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:53.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.480+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dce250 2024-04-23T18:29:53.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.481+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.481+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.481+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.481+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dce250 2024-04-23T18:29:53.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.481+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.481+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.482+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.482+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x7f1990074020 2024-04-23T18:29:53.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.482+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.482+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.482+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1998040080 con 0x7f1990074020 2024-04-23T18:29:53.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.482+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.483+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.483+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd75c0 2024-04-23T18:29:53.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.483+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.483+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.483+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.483+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dce250 2024-04-23T18:29:53.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.483+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.483+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.484+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv165 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.484+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dce250 2024-04-23T18:29:53.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.484+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.484+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.484+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.484+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd2c10 2024-04-23T18:29:53.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.485+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.485+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.485+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.485+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.485+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.485+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd75c0 2024-04-23T18:29:53.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.485+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.485+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.486+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.486+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dce250 2024-04-23T18:29:53.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.486+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.486+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.486+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.486+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dce250 2024-04-23T18:29:53.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.487+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1998040080 con 0x560cb0dce250 2024-04-23T18:29:53.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.487+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.487+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.487+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x7f1990074020 2024-04-23T18:29:53.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.488+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv37 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.488+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.488+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.488+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.488+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 24 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.488+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd2c10 2024-04-23T18:29:53.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.489+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 25 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.489+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.489+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 26 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.489+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.489+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.489+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd75c0 2024-04-23T18:29:53.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.489+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.489+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.490+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.490+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.490+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 27 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.490+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd2c10 2024-04-23T18:29:53.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.490+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 28 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.490+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.490+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 29 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.490+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.491+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.491+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x7f1990074020 2024-04-23T18:29:53.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.491+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.491+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.491+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.491+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.492+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 30 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.492+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd2c10 2024-04-23T18:29:53.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.492+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 31 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.492+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.492+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 32 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.492+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.493+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.493+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x7f1990074020 2024-04-23T18:29:53.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.493+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.493+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.493+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.493+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dce250 2024-04-23T18:29:53.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.494+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x560cb0dce250 2024-04-23T18:29:53.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.494+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.494+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv167 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f199805a020 con 0x560cb0dce250 2024-04-23T18:29:53.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.494+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dce250 2024-04-23T18:29:53.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.494+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x560cb0dce250 2024-04-23T18:29:53.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.494+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.494+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.494+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd75c0 2024-04-23T18:29:53.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.495+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.495+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.495+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.495+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.495+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 33 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.495+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd2c10 2024-04-23T18:29:53.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.496+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 34 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.496+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.496+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 35 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.496+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.496+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.496+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd75c0 2024-04-23T18:29:53.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.497+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.497+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.497+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.497+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dce250 2024-04-23T18:29:53.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.497+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x560cb0dce250 2024-04-23T18:29:53.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.497+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.497+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f199805a020 con 0x560cb0dce250 2024-04-23T18:29:53.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.497+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dce250 2024-04-23T18:29:53.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.498+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x560cb0dce250 2024-04-23T18:29:53.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.498+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dce250 2024-04-23T18:29:53.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.498+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x560cb0dce250 2024-04-23T18:29:53.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.498+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dce250 2024-04-23T18:29:53.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.498+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f199805a020 con 0x560cb0dce250 2024-04-23T18:29:53.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.498+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dce250 2024-04-23T18:29:53.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.499+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x560cb0dce250 2024-04-23T18:29:53.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.499+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.499+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.499+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd75c0 2024-04-23T18:29:53.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.499+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.499+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.500+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.500+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.500+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 36 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.500+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd2c10 2024-04-23T18:29:53.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.500+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 37 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.500+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.500+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 38 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.500+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.501+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.501+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd75c0 2024-04-23T18:29:53.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.501+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.501+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.501+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.501+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.502+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.502+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd75c0 2024-04-23T18:29:53.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.502+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.502+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.502+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.502+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.503+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.503+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd75c0 2024-04-23T18:29:53.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.503+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.503+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.503+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.503+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.503+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.503+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd75c0 2024-04-23T18:29:53.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.504+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.504+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.504+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.504+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.504+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.504+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x7f1990074020 2024-04-23T18:29:53.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.505+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.505+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.505+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.505+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.505+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.505+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd75c0 2024-04-23T18:29:53.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.506+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.506+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.506+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.506+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.506+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.506+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x7f1990074020 2024-04-23T18:29:53.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.507+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.507+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.507+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.507+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.507+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.507+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd75c0 2024-04-23T18:29:53.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.508+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.508+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd75c0 2024-04-23T18:29:53.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.508+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.508+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.508+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.508+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x7f1990074020 2024-04-23T18:29:53.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.508+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.508+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x7f1990074020 2024-04-23T18:29:53.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.509+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.509+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.509+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 39 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.509+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1a4a0 con 0x560cb0dd2c10 2024-04-23T18:29:53.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.509+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 40 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.509+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560cb0e1b4b0 con 0x560cb0dd2c10 2024-04-23T18:29:53.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.509+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 41 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.510+0000 7f1855fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:53.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.510+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94612506939920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0debb70 con 0x560cb0dce250 2024-04-23T18:29:53.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.511+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94612506939920] v34'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f199805a020 con 0x560cb0dce250 2024-04-23T18:29:53.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.511+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94612506917248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0de1210 con 0x560cb0dd2c10 2024-04-23T18:29:53.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.512+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 42 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94612506917248] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.512+0000 7f19a3b36800 20 remove_watcher() i=0 2024-04-23T18:29:53.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.512+0000 7f19a3b36800 2 removed watcher, disabling cache 2024-04-23T18:29:53.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.512+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94612506921056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddb980 con 0x560cb0dce250 2024-04-23T18:29:53.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.513+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94612506921056] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199805a020 con 0x560cb0dce250 2024-04-23T18:29:53.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.513+0000 7f19a3b36800 20 remove_watcher() i=1 2024-04-23T18:29:53.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.513+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94612506914720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddc860 con 0x560cb0dd75c0 2024-04-23T18:29:53.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.514+0000 7f199f0cb640 1 -- 172.21.15.119:0/1109351205 <== osd.3 v2:172.21.15.119:6809/3910610681 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94612506914720] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1994081070 con 0x560cb0dd75c0 2024-04-23T18:29:53.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.514+0000 7f19a3b36800 20 remove_watcher() i=2 2024-04-23T18:29:53.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.514+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94612506927648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddc860 con 0x560cb0dd2c10 2024-04-23T18:29:53.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.515+0000 7f199f8cc640 1 -- 172.21.15.119:0/1109351205 <== osd.2 v2:172.21.15.119:6800/2624052101 43 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94612506927648] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199008b040 con 0x560cb0dd2c10 2024-04-23T18:29:53.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.515+0000 7f19a3b36800 20 remove_watcher() i=3 2024-04-23T18:29:53.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.515+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94612506929184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dde220 con 0x560cb0dce250 2024-04-23T18:29:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.517+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.1 v2:172.21.15.119:6808/2736386629 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94612506929184] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199805a020 con 0x560cb0dce250 2024-04-23T18:29:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.517+0000 7f19a3b36800 20 remove_watcher() i=4 2024-04-23T18:29:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.517+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94612506933696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0ddc860 con 0x7f1990074020 2024-04-23T18:29:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.518+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94612506933696] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.518+0000 7f19a3b36800 20 remove_watcher() i=5 2024-04-23T18:29:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.518+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94612506931200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dde820 con 0x7f1990074020 2024-04-23T18:29:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.519+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94612506931200] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.519+0000 7f19a3b36800 20 remove_watcher() i=6 2024-04-23T18:29:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.519+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94612506937600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560cb0dde220 con 0x7f1990074020 2024-04-23T18:29:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 <== osd.0 v2:172.21.15.62:6800/2641588406 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94612506937600] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f199805a020 con 0x7f1990074020 2024-04-23T18:29:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 20 remove_watcher() i=7 2024-04-23T18:29:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1990074020 msgr2=0x7f199003e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1990074020 0x7f199003e450 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560cb0dce250 msgr2=0x560cb0dd0710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560cb0dce250 0x560cb0dd0710 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560cb0dd2c10 msgr2=0x560cb0dd5000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560cb0dd2c10 0x560cb0dd5000 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560cb0dd75c0 msgr2=0x560cb0dd9a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560cb0dd75c0 0x560cb0dd9a80 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1868036e60 msgr2=0x7f1868039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1868036e60 0x7f1868039320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f199401ced0 tx=0x7f199404f000 comp rx=0 tx=0).stop 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 msgr2=0x560cb0dc2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a00cd640 1 -- 172.21.15.119:0/1109351205 reap_dead start 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 0x560cb0dc2b50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f199000dfd0 tx=0x7f1990037f30 comp rx=0 tx=0).stop 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 shutdown_connections 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 --2- 172.21.15.119:0/1109351205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c0a560 0x560cb0dc2b50 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 >> 172.21.15.119:0/1109351205 conn(0x560cb0db5810 msgr2=0x560cb0db2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 shutdown_connections 2024-04-23T18:29:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/1109351205 wait complete. 2024-04-23T18:29:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/3854614749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1878036e60 msgr2=0x7f1878039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 --2- 172.21.15.119:0/3854614749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1878036e60 0x7f1878039320 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x560cb0d92020 tx=0x7f1994005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/3854614749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0dac330 msgr2=0x560cb0dac750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 --2- 172.21.15.119:0/3854614749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0dac330 0x560cb0dac750 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1990016fd0 tx=0x7f199002a4a0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/3854614749 shutdown_connections 2024-04-23T18:29:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 --2- 172.21.15.119:0/3854614749 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1878036e60 0x7f1878039320 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 --2- 172.21.15.119:0/3854614749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0dac330 0x560cb0dac750 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/3854614749 >> 172.21.15.119:0/3854614749 conn(0x560cb0da03d0 msgr2=0x560cb0da07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/3854614749 shutdown_connections 2024-04-23T18:29:53.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.520+0000 7f19a3b36800 1 -- 172.21.15.119:0/3854614749 wait complete. 2024-04-23T18:29:53.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560cb0d9b300 msgr2=0x560cb0d9d770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x560cb0d9b300 0x560cb0d9d770 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560cb0c993a0 msgr2=0x560cb0d94b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560cb0c993a0 0x560cb0d94b30 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560cb0d97410 msgr2=0x560cb0d99800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560cb0d97410 0x560cb0d99800 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1888036e60 msgr2=0x7f1888039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1888036e60 0x7f1888039320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1994054000 tx=0x7f199404e000 comp rx=0 tx=0).stop 2024-04-23T18:29:53.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c94f60 msgr2=0x560cb0d8dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 --2- 172.21.15.119:0/694477172 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560cb0c94f60 0x560cb0d8dac0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1990004000 tx=0x7f1990000bc0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a00cd640 1 -- 172.21.15.119:0/694477172 reap_dead start 2024-04-23T18:29:53.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 shutdown_connections 2024-04-23T18:29:53.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 >> 172.21.15.119:0/694477172 conn(0x560cb0c90540 msgr2=0x560cb0d80290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 shutdown_connections 2024-04-23T18:29:53.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.521+0000 7f19a3b36800 1 -- 172.21.15.119:0/694477172 wait complete. 2024-04-23T18:29:53.521 INFO:teuthology.orchestra.run.smithi119.stdout:[] 2024-04-23T18:29:53.522 DEBUG:tasks.util.rgw: json result: [] 2024-04-23T18:29:53.522 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-23T18:29:53.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-23T18:29:53.522 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-23T18:29:53.604 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:53.604 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:53.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.612+0000 7fa026d33800 1 Processor -- start 2024-04-23T18:29:53.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.612+0000 7fa026d33800 1 -- start start 2024-04-23T18:29:53.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.612+0000 7fa026d33800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557eac8508b0 0x557eac850cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.613+0000 7fa026d33800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557eac702560 con 0x557eac851210 2024-04-23T18:29:53.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.613+0000 7fa026d33800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x557eac6f3e20 con 0x557eac8508b0 2024-04-23T18:29:53.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.613+0000 7fa0229f5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557eac8508b0 0x557eac850cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.613+0000 7fa01a1f4640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x557eac851210 0x557eac8516c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:43620/0 (socket says 172.21.15.119:43620) 2024-04-23T18:29:53.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.613+0000 7fa01a1f4640 1 -- 172.21.15.119:0/558937788 learned_addr learned my addr 172.21.15.119:0/558937788 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:53.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.613+0000 7fa0229f5640 1 -- 172.21.15.119:0/558937788 >> v1:172.21.15.62:6789/0 conn(0x557eac851210 legacy=0x557eac8516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.613+0000 7fa0229f5640 1 -- 172.21.15.119:0/558937788 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eac701e60 con 0x557eac8508b0 2024-04-23T18:29:53.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.615+0000 7fa0229f5640 1 --2- 172.21.15.119:0/558937788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac850cd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa01400a470 tx=0x7fa01401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf37ce9a350a699 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.615+0000 7fa0221f4640 1 -- 172.21.15.119:0/558937788 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa014057070 con 0x557eac8508b0 2024-04-23T18:29:53.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.615+0000 7fa0221f4640 1 -- 172.21.15.119:0/558937788 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa01404adc0 con 0x557eac8508b0 2024-04-23T18:29:53.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.615+0000 7fa0221f4640 1 -- 172.21.15.119:0/558937788 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa014052590 con 0x557eac8508b0 2024-04-23T18:29:53.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.616+0000 7fa026d33800 1 -- 172.21.15.119:0/558937788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 msgr2=0x557eac850cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.616+0000 7fa026d33800 1 --2- 172.21.15.119:0/558937788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac850cd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa01400a470 tx=0x7fa01401ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:53.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.616+0000 7fa026d33800 1 -- 172.21.15.119:0/558937788 shutdown_connections 2024-04-23T18:29:53.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.616+0000 7fa026d33800 1 --2- 172.21.15.119:0/558937788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac850cd0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.616+0000 7fa026d33800 1 -- 172.21.15.119:0/558937788 >> 172.21.15.119:0/558937788 conn(0x557eac84c410 msgr2=0x557eac84e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.616+0000 7fa026d33800 1 -- 172.21.15.119:0/558937788 shutdown_connections 2024-04-23T18:29:53.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.616+0000 7fa026d33800 1 -- 172.21.15.119:0/558937788 wait complete. 2024-04-23T18:29:53.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.627+0000 7fa026d33800 1 Processor -- start 2024-04-23T18:29:53.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.627+0000 7fa026d33800 1 -- start start 2024-04-23T18:29:53.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.628+0000 7fa026d33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac945460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.628+0000 7fa026d33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557eac79d5b0 con 0x557eac8508b0 2024-04-23T18:29:53.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.628+0000 7fa0229f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac945460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.628+0000 7fa0229f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac945460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36088/0 (socket says 172.21.15.119:36088) 2024-04-23T18:29:53.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.628+0000 7fa0229f5640 1 -- 172.21.15.119:0/3887470821 learned_addr learned my addr 172.21.15.119:0/3887470821 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.628+0000 7fa0229f5640 1 -- 172.21.15.119:0/3887470821 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eac713860 con 0x557eac8508b0 2024-04-23T18:29:53.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.628+0000 7fa0229f5640 1 --2- 172.21.15.119:0/3887470821 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac945460 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa014055040 tx=0x7fa01404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f8c389fdfb8bd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.628+0000 7f9f10e09640 1 -- 172.21.15.119:0/3887470821 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa014057040 con 0x557eac8508b0 2024-04-23T18:29:53.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.628+0000 7f9f10e09640 1 -- 172.21.15.119:0/3887470821 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa014062070 con 0x557eac8508b0 2024-04-23T18:29:53.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.628+0000 7f9f10e09640 1 -- 172.21.15.119:0/3887470821 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa01405d470 con 0x557eac8508b0 2024-04-23T18:29:53.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.629+0000 7fa026d33800 1 -- 172.21.15.119:0/3887470821 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 msgr2=0x557eac945460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.629+0000 7fa026d33800 1 --2- 172.21.15.119:0/3887470821 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac945460 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa014055040 tx=0x7fa01404c000 comp rx=0 tx=0).stop 2024-04-23T18:29:53.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.629+0000 7fa026d33800 1 -- 172.21.15.119:0/3887470821 shutdown_connections 2024-04-23T18:29:53.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.629+0000 7fa026d33800 1 --2- 172.21.15.119:0/3887470821 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac945460 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.629+0000 7fa026d33800 1 -- 172.21.15.119:0/3887470821 >> 172.21.15.119:0/3887470821 conn(0x557eac84c410 msgr2=0x557eac940d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.629+0000 7fa026d33800 1 -- 172.21.15.119:0/3887470821 shutdown_connections 2024-04-23T18:29:53.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.629+0000 7fa026d33800 1 -- 172.21.15.119:0/3887470821 wait complete. 2024-04-23T18:29:53.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.629+0000 7fa026d33800 1 Processor -- start 2024-04-23T18:29:53.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.630+0000 7fa026d33800 1 -- start start 2024-04-23T18:29:53.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.630+0000 7fa026d33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac94cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.630+0000 7fa026d33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557eac852010 con 0x557eac8508b0 2024-04-23T18:29:53.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.630+0000 7fa0229f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac94cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.630+0000 7fa0229f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac94cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36100/0 (socket says 172.21.15.119:36100) 2024-04-23T18:29:53.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.630+0000 7fa0229f5640 1 -- 172.21.15.119:0/436098218 learned_addr learned my addr 172.21.15.119:0/436098218 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.630+0000 7fa0229f5640 1 -- 172.21.15.119:0/436098218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eac711eb0 con 0x557eac8508b0 2024-04-23T18:29:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.630+0000 7fa0229f5640 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac94cc80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa01405f040 tx=0x7fa014002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.631+0000 7f9f0f606640 1 -- 172.21.15.119:0/436098218 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa01406b070 con 0x557eac8508b0 2024-04-23T18:29:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.631+0000 7f9f0f606640 1 -- 172.21.15.119:0/436098218 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa01405d960 con 0x557eac8508b0 2024-04-23T18:29:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.631+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eac94d1c0 con 0x557eac8508b0 2024-04-23T18:29:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.631+0000 7f9f0f606640 1 -- 172.21.15.119:0/436098218 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa014057070 con 0x557eac8508b0 2024-04-23T18:29:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.631+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eac94d6e0 con 0x557eac8508b0 2024-04-23T18:29:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.631+0000 7f9f0f606640 1 -- 172.21.15.119:0/436098218 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa01405dc80 con 0x557eac8508b0 2024-04-23T18:29:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.632+0000 7f9f0f606640 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f08036e60 0x7f9f08039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.632+0000 7f9f0f606640 1 -- 172.21.15.119:0/436098218 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fa01408e9e0 con 0x557eac8508b0 2024-04-23T18:29:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.632+0000 7fa01a1f4640 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f08036e60 0x7f9f08039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.632+0000 7fa026d33800 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557eac851210 0x557eac953cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.632+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac954230 con 0x557eac851210 2024-04-23T18:29:53.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.632+0000 7fa0231f6640 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557eac851210 0x557eac953cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.632+0000 7fa01a1f4640 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f08036e60 0x7f9f08039320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa00c000f60 tx=0x7fa00c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.632+0000 7fa0231f6640 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557eac851210 0x557eac953cf0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.632+0000 7fa0231f6640 1 -- 172.21.15.119:0/436098218 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac851210 2024-04-23T18:29:53.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.632+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac9512c0 con 0x557eac851210 2024-04-23T18:29:53.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.633+0000 7fa0231f6640 1 -- 172.21.15.119:0/436098218 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac851210 2024-04-23T18:29:53.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.633+0000 7fa026d33800 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557eac956550 0x557eac958940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.633+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac959010 con 0x557eac956550 2024-04-23T18:29:53.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.633+0000 7fa0229f5640 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557eac956550 0x557eac958940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.633+0000 7fa0229f5640 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557eac956550 0x557eac958940 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.633+0000 7fa0229f5640 1 -- 172.21.15.119:0/436098218 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa01405a040 con 0x557eac956550 2024-04-23T18:29:53.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.633+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac955500 con 0x557eac851210 2024-04-23T18:29:53.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.634+0000 7fa0231f6640 1 -- 172.21.15.119:0/436098218 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac851210 2024-04-23T18:29:53.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.634+0000 7fa026d33800 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x557eac95a450 0x557eac95c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.634+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac95d0a0 con 0x557eac95a450 2024-04-23T18:29:53.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.634+0000 7fa01a1f4640 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x557eac95a450 0x557eac95c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.643 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.634+0000 7fa01a1f4640 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x557eac95a450 0x557eac95c910 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.635+0000 7fa01a1f4640 1 -- 172.21.15.119:0/436098218 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa00c009050 con 0x557eac95a450 2024-04-23T18:29:53.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.635+0000 7fa026d33800 1 Processor -- start 2024-04-23T18:29:53.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.635+0000 7fa026d33800 1 -- start start 2024-04-23T18:29:53.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.635+0000 7fa026d33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac96b550 0x557eac96b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.635+0000 7fa026d33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557eac743df0 con 0x557eac96b550 2024-04-23T18:29:53.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.635+0000 7fa0229f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac96b550 0x557eac96b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.635+0000 7fa0229f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac96b550 0x557eac96b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36112/0 (socket says 172.21.15.119:36112) 2024-04-23T18:29:53.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.635+0000 7fa0229f5640 1 -- 172.21.15.119:0/2071283665 learned_addr learned my addr 172.21.15.119:0/2071283665 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.636+0000 7fa0229f5640 1 -- 172.21.15.119:0/2071283665 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eac96beb0 con 0x557eac96b550 2024-04-23T18:29:53.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.636+0000 7fa0229f5640 1 --2- 172.21.15.119:0/2071283665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac96b550 0x557eac96b970 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa014066b40 tx=0x7fa0140785d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.636+0000 7f9f0ce01640 1 -- 172.21.15.119:0/2071283665 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa01408ce60 con 0x557eac96b550 2024-04-23T18:29:53.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.636+0000 7f9f0ce01640 1 -- 172.21.15.119:0/2071283665 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa014066ce0 con 0x557eac96b550 2024-04-23T18:29:53.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.636+0000 7f9f0ce01640 1 -- 172.21.15.119:0/2071283665 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa014087b60 con 0x557eac96b550 2024-04-23T18:29:53.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.636+0000 7fa026d33800 1 -- 172.21.15.119:0/2071283665 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eac96c920 con 0x557eac96b550 2024-04-23T18:29:53.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.636+0000 7fa026d33800 1 -- 172.21.15.119:0/2071283665 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eac96ce20 con 0x557eac96b550 2024-04-23T18:29:53.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.637+0000 7f9f0ce01640 1 -- 172.21.15.119:0/2071283665 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa014078730 con 0x557eac96b550 2024-04-23T18:29:53.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.637+0000 7f9f0ce01640 1 --2- 172.21.15.119:0/2071283665 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9efc036e60 0x7f9efc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.637+0000 7f9f0ce01640 1 -- 172.21.15.119:0/2071283665 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fa014082d20 con 0x557eac96b550 2024-04-23T18:29:53.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.637+0000 7fa01a1f4640 1 --2- 172.21.15.119:0/2071283665 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9efc036e60 0x7f9efc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.637+0000 7fa026d33800 1 Processor -- start 2024-04-23T18:29:53.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.637+0000 7fa026d33800 1 -- start start 2024-04-23T18:29:53.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.637+0000 7fa01a1f4640 1 --2- 172.21.15.119:0/2071283665 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9efc036e60 0x7f9efc039320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00bf50 tx=0x7fa00c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.637+0000 7fa026d33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac978640 0x557eac978a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.637+0000 7fa026d33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557eac945b20 con 0x557eac978640 2024-04-23T18:29:53.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.638+0000 7fa0229f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac978640 0x557eac978a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.638+0000 7fa0229f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac978640 0x557eac978a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36122/0 (socket says 172.21.15.119:36122) 2024-04-23T18:29:53.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.638+0000 7fa0229f5640 1 -- 172.21.15.119:0/1681089506 learned_addr learned my addr 172.21.15.119:0/1681089506 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.638+0000 7fa0229f5640 1 -- 172.21.15.119:0/1681089506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eac979030 con 0x557eac978640 2024-04-23T18:29:53.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.638+0000 7fa0229f5640 1 --2- 172.21.15.119:0/1681089506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac978640 0x557eac978a60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa014009c20 tx=0x7fa014072490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f07e51c62872767 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.638+0000 7f9f067fc640 1 -- 172.21.15.119:0/1681089506 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0140725d0 con 0x557eac978640 2024-04-23T18:29:53.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.638+0000 7f9f067fc640 1 -- 172.21.15.119:0/1681089506 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa01409d030 con 0x557eac978640 2024-04-23T18:29:53.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.638+0000 7f9f067fc640 1 -- 172.21.15.119:0/1681089506 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0140830d0 con 0x557eac978640 2024-04-23T18:29:53.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa026d33800 1 -- 172.21.15.119:0/1681089506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac978640 msgr2=0x557eac978a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa026d33800 1 --2- 172.21.15.119:0/1681089506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac978640 0x557eac978a60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa014009c20 tx=0x7fa014072490 comp rx=0 tx=0).stop 2024-04-23T18:29:53.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa026d33800 1 -- 172.21.15.119:0/1681089506 shutdown_connections 2024-04-23T18:29:53.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa026d33800 1 --2- 172.21.15.119:0/1681089506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac978640 0x557eac978a60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa026d33800 1 -- 172.21.15.119:0/1681089506 >> 172.21.15.119:0/1681089506 conn(0x557eac9749a0 msgr2=0x557eac972a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa026d33800 1 -- 172.21.15.119:0/1681089506 shutdown_connections 2024-04-23T18:29:53.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa026d33800 1 -- 172.21.15.119:0/1681089506 wait complete. 2024-04-23T18:29:53.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa026d33800 1 Processor -- start 2024-04-23T18:29:53.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa026d33800 1 -- start start 2024-04-23T18:29:53.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa026d33800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac978640 0x557eac97fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa026d33800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557eac9796e0 con 0x557eac978640 2024-04-23T18:29:53.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa0229f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac978640 0x557eac97fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa0229f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac978640 0x557eac97fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36136/0 (socket says 172.21.15.119:36136) 2024-04-23T18:29:53.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.639+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 learned_addr learned my addr 172.21.15.119:0/2762066227 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.640+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eac97ff80 con 0x557eac978640 2024-04-23T18:29:53.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.640+0000 7fa0229f5640 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac978640 0x557eac97fa40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa014064040 tx=0x7fa01408e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.640+0000 7f9f04ff9640 1 -- 172.21.15.119:0/2762066227 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0140b2070 con 0x557eac978640 2024-04-23T18:29:53.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.640+0000 7f9f04ff9640 1 -- 172.21.15.119:0/2762066227 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa01408e490 con 0x557eac978640 2024-04-23T18:29:53.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.640+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eac97ff80 con 0x557eac978640 2024-04-23T18:29:53.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.640+0000 7f9f04ff9640 1 -- 172.21.15.119:0/2762066227 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa01408e0c0 con 0x557eac978640 2024-04-23T18:29:53.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.640+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eac97ff80 con 0x557eac978640 2024-04-23T18:29:53.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.641+0000 7f9f04ff9640 1 -- 172.21.15.119:0/2762066227 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa0140b5070 con 0x557eac978640 2024-04-23T18:29:53.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.641+0000 7f9f04ff9640 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9eec036e60 0x7f9eec039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.641+0000 7f9f04ff9640 1 -- 172.21.15.119:0/2762066227 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fa0140aa070 con 0x557eac978640 2024-04-23T18:29:53.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.641+0000 7fa01a1f4640 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9eec036e60 0x7f9eec039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.641+0000 7fa026d33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.641+0000 7fa026d33800 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557eac98b200 0x557eac98d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.641+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac98de10 con 0x557eac98b200 2024-04-23T18:29:53.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.641+0000 7fa01a1f4640 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9eec036e60 0x7f9eec039320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa00c001b60 tx=0x7fa00c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.641+0000 7fa0231f6640 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557eac98b200 0x557eac98d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa0231f6640 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557eac98b200 0x557eac98d6c0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac98b200 2024-04-23T18:29:53.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa026d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa026d33800 20 realm 2024-04-23T18:29:53.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa026d33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac98e220 con 0x557eac98b200 2024-04-23T18:29:53.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac98b200 2024-04-23T18:29:53.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa026d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa026d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:53.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa026d33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac98eaf0 con 0x557eac98b200 2024-04-23T18:29:53.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac98b200 2024-04-23T18:29:53.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa026d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa026d33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.642+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98b200 2024-04-23T18:29:53.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.643+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac98b200 2024-04-23T18:29:53.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.643+0000 7fa026d33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:53.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.643+0000 7fa026d33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.643+0000 7fa026d33800 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557eac98fbf0 0x557eac991fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.643+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac9925a0 con 0x557eac98fbf0 2024-04-23T18:29:53.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.643+0000 7fa0229f5640 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557eac98fbf0 0x557eac991fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.643+0000 7fa0229f5640 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557eac98fbf0 0x557eac991fe0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.643+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa0140b4030 con 0x557eac98fbf0 2024-04-23T18:29:53.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.643+0000 7fa026d33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:53.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.643+0000 7fa026d33800 20 searching for the correct realm 2024-04-23T18:29:53.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.643+0000 7fa026d33800 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x557eac994550 0x557eac996a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.643+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac9970e0 con 0x557eac994550 2024-04-23T18:29:53.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.643+0000 7fa01a1f4640 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x557eac994550 0x557eac996a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.644+0000 7fa01a1f4640 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x557eac994550 0x557eac996a10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.644+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.644+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac9970e0 con 0x557eac98fbf0 2024-04-23T18:29:53.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.644+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0140b4030 con 0x557eac98fbf0 2024-04-23T18:29:53.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.644+0000 7fa0229f5640 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa0140b7060 0x7fa01408aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.644+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac9970e0 con 0x7fa0140b7060 2024-04-23T18:29:53.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.645+0000 7fa0231f6640 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa0140b7060 0x7fa01408aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.645+0000 7fa0231f6640 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa0140b7060 0x7fa01408aa00 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.645+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01c00a4a0 con 0x7fa0140b7060 2024-04-23T18:29:53.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.645+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98b200 2024-04-23T18:29:53.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.646+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac98b200 2024-04-23T18:29:53.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.646+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98b200 2024-04-23T18:29:53.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.646+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac98b200 2024-04-23T18:29:53.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.646+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x7fa0140b7060 2024-04-23T18:29:53.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.646+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01c00a4a0 con 0x7fa0140b7060 2024-04-23T18:29:53.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.646+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x7fa0140b7060 2024-04-23T18:29:53.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.646+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa01c00a4a0 con 0x7fa0140b7060 2024-04-23T18:29:53.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.646+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98fbf0 2024-04-23T18:29:53.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.646+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0140b4030 con 0x557eac98fbf0 2024-04-23T18:29:53.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.646+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac994550 2024-04-23T18:29:53.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.647+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.647+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98b200 2024-04-23T18:29:53.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.647+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac98b200 2024-04-23T18:29:53.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.647+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x7fa0140b7060 2024-04-23T18:29:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.647+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01c00a4a0 con 0x7fa0140b7060 2024-04-23T18:29:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.647+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98b200 2024-04-23T18:29:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.647+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac98b200 2024-04-23T18:29:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.647+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98fbf0 2024-04-23T18:29:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.648+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa0140b4030 con 0x557eac98fbf0 2024-04-23T18:29:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.648+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac994550 2024-04-23T18:29:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.648+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.648+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac994550 2024-04-23T18:29:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.648+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.648+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x7fa0140b7060 2024-04-23T18:29:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.648+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01c00a4a0 con 0x7fa0140b7060 2024-04-23T18:29:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.648+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac994550 2024-04-23T18:29:53.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.649+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.649+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac994550 2024-04-23T18:29:53.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.649+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.649+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98b200 2024-04-23T18:29:53.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.649+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac98b200 2024-04-23T18:29:53.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.649+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98b200 2024-04-23T18:29:53.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.649+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac98b200 2024-04-23T18:29:53.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.649+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x7fa0140b7060 2024-04-23T18:29:53.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.650+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01c00a4a0 con 0x7fa0140b7060 2024-04-23T18:29:53.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.650+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac994550 2024-04-23T18:29:53.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.650+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.650+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98fbf0 2024-04-23T18:29:53.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.650+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa0140b4030 con 0x557eac98fbf0 2024-04-23T18:29:53.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.650+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98b200 2024-04-23T18:29:53.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.651+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01c00a4a0 con 0x557eac98b200 2024-04-23T18:29:53.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.651+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98fbf0 2024-04-23T18:29:53.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.651+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0140b4030 con 0x557eac98fbf0 2024-04-23T18:29:53.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.651+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac994550 2024-04-23T18:29:53.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.651+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.651+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x7fa0140b7060 2024-04-23T18:29:53.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.651+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01c00a4a0 con 0x7fa0140b7060 2024-04-23T18:29:53.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.651+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98fbf0 2024-04-23T18:29:53.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.652+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.652+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac994550 2024-04-23T18:29:53.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.652+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.652+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x7fa0140b7060 2024-04-23T18:29:53.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.652+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa01c00a4a0 con 0x7fa0140b7060 2024-04-23T18:29:53.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.652+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98b200 2024-04-23T18:29:53.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.652+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.652+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eac98ee90 con 0x557eac98fbf0 2024-04-23T18:29:53.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:53.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:53.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:53.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:53.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:53.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:53.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac992e60 con 0x557eac98b200 2024-04-23T18:29:53.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac993250 con 0x557eac98b200 2024-04-23T18:29:53.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:53.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.653+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac993250 con 0x7fa0140b7060 2024-04-23T18:29:53.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:53.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 20 zone default found 2024-04-23T18:29:53.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 4 Realm: () 2024-04-23T18:29:53.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:53.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:53.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:53.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 20 zonegroup default 2024-04-23T18:29:53.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac997560 con 0x557eac98fbf0 2024-04-23T18:29:53.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac9992e0 con 0x557eac994550 2024-04-23T18:29:53.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.654+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac999680 con 0x557eac994550 2024-04-23T18:29:53.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.655+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.655+0000 7fa026d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.655+0000 7fa026d33800 20 started sync module instance, tier type = 2024-04-23T18:29:53.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.655+0000 7fa026d33800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:53.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.655+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac998780 con 0x557eac98fbf0 2024-04-23T18:29:53.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.655+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.655+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94002549984384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac998780 con 0x557eac98fbf0 2024-04-23T18:29:53.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.656+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99a040 con 0x557eac98b200 2024-04-23T18:29:53.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.656+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94002549984384] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.657+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.657+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94002549988752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac998780 con 0x557eac98b200 2024-04-23T18:29:53.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.657+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99aae0 con 0x557eac994550 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.658+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.658+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94002549990864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99b380 con 0x557eac994550 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.658+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99be80 con 0x557eac98fbf0 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.658+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94002549988752] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.660+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.660+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94002549995888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99c2a0 con 0x557eac98fbf0 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.660+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94002549990864] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.660+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99cca0 con 0x557eac98b200 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.661+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94002549995888] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.661+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.661+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94002549981904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99c2a0 con 0x557eac98b200 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.661+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99d540 con 0x7fa0140b7060 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.662+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.662+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94002550001680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99d8e0 con 0x7fa0140b7060 2024-04-23T18:29:53.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.662+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99e130 con 0x7fa0140b7060 2024-04-23T18:29:53.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.662+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94002549981904] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.663+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94002550001680] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.664+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.664+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94002550002736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99dd00 con 0x7fa0140b7060 2024-04-23T18:29:53.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.664+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99e550 con 0x7fa0140b7060 2024-04-23T18:29:53.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.665+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(58 notify.7 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.665+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94002550002736] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.665+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94002550005472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99e950 con 0x7fa0140b7060 2024-04-23T18:29:53.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.665+0000 7fa026d33800 20 add_watcher() i=0 2024-04-23T18:29:53.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.665+0000 7fa026d33800 20 add_watcher() i=1 2024-04-23T18:29:53.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.665+0000 7fa026d33800 20 add_watcher() i=2 2024-04-23T18:29:53.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.665+0000 7fa026d33800 20 add_watcher() i=3 2024-04-23T18:29:53.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.665+0000 7fa026d33800 20 add_watcher() i=4 2024-04-23T18:29:53.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.665+0000 7fa026d33800 20 add_watcher() i=5 2024-04-23T18:29:53.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.665+0000 7fa026d33800 20 add_watcher() i=6 2024-04-23T18:29:53.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.666+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94002550005472] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.666+0000 7fa026d33800 20 add_watcher() i=7 2024-04-23T18:29:53.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.666+0000 7fa026d33800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:53.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.666+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac99d910 con 0x557eac98b200 2024-04-23T18:29:53.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.667+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.667+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94002550006752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac99d910 con 0x557eac98b200 2024-04-23T18:29:53.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.668+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94002550006752] v34'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.668+0000 7f9ed97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:53.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.668+0000 7fa026d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:53.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.668+0000 7fa026d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:53.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.668+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9aa560 con 0x557eac98b200 2024-04-23T18:29:53.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.669+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.669+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9aabb0 con 0x7fa0140b7060 2024-04-23T18:29:53.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.670+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.670+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ab010 con 0x557eac994550 2024-04-23T18:29:53.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.671+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.671+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9aba30 con 0x557eac98b200 2024-04-23T18:29:53.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.672+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'175 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.672+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9a6240 con 0x557eac98fbf0 2024-04-23T18:29:53.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.673+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.673+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9a6240 con 0x557eac994550 2024-04-23T18:29:53.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.674+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.674+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ac590 con 0x557eac98b200 2024-04-23T18:29:53.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.675+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.675+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9acb50 con 0x7fa0140b7060 2024-04-23T18:29:53.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.676+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.676+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9acb50 con 0x557eac98fbf0 2024-04-23T18:29:53.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.677+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.677+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9acb50 con 0x557eac994550 2024-04-23T18:29:53.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.678+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.678+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad0c0 con 0x557eac98fbf0 2024-04-23T18:29:53.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.679+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.679+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad150 con 0x7fa0140b7060 2024-04-23T18:29:53.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.680+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.680+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad150 con 0x557eac98fbf0 2024-04-23T18:29:53.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.681+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.681+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad150 con 0x7fa0140b7060 2024-04-23T18:29:53.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.682+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.682+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9acb50 con 0x557eac98b200 2024-04-23T18:29:53.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.683+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'176 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.683+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9acb50 con 0x557eac994550 2024-04-23T18:29:53.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.684+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'53 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.684+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x557eac98fbf0 2024-04-23T18:29:53.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.685+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.685+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x557eac994550 2024-04-23T18:29:53.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.686+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.686+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x557eac98b200 2024-04-23T18:29:53.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.687+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.687+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x557eac98b200 2024-04-23T18:29:53.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.688+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'177 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.688+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x557eac994550 2024-04-23T18:29:53.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.689+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'54 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.689+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x557eac98fbf0 2024-04-23T18:29:53.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.690+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.690+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x557eac994550 2024-04-23T18:29:53.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.691+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.691+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x557eac994550 2024-04-23T18:29:53.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.692+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.692+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x557eac994550 2024-04-23T18:29:53.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.693+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.693+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x557eac994550 2024-04-23T18:29:53.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.694+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.694+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x7fa0140b7060 2024-04-23T18:29:53.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.695+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.695+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x557eac994550 2024-04-23T18:29:53.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.696+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.696+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x7fa0140b7060 2024-04-23T18:29:53.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.697+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'41 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.697+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x557eac994550 2024-04-23T18:29:53.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.698+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'55 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.698+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x7fa0140b7060 2024-04-23T18:29:53.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.699+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.699+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9ad550 con 0x557eac98fbf0 2024-04-23T18:29:53.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.700+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.701+0000 7f9e53fff640 20 reqs_thread_entry: start 2024-04-23T18:29:53.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.701+0000 7fa026d33800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:53.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.701+0000 7fa026d33800 20 Filter name: none 2024-04-23T18:29:53.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.701+0000 7f9e51ffb640 20 reqs_thread_entry: start 2024-04-23T18:29:53.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.701+0000 7fa026d33800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:53.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.701+0000 7fa026d33800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.701+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac9d8420 con 0x557eac98b200 2024-04-23T18:29:53.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.701+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.701+0000 7fa026d33800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:53.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.701+0000 7fa026d33800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:53.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.701+0000 7fa026d33800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:53.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.701+0000 7fa026d33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:53.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.702+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eac9d7f30 con 0x557eac98fbf0 2024-04-23T18:29:53.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.702+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.695 INFO:teuthology.orchestra.run.smithi119.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-23T18:29:53.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.703+0000 7f9ed97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:53.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.703+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94002550006752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9a93d0 con 0x557eac98b200 2024-04-23T18:29:53.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.704+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94002550006752] v34'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.704+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94002549984384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9a5590 con 0x557eac98fbf0 2024-04-23T18:29:53.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.705+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94002549984384] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.705+0000 7fa026d33800 20 remove_watcher() i=0 2024-04-23T18:29:53.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.705+0000 7fa026d33800 2 removed watcher, disabling cache 2024-04-23T18:29:53.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.705+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94002549988752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9a5590 con 0x557eac98b200 2024-04-23T18:29:53.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.706+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94002549988752] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.706+0000 7fa026d33800 20 remove_watcher() i=1 2024-04-23T18:29:53.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.706+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94002549990864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9a5590 con 0x557eac994550 2024-04-23T18:29:53.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.707+0000 7fa01a1f4640 1 -- 172.21.15.119:0/2762066227 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94002549990864] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c009050 con 0x557eac994550 2024-04-23T18:29:53.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.707+0000 7fa026d33800 20 remove_watcher() i=2 2024-04-23T18:29:53.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.707+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94002549995888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9a5590 con 0x557eac98fbf0 2024-04-23T18:29:53.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.708+0000 7fa0229f5640 1 -- 172.21.15.119:0/2762066227 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94002549995888] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0140cd040 con 0x557eac98fbf0 2024-04-23T18:29:53.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.708+0000 7fa026d33800 20 remove_watcher() i=3 2024-04-23T18:29:53.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.708+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94002549981904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9a5590 con 0x557eac98b200 2024-04-23T18:29:53.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.709+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94002549981904] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x557eac98b200 2024-04-23T18:29:53.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.709+0000 7fa026d33800 20 remove_watcher() i=4 2024-04-23T18:29:53.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.709+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94002550001680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9a5590 con 0x7fa0140b7060 2024-04-23T18:29:53.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.710+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94002550001680] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.710+0000 7fa026d33800 20 remove_watcher() i=5 2024-04-23T18:29:53.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.710+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94002550002736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9a5590 con 0x7fa0140b7060 2024-04-23T18:29:53.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.711+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94002550002736] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.711+0000 7fa026d33800 20 remove_watcher() i=6 2024-04-23T18:29:53.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.711+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94002550005472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eac9a5590 con 0x7fa0140b7060 2024-04-23T18:29:53.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94002550005472] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa01c040080 con 0x7fa0140b7060 2024-04-23T18:29:53.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 20 remove_watcher() i=7 2024-04-23T18:29:53.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa0140b7060 msgr2=0x7fa01408aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa0140b7060 0x7fa01408aa00 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557eac98b200 msgr2=0x557eac98d6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557eac98b200 0x557eac98d6c0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557eac98fbf0 msgr2=0x557eac991fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557eac98fbf0 0x557eac991fe0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x557eac994550 msgr2=0x557eac996a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x557eac994550 0x557eac996a10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9eec036e60 msgr2=0x7f9eec039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9eec036e60 0x7f9eec039320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa00c001b60 tx=0x7fa00c010000 comp rx=0 tx=0).stop 2024-04-23T18:29:53.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac978640 msgr2=0x557eac97fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 --2- 172.21.15.119:0/2762066227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac978640 0x557eac97fa40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa014064040 tx=0x7fa01408e870 comp rx=0 tx=0).stop 2024-04-23T18:29:53.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 reap_dead start 2024-04-23T18:29:53.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa0231f6640 1 -- 172.21.15.119:0/2762066227 reap_dead start 2024-04-23T18:29:53.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 shutdown_connections 2024-04-23T18:29:53.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 >> 172.21.15.119:0/2762066227 conn(0x557eac9749a0 msgr2=0x557eac972000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 shutdown_connections 2024-04-23T18:29:53.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.712+0000 7fa026d33800 1 -- 172.21.15.119:0/2762066227 wait complete. 2024-04-23T18:29:53.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/2071283665 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9efc036e60 msgr2=0x7f9efc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 --2- 172.21.15.119:0/2071283665 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9efc036e60 0x7f9efc039320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00bf50 tx=0x7fa00c00f000 comp rx=0 tx=0).stop 2024-04-23T18:29:53.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/2071283665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac96b550 msgr2=0x557eac96b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 --2- 172.21.15.119:0/2071283665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac96b550 0x557eac96b970 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa014066b40 tx=0x7fa0140785d0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/2071283665 shutdown_connections 2024-04-23T18:29:53.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 --2- 172.21.15.119:0/2071283665 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9efc036e60 0x7f9efc039320 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 --2- 172.21.15.119:0/2071283665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac96b550 0x557eac96b970 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/2071283665 >> 172.21.15.119:0/2071283665 conn(0x557eac95f5f0 msgr2=0x557eac95f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/2071283665 shutdown_connections 2024-04-23T18:29:53.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/2071283665 wait complete. 2024-04-23T18:29:53.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x557eac95a450 msgr2=0x557eac95c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x557eac95a450 0x557eac95c910 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557eac851210 msgr2=0x557eac953cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557eac851210 0x557eac953cf0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557eac956550 msgr2=0x557eac958940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557eac956550 0x557eac958940 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f08036e60 msgr2=0x7f9f08039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f08036e60 0x7f9f08039320 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa00c000f60 tx=0x7fa00c0012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 msgr2=0x557eac94cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 --2- 172.21.15.119:0/436098218 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557eac8508b0 0x557eac94cc80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa01405f040 tx=0x7fa014002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa0231f6640 1 -- 172.21.15.119:0/436098218 reap_dead start 2024-04-23T18:29:53.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 shutdown_connections 2024-04-23T18:29:53.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 >> 172.21.15.119:0/436098218 conn(0x557eac84c410 msgr2=0x557eac93f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 shutdown_connections 2024-04-23T18:29:53.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.713+0000 7fa026d33800 1 -- 172.21.15.119:0/436098218 wait complete. 2024-04-23T18:29:53.713 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-23T18:29:53.722 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-04-23T18:29:53.727 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:53.754 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:53.764 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:53.807 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-23T18:29:53.812 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:53.812 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-23T18:29:53.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-23T18:29:53.812 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-23T18:29:53.855 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:53.856 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:53.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.864+0000 7f9d68413800 1 Processor -- start 2024-04-23T18:29:53.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.864+0000 7f9d68413800 1 -- start start 2024-04-23T18:29:53.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.864+0000 7f9d68413800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bd37a4f5b0 0x55bd37a519a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.864+0000 7f9d68413800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bd378fb560 con 0x55bd37a4baa0 2024-04-23T18:29:53.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.864+0000 7f9d68413800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55bd378ece20 con 0x55bd37a4f5b0 2024-04-23T18:29:53.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.864+0000 7f9d63220640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bd37a4f5b0 0x55bd37a519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.857 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.864+0000 7f9d63a21640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55bd37a4baa0 0x55bd37a4de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:43624/0 (socket says 172.21.15.119:43624) 2024-04-23T18:29:53.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.864+0000 7f9d63220640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bd37a4f5b0 0x55bd37a519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36150/0 (socket says 172.21.15.119:36150) 2024-04-23T18:29:53.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.864+0000 7f9d63a21640 1 -- 172.21.15.119:0/963526167 learned_addr learned my addr 172.21.15.119:0/963526167 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:53.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.864+0000 7f9d63220640 1 -- 172.21.15.119:0/963526167 >> v1:172.21.15.62:6789/0 conn(0x55bd37a4baa0 legacy=0x55bd37a4de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.858 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.864+0000 7f9d63220640 1 -- 172.21.15.119:0/963526167 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd378fae60 con 0x55bd37a4f5b0 2024-04-23T18:29:53.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.866+0000 7f9d63220640 1 --2- 172.21.15.119:0/963526167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4f5b0 0x55bd37a519a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800a470 tx=0x7f9d5801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f2d7e1a8ad810b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.866+0000 7f9d62a1f640 1 -- 172.21.15.119:0/963526167 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d58057070 con 0x55bd37a4f5b0 2024-04-23T18:29:53.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.866+0000 7f9d62a1f640 1 -- 172.21.15.119:0/963526167 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d58052570 con 0x55bd37a4f5b0 2024-04-23T18:29:53.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.866+0000 7f9d62a1f640 1 -- 172.21.15.119:0/963526167 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d58052870 con 0x55bd37a4f5b0 2024-04-23T18:29:53.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.867+0000 7f9d68413800 1 -- 172.21.15.119:0/963526167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4f5b0 msgr2=0x55bd37a519a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.867+0000 7f9d68413800 1 --2- 172.21.15.119:0/963526167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4f5b0 0x55bd37a519a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800a470 tx=0x7f9d5801ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:53.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.867+0000 7f9d68413800 1 -- 172.21.15.119:0/963526167 shutdown_connections 2024-04-23T18:29:53.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.867+0000 7f9d68413800 1 --2- 172.21.15.119:0/963526167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4f5b0 0x55bd37a519a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.867+0000 7f9d68413800 1 -- 172.21.15.119:0/963526167 >> 172.21.15.119:0/963526167 conn(0x55bd37a45430 msgr2=0x55bd37a47850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.867+0000 7f9d68413800 1 -- 172.21.15.119:0/963526167 shutdown_connections 2024-04-23T18:29:53.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.867+0000 7f9d68413800 1 -- 172.21.15.119:0/963526167 wait complete. 2024-04-23T18:29:53.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.878+0000 7f9d68413800 1 Processor -- start 2024-04-23T18:29:53.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.878+0000 7f9d68413800 1 -- start start 2024-04-23T18:29:53.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.879+0000 7f9d68413800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4baa0 0x55bd37b3c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.879+0000 7f9d68413800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bd379965d0 con 0x55bd37a4baa0 2024-04-23T18:29:53.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.879+0000 7f9d63a21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4baa0 0x55bd37b3c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.879+0000 7f9d63a21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4baa0 0x55bd37b3c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36156/0 (socket says 172.21.15.119:36156) 2024-04-23T18:29:53.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.879+0000 7f9d63a21640 1 -- 172.21.15.119:0/2895172502 learned_addr learned my addr 172.21.15.119:0/2895172502 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.879+0000 7f9d63a21640 1 -- 172.21.15.119:0/2895172502 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd3790c860 con 0x55bd37a4baa0 2024-04-23T18:29:53.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.879+0000 7f9d63a21640 1 --2- 172.21.15.119:0/2895172502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4baa0 0x55bd37b3c220 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9d54001de0 tx=0x7f9d5400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3eea1bd9fc285a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.880+0000 7f9c51e0b640 1 -- 172.21.15.119:0/2895172502 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d54012020 con 0x55bd37a4baa0 2024-04-23T18:29:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.880+0000 7f9c51e0b640 1 -- 172.21.15.119:0/2895172502 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5400e5a0 con 0x55bd37a4baa0 2024-04-23T18:29:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.880+0000 7f9c51e0b640 1 -- 172.21.15.119:0/2895172502 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5400e8c0 con 0x55bd37a4baa0 2024-04-23T18:29:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.880+0000 7f9d68413800 1 -- 172.21.15.119:0/2895172502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4baa0 msgr2=0x55bd37b3c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.880+0000 7f9d68413800 1 --2- 172.21.15.119:0/2895172502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4baa0 0x55bd37b3c220 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9d54001de0 tx=0x7f9d5400b6c0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.880+0000 7f9d68413800 1 -- 172.21.15.119:0/2895172502 shutdown_connections 2024-04-23T18:29:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.880+0000 7f9d68413800 1 --2- 172.21.15.119:0/2895172502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4baa0 0x55bd37b3c220 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.880+0000 7f9d68413800 1 -- 172.21.15.119:0/2895172502 >> 172.21.15.119:0/2895172502 conn(0x55bd37a45430 msgr2=0x55bd37b37b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.880+0000 7f9d68413800 1 -- 172.21.15.119:0/2895172502 shutdown_connections 2024-04-23T18:29:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.881+0000 7f9d68413800 1 -- 172.21.15.119:0/2895172502 wait complete. 2024-04-23T18:29:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.881+0000 7f9d68413800 1 Processor -- start 2024-04-23T18:29:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.881+0000 7f9d68413800 1 -- start start 2024-04-23T18:29:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.881+0000 7f9d68413800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4baa0 0x55bd37b43b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.881+0000 7f9d68413800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bd37a541f0 con 0x55bd37a4baa0 2024-04-23T18:29:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.881+0000 7f9d63a21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4baa0 0x55bd37b43b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.881+0000 7f9d63a21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4baa0 0x55bd37b43b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36166/0 (socket says 172.21.15.119:36166) 2024-04-23T18:29:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.881+0000 7f9d63a21640 1 -- 172.21.15.119:0/2349830999 learned_addr learned my addr 172.21.15.119:0/2349830999 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.881+0000 7f9d63a21640 1 -- 172.21.15.119:0/2349830999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd3790aeb0 con 0x55bd37a4baa0 2024-04-23T18:29:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.882+0000 7f9d63a21640 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4baa0 0x55bd37b43b80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9d54001de0 tx=0x7f9d54000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.882+0000 7f9c4bfff640 1 -- 172.21.15.119:0/2349830999 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d54012030 con 0x55bd37a4baa0 2024-04-23T18:29:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.882+0000 7f9c4bfff640 1 -- 172.21.15.119:0/2349830999 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5401a7a0 con 0x55bd37a4baa0 2024-04-23T18:29:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.882+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd37b440c0 con 0x55bd37a4baa0 2024-04-23T18:29:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.882+0000 7f9c4bfff640 1 -- 172.21.15.119:0/2349830999 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5401aac0 con 0x55bd37a4baa0 2024-04-23T18:29:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.882+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd37b445e0 con 0x55bd37a4baa0 2024-04-23T18:29:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.883+0000 7f9c4bfff640 1 -- 172.21.15.119:0/2349830999 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9d54015020 con 0x55bd37a4baa0 2024-04-23T18:29:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.883+0000 7f9c4bfff640 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c4c036e60 0x7f9c4c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.883+0000 7f9c4bfff640 1 -- 172.21.15.119:0/2349830999 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f9d54020070 con 0x55bd37a4baa0 2024-04-23T18:29:53.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.883+0000 7f9d63220640 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c4c036e60 0x7f9c4c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.883+0000 7f9d68413800 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bd37a4f5b0 0x55bd37b4abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.883+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b4b130 con 0x55bd37a4f5b0 2024-04-23T18:29:53.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.883+0000 7f9d64222640 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bd37a4f5b0 0x55bd37b4abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.883+0000 7f9d63220640 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c4c036e60 0x7f9c4c039320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9d58054000 tx=0x7f9d5804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.883+0000 7f9d64222640 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bd37a4f5b0 0x55bd37b4abf0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.884+0000 7f9d64222640 1 -- 172.21.15.119:0/2349830999 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37a4f5b0 2024-04-23T18:29:53.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.884+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b481c0 con 0x55bd37a4f5b0 2024-04-23T18:29:53.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.884+0000 7f9d64222640 1 -- 172.21.15.119:0/2349830999 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37a4f5b0 2024-04-23T18:29:53.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.884+0000 7f9d68413800 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bd37b4d420 0x55bd37b4f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.884+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b4feb0 con 0x55bd37b4d420 2024-04-23T18:29:53.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.884+0000 7f9d63a21640 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bd37b4d420 0x55bd37b4f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.884+0000 7f9d63a21640 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bd37b4d420 0x55bd37b4f810 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.885+0000 7f9d63a21640 1 -- 172.21.15.119:0/2349830999 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9d5402dcf0 con 0x55bd37b4d420 2024-04-23T18:29:53.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.885+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b4c3d0 con 0x55bd37a4f5b0 2024-04-23T18:29:53.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.885+0000 7f9d64222640 1 -- 172.21.15.119:0/2349830999 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37a4f5b0 2024-04-23T18:29:53.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.885+0000 7f9d68413800 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bd37b51360 0x55bd37b537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.885+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b53f10 con 0x55bd37b51360 2024-04-23T18:29:53.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.885+0000 7f9d63220640 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bd37b51360 0x55bd37b537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.885+0000 7f9d63220640 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bd37b51360 0x55bd37b537b0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.886+0000 7f9d63220640 1 -- 172.21.15.119:0/2349830999 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9d58052940 con 0x55bd37b51360 2024-04-23T18:29:53.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.886+0000 7f9d68413800 1 Processor -- start 2024-04-23T18:29:53.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.886+0000 7f9d68413800 1 -- start start 2024-04-23T18:29:53.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.886+0000 7f9d68413800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4b620 0x55bd37a49a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.886+0000 7f9d68413800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bd3793cdf0 con 0x55bd37a4b620 2024-04-23T18:29:53.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.886+0000 7f9d63a21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4b620 0x55bd37a49a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.886+0000 7f9d63a21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4b620 0x55bd37a49a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36174/0 (socket says 172.21.15.119:36174) 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.886+0000 7f9d63a21640 1 -- 172.21.15.119:0/3895609525 learned_addr learned my addr 172.21.15.119:0/3895609525 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.887+0000 7f9d63a21640 1 -- 172.21.15.119:0/3895609525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd37a49fd0 con 0x55bd37a4b620 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.887+0000 7f9d63a21640 1 --2- 172.21.15.119:0/3895609525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4b620 0x55bd37a49a90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9d5404b5f0 tx=0x7f9d5400db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.887+0000 7f9c497fa640 1 -- 172.21.15.119:0/3895609525 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d54017430 con 0x55bd37a4b620 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.887+0000 7f9c497fa640 1 -- 172.21.15.119:0/3895609525 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d540175d0 con 0x55bd37a4b620 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.887+0000 7f9d68413800 1 -- 172.21.15.119:0/3895609525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd37a4a200 con 0x55bd37a4b620 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.887+0000 7f9c497fa640 1 -- 172.21.15.119:0/3895609525 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d54044bc0 con 0x55bd37a4b620 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.887+0000 7f9d68413800 1 -- 172.21.15.119:0/3895609525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd37a4a700 con 0x55bd37a4b620 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.888+0000 7f9c497fa640 1 -- 172.21.15.119:0/3895609525 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9d54044d60 con 0x55bd37a4b620 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.888+0000 7f9c497fa640 1 --2- 172.21.15.119:0/3895609525 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c3c036e60 0x7f9c3c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.888+0000 7f9c497fa640 1 -- 172.21.15.119:0/3895609525 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f9d5401b040 con 0x55bd37a4b620 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.888+0000 7f9d63220640 1 --2- 172.21.15.119:0/3895609525 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c3c036e60 0x7f9c3c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.888+0000 7f9d68413800 1 Processor -- start 2024-04-23T18:29:53.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.888+0000 7f9d68413800 1 -- start start 2024-04-23T18:29:53.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.888+0000 7f9d63220640 1 --2- 172.21.15.119:0/3895609525 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c3c036e60 0x7f9c3c039320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55bd37b480e0 tx=0x7f9d58005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.888+0000 7f9d68413800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 0x55bd37b71b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.888+0000 7f9d68413800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bd37b3c9a0 con 0x55bd37b716f0 2024-04-23T18:29:53.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.889+0000 7f9d63a21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 0x55bd37b71b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.889+0000 7f9d63a21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 0x55bd37b71b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36178/0 (socket says 172.21.15.119:36178) 2024-04-23T18:29:53.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.889+0000 7f9d63a21640 1 -- 172.21.15.119:0/2183667419 learned_addr learned my addr 172.21.15.119:0/2183667419 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.889+0000 7f9d63a21640 1 -- 172.21.15.119:0/2183667419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd37b720e0 con 0x55bd37b716f0 2024-04-23T18:29:53.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.889+0000 7f9d63a21640 1 --2- 172.21.15.119:0/2183667419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 0x55bd37b71b10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400df90 tx=0x7f9d54045110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4cc0411294ef72 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.889+0000 7f9c42ffd640 1 -- 172.21.15.119:0/2183667419 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d54036d30 con 0x55bd37b716f0 2024-04-23T18:29:53.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.889+0000 7f9c42ffd640 1 -- 172.21.15.119:0/2183667419 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d54009350 con 0x55bd37b716f0 2024-04-23T18:29:53.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.889+0000 7f9c42ffd640 1 -- 172.21.15.119:0/2183667419 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d540096d0 con 0x55bd37b716f0 2024-04-23T18:29:53.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d68413800 1 -- 172.21.15.119:0/2183667419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 msgr2=0x55bd37b71b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d68413800 1 --2- 172.21.15.119:0/2183667419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 0x55bd37b71b10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400df90 tx=0x7f9d54045110 comp rx=0 tx=0).stop 2024-04-23T18:29:53.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d68413800 1 -- 172.21.15.119:0/2183667419 shutdown_connections 2024-04-23T18:29:53.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d68413800 1 --2- 172.21.15.119:0/2183667419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 0x55bd37b71b10 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d68413800 1 -- 172.21.15.119:0/2183667419 >> 172.21.15.119:0/2183667419 conn(0x55bd37b6da50 msgr2=0x55bd37b6bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d68413800 1 -- 172.21.15.119:0/2183667419 shutdown_connections 2024-04-23T18:29:53.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d68413800 1 -- 172.21.15.119:0/2183667419 wait complete. 2024-04-23T18:29:53.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d68413800 1 Processor -- start 2024-04-23T18:29:53.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d68413800 1 -- start start 2024-04-23T18:29:53.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d68413800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 0x55bd37b78b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d68413800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bd37b72790 con 0x55bd37b716f0 2024-04-23T18:29:53.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d63a21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 0x55bd37b78b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d63a21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 0x55bd37b78b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36180/0 (socket says 172.21.15.119:36180) 2024-04-23T18:29:53.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.890+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 learned_addr learned my addr 172.21.15.119:0/2553531964 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.891+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd37b79070 con 0x55bd37b716f0 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.891+0000 7f9d63a21640 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 0x55bd37b78b30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400dbf0 tx=0x7f9d5400df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.891+0000 7f9c417fa640 1 -- 172.21.15.119:0/2553531964 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d54072070 con 0x55bd37b716f0 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.891+0000 7f9c417fa640 1 -- 172.21.15.119:0/2553531964 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d540098e0 con 0x55bd37b716f0 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.891+0000 7f9c417fa640 1 -- 172.21.15.119:0/2553531964 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d5403f530 con 0x55bd37b716f0 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.891+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd37b79070 con 0x55bd37b716f0 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.891+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd37b79070 con 0x55bd37b716f0 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.892+0000 7f9c417fa640 1 -- 172.21.15.119:0/2553531964 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9d54075070 con 0x55bd37b716f0 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.892+0000 7f9c417fa640 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c2c036e60 0x7f9c2c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.892+0000 7f9c417fa640 1 -- 172.21.15.119:0/2553531964 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f9d5406a050 con 0x55bd37b716f0 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.892+0000 7f9d63220640 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c2c036e60 0x7f9c2c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.892+0000 7f9d63220640 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c2c036e60 0x7f9c2c039320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d58052fd0 tx=0x7f9d5804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.892+0000 7f9d68413800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.892+0000 7f9d68413800 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bd37b84250 0x55bd37b86710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.892+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b86e60 con 0x55bd37b84250 2024-04-23T18:29:53.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d64222640 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bd37b84250 0x55bd37b86710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d64222640 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bd37b84250 0x55bd37b86710 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37b84250 2024-04-23T18:29:53.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d68413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d68413800 20 realm 2024-04-23T18:29:53.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d68413800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87270 con 0x55bd37b84250 2024-04-23T18:29:53.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37b84250 2024-04-23T18:29:53.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d68413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d68413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:53.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d68413800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87b40 con 0x55bd37b84250 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37b84250 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d68413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d68413800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.893+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b84250 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.894+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37b84250 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.894+0000 7f9d68413800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.894+0000 7f9d68413800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.894+0000 7f9d68413800 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bd37b88c40 0x55bd37b8b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.894+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b8b640 con 0x55bd37b88c40 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.894+0000 7f9d63a21640 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bd37b88c40 0x55bd37b8b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.894+0000 7f9d63a21640 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bd37b88c40 0x55bd37b8b030 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.894+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9d54074030 con 0x55bd37b88c40 2024-04-23T18:29:53.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.894+0000 7f9d68413800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:53.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.894+0000 7f9d68413800 20 searching for the correct realm 2024-04-23T18:29:53.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.894+0000 7f9d68413800 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bd37b8d5f0 0x55bd37b8fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.894+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b90180 con 0x55bd37b8d5f0 2024-04-23T18:29:53.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.895+0000 7f9d63220640 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bd37b8d5f0 0x55bd37b8fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.895+0000 7f9d63220640 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bd37b8d5f0 0x55bd37b8fab0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.895+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.895+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b90180 con 0x55bd37b88c40 2024-04-23T18:29:53.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.895+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d54074030 con 0x55bd37b88c40 2024-04-23T18:29:53.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.895+0000 7f9d63a21640 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f9d54077060 0x7f9d5401f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.895+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b90180 con 0x7f9d54077060 2024-04-23T18:29:53.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.896+0000 7f9d64222640 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f9d54077060 0x7f9d5401f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.896+0000 7f9d64222640 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f9d54077060 0x7f9d5401f930 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.896+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x7f9d54077060 2024-04-23T18:29:53.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.896+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b84250 2024-04-23T18:29:53.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.896+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37b84250 2024-04-23T18:29:53.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.897+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b84250 2024-04-23T18:29:53.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.897+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37b84250 2024-04-23T18:29:53.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.897+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x7f9d54077060 2024-04-23T18:29:53.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.897+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x7f9d54077060 2024-04-23T18:29:53.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.897+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x7f9d54077060 2024-04-23T18:29:53.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.897+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x7f9d54077060 2024-04-23T18:29:53.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.897+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b88c40 2024-04-23T18:29:53.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.897+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d54074030 con 0x55bd37b88c40 2024-04-23T18:29:53.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.897+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b8d5f0 2024-04-23T18:29:53.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.898+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.898+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b84250 2024-04-23T18:29:53.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.898+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37b84250 2024-04-23T18:29:53.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.898+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x7f9d54077060 2024-04-23T18:29:53.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.898+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x7f9d54077060 2024-04-23T18:29:53.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.898+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b84250 2024-04-23T18:29:53.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.898+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37b84250 2024-04-23T18:29:53.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.898+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b88c40 2024-04-23T18:29:53.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.899+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9d54074030 con 0x55bd37b88c40 2024-04-23T18:29:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.899+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b8d5f0 2024-04-23T18:29:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.899+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.899+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b8d5f0 2024-04-23T18:29:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.899+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.899+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x7f9d54077060 2024-04-23T18:29:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.899+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x7f9d54077060 2024-04-23T18:29:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.899+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b8d5f0 2024-04-23T18:29:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.900+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.900+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b8d5f0 2024-04-23T18:29:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.900+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.900+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b84250 2024-04-23T18:29:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.900+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37b84250 2024-04-23T18:29:53.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.900+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b84250 2024-04-23T18:29:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.900+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37b84250 2024-04-23T18:29:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.900+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x7f9d54077060 2024-04-23T18:29:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.901+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x7f9d54077060 2024-04-23T18:29:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.901+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b8d5f0 2024-04-23T18:29:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.901+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.901+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b88c40 2024-04-23T18:29:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.901+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9d54074030 con 0x55bd37b88c40 2024-04-23T18:29:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.901+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b84250 2024-04-23T18:29:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.901+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x55bd37b84250 2024-04-23T18:29:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.901+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b88c40 2024-04-23T18:29:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.902+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d54074030 con 0x55bd37b88c40 2024-04-23T18:29:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.902+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b8d5f0 2024-04-23T18:29:53.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.902+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.902+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x7f9d54077060 2024-04-23T18:29:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.902+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x7f9d54077060 2024-04-23T18:29:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.902+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b88c40 2024-04-23T18:29:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.902+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5408c040 con 0x55bd37b88c40 2024-04-23T18:29:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.902+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b8d5f0 2024-04-23T18:29:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.903+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.903+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x7f9d54077060 2024-04-23T18:29:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.903+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5c00a4a0 con 0x7f9d54077060 2024-04-23T18:29:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.903+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b84250 2024-04-23T18:29:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.903+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9d5c040080 con 0x55bd37b84250 2024-04-23T18:29:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.903+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b87ee0 con 0x55bd37b88c40 2024-04-23T18:29:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d5408c040 con 0x55bd37b88c40 2024-04-23T18:29:53.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b8bf00 con 0x55bd37b84250 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x55bd37b84250 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b8c2f0 con 0x55bd37b84250 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d5c040080 con 0x55bd37b84250 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:53.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b8c2f0 con 0x7f9d54077060 2024-04-23T18:29:53.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9d5c040080 con 0x7f9d54077060 2024-04-23T18:29:53.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:53.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 zone default found 2024-04-23T18:29:53.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 4 Realm: () 2024-04-23T18:29:53.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:53.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:53.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:53.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 zonegroup default 2024-04-23T18:29:53.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.904+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b8bab0 con 0x55bd37b88c40 2024-04-23T18:29:53.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.905+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9d5408c040 con 0x55bd37b88c40 2024-04-23T18:29:53.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.905+0000 7f9d68413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.905+0000 7f9d68413800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.905+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b91fe0 con 0x55bd37b8d5f0 2024-04-23T18:29:53.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.905+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.905+0000 7f9d68413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.905+0000 7f9d68413800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.905+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b92490 con 0x55bd37b8d5f0 2024-04-23T18:29:53.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.905+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.905+0000 7f9d68413800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:53.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.905+0000 7f9d68413800 20 started sync module instance, tier type = 2024-04-23T18:29:53.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.905+0000 7f9d68413800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:53.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.905+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b91480 con 0x55bd37b88c40 2024-04-23T18:29:53.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.906+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5408c040 con 0x55bd37b88c40 2024-04-23T18:29:53.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.906+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94271172057200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b92da0 con 0x55bd37b88c40 2024-04-23T18:29:53.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.906+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b935f0 con 0x55bd37b84250 2024-04-23T18:29:53.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.907+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94271172057200] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5408c040 con 0x55bd37b88c40 2024-04-23T18:29:53.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.908+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x55bd37b84250 2024-04-23T18:29:53.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.908+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94271172061424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b93670 con 0x55bd37b84250 2024-04-23T18:29:53.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.908+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b94190 con 0x55bd37b8d5f0 2024-04-23T18:29:53.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.909+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.909+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94271172066400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b94a30 con 0x55bd37b8d5f0 2024-04-23T18:29:53.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.909+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b95500 con 0x55bd37b88c40 2024-04-23T18:29:53.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.909+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94271172061424] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x55bd37b84250 2024-04-23T18:29:53.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.910+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94271172066400] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.910+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5408c040 con 0x55bd37b88c40 2024-04-23T18:29:53.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.910+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94271172068736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b93140 con 0x55bd37b88c40 2024-04-23T18:29:53.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.910+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b95de0 con 0x55bd37b84250 2024-04-23T18:29:53.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.911+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94271172068736] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5408c040 con 0x55bd37b88c40 2024-04-23T18:29:53.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.911+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x55bd37b84250 2024-04-23T18:29:53.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.911+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94271172071408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b95da0 con 0x55bd37b84250 2024-04-23T18:29:53.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.911+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b96820 con 0x7f9d54077060 2024-04-23T18:29:53.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.912+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x7f9d54077060 2024-04-23T18:29:53.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.912+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94271172076400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b96790 con 0x7f9d54077060 2024-04-23T18:29:53.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.912+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b97770 con 0x7f9d54077060 2024-04-23T18:29:53.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.912+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94271172071408] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x55bd37b84250 2024-04-23T18:29:53.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.913+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(56 notify.6 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x7f9d54077060 2024-04-23T18:29:53.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.913+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94271172080224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b97730 con 0x7f9d54077060 2024-04-23T18:29:53.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.913+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b97730 con 0x7f9d54077060 2024-04-23T18:29:53.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.913+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94271172076400] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x7f9d54077060 2024-04-23T18:29:53.920 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.914+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(58 notify.7 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x7f9d54077060 2024-04-23T18:29:53.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.914+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94271172078608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b98190 con 0x7f9d54077060 2024-04-23T18:29:53.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.914+0000 7f9d68413800 20 add_watcher() i=0 2024-04-23T18:29:53.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.914+0000 7f9d68413800 20 add_watcher() i=1 2024-04-23T18:29:53.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.914+0000 7f9d68413800 20 add_watcher() i=2 2024-04-23T18:29:53.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.914+0000 7f9d68413800 20 add_watcher() i=3 2024-04-23T18:29:53.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.914+0000 7f9d68413800 20 add_watcher() i=4 2024-04-23T18:29:53.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.914+0000 7f9d68413800 20 add_watcher() i=5 2024-04-23T18:29:53.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.914+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94271172080224] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x7f9d54077060 2024-04-23T18:29:53.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.914+0000 7f9d68413800 20 add_watcher() i=6 2024-04-23T18:29:53.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.915+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94271172078608] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x7f9d54077060 2024-04-23T18:29:53.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.915+0000 7f9d68413800 20 add_watcher() i=7 2024-04-23T18:29:53.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.915+0000 7f9d68413800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:53.921 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.915+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b958f0 con 0x55bd37b84250 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.915+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9d5c040080 con 0x55bd37b84250 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.915+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94271172082800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b958f0 con 0x55bd37b84250 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.916+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94271172082800] v34'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x55bd37b84250 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.916+0000 7f9c19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.916+0000 7f9d68413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.916+0000 7f9d68413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.916+0000 7f9d68413800 5 note: GC not initialized 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.917+0000 7f9c18fe1640 20 reqs_thread_entry: start 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.917+0000 7f9d68413800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.917+0000 7f9d68413800 20 Filter name: none 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.917+0000 7f9b927fc640 20 reqs_thread_entry: start 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.917+0000 7f9d68413800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.917+0000 7f9d68413800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.917+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37bced10 con 0x55bd37b88c40 2024-04-23T18:29:53.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.917+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f9d5408c040 con 0x55bd37b88c40 2024-04-23T18:29:53.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.917+0000 7f9d68413800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:53.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.917+0000 7f9d68413800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-23T18:29:53.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.917+0000 7f9d68413800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:53.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.917+0000 7f9d68413800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 : miss 2024-04-23T18:29:53.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.917+0000 7f9d68413800 20 rados->read ofs=0 len=0 2024-04-23T18:29:53.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.918+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.e 8:709d5331:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37bd0900 con 0x7f9d54077060 2024-04-23T18:29:53.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.918+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9d5c040080 con 0x7f9d54077060 2024-04-23T18:29:53.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.918+0000 7f9d68413800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:53.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.918+0000 7f9d68413800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 info.flags=0x17 2024-04-23T18:29:53.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.918+0000 7f9d68413800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 to cache LRU end 2024-04-23T18:29:53.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.918+0000 7f9d68413800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:53.923 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.918+0000 7f9d68413800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:53.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.918+0000 7f9d68413800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 2024-04-23T18:29:53.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.918+0000 7f9d68413800 20 get_obj_state: octx=0x7f9d5c00aaf0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55bd37bd2fc8 s->prefetch_data=0 2024-04-23T18:29:53.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.919+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 3.as0 3:5165f270:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bd37bd40e0 con 0x55bd37b8d5f0 2024-04-23T18:29:53.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.919+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.919+0000 7f9d68413800 10 manifest: total_size = 5 2024-04-23T18:29:53.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.919+0000 7f9d68413800 20 get_obj_state: setting s->obj_tag to _q2By9EOsbmjk6ZbCBz24EGEkMcscSGy 2024-04-23T18:29:53.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.919+0000 7f9c19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:53.924 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.920+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94271172082800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37bcc680 con 0x55bd37b84250 2024-04-23T18:29:53.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.921+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94271172082800] v34'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x55bd37b84250 2024-04-23T18:29:53.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.921+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94271172057200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37bcc680 con 0x55bd37b88c40 2024-04-23T18:29:53.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.922+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94271172057200] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5408c040 con 0x55bd37b88c40 2024-04-23T18:29:53.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.922+0000 7f9d68413800 20 remove_watcher() i=0 2024-04-23T18:29:53.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.922+0000 7f9d68413800 2 removed watcher, disabling cache 2024-04-23T18:29:53.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.922+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94271172061424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37bcc680 con 0x55bd37b84250 2024-04-23T18:29:53.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.923+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94271172061424] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x55bd37b84250 2024-04-23T18:29:53.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.923+0000 7f9d68413800 20 remove_watcher() i=1 2024-04-23T18:29:53.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.923+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94271172066400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37bcc680 con 0x55bd37b8d5f0 2024-04-23T18:29:53.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.924+0000 7f9d63220640 1 -- 172.21.15.119:0/2553531964 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94271172066400] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d58081070 con 0x55bd37b8d5f0 2024-04-23T18:29:53.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.924+0000 7f9d68413800 20 remove_watcher() i=2 2024-04-23T18:29:53.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.924+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94271172068736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b91870 con 0x55bd37b88c40 2024-04-23T18:29:53.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.925+0000 7f9d63a21640 1 -- 172.21.15.119:0/2553531964 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94271172068736] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5408c040 con 0x55bd37b88c40 2024-04-23T18:29:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.925+0000 7f9d68413800 20 remove_watcher() i=3 2024-04-23T18:29:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.925+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94271172071408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b928f0 con 0x55bd37b84250 2024-04-23T18:29:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.926+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94271172071408] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x55bd37b84250 2024-04-23T18:29:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.926+0000 7f9d68413800 20 remove_watcher() i=4 2024-04-23T18:29:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.926+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94271172076400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b93c60 con 0x7f9d54077060 2024-04-23T18:29:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.927+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94271172076400] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x7f9d54077060 2024-04-23T18:29:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.927+0000 7f9d68413800 20 remove_watcher() i=5 2024-04-23T18:29:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.927+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94271172080224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b91870 con 0x7f9d54077060 2024-04-23T18:29:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.928+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94271172080224] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x7f9d54077060 2024-04-23T18:29:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.928+0000 7f9d68413800 20 remove_watcher() i=6 2024-04-23T18:29:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.928+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94271172078608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bd37b928f0 con 0x7f9d54077060 2024-04-23T18:29:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.929+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94271172078608] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d5c040080 con 0x7f9d54077060 2024-04-23T18:29:53.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.929+0000 7f9d68413800 20 remove_watcher() i=7 2024-04-23T18:29:53.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.929+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f9d54077060 msgr2=0x7f9d5401f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.929+0000 7f9d68413800 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f9d54077060 0x7f9d5401f930 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.929+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bd37b84250 msgr2=0x55bd37b86710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.929+0000 7f9d68413800 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bd37b84250 0x55bd37b86710 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.929+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bd37b88c40 msgr2=0x55bd37b8b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.929+0000 7f9d68413800 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bd37b88c40 0x55bd37b8b030 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.929+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bd37b8d5f0 msgr2=0x55bd37b8fab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.929+0000 7f9d68413800 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bd37b8d5f0 0x55bd37b8fab0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c2c036e60 msgr2=0x7f9c2c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c2c036e60 0x7f9c2c039320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9d58052fd0 tx=0x7f9d5804f000 comp rx=0 tx=0).stop 2024-04-23T18:29:53.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 msgr2=0x55bd37b78b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d64222640 1 -- 172.21.15.119:0/2553531964 reap_dead start 2024-04-23T18:29:53.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 0x55bd37b78b30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400dbf0 tx=0x7f9d5400df20 comp rx=0 tx=0).stop 2024-04-23T18:29:53.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 shutdown_connections 2024-04-23T18:29:53.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 --2- 172.21.15.119:0/2553531964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37b716f0 0x55bd37b78b30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 >> 172.21.15.119:0/2553531964 conn(0x55bd37b6da50 msgr2=0x55bd37b6b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 shutdown_connections 2024-04-23T18:29:53.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/2553531964 wait complete. 2024-04-23T18:29:53.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/3895609525 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c3c036e60 msgr2=0x7f9c3c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 --2- 172.21.15.119:0/3895609525 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c3c036e60 0x7f9c3c039320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x55bd37b480e0 tx=0x7f9d58005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:53.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/3895609525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4b620 msgr2=0x55bd37a49a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 --2- 172.21.15.119:0/3895609525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4b620 0x55bd37a49a90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9d5404b5f0 tx=0x7f9d5400db20 comp rx=0 tx=0).stop 2024-04-23T18:29:53.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/3895609525 shutdown_connections 2024-04-23T18:29:53.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 --2- 172.21.15.119:0/3895609525 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c3c036e60 0x7f9c3c039320 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 --2- 172.21.15.119:0/3895609525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4b620 0x55bd37a49a90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/3895609525 >> 172.21.15.119:0/3895609525 conn(0x55bd37b56410 msgr2=0x55bd37b56810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/3895609525 shutdown_connections 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/3895609525 wait complete. 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bd37b51360 msgr2=0x55bd37b537b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bd37b51360 0x55bd37b537b0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bd37a4f5b0 msgr2=0x55bd37b4abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bd37a4f5b0 0x55bd37b4abf0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bd37b4d420 msgr2=0x55bd37b4f810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.930+0000 7f9d68413800 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bd37b4d420 0x55bd37b4f810 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.931+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c4c036e60 msgr2=0x7f9c4c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.931+0000 7f9d68413800 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9c4c036e60 0x7f9c4c039320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9d58054000 tx=0x7f9d5804e000 comp rx=0 tx=0).stop 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.931+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4baa0 msgr2=0x55bd37b43b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.931+0000 7f9d68413800 1 --2- 172.21.15.119:0/2349830999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bd37a4baa0 0x55bd37b43b80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9d54001de0 tx=0x7f9d54000ed0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.931+0000 7f9d64222640 1 -- 172.21.15.119:0/2349830999 reap_dead start 2024-04-23T18:29:53.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.931+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 shutdown_connections 2024-04-23T18:29:53.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.931+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 >> 172.21.15.119:0/2349830999 conn(0x55bd37a45430 msgr2=0x55bd37b363a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.931+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 shutdown_connections 2024-04-23T18:29:53.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.931+0000 7f9d68413800 1 -- 172.21.15.119:0/2349830999 wait complete. 2024-04-23T18:29:53.936 INFO:teuthology.orchestra.run.smithi119.stdout:fooFoofooFooFULL_CONTROL 2024-04-23T18:29:53.936 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-04-23T18:29:53.938 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-04-23T18:29:53.943 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:53.943 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-23T18:29:53.943 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-23T18:29:53.943 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-23T18:29:53.986 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:53.987 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:53.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.995+0000 7fb41f61f800 1 Processor -- start 2024-04-23T18:29:53.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.995+0000 7fb41f61f800 1 -- start start 2024-04-23T18:29:53.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.995+0000 7fb41f61f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d7302e3590 0x55d7302e5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:53.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.995+0000 7fb41f61f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d73018f560 con 0x55d7302dfa80 2024-04-23T18:29:53.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.995+0000 7fb41f61f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55d730180e20 con 0x55d7302e3590 2024-04-23T18:29:53.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.995+0000 7fb41c924640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d7302e3590 0x55d7302e5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.995+0000 7fb41c924640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d7302e3590 0x55d7302e5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36182/0 (socket says 172.21.15.119:36182) 2024-04-23T18:29:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.995+0000 7fb41c924640 1 -- 172.21.15.119:0/1339509076 learned_addr learned my addr 172.21.15.119:0/1339509076 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.995+0000 7fb41d125640 1 --1- 172.21.15.119:0/1339509076 >> v1:172.21.15.62:6789/0 conn(0x55d7302dfa80 0x55d7302e1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:43628/0 (socket says 172.21.15.119:43628) 2024-04-23T18:29:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.996+0000 7fb41c924640 1 -- 172.21.15.119:0/1339509076 >> v1:172.21.15.62:6789/0 conn(0x55d7302dfa80 legacy=0x55d7302e1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.996+0000 7fb41c924640 1 -- 172.21.15.119:0/1339509076 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d73018ee60 con 0x55d7302e3590 2024-04-23T18:29:53.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.997+0000 7fb41c924640 1 --2- 172.21.15.119:0/1339509076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302e3590 0x55d7302e5980 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb41400a520 tx=0x7fb41401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36cc438e5dd5d3f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:53.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.997+0000 7fb40ffff640 1 -- 172.21.15.119:0/1339509076 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb414057070 con 0x55d7302e3590 2024-04-23T18:29:53.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.998+0000 7fb40ffff640 1 -- 172.21.15.119:0/1339509076 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb414052570 con 0x55d7302e3590 2024-04-23T18:29:53.990 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.998+0000 7fb40ffff640 1 -- 172.21.15.119:0/1339509076 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb41404ae60 con 0x55d7302e3590 2024-04-23T18:29:53.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.998+0000 7fb41f61f800 1 -- 172.21.15.119:0/1339509076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302e3590 msgr2=0x55d7302e5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:53.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.998+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1339509076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302e3590 0x55d7302e5980 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb41400a520 tx=0x7fb41401d010 comp rx=0 tx=0).stop 2024-04-23T18:29:53.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.998+0000 7fb41f61f800 1 -- 172.21.15.119:0/1339509076 shutdown_connections 2024-04-23T18:29:53.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.998+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1339509076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302e3590 0x55d7302e5980 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:53.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.998+0000 7fb41f61f800 1 -- 172.21.15.119:0/1339509076 >> 172.21.15.119:0/1339509076 conn(0x55d7302d9430 msgr2=0x55d7302db850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:53.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.998+0000 7fb41f61f800 1 -- 172.21.15.119:0/1339509076 shutdown_connections 2024-04-23T18:29:53.991 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:53.998+0000 7fb41f61f800 1 -- 172.21.15.119:0/1339509076 wait complete. 2024-04-23T18:29:54.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.010+0000 7fb41f61f800 1 Processor -- start 2024-04-23T18:29:54.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.010+0000 7fb41f61f800 1 -- start start 2024-04-23T18:29:54.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.010+0000 7fb41f61f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302dfa80 0x55d7302df3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.010+0000 7fb41f61f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d73022a5d0 con 0x55d7302dfa80 2024-04-23T18:29:54.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.010+0000 7fb41d125640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302dfa80 0x55d7302df3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.010+0000 7fb41d125640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302dfa80 0x55d7302df3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36186/0 (socket says 172.21.15.119:36186) 2024-04-23T18:29:54.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.010+0000 7fb41d125640 1 -- 172.21.15.119:0/2533336565 learned_addr learned my addr 172.21.15.119:0/2533336565 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.010+0000 7fb41d125640 1 -- 172.21.15.119:0/2533336565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7301a0860 con 0x55d7302dfa80 2024-04-23T18:29:54.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.011+0000 7fb41d125640 1 --2- 172.21.15.119:0/2533336565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302dfa80 0x55d7302df3c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb410001e10 tx=0x7fb41000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb98697bb832fbb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.011+0000 7fb30b606640 1 -- 172.21.15.119:0/2533336565 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb41000e5c0 con 0x55d7302dfa80 2024-04-23T18:29:54.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.011+0000 7fb30b606640 1 -- 172.21.15.119:0/2533336565 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb410006070 con 0x55d7302dfa80 2024-04-23T18:29:54.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.011+0000 7fb30b606640 1 -- 172.21.15.119:0/2533336565 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb41000e930 con 0x55d7302dfa80 2024-04-23T18:29:54.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.011+0000 7fb41f61f800 1 -- 172.21.15.119:0/2533336565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302dfa80 msgr2=0x55d7302df3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.011+0000 7fb41f61f800 1 --2- 172.21.15.119:0/2533336565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302dfa80 0x55d7302df3c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb410001e10 tx=0x7fb41000b6c0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.011+0000 7fb41f61f800 1 -- 172.21.15.119:0/2533336565 shutdown_connections 2024-04-23T18:29:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.011+0000 7fb41f61f800 1 --2- 172.21.15.119:0/2533336565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302dfa80 0x55d7302df3c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.012+0000 7fb41f61f800 1 -- 172.21.15.119:0/2533336565 >> 172.21.15.119:0/2533336565 conn(0x55d7302d9430 msgr2=0x55d7303cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.012+0000 7fb41f61f800 1 -- 172.21.15.119:0/2533336565 shutdown_connections 2024-04-23T18:29:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.012+0000 7fb41f61f800 1 -- 172.21.15.119:0/2533336565 wait complete. 2024-04-23T18:29:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.012+0000 7fb41f61f800 1 Processor -- start 2024-04-23T18:29:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.012+0000 7fb41f61f800 1 -- start start 2024-04-23T18:29:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.012+0000 7fb41f61f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302dfa80 0x55d7303d9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.012+0000 7fb41f61f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d7302e81d0 con 0x55d7302dfa80 2024-04-23T18:29:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.012+0000 7fb41d125640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302dfa80 0x55d7303d9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.012+0000 7fb41d125640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302dfa80 0x55d7303d9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36202/0 (socket says 172.21.15.119:36202) 2024-04-23T18:29:54.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.012+0000 7fb41d125640 1 -- 172.21.15.119:0/1866658316 learned_addr learned my addr 172.21.15.119:0/1866658316 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.012+0000 7fb41d125640 1 -- 172.21.15.119:0/1866658316 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d73019eeb0 con 0x55d7302dfa80 2024-04-23T18:29:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.013+0000 7fb41d125640 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302dfa80 0x55d7303d9d60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb41000b700 tx=0x7fb410000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.013+0000 7fb309e03640 1 -- 172.21.15.119:0/1866658316 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb41000f8d0 con 0x55d7302dfa80 2024-04-23T18:29:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.013+0000 7fb309e03640 1 -- 172.21.15.119:0/1866658316 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb41000fa70 con 0x55d7302dfa80 2024-04-23T18:29:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.013+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7303da2a0 con 0x55d7302dfa80 2024-04-23T18:29:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.013+0000 7fb309e03640 1 -- 172.21.15.119:0/1866658316 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb41000fd50 con 0x55d7302dfa80 2024-04-23T18:29:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.013+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7303da7c0 con 0x55d7302dfa80 2024-04-23T18:29:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.014+0000 7fb309e03640 1 -- 172.21.15.119:0/1866658316 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb410017070 con 0x55d7302dfa80 2024-04-23T18:29:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.014+0000 7fb309e03640 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb304036e60 0x7fb304039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.014+0000 7fb309e03640 1 -- 172.21.15.119:0/1866658316 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb410015020 con 0x55d7302dfa80 2024-04-23T18:29:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.014+0000 7fb41c924640 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb304036e60 0x7fb304039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.014+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d7302e3590 0x55d7303e0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.014+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d7303e1360 con 0x55d7302e3590 2024-04-23T18:29:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.014+0000 7fb41d926640 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d7302e3590 0x55d7303e0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.014+0000 7fb41c924640 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb304036e60 0x7fb304039320 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb414054000 tx=0x7fb41404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.014+0000 7fb41d926640 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d7302e3590 0x55d7303e0dd0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.015+0000 7fb41d926640 1 -- 172.21.15.119:0/1866658316 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d7302e3590 2024-04-23T18:29:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.015+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d7303de3a0 con 0x55d7302e3590 2024-04-23T18:29:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.015+0000 7fb41d926640 1 -- 172.21.15.119:0/1866658316 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d7302e3590 2024-04-23T18:29:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.015+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d7303e36b0 0x55d7303e5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.015+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d7303e6140 con 0x55d7303e36b0 2024-04-23T18:29:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.015+0000 7fb41d125640 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d7303e36b0 0x55d7303e5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.015+0000 7fb41d125640 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d7303e36b0 0x55d7303e5aa0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.016+0000 7fb41d125640 1 -- 172.21.15.119:0/1866658316 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb41002e070 con 0x55d7303e36b0 2024-04-23T18:29:54.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.016+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d7303e2660 con 0x55d7302e3590 2024-04-23T18:29:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.016+0000 7fb41d926640 1 -- 172.21.15.119:0/1866658316 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d7302e3590 2024-04-23T18:29:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.016+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d7303e75f0 0x55d7303e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.016+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d7303ea1a0 con 0x55d7303e75f0 2024-04-23T18:29:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.016+0000 7fb41c924640 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d7303e75f0 0x55d7303e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.016+0000 7fb41c924640 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d7303e75f0 0x55d7303e9a40 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.017+0000 7fb41c924640 1 -- 172.21.15.119:0/1866658316 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb41405a040 con 0x55d7303e75f0 2024-04-23T18:29:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.017+0000 7fb41f61f800 1 Processor -- start 2024-04-23T18:29:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.017+0000 7fb41f61f800 1 -- start start 2024-04-23T18:29:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.017+0000 7fb41f61f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7303f8600 0x55d7303f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.017+0000 7fb41f61f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d7301d0df0 con 0x55d7303f8600 2024-04-23T18:29:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.017+0000 7fb41d125640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7303f8600 0x55d7303f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.017+0000 7fb41d125640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7303f8600 0x55d7303f8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36210/0 (socket says 172.21.15.119:36210) 2024-04-23T18:29:54.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.017+0000 7fb41d125640 1 -- 172.21.15.119:0/2452936411 learned_addr learned my addr 172.21.15.119:0/2452936411 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.018+0000 7fb41d125640 1 -- 172.21.15.119:0/2452936411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7303f8f60 con 0x55d7303f8600 2024-04-23T18:29:54.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.018+0000 7fb41d125640 1 --2- 172.21.15.119:0/2452936411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7303f8600 0x55d7303f8a20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb410001640 tx=0x7fb410013df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.018+0000 7fb302ffd640 1 -- 172.21.15.119:0/2452936411 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb41001a690 con 0x55d7303f8600 2024-04-23T18:29:54.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.018+0000 7fb302ffd640 1 -- 172.21.15.119:0/2452936411 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb41001a850 con 0x55d7303f8600 2024-04-23T18:29:54.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.018+0000 7fb41f61f800 1 -- 172.21.15.119:0/2452936411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7303f99d0 con 0x55d7303f8600 2024-04-23T18:29:54.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.018+0000 7fb302ffd640 1 -- 172.21.15.119:0/2452936411 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb41004d1e0 con 0x55d7303f8600 2024-04-23T18:29:54.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.018+0000 7fb41f61f800 1 -- 172.21.15.119:0/2452936411 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7303f9ed0 con 0x55d7303f8600 2024-04-23T18:29:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.019+0000 7fb302ffd640 1 -- 172.21.15.119:0/2452936411 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb41004d380 con 0x55d7303f8600 2024-04-23T18:29:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.019+0000 7fb302ffd640 1 --2- 172.21.15.119:0/2452936411 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2f4036e60 0x7fb2f4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.019+0000 7fb302ffd640 1 -- 172.21.15.119:0/2452936411 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb41003cd00 con 0x55d7303f8600 2024-04-23T18:29:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.019+0000 7fb41c924640 1 --2- 172.21.15.119:0/2452936411 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2f4036e60 0x7fb2f4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.019+0000 7fb41f61f800 1 Processor -- start 2024-04-23T18:29:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.019+0000 7fb41f61f800 1 -- start start 2024-04-23T18:29:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.019+0000 7fb41c924640 1 --2- 172.21.15.119:0/2452936411 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2f4036e60 0x7fb2f4039320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55d7303de2c0 tx=0x7fb414005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.019+0000 7fb41f61f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 0x55d730405b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.019+0000 7fb41f61f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d7302dda40 con 0x55d730405730 2024-04-23T18:29:54.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.019+0000 7fb41d125640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 0x55d730405b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.019+0000 7fb41d125640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 0x55d730405b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36222/0 (socket says 172.21.15.119:36222) 2024-04-23T18:29:54.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.019+0000 7fb41d125640 1 -- 172.21.15.119:0/525452184 learned_addr learned my addr 172.21.15.119:0/525452184 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.020+0000 7fb41d125640 1 -- 172.21.15.119:0/525452184 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d730406120 con 0x55d730405730 2024-04-23T18:29:54.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.020+0000 7fb41d125640 1 --2- 172.21.15.119:0/525452184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 0x55d730405b50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb410032fd0 tx=0x7fb410019f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159d1a62a3ea5fcb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.020+0000 7fb300ff9640 1 -- 172.21.15.119:0/525452184 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb410027a00 con 0x55d730405730 2024-04-23T18:29:54.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.020+0000 7fb300ff9640 1 -- 172.21.15.119:0/525452184 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb410031d50 con 0x55d730405730 2024-04-23T18:29:54.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.020+0000 7fb300ff9640 1 -- 172.21.15.119:0/525452184 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb41004a6f0 con 0x55d730405730 2024-04-23T18:29:54.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.020+0000 7fb41f61f800 1 -- 172.21.15.119:0/525452184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 msgr2=0x55d730405b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.020+0000 7fb41f61f800 1 --2- 172.21.15.119:0/525452184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 0x55d730405b50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb410032fd0 tx=0x7fb410019f40 comp rx=0 tx=0).stop 2024-04-23T18:29:54.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.020+0000 7fb41f61f800 1 -- 172.21.15.119:0/525452184 shutdown_connections 2024-04-23T18:29:54.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.020+0000 7fb41f61f800 1 --2- 172.21.15.119:0/525452184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 0x55d730405b50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.020+0000 7fb41f61f800 1 -- 172.21.15.119:0/525452184 >> 172.21.15.119:0/525452184 conn(0x55d730401a50 msgr2=0x55d7303ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.020+0000 7fb41f61f800 1 -- 172.21.15.119:0/525452184 shutdown_connections 2024-04-23T18:29:54.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.020+0000 7fb41f61f800 1 -- 172.21.15.119:0/525452184 wait complete. 2024-04-23T18:29:54.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.021+0000 7fb41f61f800 1 Processor -- start 2024-04-23T18:29:54.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.021+0000 7fb41f61f800 1 -- start start 2024-04-23T18:29:54.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.021+0000 7fb41f61f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 0x55d73040cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.021+0000 7fb41f61f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d730406840 con 0x55d730405730 2024-04-23T18:29:54.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.021+0000 7fb41d125640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 0x55d73040cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.021+0000 7fb41d125640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 0x55d73040cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36232/0 (socket says 172.21.15.119:36232) 2024-04-23T18:29:54.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.021+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 learned_addr learned my addr 172.21.15.119:0/1150829493 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.021+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d73040d080 con 0x55d730405730 2024-04-23T18:29:54.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.022+0000 7fb41d125640 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 0x55d73040cb40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb41001ba90 tx=0x7fb41001ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.022+0000 7fb2f2ffd640 1 -- 172.21.15.119:0/1150829493 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb410027a00 con 0x55d730405730 2024-04-23T18:29:54.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.022+0000 7fb2f2ffd640 1 -- 172.21.15.119:0/1150829493 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb41006a030 con 0x55d730405730 2024-04-23T18:29:54.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.022+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d73040d080 con 0x55d730405730 2024-04-23T18:29:54.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.022+0000 7fb2f2ffd640 1 -- 172.21.15.119:0/1150829493 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb41001d5f0 con 0x55d730405730 2024-04-23T18:29:54.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.022+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d73040d080 con 0x55d730405730 2024-04-23T18:29:54.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.023+0000 7fb2f2ffd640 1 -- 172.21.15.119:0/1150829493 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb410060070 con 0x55d730405730 2024-04-23T18:29:54.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.023+0000 7fb2f2ffd640 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2e8036e60 0x7fb2e8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.023+0000 7fb2f2ffd640 1 -- 172.21.15.119:0/1150829493 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb41005e020 con 0x55d730405730 2024-04-23T18:29:54.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.023+0000 7fb41c924640 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2e8036e60 0x7fb2e8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.023+0000 7fb41f61f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.023+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d730418290 0x55d73041a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.023+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73041aea0 con 0x55d730418290 2024-04-23T18:29:54.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.023+0000 7fb41c924640 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2e8036e60 0x7fb2e8039320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb414055040 tx=0x7fb41404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.023+0000 7fb41d926640 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d730418290 0x55d73041a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41d926640 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d730418290 0x55d73041a750 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d730418290 2024-04-23T18:29:54.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41f61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41f61f800 20 realm 2024-04-23T18:29:54.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41f61f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73041b2b0 con 0x55d730418290 2024-04-23T18:29:54.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d730418290 2024-04-23T18:29:54.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41f61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41f61f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:54.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41f61f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bb80 con 0x55d730418290 2024-04-23T18:29:54.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d730418290 2024-04-23T18:29:54.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41f61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41f61f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.024+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730418290 2024-04-23T18:29:54.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.025+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d730418290 2024-04-23T18:29:54.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.025+0000 7fb41f61f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:54.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.025+0000 7fb41f61f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.025+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d73041cc80 0x55d73041f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.025+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73041f680 con 0x55d73041cc80 2024-04-23T18:29:54.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.025+0000 7fb41d125640 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d73041cc80 0x55d73041f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.025+0000 7fb41d125640 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d73041cc80 0x55d73041f070 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.025+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb41002e070 con 0x55d73041cc80 2024-04-23T18:29:54.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.025+0000 7fb41f61f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.025+0000 7fb41f61f800 20 searching for the correct realm 2024-04-23T18:29:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.025+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d730421630 0x55d730423af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.025+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d7304241c0 con 0x55d730421630 2024-04-23T18:29:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.025+0000 7fb41c924640 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d730421630 0x55d730423af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.026+0000 7fb41c924640 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d730421630 0x55d730423af0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.026+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.026+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d7304241c0 con 0x55d73041cc80 2024-04-23T18:29:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.026+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41002e070 con 0x55d73041cc80 2024-04-23T18:29:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.026+0000 7fb41d125640 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb41000f070 0x7fb410013130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.026+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d7304241c0 con 0x7fb41000f070 2024-04-23T18:29:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.027+0000 7fb41d926640 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb41000f070 0x7fb410013130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.027+0000 7fb41d926640 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb41000f070 0x7fb410013130 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.027+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800a4a0 con 0x7fb41000f070 2024-04-23T18:29:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.027+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730418290 2024-04-23T18:29:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.027+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d730418290 2024-04-23T18:29:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.027+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730418290 2024-04-23T18:29:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.028+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d730418290 2024-04-23T18:29:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.028+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x7fb41000f070 2024-04-23T18:29:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.028+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800a4a0 con 0x7fb41000f070 2024-04-23T18:29:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.028+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x7fb41000f070 2024-04-23T18:29:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.028+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb41800a4a0 con 0x7fb41000f070 2024-04-23T18:29:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.028+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d73041cc80 2024-04-23T18:29:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.028+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41002e070 con 0x55d73041cc80 2024-04-23T18:29:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.028+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730421630 2024-04-23T18:29:54.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.029+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.029+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730418290 2024-04-23T18:29:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.029+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d730418290 2024-04-23T18:29:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.029+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x7fb41000f070 2024-04-23T18:29:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.029+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800a4a0 con 0x7fb41000f070 2024-04-23T18:29:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.029+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730418290 2024-04-23T18:29:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.029+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d730418290 2024-04-23T18:29:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.029+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d73041cc80 2024-04-23T18:29:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.030+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb41002e070 con 0x55d73041cc80 2024-04-23T18:29:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.030+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730421630 2024-04-23T18:29:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.030+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.030+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730421630 2024-04-23T18:29:54.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.030+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.030+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x7fb41000f070 2024-04-23T18:29:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.030+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800a4a0 con 0x7fb41000f070 2024-04-23T18:29:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.030+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730421630 2024-04-23T18:29:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.031+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.031+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730421630 2024-04-23T18:29:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.031+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.031+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730418290 2024-04-23T18:29:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.031+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d730418290 2024-04-23T18:29:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.031+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730418290 2024-04-23T18:29:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.031+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d730418290 2024-04-23T18:29:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.031+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x7fb41000f070 2024-04-23T18:29:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.032+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800a4a0 con 0x7fb41000f070 2024-04-23T18:29:54.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.032+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730421630 2024-04-23T18:29:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.032+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.032+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d73041cc80 2024-04-23T18:29:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.032+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb41002e070 con 0x55d73041cc80 2024-04-23T18:29:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.032+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730418290 2024-04-23T18:29:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.033+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800a4a0 con 0x55d730418290 2024-04-23T18:29:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.033+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d73041cc80 2024-04-23T18:29:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.033+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41002e070 con 0x55d73041cc80 2024-04-23T18:29:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.033+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730421630 2024-04-23T18:29:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.033+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.033+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x7fb41000f070 2024-04-23T18:29:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.033+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800a4a0 con 0x7fb41000f070 2024-04-23T18:29:54.043 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.033+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d73041cc80 2024-04-23T18:29:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.034+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41008c040 con 0x55d73041cc80 2024-04-23T18:29:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.034+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730421630 2024-04-23T18:29:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.034+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.034+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x7fb41000f070 2024-04-23T18:29:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.034+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41800a4a0 con 0x7fb41000f070 2024-04-23T18:29:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.034+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d730418290 2024-04-23T18:29:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.034+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb418040080 con 0x55d730418290 2024-04-23T18:29:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.034+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d73041bf20 con 0x55d73041cc80 2024-04-23T18:29:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb41008c040 con 0x55d73041cc80 2024-04-23T18:29:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:54.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73041ff40 con 0x55d730418290 2024-04-23T18:29:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb418040080 con 0x55d730418290 2024-04-23T18:29:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730420330 con 0x55d730418290 2024-04-23T18:29:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb418040080 con 0x55d730418290 2024-04-23T18:29:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.035+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730420330 con 0x7fb41000f070 2024-04-23T18:29:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb418040080 con 0x7fb41000f070 2024-04-23T18:29:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 20 zone default found 2024-04-23T18:29:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 4 Realm: () 2024-04-23T18:29:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 20 zonegroup default 2024-04-23T18:29:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73041fb80 con 0x55d73041cc80 2024-04-23T18:29:54.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb41008c040 con 0x55d73041cc80 2024-04-23T18:29:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730426050 con 0x55d730421630 2024-04-23T18:29:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d7304264c0 con 0x55d730421630 2024-04-23T18:29:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 20 started sync module instance, tier type = 2024-04-23T18:29:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.036+0000 7fb41f61f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.037+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d7304254c0 con 0x55d73041cc80 2024-04-23T18:29:54.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.038+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41008c040 con 0x55d73041cc80 2024-04-23T18:29:54.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.038+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94382715984048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730425120 con 0x55d73041cc80 2024-04-23T18:29:54.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.038+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d7304273d0 con 0x55d730418290 2024-04-23T18:29:54.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.039+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94382715984048] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41008c040 con 0x55d73041cc80 2024-04-23T18:29:54.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.039+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x55d730418290 2024-04-23T18:29:54.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.039+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94382715989792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730427340 con 0x55d730418290 2024-04-23T18:29:54.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.039+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730428290 con 0x55d730421630 2024-04-23T18:29:54.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.040+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94382715989792] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x55d730418290 2024-04-23T18:29:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.042+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.042+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94382715993568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730428680 con 0x55d730421630 2024-04-23T18:29:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.042+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d7304290a0 con 0x55d73041cc80 2024-04-23T18:29:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.043+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41008c040 con 0x55d73041cc80 2024-04-23T18:29:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.043+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94382715999376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730429d60 con 0x55d73041cc80 2024-04-23T18:29:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.043+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73042a7b0 con 0x55d730418290 2024-04-23T18:29:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.043+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94382715993568] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.044+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x55d730418290 2024-04-23T18:29:54.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.044+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94382716002976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730429d60 con 0x55d730418290 2024-04-23T18:29:54.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.044+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73042b1c0 con 0x7fb41000f070 2024-04-23T18:29:54.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.044+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94382715999376] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41008c040 con 0x55d73041cc80 2024-04-23T18:29:54.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.045+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94382716002976] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x55d730418290 2024-04-23T18:29:54.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.045+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x7fb41000f070 2024-04-23T18:29:54.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.045+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94382716005648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730429d60 con 0x7fb41000f070 2024-04-23T18:29:54.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.045+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73042b130 con 0x7fb41000f070 2024-04-23T18:29:54.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.046+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(56 notify.6 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x7fb41000f070 2024-04-23T18:29:54.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.046+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94382716006704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73042ba60 con 0x7fb41000f070 2024-04-23T18:29:54.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.046+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73042c540 con 0x7fb41000f070 2024-04-23T18:29:54.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.046+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94382716005648] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x7fb41000f070 2024-04-23T18:29:54.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.047+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94382716006704] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x7fb41000f070 2024-04-23T18:29:54.060 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.047+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x7fb41000f070 2024-04-23T18:29:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.047+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94382716000432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73042c050 con 0x7fb41000f070 2024-04-23T18:29:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.047+0000 7fb41f61f800 20 add_watcher() i=0 2024-04-23T18:29:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.047+0000 7fb41f61f800 20 add_watcher() i=1 2024-04-23T18:29:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.047+0000 7fb41f61f800 20 add_watcher() i=2 2024-04-23T18:29:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.047+0000 7fb41f61f800 20 add_watcher() i=3 2024-04-23T18:29:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.047+0000 7fb41f61f800 20 add_watcher() i=4 2024-04-23T18:29:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.047+0000 7fb41f61f800 20 add_watcher() i=5 2024-04-23T18:29:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.047+0000 7fb41f61f800 20 add_watcher() i=6 2024-04-23T18:29:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.048+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94382716000432] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x7fb41000f070 2024-04-23T18:29:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.048+0000 7fb41f61f800 20 add_watcher() i=7 2024-04-23T18:29:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.048+0000 7fb41f61f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:54.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.048+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73042f530 con 0x55d730418290 2024-04-23T18:29:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.048+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb418040080 con 0x55d730418290 2024-04-23T18:29:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.048+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94382716010576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73042c990 con 0x55d730418290 2024-04-23T18:29:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.049+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94382716010576] v34'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb418040080 con 0x55d730418290 2024-04-23T18:29:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.049+0000 7fb2d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.049+0000 7fb41f61f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.049+0000 7fb41f61f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.049+0000 7fb41f61f800 5 note: GC not initialized 2024-04-23T18:29:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb2d27e4640 20 reqs_thread_entry: start 2024-04-23T18:29:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb41f61f800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb41f61f800 20 Filter name: none 2024-04-23T18:29:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb243fff640 20 reqs_thread_entry: start 2024-04-23T18:29:54.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb41f61f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-23T18:29:54.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb41f61f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730463080 con 0x55d73041cc80 2024-04-23T18:29:54.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb41008c040 con 0x55d73041cc80 2024-04-23T18:29:54.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb41f61f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:54.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb41f61f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-23T18:29:54.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb41f61f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:54.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb41f61f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 : miss 2024-04-23T18:29:54.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb41f61f800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.050+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.e 8:709d5331:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730464c40 con 0x7fb41000f070 2024-04-23T18:29:54.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.051+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb418040080 con 0x7fb41000f070 2024-04-23T18:29:54.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.051+0000 7fb41f61f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:54.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.051+0000 7fb41f61f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 info.flags=0x17 2024-04-23T18:29:54.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.051+0000 7fb41f61f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 to cache LRU end 2024-04-23T18:29:54.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.051+0000 7fb41f61f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:54.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.051+0000 7fb41f61f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:54.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.051+0000 7fb41f61f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 2024-04-23T18:29:54.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.051+0000 7fb41f61f800 20 get_obj_state: octx=0x7fb41800aaf0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55d730467308 s->prefetch_data=0 2024-04-23T18:29:54.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.051+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 3.as0 3:5165f270:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730468420 con 0x55d730421630 2024-04-23T18:29:54.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.051+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.051+0000 7fb41f61f800 10 manifest: total_size = 5 2024-04-23T18:29:54.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.051+0000 7fb41f61f800 20 get_obj_state: setting s->obj_tag to _oR-lHqJ1IS1KyVnEtQ6nlidoKlJDtm4 2024-04-23T18:29:54.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.052+0000 7fb2d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:54.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.052+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94382716010576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730460a10 con 0x55d730418290 2024-04-23T18:29:54.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.053+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94382716010576] v34'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb418040080 con 0x55d730418290 2024-04-23T18:29:54.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.053+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94382715984048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730460a10 con 0x55d73041cc80 2024-04-23T18:29:54.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.054+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94382715984048] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41008c040 con 0x55d73041cc80 2024-04-23T18:29:54.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.054+0000 7fb41f61f800 20 remove_watcher() i=0 2024-04-23T18:29:54.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.054+0000 7fb41f61f800 2 removed watcher, disabling cache 2024-04-23T18:29:54.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.054+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94382715989792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730460a10 con 0x55d730418290 2024-04-23T18:29:54.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.055+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94382715989792] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x55d730418290 2024-04-23T18:29:54.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.055+0000 7fb41f61f800 20 remove_watcher() i=1 2024-04-23T18:29:54.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.055+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94382715993568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730460a10 con 0x55d730421630 2024-04-23T18:29:54.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.056+0000 7fb41c924640 1 -- 172.21.15.119:0/1150829493 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94382715993568] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41407f070 con 0x55d730421630 2024-04-23T18:29:54.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.056+0000 7fb41f61f800 20 remove_watcher() i=2 2024-04-23T18:29:54.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.056+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94382715999376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730426f20 con 0x55d73041cc80 2024-04-23T18:29:54.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.057+0000 7fb41d125640 1 -- 172.21.15.119:0/1150829493 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94382715999376] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb41008c040 con 0x55d73041cc80 2024-04-23T18:29:54.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.057+0000 7fb41f61f800 20 remove_watcher() i=3 2024-04-23T18:29:54.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.057+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94382716002976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730427de0 con 0x55d730418290 2024-04-23T18:29:54.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.058+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94382716002976] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x55d730418290 2024-04-23T18:29:54.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.058+0000 7fb41f61f800 20 remove_watcher() i=4 2024-04-23T18:29:54.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.058+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94382716005648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730429490 con 0x7fb41000f070 2024-04-23T18:29:54.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.059+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94382716005648] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x7fb41000f070 2024-04-23T18:29:54.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.059+0000 7fb41f61f800 20 remove_watcher() i=5 2024-04-23T18:29:54.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.059+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94382716006704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730426f20 con 0x7fb41000f070 2024-04-23T18:29:54.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.060+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94382716006704] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x7fb41000f070 2024-04-23T18:29:54.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.060+0000 7fb41f61f800 20 remove_watcher() i=6 2024-04-23T18:29:54.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.060+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94382716000432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730427de0 con 0x7fb41000f070 2024-04-23T18:29:54.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.061+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94382716000432] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb418040080 con 0x7fb41000f070 2024-04-23T18:29:54.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.061+0000 7fb41f61f800 20 remove_watcher() i=7 2024-04-23T18:29:54.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb41000f070 msgr2=0x7fb410013130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb41000f070 0x7fb410013130 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d730418290 msgr2=0x55d73041a750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d730418290 0x55d73041a750 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d73041cc80 msgr2=0x55d73041f070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d73041cc80 0x55d73041f070 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d730421630 msgr2=0x55d730423af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d730421630 0x55d730423af0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2e8036e60 msgr2=0x7fb2e8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2e8036e60 0x7fb2e8039320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb414055040 tx=0x7fb41404f000 comp rx=0 tx=0).stop 2024-04-23T18:29:54.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 msgr2=0x55d73040cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 0x55d73040cb40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb41001ba90 tx=0x7fb41001ff20 comp rx=0 tx=0).stop 2024-04-23T18:29:54.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41d926640 1 -- 172.21.15.119:0/1150829493 reap_dead start 2024-04-23T18:29:54.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 shutdown_connections 2024-04-23T18:29:54.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1150829493 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730405730 0x55d73040cb40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 >> 172.21.15.119:0/1150829493 conn(0x55d730401a50 msgr2=0x55d7303ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 shutdown_connections 2024-04-23T18:29:54.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/1150829493 wait complete. 2024-04-23T18:29:54.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/2452936411 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2f4036e60 msgr2=0x7fb2f4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 --2- 172.21.15.119:0/2452936411 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2f4036e60 0x7fb2f4039320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55d7303de2c0 tx=0x7fb414005ac0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/2452936411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7303f8600 msgr2=0x55d7303f8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 --2- 172.21.15.119:0/2452936411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7303f8600 0x55d7303f8a20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb410001640 tx=0x7fb410013df0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/2452936411 shutdown_connections 2024-04-23T18:29:54.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 --2- 172.21.15.119:0/2452936411 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2f4036e60 0x7fb2f4039320 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 --2- 172.21.15.119:0/2452936411 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7303f8600 0x55d7303f8a20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/2452936411 >> 172.21.15.119:0/2452936411 conn(0x55d7303ec6a0 msgr2=0x55d7303ecaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/2452936411 shutdown_connections 2024-04-23T18:29:54.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.062+0000 7fb41f61f800 1 -- 172.21.15.119:0/2452936411 wait complete. 2024-04-23T18:29:54.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d7303e75f0 msgr2=0x55d7303e9a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d7303e75f0 0x55d7303e9a40 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d7302e3590 msgr2=0x55d7303e0dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d7302e3590 0x55d7303e0dd0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d7303e36b0 msgr2=0x55d7303e5aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d7303e36b0 0x55d7303e5aa0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb304036e60 msgr2=0x7fb304039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb304036e60 0x7fb304039320 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb414054000 tx=0x7fb41404e000 comp rx=0 tx=0).stop 2024-04-23T18:29:54.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302dfa80 msgr2=0x55d7303d9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 --2- 172.21.15.119:0/1866658316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d7302dfa80 0x55d7303d9d60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb41000b700 tx=0x7fb410000bc0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41d926640 1 -- 172.21.15.119:0/1866658316 reap_dead start 2024-04-23T18:29:54.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 shutdown_connections 2024-04-23T18:29:54.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 >> 172.21.15.119:0/1866658316 conn(0x55d7302d9430 msgr2=0x55d7303cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 shutdown_connections 2024-04-23T18:29:54.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.063+0000 7fb41f61f800 1 -- 172.21.15.119:0/1866658316 wait complete. 2024-04-23T18:29:54.071 INFO:teuthology.orchestra.run.smithi119.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-23T18:29:54.071 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-23T18:29:54.073 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-04-23T18:29:54.091 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:54.152 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-23T18:29:54.153 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-23T18:29:54.153 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-23T18:29:54.153 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-23T18:29:54.153 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-23T18:29:54.153 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-23T18:29:54.153 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-04-23T18:29:54.197 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:54.197 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:54.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.205+0000 7fb30f536800 1 Processor -- start 2024-04-23T18:29:54.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.205+0000 7fb30f536800 1 -- start start 2024-04-23T18:29:54.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.205+0000 7fb30f536800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x563299705310 0x563299707700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.205+0000 7fb30f536800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5632995b2560 con 0x563299700e80 2024-04-23T18:29:54.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.205+0000 7fb30f536800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5632995a3e20 con 0x563299705310 2024-04-23T18:29:54.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.205+0000 7fb30aacb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x563299705310 0x563299707700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.205+0000 7fb30b2cc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x563299700e80 0x5632997012a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:43642/0 (socket says 172.21.15.119:43642) 2024-04-23T18:29:54.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.205+0000 7fb30b2cc640 1 -- 172.21.15.119:0/2411629274 learned_addr learned my addr 172.21.15.119:0/2411629274 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:54.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.206+0000 7fb30aacb640 1 -- 172.21.15.119:0/2411629274 >> v1:172.21.15.62:6789/0 conn(0x563299700e80 legacy=0x5632997012a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.206+0000 7fb30aacb640 1 -- 172.21.15.119:0/2411629274 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632995b1e60 con 0x563299705310 2024-04-23T18:29:54.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.207+0000 7fb30aacb640 1 --2- 172.21.15.119:0/2411629274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299705310 0x563299707700 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb30000a470 tx=0x7fb30001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4799aede571591c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.208+0000 7fb30a2ca640 1 -- 172.21.15.119:0/2411629274 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb300057070 con 0x563299705310 2024-04-23T18:29:54.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.208+0000 7fb30a2ca640 1 -- 172.21.15.119:0/2411629274 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb300052570 con 0x563299705310 2024-04-23T18:29:54.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.208+0000 7fb30a2ca640 1 -- 172.21.15.119:0/2411629274 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb300052870 con 0x563299705310 2024-04-23T18:29:54.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.208+0000 7fb30f536800 1 -- 172.21.15.119:0/2411629274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299705310 msgr2=0x563299707700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.208+0000 7fb30f536800 1 --2- 172.21.15.119:0/2411629274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299705310 0x563299707700 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb30000a470 tx=0x7fb30001ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:54.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.208+0000 7fb30f536800 1 -- 172.21.15.119:0/2411629274 shutdown_connections 2024-04-23T18:29:54.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.208+0000 7fb30f536800 1 --2- 172.21.15.119:0/2411629274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299705310 0x563299707700 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.208+0000 7fb30f536800 1 -- 172.21.15.119:0/2411629274 >> 172.21.15.119:0/2411629274 conn(0x5632996fc440 msgr2=0x5632996fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.208+0000 7fb30f536800 1 -- 172.21.15.119:0/2411629274 shutdown_connections 2024-04-23T18:29:54.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.208+0000 7fb30f536800 1 -- 172.21.15.119:0/2411629274 wait complete. 2024-04-23T18:29:54.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.220+0000 7fb30f536800 1 Processor -- start 2024-04-23T18:29:54.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.220+0000 7fb30f536800 1 -- start start 2024-04-23T18:29:54.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.220+0000 7fb30f536800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299700e80 0x563299674e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.220+0000 7fb30f536800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56329964d5d0 con 0x563299700e80 2024-04-23T18:29:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.220+0000 7fb30b2cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299700e80 0x563299674e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.220+0000 7fb30b2cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299700e80 0x563299674e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36248/0 (socket says 172.21.15.119:36248) 2024-04-23T18:29:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.220+0000 7fb30b2cc640 1 -- 172.21.15.119:0/3607698601 learned_addr learned my addr 172.21.15.119:0/3607698601 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.220+0000 7fb30b2cc640 1 -- 172.21.15.119:0/3607698601 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632995c3860 con 0x563299700e80 2024-04-23T18:29:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.221+0000 7fb30b2cc640 1 --2- 172.21.15.119:0/3607698601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299700e80 0x563299674e80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb304001610 tx=0x7fb304001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9f04c53968d2a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.221+0000 7fb1f960a640 1 -- 172.21.15.119:0/3607698601 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb304004520 con 0x563299700e80 2024-04-23T18:29:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.221+0000 7fb1f960a640 1 -- 172.21.15.119:0/3607698601 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3040046c0 con 0x563299700e80 2024-04-23T18:29:54.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.221+0000 7fb1f960a640 1 -- 172.21.15.119:0/3607698601 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb304004a20 con 0x563299700e80 2024-04-23T18:29:54.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.221+0000 7fb30f536800 1 -- 172.21.15.119:0/3607698601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299700e80 msgr2=0x563299674e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.221+0000 7fb30f536800 1 --2- 172.21.15.119:0/3607698601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299700e80 0x563299674e80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb304001610 tx=0x7fb304001ad0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.221+0000 7fb30f536800 1 -- 172.21.15.119:0/3607698601 shutdown_connections 2024-04-23T18:29:54.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.221+0000 7fb30f536800 1 --2- 172.21.15.119:0/3607698601 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299700e80 0x563299674e80 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.221+0000 7fb30f536800 1 -- 172.21.15.119:0/3607698601 >> 172.21.15.119:0/3607698601 conn(0x5632996fc440 msgr2=0x5632997ed9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.221+0000 7fb30f536800 1 -- 172.21.15.119:0/3607698601 shutdown_connections 2024-04-23T18:29:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.221+0000 7fb30f536800 1 -- 172.21.15.119:0/3607698601 wait complete. 2024-04-23T18:29:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.222+0000 7fb30f536800 1 Processor -- start 2024-04-23T18:29:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.222+0000 7fb30f536800 1 -- start start 2024-04-23T18:29:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.222+0000 7fb30f536800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299700e80 0x5632997fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.222+0000 7fb30f536800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563299707fd0 con 0x563299700e80 2024-04-23T18:29:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.222+0000 7fb30b2cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299700e80 0x5632997fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.222+0000 7fb30b2cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299700e80 0x5632997fabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36264/0 (socket says 172.21.15.119:36264) 2024-04-23T18:29:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.222+0000 7fb30b2cc640 1 -- 172.21.15.119:0/3742731964 learned_addr learned my addr 172.21.15.119:0/3742731964 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.222+0000 7fb30b2cc640 1 -- 172.21.15.119:0/3742731964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632995c1eb0 con 0x563299700e80 2024-04-23T18:29:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.223+0000 7fb30b2cc640 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299700e80 0x5632997fabc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb304001b10 tx=0x7fb304000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.223+0000 7fb1f7e07640 1 -- 172.21.15.119:0/3742731964 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb304022030 con 0x563299700e80 2024-04-23T18:29:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.223+0000 7fb1f7e07640 1 -- 172.21.15.119:0/3742731964 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb304019040 con 0x563299700e80 2024-04-23T18:29:54.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.223+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632997fb100 con 0x563299700e80 2024-04-23T18:29:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.223+0000 7fb1f7e07640 1 -- 172.21.15.119:0/3742731964 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3040042c0 con 0x563299700e80 2024-04-23T18:29:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.223+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632997fb5c0 con 0x563299700e80 2024-04-23T18:29:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.224+0000 7fb1f7e07640 1 -- 172.21.15.119:0/3742731964 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb304025070 con 0x563299700e80 2024-04-23T18:29:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.224+0000 7fb1f7e07640 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1f0036e60 0x7fb1f0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.224+0000 7fb1f7e07640 1 -- 172.21.15.119:0/3742731964 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb304023070 con 0x563299700e80 2024-04-23T18:29:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.224+0000 7fb30aacb640 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1f0036e60 0x7fb1f0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.224+0000 7fb30f536800 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563299705310 0x563299801b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.224+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299802180 con 0x563299705310 2024-04-23T18:29:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.224+0000 7fb30bacd640 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563299705310 0x563299801b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.224+0000 7fb30aacb640 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1f0036e60 0x7fb1f0039320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb300054000 tx=0x7fb30004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.224+0000 7fb30bacd640 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563299705310 0x563299801b60 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.225+0000 7fb30bacd640 1 -- 172.21.15.119:0/3742731964 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299705310 2024-04-23T18:29:54.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.225+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632997ff1e0 con 0x563299705310 2024-04-23T18:29:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.225+0000 7fb30bacd640 1 -- 172.21.15.119:0/3742731964 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299705310 2024-04-23T18:29:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.225+0000 7fb30f536800 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563299804490 0x563299806880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.225+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299806f70 con 0x563299804490 2024-04-23T18:29:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.225+0000 7fb30b2cc640 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563299804490 0x563299806880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.225+0000 7fb30b2cc640 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563299804490 0x563299806880 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.226+0000 7fb30b2cc640 1 -- 172.21.15.119:0/3742731964 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb30400f030 con 0x563299804490 2024-04-23T18:29:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.226+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299803440 con 0x563299705310 2024-04-23T18:29:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.226+0000 7fb30bacd640 1 -- 172.21.15.119:0/3742731964 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299705310 2024-04-23T18:29:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.226+0000 7fb30f536800 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5632998083d0 0x56329980a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.226+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329980afa0 con 0x5632998083d0 2024-04-23T18:29:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.226+0000 7fb30aacb640 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5632998083d0 0x56329980a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.222 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.226+0000 7fb30aacb640 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5632998083d0 0x56329980a840 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.223 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.227+0000 7fb30aacb640 1 -- 172.21.15.119:0/3742731964 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb300052980 con 0x5632998083d0 2024-04-23T18:29:54.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.227+0000 7fb30f536800 1 Processor -- start 2024-04-23T18:29:54.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.227+0000 7fb30f536800 1 -- start start 2024-04-23T18:29:54.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.227+0000 7fb30f536800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299819380 0x5632998197a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.227+0000 7fb30f536800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5632995f3df0 con 0x563299819380 2024-04-23T18:29:54.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.227+0000 7fb30b2cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299819380 0x5632998197a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.227+0000 7fb30b2cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299819380 0x5632998197a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36278/0 (socket says 172.21.15.119:36278) 2024-04-23T18:29:54.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.227+0000 7fb30b2cc640 1 -- 172.21.15.119:0/1128391454 learned_addr learned my addr 172.21.15.119:0/1128391454 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.228+0000 7fb30b2cc640 1 -- 172.21.15.119:0/1128391454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563299819ce0 con 0x563299819380 2024-04-23T18:29:54.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.228+0000 7fb30b2cc640 1 --2- 172.21.15.119:0/1128391454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299819380 0x5632998197a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb30401ee70 tx=0x7fb304011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.228+0000 7fb1f5602640 1 -- 172.21.15.119:0/1128391454 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb304044530 con 0x563299819380 2024-04-23T18:29:54.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.228+0000 7fb1f5602640 1 -- 172.21.15.119:0/1128391454 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3040446d0 con 0x563299819380 2024-04-23T18:29:54.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.228+0000 7fb30f536800 1 -- 172.21.15.119:0/1128391454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56329981a750 con 0x563299819380 2024-04-23T18:29:54.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.228+0000 7fb1f5602640 1 -- 172.21.15.119:0/1128391454 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb304044ab0 con 0x563299819380 2024-04-23T18:29:54.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.228+0000 7fb30f536800 1 -- 172.21.15.119:0/1128391454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56329981a750 con 0x563299819380 2024-04-23T18:29:54.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.229+0000 7fb1f5602640 1 -- 172.21.15.119:0/1128391454 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb304010070 con 0x563299819380 2024-04-23T18:29:54.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.229+0000 7fb1f5602640 1 --2- 172.21.15.119:0/1128391454 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1e4036e60 0x7fb1e4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.229+0000 7fb1f5602640 1 -- 172.21.15.119:0/1128391454 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb30403bd40 con 0x563299819380 2024-04-23T18:29:54.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.229+0000 7fb30aacb640 1 --2- 172.21.15.119:0/1128391454 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1e4036e60 0x7fb1e4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.229+0000 7fb30f536800 1 Processor -- start 2024-04-23T18:29:54.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.229+0000 7fb30f536800 1 -- start start 2024-04-23T18:29:54.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.229+0000 7fb30aacb640 1 --2- 172.21.15.119:0/1128391454 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1e4036e60 0x7fb1e4039320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x563299802a40 tx=0x7fb300005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.229+0000 7fb30f536800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 0x563299826780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.229+0000 7fb30f536800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5632997f6040 con 0x563299826380 2024-04-23T18:29:54.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.229+0000 7fb30b2cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 0x563299826780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.229+0000 7fb30b2cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 0x563299826780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36282/0 (socket says 172.21.15.119:36282) 2024-04-23T18:29:54.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.229+0000 7fb30b2cc640 1 -- 172.21.15.119:0/2876357754 learned_addr learned my addr 172.21.15.119:0/2876357754 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.230+0000 7fb30b2cc640 1 -- 172.21.15.119:0/2876357754 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563299826d50 con 0x563299826380 2024-04-23T18:29:54.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.230+0000 7fb30b2cc640 1 --2- 172.21.15.119:0/2876357754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 0x563299826780 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb30401efd0 tx=0x7fb304026d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce7314fa910906d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.230+0000 7fb1eeffd640 1 -- 172.21.15.119:0/2876357754 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb304012a20 con 0x563299826380 2024-04-23T18:29:54.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.230+0000 7fb1eeffd640 1 -- 172.21.15.119:0/2876357754 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb30405d070 con 0x563299826380 2024-04-23T18:29:54.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.230+0000 7fb1eeffd640 1 -- 172.21.15.119:0/2876357754 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3040266f0 con 0x563299826380 2024-04-23T18:29:54.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.230+0000 7fb30f536800 1 -- 172.21.15.119:0/2876357754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 msgr2=0x563299826780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.230+0000 7fb30f536800 1 --2- 172.21.15.119:0/2876357754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 0x563299826780 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb30401efd0 tx=0x7fb304026d10 comp rx=0 tx=0).stop 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.230+0000 7fb30f536800 1 -- 172.21.15.119:0/2876357754 shutdown_connections 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.230+0000 7fb30f536800 1 --2- 172.21.15.119:0/2876357754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 0x563299826780 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.230+0000 7fb30f536800 1 -- 172.21.15.119:0/2876357754 >> 172.21.15.119:0/2876357754 conn(0x563299822650 msgr2=0x5632998206b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.230+0000 7fb30f536800 1 -- 172.21.15.119:0/2876357754 shutdown_connections 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.230+0000 7fb30f536800 1 -- 172.21.15.119:0/2876357754 wait complete. 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.231+0000 7fb30f536800 1 Processor -- start 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.231+0000 7fb30f536800 1 -- start start 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.231+0000 7fb30f536800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 0x56329982d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.231+0000 7fb30f536800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5632998272c0 con 0x563299826380 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.231+0000 7fb30b2cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 0x56329982d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.231+0000 7fb30b2cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 0x56329982d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36298/0 (socket says 172.21.15.119:36298) 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.231+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 learned_addr learned my addr 172.21.15.119:0/317169552 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.231+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56329982da70 con 0x563299826380 2024-04-23T18:29:54.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.231+0000 7fb30b2cc640 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 0x56329982d530 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb30404be80 tx=0x7fb30403dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.232+0000 7fb1ed7fa640 1 -- 172.21.15.119:0/317169552 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb30406c020 con 0x563299826380 2024-04-23T18:29:54.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.232+0000 7fb1ed7fa640 1 -- 172.21.15.119:0/317169552 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb304030b00 con 0x563299826380 2024-04-23T18:29:54.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.232+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56329982da70 con 0x563299826380 2024-04-23T18:29:54.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.232+0000 7fb1ed7fa640 1 -- 172.21.15.119:0/317169552 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb30403f3a0 con 0x563299826380 2024-04-23T18:29:54.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.232+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56329982da70 con 0x563299826380 2024-04-23T18:29:54.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.232+0000 7fb1ed7fa640 1 -- 172.21.15.119:0/317169552 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb30406f020 con 0x563299826380 2024-04-23T18:29:54.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.233+0000 7fb1ed7fa640 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1d4036e60 0x7fb1d4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.233+0000 7fb1ed7fa640 1 -- 172.21.15.119:0/317169552 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb304072d10 con 0x563299826380 2024-04-23T18:29:54.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.233+0000 7fb30aacb640 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1d4036e60 0x7fb1d4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.233+0000 7fb30aacb640 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1d4036e60 0x7fb1d4039320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb30001ced0 tx=0x7fb30004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.233+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.233+0000 7fb30f536800 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563299838b70 0x56329983b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.233+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329983b780 con 0x563299838b70 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.233+0000 7fb30bacd640 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563299838b70 0x56329983b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30bacd640 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563299838b70 0x56329983b030 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30f536800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30f536800 20 realm 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329983bbb0 con 0x563299838b70 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30f536800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30f536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299838b70 2024-04-23T18:29:54.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30f536800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.234+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329983c820 con 0x563299838b70 2024-04-23T18:29:54.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.235+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.235+0000 7fb30f536800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:54.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.235+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.235+0000 7fb30f536800 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56329983d1e0 0x56329983f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.235+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329983fbe0 con 0x56329983d1e0 2024-04-23T18:29:54.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.235+0000 7fb30b2cc640 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56329983d1e0 0x56329983f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.235+0000 7fb30b2cc640 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56329983d1e0 0x56329983f5d0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.235+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb30400f030 con 0x56329983d1e0 2024-04-23T18:29:54.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.235+0000 7fb30f536800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:54.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.235+0000 7fb30f536800 20 searching for the correct realm 2024-04-23T18:29:54.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.235+0000 7fb30f536800 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563299841b70 0x563299844030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.235+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563299844700 con 0x563299841b70 2024-04-23T18:29:54.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.235+0000 7fb30aacb640 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563299841b70 0x563299844030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.236+0000 7fb30aacb640 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563299841b70 0x563299844030 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.236+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.236+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563299844700 con 0x56329983d1e0 2024-04-23T18:29:54.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.236+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb30400f030 con 0x56329983d1e0 2024-04-23T18:29:54.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.236+0000 7fb30b2cc640 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb304071020 0x7fb304064850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.236+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563299844700 con 0x7fb304071020 2024-04-23T18:29:54.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.237+0000 7fb30bacd640 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb304071020 0x7fb304064850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.237+0000 7fb30bacd640 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb304071020 0x7fb304064850 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.237+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.237+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299838b70 2024-04-23T18:29:54.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.237+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.237+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299838b70 2024-04-23T18:29:54.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.238+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.238+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x7fb304071020 2024-04-23T18:29:54.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.238+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.238+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x7fb304071020 2024-04-23T18:29:54.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.238+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.238+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x56329983d1e0 2024-04-23T18:29:54.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.238+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb30400f030 con 0x56329983d1e0 2024-04-23T18:29:54.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.238+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299841b70 2024-04-23T18:29:54.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.239+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.239+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299838b70 2024-04-23T18:29:54.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.239+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.239+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x7fb304071020 2024-04-23T18:29:54.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.239+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.239+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299838b70 2024-04-23T18:29:54.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.239+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.239+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x56329983d1e0 2024-04-23T18:29:54.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.240+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb30400f030 con 0x56329983d1e0 2024-04-23T18:29:54.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.240+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299841b70 2024-04-23T18:29:54.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.240+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.240+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299841b70 2024-04-23T18:29:54.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.240+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.240+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x7fb304071020 2024-04-23T18:29:54.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.240+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.240+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299841b70 2024-04-23T18:29:54.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.241+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.241+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299841b70 2024-04-23T18:29:54.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.241+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.241+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299838b70 2024-04-23T18:29:54.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.241+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.241+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299838b70 2024-04-23T18:29:54.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.241+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.241+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x7fb304071020 2024-04-23T18:29:54.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.242+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.242+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299841b70 2024-04-23T18:29:54.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.242+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.242+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x56329983d1e0 2024-04-23T18:29:54.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.242+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb30400f030 con 0x56329983d1e0 2024-04-23T18:29:54.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.242+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299838b70 2024-04-23T18:29:54.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.243+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.243+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x56329983d1e0 2024-04-23T18:29:54.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.243+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb30400f030 con 0x56329983d1e0 2024-04-23T18:29:54.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.243+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299841b70 2024-04-23T18:29:54.251 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.243+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.243+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x7fb304071020 2024-04-23T18:29:54.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.244+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.244+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x56329983d1e0 2024-04-23T18:29:54.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.244+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.244+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299841b70 2024-04-23T18:29:54.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.244+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.244+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x7fb304071020 2024-04-23T18:29:54.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.244+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.244+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x563299838b70 2024-04-23T18:29:54.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56329983c480 con 0x56329983d1e0 2024-04-23T18:29:54.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:54.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:54.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:54.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:54.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:54.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:54.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329983ff80 con 0x563299838b70 2024-04-23T18:29:54.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299840370 con 0x563299838b70 2024-04-23T18:29:54.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:54.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.245+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299840370 con 0x7fb304071020 2024-04-23T18:29:54.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:54.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 20 zone default found 2024-04-23T18:29:54.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 4 Realm: () 2024-04-23T18:29:54.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:54.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:54.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:54.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 20 zonegroup default 2024-04-23T18:29:54.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632998410b0 con 0x56329983d1e0 2024-04-23T18:29:54.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632998465f0 con 0x563299841b70 2024-04-23T18:29:54.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299846a10 con 0x563299841b70 2024-04-23T18:29:54.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.246+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.247+0000 7fb30f536800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.247+0000 7fb30f536800 20 started sync module instance, tier type = 2024-04-23T18:29:54.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.247+0000 7fb30f536800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:54.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.247+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299845a00 con 0x56329983d1e0 2024-04-23T18:29:54.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.248+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.248+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94775323942384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299846210 con 0x56329983d1e0 2024-04-23T18:29:54.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.248+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299847940 con 0x563299838b70 2024-04-23T18:29:54.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.249+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94775323942384] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.249+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.249+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94775323948176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299847d60 con 0x563299838b70 2024-04-23T18:29:54.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.249+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299848760 con 0x563299841b70 2024-04-23T18:29:54.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.250+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94775323948176] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.250+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.250+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94775323949232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299847cd0 con 0x563299841b70 2024-04-23T18:29:54.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.250+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299849620 con 0x56329983d1e0 2024-04-23T18:29:54.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.251+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94775323949232] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.251+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.251+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94775323955568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299849a40 con 0x56329983d1e0 2024-04-23T18:29:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.251+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329984a400 con 0x563299838b70 2024-04-23T18:29:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.252+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.252+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94775323955568] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.252+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94775323957168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329984a400 con 0x563299838b70 2024-04-23T18:29:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.252+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329984ae10 con 0x7fb304071020 2024-04-23T18:29:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.253+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.253+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94775323961696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329984ad80 con 0x7fb304071020 2024-04-23T18:29:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.253+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94775323957168] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.253+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329984bd70 con 0x7fb304071020 2024-04-23T18:29:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.254+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(56 notify.6 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.254+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94775323959200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329984bd70 con 0x7fb304071020 2024-04-23T18:29:54.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.254+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329984c770 con 0x7fb304071020 2024-04-23T18:29:54.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.254+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94775323961696] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.255+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94775323959200] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.255+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.255+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94775323965520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329984c280 con 0x7fb304071020 2024-04-23T18:29:54.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.255+0000 7fb30f536800 20 add_watcher() i=0 2024-04-23T18:29:54.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.255+0000 7fb30f536800 20 add_watcher() i=1 2024-04-23T18:29:54.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.255+0000 7fb30f536800 20 add_watcher() i=2 2024-04-23T18:29:54.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.255+0000 7fb30f536800 20 add_watcher() i=3 2024-04-23T18:29:54.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.255+0000 7fb30f536800 20 add_watcher() i=4 2024-04-23T18:29:54.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.255+0000 7fb30f536800 20 add_watcher() i=5 2024-04-23T18:29:54.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.255+0000 7fb30f536800 20 add_watcher() i=6 2024-04-23T18:29:54.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.256+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94775323965520] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.256+0000 7fb30f536800 20 add_watcher() i=7 2024-04-23T18:29:54.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.256+0000 7fb30f536800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:54.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.256+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329984f760 con 0x563299838b70 2024-04-23T18:29:54.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.256+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.256+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94775323968128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329984cc60 con 0x563299838b70 2024-04-23T18:29:54.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.257+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94775323968128] v34'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.257+0000 7fb1c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:54.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.258+0000 7fb30f536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:54.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.258+0000 7fb30f536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:54.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.258+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329984f5e0 con 0x563299838b70 2024-04-23T18:29:54.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.259+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.259+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299858980 con 0x7fb304071020 2024-04-23T18:29:54.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.260+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.260+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299858e30 con 0x563299841b70 2024-04-23T18:29:54.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.261+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.261+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299859680 con 0x563299838b70 2024-04-23T18:29:54.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.262+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'184 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.262+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299859a40 con 0x56329983d1e0 2024-04-23T18:29:54.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.263+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.263+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299859a40 con 0x563299841b70 2024-04-23T18:29:54.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.264+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.264+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329985a540 con 0x563299838b70 2024-04-23T18:29:54.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.265+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.265+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329985a540 con 0x7fb304071020 2024-04-23T18:29:54.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.266+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.266+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329985a540 con 0x56329983d1e0 2024-04-23T18:29:54.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.267+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.267+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329985a540 con 0x563299841b70 2024-04-23T18:29:54.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.268+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.268+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857e20 con 0x56329983d1e0 2024-04-23T18:29:54.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.269+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.269+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857e20 con 0x7fb304071020 2024-04-23T18:29:54.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.270+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.270+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857e20 con 0x56329983d1e0 2024-04-23T18:29:54.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.271+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.271+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x7fb304071020 2024-04-23T18:29:54.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.272+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.272+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x563299838b70 2024-04-23T18:29:54.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.273+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'185 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.273+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x563299841b70 2024-04-23T18:29:54.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.274+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'56 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.274+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x56329983d1e0 2024-04-23T18:29:54.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.275+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.275+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x563299841b70 2024-04-23T18:29:54.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.276+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.276+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x563299838b70 2024-04-23T18:29:54.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.277+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.277+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x563299838b70 2024-04-23T18:29:54.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.278+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'186 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.278+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x563299841b70 2024-04-23T18:29:54.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.279+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'57 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.279+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x56329983d1e0 2024-04-23T18:29:54.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.280+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.280+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x563299841b70 2024-04-23T18:29:54.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.281+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.281+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x563299841b70 2024-04-23T18:29:54.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.282+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.282+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x563299841b70 2024-04-23T18:29:54.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.283+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.283+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x563299841b70 2024-04-23T18:29:54.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.284+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.284+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x7fb304071020 2024-04-23T18:29:54.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.285+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.285+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x563299841b70 2024-04-23T18:29:54.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.286+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.286+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x7fb304071020 2024-04-23T18:29:54.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.287+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'43 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.287+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x563299841b70 2024-04-23T18:29:54.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.288+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'58 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.288+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x7fb304071020 2024-04-23T18:29:54.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.289+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.289+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299857c50 con 0x56329983d1e0 2024-04-23T18:29:54.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.290+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.290+0000 7fb1c0fe1640 20 reqs_thread_entry: start 2024-04-23T18:29:54.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.290+0000 7fb30f536800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:54.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.290+0000 7fb30f536800 20 Filter name: none 2024-04-23T18:29:54.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.290+0000 7fb13a7fc640 20 reqs_thread_entry: start 2024-04-23T18:29:54.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.290+0000 7fb30f536800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-23T18:29:54.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.290+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.290+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299885ba0 con 0x56329983d1e0 2024-04-23T18:29:54.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30f536800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:29:54.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30f536800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-23T18:29:54.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30f536800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:29:54.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30f536800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 : miss 2024-04-23T18:29:54.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:95 8.e 8:709d5331:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632998875d0 con 0x7fb304071020 2024-04-23T18:29:54.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(95 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30f536800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:29:54.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30f536800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 info.flags=0x17 2024-04-23T18:29:54.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30f536800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 to cache LRU end 2024-04-23T18:29:54.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30f536800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:54.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30f536800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:29:54.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30f536800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 2024-04-23T18:29:54.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.291+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:96 4.c 4:31a01eb7:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904cb0 con 0x563299838b70 2024-04-23T18:29:54.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.292+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(96 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.292+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:97 4.17 4:eb812bf6:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904cb0 con 0x7fb304071020 2024-04-23T18:29:54.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.292+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(97 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.292+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:98 4.2f 4:f5cd785b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904cb0 con 0x563299838b70 2024-04-23T18:29:54.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.293+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(98 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.2 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.293+0000 7fb30f536800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-04-23T18:29:54.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.293+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:99 4.21 4:859a5a2b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904cb0 con 0x7fb304071020 2024-04-23T18:29:54.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.293+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(99 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2fc0083e0 con 0x7fb304071020 2024-04-23T18:29:54.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.293+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:100 4.28 4:15c1bb38:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904cf0 con 0x563299838b70 2024-04-23T18:29:54.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.293+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(100 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.293+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:101 4.19 4:9a8e0a1b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904cf0 con 0x563299841b70 2024-04-23T18:29:54.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.294+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(101 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.294+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:102 4.b 4:d3f0904b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904cf0 con 0x56329983d1e0 2024-04-23T18:29:54.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.294+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(102 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.6 [call out=426b] v0'0 uv7 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.294+0000 7fb30f536800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-04-23T18:29:54.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.294+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:103 4.0 4:015f5000:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904cf0 con 0x563299841b70 2024-04-23T18:29:54.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.294+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(103 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.7 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.295+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:104 4.1 4:82ba6ec4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904cf0 con 0x56329983d1e0 2024-04-23T18:29:54.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.295+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== osd_op_reply(104 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.8 [call out=424b] v0'0 uv9 ondisk = 0) ==== 194+0+424 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.295+0000 7fb30f536800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-04-23T18:29:54.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.295+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:105 4.8 4:10040a41:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904d10 con 0x563299841b70 2024-04-23T18:29:54.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.295+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 28 ==== osd_op_reply(105 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.295+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:106 4.10 4:0aba0da8:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904d10 con 0x563299841b70 2024-04-23T18:29:54.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.295+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 29 ==== osd_op_reply(106 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10 [call out=698b] v0'0 uv9 ondisk = 0) ==== 195+0+698 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.295+0000 7fb30f536800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-04-23T18:29:54.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.295+0000 7fb30f536800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-04-23T18:29:54.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.295+0000 7fb30f536800 20 get_obj_state: octx=0x7fb2fc008ce0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x563299904188 s->prefetch_data=0 2024-04-23T18:29:54.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.296+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:107 3.28s0 3:176b90f2:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299902680 con 0x563299841b70 2024-04-23T18:29:54.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.296+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 30 ==== osd_op_reply(107 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.296+0000 7fb30f536800 10 manifest: total_size = 6 2024-04-23T18:29:54.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.296+0000 7fb30f536800 20 get_obj_state: setting s->obj_tag to b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.1131837648492454706 2024-04-23T18:29:54.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.296+0000 7fb30f536800 20 get_obj_state: octx=0x7fb2fc008ce0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x563299904188 s->prefetch_data=0 2024-04-23T18:29:54.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.296+0000 7fb30f536800 20 prepare_atomic_modification: state is not atomic. state=0x563299904188 2024-04-23T18:29:54.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.296+0000 7fb30f536800 20 bucket index object: :.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.2 2024-04-23T18:29:54.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.296+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:108 4.2f 4:f5cd785b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329988c5b0 con 0x563299838b70 2024-04-23T18:29:54.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.297+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(108 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.2 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.297+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:109 3.28s0 3:176b90f2:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329988c5b0 con 0x563299841b70 2024-04-23T18:29:54.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.298+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 31 ==== osd_op_reply(109 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_9c8454ddf7aa50116496bac348d7550d [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.298+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:110 4.2f 4:f5cd785b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329988d040 con 0x563299838b70 2024-04-23T18:29:54.298 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.298+0000 7fb30f536800 20 get_obj_state: octx=0x7fb2fc008ce0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x563299904188 s->prefetch_data=0 2024-04-23T18:29:54.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.298+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:111 3.17s0 3:ebf42d99:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299902ce0 con 0x563299838b70 2024-04-23T18:29:54.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.299+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(111 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.299+0000 7fb30f536800 10 manifest: total_size = 3 2024-04-23T18:29:54.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.299+0000 7fb30f536800 20 get_obj_state: setting s->obj_tag to b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.13306627764191372415 2024-04-23T18:29:54.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.299+0000 7fb30f536800 20 get_obj_state: octx=0x7fb2fc008ce0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x563299904188 s->prefetch_data=0 2024-04-23T18:29:54.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.299+0000 7fb30f536800 20 prepare_atomic_modification: state is not atomic. state=0x563299904188 2024-04-23T18:29:54.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.299+0000 7fb30f536800 20 bucket index object: :.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.6 2024-04-23T18:29:54.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.299+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:112 4.b 4:d3f0904b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329988d040 con 0x56329983d1e0 2024-04-23T18:29:54.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.299+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(110 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.2 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb2fc0083e0 con 0x563299838b70 2024-04-23T18:29:54.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.299+0000 7fb1eeffd640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-04-23T18:29:54.299 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.300+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 24 ==== osd_op_reply(112 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.6 [stat,call,call] v34'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.300+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:113 3.17s0 3:ebf42d99:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329988d040 con 0x563299838b70 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.301+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(113 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_b1b9a972ccd8c962a473909b97007eb4 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x563299838b70 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.301+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:114 4.b 4:d3f0904b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329988dcc0 con 0x56329983d1e0 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.301+0000 7fb30f536800 20 get_obj_state: octx=0x7fb2fc008ce0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x563299904188 s->prefetch_data=0 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.301+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:115 3.3fs0 3:fcb3c4ce:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329988e840 con 0x56329983d1e0 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.302+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 25 ==== osd_op_reply(115 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+891 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.302+0000 7fb30f536800 10 manifest: total_size = 4 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.302+0000 7fb30f536800 20 get_obj_state: setting s->obj_tag to b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.160142467480733196 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.302+0000 7fb30f536800 20 get_obj_state: octx=0x7fb2fc008ce0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x563299904188 s->prefetch_data=0 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.302+0000 7fb30f536800 20 prepare_atomic_modification: state is not atomic. state=0x563299904188 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.302+0000 7fb30f536800 20 bucket index object: :.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.8 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.302+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:116 4.1 4:82ba6ec4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329988dcc0 con 0x56329983d1e0 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.303+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 26 ==== osd_op_reply(114 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.6 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.300 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.303+0000 7fb1ee7fc640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-04-23T18:29:54.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.303+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 27 ==== osd_op_reply(116 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.8 [stat,call,call] v34'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.303+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:117 3.3fs0 3:fcb3c4ce:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329988dcc0 con 0x56329983d1e0 2024-04-23T18:29:54.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.304+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 28 ==== osd_op_reply(117 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.304+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:118 4.1 4:82ba6ec4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329988dc40 con 0x56329983d1e0 2024-04-23T18:29:54.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.304+0000 7fb30f536800 20 get_obj_state: octx=0x7fb2fc008ce0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x563299904188 s->prefetch_data=0 2024-04-23T18:29:54.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.304+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:119 3.39s0 3:9d99d62f:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329988dc40 con 0x563299841b70 2024-04-23T18:29:54.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.304+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 32 ==== osd_op_reply(119 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.304+0000 7fb30f536800 10 manifest: total_size = 5 2024-04-23T18:29:54.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.304+0000 7fb30f536800 20 get_obj_state: setting s->obj_tag to b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11517602537227105532 2024-04-23T18:29:54.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.304+0000 7fb30f536800 20 get_obj_state: octx=0x7fb2fc008ce0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x563299904188 s->prefetch_data=0 2024-04-23T18:29:54.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.304+0000 7fb30f536800 20 prepare_atomic_modification: state is not atomic. state=0x563299904188 2024-04-23T18:29:54.301 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.304+0000 7fb30f536800 20 bucket index object: :.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10 2024-04-23T18:29:54.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.304+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:120 4.10 4:0aba0da8:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632998933c0 con 0x563299841b70 2024-04-23T18:29:54.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.305+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 29 ==== osd_op_reply(118 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.8 [stat,call,call] v34'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.305+0000 7fb1eeffd640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-04-23T18:29:54.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.306+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 33 ==== osd_op_reply(120 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10 [stat,call,call] v34'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.302 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.306+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:121 3.39s0 3:9d99d62f:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632998923b0 con 0x563299841b70 2024-04-23T18:29:54.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.307+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 34 ==== osd_op_reply(121 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_24d27c169c2c881eb09a065116f2aa5c [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.307+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:122 4.10 4:0aba0da8:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299893310 con 0x563299841b70 2024-04-23T18:29:54.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.307+0000 7fb30f536800 20 get_obj_state: octx=0x7fb2fc008ce0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x563299904188 s->prefetch_data=0 2024-04-23T18:29:54.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.307+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:123 3.as0 3:5165f270:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299893310 con 0x563299841b70 2024-04-23T18:29:54.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.307+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 35 ==== osd_op_reply(123 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.307+0000 7fb30f536800 10 manifest: total_size = 5 2024-04-23T18:29:54.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.307+0000 7fb30f536800 20 get_obj_state: setting s->obj_tag to _oR-lHqJ1IS1KyVnEtQ6nlidoKlJDtm4 2024-04-23T18:29:54.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.307+0000 7fb30f536800 20 get_obj_state: octx=0x7fb2fc008ce0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x563299904188 s->prefetch_data=0 2024-04-23T18:29:54.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.307+0000 7fb30f536800 20 prepare_atomic_modification: state is not atomic. state=0x563299904188 2024-04-23T18:29:54.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.307+0000 7fb30f536800 20 bucket index object: :.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10 2024-04-23T18:29:54.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.307+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:124 4.10 4:0aba0da8:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889510 con 0x563299841b70 2024-04-23T18:29:54.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.308+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 36 ==== osd_op_reply(122 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10 [stat,call,call] v34'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.308+0000 7fb1ee7fc640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-04-23T18:29:54.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.309+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 37 ==== osd_op_reply(124 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10 [stat,call,call] v34'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.309+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:125 3.as0 3:5165f270:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889af0 con 0x563299841b70 2024-04-23T18:29:54.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.310+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 38 ==== osd_op_reply(125 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5_bb3aec0fdcdbc2974890f805c585d432 [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.310+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:126 4.10 4:0aba0da8:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889510 con 0x563299841b70 2024-04-23T18:29:54.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.310+0000 7fb30f536800 20 list_objects_ordered: starting attempt 1 2024-04-23T18:29:54.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.310+0000 7fb30f536800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-23T18:29:54.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.310+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:127 4.c 4:31a01eb7:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299889510 con 0x563299838b70 2024-04-23T18:29:54.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.310+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:128 4.17 4:eb812bf6:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299903fa0 con 0x7fb304071020 2024-04-23T18:29:54.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.310+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:129 4.2f 4:f5cd785b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299896990 con 0x563299838b70 2024-04-23T18:29:54.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.310+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:130 4.21 4:859a5a2b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299899280 con 0x7fb304071020 2024-04-23T18:29:54.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.310+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:131 4.28 4:15c1bb38:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329989bb70 con 0x563299838b70 2024-04-23T18:29:54.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.310+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:132 4.19 4:9a8e0a1b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329989e4d0 con 0x563299841b70 2024-04-23T18:29:54.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.310+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:133 4.b 4:d3f0904b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299899280 con 0x56329983d1e0 2024-04-23T18:29:54.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.310+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:134 4.0 4:015f5000:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632998a3300 con 0x563299841b70 2024-04-23T18:29:54.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.311+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 30 ==== osd_op_reply(133 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.6 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.311+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:135 4.1 4:82ba6ec4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632998a37c0 con 0x56329983d1e0 2024-04-23T18:29:54.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.311+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(128 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.311+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 39 ==== osd_op_reply(132 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.311+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(130 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.311+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 40 ==== osd_op_reply(134 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.7 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.311+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:136 4.8 4:10040a41:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632998a3300 con 0x563299841b70 2024-04-23T18:29:54.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.311+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:137 4.10 4:0aba0da8:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329989c000 con 0x563299841b70 2024-04-23T18:29:54.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.311+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 34 ==== osd_op_reply(129 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb2fc043040 con 0x563299838b70 2024-04-23T18:29:54.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.311+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 35 ==== osd_op_reply(127 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2fc043040 con 0x563299838b70 2024-04-23T18:29:54.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.311+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 41 ==== osd_op_reply(136 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.311+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 31 ==== osd_op_reply(135 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.8 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.311+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 36 ==== osd_op_reply(131 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2fc043040 con 0x563299838b70 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 42 ==== osd_op_reply(126 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb1eeffd640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 43 ==== osd_op_reply(137 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5])"; uploads.size()=0; is_truncated=0 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:138 4.c 4:31a01eb7:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329989c000 con 0x563299838b70 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:139 4.17 4:eb812bf6:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904320 con 0x7fb304071020 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:140 4.2f 4:f5cd785b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904750 con 0x563299838b70 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:141 4.21 4:859a5a2b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299899880 con 0x7fb304071020 2024-04-23T18:29:54.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:142 4.28 4:15c1bb38:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329989c000 con 0x563299838b70 2024-04-23T18:29:54.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:143 4.19 4:9a8e0a1b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904750 con 0x563299841b70 2024-04-23T18:29:54.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:144 4.b 4:d3f0904b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329989c000 con 0x56329983d1e0 2024-04-23T18:29:54.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:145 4.0 4:015f5000:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904750 con 0x563299841b70 2024-04-23T18:29:54.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:146 4.1 4:82ba6ec4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56329989c000 con 0x56329983d1e0 2024-04-23T18:29:54.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:147 4.8 4:10040a41:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299904750 con 0x563299841b70 2024-04-23T18:29:54.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:148 4.10 4:0aba0da8:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632998a37b0 con 0x563299841b70 2024-04-23T18:29:54.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 32 ==== osd_op_reply(144 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.6 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 37 ==== osd_op_reply(138 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2fc043040 con 0x563299838b70 2024-04-23T18:29:54.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.312+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 38 ==== osd_op_reply(140 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb2fc043040 con 0x563299838b70 2024-04-23T18:29:54.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.313+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 39 ==== osd_op_reply(142 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2fc043040 con 0x563299838b70 2024-04-23T18:29:54.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.313+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(139 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.313+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(141 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.316 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.313+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 33 ==== osd_op_reply(146 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.8 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.313+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 44 ==== osd_op_reply(143 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.313+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 45 ==== osd_op_reply(147 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.313+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 46 ==== osd_op_reply(145 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.7 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.313+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 47 ==== osd_op_reply(148 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.313+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632998993d0 con 0x56329983d1e0 2024-04-23T18:29:54.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.314+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 34 ==== osd_op_reply(149 foo.buckets [call] v34'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.314+0000 7fb30f536800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-04-23T18:29:54.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.314+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299903fa0 con 0x56329983d1e0 2024-04-23T18:29:54.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.315+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 35 ==== osd_op_reply(150 myfoo [call,call,delete] v34'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.315+0000 7fb30f536800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-23T18:29:54.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.315+0000 7fb30f536800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-23T18:29:54.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.315+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94775324721056 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299902520 con 0x7fb304071020 2024-04-23T18:29:54.317 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.315+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== watch-notify(notify (1) cookie 94775323959200 notify 146028888089 ret 0) ==== 191+0+0 (crc 0 0 0) 0x563299885670 con 0x7fb304071020 2024-04-23T18:29:54.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.315+0000 7fb1eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94775323959200 notifier 4644 bl.length()=149 2024-04-23T18:29:54.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.315+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 31 ==== osd_op_reply(151 notify.6 [notify cookie 94775324721056 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.315+0000 7fb1eeffd640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb1d0003d60 con 0x7fb304071020 2024-04-23T18:29:54.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.316+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 32 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.316+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 33 ==== watch-notify(notify_complete (2) cookie 94775324721056 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632998589d0 con 0x7fb304071020 2024-04-23T18:29:54.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.316+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:153 8.e 8:709d5331:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632998993d0 con 0x7fb304071020 2024-04-23T18:29:54.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.317+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 34 ==== osd_op_reply(153 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 [call,call,delete] v34'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.317+0000 7fb30f536800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 from cache 2024-04-23T18:29:54.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.317+0000 7fb30f536800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5, ofs0, ns] 2024-04-23T18:29:54.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.317+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:154 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94775324721056 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632998993d0 con 0x7fb304071020 2024-04-23T18:29:54.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.317+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 35 ==== watch-notify(notify (1) cookie 94775323959200 notify 146028888090 ret 0) ==== 248+0+0 (crc 0 0 0) 0x5632998589d0 con 0x7fb304071020 2024-04-23T18:29:54.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.317+0000 7fb1ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94775323959200 notifier 4644 bl.length()=206 2024-04-23T18:29:54.318 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.317+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 36 ==== osd_op_reply(154 notify.6 [notify cookie 94775324721056 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.317+0000 7fb1ee7fc640 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:155 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb1400032c0 con 0x7fb304071020 2024-04-23T18:29:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.317+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 37 ==== osd_op_reply(155 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.318+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 38 ==== watch-notify(notify_complete (2) cookie 94775324721056 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56329984f7b0 con 0x7fb304071020 2024-04-23T18:29:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.318+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:156 4.c 4:31a01eb7:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632998993d0 con 0x563299838b70 2024-04-23T18:29:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.318+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:157 4.17 4:eb812bf6:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299902520 con 0x7fb304071020 2024-04-23T18:29:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.318+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:158 4.2f 4:f5cd785b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632998864b0 con 0x563299838b70 2024-04-23T18:29:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.318+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:159 4.21 4:859a5a2b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299886890 con 0x7fb304071020 2024-04-23T18:29:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.318+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:160 4.28 4:15c1bb38:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299886c70 con 0x563299838b70 2024-04-23T18:29:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.318+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:161 4.19 4:9a8e0a1b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299902520 con 0x563299841b70 2024-04-23T18:29:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.318+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:162 4.b 4:d3f0904b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632998864b0 con 0x56329983d1e0 2024-04-23T18:29:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.318+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:163 4.0 4:015f5000:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299886c70 con 0x563299841b70 2024-04-23T18:29:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.318+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:164 4.1 4:82ba6ec4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299886890 con 0x56329983d1e0 2024-04-23T18:29:54.319 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.318+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:165 4.8 4:10040a41:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889f30 con 0x563299841b70 2024-04-23T18:29:54.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.318+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:166 4.10 4:0aba0da8:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56329988a9b0 con 0x563299841b70 2024-04-23T18:29:54.320 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.319+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 36 ==== osd_op_reply(162 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.6 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.319+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 37 ==== osd_op_reply(164 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.8 [delete] v34'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.319+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 48 ==== osd_op_reply(161 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.5 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.320+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 40 ==== osd_op_reply(160 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.4 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x563299838b70 2024-04-23T18:29:54.323 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.320+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 39 ==== osd_op_reply(157 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.1 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.320+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 40 ==== osd_op_reply(159 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.3 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.320+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 41 ==== osd_op_reply(158 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.2 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x563299838b70 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.320+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 42 ==== osd_op_reply(156 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.0 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x563299838b70 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.320+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 49 ==== osd_op_reply(163 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.7 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.321+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 50 ==== osd_op_reply(165 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.9 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.321+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 51 ==== osd_op_reply(166 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5.10 [delete] v34'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.321+0000 7fb30f536800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 : miss 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.321+0000 7fb30f536800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.321+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:167 6.14 6:2841b61a:::pubsub..bucket.myfoo%2fb69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563299889f30 con 0x56329983d1e0 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.321+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 38 ==== osd_op_reply(167 pubsub..bucket.myfoo/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.321+0000 7fb30f536800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.321+0000 7fb30f536800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 info.flags=0x0 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.321+0000 7fb30f536800 10 adding default.rgw.log++pubsub..bucket.myfoo/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 to cache LRU end 2024-04-23T18:29:54.324 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.321+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:168 6.14 6:2841b61a:::pubsub..bucket.myfoo%2fb69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889f30 con 0x56329983d1e0 2024-04-23T18:29:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.322+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 39 ==== osd_op_reply(168 pubsub..bucket.myfoo/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.5 [delete] v34'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.322+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889f30 con 0x56329983d1e0 2024-04-23T18:29:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.324+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 40 ==== osd_op_reply(169 foo.buckets [call] v34'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.324+0000 7fb1c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.324+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94775323968128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889f30 con 0x563299838b70 2024-04-23T18:29:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.325+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 43 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94775323968128] v34'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x563299838b70 2024-04-23T18:29:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.325+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94775323942384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889f30 con 0x56329983d1e0 2024-04-23T18:29:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.326+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 41 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94775323942384] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.326+0000 7fb30f536800 20 remove_watcher() i=0 2024-04-23T18:29:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.326+0000 7fb30f536800 2 removed watcher, disabling cache 2024-04-23T18:29:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.326+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94775323948176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889f30 con 0x563299838b70 2024-04-23T18:29:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.328+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 44 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94775323948176] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x563299838b70 2024-04-23T18:29:54.325 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.328+0000 7fb30f536800 20 remove_watcher() i=1 2024-04-23T18:29:54.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.328+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94775323949232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889f30 con 0x563299841b70 2024-04-23T18:29:54.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.329+0000 7fb30aacb640 1 -- 172.21.15.119:0/317169552 <== osd.3 v2:172.21.15.119:6809/3910610681 52 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94775323949232] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb300081070 con 0x563299841b70 2024-04-23T18:29:54.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.329+0000 7fb30f536800 20 remove_watcher() i=2 2024-04-23T18:29:54.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.329+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94775323955568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889f30 con 0x56329983d1e0 2024-04-23T18:29:54.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.330+0000 7fb30b2cc640 1 -- 172.21.15.119:0/317169552 <== osd.2 v2:172.21.15.119:6800/2624052101 42 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94775323955568] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb30408d040 con 0x56329983d1e0 2024-04-23T18:29:54.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.330+0000 7fb30f536800 20 remove_watcher() i=3 2024-04-23T18:29:54.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.330+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94775323957168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889f30 con 0x563299838b70 2024-04-23T18:29:54.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.331+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.1 v2:172.21.15.119:6808/2736386629 45 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94775323957168] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x563299838b70 2024-04-23T18:29:54.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.331+0000 7fb30f536800 20 remove_watcher() i=4 2024-04-23T18:29:54.326 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.331+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94775323961696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889f30 con 0x7fb304071020 2024-04-23T18:29:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.332+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 41 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94775323961696] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.332+0000 7fb30f536800 20 remove_watcher() i=5 2024-04-23T18:29:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.332+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94775323959200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889f30 con 0x7fb304071020 2024-04-23T18:29:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.333+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 42 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94775323959200] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.333+0000 7fb30f536800 20 remove_watcher() i=6 2024-04-23T18:29:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.333+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94775323965520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563299889f30 con 0x7fb304071020 2024-04-23T18:29:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 <== osd.0 v2:172.21.15.62:6800/2641588406 43 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94775323965520] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2fc043040 con 0x7fb304071020 2024-04-23T18:29:54.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 20 remove_watcher() i=7 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb304071020 msgr2=0x7fb304064850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb304071020 0x7fb304064850 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563299838b70 msgr2=0x56329983b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563299838b70 0x56329983b030 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56329983d1e0 msgr2=0x56329983f5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56329983d1e0 0x56329983f5d0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563299841b70 msgr2=0x563299844030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563299841b70 0x563299844030 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1d4036e60 msgr2=0x7fb1d4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1d4036e60 0x7fb1d4039320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb30001ced0 tx=0x7fb30004f000 comp rx=0 tx=0).stop 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 msgr2=0x56329982d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30bacd640 1 -- 172.21.15.119:0/317169552 reap_dead start 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 0x56329982d530 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb30404be80 tx=0x7fb30403dea0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 shutdown_connections 2024-04-23T18:29:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 --2- 172.21.15.119:0/317169552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299826380 0x56329982d530 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 >> 172.21.15.119:0/317169552 conn(0x563299822650 msgr2=0x56329981fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 shutdown_connections 2024-04-23T18:29:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/317169552 wait complete. 2024-04-23T18:29:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/1128391454 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1e4036e60 msgr2=0x7fb1e4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 --2- 172.21.15.119:0/1128391454 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1e4036e60 0x7fb1e4039320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x563299802a40 tx=0x7fb300005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/1128391454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299819380 msgr2=0x5632998197a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 --2- 172.21.15.119:0/1128391454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299819380 0x5632998197a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb30401ee70 tx=0x7fb304011b20 comp rx=0 tx=0).stop 2024-04-23T18:29:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/1128391454 shutdown_connections 2024-04-23T18:29:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 --2- 172.21.15.119:0/1128391454 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1e4036e60 0x7fb1e4039320 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 --2- 172.21.15.119:0/1128391454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299819380 0x5632998197a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/1128391454 >> 172.21.15.119:0/1128391454 conn(0x56329980d420 msgr2=0x56329980d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.332 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.334+0000 7fb30f536800 1 -- 172.21.15.119:0/1128391454 shutdown_connections 2024-04-23T18:29:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 -- 172.21.15.119:0/1128391454 wait complete. 2024-04-23T18:29:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5632998083d0 msgr2=0x56329980a840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5632998083d0 0x56329980a840 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563299705310 msgr2=0x563299801b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563299705310 0x563299801b60 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563299804490 msgr2=0x563299806880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563299804490 0x563299806880 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1f0036e60 msgr2=0x7fb1f0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb1f0036e60 0x7fb1f0039320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb300054000 tx=0x7fb30004e000 comp rx=0 tx=0).stop 2024-04-23T18:29:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299700e80 msgr2=0x5632997fabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 --2- 172.21.15.119:0/3742731964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563299700e80 0x5632997fabc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb304001b10 tx=0x7fb304000f40 comp rx=0 tx=0).stop 2024-04-23T18:29:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30bacd640 1 -- 172.21.15.119:0/3742731964 reap_dead start 2024-04-23T18:29:54.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 shutdown_connections 2024-04-23T18:29:54.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 >> 172.21.15.119:0/3742731964 conn(0x5632996fc440 msgr2=0x5632997ec1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 shutdown_connections 2024-04-23T18:29:54.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.335+0000 7fb30f536800 1 -- 172.21.15.119:0/3742731964 wait complete. 2024-04-23T18:29:54.335 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-23T18:29:54.335 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-23T18:29:54.336 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-04-23T18:29:54.420 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:54.420 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:54.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.428+0000 7f8f28287800 1 Processor -- start 2024-04-23T18:29:54.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.428+0000 7f8f28287800 1 -- start start 2024-04-23T18:29:54.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.429+0000 7f8f28287800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f902754310 0x55f902756700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.429+0000 7f8f28287800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f902601560 con 0x55f90274fe80 2024-04-23T18:29:54.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.429+0000 7f8f28287800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55f9025f2e20 con 0x55f902754310 2024-04-23T18:29:54.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.429+0000 7f8f25585640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f902754310 0x55f902756700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.429+0000 7f8f25d86640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55f90274fe80 0x55f9027502a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:43648/0 (socket says 172.21.15.119:43648) 2024-04-23T18:29:54.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.429+0000 7f8f25d86640 1 -- 172.21.15.119:0/3924538292 learned_addr learned my addr 172.21.15.119:0/3924538292 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:54.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.429+0000 7f8f25585640 1 -- 172.21.15.119:0/3924538292 >> v1:172.21.15.62:6789/0 conn(0x55f90274fe80 legacy=0x55f9027502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.429+0000 7f8f25585640 1 -- 172.21.15.119:0/3924538292 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f902600e60 con 0x55f902754310 2024-04-23T18:29:54.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.431+0000 7f8f25585640 1 --2- 172.21.15.119:0/3924538292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f902754310 0x55f902756700 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00a600 tx=0x7f8f1c01ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7653b0dd87b43a25 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.431+0000 7f8f24d84640 1 -- 172.21.15.119:0/3924538292 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1c00a200 con 0x55f902754310 2024-04-23T18:29:54.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.431+0000 7f8f24d84640 1 -- 172.21.15.119:0/3924538292 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1c00a3a0 con 0x55f902754310 2024-04-23T18:29:54.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.431+0000 7f8f24d84640 1 -- 172.21.15.119:0/3924538292 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1c0086e0 con 0x55f902754310 2024-04-23T18:29:54.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.432+0000 7f8f28287800 1 -- 172.21.15.119:0/3924538292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f902754310 msgr2=0x55f902756700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.432+0000 7f8f28287800 1 --2- 172.21.15.119:0/3924538292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f902754310 0x55f902756700 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00a600 tx=0x7f8f1c01ed70 comp rx=0 tx=0).stop 2024-04-23T18:29:54.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.432+0000 7f8f28287800 1 -- 172.21.15.119:0/3924538292 shutdown_connections 2024-04-23T18:29:54.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.432+0000 7f8f28287800 1 --2- 172.21.15.119:0/3924538292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f902754310 0x55f902756700 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.432+0000 7f8f28287800 1 -- 172.21.15.119:0/3924538292 >> 172.21.15.119:0/3924538292 conn(0x55f90274b440 msgr2=0x55f90274d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.432+0000 7f8f28287800 1 -- 172.21.15.119:0/3924538292 shutdown_connections 2024-04-23T18:29:54.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.432+0000 7f8f28287800 1 -- 172.21.15.119:0/3924538292 wait complete. 2024-04-23T18:29:54.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.443+0000 7f8f28287800 1 Processor -- start 2024-04-23T18:29:54.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.443+0000 7f8f28287800 1 -- start start 2024-04-23T18:29:54.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.443+0000 7f8f28287800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f90274fe80 0x55f90283ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.444+0000 7f8f28287800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f90269c5d0 con 0x55f90274fe80 2024-04-23T18:29:54.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.444+0000 7f8f25d86640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f90274fe80 0x55f90283ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.444+0000 7f8f25d86640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f90274fe80 0x55f90283ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36306/0 (socket says 172.21.15.119:36306) 2024-04-23T18:29:54.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.444+0000 7f8f25d86640 1 -- 172.21.15.119:0/129977839 learned_addr learned my addr 172.21.15.119:0/129977839 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.444+0000 7f8f25d86640 1 -- 172.21.15.119:0/129977839 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f902612860 con 0x55f90274fe80 2024-04-23T18:29:54.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.444+0000 7f8f25d86640 1 --2- 172.21.15.119:0/129977839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f90274fe80 0x55f90283ff40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8f18001d80 tx=0x7f8f18001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879fa144e3ad439b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.444+0000 7f8e13e07640 1 -- 172.21.15.119:0/129977839 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f18013030 con 0x55f90274fe80 2024-04-23T18:29:54.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.444+0000 7f8e13e07640 1 -- 172.21.15.119:0/129977839 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1800e470 con 0x55f90274fe80 2024-04-23T18:29:54.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.445+0000 7f8e13e07640 1 -- 172.21.15.119:0/129977839 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1800e810 con 0x55f90274fe80 2024-04-23T18:29:54.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.445+0000 7f8f28287800 1 -- 172.21.15.119:0/129977839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f90274fe80 msgr2=0x55f90283ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.445+0000 7f8f28287800 1 --2- 172.21.15.119:0/129977839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f90274fe80 0x55f90283ff40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8f18001d80 tx=0x7f8f18001e70 comp rx=0 tx=0).stop 2024-04-23T18:29:54.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.445+0000 7f8f28287800 1 -- 172.21.15.119:0/129977839 shutdown_connections 2024-04-23T18:29:54.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.445+0000 7f8f28287800 1 --2- 172.21.15.119:0/129977839 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f90274fe80 0x55f90283ff40 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.445+0000 7f8f28287800 1 -- 172.21.15.119:0/129977839 >> 172.21.15.119:0/129977839 conn(0x55f90274b440 msgr2=0x55f90283b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.445+0000 7f8f28287800 1 -- 172.21.15.119:0/129977839 shutdown_connections 2024-04-23T18:29:54.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.445+0000 7f8f28287800 1 -- 172.21.15.119:0/129977839 wait complete. 2024-04-23T18:29:54.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.446+0000 7f8f28287800 1 Processor -- start 2024-04-23T18:29:54.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.446+0000 7f8f28287800 1 -- start start 2024-04-23T18:29:54.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.446+0000 7f8f28287800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f90274fe80 0x55f9028478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.446+0000 7f8f28287800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f902756f70 con 0x55f90274fe80 2024-04-23T18:29:54.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.446+0000 7f8f25d86640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f90274fe80 0x55f9028478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.446+0000 7f8f25d86640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f90274fe80 0x55f9028478d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36308/0 (socket says 172.21.15.119:36308) 2024-04-23T18:29:54.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.446+0000 7f8f25d86640 1 -- 172.21.15.119:0/2920053638 learned_addr learned my addr 172.21.15.119:0/2920053638 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.446+0000 7f8f25d86640 1 -- 172.21.15.119:0/2920053638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f902610eb0 con 0x55f90274fe80 2024-04-23T18:29:54.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.447+0000 7f8f25d86640 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f90274fe80 0x55f9028478d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8f18004000 tx=0x7f8f18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.447+0000 7f8e12604640 1 -- 172.21.15.119:0/2920053638 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f18027070 con 0x55f90274fe80 2024-04-23T18:29:54.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.447+0000 7f8e12604640 1 -- 172.21.15.119:0/2920053638 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f18019900 con 0x55f90274fe80 2024-04-23T18:29:54.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.447+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f902847e10 con 0x55f90274fe80 2024-04-23T18:29:54.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.447+0000 7f8e12604640 1 -- 172.21.15.119:0/2920053638 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f18019c60 con 0x55f90274fe80 2024-04-23T18:29:54.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.447+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f902848330 con 0x55f90274fe80 2024-04-23T18:29:54.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.447+0000 7f8e12604640 1 -- 172.21.15.119:0/2920053638 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8f1802a070 con 0x55f90274fe80 2024-04-23T18:29:54.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.448+0000 7f8e12604640 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e0c036e60 0x7f8e0c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.449 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.448+0000 7f8e12604640 1 -- 172.21.15.119:0/2920053638 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f8f1801f070 con 0x55f90274fe80 2024-04-23T18:29:54.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.448+0000 7f8f25585640 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e0c036e60 0x7f8e0c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.448+0000 7f8f28287800 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f902754310 0x55f90284e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.448+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f90284eec0 con 0x55f902754310 2024-04-23T18:29:54.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.448+0000 7f8f26587640 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f902754310 0x55f90284e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.448+0000 7f8f25585640 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e0c036e60 0x7f8e0c039320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c055000 tx=0x7f8f1c050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.448+0000 7f8f26587640 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f902754310 0x55f90284e940 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.449+0000 7f8f26587640 1 -- 172.21.15.119:0/2920053638 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f902754310 2024-04-23T18:29:54.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.449+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f90284bf10 con 0x55f902754310 2024-04-23T18:29:54.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.449+0000 7f8f26587640 1 -- 172.21.15.119:0/2920053638 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f902754310 2024-04-23T18:29:54.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.449+0000 7f8f28287800 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f902851210 0x55f902853600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.449+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f902853cf0 con 0x55f902851210 2024-04-23T18:29:54.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.449+0000 7f8f25d86640 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f902851210 0x55f902853600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.449+0000 7f8f25d86640 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f902851210 0x55f902853600 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.450+0000 7f8f25d86640 1 -- 172.21.15.119:0/2920053638 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f18029030 con 0x55f902851210 2024-04-23T18:29:54.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.450+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f902850190 con 0x55f902754310 2024-04-23T18:29:54.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.450+0000 7f8f26587640 1 -- 172.21.15.119:0/2920053638 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f902754310 2024-04-23T18:29:54.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.450+0000 7f8f28287800 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f902855150 0x55f9028575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.450+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f902857d20 con 0x55f902855150 2024-04-23T18:29:54.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.450+0000 7f8f25585640 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f902855150 0x55f9028575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.450+0000 7f8f25585640 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f902855150 0x55f9028575c0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.451+0000 7f8f25585640 1 -- 172.21.15.119:0/2920053638 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f1c008950 con 0x55f902855150 2024-04-23T18:29:54.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.451+0000 7f8f28287800 1 Processor -- start 2024-04-23T18:29:54.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.451+0000 7f8f28287800 1 -- start start 2024-04-23T18:29:54.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.451+0000 7f8f28287800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f902866180 0x55f9028665a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.451+0000 7f8f28287800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f902642df0 con 0x55f902866180 2024-04-23T18:29:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.451+0000 7f8f25d86640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f902866180 0x55f9028665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.452+0000 7f8f25d86640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f902866180 0x55f9028665a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36316/0 (socket says 172.21.15.119:36316) 2024-04-23T18:29:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.452+0000 7f8f25d86640 1 -- 172.21.15.119:0/1457135666 learned_addr learned my addr 172.21.15.119:0/1457135666 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.452+0000 7f8f25d86640 1 -- 172.21.15.119:0/1457135666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f902866ae0 con 0x55f902866180 2024-04-23T18:29:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.452+0000 7f8f25d86640 1 --2- 172.21.15.119:0/1457135666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f902866180 0x55f9028665a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8f18016fd0 tx=0x7f8f180177a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.452+0000 7f8e0b7fe640 1 -- 172.21.15.119:0/1457135666 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f180440c0 con 0x55f902866180 2024-04-23T18:29:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.452+0000 7f8e0b7fe640 1 -- 172.21.15.119:0/1457135666 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f18044260 con 0x55f902866180 2024-04-23T18:29:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.452+0000 7f8f28287800 1 -- 172.21.15.119:0/1457135666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f902867550 con 0x55f902866180 2024-04-23T18:29:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.452+0000 7f8e0b7fe640 1 -- 172.21.15.119:0/1457135666 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f18044540 con 0x55f902866180 2024-04-23T18:29:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.452+0000 7f8f28287800 1 -- 172.21.15.119:0/1457135666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f902867a50 con 0x55f902866180 2024-04-23T18:29:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.453+0000 7f8e0b7fe640 1 -- 172.21.15.119:0/1457135666 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8f1803b060 con 0x55f902866180 2024-04-23T18:29:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.453+0000 7f8e0b7fe640 1 --2- 172.21.15.119:0/1457135666 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e00036e60 0x7f8e00039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.453+0000 7f8e0b7fe640 1 -- 172.21.15.119:0/1457135666 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f8f18014070 con 0x55f902866180 2024-04-23T18:29:54.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.453+0000 7f8f25585640 1 --2- 172.21.15.119:0/1457135666 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e00036e60 0x7f8e00039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.453+0000 7f8f28287800 1 Processor -- start 2024-04-23T18:29:54.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.453+0000 7f8f28287800 1 -- start start 2024-04-23T18:29:54.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.453+0000 7f8f25585640 1 --2- 172.21.15.119:0/1457135666 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e00036e60 0x7f8e00039320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55f90284f7c0 tx=0x7f8f1c005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.453+0000 7f8f28287800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9028776b0 0x55f902877ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.453+0000 7f8f28287800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f9028406c0 con 0x55f9028776b0 2024-04-23T18:29:54.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.454+0000 7f8f25d86640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9028776b0 0x55f902877ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.454+0000 7f8f25d86640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9028776b0 0x55f902877ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36326/0 (socket says 172.21.15.119:36326) 2024-04-23T18:29:54.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.454+0000 7f8f25d86640 1 -- 172.21.15.119:0/2315300445 learned_addr learned my addr 172.21.15.119:0/2315300445 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.454+0000 7f8f25d86640 1 -- 172.21.15.119:0/2315300445 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9028780a0 con 0x55f9028776b0 2024-04-23T18:29:54.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.454+0000 7f8f25d86640 1 --2- 172.21.15.119:0/2315300445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9028776b0 0x55f902877ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8f18041fd0 tx=0x7f8f1802cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2bbc2e7bf404b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.454+0000 7f8e097fa640 1 -- 172.21.15.119:0/2315300445 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1805d070 con 0x55f9028776b0 2024-04-23T18:29:54.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.454+0000 7f8e097fa640 1 -- 172.21.15.119:0/2315300445 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1800ce70 con 0x55f9028776b0 2024-04-23T18:29:54.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.454+0000 7f8e097fa640 1 -- 172.21.15.119:0/2315300445 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1802c440 con 0x55f9028776b0 2024-04-23T18:29:54.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.454+0000 7f8f28287800 1 -- 172.21.15.119:0/2315300445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9028776b0 msgr2=0x55f902877ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.454+0000 7f8f28287800 1 --2- 172.21.15.119:0/2315300445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9028776b0 0x55f902877ad0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8f18041fd0 tx=0x7f8f1802cd10 comp rx=0 tx=0).stop 2024-04-23T18:29:54.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.455+0000 7f8f28287800 1 -- 172.21.15.119:0/2315300445 shutdown_connections 2024-04-23T18:29:54.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.455+0000 7f8f28287800 1 --2- 172.21.15.119:0/2315300445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9028776b0 0x55f902877ad0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.455+0000 7f8f28287800 1 -- 172.21.15.119:0/2315300445 >> 172.21.15.119:0/2315300445 conn(0x55f90286f5b0 msgr2=0x55f90286d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.455+0000 7f8f28287800 1 -- 172.21.15.119:0/2315300445 shutdown_connections 2024-04-23T18:29:54.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.455+0000 7f8f28287800 1 -- 172.21.15.119:0/2315300445 wait complete. 2024-04-23T18:29:54.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.455+0000 7f8f28287800 1 Processor -- start 2024-04-23T18:29:54.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.455+0000 7f8f28287800 1 -- start start 2024-04-23T18:29:54.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.455+0000 7f8f28287800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9028776b0 0x55f90287ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.455+0000 7f8f28287800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f902878730 con 0x55f9028776b0 2024-04-23T18:29:54.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.455+0000 7f8f25d86640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9028776b0 0x55f90287ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.455+0000 7f8f25d86640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9028776b0 0x55f90287ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36330/0 (socket says 172.21.15.119:36330) 2024-04-23T18:29:54.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.455+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 learned_addr learned my addr 172.21.15.119:0/834187824 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.455+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f90287efb0 con 0x55f9028776b0 2024-04-23T18:29:54.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.456+0000 7f8f25d86640 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9028776b0 0x55f90287ea70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8f1805b040 tx=0x7f8f18013730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.456+0000 7f8df77fe640 1 -- 172.21.15.119:0/834187824 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f18067070 con 0x55f9028776b0 2024-04-23T18:29:54.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.456+0000 7f8df77fe640 1 -- 172.21.15.119:0/834187824 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1804b8f0 con 0x55f9028776b0 2024-04-23T18:29:54.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.456+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f90287efb0 con 0x55f9028776b0 2024-04-23T18:29:54.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.456+0000 7f8df77fe640 1 -- 172.21.15.119:0/834187824 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1805d040 con 0x55f9028776b0 2024-04-23T18:29:54.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.456+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f90287efb0 con 0x55f9028776b0 2024-04-23T18:29:54.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.457+0000 7f8df77fe640 1 -- 172.21.15.119:0/834187824 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8f1806a070 con 0x55f9028776b0 2024-04-23T18:29:54.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.457+0000 7f8df77fe640 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8df0036e60 0x7f8df0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.457+0000 7f8df77fe640 1 -- 172.21.15.119:0/834187824 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f8f1806dd60 con 0x55f9028776b0 2024-04-23T18:29:54.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.457+0000 7f8f25585640 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8df0036e60 0x7f8df0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.457+0000 7f8f25585640 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8df0036e60 0x7f8df0039320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c005870 tx=0x7f8f1c00a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.457+0000 7f8f28287800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.457+0000 7f8f28287800 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f90288a220 0x55f90288c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.470 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.457+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f90288ce30 con 0x55f90288a220 2024-04-23T18:29:54.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f26587640 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f90288a220 0x55f90288c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f26587640 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f90288a220 0x55f90288c6e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f90288a220 2024-04-23T18:29:54.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f28287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f28287800 20 realm 2024-04-23T18:29:54.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f28287800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f90288d240 con 0x55f90288a220 2024-04-23T18:29:54.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f90288a220 2024-04-23T18:29:54.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f28287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f28287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:54.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f28287800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f90288db10 con 0x55f90288a220 2024-04-23T18:29:54.471 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f90288a220 2024-04-23T18:29:54.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f28287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f28287800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.458+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288a220 2024-04-23T18:29:54.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.459+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f90288a220 2024-04-23T18:29:54.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.459+0000 7f8f28287800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:54.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.459+0000 7f8f28287800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.459+0000 7f8f28287800 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f90288ec10 0x55f902891000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.459+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f902891610 con 0x55f90288ec10 2024-04-23T18:29:54.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.459+0000 7f8f25d86640 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f90288ec10 0x55f902891000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.459+0000 7f8f25d86640 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f90288ec10 0x55f902891000 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.459+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f18073070 con 0x55f90288ec10 2024-04-23T18:29:54.472 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.459+0000 7f8f28287800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:54.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.459+0000 7f8f28287800 20 searching for the correct realm 2024-04-23T18:29:54.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.459+0000 7f8f28287800 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9028935e0 0x55f902895a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.459+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f902896140 con 0x55f9028935e0 2024-04-23T18:29:54.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.459+0000 7f8f25585640 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9028935e0 0x55f902895a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.460+0000 7f8f25585640 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9028935e0 0x55f902895a70 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.460+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.460+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f902896140 con 0x55f90288ec10 2024-04-23T18:29:54.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.460+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f18073070 con 0x55f90288ec10 2024-04-23T18:29:54.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.460+0000 7f8f25d86640 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8f1806c070 0x7f8f18011510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.460+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f902896140 con 0x7f8f1806c070 2024-04-23T18:29:54.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.461+0000 7f8f26587640 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8f1806c070 0x7f8f18011510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.461+0000 7f8f26587640 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8f1806c070 0x7f8f18011510 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.473 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.461+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2000a4a0 con 0x7f8f1806c070 2024-04-23T18:29:54.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.461+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288a220 2024-04-23T18:29:54.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.462+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f90288a220 2024-04-23T18:29:54.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.462+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288a220 2024-04-23T18:29:54.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.462+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f90288a220 2024-04-23T18:29:54.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.462+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x7f8f1806c070 2024-04-23T18:29:54.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.462+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2000a4a0 con 0x7f8f1806c070 2024-04-23T18:29:54.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.462+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x7f8f1806c070 2024-04-23T18:29:54.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.462+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8f2000a4a0 con 0x7f8f1806c070 2024-04-23T18:29:54.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.462+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288ec10 2024-04-23T18:29:54.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.462+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f18073070 con 0x55f90288ec10 2024-04-23T18:29:54.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.463+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f9028935e0 2024-04-23T18:29:54.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.463+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.474 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.463+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288a220 2024-04-23T18:29:54.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.463+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f90288a220 2024-04-23T18:29:54.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.463+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x7f8f1806c070 2024-04-23T18:29:54.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.463+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2000a4a0 con 0x7f8f1806c070 2024-04-23T18:29:54.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.463+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288a220 2024-04-23T18:29:54.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.463+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f90288a220 2024-04-23T18:29:54.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.463+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288ec10 2024-04-23T18:29:54.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.464+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8f18073070 con 0x55f90288ec10 2024-04-23T18:29:54.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.464+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f9028935e0 2024-04-23T18:29:54.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.464+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.464+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f9028935e0 2024-04-23T18:29:54.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.464+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.464+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x7f8f1806c070 2024-04-23T18:29:54.475 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.464+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2000a4a0 con 0x7f8f1806c070 2024-04-23T18:29:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.464+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f9028935e0 2024-04-23T18:29:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.465+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.465+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f9028935e0 2024-04-23T18:29:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.465+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.465+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288a220 2024-04-23T18:29:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.465+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f90288a220 2024-04-23T18:29:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.465+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288a220 2024-04-23T18:29:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.466+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f90288a220 2024-04-23T18:29:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.466+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x7f8f1806c070 2024-04-23T18:29:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.466+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2000a4a0 con 0x7f8f1806c070 2024-04-23T18:29:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.466+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f9028935e0 2024-04-23T18:29:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.466+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.476 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.466+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288ec10 2024-04-23T18:29:54.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.466+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8f18073070 con 0x55f90288ec10 2024-04-23T18:29:54.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.466+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288a220 2024-04-23T18:29:54.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.467+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2000a4a0 con 0x55f90288a220 2024-04-23T18:29:54.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.467+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288ec10 2024-04-23T18:29:54.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.467+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f18073070 con 0x55f90288ec10 2024-04-23T18:29:54.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.467+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f9028935e0 2024-04-23T18:29:54.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.467+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.467+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x7f8f1806c070 2024-04-23T18:29:54.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.468+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2000a4a0 con 0x7f8f1806c070 2024-04-23T18:29:54.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.468+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288ec10 2024-04-23T18:29:54.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.468+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f18088040 con 0x55f90288ec10 2024-04-23T18:29:54.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.468+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f9028935e0 2024-04-23T18:29:54.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.468+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.468+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x7f8f1806c070 2024-04-23T18:29:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f2000a4a0 con 0x7f8f1806c070 2024-04-23T18:29:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288a220 2024-04-23T18:29:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f90288deb0 con 0x55f90288ec10 2024-04-23T18:29:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f18088040 con 0x55f90288ec10 2024-04-23T18:29:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f28287800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f28287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f28287800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f28287800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f28287800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:54.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f28287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:54.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f28287800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f902891ed0 con 0x55f90288a220 2024-04-23T18:29:54.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f28287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f28287800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.469+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9028922c0 con 0x55f90288a220 2024-04-23T18:29:54.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:54.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9028922c0 con 0x7f8f1806c070 2024-04-23T18:29:54.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f20040080 con 0x7f8f1806c070 2024-04-23T18:29:54.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:54.479 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 20 zone default found 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 4 Realm: () 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 20 zonegroup default 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f902891ae0 con 0x55f90288ec10 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f18088040 con 0x55f90288ec10 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.470+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f902897fa0 con 0x55f9028935e0 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.471+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.471+0000 7f8f28287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.480 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.471+0000 7f8f28287800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.471+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f902898430 con 0x55f9028935e0 2024-04-23T18:29:54.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.471+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.471+0000 7f8f28287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.471+0000 7f8f28287800 20 started sync module instance, tier type = 2024-04-23T18:29:54.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.471+0000 7f8f28287800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:54.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.471+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f902897440 con 0x55f90288ec10 2024-04-23T18:29:54.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.472+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f18088040 con 0x55f90288ec10 2024-04-23T18:29:54.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.472+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94527977781296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f902898d40 con 0x55f90288ec10 2024-04-23T18:29:54.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.472+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f902899590 con 0x55f90288a220 2024-04-23T18:29:54.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.473+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94527977781296] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f18088040 con 0x55f90288ec10 2024-04-23T18:29:54.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.473+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.473+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94527977785488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f902899280 con 0x55f90288a220 2024-04-23T18:29:54.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.473+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f902899da0 con 0x55f9028935e0 2024-04-23T18:29:54.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.474+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94527977785488] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.474+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.474+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94527977789552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f90289a190 con 0x55f9028935e0 2024-04-23T18:29:54.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.474+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f90289ab90 con 0x55f90288ec10 2024-04-23T18:29:54.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.475+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94527977789552] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.475+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f18088040 con 0x55f90288ec10 2024-04-23T18:29:54.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.475+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94527977786608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f90289af80 con 0x55f90288ec10 2024-04-23T18:29:54.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.475+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f90289b9c0 con 0x55f90288a220 2024-04-23T18:29:54.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.476+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.476+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94527977796752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f90289b980 con 0x55f90288a220 2024-04-23T18:29:54.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.477+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f90289c9a0 con 0x7f8f1806c070 2024-04-23T18:29:54.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.477+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94527977786608] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f18088040 con 0x55f90288ec10 2024-04-23T18:29:54.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.477+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x7f8f1806c070 2024-04-23T18:29:54.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.478+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94527977800880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f90289c9a0 con 0x7f8f1806c070 2024-04-23T18:29:54.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.478+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f90289d3b0 con 0x7f8f1806c070 2024-04-23T18:29:54.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.478+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94527977796752] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.478+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94527977800880] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x7f8f1806c070 2024-04-23T18:29:54.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.479+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x7f8f1806c070 2024-04-23T18:29:54.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.479+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94527977793184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f90289cf00 con 0x7f8f1806c070 2024-04-23T18:29:54.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.479+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f90289dc50 con 0x7f8f1806c070 2024-04-23T18:29:54.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.480+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94527977793184] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x7f8f1806c070 2024-04-23T18:29:54.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.480+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x7f8f1806c070 2024-04-23T18:29:54.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.480+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94527977798976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f90289cf00 con 0x7f8f1806c070 2024-04-23T18:29:54.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.480+0000 7f8f28287800 20 add_watcher() i=0 2024-04-23T18:29:54.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.480+0000 7f8f28287800 20 add_watcher() i=1 2024-04-23T18:29:54.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.480+0000 7f8f28287800 20 add_watcher() i=2 2024-04-23T18:29:54.487 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.480+0000 7f8f28287800 20 add_watcher() i=3 2024-04-23T18:29:54.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.480+0000 7f8f28287800 20 add_watcher() i=4 2024-04-23T18:29:54.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.480+0000 7f8f28287800 20 add_watcher() i=5 2024-04-23T18:29:54.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.480+0000 7f8f28287800 20 add_watcher() i=6 2024-04-23T18:29:54.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.481+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94527977798976] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x7f8f1806c070 2024-04-23T18:29:54.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.481+0000 7f8f28287800 20 add_watcher() i=7 2024-04-23T18:29:54.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.481+0000 7f8f28287800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:54.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.481+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9028a0c80 con 0x55f90288a220 2024-04-23T18:29:54.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.481+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.481+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94527977805728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f90289e0e0 con 0x55f90288a220 2024-04-23T18:29:54.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.482+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94527977805728] v34'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.482+0000 7f8dd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:54.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.482+0000 7f8f28287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:54.488 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.482+0000 7f8f28287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:54.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.482+0000 7f8f28287800 5 note: GC not initialized 2024-04-23T18:29:54.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.482+0000 7f8dd67fc640 20 reqs_thread_entry: start 2024-04-23T18:29:54.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.483+0000 7f8f28287800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:54.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.483+0000 7f8f28287800 20 Filter name: none 2024-04-23T18:29:54.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.483+0000 7f8d47fff640 20 reqs_thread_entry: start 2024-04-23T18:29:54.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.483+0000 7f8f28287800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:54.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.483+0000 7f8f28287800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.483+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9028d42f0 con 0x55f90288a220 2024-04-23T18:29:54.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.483+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.489 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.483+0000 7f8f28287800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:54.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.483+0000 7f8f28287800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:54.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.483+0000 7f8f28287800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:54.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.483+0000 7f8f28287800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:54.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.483+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9028da4a0 con 0x55f90288a220 2024-04-23T18:29:54.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.484+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v34'16 uv16 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.484+0000 7f8f28287800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:54.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.484+0000 7f8f28287800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:54.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.484+0000 7f8f28287800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:54.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.484+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94527978053408 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f9028d5d70 con 0x55f90288a220 2024-04-23T18:29:54.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.485+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify (1) cookie 94527977796752 notify 146028888086 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f8f20018bf0 con 0x55f90288a220 2024-04-23T18:29:54.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.485+0000 7f8e097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94527977796752 notifier 4651 bl.length()=579 2024-04-23T18:29:54.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.485+0000 7f8e097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:54.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.485+0000 7f8e097fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:54.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.485+0000 7f8e097fa640 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8de8003ea0 con 0x55f90288a220 2024-04-23T18:29:54.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.485+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(64 notify.4 [notify cookie 94527978053408 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.485+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== watch-notify(notify_complete (2) cookie 94527978053408 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8f20018dc0 con 0x55f90288a220 2024-04-23T18:29:54.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.485+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.491 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:54.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.486+0000 7f8dd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:54.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.486+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94527977805728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9028d9320 con 0x55f90288a220 2024-04-23T18:29:54.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.487+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94527977805728] v34'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.487+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94527977781296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f9028d9320 con 0x55f90288ec10 2024-04-23T18:29:54.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.488+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94527977781296] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f18088040 con 0x55f90288ec10 2024-04-23T18:29:54.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.488+0000 7f8f28287800 20 remove_watcher() i=0 2024-04-23T18:29:54.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.488+0000 7f8f28287800 2 removed watcher, disabling cache 2024-04-23T18:29:54.497 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.488+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94527977785488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f902897830 con 0x55f90288a220 2024-04-23T18:29:54.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.489+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94527977785488] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.489+0000 7f8f28287800 20 remove_watcher() i=1 2024-04-23T18:29:54.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.489+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94527977789552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f902897830 con 0x55f9028935e0 2024-04-23T18:29:54.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.490+0000 7f8f25585640 1 -- 172.21.15.119:0/834187824 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94527977789552] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f1c073070 con 0x55f9028935e0 2024-04-23T18:29:54.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.490+0000 7f8f28287800 20 remove_watcher() i=2 2024-04-23T18:29:54.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.490+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94527977786608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f902899870 con 0x55f90288ec10 2024-04-23T18:29:54.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.491+0000 7f8f25d86640 1 -- 172.21.15.119:0/834187824 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94527977786608] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f18088040 con 0x55f90288ec10 2024-04-23T18:29:54.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.491+0000 7f8f28287800 20 remove_watcher() i=3 2024-04-23T18:29:54.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.491+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94527977796752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f902898d40 con 0x55f90288a220 2024-04-23T18:29:54.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.492+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94527977796752] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x55f90288a220 2024-04-23T18:29:54.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.492+0000 7f8f28287800 20 remove_watcher() i=4 2024-04-23T18:29:54.498 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.492+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94527977800880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f902898d40 con 0x7f8f1806c070 2024-04-23T18:29:54.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.493+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94527977800880] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x7f8f1806c070 2024-04-23T18:29:54.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.493+0000 7f8f28287800 20 remove_watcher() i=5 2024-04-23T18:29:54.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.493+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94527977793184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f902898d40 con 0x7f8f1806c070 2024-04-23T18:29:54.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.494+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94527977793184] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x7f8f1806c070 2024-04-23T18:29:54.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.494+0000 7f8f28287800 20 remove_watcher() i=6 2024-04-23T18:29:54.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.494+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94527977798976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f902898d40 con 0x7f8f1806c070 2024-04-23T18:29:54.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94527977798976] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f20040080 con 0x7f8f1806c070 2024-04-23T18:29:54.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 20 remove_watcher() i=7 2024-04-23T18:29:54.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8f1806c070 msgr2=0x7f8f18011510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f8f1806c070 0x7f8f18011510 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f90288a220 msgr2=0x55f90288c6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f90288a220 0x55f90288c6e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f90288ec10 msgr2=0x55f902891000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f90288ec10 0x55f902891000 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9028935e0 msgr2=0x55f902895a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55f9028935e0 0x55f902895a70 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8df0036e60 msgr2=0x7f8df0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8df0036e60 0x7f8df0039320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c005870 tx=0x7f8f1c00a000 comp rx=0 tx=0).stop 2024-04-23T18:29:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9028776b0 msgr2=0x55f90287ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 --2- 172.21.15.119:0/834187824 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f9028776b0 0x55f90287ea70 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8f1805b040 tx=0x7f8f18013730 comp rx=0 tx=0).stop 2024-04-23T18:29:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 reap_dead start 2024-04-23T18:29:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f26587640 1 -- 172.21.15.119:0/834187824 reap_dead start 2024-04-23T18:29:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 shutdown_connections 2024-04-23T18:29:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 >> 172.21.15.119:0/834187824 conn(0x55f90286f5b0 msgr2=0x55f90286cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 shutdown_connections 2024-04-23T18:29:54.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.495+0000 7f8f28287800 1 -- 172.21.15.119:0/834187824 wait complete. 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/1457135666 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e00036e60 msgr2=0x7f8e00039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 --2- 172.21.15.119:0/1457135666 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e00036e60 0x7f8e00039320 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55f90284f7c0 tx=0x7f8f1c005a00 comp rx=0 tx=0).stop 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/1457135666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f902866180 msgr2=0x55f9028665a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 --2- 172.21.15.119:0/1457135666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f902866180 0x55f9028665a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8f18016fd0 tx=0x7f8f180177a0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/1457135666 shutdown_connections 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 --2- 172.21.15.119:0/1457135666 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e00036e60 0x7f8e00039320 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 --2- 172.21.15.119:0/1457135666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f902866180 0x55f9028665a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/1457135666 >> 172.21.15.119:0/1457135666 conn(0x55f90285a220 msgr2=0x55f90285a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/1457135666 shutdown_connections 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/1457135666 wait complete. 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f902855150 msgr2=0x55f9028575c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55f902855150 0x55f9028575c0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f902754310 msgr2=0x55f90284e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55f902754310 0x55f90284e940 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f902851210 msgr2=0x55f902853600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55f902851210 0x55f902853600 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e0c036e60 msgr2=0x7f8e0c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8e0c036e60 0x7f8e0c039320 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c055000 tx=0x7f8f1c050000 comp rx=0 tx=0).stop 2024-04-23T18:29:54.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f90274fe80 msgr2=0x55f9028478d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 --2- 172.21.15.119:0/2920053638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f90274fe80 0x55f9028478d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8f18004000 tx=0x7f8f18000bc0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f26587640 1 -- 172.21.15.119:0/2920053638 reap_dead start 2024-04-23T18:29:54.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 shutdown_connections 2024-04-23T18:29:54.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 >> 172.21.15.119:0/2920053638 conn(0x55f90274b440 msgr2=0x55f90283a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 shutdown_connections 2024-04-23T18:29:54.502 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.496+0000 7f8f28287800 1 -- 172.21.15.119:0/2920053638 wait complete. 2024-04-23T18:29:54.503 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:54.503 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-23T18:29:54.503 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-23T18:29:54.503 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-04-23T18:29:54.547 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:54.547 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:54.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.555+0000 7f6d31016800 1 Processor -- start 2024-04-23T18:29:54.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.556+0000 7f6d31016800 1 -- start start 2024-04-23T18:29:54.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.556+0000 7f6d31016800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ac6ba48a10 0x55ac6ba4ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.556+0000 7f6d31016800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ac6b8f8560 con 0x55ac6ba4b340 2024-04-23T18:29:54.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.556+0000 7f6d31016800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55ac6b8e9e20 con 0x55ac6ba48a10 2024-04-23T18:29:54.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.556+0000 7f6d2c684640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ac6ba48a10 0x55ac6ba4ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.556+0000 7f6d23fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55ac6ba4b340 0x55ac6ba4d730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:43664/0 (socket says 172.21.15.119:43664) 2024-04-23T18:29:54.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.556+0000 7f6d23fff640 1 -- 172.21.15.119:0/3447153817 learned_addr learned my addr 172.21.15.119:0/3447153817 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:29:54.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.556+0000 7f6d2c684640 1 -- 172.21.15.119:0/3447153817 >> v1:172.21.15.62:6789/0 conn(0x55ac6ba4b340 legacy=0x55ac6ba4d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.556+0000 7f6d2c684640 1 -- 172.21.15.119:0/3447153817 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac6b8f7e60 con 0x55ac6ba48a10 2024-04-23T18:29:54.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.558+0000 7f6d2c684640 1 --2- 172.21.15.119:0/3447153817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6ba4ae00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00a470 tx=0x7f6d1c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1526eb6d07b92bdb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.558+0000 7f6d2be83640 1 -- 172.21.15.119:0/3447153817 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c057070 con 0x55ac6ba48a10 2024-04-23T18:29:54.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.558+0000 7f6d2be83640 1 -- 172.21.15.119:0/3447153817 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c052570 con 0x55ac6ba48a10 2024-04-23T18:29:54.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.558+0000 7f6d2be83640 1 -- 172.21.15.119:0/3447153817 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c052870 con 0x55ac6ba48a10 2024-04-23T18:29:54.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.559+0000 7f6d31016800 1 -- 172.21.15.119:0/3447153817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 msgr2=0x55ac6ba4ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.559+0000 7f6d31016800 1 --2- 172.21.15.119:0/3447153817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6ba4ae00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00a470 tx=0x7f6d1c01ce90 comp rx=0 tx=0).stop 2024-04-23T18:29:54.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.559+0000 7f6d31016800 1 -- 172.21.15.119:0/3447153817 shutdown_connections 2024-04-23T18:29:54.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.559+0000 7f6d31016800 1 --2- 172.21.15.119:0/3447153817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6ba4ae00 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.559+0000 7f6d31016800 1 -- 172.21.15.119:0/3447153817 >> 172.21.15.119:0/3447153817 conn(0x55ac6ba42440 msgr2=0x55ac6ba44860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.559+0000 7f6d31016800 1 -- 172.21.15.119:0/3447153817 shutdown_connections 2024-04-23T18:29:54.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.559+0000 7f6d31016800 1 -- 172.21.15.119:0/3447153817 wait complete. 2024-04-23T18:29:54.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.570+0000 7f6d31016800 1 Processor -- start 2024-04-23T18:29:54.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.570+0000 7f6d31016800 1 -- start start 2024-04-23T18:29:54.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.571+0000 7f6d31016800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6bb39190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.571+0000 7f6d31016800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ac6b9935d0 con 0x55ac6ba48a10 2024-04-23T18:29:54.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.571+0000 7f6d2c684640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6bb39190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.571+0000 7f6d2c684640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6bb39190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36348/0 (socket says 172.21.15.119:36348) 2024-04-23T18:29:54.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.571+0000 7f6d2c684640 1 -- 172.21.15.119:0/4282233552 learned_addr learned my addr 172.21.15.119:0/4282233552 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.571+0000 7f6d2c684640 1 -- 172.21.15.119:0/4282233552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac6b909860 con 0x55ac6ba48a10 2024-04-23T18:29:54.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.571+0000 7f6d2c684640 1 --2- 172.21.15.119:0/4282233552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6bb39190 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c055040 tx=0x7f6d1c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e15d204fcc7f704 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.572+0000 7f6c1a60c640 1 -- 172.21.15.119:0/4282233552 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c057070 con 0x55ac6ba48a10 2024-04-23T18:29:54.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.572+0000 7f6c1a60c640 1 -- 172.21.15.119:0/4282233552 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c063070 con 0x55ac6ba48a10 2024-04-23T18:29:54.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.572+0000 7f6c1a60c640 1 -- 172.21.15.119:0/4282233552 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c052720 con 0x55ac6ba48a10 2024-04-23T18:29:54.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.572+0000 7f6d31016800 1 -- 172.21.15.119:0/4282233552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 msgr2=0x55ac6bb39190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.572+0000 7f6d31016800 1 --2- 172.21.15.119:0/4282233552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6bb39190 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c055040 tx=0x7f6d1c04c000 comp rx=0 tx=0).stop 2024-04-23T18:29:54.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.572+0000 7f6d31016800 1 -- 172.21.15.119:0/4282233552 shutdown_connections 2024-04-23T18:29:54.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.572+0000 7f6d31016800 1 --2- 172.21.15.119:0/4282233552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6bb39190 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.572+0000 7f6d31016800 1 -- 172.21.15.119:0/4282233552 >> 172.21.15.119:0/4282233552 conn(0x55ac6ba42440 msgr2=0x55ac6bb34ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.572+0000 7f6d31016800 1 -- 172.21.15.119:0/4282233552 shutdown_connections 2024-04-23T18:29:54.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.572+0000 7f6d31016800 1 -- 172.21.15.119:0/4282233552 wait complete. 2024-04-23T18:29:54.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.573+0000 7f6d31016800 1 Processor -- start 2024-04-23T18:29:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.573+0000 7f6d31016800 1 -- start start 2024-04-23T18:29:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.573+0000 7f6d31016800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6bb40960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.573+0000 7f6d31016800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ac6ba4f0f0 con 0x55ac6ba48a10 2024-04-23T18:29:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.573+0000 7f6d2c684640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6bb40960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.573+0000 7f6d2c684640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6bb40960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36354/0 (socket says 172.21.15.119:36354) 2024-04-23T18:29:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.573+0000 7f6d2c684640 1 -- 172.21.15.119:0/3711923331 learned_addr learned my addr 172.21.15.119:0/3711923331 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.574+0000 7f6d2c684640 1 -- 172.21.15.119:0/3711923331 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac6b907eb0 con 0x55ac6ba48a10 2024-04-23T18:29:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.574+0000 7f6d2c684640 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6bb40960 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c000c00 tx=0x7f6d1c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.574+0000 7f6c18e09640 1 -- 172.21.15.119:0/3711923331 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c05e480 con 0x55ac6ba48a10 2024-04-23T18:29:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.574+0000 7f6c18e09640 1 -- 172.21.15.119:0/3711923331 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c06c070 con 0x55ac6ba48a10 2024-04-23T18:29:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.574+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac6bb40ea0 con 0x55ac6ba48a10 2024-04-23T18:29:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.574+0000 7f6c18e09640 1 -- 172.21.15.119:0/3711923331 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c05e750 con 0x55ac6ba48a10 2024-04-23T18:29:54.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.574+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac6bb413c0 con 0x55ac6ba48a10 2024-04-23T18:29:54.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.575+0000 7f6c18e09640 1 -- 172.21.15.119:0/3711923331 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6d1c077060 con 0x55ac6ba48a10 2024-04-23T18:29:54.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.575+0000 7f6c18e09640 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c14036e60 0x7f6c14039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.575+0000 7f6c18e09640 1 -- 172.21.15.119:0/3711923331 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f6d1c08ec50 con 0x55ac6ba48a10 2024-04-23T18:29:54.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.575+0000 7f6d23fff640 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c14036e60 0x7f6c14039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.575+0000 7f6d31016800 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ac6ba4b340 0x55ac6bb479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.575+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb47f50 con 0x55ac6ba4b340 2024-04-23T18:29:54.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.575+0000 7f6d2ce85640 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ac6ba4b340 0x55ac6bb479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.575+0000 7f6d23fff640 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c14036e60 0x7f6c14039320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6d14000f60 tx=0x7f6d140012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.575+0000 7f6d2ce85640 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ac6ba4b340 0x55ac6bb479d0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.576+0000 7f6d2ce85640 1 -- 172.21.15.119:0/3711923331 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6ba4b340 2024-04-23T18:29:54.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.576+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb44f80 con 0x55ac6ba4b340 2024-04-23T18:29:54.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.576+0000 7f6d2ce85640 1 -- 172.21.15.119:0/3711923331 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6ba4b340 2024-04-23T18:29:54.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.576+0000 7f6d31016800 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ac6bb4a280 0x55ac6bb4c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.576+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb4cd10 con 0x55ac6bb4a280 2024-04-23T18:29:54.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.576+0000 7f6d2c684640 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ac6bb4a280 0x55ac6bb4c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.576+0000 7f6d2c684640 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ac6bb4a280 0x55ac6bb4c670 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.577+0000 7f6d2c684640 1 -- 172.21.15.119:0/3711923331 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d1c009410 con 0x55ac6bb4a280 2024-04-23T18:29:54.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.577+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb49230 con 0x55ac6ba4b340 2024-04-23T18:29:54.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.577+0000 7f6d2ce85640 1 -- 172.21.15.119:0/3711923331 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6ba4b340 2024-04-23T18:29:54.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.577+0000 7f6d31016800 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55ac6bb4e1c0 0x55ac6bb50610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.577+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb50d70 con 0x55ac6bb4e1c0 2024-04-23T18:29:54.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.577+0000 7f6d23fff640 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55ac6bb4e1c0 0x55ac6bb50610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.577+0000 7f6d23fff640 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55ac6bb4e1c0 0x55ac6bb50610 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.578+0000 7f6d23fff640 1 -- 172.21.15.119:0/3711923331 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb4e1c0 2024-04-23T18:29:54.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.578+0000 7f6d31016800 1 Processor -- start 2024-04-23T18:29:54.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.578+0000 7f6d31016800 1 -- start start 2024-04-23T18:29:54.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.578+0000 7f6d31016800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb5f1d0 0x55ac6bb5f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.578+0000 7f6d31016800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ac6b939df0 con 0x55ac6bb5f1d0 2024-04-23T18:29:54.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.579+0000 7f6d2c684640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb5f1d0 0x55ac6bb5f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.579+0000 7f6d2c684640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb5f1d0 0x55ac6bb5f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36356/0 (socket says 172.21.15.119:36356) 2024-04-23T18:29:54.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.579+0000 7f6d2c684640 1 -- 172.21.15.119:0/3137676941 learned_addr learned my addr 172.21.15.119:0/3137676941 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.579+0000 7f6d2c684640 1 -- 172.21.15.119:0/3137676941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac6bb5fb30 con 0x55ac6bb5f1d0 2024-04-23T18:29:54.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.579+0000 7f6d2c684640 1 --2- 172.21.15.119:0/3137676941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb5f1d0 0x55ac6bb5f5f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c08cef0 tx=0x7f6d1c009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.579+0000 7f6c11ffb640 1 -- 172.21.15.119:0/3137676941 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c054a90 con 0x55ac6bb5f1d0 2024-04-23T18:29:54.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.579+0000 7f6c11ffb640 1 -- 172.21.15.119:0/3137676941 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c093070 con 0x55ac6bb5f1d0 2024-04-23T18:29:54.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.579+0000 7f6d31016800 1 -- 172.21.15.119:0/3137676941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac6bb605a0 con 0x55ac6bb5f1d0 2024-04-23T18:29:54.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.579+0000 7f6c11ffb640 1 -- 172.21.15.119:0/3137676941 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c054d60 con 0x55ac6bb5f1d0 2024-04-23T18:29:54.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.579+0000 7f6d31016800 1 -- 172.21.15.119:0/3137676941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac6bb60aa0 con 0x55ac6bb5f1d0 2024-04-23T18:29:54.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.580+0000 7f6c11ffb640 1 -- 172.21.15.119:0/3137676941 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6d1c085040 con 0x55ac6bb5f1d0 2024-04-23T18:29:54.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.580+0000 7f6c11ffb640 1 --2- 172.21.15.119:0/3137676941 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c04036e60 0x7f6c04039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.580+0000 7f6c11ffb640 1 -- 172.21.15.119:0/3137676941 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f6d1c073120 con 0x55ac6bb5f1d0 2024-04-23T18:29:54.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.580+0000 7f6d23fff640 1 --2- 172.21.15.119:0/3137676941 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c04036e60 0x7f6c04039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.580+0000 7f6d31016800 1 Processor -- start 2024-04-23T18:29:54.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.580+0000 7f6d31016800 1 -- start start 2024-04-23T18:29:54.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.580+0000 7f6d23fff640 1 --2- 172.21.15.119:0/3137676941 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c04036e60 0x7f6c04039320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400bf50 tx=0x7f6d1400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.581+0000 7f6d31016800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 0x55ac6bb6c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.581+0000 7f6d31016800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ac6bb39850 con 0x55ac6bb6c330 2024-04-23T18:29:54.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.581+0000 7f6d2c684640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 0x55ac6bb6c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.581+0000 7f6d2c684640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 0x55ac6bb6c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36366/0 (socket says 172.21.15.119:36366) 2024-04-23T18:29:54.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.581+0000 7f6d2c684640 1 -- 172.21.15.119:0/2989679582 learned_addr learned my addr 172.21.15.119:0/2989679582 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.581+0000 7f6d2c684640 1 -- 172.21.15.119:0/2989679582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac6bb6cd20 con 0x55ac6bb6c330 2024-04-23T18:29:54.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.581+0000 7f6d2c684640 1 --2- 172.21.15.119:0/2989679582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 0x55ac6bb6c750 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c098b70 tx=0x7f6d1c066ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49501f2331193aea server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.581+0000 7f6c0b7fe640 1 -- 172.21.15.119:0/2989679582 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c08e300 con 0x55ac6bb6c330 2024-04-23T18:29:54.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.581+0000 7f6c0b7fe640 1 -- 172.21.15.119:0/2989679582 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c058040 con 0x55ac6bb6c330 2024-04-23T18:29:54.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.581+0000 7f6c0b7fe640 1 -- 172.21.15.119:0/2989679582 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c06f4f0 con 0x55ac6bb6c330 2024-04-23T18:29:54.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d31016800 1 -- 172.21.15.119:0/2989679582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 msgr2=0x55ac6bb6c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d31016800 1 --2- 172.21.15.119:0/2989679582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 0x55ac6bb6c750 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c098b70 tx=0x7f6d1c066ec0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d31016800 1 -- 172.21.15.119:0/2989679582 shutdown_connections 2024-04-23T18:29:54.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d31016800 1 --2- 172.21.15.119:0/2989679582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 0x55ac6bb6c750 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d31016800 1 -- 172.21.15.119:0/2989679582 >> 172.21.15.119:0/2989679582 conn(0x55ac6bb68600 msgr2=0x55ac6bb66660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d31016800 1 -- 172.21.15.119:0/2989679582 shutdown_connections 2024-04-23T18:29:54.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d31016800 1 -- 172.21.15.119:0/2989679582 wait complete. 2024-04-23T18:29:54.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d31016800 1 Processor -- start 2024-04-23T18:29:54.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d31016800 1 -- start start 2024-04-23T18:29:54.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d31016800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 0x55ac6bb73690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d31016800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ac6bb6d380 con 0x55ac6bb6c330 2024-04-23T18:29:54.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d2c684640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 0x55ac6bb73690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d2c684640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 0x55ac6bb73690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36374/0 (socket says 172.21.15.119:36374) 2024-04-23T18:29:54.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.582+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 learned_addr learned my addr 172.21.15.119:0/1658243245 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.583+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac6bb73bd0 con 0x55ac6bb6c330 2024-04-23T18:29:54.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.583+0000 7f6d2c684640 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 0x55ac6bb73690 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c098b70 tx=0x7f6d1c061f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.583+0000 7f6c09ffb640 1 -- 172.21.15.119:0/1658243245 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c06f3c0 con 0x55ac6bb6c330 2024-04-23T18:29:54.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.583+0000 7f6c09ffb640 1 -- 172.21.15.119:0/1658243245 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c07d510 con 0x55ac6bb6c330 2024-04-23T18:29:54.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.583+0000 7f6c09ffb640 1 -- 172.21.15.119:0/1658243245 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c06f560 con 0x55ac6bb6c330 2024-04-23T18:29:54.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.583+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac6bb73bd0 con 0x55ac6bb6c330 2024-04-23T18:29:54.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.583+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac6bb73bd0 con 0x55ac6bb6c330 2024-04-23T18:29:54.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.584+0000 7f6c09ffb640 1 -- 172.21.15.119:0/1658243245 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f6d1c06e030 con 0x55ac6bb6c330 2024-04-23T18:29:54.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.584+0000 7f6c09ffb640 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6bfc036e60 0x7f6bfc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.584+0000 7f6c09ffb640 1 -- 172.21.15.119:0/1658243245 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f6d1c0b99e0 con 0x55ac6bb6c330 2024-04-23T18:29:54.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.584+0000 7f6d23fff640 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6bfc036e60 0x7f6bfc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d23fff640 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6bfc036e60 0x7f6bfc039320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6d14001b60 tx=0x7f6d14010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d31016800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d31016800 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ac6bb7ede0 0x55ac6bb812a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb819f0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d2ce85640 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ac6bb7ede0 0x55ac6bb812a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d2ce85640 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ac6bb7ede0 0x55ac6bb812a0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d31016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d31016800 20 realm 2024-04-23T18:29:54.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d31016800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb81e00 con 0x55ac6bb7ede0 2024-04-23T18:29:54.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d31016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d31016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:54.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d31016800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.585+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb826d0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.586+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.586+0000 7f6d31016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.586+0000 7f6d31016800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.586+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb7ede0 2024-04-23T18:29:54.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.586+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.586+0000 7f6d31016800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:54.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.586+0000 7f6d31016800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.586+0000 7f6d31016800 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ac6bb837d0 0x55ac6bb85bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.586+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb861d0 con 0x55ac6bb837d0 2024-04-23T18:29:54.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.586+0000 7f6d2c684640 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ac6bb837d0 0x55ac6bb85bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.598 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.586+0000 7f6d2c684640 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ac6bb837d0 0x55ac6bb85bc0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.587+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d1c009410 con 0x55ac6bb837d0 2024-04-23T18:29:54.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.587+0000 7f6d31016800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:54.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.587+0000 7f6d31016800 20 searching for the correct realm 2024-04-23T18:29:54.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.587+0000 7f6d31016800 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55ac6bb88180 0x55ac6bb8a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.587+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8ad10 con 0x55ac6bb88180 2024-04-23T18:29:54.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.587+0000 7f6d23fff640 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55ac6bb88180 0x55ac6bb8a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.587+0000 7f6d23fff640 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55ac6bb88180 0x55ac6bb8a640 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.587+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.587+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8ad10 con 0x55ac6bb837d0 2024-04-23T18:29:54.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.588+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1c009410 con 0x55ac6bb837d0 2024-04-23T18:29:54.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.588+0000 7f6d2c684640 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f6d1c088040 0x7f6d1c0513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.588+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8ad10 con 0x7f6d1c088040 2024-04-23T18:29:54.599 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.588+0000 7f6d2ce85640 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f6d1c088040 0x7f6d1c0513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.588+0000 7f6d2ce85640 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f6d1c088040 0x7f6d1c0513a0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.588+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2400a4a0 con 0x7f6d1c088040 2024-04-23T18:29:54.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.588+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb7ede0 2024-04-23T18:29:54.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.589+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.589+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb7ede0 2024-04-23T18:29:54.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.589+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.589+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x7f6d1c088040 2024-04-23T18:29:54.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.589+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2400a4a0 con 0x7f6d1c088040 2024-04-23T18:29:54.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.589+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x7f6d1c088040 2024-04-23T18:29:54.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.589+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6d2400a4a0 con 0x7f6d1c088040 2024-04-23T18:29:54.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.589+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb837d0 2024-04-23T18:29:54.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.589+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1c009410 con 0x55ac6bb837d0 2024-04-23T18:29:54.600 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.589+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb88180 2024-04-23T18:29:54.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.590+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.590+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb7ede0 2024-04-23T18:29:54.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.590+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.590+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x7f6d1c088040 2024-04-23T18:29:54.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.590+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2400a4a0 con 0x7f6d1c088040 2024-04-23T18:29:54.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.590+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb7ede0 2024-04-23T18:29:54.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.590+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.590+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb837d0 2024-04-23T18:29:54.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.591+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d1c009410 con 0x55ac6bb837d0 2024-04-23T18:29:54.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.591+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb88180 2024-04-23T18:29:54.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.591+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.591+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb88180 2024-04-23T18:29:54.601 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.591+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.591+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x7f6d1c088040 2024-04-23T18:29:54.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.591+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2400a4a0 con 0x7f6d1c088040 2024-04-23T18:29:54.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.591+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb88180 2024-04-23T18:29:54.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.592+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.592+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb88180 2024-04-23T18:29:54.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.592+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.592+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb7ede0 2024-04-23T18:29:54.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.592+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.592+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb7ede0 2024-04-23T18:29:54.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.592+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.592+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x7f6d1c088040 2024-04-23T18:29:54.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.592+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2400a4a0 con 0x7f6d1c088040 2024-04-23T18:29:54.602 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.592+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb88180 2024-04-23T18:29:54.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.593+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.593+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb837d0 2024-04-23T18:29:54.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.593+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d1c009410 con 0x55ac6bb837d0 2024-04-23T18:29:54.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.593+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb7ede0 2024-04-23T18:29:54.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.593+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2400a4a0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.593+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb837d0 2024-04-23T18:29:54.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.593+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1c009410 con 0x55ac6bb837d0 2024-04-23T18:29:54.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.593+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb88180 2024-04-23T18:29:54.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.594+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.594+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x7f6d1c088040 2024-04-23T18:29:54.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.594+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2400a4a0 con 0x7f6d1c088040 2024-04-23T18:29:54.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.594+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb837d0 2024-04-23T18:29:54.603 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.594+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1c0cd040 con 0x55ac6bb837d0 2024-04-23T18:29:54.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.594+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb88180 2024-04-23T18:29:54.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.594+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.594+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x7f6d1c088040 2024-04-23T18:29:54.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2400a4a0 con 0x7f6d1c088040 2024-04-23T18:29:54.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb7ede0 2024-04-23T18:29:54.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb82a70 con 0x55ac6bb837d0 2024-04-23T18:29:54.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1c0cd040 con 0x55ac6bb837d0 2024-04-23T18:29:54.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d31016800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:54.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d31016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:54.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d31016800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:54.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d31016800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:54.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d31016800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d31016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d31016800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb86a90 con 0x55ac6bb7ede0 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d31016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d31016800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.595+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb86e80 con 0x55ac6bb7ede0 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d31016800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d31016800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb86e80 con 0x7f6d1c088040 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6d24040080 con 0x7f6d1c088040 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d31016800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:54.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d31016800 20 zone default found 2024-04-23T18:29:54.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d31016800 4 Realm: () 2024-04-23T18:29:54.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d31016800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:54.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d31016800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:54.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d31016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:54.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d31016800 20 zonegroup default 2024-04-23T18:29:54.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d31016800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8b190 con 0x55ac6bb837d0 2024-04-23T18:29:54.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.596+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d1c0cd040 con 0x55ac6bb837d0 2024-04-23T18:29:54.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.597+0000 7f6d31016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.597+0000 7f6d31016800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.597+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8cf10 con 0x55ac6bb88180 2024-04-23T18:29:54.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.597+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.597+0000 7f6d31016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.597+0000 7f6d31016800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.597+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8d2b0 con 0x55ac6bb88180 2024-04-23T18:29:54.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.597+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.597+0000 7f6d31016800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.597+0000 7f6d31016800 20 started sync module instance, tier type = 2024-04-23T18:29:54.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.597+0000 7f6d31016800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:54.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.597+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8c3b0 con 0x55ac6bb837d0 2024-04-23T18:29:54.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.598+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c0cd040 con 0x55ac6bb837d0 2024-04-23T18:29:54.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.598+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94199030007712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8db00 con 0x55ac6bb837d0 2024-04-23T18:29:54.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.598+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8e350 con 0x55ac6bb7ede0 2024-04-23T18:29:54.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.599+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94199030007712] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c0cd040 con 0x55ac6bb837d0 2024-04-23T18:29:54.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.599+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.599+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94199030011472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8e350 con 0x55ac6bb7ede0 2024-04-23T18:29:54.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.599+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8ee40 con 0x55ac6bb88180 2024-04-23T18:29:54.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.602+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.602+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94199030016272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8f6e0 con 0x55ac6bb88180 2024-04-23T18:29:54.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.602+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94199030011472] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.602+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb901c0 con 0x55ac6bb837d0 2024-04-23T18:29:54.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.603+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c0cd040 con 0x55ac6bb837d0 2024-04-23T18:29:54.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.603+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94199030013600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb90a60 con 0x55ac6bb837d0 2024-04-23T18:29:54.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.603+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb91420 con 0x55ac6bb7ede0 2024-04-23T18:29:54.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.603+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94199030016272] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.604+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.604+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94199030018608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb91420 con 0x55ac6bb7ede0 2024-04-23T18:29:54.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.604+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb91de0 con 0x7f6d1c088040 2024-04-23T18:29:54.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.604+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94199030013600] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c0cd040 con 0x55ac6bb837d0 2024-04-23T18:29:54.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.605+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x7f6d1c088040 2024-04-23T18:29:54.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.605+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94199030023600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb91de0 con 0x7f6d1c088040 2024-04-23T18:29:54.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.605+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb927f0 con 0x7f6d1c088040 2024-04-23T18:29:54.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.605+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94199030018608] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.606+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94199030023600] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x7f6d1c088040 2024-04-23T18:29:54.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.606+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x7f6d1c088040 2024-04-23T18:29:54.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.606+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94199030028592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb91d50 con 0x7f6d1c088040 2024-04-23T18:29:54.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.606+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb92ca0 con 0x7f6d1c088040 2024-04-23T18:29:54.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.607+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94199030028592] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x7f6d1c088040 2024-04-23T18:29:54.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.607+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x7f6d1c088040 2024-04-23T18:29:54.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.607+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94199030031168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb92c10 con 0x7f6d1c088040 2024-04-23T18:29:54.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.607+0000 7f6d31016800 20 add_watcher() i=0 2024-04-23T18:29:54.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.607+0000 7f6d31016800 20 add_watcher() i=1 2024-04-23T18:29:54.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.607+0000 7f6d31016800 20 add_watcher() i=2 2024-04-23T18:29:54.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.607+0000 7f6d31016800 20 add_watcher() i=3 2024-04-23T18:29:54.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.607+0000 7f6d31016800 20 add_watcher() i=4 2024-04-23T18:29:54.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.607+0000 7f6d31016800 20 add_watcher() i=5 2024-04-23T18:29:54.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.607+0000 7f6d31016800 20 add_watcher() i=6 2024-04-23T18:29:54.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.608+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94199030031168] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x7f6d1c088040 2024-04-23T18:29:54.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.608+0000 7f6d31016800 20 add_watcher() i=7 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.608+0000 7f6d31016800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.608+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb96010 con 0x55ac6bb7ede0 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.609+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.609+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94199030032688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb934d0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.610+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94199030032688] v34'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.610+0000 7f6be27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.610+0000 7f6d31016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.610+0000 7f6d31016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.610+0000 7f6d31016800 5 note: GC not initialized 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.610+0000 7f6be17e2640 20 reqs_thread_entry: start 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.610+0000 7f6d31016800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.610+0000 7f6d31016800 20 Filter name: none 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.610+0000 7f6b52ffd640 20 reqs_thread_entry: start 2024-04-23T18:29:54.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.610+0000 7f6d31016800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:54.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.610+0000 7f6d31016800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.610+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bbc9800 con 0x55ac6bb7ede0 2024-04-23T18:29:54.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.611+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv16 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.611+0000 7f6d31016800 20 rados_obj.operate() r=0 bl.length=403 2024-04-23T18:29:54.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.611+0000 7f6d31016800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:54.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.611+0000 7f6d31016800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:54.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.611+0000 7f6d31016800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:54.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.611+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bbcf9f0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.612+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'17 uv17 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.612+0000 7f6d31016800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:54.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.612+0000 7f6d31016800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:54.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.612+0000 7f6d31016800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:29:54.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.612+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94199030281312 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bbcb280 con 0x55ac6bb7ede0 2024-04-23T18:29:54.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.612+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify (1) cookie 94199030018608 notify 146028888087 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f6d24018c10 con 0x55ac6bb7ede0 2024-04-23T18:29:54.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.612+0000 7f6c0b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94199030018608 notifier 4658 bl.length()=567 2024-04-23T18:29:54.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.612+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(64 notify.4 [notify cookie 94199030281312 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.612+0000 7f6c0b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-23T18:29:54.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.612+0000 7f6c0b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:54.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.612+0000 7f6c0b7fe640 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6bf0003ea0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.612+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.613+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== watch-notify(notify_complete (2) cookie 94199030281312 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d24018de0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.617 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-23T18:29:30.443774Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:29:30.443759Z","tags":[],"group_ids":[]} 2024-04-23T18:29:54.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.613+0000 7f6be27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:54.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.613+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94199030032688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb95ba0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.614+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94199030032688] v34'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.614+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94199030007712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb92900 con 0x55ac6bb837d0 2024-04-23T18:29:54.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.615+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94199030007712] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c0cd040 con 0x55ac6bb837d0 2024-04-23T18:29:54.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.615+0000 7f6d31016800 20 remove_watcher() i=0 2024-04-23T18:29:54.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.615+0000 7f6d31016800 2 removed watcher, disabling cache 2024-04-23T18:29:54.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.615+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94199030011472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8c7a0 con 0x55ac6bb7ede0 2024-04-23T18:29:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.616+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94199030011472] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.616+0000 7f6d31016800 20 remove_watcher() i=1 2024-04-23T18:29:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.616+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94199030016272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8c7a0 con 0x55ac6bb88180 2024-04-23T18:29:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.617+0000 7f6d23fff640 1 -- 172.21.15.119:0/1658243245 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94199030016272] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d14009050 con 0x55ac6bb88180 2024-04-23T18:29:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.617+0000 7f6d31016800 20 remove_watcher() i=2 2024-04-23T18:29:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.617+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94199030013600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8d650 con 0x55ac6bb837d0 2024-04-23T18:29:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.618+0000 7f6d2c684640 1 -- 172.21.15.119:0/1658243245 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94199030013600] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c0cd040 con 0x55ac6bb837d0 2024-04-23T18:29:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.618+0000 7f6d31016800 20 remove_watcher() i=3 2024-04-23T18:29:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.618+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94199030018608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8d650 con 0x55ac6bb7ede0 2024-04-23T18:29:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.619+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94199030018608] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x55ac6bb7ede0 2024-04-23T18:29:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.619+0000 7f6d31016800 20 remove_watcher() i=4 2024-04-23T18:29:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.619+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94199030023600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8d650 con 0x7f6d1c088040 2024-04-23T18:29:54.624 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.620+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94199030023600] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x7f6d1c088040 2024-04-23T18:29:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.620+0000 7f6d31016800 20 remove_watcher() i=5 2024-04-23T18:29:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.620+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94199030028592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb905b0 con 0x7f6d1c088040 2024-04-23T18:29:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.621+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94199030028592] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x7f6d1c088040 2024-04-23T18:29:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.621+0000 7f6d31016800 20 remove_watcher() i=6 2024-04-23T18:29:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.621+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94199030031168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6bb8d650 con 0x7f6d1c088040 2024-04-23T18:29:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94199030031168] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d24040080 con 0x7f6d1c088040 2024-04-23T18:29:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 20 remove_watcher() i=7 2024-04-23T18:29:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f6d1c088040 msgr2=0x7f6d1c0513a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f6d1c088040 0x7f6d1c0513a0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ac6bb7ede0 msgr2=0x55ac6bb812a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.625 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ac6bb7ede0 0x55ac6bb812a0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ac6bb837d0 msgr2=0x55ac6bb85bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ac6bb837d0 0x55ac6bb85bc0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55ac6bb88180 msgr2=0x55ac6bb8a640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55ac6bb88180 0x55ac6bb8a640 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6bfc036e60 msgr2=0x7f6bfc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6bfc036e60 0x7f6bfc039320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6d14001b60 tx=0x7f6d14010000 comp rx=0 tx=0).stop 2024-04-23T18:29:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 msgr2=0x55ac6bb73690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d2ce85640 1 -- 172.21.15.119:0/1658243245 reap_dead start 2024-04-23T18:29:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 0x55ac6bb73690 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c098b70 tx=0x7f6d1c061f70 comp rx=0 tx=0).stop 2024-04-23T18:29:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 shutdown_connections 2024-04-23T18:29:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 --2- 172.21.15.119:0/1658243245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb6c330 0x55ac6bb73690 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 >> 172.21.15.119:0/1658243245 conn(0x55ac6bb68600 msgr2=0x55ac6bb65c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 shutdown_connections 2024-04-23T18:29:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.622+0000 7f6d31016800 1 -- 172.21.15.119:0/1658243245 wait complete. 2024-04-23T18:29:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3137676941 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c04036e60 msgr2=0x7f6c04039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 --2- 172.21.15.119:0/3137676941 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c04036e60 0x7f6c04039320 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400bf50 tx=0x7f6d1400f000 comp rx=0 tx=0).stop 2024-04-23T18:29:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3137676941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb5f1d0 msgr2=0x55ac6bb5f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 --2- 172.21.15.119:0/3137676941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb5f1d0 0x55ac6bb5f5f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c08cef0 tx=0x7f6d1c009a60 comp rx=0 tx=0).stop 2024-04-23T18:29:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3137676941 shutdown_connections 2024-04-23T18:29:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 --2- 172.21.15.119:0/3137676941 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c04036e60 0x7f6c04039320 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 --2- 172.21.15.119:0/3137676941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6bb5f1d0 0x55ac6bb5f5f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3137676941 >> 172.21.15.119:0/3137676941 conn(0x55ac6bb53270 msgr2=0x55ac6bb53670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3137676941 shutdown_connections 2024-04-23T18:29:54.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3137676941 wait complete. 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55ac6bb4e1c0 msgr2=0x55ac6bb50610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55ac6bb4e1c0 0x55ac6bb50610 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ac6ba4b340 msgr2=0x55ac6bb479d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55ac6ba4b340 0x55ac6bb479d0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ac6bb4a280 msgr2=0x55ac6bb4c670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55ac6bb4a280 0x55ac6bb4c670 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c14036e60 msgr2=0x7f6c14039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6c14036e60 0x7f6c14039320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6d14000f60 tx=0x7f6d140012b0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 msgr2=0x55ac6bb40960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 --2- 172.21.15.119:0/3711923331 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ac6ba48a10 0x55ac6bb40960 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c000c00 tx=0x7f6d1c002fb0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d2ce85640 1 -- 172.21.15.119:0/3711923331 reap_dead start 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 shutdown_connections 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 >> 172.21.15.119:0/3711923331 conn(0x55ac6ba42440 msgr2=0x55ac6bb37b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 shutdown_connections 2024-04-23T18:29:54.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.623+0000 7f6d31016800 1 -- 172.21.15.119:0/3711923331 wait complete. 2024-04-23T18:29:54.629 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-23T18:29:30.443774Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:29:30.443759Z', 'tags': [], 'group_ids': []} 2024-04-23T18:29:54.642 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:54.642 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-23T18:29:54.642 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-23T18:29:54.642 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-23T18:29:54.685 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:29:54.685 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:29:54.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.693+0000 7fa9a3f75800 1 Processor -- start 2024-04-23T18:29:54.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.693+0000 7fa9a3f75800 1 -- start start 2024-04-23T18:29:54.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.693+0000 7fa9a3f75800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e958fae3d0 0x55e958fb6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.693+0000 7fa9a3f75800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e958e5e560 con 0x55e958fac890 2024-04-23T18:29:54.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.693+0000 7fa9a3f75800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55e958e4fe20 con 0x55e958fae3d0 2024-04-23T18:29:54.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.694+0000 7fa99927a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e958fae3d0 0x55e958fb6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.694+0000 7fa99927a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e958fae3d0 0x55e958fb6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36376/0 (socket says 172.21.15.119:36376) 2024-04-23T18:29:54.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.694+0000 7fa9a1a7b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55e958fac890 0x55e958faccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:43676/0 (socket says 172.21.15.119:43676) 2024-04-23T18:29:54.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.694+0000 7fa99927a640 1 -- 172.21.15.119:0/3789409439 learned_addr learned my addr 172.21.15.119:0/3789409439 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.694+0000 7fa99927a640 1 -- 172.21.15.119:0/3789409439 >> v1:172.21.15.62:6789/0 conn(0x55e958fac890 legacy=0x55e958faccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.694+0000 7fa99927a640 1 -- 172.21.15.119:0/3789409439 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e958e5de60 con 0x55e958fae3d0 2024-04-23T18:29:54.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.696+0000 7fa99927a640 1 --2- 172.21.15.119:0/3789409439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fae3d0 0x55e958fb6ed0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00a520 tx=0x7fa98c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5245edb810dd3a2d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.696+0000 7fa9a127a640 1 -- 172.21.15.119:0/3789409439 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa98c057070 con 0x55e958fae3d0 2024-04-23T18:29:54.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.696+0000 7fa9a127a640 1 -- 172.21.15.119:0/3789409439 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa98c052440 con 0x55e958fae3d0 2024-04-23T18:29:54.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.696+0000 7fa9a127a640 1 -- 172.21.15.119:0/3789409439 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa98c04ae60 con 0x55e958fae3d0 2024-04-23T18:29:54.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.696+0000 7fa9a3f75800 1 -- 172.21.15.119:0/3789409439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fae3d0 msgr2=0x55e958fb6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.696+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/3789409439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fae3d0 0x55e958fb6ed0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00a520 tx=0x7fa98c01d010 comp rx=0 tx=0).stop 2024-04-23T18:29:54.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.696+0000 7fa9a3f75800 1 -- 172.21.15.119:0/3789409439 shutdown_connections 2024-04-23T18:29:54.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.696+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/3789409439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fae3d0 0x55e958fb6ed0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.696+0000 7fa9a3f75800 1 -- 172.21.15.119:0/3789409439 >> 172.21.15.119:0/3789409439 conn(0x55e958fa8410 msgr2=0x55e958faa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.696+0000 7fa9a3f75800 1 -- 172.21.15.119:0/3789409439 shutdown_connections 2024-04-23T18:29:54.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.696+0000 7fa9a3f75800 1 -- 172.21.15.119:0/3789409439 wait complete. 2024-04-23T18:29:54.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.708+0000 7fa9a3f75800 1 Processor -- start 2024-04-23T18:29:54.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.708+0000 7fa9a3f75800 1 -- start start 2024-04-23T18:29:54.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.708+0000 7fa9a3f75800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fac890 0x55e9590a1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.708+0000 7fa9a3f75800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e958ef95b0 con 0x55e958fac890 2024-04-23T18:29:54.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.709+0000 7fa9a1a7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fac890 0x55e9590a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.709+0000 7fa9a1a7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fac890 0x55e9590a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36392/0 (socket says 172.21.15.119:36392) 2024-04-23T18:29:54.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.709+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/1611504542 learned_addr learned my addr 172.21.15.119:0/1611504542 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.709+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/1611504542 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e958e6f860 con 0x55e958fac890 2024-04-23T18:29:54.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.709+0000 7fa9a1a7b640 1 --2- 172.21.15.119:0/1611504542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fac890 0x55e9590a1570 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa994001e10 tx=0x7fa99400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b93a0ee8406ee61 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.709+0000 7fa88fe07640 1 -- 172.21.15.119:0/1611504542 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99400e5c0 con 0x55e958fac890 2024-04-23T18:29:54.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.709+0000 7fa88fe07640 1 -- 172.21.15.119:0/1611504542 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa994006070 con 0x55e958fac890 2024-04-23T18:29:54.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.709+0000 7fa88fe07640 1 -- 172.21.15.119:0/1611504542 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99400e930 con 0x55e958fac890 2024-04-23T18:29:54.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.710+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1611504542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fac890 msgr2=0x55e9590a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.710+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/1611504542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fac890 0x55e9590a1570 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa994001e10 tx=0x7fa99400b6c0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.710+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1611504542 shutdown_connections 2024-04-23T18:29:54.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.710+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/1611504542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fac890 0x55e9590a1570 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.710+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1611504542 >> 172.21.15.119:0/1611504542 conn(0x55e958fa8410 msgr2=0x55e95909ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.710+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1611504542 shutdown_connections 2024-04-23T18:29:54.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.710+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1611504542 wait complete. 2024-04-23T18:29:54.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.710+0000 7fa9a3f75800 1 Processor -- start 2024-04-23T18:29:54.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.710+0000 7fa9a3f75800 1 -- start start 2024-04-23T18:29:54.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.710+0000 7fa9a3f75800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fac890 0x55e9590a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.710+0000 7fa9a3f75800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e958fb96f0 con 0x55e958fac890 2024-04-23T18:29:54.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.711+0000 7fa9a1a7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fac890 0x55e9590a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.711+0000 7fa9a1a7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fac890 0x55e9590a8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36398/0 (socket says 172.21.15.119:36398) 2024-04-23T18:29:54.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.711+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/307170742 learned_addr learned my addr 172.21.15.119:0/307170742 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.711+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/307170742 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e958e6deb0 con 0x55e958fac890 2024-04-23T18:29:54.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.711+0000 7fa9a1a7b640 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fac890 0x55e9590a8f40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa99400b700 tx=0x7fa994000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.711+0000 7fa88e604640 1 -- 172.21.15.119:0/307170742 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99400f8d0 con 0x55e958fac890 2024-04-23T18:29:54.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.711+0000 7fa88e604640 1 -- 172.21.15.119:0/307170742 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99400fa70 con 0x55e958fac890 2024-04-23T18:29:54.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.711+0000 7fa88e604640 1 -- 172.21.15.119:0/307170742 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99400fd50 con 0x55e958fac890 2024-04-23T18:29:54.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.711+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9590a9480 con 0x55e958fac890 2024-04-23T18:29:54.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.711+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9590a99a0 con 0x55e958fac890 2024-04-23T18:29:54.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.712+0000 7fa88e604640 1 -- 172.21.15.119:0/307170742 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa994017070 con 0x55e958fac890 2024-04-23T18:29:54.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.712+0000 7fa88e604640 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa888036e60 0x7fa888039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.712+0000 7fa88e604640 1 -- 172.21.15.119:0/307170742 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fa994015020 con 0x55e958fac890 2024-04-23T18:29:54.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.712+0000 7fa99927a640 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa888036e60 0x7fa888039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.713+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e958fae3d0 0x55e9590aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.713+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590b04f0 con 0x55e958fae3d0 2024-04-23T18:29:54.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.713+0000 7fa9a227c640 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e958fae3d0 0x55e9590aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.713+0000 7fa99927a640 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa888036e60 0x7fa888039320 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa98c054000 tx=0x7fa98c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.713+0000 7fa9a227c640 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e958fae3d0 0x55e9590aff60 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.713+0000 7fa9a227c640 1 -- 172.21.15.119:0/307170742 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e958fae3d0 2024-04-23T18:29:54.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.713+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590ad530 con 0x55e958fae3d0 2024-04-23T18:29:54.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.713+0000 7fa9a227c640 1 -- 172.21.15.119:0/307170742 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e958fae3d0 2024-04-23T18:29:54.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.714+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e9590b2840 0x55e9590b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.714+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590b52d0 con 0x55e9590b2840 2024-04-23T18:29:54.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.714+0000 7fa9a1a7b640 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e9590b2840 0x55e9590b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.714+0000 7fa9a1a7b640 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e9590b2840 0x55e9590b4c30 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.714+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/307170742 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590b2840 2024-04-23T18:29:54.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.714+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590b17f0 con 0x55e958fae3d0 2024-04-23T18:29:54.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.714+0000 7fa9a227c640 1 -- 172.21.15.119:0/307170742 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e958fae3d0 2024-04-23T18:29:54.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.714+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e9590b6780 0x55e9590b8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.714+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590b9330 con 0x55e9590b6780 2024-04-23T18:29:54.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.715+0000 7fa99927a640 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e9590b6780 0x55e9590b8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.715+0000 7fa99927a640 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e9590b6780 0x55e9590b8bd0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.715+0000 7fa99927a640 1 -- 172.21.15.119:0/307170742 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa98c05a040 con 0x55e9590b6780 2024-04-23T18:29:54.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.716+0000 7fa9a3f75800 1 Processor -- start 2024-04-23T18:29:54.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.716+0000 7fa9a3f75800 1 -- start start 2024-04-23T18:29:54.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.716+0000 7fa9a3f75800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590c7790 0x55e9590c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.716+0000 7fa9a3f75800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e958e9fdf0 con 0x55e9590c7790 2024-04-23T18:29:54.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.716+0000 7fa9a1a7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590c7790 0x55e9590c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.716+0000 7fa9a1a7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590c7790 0x55e9590c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36414/0 (socket says 172.21.15.119:36414) 2024-04-23T18:29:54.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.716+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/1210432833 learned_addr learned my addr 172.21.15.119:0/1210432833 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.716+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/1210432833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9590c80f0 con 0x55e9590c7790 2024-04-23T18:29:54.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.716+0000 7fa9a1a7b640 1 --2- 172.21.15.119:0/1210432833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590c7790 0x55e9590c7bb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa99404bb70 tx=0x7fa994017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.716+0000 7fa8877fe640 1 -- 172.21.15.119:0/1210432833 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99401ae10 con 0x55e9590c7790 2024-04-23T18:29:54.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.716+0000 7fa8877fe640 1 -- 172.21.15.119:0/1210432833 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa994045b10 con 0x55e9590c7790 2024-04-23T18:29:54.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.716+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1210432833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9590c8b60 con 0x55e9590c7790 2024-04-23T18:29:54.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.716+0000 7fa8877fe640 1 -- 172.21.15.119:0/1210432833 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994045df0 con 0x55e9590c7790 2024-04-23T18:29:54.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.717+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1210432833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9590c9060 con 0x55e9590c7790 2024-04-23T18:29:54.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.717+0000 7fa8877fe640 1 -- 172.21.15.119:0/1210432833 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa9940451a0 con 0x55e9590c7790 2024-04-23T18:29:54.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.717+0000 7fa8877fe640 1 --2- 172.21.15.119:0/1210432833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa87c036eb0 0x7fa87c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.717+0000 7fa8877fe640 1 -- 172.21.15.119:0/1210432833 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fa99403dd00 con 0x55e9590c7790 2024-04-23T18:29:54.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.717+0000 7fa99927a640 1 --2- 172.21.15.119:0/1210432833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa87c036eb0 0x7fa87c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.718+0000 7fa9a3f75800 1 Processor -- start 2024-04-23T18:29:54.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.718+0000 7fa9a3f75800 1 -- start start 2024-04-23T18:29:54.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.718+0000 7fa99927a640 1 --2- 172.21.15.119:0/1210432833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa87c036eb0 0x7fa87c039370 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55e9590ad450 tx=0x7fa98c005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.718+0000 7fa9a3f75800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 0x55e9590d4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.718+0000 7fa9a3f75800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e9590a1cf0 con 0x55e9590d4880 2024-04-23T18:29:54.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.718+0000 7fa9a1a7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 0x55e9590d4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.718+0000 7fa9a1a7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 0x55e9590d4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36420/0 (socket says 172.21.15.119:36420) 2024-04-23T18:29:54.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.718+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/1114301390 learned_addr learned my addr 172.21.15.119:0/1114301390 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.718+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/1114301390 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9590d5270 con 0x55e9590d4880 2024-04-23T18:29:54.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.718+0000 7fa9a1a7b640 1 --2- 172.21.15.119:0/1114301390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 0x55e9590d4ca0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa99401aac0 tx=0x7fa99400c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d35654ec46e51b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.718+0000 7fa8857fa640 1 -- 172.21.15.119:0/1114301390 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994019d80 con 0x55e9590d4880 2024-04-23T18:29:54.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.718+0000 7fa8857fa640 1 -- 172.21.15.119:0/1114301390 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99405e020 con 0x55e9590d4880 2024-04-23T18:29:54.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.719+0000 7fa8857fa640 1 -- 172.21.15.119:0/1114301390 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9940199b0 con 0x55e9590d4880 2024-04-23T18:29:54.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.719+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1114301390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 msgr2=0x55e9590d4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.719+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/1114301390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 0x55e9590d4ca0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa99401aac0 tx=0x7fa99400c360 comp rx=0 tx=0).stop 2024-04-23T18:29:54.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.719+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1114301390 shutdown_connections 2024-04-23T18:29:54.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.719+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/1114301390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 0x55e9590d4ca0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.719+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1114301390 >> 172.21.15.119:0/1114301390 conn(0x55e9590d0be0 msgr2=0x55e9590cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.719+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1114301390 shutdown_connections 2024-04-23T18:29:54.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.719+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1114301390 wait complete. 2024-04-23T18:29:54.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.719+0000 7fa9a3f75800 1 Processor -- start 2024-04-23T18:29:54.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.719+0000 7fa9a3f75800 1 -- start start 2024-04-23T18:29:54.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.719+0000 7fa9a3f75800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 0x55e9590dbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.719+0000 7fa9a3f75800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e9590d5920 con 0x55e9590d4880 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.720+0000 7fa9a1a7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 0x55e9590dbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.720+0000 7fa9a1a7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 0x55e9590dbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36436/0 (socket says 172.21.15.119:36436) 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.720+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 learned_addr learned my addr 172.21.15.119:0/4203808187 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.720+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9590dc1a0 con 0x55e9590d4880 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.720+0000 7fa9a1a7b640 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 0x55e9590dbc60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa99400c460 tx=0x7fa99401ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.720+0000 7fa8737fe640 1 -- 172.21.15.119:0/4203808187 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994019860 con 0x55e9590d4880 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.720+0000 7fa8737fe640 1 -- 172.21.15.119:0/4203808187 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99401dad0 con 0x55e9590d4880 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.720+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9590dc1a0 con 0x55e9590d4880 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.720+0000 7fa8737fe640 1 -- 172.21.15.119:0/4203808187 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994019a00 con 0x55e9590d4880 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.720+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9590dc1a0 con 0x55e9590d4880 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.721+0000 7fa8737fe640 1 -- 172.21.15.119:0/4203808187 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa99404d9b0 con 0x55e9590d4880 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.721+0000 7fa8737fe640 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa86c036e60 0x7fa86c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.721+0000 7fa8737fe640 1 -- 172.21.15.119:0/4203808187 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fa99406c030 con 0x55e9590d4880 2024-04-23T18:29:54.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.721+0000 7fa99927a640 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa86c036e60 0x7fa86c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa99927a640 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa86c036e60 0x7fa86c039320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55e9590b9730 tx=0x7fa98c04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa9a3f75800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e9590e73d0 0x55e9590e9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590e9fe0 con 0x55e9590e73d0 2024-04-23T18:29:54.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa9a227c640 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e9590e73d0 0x55e9590e9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa9a227c640 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e9590e73d0 0x55e9590e9890 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e9590e73d0 2024-04-23T18:29:54.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa9a3f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa9a3f75800 20 realm 2024-04-23T18:29:54.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa9a3f75800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590ea3f0 con 0x55e9590e73d0 2024-04-23T18:29:54.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e9590e73d0 2024-04-23T18:29:54.734 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa9a3f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.722+0000 7fa9a3f75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:29:54.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.723+0000 7fa9a3f75800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.723+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eacc0 con 0x55e9590e73d0 2024-04-23T18:29:54.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.723+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e9590e73d0 2024-04-23T18:29:54.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.723+0000 7fa9a3f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.723+0000 7fa9a3f75800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.723+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590e73d0 2024-04-23T18:29:54.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.723+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e9590e73d0 2024-04-23T18:29:54.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.723+0000 7fa9a3f75800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:54.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.723+0000 7fa9a3f75800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.723+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e9590ebdc0 0x55e9590ee1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.723+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590ee7c0 con 0x55e9590ebdc0 2024-04-23T18:29:54.735 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.723+0000 7fa9a1a7b640 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e9590ebdc0 0x55e9590ee1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.723+0000 7fa9a1a7b640 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e9590ebdc0 0x55e9590ee1b0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.724+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.724+0000 7fa9a3f75800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:29:54.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.724+0000 7fa9a3f75800 20 searching for the correct realm 2024-04-23T18:29:54.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.724+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e9590f0770 0x55e9590f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.724+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f3300 con 0x55e9590f0770 2024-04-23T18:29:54.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.724+0000 7fa99927a640 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e9590f0770 0x55e9590f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.724+0000 7fa99927a640 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e9590f0770 0x55e9590f2c30 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.724+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.724+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f3300 con 0x55e9590ebdc0 2024-04-23T18:29:54.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.725+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.725+0000 7fa9a1a7b640 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa99400f070 0x7fa9940266d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:29:54.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.725+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f3300 con 0x7fa99400f070 2024-04-23T18:29:54.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.725+0000 7fa9a227c640 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa99400f070 0x7fa9940266d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:29:54.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.725+0000 7fa9a227c640 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa99400f070 0x7fa9940266d0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:29:54.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.725+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c00a4a0 con 0x7fa99400f070 2024-04-23T18:29:54.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.725+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590e73d0 2024-04-23T18:29:54.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.726+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e9590e73d0 2024-04-23T18:29:54.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.726+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590e73d0 2024-04-23T18:29:54.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.726+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e9590e73d0 2024-04-23T18:29:54.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.726+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x7fa99400f070 2024-04-23T18:29:54.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.726+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c00a4a0 con 0x7fa99400f070 2024-04-23T18:29:54.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.726+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x7fa99400f070 2024-04-23T18:29:54.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.726+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa99c00a4a0 con 0x7fa99400f070 2024-04-23T18:29:54.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.726+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590ebdc0 2024-04-23T18:29:54.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.727+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.727+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590f0770 2024-04-23T18:29:54.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.727+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.727+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590e73d0 2024-04-23T18:29:54.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.727+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e9590e73d0 2024-04-23T18:29:54.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.727+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x7fa99400f070 2024-04-23T18:29:54.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.727+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c00a4a0 con 0x7fa99400f070 2024-04-23T18:29:54.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.727+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590e73d0 2024-04-23T18:29:54.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.728+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e9590e73d0 2024-04-23T18:29:54.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.728+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590ebdc0 2024-04-23T18:29:54.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.728+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.728+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590f0770 2024-04-23T18:29:54.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.728+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.728+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590f0770 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.728+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.728+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x7fa99400f070 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.729+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c00a4a0 con 0x7fa99400f070 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.729+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590f0770 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.729+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.729+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590f0770 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.729+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.729+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590e73d0 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.729+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e9590e73d0 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.729+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590e73d0 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.729+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e9590e73d0 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.729+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x7fa99400f070 2024-04-23T18:29:54.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.730+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c00a4a0 con 0x7fa99400f070 2024-04-23T18:29:54.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.730+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590f0770 2024-04-23T18:29:54.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.730+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.730+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590ebdc0 2024-04-23T18:29:54.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.730+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.730+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590e73d0 2024-04-23T18:29:54.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.731+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c00a4a0 con 0x55e9590e73d0 2024-04-23T18:29:54.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.731+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590ebdc0 2024-04-23T18:29:54.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.731+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.731+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590f0770 2024-04-23T18:29:54.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.731+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.731+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x7fa99400f070 2024-04-23T18:29:54.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.731+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c00a4a0 con 0x7fa99400f070 2024-04-23T18:29:54.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.731+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590ebdc0 2024-04-23T18:29:54.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.731+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.732+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590f0770 2024-04-23T18:29:54.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.732+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.732+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x7fa99400f070 2024-04-23T18:29:54.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.732+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c00a4a0 con 0x7fa99400f070 2024-04-23T18:29:54.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.732+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590e73d0 2024-04-23T18:29:54.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.732+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.732+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eb060 con 0x55e9590ebdc0 2024-04-23T18:29:54.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.732+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:29:54.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:29:54.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:29:54.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:29:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:29:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:29:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590ef080 con 0x55e9590e73d0 2024-04-23T18:29:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590ef470 con 0x55e9590e73d0 2024-04-23T18:29:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:29:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590ef470 con 0x7fa99400f070 2024-04-23T18:29:54.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 zone default found 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 4 Realm: () 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 zonegroup default 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.733+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590eec60 con 0x55e9590ebdc0 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.734+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.734+0000 7fa9a3f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.734+0000 7fa9a3f75800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.734+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f5160 con 0x55e9590f0770 2024-04-23T18:29:54.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.734+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.734+0000 7fa9a3f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.734+0000 7fa9a3f75800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.734+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f55a0 con 0x55e9590f0770 2024-04-23T18:29:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.734+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.734+0000 7fa9a3f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:29:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.734+0000 7fa9a3f75800 20 started sync module instance, tier type = 2024-04-23T18:29:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.734+0000 7fa9a3f75800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:29:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.734+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f4600 con 0x55e9590ebdc0 2024-04-23T18:29:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.735+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.735+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94460709915120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f5eb0 con 0x55e9590ebdc0 2024-04-23T18:29:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.735+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f6700 con 0x55e9590e73d0 2024-04-23T18:29:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.737+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.737+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94460709921632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f6d70 con 0x55e9590e73d0 2024-04-23T18:29:54.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.737+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f7890 con 0x55e9590f0770 2024-04-23T18:29:54.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.738+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94460709921632] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.738+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94460709915120] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.738+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.738+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94460709919232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f67c0 con 0x55e9590f0770 2024-04-23T18:29:54.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.738+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f82a0 con 0x55e9590ebdc0 2024-04-23T18:29:54.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.739+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94460709919232] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.739+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.739+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94460709925728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f8af0 con 0x55e9590ebdc0 2024-04-23T18:29:54.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.739+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f9340 con 0x55e9590e73d0 2024-04-23T18:29:54.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.740+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.740+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94460709932288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f9770 con 0x55e9590e73d0 2024-04-23T18:29:54.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.740+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590fa290 con 0x7fa99400f070 2024-04-23T18:29:54.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.740+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94460709925728] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.741+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.741+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94460709936480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590fa250 con 0x7fa99400f070 2024-04-23T18:29:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.741+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590faca0 con 0x7fa99400f070 2024-04-23T18:29:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.741+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94460709932288] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.742+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94460709936480] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.742+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.742+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94460709930560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590fa7f0 con 0x7fa99400f070 2024-04-23T18:29:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.742+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590fb1b0 con 0x7fa99400f070 2024-04-23T18:29:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.743+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(58 notify.7 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.743+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94460709940480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590fb5d0 con 0x7fa99400f070 2024-04-23T18:29:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.743+0000 7fa9a3f75800 20 add_watcher() i=0 2024-04-23T18:29:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.743+0000 7fa9a3f75800 20 add_watcher() i=1 2024-04-23T18:29:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.743+0000 7fa9a3f75800 20 add_watcher() i=2 2024-04-23T18:29:54.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.743+0000 7fa9a3f75800 20 add_watcher() i=3 2024-04-23T18:29:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.743+0000 7fa9a3f75800 20 add_watcher() i=4 2024-04-23T18:29:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.743+0000 7fa9a3f75800 20 add_watcher() i=5 2024-04-23T18:29:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.743+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94460709930560] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.743+0000 7fa9a3f75800 20 add_watcher() i=6 2024-04-23T18:29:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.744+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94460709940480] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.744+0000 7fa9a3f75800 20 add_watcher() i=7 2024-04-23T18:29:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.744+0000 7fa9a3f75800 2 all 8 watchers are set, enabling cache 2024-04-23T18:29:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.744+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f91c0 con 0x55e9590e73d0 2024-04-23T18:29:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.745+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.745+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94460709941536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f91c0 con 0x55e9590e73d0 2024-04-23T18:29:54.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.746+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94460709941536] v34'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.746+0000 7fa8537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.746+0000 7fa9a3f75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:29:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.746+0000 7fa9a3f75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:29:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.746+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959107260 con 0x55e9590e73d0 2024-04-23T18:29:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.747+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.747+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9591078b0 con 0x7fa99400f070 2024-04-23T18:29:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.748+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.748+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959107d10 con 0x55e9590f0770 2024-04-23T18:29:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.749+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.749+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959108730 con 0x55e9590e73d0 2024-04-23T18:29:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.750+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'193 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.750+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959102e70 con 0x55e9590ebdc0 2024-04-23T18:29:54.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.751+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.751+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959102e70 con 0x55e9590f0770 2024-04-23T18:29:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.752+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.752+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959109290 con 0x55e9590e73d0 2024-04-23T18:29:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.753+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.753+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959109740 con 0x7fa99400f070 2024-04-23T18:29:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.754+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.754+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959109740 con 0x55e9590ebdc0 2024-04-23T18:29:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.755+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.755+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9591097d0 con 0x55e9590f0770 2024-04-23T18:29:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.756+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.756+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959109dc0 con 0x55e9590ebdc0 2024-04-23T18:29:54.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.757+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.757+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959109d60 con 0x7fa99400f070 2024-04-23T18:29:54.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.758+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.758+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959109d60 con 0x55e9590ebdc0 2024-04-23T18:29:54.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.759+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.759+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959109d60 con 0x7fa99400f070 2024-04-23T18:29:54.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.760+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.760+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959109cd0 con 0x55e9590e73d0 2024-04-23T18:29:54.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.761+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'194 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.761+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959109cd0 con 0x55e9590f0770 2024-04-23T18:29:54.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.762+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'59 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.762+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959109cd0 con 0x55e9590ebdc0 2024-04-23T18:29:54.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.763+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.763+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x55e9590f0770 2024-04-23T18:29:54.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.764+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.764+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x55e9590e73d0 2024-04-23T18:29:54.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.765+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.765+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x55e9590e73d0 2024-04-23T18:29:54.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.766+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'195 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.766+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x55e9590f0770 2024-04-23T18:29:54.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.767+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'60 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.767+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x55e9590ebdc0 2024-04-23T18:29:54.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.768+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.768+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x55e9590f0770 2024-04-23T18:29:54.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.769+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.769+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x55e9590f0770 2024-04-23T18:29:54.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.770+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.770+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x55e9590f0770 2024-04-23T18:29:54.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.771+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.771+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x55e9590f0770 2024-04-23T18:29:54.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.772+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.772+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x7fa99400f070 2024-04-23T18:29:54.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.773+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.773+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x55e9590f0770 2024-04-23T18:29:54.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.774+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.774+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x7fa99400f070 2024-04-23T18:29:54.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.775+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'45 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.775+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x55e9590f0770 2024-04-23T18:29:54.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.776+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'61 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.776+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x7fa99400f070 2024-04-23T18:29:54.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.777+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.777+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e95910a160 con 0x55e9590ebdc0 2024-04-23T18:29:54.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.777+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.777+0000 7fa8527fc640 20 reqs_thread_entry: start 2024-04-23T18:29:54.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.777+0000 7fa9a3f75800 20 init_complete bucket index max shards: 11 2024-04-23T18:29:54.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.777+0000 7fa9a3f75800 20 Filter name: none 2024-04-23T18:29:54.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.777+0000 7fa7c3fff640 20 reqs_thread_entry: start 2024-04-23T18:29:54.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.777+0000 7fa9a3f75800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:29:54.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.777+0000 7fa9a3f75800 20 rados->read ofs=0 len=0 2024-04-23T18:29:54.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.777+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e9591351c0 con 0x55e9590e73d0 2024-04-23T18:29:54.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.778+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.778+0000 7fa9a3f75800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:29:54.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.778+0000 7fa9a3f75800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:29:54.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.778+0000 7fa9a3f75800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:29:54.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.778+0000 7fa9a3f75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:29:54.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.778+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e959135120 con 0x55e9590ebdc0 2024-04-23T18:29:54.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.778+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.773 INFO:teuthology.orchestra.run.smithi119.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-23T18:29:54.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.779+0000 7fa8537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:29:54.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.779+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94460709941536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e959105be0 con 0x55e9590e73d0 2024-04-23T18:29:54.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.780+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94460709941536] v34'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.780+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94460709915120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590fb120 con 0x55e9590ebdc0 2024-04-23T18:29:54.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.781+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94460709915120] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.781+0000 7fa9a3f75800 20 remove_watcher() i=0 2024-04-23T18:29:54.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.781+0000 7fa9a3f75800 2 removed watcher, disabling cache 2024-04-23T18:29:54.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.781+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94460709921632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590fb120 con 0x55e9590e73d0 2024-04-23T18:29:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.782+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94460709921632] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.782+0000 7fa9a3f75800 20 remove_watcher() i=1 2024-04-23T18:29:54.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.782+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94460709919232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f6360 con 0x55e9590f0770 2024-04-23T18:29:54.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.783+0000 7fa99927a640 1 -- 172.21.15.119:0/4203808187 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94460709919232] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c07f070 con 0x55e9590f0770 2024-04-23T18:29:54.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.783+0000 7fa9a3f75800 20 remove_watcher() i=2 2024-04-23T18:29:54.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.783+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94460709925728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590fb120 con 0x55e9590ebdc0 2024-04-23T18:29:54.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.784+0000 7fa9a1a7b640 1 -- 172.21.15.119:0/4203808187 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94460709925728] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99402e070 con 0x55e9590ebdc0 2024-04-23T18:29:54.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.784+0000 7fa9a3f75800 20 remove_watcher() i=3 2024-04-23T18:29:54.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.784+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94460709932288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f5a00 con 0x55e9590e73d0 2024-04-23T18:29:54.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.785+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94460709932288] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x55e9590e73d0 2024-04-23T18:29:54.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.785+0000 7fa9a3f75800 20 remove_watcher() i=4 2024-04-23T18:29:54.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.785+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94460709936480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590fb120 con 0x7fa99400f070 2024-04-23T18:29:54.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.786+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94460709936480] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.786+0000 7fa9a3f75800 20 remove_watcher() i=5 2024-04-23T18:29:54.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.786+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94460709930560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f8d00 con 0x7fa99400f070 2024-04-23T18:29:54.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.787+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94460709930560] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.787+0000 7fa9a3f75800 20 remove_watcher() i=6 2024-04-23T18:29:54.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.787+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94460709940480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e9590f5a00 con 0x7fa99400f070 2024-04-23T18:29:54.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94460709940480] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c040080 con 0x7fa99400f070 2024-04-23T18:29:54.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 20 remove_watcher() i=7 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa99400f070 msgr2=0x7fa9940266d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa99400f070 0x7fa9940266d0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e9590e73d0 msgr2=0x55e9590e9890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e9590e73d0 0x55e9590e9890 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e9590ebdc0 msgr2=0x55e9590ee1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e9590ebdc0 0x55e9590ee1b0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e9590f0770 msgr2=0x55e9590f2c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e9590f0770 0x55e9590f2c30 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa86c036e60 msgr2=0x7fa86c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa86c036e60 0x7fa86c039320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55e9590b9730 tx=0x7fa98c04f000 comp rx=0 tx=0).stop 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a227c640 1 -- 172.21.15.119:0/4203808187 reap_dead start 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 msgr2=0x55e9590dbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 0x55e9590dbc60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa99400c460 tx=0x7fa99401ff30 comp rx=0 tx=0).stop 2024-04-23T18:29:54.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 shutdown_connections 2024-04-23T18:29:54.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/4203808187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590d4880 0x55e9590dbc60 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 >> 172.21.15.119:0/4203808187 conn(0x55e9590d0be0 msgr2=0x55e9590ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 shutdown_connections 2024-04-23T18:29:54.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/4203808187 wait complete. 2024-04-23T18:29:54.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1210432833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa87c036eb0 msgr2=0x7fa87c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/1210432833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa87c036eb0 0x7fa87c039370 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55e9590ad450 tx=0x7fa98c005ac0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1210432833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590c7790 msgr2=0x55e9590c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/1210432833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590c7790 0x55e9590c7bb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa99404bb70 tx=0x7fa994017d50 comp rx=0 tx=0).stop 2024-04-23T18:29:54.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1210432833 shutdown_connections 2024-04-23T18:29:54.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/1210432833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa87c036eb0 0x7fa87c039370 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/1210432833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e9590c7790 0x55e9590c7bb0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1210432833 >> 172.21.15.119:0/1210432833 conn(0x55e9590bb830 msgr2=0x55e9590bbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1210432833 shutdown_connections 2024-04-23T18:29:54.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.789+0000 7fa9a3f75800 1 -- 172.21.15.119:0/1210432833 wait complete. 2024-04-23T18:29:54.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e9590b6780 msgr2=0x55e9590b8bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e9590b6780 0x55e9590b8bd0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e958fae3d0 msgr2=0x55e9590aff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e958fae3d0 0x55e9590aff60 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e9590b2840 msgr2=0x55e9590b4c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e9590b2840 0x55e9590b4c30 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa888036e60 msgr2=0x7fa888039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa888036e60 0x7fa888039320 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa98c054000 tx=0x7fa98c04e000 comp rx=0 tx=0).stop 2024-04-23T18:29:54.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fac890 msgr2=0x55e9590a8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:29:54.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 --2- 172.21.15.119:0/307170742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e958fac890 0x55e9590a8f40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa99400b700 tx=0x7fa994000bc0 comp rx=0 tx=0).stop 2024-04-23T18:29:54.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a227c640 1 -- 172.21.15.119:0/307170742 reap_dead start 2024-04-23T18:29:54.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 shutdown_connections 2024-04-23T18:29:54.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 >> 172.21.15.119:0/307170742 conn(0x55e958fa8410 msgr2=0x55e95909ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:29:54.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 shutdown_connections 2024-04-23T18:29:54.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:29:54.790+0000 7fa9a3f75800 1 -- 172.21.15.119:0/307170742 wait complete. 2024-04-23T18:29:54.791 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-23T18:29:54.805 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:29:54.851 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-23T18:30:29.851 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-04-23T18:30:29.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-04-23T18:30:29.852 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-04-23T18:30:29.902 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:30:29.902 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:30:29.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.910+0000 7f391b01b800 1 Processor -- start 2024-04-23T18:30:29.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.910+0000 7f391b01b800 1 -- start start 2024-04-23T18:30:29.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.910+0000 7f391b01b800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5650b23e3890 0x5650b23e3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.910+0000 7f391b01b800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5650b2295560 con 0x5650b23e41f0 2024-04-23T18:30:29.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.910+0000 7f391b01b800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5650b2286e20 con 0x5650b23e3890 2024-04-23T18:30:29.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.911+0000 7f3918b1a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5650b23e3890 0x5650b23e3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.911+0000 7f3918319640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5650b23e41f0 0x5650b23e46a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:39310/0 (socket says 172.21.15.119:39310) 2024-04-23T18:30:29.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.911+0000 7f3918319640 1 -- 172.21.15.119:0/2757082848 learned_addr learned my addr 172.21.15.119:0/2757082848 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:30:29.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.911+0000 7f3918b1a640 1 -- 172.21.15.119:0/2757082848 >> v1:172.21.15.62:6789/0 conn(0x5650b23e41f0 legacy=0x5650b23e46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.911+0000 7f3918b1a640 1 -- 172.21.15.119:0/2757082848 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650b2294e60 con 0x5650b23e3890 2024-04-23T18:30:29.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.913+0000 7f3918b1a640 1 --2- 172.21.15.119:0/2757082848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b23e3cb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3908005fd0 tx=0x7f390801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2fa3e990a7e84c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.913+0000 7f3917b18640 1 -- 172.21.15.119:0/2757082848 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3908052560 con 0x5650b23e3890 2024-04-23T18:30:29.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.913+0000 7f3917b18640 1 -- 172.21.15.119:0/2757082848 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3908052700 con 0x5650b23e3890 2024-04-23T18:30:29.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.913+0000 7f3917b18640 1 -- 172.21.15.119:0/2757082848 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3908052a60 con 0x5650b23e3890 2024-04-23T18:30:29.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.914+0000 7f391b01b800 1 -- 172.21.15.119:0/2757082848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 msgr2=0x5650b23e3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.914+0000 7f391b01b800 1 --2- 172.21.15.119:0/2757082848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b23e3cb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3908005fd0 tx=0x7f390801ccc0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.914+0000 7f391b01b800 1 -- 172.21.15.119:0/2757082848 shutdown_connections 2024-04-23T18:30:29.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.914+0000 7f391b01b800 1 --2- 172.21.15.119:0/2757082848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b23e3cb0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.914+0000 7f391b01b800 1 -- 172.21.15.119:0/2757082848 >> 172.21.15.119:0/2757082848 conn(0x5650b23df410 msgr2=0x5650b23e1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:29.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.914+0000 7f391b01b800 1 -- 172.21.15.119:0/2757082848 shutdown_connections 2024-04-23T18:30:29.907 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.914+0000 7f391b01b800 1 -- 172.21.15.119:0/2757082848 wait complete. 2024-04-23T18:30:29.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.928+0000 7f391b01b800 1 Processor -- start 2024-04-23T18:30:29.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.928+0000 7f391b01b800 1 -- start start 2024-04-23T18:30:29.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.928+0000 7f391b01b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b24d84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.928+0000 7f391b01b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5650b23305b0 con 0x5650b23e3890 2024-04-23T18:30:29.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.928+0000 7f3918b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b24d84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.928+0000 7f3918b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b24d84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35818/0 (socket says 172.21.15.119:35818) 2024-04-23T18:30:29.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.928+0000 7f3918b1a640 1 -- 172.21.15.119:0/3037881610 learned_addr learned my addr 172.21.15.119:0/3037881610 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:29.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.929+0000 7f3918b1a640 1 -- 172.21.15.119:0/3037881610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650b22a6860 con 0x5650b23e3890 2024-04-23T18:30:29.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.929+0000 7f3918b1a640 1 --2- 172.21.15.119:0/3037881610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b24d84c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3908054040 tx=0x7f390804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc395d0e434fc4d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.929+0000 7f3806e0d640 1 -- 172.21.15.119:0/3037881610 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39080529e0 con 0x5650b23e3890 2024-04-23T18:30:29.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.929+0000 7f3806e0d640 1 -- 172.21.15.119:0/3037881610 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3908052b80 con 0x5650b23e3890 2024-04-23T18:30:29.922 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.929+0000 7f3806e0d640 1 -- 172.21.15.119:0/3037881610 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f390805c430 con 0x5650b23e3890 2024-04-23T18:30:29.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.930+0000 7f391b01b800 1 -- 172.21.15.119:0/3037881610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 msgr2=0x5650b24d84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.930+0000 7f391b01b800 1 --2- 172.21.15.119:0/3037881610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b24d84c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3908054040 tx=0x7f390804c000 comp rx=0 tx=0).stop 2024-04-23T18:30:29.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.930+0000 7f391b01b800 1 -- 172.21.15.119:0/3037881610 shutdown_connections 2024-04-23T18:30:29.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.930+0000 7f391b01b800 1 --2- 172.21.15.119:0/3037881610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b24d84c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.930+0000 7f391b01b800 1 -- 172.21.15.119:0/3037881610 >> 172.21.15.119:0/3037881610 conn(0x5650b23df410 msgr2=0x5650b24d3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:29.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.930+0000 7f391b01b800 1 -- 172.21.15.119:0/3037881610 shutdown_connections 2024-04-23T18:30:29.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.930+0000 7f391b01b800 1 -- 172.21.15.119:0/3037881610 wait complete. 2024-04-23T18:30:29.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.930+0000 7f391b01b800 1 Processor -- start 2024-04-23T18:30:29.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.930+0000 7f391b01b800 1 -- start start 2024-04-23T18:30:29.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.930+0000 7f391b01b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b24dfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.930+0000 7f391b01b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5650b23e5050 con 0x5650b23e3890 2024-04-23T18:30:29.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.931+0000 7f3918b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b24dfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.931+0000 7f3918b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b24dfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35826/0 (socket says 172.21.15.119:35826) 2024-04-23T18:30:29.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.931+0000 7f3918b1a640 1 -- 172.21.15.119:0/816766289 learned_addr learned my addr 172.21.15.119:0/816766289 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:29.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.931+0000 7f3918b1a640 1 -- 172.21.15.119:0/816766289 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650b22a4eb0 con 0x5650b23e3890 2024-04-23T18:30:29.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.931+0000 7f3918b1a640 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b24dfd70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3908044810 tx=0x7f3908003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.931+0000 7f380560a640 1 -- 172.21.15.119:0/816766289 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3908066410 con 0x5650b23e3890 2024-04-23T18:30:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.931+0000 7f380560a640 1 -- 172.21.15.119:0/816766289 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39080665b0 con 0x5650b23e3890 2024-04-23T18:30:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.931+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650b24e02b0 con 0x5650b23e3890 2024-04-23T18:30:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.931+0000 7f380560a640 1 -- 172.21.15.119:0/816766289 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39080668d0 con 0x5650b23e3890 2024-04-23T18:30:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.931+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650b24e07d0 con 0x5650b23e3890 2024-04-23T18:30:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.932+0000 7f380560a640 1 -- 172.21.15.119:0/816766289 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3908078020 con 0x5650b23e3890 2024-04-23T18:30:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.932+0000 7f380560a640 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3800036eb0 0x7f3800039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.933+0000 7f380560a640 1 -- 172.21.15.119:0/816766289 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f390808f1f0 con 0x5650b23e3890 2024-04-23T18:30:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.933+0000 7f3918319640 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3800036eb0 0x7f3800039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.933+0000 7f391b01b800 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5650b23e41f0 0x5650b24e6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.933+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b24e7400 con 0x5650b23e41f0 2024-04-23T18:30:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.933+0000 7f391931b640 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5650b23e41f0 0x5650b24e6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.933+0000 7f3918319640 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3800036eb0 0x7f3800039370 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f390c000f60 tx=0x7f390c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.933+0000 7f391931b640 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5650b23e41f0 0x5650b24e6de0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.933+0000 7f391931b640 1 -- 172.21.15.119:0/816766289 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39100083e0 con 0x5650b23e41f0 2024-04-23T18:30:29.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.933+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b24e4390 con 0x5650b23e41f0 2024-04-23T18:30:29.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.934+0000 7f391931b640 1 -- 172.21.15.119:0/816766289 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39100083e0 con 0x5650b23e41f0 2024-04-23T18:30:29.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.934+0000 7f391b01b800 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5650b24e9710 0x5650b24ebb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.934+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b24ec1f0 con 0x5650b24e9710 2024-04-23T18:30:29.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.934+0000 7f3918b1a640 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5650b24e9710 0x5650b24ebb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.934+0000 7f3918b1a640 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5650b24e9710 0x5650b24ebb00 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.934+0000 7f3918b1a640 1 -- 172.21.15.119:0/816766289 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3908071910 con 0x5650b24e9710 2024-04-23T18:30:29.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.935+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b24e86c0 con 0x5650b23e41f0 2024-04-23T18:30:29.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.935+0000 7f391931b640 1 -- 172.21.15.119:0/816766289 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39100083e0 con 0x5650b23e41f0 2024-04-23T18:30:29.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.935+0000 7f391b01b800 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5650b24ed650 0x5650b24efac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.935+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b24f0220 con 0x5650b24ed650 2024-04-23T18:30:29.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.935+0000 7f3918319640 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5650b24ed650 0x5650b24efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.936+0000 7f3918319640 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5650b24ed650 0x5650b24efac0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.936+0000 7f3918319640 1 -- 172.21.15.119:0/816766289 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f390c009050 con 0x5650b24ed650 2024-04-23T18:30:29.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.936+0000 7f391b01b800 1 Processor -- start 2024-04-23T18:30:29.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.936+0000 7f391b01b800 1 -- start start 2024-04-23T18:30:29.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.937+0000 7f391b01b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b24fe6d0 0x5650b24feaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.937+0000 7f391b01b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5650b22d6df0 con 0x5650b24fe6d0 2024-04-23T18:30:29.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.937+0000 7f3918b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b24fe6d0 0x5650b24feaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.937+0000 7f3918b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b24fe6d0 0x5650b24feaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35838/0 (socket says 172.21.15.119:35838) 2024-04-23T18:30:29.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.937+0000 7f3918b1a640 1 -- 172.21.15.119:0/434395787 learned_addr learned my addr 172.21.15.119:0/434395787 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:29.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.937+0000 7f3918b1a640 1 -- 172.21.15.119:0/434395787 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650b24ff030 con 0x5650b24fe6d0 2024-04-23T18:30:29.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.937+0000 7f3918b1a640 1 --2- 172.21.15.119:0/434395787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b24fe6d0 0x5650b24feaf0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f390808d530 tx=0x7f3908079e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.937+0000 7f37fe7fc640 1 -- 172.21.15.119:0/434395787 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3908094070 con 0x5650b24fe6d0 2024-04-23T18:30:29.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.938+0000 7f37fe7fc640 1 -- 172.21.15.119:0/434395787 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3908068ab0 con 0x5650b24fe6d0 2024-04-23T18:30:29.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.938+0000 7f37fe7fc640 1 -- 172.21.15.119:0/434395787 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f390808a070 con 0x5650b24fe6d0 2024-04-23T18:30:29.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.938+0000 7f391b01b800 1 -- 172.21.15.119:0/434395787 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650b24ffaa0 con 0x5650b24fe6d0 2024-04-23T18:30:29.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.938+0000 7f391b01b800 1 -- 172.21.15.119:0/434395787 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650b24fffa0 con 0x5650b24fe6d0 2024-04-23T18:30:29.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.938+0000 7f37fe7fc640 1 -- 172.21.15.119:0/434395787 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3908097070 con 0x5650b24fe6d0 2024-04-23T18:30:29.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.939+0000 7f37fe7fc640 1 --2- 172.21.15.119:0/434395787 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f37f0036e60 0x7f37f0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.939+0000 7f37fe7fc640 1 -- 172.21.15.119:0/434395787 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f3908080040 con 0x5650b24fe6d0 2024-04-23T18:30:29.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.939+0000 7f3918319640 1 --2- 172.21.15.119:0/434395787 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f37f0036e60 0x7f37f0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.939+0000 7f391b01b800 1 Processor -- start 2024-04-23T18:30:29.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.939+0000 7f391b01b800 1 -- start start 2024-04-23T18:30:29.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.939+0000 7f3918319640 1 --2- 172.21.15.119:0/434395787 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f37f0036e60 0x7f37f0039320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f390c00bf50 tx=0x7f390c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.939+0000 7f391b01b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b250b880 0x5650b250bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.939+0000 7f391b01b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5650b24d8b80 con 0x5650b250b880 2024-04-23T18:30:29.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.940+0000 7f3918b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b250b880 0x5650b250bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.940+0000 7f3918b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b250b880 0x5650b250bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35844/0 (socket says 172.21.15.119:35844) 2024-04-23T18:30:29.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.940+0000 7f3918b1a640 1 -- 172.21.15.119:0/3974364857 learned_addr learned my addr 172.21.15.119:0/3974364857 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:29.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.940+0000 7f3918b1a640 1 -- 172.21.15.119:0/3974364857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650b250c270 con 0x5650b250b880 2024-04-23T18:30:29.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.940+0000 7f3918b1a640 1 --2- 172.21.15.119:0/3974364857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b250b880 0x5650b250bca0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3908066fb0 tx=0x7f390808dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68da4a1e030838e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.940+0000 7f37effff640 1 -- 172.21.15.119:0/3974364857 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f390809ae70 con 0x5650b250b880 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.940+0000 7f37effff640 1 -- 172.21.15.119:0/3974364857 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3908068200 con 0x5650b250b880 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.940+0000 7f37effff640 1 -- 172.21.15.119:0/3974364857 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3908005160 con 0x5650b250b880 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.941+0000 7f391b01b800 1 -- 172.21.15.119:0/3974364857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b250b880 msgr2=0x5650b250bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.941+0000 7f391b01b800 1 --2- 172.21.15.119:0/3974364857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b250b880 0x5650b250bca0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3908066fb0 tx=0x7f390808dca0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.941+0000 7f391b01b800 1 -- 172.21.15.119:0/3974364857 shutdown_connections 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.941+0000 7f391b01b800 1 --2- 172.21.15.119:0/3974364857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b250b880 0x5650b250bca0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.941+0000 7f391b01b800 1 -- 172.21.15.119:0/3974364857 >> 172.21.15.119:0/3974364857 conn(0x5650b2507b50 msgr2=0x5650b2505bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.941+0000 7f391b01b800 1 -- 172.21.15.119:0/3974364857 shutdown_connections 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.941+0000 7f391b01b800 1 -- 172.21.15.119:0/3974364857 wait complete. 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.941+0000 7f391b01b800 1 Processor -- start 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.941+0000 7f391b01b800 1 -- start start 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.941+0000 7f391b01b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b250b880 0x5650b2512bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.941+0000 7f391b01b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5650b250c8d0 con 0x5650b250b880 2024-04-23T18:30:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.942+0000 7f3918b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b250b880 0x5650b2512bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.942+0000 7f3918b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b250b880 0x5650b2512bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35854/0 (socket says 172.21.15.119:35854) 2024-04-23T18:30:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.942+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 learned_addr learned my addr 172.21.15.119:0/2730913878 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.942+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650b2513100 con 0x5650b250b880 2024-04-23T18:30:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.942+0000 7f3918b1a640 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b250b880 0x5650b2512bc0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3908066fb0 tx=0x7f39080871c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.942+0000 7f37ee7fc640 1 -- 172.21.15.119:0/2730913878 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39080686d0 con 0x5650b250b880 2024-04-23T18:30:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.942+0000 7f37ee7fc640 1 -- 172.21.15.119:0/2730913878 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39080793a0 con 0x5650b250b880 2024-04-23T18:30:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.942+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650b2513100 con 0x5650b250b880 2024-04-23T18:30:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.942+0000 7f37ee7fc640 1 -- 172.21.15.119:0/2730913878 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3908079680 con 0x5650b250b880 2024-04-23T18:30:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.943+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650b2513100 con 0x5650b250b880 2024-04-23T18:30:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.943+0000 7f37ee7fc640 1 -- 172.21.15.119:0/2730913878 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3908083040 con 0x5650b250b880 2024-04-23T18:30:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.944+0000 7f37ee7fc640 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f37e4036eb0 0x7f37e4039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.944+0000 7f391b01b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:29.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.944+0000 7f37ee7fc640 1 -- 172.21.15.119:0/2730913878 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f39080a4070 con 0x5650b250b880 2024-04-23T18:30:29.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.944+0000 7f3918319640 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f37e4036eb0 0x7f37e4039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.944+0000 7f391b01b800 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5650b251e150 0x5650b2520610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.944+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2520d60 con 0x5650b251e150 2024-04-23T18:30:29.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.944+0000 7f391931b640 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5650b251e150 0x5650b2520610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.944+0000 7f3918319640 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f37e4036eb0 0x7f37e4039370 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f390c001b60 tx=0x7f390c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.944+0000 7f391931b640 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5650b251e150 0x5650b2520610 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39100083e0 con 0x5650b251e150 2024-04-23T18:30:29.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:29.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 20 realm 2024-04-23T18:30:29.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:29.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b25211e0 con 0x5650b251e150 2024-04-23T18:30:29.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39100083e0 con 0x5650b251e150 2024-04-23T18:30:29.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:29.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:30:29.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:29.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b251e150 2024-04-23T18:30:29.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39100083e0 con 0x5650b251e150 2024-04-23T18:30:29.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:29.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:29.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521e20 con 0x5650b251e150 2024-04-23T18:30:29.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39100083e0 con 0x5650b251e150 2024-04-23T18:30:29.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:29.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:29.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5650b25227e0 0x5650b2524bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.945+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2525110 con 0x5650b25227e0 2024-04-23T18:30:29.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.946+0000 7f3918b1a640 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5650b25227e0 0x5650b2524bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.946+0000 7f3918b1a640 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5650b25227e0 0x5650b2524bd0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.946+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.946+0000 7f391b01b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:30:29.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.946+0000 7f391b01b800 20 searching for the correct realm 2024-04-23T18:30:29.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.946+0000 7f391b01b800 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5650b25271f0 0x5650b25296b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.946+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2529d80 con 0x5650b25271f0 2024-04-23T18:30:29.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.946+0000 7f3918319640 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5650b25271f0 0x5650b25296b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.946+0000 7f3918319640 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5650b25271f0 0x5650b25296b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.947+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.947+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2529d80 con 0x5650b25227e0 2024-04-23T18:30:29.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.947+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.947+0000 7f3918b1a640 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f39080a7030 0x7f39080976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.947+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2529d80 con 0x7f39080a7030 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.948+0000 7f391931b640 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f39080a7030 0x7f39080976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.948+0000 7f391931b640 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f39080a7030 0x7f39080976a0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.948+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39100083e0 con 0x7f39080a7030 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.948+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b251e150 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.949+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39100083e0 con 0x5650b251e150 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.949+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b251e150 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.949+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3910026040 con 0x5650b251e150 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.949+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x7f39080a7030 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.949+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3910026040 con 0x7f39080a7030 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.949+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x7f39080a7030 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.950+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3910026040 con 0x7f39080a7030 2024-04-23T18:30:29.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.950+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25227e0 2024-04-23T18:30:29.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.950+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.950+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25271f0 2024-04-23T18:30:29.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.950+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.950+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b251e150 2024-04-23T18:30:29.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.950+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3910026040 con 0x5650b251e150 2024-04-23T18:30:29.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.950+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x7f39080a7030 2024-04-23T18:30:29.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.951+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3910026040 con 0x7f39080a7030 2024-04-23T18:30:29.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.951+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b251e150 2024-04-23T18:30:29.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.951+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3910026040 con 0x5650b251e150 2024-04-23T18:30:29.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.951+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25227e0 2024-04-23T18:30:29.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.951+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.951+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25271f0 2024-04-23T18:30:29.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.951+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.951+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25271f0 2024-04-23T18:30:29.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.952+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.952+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x7f39080a7030 2024-04-23T18:30:29.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.952+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3910026040 con 0x7f39080a7030 2024-04-23T18:30:29.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.952+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25271f0 2024-04-23T18:30:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.952+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.952+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25271f0 2024-04-23T18:30:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.952+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.952+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b251e150 2024-04-23T18:30:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.953+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3910026040 con 0x5650b251e150 2024-04-23T18:30:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.953+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b251e150 2024-04-23T18:30:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.953+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3910026040 con 0x5650b251e150 2024-04-23T18:30:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.953+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x7f39080a7030 2024-04-23T18:30:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.953+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3910026040 con 0x7f39080a7030 2024-04-23T18:30:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.953+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25271f0 2024-04-23T18:30:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.954+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.954+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25227e0 2024-04-23T18:30:29.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.954+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.954+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b251e150 2024-04-23T18:30:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.954+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3910026040 con 0x5650b251e150 2024-04-23T18:30:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.954+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25227e0 2024-04-23T18:30:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.954+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.954+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25271f0 2024-04-23T18:30:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.955+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.955+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x7f39080a7030 2024-04-23T18:30:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.955+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3910026040 con 0x7f39080a7030 2024-04-23T18:30:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.955+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25227e0 2024-04-23T18:30:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.955+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.955+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25271f0 2024-04-23T18:30:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.956+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.956+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x7f39080a7030 2024-04-23T18:30:29.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.956+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3910026040 con 0x7f39080a7030 2024-04-23T18:30:29.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.956+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b251e150 2024-04-23T18:30:29.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.956+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3910026040 con 0x5650b251e150 2024-04-23T18:30:29.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.956+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650b2521a80 con 0x5650b25227e0 2024-04-23T18:30:29.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:30:29.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:30:29.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:30:29.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:30:29.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:30:29.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:30:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2525ab0 con 0x5650b251e150 2024-04-23T18:30:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3910026040 con 0x5650b251e150 2024-04-23T18:30:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2525ea0 con 0x5650b251e150 2024-04-23T18:30:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3910026040 con 0x5650b251e150 2024-04-23T18:30:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.957+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2525ea0 con 0x7f39080a7030 2024-04-23T18:30:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f391b01b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f391b01b800 20 zone default found 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f391b01b800 4 Realm: () 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f391b01b800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f391b01b800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f391b01b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f391b01b800 20 zonegroup default 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f391b01b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b25262c0 con 0x5650b25227e0 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f391b01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f391b01b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b252bbe0 con 0x5650b25271f0 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.958+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.959+0000 7f391b01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:29.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.959+0000 7f391b01b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:29.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.959+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b252bf80 con 0x5650b25271f0 2024-04-23T18:30:29.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.959+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.959+0000 7f391b01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:29.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.959+0000 7f391b01b800 20 started sync module instance, tier type = 2024-04-23T18:30:29.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.959+0000 7f391b01b800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:30:29.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.959+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252b080 con 0x5650b25227e0 2024-04-23T18:30:29.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.960+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.960+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94904589137056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252ace0 con 0x5650b25227e0 2024-04-23T18:30:29.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.960+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252cdf0 con 0x5650b251e150 2024-04-23T18:30:29.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.961+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94904589137056] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.962+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.962+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94904589142336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252cd60 con 0x5650b251e150 2024-04-23T18:30:29.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.962+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252dcb0 con 0x5650b25271f0 2024-04-23T18:30:29.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.963+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.963+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94904589146112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252e550 con 0x5650b25271f0 2024-04-23T18:30:29.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.963+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252f020 con 0x5650b25227e0 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.964+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94904589142336] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.964+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94904589146112] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.965+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.965+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94904589150992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252f440 con 0x5650b25227e0 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.965+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252fc90 con 0x5650b251e150 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.966+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94904589150992] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.966+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.966+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94904589153344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b2530080 con 0x5650b251e150 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.966+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b25308d0 con 0x7f39080a7030 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.967+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94904589153344] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.967+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.967+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94904589156176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b2530820 con 0x7f39080a7030 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.967+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b2531070 con 0x7f39080a7030 2024-04-23T18:30:29.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.968+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94904589156176] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.968+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.968+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94904589157712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b2530f00 con 0x7f39080a7030 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.968+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b2531a20 con 0x7f39080a7030 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.969+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94904589157712] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.970+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.970+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94904589161712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b25319e0 con 0x7f39080a7030 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.970+0000 7f391b01b800 20 add_watcher() i=0 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.970+0000 7f391b01b800 20 add_watcher() i=1 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.970+0000 7f391b01b800 20 add_watcher() i=2 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.970+0000 7f391b01b800 20 add_watcher() i=3 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.970+0000 7f391b01b800 20 add_watcher() i=4 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.970+0000 7f391b01b800 20 add_watcher() i=5 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.970+0000 7f391b01b800 20 add_watcher() i=6 2024-04-23T18:30:29.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.971+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94904589161712] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.971+0000 7f391b01b800 20 add_watcher() i=7 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.971+0000 7f391b01b800 2 all 8 watchers are set, enabling cache 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.971+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2534e40 con 0x5650b251e150 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.971+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.971+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94904589158768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b2532330 con 0x5650b251e150 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.972+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94904589158768] v34'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.972+0000 7f37cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.972+0000 7f391b01b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.972+0000 7f391b01b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.972+0000 7f391b01b800 5 note: GC not initialized 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.973+0000 7f37cdfe3640 20 reqs_thread_entry: start 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.973+0000 7f391b01b800 20 init_complete bucket index max shards: 11 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.973+0000 7f391b01b800 20 Filter name: none 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.973+0000 7f373f7fe640 20 reqs_thread_entry: start 2024-04-23T18:30:29.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.973+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2568900 con 0x5650b251e150 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.973+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.973+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2568900 con 0x5650b25227e0 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.973+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.974+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b25688c0 con 0x5650b251e150 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.974+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.974+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b25688c0 con 0x5650b25271f0 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.974+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.974+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2568e10 con 0x5650b25271f0 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.974+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.974+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2569240 con 0x5650b25271f0 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.974+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.974+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2569240 con 0x5650b251e150 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.975+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.984 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.975+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2569240 con 0x5650b251e150 2024-04-23T18:30:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.975+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.975+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b2569240 con 0x5650b25271f0 2024-04-23T18:30:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.975+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.975+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b25691f0 con 0x5650b25271f0 2024-04-23T18:30:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.975+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.975+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b25691d0 con 0x7f39080a7030 2024-04-23T18:30:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.976+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.976+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256abd0 con 0x5650b251e150 2024-04-23T18:30:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.976+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.976+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b25227e0 2024-04-23T18:30:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.977+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.977+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b25271f0 2024-04-23T18:30:29.985 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.977+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.977+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x7f39080a7030 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.977+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.977+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x7f39080a7030 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.978+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.978+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b25271f0 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.978+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.978+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x7f39080a7030 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.978+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.978+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b251e150 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.978+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.979+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b25271f0 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.979+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.979+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x7f39080a7030 2024-04-23T18:30:29.986 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.979+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.979+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b25227e0 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.979+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.979+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x7f39080a7030 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.980+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.980+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b251e150 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.980+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.980+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b251e150 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.980+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.980+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b25271f0 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.980+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.980+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b251e150 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.980+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.981+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b251e150 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.981+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.987 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.981+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b25271f0 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.981+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.981+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b25271f0 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.981+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.981+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x5650b25271f0 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.981+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.981+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650b256ab80 con 0x7f39080a7030 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.982+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.982+0000 7f37cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.982+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94904589158768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b25340e0 con 0x5650b251e150 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.983+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94904589158768] v34'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.983+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94904589137056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b2530970 con 0x5650b25227e0 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.984+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94904589137056] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.984+0000 7f391b01b800 20 remove_watcher() i=0 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.984+0000 7f391b01b800 2 removed watcher, disabling cache 2024-04-23T18:30:29.988 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.984+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94904589142336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252b4a0 con 0x5650b251e150 2024-04-23T18:30:29.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.986+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94904589142336] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.986+0000 7f391b01b800 20 remove_watcher() i=1 2024-04-23T18:30:29.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.986+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94904589146112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252b4a0 con 0x5650b25271f0 2024-04-23T18:30:29.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.987+0000 7f3918319640 1 -- 172.21.15.119:0/2730913878 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94904589146112] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f390c009050 con 0x5650b25271f0 2024-04-23T18:30:29.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.987+0000 7f391b01b800 20 remove_watcher() i=2 2024-04-23T18:30:29.989 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.987+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94904589150992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252d800 con 0x5650b25227e0 2024-04-23T18:30:29.993 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.988+0000 7f3918b1a640 1 -- 172.21.15.119:0/2730913878 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94904589150992] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3908096030 con 0x5650b25227e0 2024-04-23T18:30:29.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.988+0000 7f391b01b800 20 remove_watcher() i=3 2024-04-23T18:30:29.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.988+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94904589153344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252b4a0 con 0x5650b251e150 2024-04-23T18:30:29.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.989+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94904589153344] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x5650b251e150 2024-04-23T18:30:29.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.989+0000 7f391b01b800 20 remove_watcher() i=4 2024-04-23T18:30:29.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.989+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94904589156176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252eb10 con 0x7f39080a7030 2024-04-23T18:30:29.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.991+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94904589156176] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.991+0000 7f391b01b800 20 remove_watcher() i=5 2024-04-23T18:30:29.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.991+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94904589157712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252d800 con 0x7f39080a7030 2024-04-23T18:30:29.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.992+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94904589157712] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.992+0000 7f391b01b800 20 remove_watcher() i=6 2024-04-23T18:30:29.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.992+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94904589161712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650b252f440 con 0x7f39080a7030 2024-04-23T18:30:29.994 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.993+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94904589161712] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3910036040 con 0x7f39080a7030 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.993+0000 7f391b01b800 20 remove_watcher() i=7 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.993+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f39080a7030 msgr2=0x7f39080976a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.993+0000 7f391b01b800 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f39080a7030 0x7f39080976a0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.993+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5650b251e150 msgr2=0x5650b2520610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.993+0000 7f391b01b800 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5650b251e150 0x5650b2520610 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.993+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5650b25227e0 msgr2=0x5650b2524bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.993+0000 7f391b01b800 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5650b25227e0 0x5650b2524bd0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.993+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5650b25271f0 msgr2=0x5650b25296b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.993+0000 7f391b01b800 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5650b25271f0 0x5650b25296b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f37e4036eb0 msgr2=0x7f37e4039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f37e4036eb0 0x7f37e4039370 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f390c001b60 tx=0x7f390c010000 comp rx=0 tx=0).stop 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b250b880 msgr2=0x5650b2512bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 --2- 172.21.15.119:0/2730913878 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b250b880 0x5650b2512bc0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3908066fb0 tx=0x7f39080871c0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.995 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 reap_dead start 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391931b640 1 -- 172.21.15.119:0/2730913878 reap_dead start 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 shutdown_connections 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 >> 172.21.15.119:0/2730913878 conn(0x5650b2507b50 msgr2=0x5650b25051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 shutdown_connections 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/2730913878 wait complete. 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/434395787 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f37f0036e60 msgr2=0x7f37f0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 --2- 172.21.15.119:0/434395787 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f37f0036e60 0x7f37f0039320 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f390c00bf50 tx=0x7f390c00f000 comp rx=0 tx=0).stop 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/434395787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b24fe6d0 msgr2=0x5650b24feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 --2- 172.21.15.119:0/434395787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b24fe6d0 0x5650b24feaf0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f390808d530 tx=0x7f3908079e10 comp rx=0 tx=0).stop 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/434395787 shutdown_connections 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 --2- 172.21.15.119:0/434395787 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f37f0036e60 0x7f37f0039320 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 --2- 172.21.15.119:0/434395787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b24fe6d0 0x5650b24feaf0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/434395787 >> 172.21.15.119:0/434395787 conn(0x5650b24f2770 msgr2=0x5650b24f2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:29.996 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/434395787 shutdown_connections 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/434395787 wait complete. 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5650b24ed650 msgr2=0x5650b24efac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5650b24ed650 0x5650b24efac0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5650b23e41f0 msgr2=0x5650b24e6de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5650b23e41f0 0x5650b24e6de0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5650b24e9710 msgr2=0x5650b24ebb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.994+0000 7f391b01b800 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5650b24e9710 0x5650b24ebb00 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.995+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3800036eb0 msgr2=0x7f3800039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.995+0000 7f391b01b800 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3800036eb0 0x7f3800039370 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f390c000f60 tx=0x7f390c0012b0 comp rx=0 tx=0).stop 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.995+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 msgr2=0x5650b24dfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.995+0000 7f391b01b800 1 --2- 172.21.15.119:0/816766289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5650b23e3890 0x5650b24dfd70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3908044810 tx=0x7f3908003330 comp rx=0 tx=0).stop 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.995+0000 7f391931b640 1 -- 172.21.15.119:0/816766289 reap_dead start 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.995+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 shutdown_connections 2024-04-23T18:30:29.997 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.995+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 >> 172.21.15.119:0/816766289 conn(0x5650b23df410 msgr2=0x5650b24d6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:29.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.995+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 shutdown_connections 2024-04-23T18:30:29.998 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:29.995+0000 7f391b01b800 1 -- 172.21.15.119:0/816766289 wait complete. 2024-04-23T18:30:29.998 INFO:teuthology.orchestra.run.smithi119.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-23T18:30:29.999 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:30:29.999 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-23T18:30:29.999 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-23T18:30:29.999 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-23T18:30:30.040 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:30:30.040 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:30:30.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.048+0000 7ff747d2f800 1 Processor -- start 2024-04-23T18:30:30.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.048+0000 7ff747d2f800 1 -- start start 2024-04-23T18:30:30.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.048+0000 7ff747d2f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559739ae8e50 0x559739ae9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.048+0000 7ff747d2f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55973999a560 con 0x559739aea0b0 2024-04-23T18:30:30.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.048+0000 7ff747d2f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55973998be20 con 0x559739ae8e50 2024-04-23T18:30:30.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.049+0000 7ff7439f5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559739ae8e50 0x559739ae9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.049+0000 7ff7431f4640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x559739aea0b0 0x559739aea530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:39326/0 (socket says 172.21.15.119:39326) 2024-04-23T18:30:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.049+0000 7ff7431f4640 1 -- 172.21.15.119:0/1781480651 learned_addr learned my addr 172.21.15.119:0/1781480651 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:30:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.049+0000 7ff7439f5640 1 -- 172.21.15.119:0/1781480651 >> v1:172.21.15.62:6789/0 conn(0x559739aea0b0 legacy=0x559739aea530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.049+0000 7ff7439f5640 1 -- 172.21.15.119:0/1781480651 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559739999e60 con 0x559739ae8e50 2024-04-23T18:30:30.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.051+0000 7ff7439f5640 1 --2- 172.21.15.119:0/1781480651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739ae9270 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff73400a470 tx=0x7ff73401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c22346022b1ea80 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.051+0000 7ff7429f3640 1 -- 172.21.15.119:0/1781480651 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff734057070 con 0x559739ae8e50 2024-04-23T18:30:30.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.051+0000 7ff7429f3640 1 -- 172.21.15.119:0/1781480651 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff734052570 con 0x559739ae8e50 2024-04-23T18:30:30.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.051+0000 7ff7429f3640 1 -- 172.21.15.119:0/1781480651 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff734052870 con 0x559739ae8e50 2024-04-23T18:30:30.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.051+0000 7ff747d2f800 1 -- 172.21.15.119:0/1781480651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 msgr2=0x559739ae9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.051+0000 7ff747d2f800 1 --2- 172.21.15.119:0/1781480651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739ae9270 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff73400a470 tx=0x7ff73401ce90 comp rx=0 tx=0).stop 2024-04-23T18:30:30.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.052+0000 7ff747d2f800 1 -- 172.21.15.119:0/1781480651 shutdown_connections 2024-04-23T18:30:30.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.052+0000 7ff747d2f800 1 --2- 172.21.15.119:0/1781480651 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739ae9270 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.052+0000 7ff747d2f800 1 -- 172.21.15.119:0/1781480651 >> 172.21.15.119:0/1781480651 conn(0x559739ae4410 msgr2=0x559739ae6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.052+0000 7ff747d2f800 1 -- 172.21.15.119:0/1781480651 shutdown_connections 2024-04-23T18:30:30.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.052+0000 7ff747d2f800 1 -- 172.21.15.119:0/1781480651 wait complete. 2024-04-23T18:30:30.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.063+0000 7ff747d2f800 1 Processor -- start 2024-04-23T18:30:30.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.063+0000 7ff747d2f800 1 -- start start 2024-04-23T18:30:30.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.063+0000 7ff747d2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739a5ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.063+0000 7ff747d2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559739a355a0 con 0x559739ae8e50 2024-04-23T18:30:30.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.064+0000 7ff7439f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739a5ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.064+0000 7ff7439f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739a5ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35878/0 (socket says 172.21.15.119:35878) 2024-04-23T18:30:30.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.064+0000 7ff7439f5640 1 -- 172.21.15.119:0/2086095690 learned_addr learned my addr 172.21.15.119:0/2086095690 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.064+0000 7ff7439f5640 1 -- 172.21.15.119:0/2086095690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597399ab860 con 0x559739ae8e50 2024-04-23T18:30:30.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.064+0000 7ff7439f5640 1 --2- 172.21.15.119:0/2086095690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739a5ce50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff734055040 tx=0x7ff73404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10338a470ea89fcb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.064+0000 7ff631e0b640 1 -- 172.21.15.119:0/2086095690 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff734057070 con 0x559739ae8e50 2024-04-23T18:30:30.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.064+0000 7ff631e0b640 1 -- 172.21.15.119:0/2086095690 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff734063070 con 0x559739ae8e50 2024-04-23T18:30:30.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.064+0000 7ff631e0b640 1 -- 172.21.15.119:0/2086095690 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff734052720 con 0x559739ae8e50 2024-04-23T18:30:30.061 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.065+0000 7ff747d2f800 1 -- 172.21.15.119:0/2086095690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 msgr2=0x559739a5ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.065+0000 7ff747d2f800 1 --2- 172.21.15.119:0/2086095690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739a5ce50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff734055040 tx=0x7ff73404c000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.065+0000 7ff747d2f800 1 -- 172.21.15.119:0/2086095690 shutdown_connections 2024-04-23T18:30:30.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.065+0000 7ff747d2f800 1 --2- 172.21.15.119:0/2086095690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739a5ce50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.065+0000 7ff747d2f800 1 -- 172.21.15.119:0/2086095690 >> 172.21.15.119:0/2086095690 conn(0x559739ae4410 msgr2=0x559739bd5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.065+0000 7ff747d2f800 1 -- 172.21.15.119:0/2086095690 shutdown_connections 2024-04-23T18:30:30.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.065+0000 7ff747d2f800 1 -- 172.21.15.119:0/2086095690 wait complete. 2024-04-23T18:30:30.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.065+0000 7ff747d2f800 1 Processor -- start 2024-04-23T18:30:30.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.065+0000 7ff747d2f800 1 -- start start 2024-04-23T18:30:30.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.066+0000 7ff747d2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739bdbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.066+0000 7ff747d2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559739af2520 con 0x559739ae8e50 2024-04-23T18:30:30.062 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.066+0000 7ff7439f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739bdbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.066+0000 7ff7439f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739bdbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35884/0 (socket says 172.21.15.119:35884) 2024-04-23T18:30:30.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.066+0000 7ff7439f5640 1 -- 172.21.15.119:0/845347597 learned_addr learned my addr 172.21.15.119:0/845347597 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.066+0000 7ff7439f5640 1 -- 172.21.15.119:0/845347597 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597399a9eb0 con 0x559739ae8e50 2024-04-23T18:30:30.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.066+0000 7ff7439f5640 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739bdbbf0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff734000c00 tx=0x7ff734002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.066+0000 7ff62bfff640 1 -- 172.21.15.119:0/845347597 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff734052c50 con 0x559739ae8e50 2024-04-23T18:30:30.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.066+0000 7ff62bfff640 1 -- 172.21.15.119:0/845347597 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff73406c070 con 0x559739ae8e50 2024-04-23T18:30:30.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.066+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559739bdc130 con 0x559739ae8e50 2024-04-23T18:30:30.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.066+0000 7ff62bfff640 1 -- 172.21.15.119:0/845347597 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff73405e480 con 0x559739ae8e50 2024-04-23T18:30:30.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.067+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559739bda680 con 0x559739ae8e50 2024-04-23T18:30:30.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.067+0000 7ff62bfff640 1 -- 172.21.15.119:0/845347597 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff734077060 con 0x559739ae8e50 2024-04-23T18:30:30.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.067+0000 7ff62bfff640 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff62c036e60 0x7ff62c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.067+0000 7ff62bfff640 1 -- 172.21.15.119:0/845347597 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7ff73408ea00 con 0x559739ae8e50 2024-04-23T18:30:30.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.068+0000 7ff7431f4640 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff62c036e60 0x7ff62c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.068+0000 7ff747d2f800 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559739aea0b0 0x559739bec200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.068+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739bec740 con 0x559739aea0b0 2024-04-23T18:30:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.068+0000 7ff7441f6640 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559739aea0b0 0x559739bec200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.068+0000 7ff7431f4640 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff62c036e60 0x7ff62c039320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff738000f60 tx=0x7ff7380012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.068+0000 7ff7441f6640 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559739aea0b0 0x559739bec200 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.068+0000 7ff7441f6640 1 -- 172.21.15.119:0/845347597 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739aea0b0 2024-04-23T18:30:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.068+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739becae0 con 0x559739aea0b0 2024-04-23T18:30:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.069+0000 7ff7441f6640 1 -- 172.21.15.119:0/845347597 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739aea0b0 2024-04-23T18:30:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.069+0000 7ff747d2f800 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559739bee8c0 0x559739bf0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.069+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739bf1380 con 0x559739bee8c0 2024-04-23T18:30:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.069+0000 7ff7439f5640 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559739bee8c0 0x559739bf0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.069+0000 7ff7439f5640 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559739bee8c0 0x559739bf0cb0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.069+0000 7ff7439f5640 1 -- 172.21.15.119:0/845347597 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff73406fce0 con 0x559739bee8c0 2024-04-23T18:30:30.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.069+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739bed870 con 0x559739aea0b0 2024-04-23T18:30:30.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.070+0000 7ff7441f6640 1 -- 172.21.15.119:0/845347597 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739aea0b0 2024-04-23T18:30:30.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.070+0000 7ff747d2f800 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559739bf2830 0x559739bf4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.070+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739bf53e0 con 0x559739bf2830 2024-04-23T18:30:30.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.070+0000 7ff7431f4640 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559739bf2830 0x559739bf4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.070+0000 7ff7431f4640 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559739bf2830 0x559739bf4c80 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.071+0000 7ff7431f4640 1 -- 172.21.15.119:0/845347597 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff738009050 con 0x559739bf2830 2024-04-23T18:30:30.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.071+0000 7ff747d2f800 1 Processor -- start 2024-04-23T18:30:30.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.071+0000 7ff747d2f800 1 -- start start 2024-04-23T18:30:30.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.071+0000 7ff747d2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c03840 0x559739c03c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.071+0000 7ff747d2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5597399dbdf0 con 0x559739c03840 2024-04-23T18:30:30.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.071+0000 7ff7439f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c03840 0x559739c03c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.071+0000 7ff7439f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c03840 0x559739c03c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35888/0 (socket says 172.21.15.119:35888) 2024-04-23T18:30:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.071+0000 7ff7439f5640 1 -- 172.21.15.119:0/3109479933 learned_addr learned my addr 172.21.15.119:0/3109479933 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.072+0000 7ff7439f5640 1 -- 172.21.15.119:0/3109479933 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559739c041a0 con 0x559739c03840 2024-04-23T18:30:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.072+0000 7ff7439f5640 1 --2- 172.21.15.119:0/3109479933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c03840 0x559739c03c60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff73408e010 tx=0x7ff734079710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.072+0000 7ff6297fa640 1 -- 172.21.15.119:0/3109479933 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7340664b0 con 0x559739c03840 2024-04-23T18:30:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.072+0000 7ff747d2f800 1 -- 172.21.15.119:0/3109479933 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559739c041a0 con 0x559739c03840 2024-04-23T18:30:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.072+0000 7ff6297fa640 1 -- 172.21.15.119:0/3109479933 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff734058040 con 0x559739c03840 2024-04-23T18:30:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.072+0000 7ff6297fa640 1 -- 172.21.15.119:0/3109479933 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff734009d60 con 0x559739c03840 2024-04-23T18:30:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.072+0000 7ff747d2f800 1 -- 172.21.15.119:0/3109479933 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559739c041a0 con 0x559739c03840 2024-04-23T18:30:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.073+0000 7ff6297fa640 1 -- 172.21.15.119:0/3109479933 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff73406e030 con 0x559739c03840 2024-04-23T18:30:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.073+0000 7ff6297fa640 1 --2- 172.21.15.119:0/3109479933 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff61c036e60 0x7ff61c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.073+0000 7ff6297fa640 1 -- 172.21.15.119:0/3109479933 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7ff734086070 con 0x559739c03840 2024-04-23T18:30:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.073+0000 7ff7431f4640 1 --2- 172.21.15.119:0/3109479933 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff61c036e60 0x7ff61c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.073+0000 7ff747d2f800 1 Processor -- start 2024-04-23T18:30:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.073+0000 7ff747d2f800 1 -- start start 2024-04-23T18:30:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.073+0000 7ff7431f4640 1 --2- 172.21.15.119:0/3109479933 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff61c036e60 0x7ff61c039320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff73800bf50 tx=0x7ff73800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.073+0000 7ff747d2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c10510 0x559739c10930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.073+0000 7ff747d2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559739bde3d0 con 0x559739c10510 2024-04-23T18:30:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.074+0000 7ff7439f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c10510 0x559739c10930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.074+0000 7ff7439f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c10510 0x559739c10930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35894/0 (socket says 172.21.15.119:35894) 2024-04-23T18:30:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.074+0000 7ff7439f5640 1 -- 172.21.15.119:0/1264036280 learned_addr learned my addr 172.21.15.119:0/1264036280 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.074+0000 7ff7439f5640 1 -- 172.21.15.119:0/1264036280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559739c10f00 con 0x559739c10510 2024-04-23T18:30:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.074+0000 7ff7439f5640 1 --2- 172.21.15.119:0/1264036280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c10510 0x559739c10930 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff73406fc50 tx=0x7ff73405e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9984a13dbedbbef0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.074+0000 7ff622ffd640 1 -- 172.21.15.119:0/1264036280 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff73408e710 con 0x559739c10510 2024-04-23T18:30:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.074+0000 7ff622ffd640 1 -- 172.21.15.119:0/1264036280 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff734068ac0 con 0x559739c10510 2024-04-23T18:30:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.074+0000 7ff622ffd640 1 -- 172.21.15.119:0/1264036280 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff73407f5f0 con 0x559739c10510 2024-04-23T18:30:30.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.075+0000 7ff747d2f800 1 -- 172.21.15.119:0/1264036280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c10510 msgr2=0x559739c10930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.075+0000 7ff747d2f800 1 --2- 172.21.15.119:0/1264036280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c10510 0x559739c10930 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff73406fc50 tx=0x7ff73405e750 comp rx=0 tx=0).stop 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.075+0000 7ff747d2f800 1 -- 172.21.15.119:0/1264036280 shutdown_connections 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.075+0000 7ff747d2f800 1 --2- 172.21.15.119:0/1264036280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c10510 0x559739c10930 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.075+0000 7ff747d2f800 1 -- 172.21.15.119:0/1264036280 >> 172.21.15.119:0/1264036280 conn(0x559739c0c870 msgr2=0x559739c0a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.075+0000 7ff747d2f800 1 -- 172.21.15.119:0/1264036280 shutdown_connections 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.075+0000 7ff747d2f800 1 -- 172.21.15.119:0/1264036280 wait complete. 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.075+0000 7ff747d2f800 1 Processor -- start 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.075+0000 7ff747d2f800 1 -- start start 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.075+0000 7ff747d2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c10510 0x559739c17970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.075+0000 7ff747d2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559739c115b0 con 0x559739c10510 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.076+0000 7ff7439f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c10510 0x559739c17970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.076+0000 7ff7439f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c10510 0x559739c17970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35906/0 (socket says 172.21.15.119:35906) 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.076+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 learned_addr learned my addr 172.21.15.119:0/2752067739 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.076+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559739c17eb0 con 0x559739c10510 2024-04-23T18:30:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.076+0000 7ff7439f5640 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c10510 0x559739c17970 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff734075000 tx=0x7ff734009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.076+0000 7ff6217fa640 1 -- 172.21.15.119:0/2752067739 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff73408b640 con 0x559739c10510 2024-04-23T18:30:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.076+0000 7ff6217fa640 1 -- 172.21.15.119:0/2752067739 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff73408b7e0 con 0x559739c10510 2024-04-23T18:30:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.076+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559739c17eb0 con 0x559739c10510 2024-04-23T18:30:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.076+0000 7ff6217fa640 1 -- 172.21.15.119:0/2752067739 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff734055970 con 0x559739c10510 2024-04-23T18:30:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.076+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559739c17eb0 con 0x559739c10510 2024-04-23T18:30:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.077+0000 7ff6217fa640 1 -- 172.21.15.119:0/2752067739 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff734055b10 con 0x559739c10510 2024-04-23T18:30:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.077+0000 7ff6217fa640 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff60c036e60 0x7ff60c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.077+0000 7ff747d2f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.077+0000 7ff6217fa640 1 -- 172.21.15.119:0/2752067739 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7ff7340add80 con 0x559739c10510 2024-04-23T18:30:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.077+0000 7ff7431f4640 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff60c036e60 0x7ff60c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.077+0000 7ff747d2f800 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559739c22f30 0x559739c253d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.077+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c25b20 con 0x559739c22f30 2024-04-23T18:30:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff7441f6640 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559739c22f30 0x559739c253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff7431f4640 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff60c036e60 0x7ff60c039320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff738001b60 tx=0x7ff738010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff7441f6640 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559739c22f30 0x559739c253d0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739c22f30 2024-04-23T18:30:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff747d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff747d2f800 20 realm 2024-04-23T18:30:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff747d2f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c25f30 con 0x559739c22f30 2024-04-23T18:30:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739c22f30 2024-04-23T18:30:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff747d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff747d2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:30:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff747d2f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c267d0 con 0x559739c22f30 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739c22f30 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff747d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff747d2f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.078+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c22f30 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.079+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739c22f30 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.079+0000 7ff747d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.079+0000 7ff747d2f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.079+0000 7ff747d2f800 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559739c278d0 0x559739c29cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.079+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c2a200 con 0x559739c278d0 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.079+0000 7ff7439f5640 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559739c278d0 0x559739c29cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.079+0000 7ff7439f5640 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559739c278d0 0x559739c29cc0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.079+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff73406fce0 con 0x559739c278d0 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.079+0000 7ff747d2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:30:30.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.079+0000 7ff747d2f800 20 searching for the correct realm 2024-04-23T18:30:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.079+0000 7ff747d2f800 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559739c2c280 0x559739c2e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.079+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c2ee10 con 0x559739c2c280 2024-04-23T18:30:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.079+0000 7ff7431f4640 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559739c2c280 0x559739c2e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.080+0000 7ff7431f4640 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559739c2c280 0x559739c2e740 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.080+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.080+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c2ee10 con 0x559739c278d0 2024-04-23T18:30:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.080+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73406fce0 con 0x559739c278d0 2024-04-23T18:30:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.080+0000 7ff7439f5640 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ff73408e0b0 0x7ff734072450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.080+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c2ee10 con 0x7ff73408e0b0 2024-04-23T18:30:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.081+0000 7ff7441f6640 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ff73408e0b0 0x7ff734072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.081+0000 7ff7441f6640 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ff73408e0b0 0x7ff734072450 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.081+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00a4a0 con 0x7ff73408e0b0 2024-04-23T18:30:30.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.081+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c22f30 2024-04-23T18:30:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.082+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739c22f30 2024-04-23T18:30:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.082+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c22f30 2024-04-23T18:30:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.082+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739c22f30 2024-04-23T18:30:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.082+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x7ff73408e0b0 2024-04-23T18:30:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.082+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00a4a0 con 0x7ff73408e0b0 2024-04-23T18:30:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.082+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x7ff73408e0b0 2024-04-23T18:30:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.083+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff73c00a4a0 con 0x7ff73408e0b0 2024-04-23T18:30:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.083+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c278d0 2024-04-23T18:30:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.083+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73406fce0 con 0x559739c278d0 2024-04-23T18:30:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.083+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c2c280 2024-04-23T18:30:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.083+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.083+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c22f30 2024-04-23T18:30:30.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.083+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739c22f30 2024-04-23T18:30:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.083+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x7ff73408e0b0 2024-04-23T18:30:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.084+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00a4a0 con 0x7ff73408e0b0 2024-04-23T18:30:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.084+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c22f30 2024-04-23T18:30:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.084+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739c22f30 2024-04-23T18:30:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.084+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c278d0 2024-04-23T18:30:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.084+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff73406fce0 con 0x559739c278d0 2024-04-23T18:30:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.084+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c2c280 2024-04-23T18:30:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.084+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.084+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c2c280 2024-04-23T18:30:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.084+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.086 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.084+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x7ff73408e0b0 2024-04-23T18:30:30.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.085+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00a4a0 con 0x7ff73408e0b0 2024-04-23T18:30:30.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.085+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c2c280 2024-04-23T18:30:30.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.085+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.085+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c2c280 2024-04-23T18:30:30.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.085+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.085+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c22f30 2024-04-23T18:30:30.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.085+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739c22f30 2024-04-23T18:30:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.085+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c22f30 2024-04-23T18:30:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.086+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739c22f30 2024-04-23T18:30:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.086+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x7ff73408e0b0 2024-04-23T18:30:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.086+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00a4a0 con 0x7ff73408e0b0 2024-04-23T18:30:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.086+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c2c280 2024-04-23T18:30:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.086+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.086+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c278d0 2024-04-23T18:30:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.086+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff73406fce0 con 0x559739c278d0 2024-04-23T18:30:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.087+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c22f30 2024-04-23T18:30:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.087+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00a4a0 con 0x559739c22f30 2024-04-23T18:30:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.087+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c278d0 2024-04-23T18:30:30.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.087+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73406fce0 con 0x559739c278d0 2024-04-23T18:30:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.087+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c2c280 2024-04-23T18:30:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.087+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.087+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x7ff73408e0b0 2024-04-23T18:30:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.088+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00a4a0 con 0x7ff73408e0b0 2024-04-23T18:30:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.088+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c278d0 2024-04-23T18:30:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.088+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7340c5040 con 0x559739c278d0 2024-04-23T18:30:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.088+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c2c280 2024-04-23T18:30:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.088+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.088+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x7ff73408e0b0 2024-04-23T18:30:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.088+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff73c00a4a0 con 0x7ff73408e0b0 2024-04-23T18:30:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.088+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c22f30 2024-04-23T18:30:30.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559739c26b70 con 0x559739c278d0 2024-04-23T18:30:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7340c5040 con 0x559739c278d0 2024-04-23T18:30:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:30:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:30:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:30:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:30:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:30:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:30:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c2ab80 con 0x559739c22f30 2024-04-23T18:30:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c2af70 con 0x559739c22f30 2024-04-23T18:30:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.089+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c2af70 con 0x7ff73408e0b0 2024-04-23T18:30:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff747d2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:30:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff747d2f800 20 zone default found 2024-04-23T18:30:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff747d2f800 4 Realm: () 2024-04-23T18:30:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff747d2f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:30:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff747d2f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:30:30.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff747d2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff747d2f800 20 zonegroup default 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff747d2f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c2b390 con 0x559739c278d0 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff7340c5040 con 0x559739c278d0 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff747d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff747d2f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c30c70 con 0x559739c2c280 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.090+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.091+0000 7ff747d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.091+0000 7ff747d2f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.091+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c31010 con 0x559739c2c280 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.091+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.091+0000 7ff747d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.091+0000 7ff747d2f800 20 started sync module instance, tier type = 2024-04-23T18:30:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.091+0000 7ff747d2f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:30:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.091+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c30110 con 0x559739c278d0 2024-04-23T18:30:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.092+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7340c5040 con 0x559739c278d0 2024-04-23T18:30:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.092+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94107997504768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c2fd70 con 0x559739c278d0 2024-04-23T18:30:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.092+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c31ed0 con 0x559739c22f30 2024-04-23T18:30:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.093+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94107997504768] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7340c5040 con 0x559739c278d0 2024-04-23T18:30:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.093+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.093+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94107997510176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c31e40 con 0x559739c22f30 2024-04-23T18:30:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.093+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c32d90 con 0x559739c2c280 2024-04-23T18:30:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.095+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.095+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94107997513952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c33630 con 0x559739c2c280 2024-04-23T18:30:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.095+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c34100 con 0x559739c278d0 2024-04-23T18:30:30.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.095+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94107997510176] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.096+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94107997513952] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.096+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7340c5040 con 0x559739c278d0 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.096+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94107997516160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c322c0 con 0x559739c278d0 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.096+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c34b10 con 0x559739c22f30 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.097+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94107997516160] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7340c5040 con 0x559739c278d0 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.097+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.097+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94107997518832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c34b10 con 0x559739c22f30 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.097+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c353a0 con 0x7ff73408e0b0 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.098+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94107997518832] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.098+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.099+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94107997521504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c34f30 con 0x7ff73408e0b0 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.099+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c35db0 con 0x7ff73408e0b0 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.100+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94107997521504] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.100+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.100+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94107997522560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c35f90 con 0x7ff73408e0b0 2024-04-23T18:30:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.100+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c367e0 con 0x7ff73408e0b0 2024-04-23T18:30:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.101+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94107997522560] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.101+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.101+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94107997527232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c36630 con 0x7ff73408e0b0 2024-04-23T18:30:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.101+0000 7ff747d2f800 20 add_watcher() i=0 2024-04-23T18:30:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.101+0000 7ff747d2f800 20 add_watcher() i=1 2024-04-23T18:30:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.101+0000 7ff747d2f800 20 add_watcher() i=2 2024-04-23T18:30:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.101+0000 7ff747d2f800 20 add_watcher() i=3 2024-04-23T18:30:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.101+0000 7ff747d2f800 20 add_watcher() i=4 2024-04-23T18:30:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.101+0000 7ff747d2f800 20 add_watcher() i=5 2024-04-23T18:30:30.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.101+0000 7ff747d2f800 20 add_watcher() i=6 2024-04-23T18:30:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.102+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94107997527232] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.102+0000 7ff747d2f800 20 add_watcher() i=7 2024-04-23T18:30:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.102+0000 7ff747d2f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:30:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.102+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c39b70 con 0x559739c22f30 2024-04-23T18:30:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.102+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.102+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94107997528288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c37060 con 0x559739c22f30 2024-04-23T18:30:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.103+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94107997528288] v34'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.103+0000 7ff5f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.103+0000 7ff747d2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:30:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.103+0000 7ff747d2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:30:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.103+0000 7ff747d2f800 5 note: GC not initialized 2024-04-23T18:30:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.104+0000 7ff5f8fe1640 20 reqs_thread_entry: start 2024-04-23T18:30:30.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.104+0000 7ff747d2f800 20 init_complete bucket index max shards: 11 2024-04-23T18:30:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.104+0000 7ff747d2f800 20 Filter name: none 2024-04-23T18:30:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.104+0000 7ff5727fc640 20 reqs_thread_entry: start 2024-04-23T18:30:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.104+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6d7a0 con 0x559739c22f30 2024-04-23T18:30:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.104+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.104+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6d7a0 con 0x559739c278d0 2024-04-23T18:30:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.104+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff7340c5040 con 0x559739c278d0 2024-04-23T18:30:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.104+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6d760 con 0x559739c22f30 2024-04-23T18:30:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.105+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.105+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6d760 con 0x559739c2c280 2024-04-23T18:30:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.105+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.105+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6dc70 con 0x559739c2c280 2024-04-23T18:30:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.105+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.112 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.105+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6e0a0 con 0x559739c2c280 2024-04-23T18:30:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.105+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.105+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6e0a0 con 0x559739c22f30 2024-04-23T18:30:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.105+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.105+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6e060 con 0x559739c22f30 2024-04-23T18:30:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.106+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.106+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6e060 con 0x559739c2c280 2024-04-23T18:30:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.106+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.106+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6e060 con 0x559739c2c280 2024-04-23T18:30:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.106+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.106+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6e060 con 0x7ff73408e0b0 2024-04-23T18:30:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.107+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.107+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6fad0 con 0x559739c22f30 2024-04-23T18:30:30.113 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.107+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.107+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6fad0 con 0x559739c278d0 2024-04-23T18:30:30.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.107+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff7340c5040 con 0x559739c278d0 2024-04-23T18:30:30.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.107+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6fad0 con 0x559739c2c280 2024-04-23T18:30:30.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.107+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.107+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6fad0 con 0x7ff73408e0b0 2024-04-23T18:30:30.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.108+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.108+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6fa80 con 0x7ff73408e0b0 2024-04-23T18:30:30.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.108+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.108+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6fa80 con 0x559739c2c280 2024-04-23T18:30:30.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.108+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.114 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.108+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6fa30 con 0x7ff73408e0b0 2024-04-23T18:30:30.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.109+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.109+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f9c0 con 0x559739c22f30 2024-04-23T18:30:30.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.109+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.109+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f9c0 con 0x559739c2c280 2024-04-23T18:30:30.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.109+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.109+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f970 con 0x7ff73408e0b0 2024-04-23T18:30:30.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.109+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.109+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f970 con 0x559739c278d0 2024-04-23T18:30:30.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.110+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff7340c5040 con 0x559739c278d0 2024-04-23T18:30:30.115 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.110+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f970 con 0x7ff73408e0b0 2024-04-23T18:30:30.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.110+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.110+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f970 con 0x559739c22f30 2024-04-23T18:30:30.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.110+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.110+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f970 con 0x559739c22f30 2024-04-23T18:30:30.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.110+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.111+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f970 con 0x559739c2c280 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.111+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.111+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f950 con 0x559739c22f30 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.111+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.111+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f950 con 0x559739c22f30 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.111+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.111+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f950 con 0x559739c2c280 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.111+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.111+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f950 con 0x559739c2c280 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.111+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.112+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f950 con 0x559739c2c280 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.112+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.112+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559739c6f950 con 0x7ff73408e0b0 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.112+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.113+0000 7ff5f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.113+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94107997528288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c6be10 con 0x559739c22f30 2024-04-23T18:30:30.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.114+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94107997528288] v34'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.114+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94107997504768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c6be10 con 0x559739c278d0 2024-04-23T18:30:30.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.115+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94107997504768] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7340c5040 con 0x559739c278d0 2024-04-23T18:30:30.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.115+0000 7ff747d2f800 20 remove_watcher() i=0 2024-04-23T18:30:30.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.115+0000 7ff747d2f800 2 removed watcher, disabling cache 2024-04-23T18:30:30.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.115+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94107997510176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c6e060 con 0x559739c22f30 2024-04-23T18:30:30.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.116+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94107997510176] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.116+0000 7ff747d2f800 20 remove_watcher() i=1 2024-04-23T18:30:30.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.116+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94107997513952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c6e060 con 0x559739c2c280 2024-04-23T18:30:30.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.117+0000 7ff7431f4640 1 -- 172.21.15.119:0/2752067739 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94107997513952] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff738009050 con 0x559739c2c280 2024-04-23T18:30:30.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.117+0000 7ff747d2f800 20 remove_watcher() i=2 2024-04-23T18:30:30.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.117+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94107997516160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c6e060 con 0x559739c278d0 2024-04-23T18:30:30.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.118+0000 7ff7439f5640 1 -- 172.21.15.119:0/2752067739 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94107997516160] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7340c5040 con 0x559739c278d0 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.118+0000 7ff747d2f800 20 remove_watcher() i=3 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.118+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94107997518832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c6e060 con 0x559739c22f30 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.119+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94107997518832] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x559739c22f30 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.119+0000 7ff747d2f800 20 remove_watcher() i=4 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.120+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94107997521504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c6e060 con 0x7ff73408e0b0 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.121+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94107997521504] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.121+0000 7ff747d2f800 20 remove_watcher() i=5 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.121+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94107997522560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c6e060 con 0x7ff73408e0b0 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.122+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94107997522560] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.122+0000 7ff747d2f800 20 remove_watcher() i=6 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.122+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94107997527232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559739c6e060 con 0x7ff73408e0b0 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94107997527232] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff73c040080 con 0x7ff73408e0b0 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 20 remove_watcher() i=7 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ff73408e0b0 msgr2=0x7ff734072450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ff73408e0b0 0x7ff734072450 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559739c22f30 msgr2=0x559739c253d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559739c22f30 0x559739c253d0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559739c278d0 msgr2=0x559739c29cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559739c278d0 0x559739c29cc0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559739c2c280 msgr2=0x559739c2e740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559739c2c280 0x559739c2e740 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff60c036e60 msgr2=0x7ff60c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff60c036e60 0x7ff60c039320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff738001b60 tx=0x7ff738010000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c10510 msgr2=0x559739c17970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 --2- 172.21.15.119:0/2752067739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c10510 0x559739c17970 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff734075000 tx=0x7ff734009f60 comp rx=0 tx=0).stop 2024-04-23T18:30:30.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 reap_dead start 2024-04-23T18:30:30.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff7441f6640 1 -- 172.21.15.119:0/2752067739 reap_dead start 2024-04-23T18:30:30.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 shutdown_connections 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 >> 172.21.15.119:0/2752067739 conn(0x559739c0c870 msgr2=0x559739c09ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 shutdown_connections 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/2752067739 wait complete. 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/3109479933 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff61c036e60 msgr2=0x7ff61c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 --2- 172.21.15.119:0/3109479933 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff61c036e60 0x7ff61c039320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff73800bf50 tx=0x7ff73800f000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/3109479933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c03840 msgr2=0x559739c03c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 --2- 172.21.15.119:0/3109479933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c03840 0x559739c03c60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff73408e010 tx=0x7ff734079710 comp rx=0 tx=0).stop 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/3109479933 shutdown_connections 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 --2- 172.21.15.119:0/3109479933 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff61c036e60 0x7ff61c039320 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 --2- 172.21.15.119:0/3109479933 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739c03840 0x559739c03c60 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/3109479933 >> 172.21.15.119:0/3109479933 conn(0x559739bf78e0 msgr2=0x559739bf7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/3109479933 shutdown_connections 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.123+0000 7ff747d2f800 1 -- 172.21.15.119:0/3109479933 wait complete. 2024-04-23T18:30:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559739bf2830 msgr2=0x559739bf4c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559739bf2830 0x559739bf4c80 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559739aea0b0 msgr2=0x559739bec200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559739aea0b0 0x559739bec200 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559739bee8c0 msgr2=0x559739bf0cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559739bee8c0 0x559739bf0cb0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff62c036e60 msgr2=0x7ff62c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff62c036e60 0x7ff62c039320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff738000f60 tx=0x7ff7380012b0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 msgr2=0x559739bdbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 --2- 172.21.15.119:0/845347597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559739ae8e50 0x559739bdbbf0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff734000c00 tx=0x7ff734002fb0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff7441f6640 1 -- 172.21.15.119:0/845347597 reap_dead start 2024-04-23T18:30:30.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 shutdown_connections 2024-04-23T18:30:30.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 >> 172.21.15.119:0/845347597 conn(0x559739ae4410 msgr2=0x559739bd4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 shutdown_connections 2024-04-23T18:30:30.129 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.124+0000 7ff747d2f800 1 -- 172.21.15.119:0/845347597 wait complete. 2024-04-23T18:30:30.129 INFO:teuthology.orchestra.run.smithi119.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-23T18:30:30.130 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:30:30.130 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-23T18:30:30.130 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-23T18:30:30.131 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-23T18:30:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:30:30.213 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:30:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.221+0000 7f5b67a16800 1 Processor -- start 2024-04-23T18:30:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.221+0000 7f5b67a16800 1 -- start start 2024-04-23T18:30:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.221+0000 7f5b67a16800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560163509a60 0x56016350be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.221+0000 7f5b67a16800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5601633b9560 con 0x56016350c390 2024-04-23T18:30:30.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.221+0000 7f5b67a16800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5601633aae20 con 0x560163509a60 2024-04-23T18:30:30.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.222+0000 7f5b63084640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560163509a60 0x56016350be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.222+0000 7f5b5a883640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x56016350c390 0x56016350e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:39338/0 (socket says 172.21.15.119:39338) 2024-04-23T18:30:30.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.222+0000 7f5b5a883640 1 -- 172.21.15.119:0/2888018367 learned_addr learned my addr 172.21.15.119:0/2888018367 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:30:30.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.222+0000 7f5b63084640 1 -- 172.21.15.119:0/2888018367 >> v1:172.21.15.62:6789/0 conn(0x56016350c390 legacy=0x56016350e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.222+0000 7f5b63084640 1 -- 172.21.15.119:0/2888018367 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601633b8e60 con 0x560163509a60 2024-04-23T18:30:30.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.224+0000 7f5b63084640 1 --2- 172.21.15.119:0/2888018367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x56016350be50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400a470 tx=0x7f5b5401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05c5b5f9d76f9c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.224+0000 7f5b62883640 1 -- 172.21.15.119:0/2888018367 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b54057070 con 0x560163509a60 2024-04-23T18:30:30.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.224+0000 7f5b62883640 1 -- 172.21.15.119:0/2888018367 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b54052570 con 0x560163509a60 2024-04-23T18:30:30.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.224+0000 7f5b62883640 1 -- 172.21.15.119:0/2888018367 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b54052870 con 0x560163509a60 2024-04-23T18:30:30.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.225+0000 7f5b67a16800 1 -- 172.21.15.119:0/2888018367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 msgr2=0x56016350be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.225+0000 7f5b67a16800 1 --2- 172.21.15.119:0/2888018367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x56016350be50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400a470 tx=0x7f5b5401ce90 comp rx=0 tx=0).stop 2024-04-23T18:30:30.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.225+0000 7f5b67a16800 1 -- 172.21.15.119:0/2888018367 shutdown_connections 2024-04-23T18:30:30.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.225+0000 7f5b67a16800 1 --2- 172.21.15.119:0/2888018367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x56016350be50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.225+0000 7f5b67a16800 1 -- 172.21.15.119:0/2888018367 >> 172.21.15.119:0/2888018367 conn(0x560163503410 msgr2=0x560163505830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.225+0000 7f5b67a16800 1 -- 172.21.15.119:0/2888018367 shutdown_connections 2024-04-23T18:30:30.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.225+0000 7f5b67a16800 1 -- 172.21.15.119:0/2888018367 wait complete. 2024-04-23T18:30:30.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.236+0000 7f5b67a16800 1 Processor -- start 2024-04-23T18:30:30.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.236+0000 7f5b67a16800 1 -- start start 2024-04-23T18:30:30.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.236+0000 7f5b67a16800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x5601635093a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.236+0000 7f5b67a16800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5601634545b0 con 0x560163509a60 2024-04-23T18:30:30.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.237+0000 7f5b63084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x5601635093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.237+0000 7f5b63084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x5601635093a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35940/0 (socket says 172.21.15.119:35940) 2024-04-23T18:30:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.237+0000 7f5b63084640 1 -- 172.21.15.119:0/2461350183 learned_addr learned my addr 172.21.15.119:0/2461350183 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.237+0000 7f5b63084640 1 -- 172.21.15.119:0/2461350183 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601633ca860 con 0x560163509a60 2024-04-23T18:30:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.237+0000 7f5b63084640 1 --2- 172.21.15.119:0/2461350183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x5601635093a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5b54055040 tx=0x7f5b5404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b7ab5939ca2187 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.238+0000 7f5a5160a640 1 -- 172.21.15.119:0/2461350183 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b54057070 con 0x560163509a60 2024-04-23T18:30:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.238+0000 7f5a5160a640 1 -- 172.21.15.119:0/2461350183 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b54063070 con 0x560163509a60 2024-04-23T18:30:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.238+0000 7f5a5160a640 1 -- 172.21.15.119:0/2461350183 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b54052720 con 0x560163509a60 2024-04-23T18:30:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.238+0000 7f5b67a16800 1 -- 172.21.15.119:0/2461350183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 msgr2=0x5601635093a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.238+0000 7f5b67a16800 1 --2- 172.21.15.119:0/2461350183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x5601635093a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5b54055040 tx=0x7f5b5404c000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.238+0000 7f5b67a16800 1 -- 172.21.15.119:0/2461350183 shutdown_connections 2024-04-23T18:30:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.238+0000 7f5b67a16800 1 --2- 172.21.15.119:0/2461350183 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x5601635093a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.238+0000 7f5b67a16800 1 -- 172.21.15.119:0/2461350183 >> 172.21.15.119:0/2461350183 conn(0x560163503410 msgr2=0x5601635f5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.238+0000 7f5b67a16800 1 -- 172.21.15.119:0/2461350183 shutdown_connections 2024-04-23T18:30:30.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.238+0000 7f5b67a16800 1 -- 172.21.15.119:0/2461350183 wait complete. 2024-04-23T18:30:30.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.239+0000 7f5b67a16800 1 Processor -- start 2024-04-23T18:30:30.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.239+0000 7f5b67a16800 1 -- start start 2024-04-23T18:30:30.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.239+0000 7f5b67a16800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x560163603af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.239+0000 7f5b67a16800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5601635121b0 con 0x560163509a60 2024-04-23T18:30:30.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.239+0000 7f5b63084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x560163603af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.239+0000 7f5b63084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x560163603af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35952/0 (socket says 172.21.15.119:35952) 2024-04-23T18:30:30.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.239+0000 7f5b63084640 1 -- 172.21.15.119:0/1179630714 learned_addr learned my addr 172.21.15.119:0/1179630714 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.239+0000 7f5b63084640 1 -- 172.21.15.119:0/1179630714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601633c8eb0 con 0x560163509a60 2024-04-23T18:30:30.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.239+0000 7f5b63084640 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x560163603af0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5b54055040 tx=0x7f5b54002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.240+0000 7f5a4fe07640 1 -- 172.21.15.119:0/1179630714 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b54052df0 con 0x560163509a60 2024-04-23T18:30:30.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.240+0000 7f5a4fe07640 1 -- 172.21.15.119:0/1179630714 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b5406c070 con 0x560163509a60 2024-04-23T18:30:30.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.240+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560163604030 con 0x560163509a60 2024-04-23T18:30:30.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.240+0000 7f5a4fe07640 1 -- 172.21.15.119:0/1179630714 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b5405e5d0 con 0x560163509a60 2024-04-23T18:30:30.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.240+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560163604550 con 0x560163509a60 2024-04-23T18:30:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.240+0000 7f5a4fe07640 1 -- 172.21.15.119:0/1179630714 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5b54077060 con 0x560163509a60 2024-04-23T18:30:30.252 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.241+0000 7f5a4fe07640 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a48036e60 0x7f5a48039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.241+0000 7f5a4fe07640 1 -- 172.21.15.119:0/1179630714 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f5b5408ebe0 con 0x560163509a60 2024-04-23T18:30:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.241+0000 7f5b5a883640 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a48036e60 0x7f5a48039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.241+0000 7f5b67a16800 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56016350c390 0x56016360ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.241+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56016360b130 con 0x56016350c390 2024-04-23T18:30:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.241+0000 7f5b63885640 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56016350c390 0x56016360ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.241+0000 7f5b5a883640 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a48036e60 0x7f5a48039320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c001d90 tx=0x7f5b4c0012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.241+0000 7f5b63885640 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56016350c390 0x56016360ab60 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.241+0000 7f5b63885640 1 -- 172.21.15.119:0/1179630714 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x56016350c390 2024-04-23T18:30:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.242+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560163608110 con 0x56016350c390 2024-04-23T18:30:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.242+0000 7f5b63885640 1 -- 172.21.15.119:0/1179630714 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x56016350c390 2024-04-23T18:30:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.242+0000 7f5b67a16800 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56016360d460 0x56016360f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.242+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56016360fef0 con 0x56016360d460 2024-04-23T18:30:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.242+0000 7f5b63084640 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56016360d460 0x56016360f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.242+0000 7f5b63084640 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56016360d460 0x56016360f850 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.242+0000 7f5b63084640 1 -- 172.21.15.119:0/1179630714 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5b5406fce0 con 0x56016360d460 2024-04-23T18:30:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.242+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56016360c410 con 0x56016350c390 2024-04-23T18:30:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.243+0000 7f5b63885640 1 -- 172.21.15.119:0/1179630714 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x56016350c390 2024-04-23T18:30:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.243+0000 7f5b67a16800 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5601636113a0 0x5601636137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.243+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560163613f50 con 0x5601636113a0 2024-04-23T18:30:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.243+0000 7f5b5a883640 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5601636113a0 0x5601636137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.244+0000 7f5b5a883640 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5601636113a0 0x5601636137f0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.244+0000 7f5b5a883640 1 -- 172.21.15.119:0/1179630714 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5b4c009050 con 0x5601636113a0 2024-04-23T18:30:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.244+0000 7f5b67a16800 1 Processor -- start 2024-04-23T18:30:30.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.244+0000 7f5b67a16800 1 -- start start 2024-04-23T18:30:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.244+0000 7f5b67a16800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601636223b0 0x5601636227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.244+0000 7f5b67a16800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5601633fadf0 con 0x5601636223b0 2024-04-23T18:30:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.245+0000 7f5b63084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601636223b0 0x5601636227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.245+0000 7f5b63084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601636223b0 0x5601636227d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35960/0 (socket says 172.21.15.119:35960) 2024-04-23T18:30:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.245+0000 7f5b63084640 1 -- 172.21.15.119:0/3733079498 learned_addr learned my addr 172.21.15.119:0/3733079498 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.245+0000 7f5b63084640 1 -- 172.21.15.119:0/3733079498 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560163622d10 con 0x5601636223b0 2024-04-23T18:30:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.245+0000 7f5b63084640 1 --2- 172.21.15.119:0/3733079498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601636223b0 0x5601636227d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5b5406ff90 tx=0x7f5b5406f6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.245+0000 7f5a4d602640 1 -- 172.21.15.119:0/3733079498 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b54068ae0 con 0x5601636223b0 2024-04-23T18:30:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.245+0000 7f5a4d602640 1 -- 172.21.15.119:0/3733079498 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b54093070 con 0x5601636223b0 2024-04-23T18:30:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.245+0000 7f5a4d602640 1 -- 172.21.15.119:0/3733079498 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b54068e10 con 0x5601636223b0 2024-04-23T18:30:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.245+0000 7f5b67a16800 1 -- 172.21.15.119:0/3733079498 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560163623780 con 0x5601636223b0 2024-04-23T18:30:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.245+0000 7f5b67a16800 1 -- 172.21.15.119:0/3733079498 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560163623c80 con 0x5601636223b0 2024-04-23T18:30:30.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.246+0000 7f5a4d602640 1 -- 172.21.15.119:0/3733079498 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5b5406e030 con 0x5601636223b0 2024-04-23T18:30:30.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.246+0000 7f5a4d602640 1 --2- 172.21.15.119:0/3733079498 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a3c036e10 0x7f5a3c0392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.246+0000 7f5a4d602640 1 -- 172.21.15.119:0/3733079498 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f5b5408b050 con 0x5601636223b0 2024-04-23T18:30:30.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.246+0000 7f5b5a883640 1 --2- 172.21.15.119:0/3733079498 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a3c036e10 0x7f5a3c0392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.247+0000 7f5b67a16800 1 Processor -- start 2024-04-23T18:30:30.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.247+0000 7f5b67a16800 1 -- start start 2024-04-23T18:30:30.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.247+0000 7f5b5a883640 1 --2- 172.21.15.119:0/3733079498 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a3c036e10 0x7f5a3c0392d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x560163608050 tx=0x7f5b4c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.247+0000 7f5b67a16800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 0x56016362f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.247+0000 7f5b67a16800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560163507960 con 0x56016362f4e0 2024-04-23T18:30:30.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.247+0000 7f5b63084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 0x56016362f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.247+0000 7f5b63084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 0x56016362f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35964/0 (socket says 172.21.15.119:35964) 2024-04-23T18:30:30.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.247+0000 7f5b63084640 1 -- 172.21.15.119:0/1811491817 learned_addr learned my addr 172.21.15.119:0/1811491817 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.247+0000 7f5b63084640 1 -- 172.21.15.119:0/1811491817 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56016362fed0 con 0x56016362f4e0 2024-04-23T18:30:30.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.247+0000 7f5b63084640 1 --2- 172.21.15.119:0/1811491817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 0x56016362f900 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5b54088010 tx=0x7f5b54083750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c46642b119d50dc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.248+0000 7f5a46ffd640 1 -- 172.21.15.119:0/1811491817 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b54050bd0 con 0x56016362f4e0 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.248+0000 7f5a46ffd640 1 -- 172.21.15.119:0/1811491817 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b54058040 con 0x56016362f4e0 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.248+0000 7f5a46ffd640 1 -- 172.21.15.119:0/1811491817 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b5408bb50 con 0x56016362f4e0 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.248+0000 7f5b67a16800 1 -- 172.21.15.119:0/1811491817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 msgr2=0x56016362f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.248+0000 7f5b67a16800 1 --2- 172.21.15.119:0/1811491817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 0x56016362f900 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5b54088010 tx=0x7f5b54083750 comp rx=0 tx=0).stop 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.248+0000 7f5b67a16800 1 -- 172.21.15.119:0/1811491817 shutdown_connections 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.248+0000 7f5b67a16800 1 --2- 172.21.15.119:0/1811491817 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 0x56016362f900 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.248+0000 7f5b67a16800 1 -- 172.21.15.119:0/1811491817 >> 172.21.15.119:0/1811491817 conn(0x56016362b800 msgr2=0x560163629860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.248+0000 7f5b67a16800 1 -- 172.21.15.119:0/1811491817 shutdown_connections 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.248+0000 7f5b67a16800 1 -- 172.21.15.119:0/1811491817 wait complete. 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.248+0000 7f5b67a16800 1 Processor -- start 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.248+0000 7f5b67a16800 1 -- start start 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.249+0000 7f5b67a16800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 0x5601636368d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.249+0000 7f5b67a16800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5601636305f0 con 0x56016362f4e0 2024-04-23T18:30:30.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.249+0000 7f5b63084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 0x5601636368d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.249+0000 7f5b63084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 0x5601636368d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:35980/0 (socket says 172.21.15.119:35980) 2024-04-23T18:30:30.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.249+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 learned_addr learned my addr 172.21.15.119:0/3230500969 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.249+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560163636e10 con 0x56016362f4e0 2024-04-23T18:30:30.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.249+0000 7f5b63084640 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 0x5601636368d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5b540686d0 tx=0x7f5b5407ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.249+0000 7f5a457fa640 1 -- 172.21.15.119:0/3230500969 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b540667d0 con 0x56016362f4e0 2024-04-23T18:30:30.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.249+0000 7f5a457fa640 1 -- 172.21.15.119:0/3230500969 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b54050340 con 0x56016362f4e0 2024-04-23T18:30:30.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.249+0000 7f5a457fa640 1 -- 172.21.15.119:0/3230500969 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b54066970 con 0x56016362f4e0 2024-04-23T18:30:30.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.249+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560163636e10 con 0x56016362f4e0 2024-04-23T18:30:30.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.249+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560163636e10 con 0x56016362f4e0 2024-04-23T18:30:30.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.250+0000 7f5a457fa640 1 -- 172.21.15.119:0/3230500969 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5b540bc020 con 0x56016362f4e0 2024-04-23T18:30:30.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.250+0000 7f5a457fa640 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a2c036e60 0x7f5a2c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.250+0000 7f5a457fa640 1 -- 172.21.15.119:0/3230500969 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f5b540ba020 con 0x56016362f4e0 2024-04-23T18:30:30.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.251+0000 7f5b5a883640 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a2c036e60 0x7f5a2c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.251+0000 7f5b67a16800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.251+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560163641f20 0x5601636443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.251+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560163644b30 con 0x560163641f20 2024-04-23T18:30:30.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.251+0000 7f5b63885640 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560163641f20 0x5601636443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.251+0000 7f5b5a883640 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a2c036e60 0x7f5a2c039320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x560163614350 tx=0x7f5b4c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.251+0000 7f5b63885640 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560163641f20 0x5601636443e0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.251+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x560163641f20 2024-04-23T18:30:30.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.251+0000 7f5b67a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.251+0000 7f5b67a16800 20 realm 2024-04-23T18:30:30.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.251+0000 7f5b67a16800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.251+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560163644f40 con 0x560163641f20 2024-04-23T18:30:30.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x560163641f20 2024-04-23T18:30:30.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b67a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b67a16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:30:30.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b67a16800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5601636457e0 con 0x560163641f20 2024-04-23T18:30:30.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x560163641f20 2024-04-23T18:30:30.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b67a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b67a16800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x560163641f20 2024-04-23T18:30:30.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x560163641f20 2024-04-23T18:30:30.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b67a16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b67a16800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5601636468e0 0x560163648cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560163649210 con 0x5601636468e0 2024-04-23T18:30:30.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b63084640 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5601636468e0 0x560163648cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.252+0000 7f5b63084640 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5601636468e0 0x560163648cd0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.253+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5b5406fce0 con 0x5601636468e0 2024-04-23T18:30:30.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.253+0000 7f5b67a16800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:30:30.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.253+0000 7f5b67a16800 20 searching for the correct realm 2024-04-23T18:30:30.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.253+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56016364b290 0x56016364d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.253+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56016364de20 con 0x56016364b290 2024-04-23T18:30:30.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.253+0000 7f5b5a883640 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56016364b290 0x56016364d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.253+0000 7f5b5a883640 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56016364b290 0x56016364d750 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.253+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.253+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56016364de20 con 0x5601636468e0 2024-04-23T18:30:30.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.254+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5406fce0 con 0x5601636468e0 2024-04-23T18:30:30.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.254+0000 7f5b63084640 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5b54067c20 0x7f5b54062320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.254+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56016364de20 con 0x7f5b54067c20 2024-04-23T18:30:30.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.254+0000 7f5b63885640 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5b54067c20 0x7f5b54062320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.254+0000 7f5b63885640 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5b54067c20 0x7f5b54062320 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.255+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x7f5b54067c20 2024-04-23T18:30:30.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.255+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x560163641f20 2024-04-23T18:30:30.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.255+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x560163641f20 2024-04-23T18:30:30.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.255+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x560163641f20 2024-04-23T18:30:30.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.255+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x560163641f20 2024-04-23T18:30:30.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.255+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x7f5b54067c20 2024-04-23T18:30:30.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.255+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x7f5b54067c20 2024-04-23T18:30:30.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.255+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x7f5b54067c20 2024-04-23T18:30:30.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.256+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x7f5b54067c20 2024-04-23T18:30:30.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.256+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x5601636468e0 2024-04-23T18:30:30.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.256+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5406fce0 con 0x5601636468e0 2024-04-23T18:30:30.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.256+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x56016364b290 2024-04-23T18:30:30.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.256+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.256+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x560163641f20 2024-04-23T18:30:30.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.256+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x560163641f20 2024-04-23T18:30:30.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.256+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x7f5b54067c20 2024-04-23T18:30:30.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.257+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x7f5b54067c20 2024-04-23T18:30:30.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.257+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x560163641f20 2024-04-23T18:30:30.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.257+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x560163641f20 2024-04-23T18:30:30.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.257+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x5601636468e0 2024-04-23T18:30:30.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.257+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5b5406fce0 con 0x5601636468e0 2024-04-23T18:30:30.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.257+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x56016364b290 2024-04-23T18:30:30.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.257+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.257+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x56016364b290 2024-04-23T18:30:30.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.257+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.257+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x7f5b54067c20 2024-04-23T18:30:30.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.258+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x7f5b54067c20 2024-04-23T18:30:30.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.258+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x56016364b290 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.258+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.258+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x56016364b290 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.258+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.258+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x560163641f20 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.258+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x560163641f20 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.258+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x560163641f20 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.259+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x560163641f20 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.259+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x7f5b54067c20 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.259+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x7f5b54067c20 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.259+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x56016364b290 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.259+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.259+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x5601636468e0 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.260+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5b5406fce0 con 0x5601636468e0 2024-04-23T18:30:30.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.260+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x560163641f20 2024-04-23T18:30:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.260+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x560163641f20 2024-04-23T18:30:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.260+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x5601636468e0 2024-04-23T18:30:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.260+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5406fce0 con 0x5601636468e0 2024-04-23T18:30:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.260+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x56016364b290 2024-04-23T18:30:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.260+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.260+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x7f5b54067c20 2024-04-23T18:30:30.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.261+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x7f5b54067c20 2024-04-23T18:30:30.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.261+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x5601636468e0 2024-04-23T18:30:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.261+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b540d5040 con 0x5601636468e0 2024-04-23T18:30:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.261+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x56016364b290 2024-04-23T18:30:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.261+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.261+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x7f5b54067c20 2024-04-23T18:30:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.261+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5c00a4a0 con 0x7f5b54067c20 2024-04-23T18:30:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.261+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x560163641f20 2024-04-23T18:30:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5b5c040080 con 0x560163641f20 2024-04-23T18:30:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560163645b80 con 0x5601636468e0 2024-04-23T18:30:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b540d5040 con 0x5601636468e0 2024-04-23T18:30:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b67a16800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:30:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b67a16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:30:30.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b67a16800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:30:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b67a16800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:30:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b67a16800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:30:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b67a16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:30:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b67a16800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560163649b90 con 0x560163641f20 2024-04-23T18:30:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x560163641f20 2024-04-23T18:30:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b67a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b67a16800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.262+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560163649f80 con 0x560163641f20 2024-04-23T18:30:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b5c040080 con 0x560163641f20 2024-04-23T18:30:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560163649f80 con 0x7f5b54067c20 2024-04-23T18:30:30.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5b5c040080 con 0x7f5b54067c20 2024-04-23T18:30:30.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:30:30.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 20 zone default found 2024-04-23T18:30:30.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 4 Realm: () 2024-04-23T18:30:30.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:30:30.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:30:30.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:30:30.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 20 zonegroup default 2024-04-23T18:30:30.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56016364a3a0 con 0x5601636468e0 2024-04-23T18:30:30.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5b540d5040 con 0x5601636468e0 2024-04-23T18:30:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56016364fc80 con 0x56016364b290 2024-04-23T18:30:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.263+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.264+0000 7f5b67a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.264+0000 7f5b67a16800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.264+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560163650020 con 0x56016364b290 2024-04-23T18:30:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.264+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.264+0000 7f5b67a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.264+0000 7f5b67a16800 20 started sync module instance, tier type = 2024-04-23T18:30:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.264+0000 7f5b67a16800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:30:30.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.264+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56016364f120 con 0x5601636468e0 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.265+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b540d5040 con 0x5601636468e0 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.265+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94563962516800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56016364ed80 con 0x5601636468e0 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.265+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163650ee0 con 0x560163641f20 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.266+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94563962516800] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b540d5040 con 0x5601636468e0 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.266+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x560163641f20 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.266+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94563962522160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163650e50 con 0x560163641f20 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.266+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163651de0 con 0x56016364b290 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.267+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.267+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94563962525936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163652680 con 0x56016364b290 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.267+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163653170 con 0x5601636468e0 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.268+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94563962522160] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x560163641f20 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.268+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b540d5040 con 0x5601636468e0 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.268+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94563962530880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163653560 con 0x5601636468e0 2024-04-23T18:30:30.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.268+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163653fc0 con 0x560163641f20 2024-04-23T18:30:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.269+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94563962525936] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.270+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x560163641f20 2024-04-23T18:30:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.270+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94563962530880] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b540d5040 con 0x5601636468e0 2024-04-23T18:30:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.270+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94563962524368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163653fc0 con 0x560163641f20 2024-04-23T18:30:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.270+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163654860 con 0x7f5b54067c20 2024-04-23T18:30:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.271+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94563962524368] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x560163641f20 2024-04-23T18:30:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.271+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x7f5b54067c20 2024-04-23T18:30:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.271+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94563962528208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163654470 con 0x7f5b54067c20 2024-04-23T18:30:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.271+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163654e30 con 0x7f5b54067c20 2024-04-23T18:30:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.272+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94563962528208] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x7f5b54067c20 2024-04-23T18:30:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.272+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x7f5b54067c20 2024-04-23T18:30:30.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.272+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94563962536352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163654e30 con 0x7f5b54067c20 2024-04-23T18:30:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.272+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5601636557f0 con 0x7f5b54067c20 2024-04-23T18:30:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.273+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94563962536352] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x7f5b54067c20 2024-04-23T18:30:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.273+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x7f5b54067c20 2024-04-23T18:30:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.274+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94563962538848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5601636557f0 con 0x7f5b54067c20 2024-04-23T18:30:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.274+0000 7f5b67a16800 20 add_watcher() i=0 2024-04-23T18:30:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.274+0000 7f5b67a16800 20 add_watcher() i=1 2024-04-23T18:30:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.274+0000 7f5b67a16800 20 add_watcher() i=2 2024-04-23T18:30:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.274+0000 7f5b67a16800 20 add_watcher() i=3 2024-04-23T18:30:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.274+0000 7f5b67a16800 20 add_watcher() i=4 2024-04-23T18:30:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.274+0000 7f5b67a16800 20 add_watcher() i=5 2024-04-23T18:30:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.274+0000 7f5b67a16800 20 add_watcher() i=6 2024-04-23T18:30:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.274+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94563962538848] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x7f5b54067c20 2024-04-23T18:30:30.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.274+0000 7f5b67a16800 20 add_watcher() i=7 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.274+0000 7f5b67a16800 2 all 8 watchers are set, enabling cache 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.275+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560163658b50 con 0x560163641f20 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.275+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5b5c040080 con 0x560163641f20 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.275+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94563962541232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163655d80 con 0x560163641f20 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.276+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94563962541232] v34'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x560163641f20 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.276+0000 7f5a19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.276+0000 7f5b67a16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.276+0000 7f5b67a16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.276+0000 7f5b67a16800 5 note: GC not initialized 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.276+0000 7f5a18fe1640 20 reqs_thread_entry: start 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.276+0000 7f5b67a16800 20 init_complete bucket index max shards: 11 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.276+0000 7f5b67a16800 20 Filter name: none 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.276+0000 7f59927fc640 20 reqs_thread_entry: start 2024-04-23T18:30:30.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.276+0000 7f5b67a16800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.277+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56016368bf00 con 0x560163641f20 2024-04-23T18:30:30.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.277+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5b5c040080 con 0x560163641f20 2024-04-23T18:30:30.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.277+0000 7f5b67a16800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:30:30.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.277+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56016368d450 con 0x7f5b54067c20 2024-04-23T18:30:30.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.278+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f5b5c040080 con 0x7f5b54067c20 2024-04-23T18:30:30.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.278+0000 7f5a19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.278+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94563962541232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163657f70 con 0x560163641f20 2024-04-23T18:30:30.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.279+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94563962541232] v34'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x560163641f20 2024-04-23T18:30:30.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.279+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94563962516800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5601636554b0 con 0x5601636468e0 2024-04-23T18:30:30.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.280+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94563962516800] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b540d5040 con 0x5601636468e0 2024-04-23T18:30:30.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.280+0000 7f5b67a16800 20 remove_watcher() i=0 2024-04-23T18:30:30.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.280+0000 7f5b67a16800 2 removed watcher, disabling cache 2024-04-23T18:30:30.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.280+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94563962522160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5601636554b0 con 0x560163641f20 2024-04-23T18:30:30.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.281+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94563962522160] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x560163641f20 2024-04-23T18:30:30.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.281+0000 7f5b67a16800 20 remove_watcher() i=1 2024-04-23T18:30:30.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.281+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94563962525936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163650a30 con 0x56016364b290 2024-04-23T18:30:30.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.282+0000 7f5b5a883640 1 -- 172.21.15.119:0/3230500969 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94563962525936] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b4c009050 con 0x56016364b290 2024-04-23T18:30:30.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.282+0000 7f5b67a16800 20 remove_watcher() i=2 2024-04-23T18:30:30.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.282+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94563962530880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5601636554b0 con 0x5601636468e0 2024-04-23T18:30:30.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.283+0000 7f5b63084640 1 -- 172.21.15.119:0/3230500969 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94563962530880] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b540d5040 con 0x5601636468e0 2024-04-23T18:30:30.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.283+0000 7f5b67a16800 20 remove_watcher() i=3 2024-04-23T18:30:30.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.284+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94563962524368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5601636518f0 con 0x560163641f20 2024-04-23T18:30:30.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.285+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94563962524368] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x560163641f20 2024-04-23T18:30:30.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.285+0000 7f5b67a16800 20 remove_watcher() i=4 2024-04-23T18:30:30.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.285+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94563962528208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560163652c40 con 0x7f5b54067c20 2024-04-23T18:30:30.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.286+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94563962528208] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x7f5b54067c20 2024-04-23T18:30:30.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.286+0000 7f5b67a16800 20 remove_watcher() i=5 2024-04-23T18:30:30.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.286+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94563962536352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5601636554b0 con 0x7f5b54067c20 2024-04-23T18:30:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.287+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94563962536352] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x7f5b54067c20 2024-04-23T18:30:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.287+0000 7f5b67a16800 20 remove_watcher() i=6 2024-04-23T18:30:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.287+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94563962538848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5601636518f0 con 0x7f5b54067c20 2024-04-23T18:30:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94563962538848] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5c040080 con 0x7f5b54067c20 2024-04-23T18:30:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 20 remove_watcher() i=7 2024-04-23T18:30:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5b54067c20 msgr2=0x7f5b54062320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5b54067c20 0x7f5b54062320 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560163641f20 msgr2=0x5601636443e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560163641f20 0x5601636443e0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5601636468e0 msgr2=0x560163648cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5601636468e0 0x560163648cd0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56016364b290 msgr2=0x56016364d750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x56016364b290 0x56016364d750 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a2c036e60 msgr2=0x7f5a2c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a2c036e60 0x7f5a2c039320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x560163614350 tx=0x7f5b4c010000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 msgr2=0x5601636368d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b63885640 1 -- 172.21.15.119:0/3230500969 reap_dead start 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 0x5601636368d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5b540686d0 tx=0x7f5b5407ff30 comp rx=0 tx=0).stop 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 shutdown_connections 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3230500969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56016362f4e0 0x5601636368d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 >> 172.21.15.119:0/3230500969 conn(0x56016362b800 msgr2=0x560163628e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 shutdown_connections 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 -- 172.21.15.119:0/3230500969 wait complete. 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 -- 172.21.15.119:0/3733079498 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a3c036e10 msgr2=0x7f5a3c0392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3733079498 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a3c036e10 0x7f5a3c0392d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x560163608050 tx=0x7f5b4c00f000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 -- 172.21.15.119:0/3733079498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601636223b0 msgr2=0x5601636227d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.288+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3733079498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601636223b0 0x5601636227d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5b5406ff90 tx=0x7f5b5406f6b0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 -- 172.21.15.119:0/3733079498 shutdown_connections 2024-04-23T18:30:30.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3733079498 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a3c036e10 0x7f5a3c0392d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 --2- 172.21.15.119:0/3733079498 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601636223b0 0x5601636227d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 -- 172.21.15.119:0/3733079498 >> 172.21.15.119:0/3733079498 conn(0x560163616450 msgr2=0x560163616850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 -- 172.21.15.119:0/3733079498 shutdown_connections 2024-04-23T18:30:30.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 -- 172.21.15.119:0/3733079498 wait complete. 2024-04-23T18:30:30.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5601636113a0 msgr2=0x5601636137f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5601636113a0 0x5601636137f0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56016350c390 msgr2=0x56016360ab60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x56016350c390 0x56016360ab60 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56016360d460 msgr2=0x56016360f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56016360d460 0x56016360f850 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a48036e60 msgr2=0x7f5a48039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5a48036e60 0x7f5a48039320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c001d90 tx=0x7f5b4c0012f0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 msgr2=0x560163603af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 --2- 172.21.15.119:0/1179630714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560163509a60 0x560163603af0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5b54055040 tx=0x7f5b54002fb0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b63885640 1 -- 172.21.15.119:0/1179630714 reap_dead start 2024-04-23T18:30:30.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 shutdown_connections 2024-04-23T18:30:30.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 >> 172.21.15.119:0/1179630714 conn(0x560163503410 msgr2=0x560163507e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 shutdown_connections 2024-04-23T18:30:30.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.289+0000 7f5b67a16800 1 -- 172.21.15.119:0/1179630714 wait complete. 2024-04-23T18:30:30.295 INFO:teuthology.orchestra.run.smithi119.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-23T18:30:30.295 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:30:30.295 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-23T18:30:30.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-23T18:30:30.296 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-04-23T18:30:30.380 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:30:30.380 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:30:30.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.388+0000 7fcbf332e800 1 Processor -- start 2024-04-23T18:30:30.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.388+0000 7fcbf332e800 1 -- start start 2024-04-23T18:30:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.388+0000 7fcbf332e800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556f4c1428a0 0x556f4c142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.388+0000 7fcbf332e800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556f4bff4560 con 0x556f4c143200 2024-04-23T18:30:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.388+0000 7fcbf332e800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x556f4bfe5e20 con 0x556f4c1428a0 2024-04-23T18:30:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.389+0000 7fcbef067640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556f4c1428a0 0x556f4c142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.389+0000 7fcbee866640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x556f4c143200 0x556f4c1436b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:39344/0 (socket says 172.21.15.119:39344) 2024-04-23T18:30:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.389+0000 7fcbee866640 1 -- 172.21.15.119:0/1568802240 learned_addr learned my addr 172.21.15.119:0/1568802240 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:30:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.389+0000 7fcbef067640 1 -- 172.21.15.119:0/1568802240 >> v1:172.21.15.62:6789/0 conn(0x556f4c143200 legacy=0x556f4c1436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.389+0000 7fcbef067640 1 -- 172.21.15.119:0/1568802240 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f4bff3e60 con 0x556f4c1428a0 2024-04-23T18:30:30.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.391+0000 7fcbef067640 1 --2- 172.21.15.119:0/1568802240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c142cc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000a470 tx=0x7fcbe001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd73a6d731d1f470 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.391+0000 7fcbee065640 1 -- 172.21.15.119:0/1568802240 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe0057070 con 0x556f4c1428a0 2024-04-23T18:30:30.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.391+0000 7fcbee065640 1 -- 172.21.15.119:0/1568802240 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe004adc0 con 0x556f4c1428a0 2024-04-23T18:30:30.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.391+0000 7fcbee065640 1 -- 172.21.15.119:0/1568802240 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe0052590 con 0x556f4c1428a0 2024-04-23T18:30:30.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.391+0000 7fcbf332e800 1 -- 172.21.15.119:0/1568802240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 msgr2=0x556f4c142cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.391+0000 7fcbf332e800 1 --2- 172.21.15.119:0/1568802240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c142cc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000a470 tx=0x7fcbe001ce90 comp rx=0 tx=0).stop 2024-04-23T18:30:30.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.392+0000 7fcbf332e800 1 -- 172.21.15.119:0/1568802240 shutdown_connections 2024-04-23T18:30:30.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.392+0000 7fcbf332e800 1 --2- 172.21.15.119:0/1568802240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c142cc0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.392+0000 7fcbf332e800 1 -- 172.21.15.119:0/1568802240 >> 172.21.15.119:0/1568802240 conn(0x556f4c13e440 msgr2=0x556f4c140860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.392+0000 7fcbf332e800 1 -- 172.21.15.119:0/1568802240 shutdown_connections 2024-04-23T18:30:30.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.392+0000 7fcbf332e800 1 -- 172.21.15.119:0/1568802240 wait complete. 2024-04-23T18:30:30.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.403+0000 7fcbf332e800 1 Processor -- start 2024-04-23T18:30:30.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.403+0000 7fcbf332e800 1 -- start start 2024-04-23T18:30:30.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.403+0000 7fcbf332e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c237540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.403+0000 7fcbf332e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556f4c08f5d0 con 0x556f4c1428a0 2024-04-23T18:30:30.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.404+0000 7fcbef067640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c237540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.404+0000 7fcbef067640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c237540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36006/0 (socket says 172.21.15.119:36006) 2024-04-23T18:30:30.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.404+0000 7fcbef067640 1 -- 172.21.15.119:0/3658949861 learned_addr learned my addr 172.21.15.119:0/3658949861 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.404+0000 7fcbef067640 1 -- 172.21.15.119:0/3658949861 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f4c005860 con 0x556f4c1428a0 2024-04-23T18:30:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.404+0000 7fcbef067640 1 --2- 172.21.15.119:0/3658949861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c237540 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0055040 tx=0x7fcbe004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761a49b017501e43 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.404+0000 7fcadd60a640 1 -- 172.21.15.119:0/3658949861 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe0057040 con 0x556f4c1428a0 2024-04-23T18:30:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.404+0000 7fcadd60a640 1 -- 172.21.15.119:0/3658949861 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe0062070 con 0x556f4c1428a0 2024-04-23T18:30:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.404+0000 7fcadd60a640 1 -- 172.21.15.119:0/3658949861 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe005d470 con 0x556f4c1428a0 2024-04-23T18:30:30.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.405+0000 7fcbf332e800 1 -- 172.21.15.119:0/3658949861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 msgr2=0x556f4c237540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.405+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3658949861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c237540 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0055040 tx=0x7fcbe004c000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.405+0000 7fcbf332e800 1 -- 172.21.15.119:0/3658949861 shutdown_connections 2024-04-23T18:30:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.405+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3658949861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c237540 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.405+0000 7fcbf332e800 1 -- 172.21.15.119:0/3658949861 >> 172.21.15.119:0/3658949861 conn(0x556f4c13e440 msgr2=0x556f4c232e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.405+0000 7fcbf332e800 1 -- 172.21.15.119:0/3658949861 shutdown_connections 2024-04-23T18:30:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.405+0000 7fcbf332e800 1 -- 172.21.15.119:0/3658949861 wait complete. 2024-04-23T18:30:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.405+0000 7fcbf332e800 1 Processor -- start 2024-04-23T18:30:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.406+0000 7fcbf332e800 1 -- start start 2024-04-23T18:30:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.406+0000 7fcbf332e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c23ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.406+0000 7fcbf332e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556f4c144060 con 0x556f4c1428a0 2024-04-23T18:30:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.406+0000 7fcbef067640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c23ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.406+0000 7fcbef067640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c23ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36018/0 (socket says 172.21.15.119:36018) 2024-04-23T18:30:30.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.406+0000 7fcbef067640 1 -- 172.21.15.119:0/3374844578 learned_addr learned my addr 172.21.15.119:0/3374844578 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.406+0000 7fcbef067640 1 -- 172.21.15.119:0/3374844578 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f4c003eb0 con 0x556f4c1428a0 2024-04-23T18:30:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.406+0000 7fcbef067640 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c23ede0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcbe001ce60 tx=0x7fcbe0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.406+0000 7fcadbe07640 1 -- 172.21.15.119:0/3374844578 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe006b070 con 0x556f4c1428a0 2024-04-23T18:30:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.406+0000 7fcadbe07640 1 -- 172.21.15.119:0/3374844578 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe005d970 con 0x556f4c1428a0 2024-04-23T18:30:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.406+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f4c23f320 con 0x556f4c1428a0 2024-04-23T18:30:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.406+0000 7fcadbe07640 1 -- 172.21.15.119:0/3374844578 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe0057070 con 0x556f4c1428a0 2024-04-23T18:30:30.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.407+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f4c23f840 con 0x556f4c1428a0 2024-04-23T18:30:30.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.407+0000 7fcadbe07640 1 -- 172.21.15.119:0/3374844578 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fcbe005dc90 con 0x556f4c1428a0 2024-04-23T18:30:30.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.407+0000 7fcadbe07640 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcad4036e60 0x7fcad4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.408+0000 7fcadbe07640 1 -- 172.21.15.119:0/3374844578 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fcbe008e880 con 0x556f4c1428a0 2024-04-23T18:30:30.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.408+0000 7fcbee866640 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcad4036e60 0x7fcad4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.408+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556f4c143200 0x556f4c245e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.408+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c246390 con 0x556f4c143200 2024-04-23T18:30:30.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.408+0000 7fcbef868640 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556f4c143200 0x556f4c245e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.408+0000 7fcbee866640 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcad4036e60 0x7fcad4039320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4000f60 tx=0x7fcbe40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.408+0000 7fcbef868640 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556f4c143200 0x556f4c245e50 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.408+0000 7fcbef868640 1 -- 172.21.15.119:0/3374844578 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c143200 2024-04-23T18:30:30.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.408+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c243420 con 0x556f4c143200 2024-04-23T18:30:30.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.409+0000 7fcbef868640 1 -- 172.21.15.119:0/3374844578 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c143200 2024-04-23T18:30:30.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.409+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556f4c2486e0 0x556f4c24aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.409+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c24b1a0 con 0x556f4c2486e0 2024-04-23T18:30:30.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.409+0000 7fcbef067640 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556f4c2486e0 0x556f4c24aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.409+0000 7fcbef067640 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556f4c2486e0 0x556f4c24aad0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.409+0000 7fcbef067640 1 -- 172.21.15.119:0/3374844578 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcbe005a040 con 0x556f4c2486e0 2024-04-23T18:30:30.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.409+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c247690 con 0x556f4c143200 2024-04-23T18:30:30.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.410+0000 7fcbef868640 1 -- 172.21.15.119:0/3374844578 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c143200 2024-04-23T18:30:30.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.410+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556f4c24c5e0 0x556f4c24eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.410+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c24f230 con 0x556f4c24c5e0 2024-04-23T18:30:30.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.410+0000 7fcbee866640 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556f4c24c5e0 0x556f4c24eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.410+0000 7fcbee866640 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556f4c24c5e0 0x556f4c24eaa0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.410+0000 7fcbee866640 1 -- 172.21.15.119:0/3374844578 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c24c5e0 2024-04-23T18:30:30.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.411+0000 7fcbf332e800 1 Processor -- start 2024-04-23T18:30:30.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.411+0000 7fcbf332e800 1 -- start start 2024-04-23T18:30:30.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.411+0000 7fcbf332e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c25d6e0 0x556f4c25db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.411+0000 7fcbf332e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556f4c035df0 con 0x556f4c25d6e0 2024-04-23T18:30:30.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.411+0000 7fcbef067640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c25d6e0 0x556f4c25db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.411+0000 7fcbef067640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c25d6e0 0x556f4c25db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36032/0 (socket says 172.21.15.119:36032) 2024-04-23T18:30:30.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.411+0000 7fcbef067640 1 -- 172.21.15.119:0/1348975769 learned_addr learned my addr 172.21.15.119:0/1348975769 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.411+0000 7fcbef067640 1 -- 172.21.15.119:0/1348975769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f4c25e040 con 0x556f4c25d6e0 2024-04-23T18:30:30.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.412+0000 7fcbef067640 1 --2- 172.21.15.119:0/1348975769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c25d6e0 0x556f4c25db00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fcbe008cb20 tx=0x7fcbe005bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.411 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.412+0000 7fcad9602640 1 -- 172.21.15.119:0/1348975769 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe005bd80 con 0x556f4c25d6e0 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.412+0000 7fcad9602640 1 -- 172.21.15.119:0/1348975769 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe0009840 con 0x556f4c25d6e0 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.412+0000 7fcad9602640 1 -- 172.21.15.119:0/1348975769 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe008b3b0 con 0x556f4c25d6e0 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.412+0000 7fcbf332e800 1 -- 172.21.15.119:0/1348975769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f4c25eab0 con 0x556f4c25d6e0 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.412+0000 7fcbf332e800 1 -- 172.21.15.119:0/1348975769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f4c25efb0 con 0x556f4c25d6e0 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.413+0000 7fcad9602640 1 -- 172.21.15.119:0/1348975769 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fcbe0095060 con 0x556f4c25d6e0 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.413+0000 7fcad9602640 1 --2- 172.21.15.119:0/1348975769 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcac8036eb0 0x7fcac8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.413+0000 7fcad9602640 1 -- 172.21.15.119:0/1348975769 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fcbe0089030 con 0x556f4c25d6e0 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.413+0000 7fcbee866640 1 --2- 172.21.15.119:0/1348975769 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcac8036eb0 0x7fcac8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.413+0000 7fcbf332e800 1 Processor -- start 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.413+0000 7fcbf332e800 1 -- start start 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.413+0000 7fcbee866640 1 --2- 172.21.15.119:0/1348975769 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcac8036eb0 0x7fcac8039370 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400bf50 tx=0x7fcbe400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.413+0000 7fcbf332e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 0x556f4c26ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.413+0000 7fcbf332e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556f4c237c00 con 0x556f4c26a800 2024-04-23T18:30:30.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.414+0000 7fcbef067640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 0x556f4c26ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.414+0000 7fcbef067640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 0x556f4c26ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36034/0 (socket says 172.21.15.119:36034) 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.414+0000 7fcbef067640 1 -- 172.21.15.119:0/2269280091 learned_addr learned my addr 172.21.15.119:0/2269280091 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.414+0000 7fcbef067640 1 -- 172.21.15.119:0/2269280091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f4c26b1f0 con 0x556f4c26a800 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.414+0000 7fcbef067640 1 --2- 172.21.15.119:0/2269280091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 0x556f4c26ac20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcbe008e100 tx=0x7fcbe008b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a4067150b65992 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.414+0000 7fcad2ffd640 1 -- 172.21.15.119:0/2269280091 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe00a5020 con 0x556f4c26a800 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.414+0000 7fcad2ffd640 1 -- 172.21.15.119:0/2269280091 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe0058280 con 0x556f4c26a800 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.414+0000 7fcad2ffd640 1 -- 172.21.15.119:0/2269280091 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe0081d10 con 0x556f4c26a800 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbf332e800 1 -- 172.21.15.119:0/2269280091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 msgr2=0x556f4c26ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbf332e800 1 --2- 172.21.15.119:0/2269280091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 0x556f4c26ac20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fcbe008e100 tx=0x7fcbe008b550 comp rx=0 tx=0).stop 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbf332e800 1 -- 172.21.15.119:0/2269280091 shutdown_connections 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbf332e800 1 --2- 172.21.15.119:0/2269280091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 0x556f4c26ac20 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbf332e800 1 -- 172.21.15.119:0/2269280091 >> 172.21.15.119:0/2269280091 conn(0x556f4c266b60 msgr2=0x556f4c264bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbf332e800 1 -- 172.21.15.119:0/2269280091 shutdown_connections 2024-04-23T18:30:30.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbf332e800 1 -- 172.21.15.119:0/2269280091 wait complete. 2024-04-23T18:30:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbf332e800 1 Processor -- start 2024-04-23T18:30:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbf332e800 1 -- start start 2024-04-23T18:30:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbf332e800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 0x556f4c271bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbf332e800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556f4c26b8a0 con 0x556f4c26a800 2024-04-23T18:30:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbef067640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 0x556f4c271bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbef067640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 0x556f4c271bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36042/0 (socket says 172.21.15.119:36042) 2024-04-23T18:30:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.415+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 learned_addr learned my addr 172.21.15.119:0/3302324452 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.416+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f4c272110 con 0x556f4c26a800 2024-04-23T18:30:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.416+0000 7fcbef067640 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 0x556f4c271bd0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcbe008b590 tx=0x7fcbe005ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.416+0000 7fcad17fa640 1 -- 172.21.15.119:0/3302324452 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe00ba070 con 0x556f4c26a800 2024-04-23T18:30:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.416+0000 7fcad17fa640 1 -- 172.21.15.119:0/3302324452 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe0079980 con 0x556f4c26a800 2024-04-23T18:30:30.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.416+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f4c272110 con 0x556f4c26a800 2024-04-23T18:30:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.416+0000 7fcad17fa640 1 -- 172.21.15.119:0/3302324452 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbe006e720 con 0x556f4c26a800 2024-04-23T18:30:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.416+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f4c272110 con 0x556f4c26a800 2024-04-23T18:30:30.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.417+0000 7fcad17fa640 1 -- 172.21.15.119:0/3302324452 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fcbe00bd070 con 0x556f4c26a800 2024-04-23T18:30:30.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.417+0000 7fcad17fa640 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcab8036e60 0x7fcab8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.417+0000 7fcad17fa640 1 -- 172.21.15.119:0/3302324452 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fcbe00b0030 con 0x556f4c26a800 2024-04-23T18:30:30.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.417+0000 7fcbee866640 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcab8036e60 0x7fcab8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.417+0000 7fcbf332e800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.417+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556f4c27d2c0 0x556f4c27f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.417+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c27fed0 con 0x556f4c27d2c0 2024-04-23T18:30:30.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.417+0000 7fcbef868640 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556f4c27d2c0 0x556f4c27f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.417+0000 7fcbee866640 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcab8036e60 0x7fcab8039320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4001b60 tx=0x7fcbe4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbef868640 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556f4c27d2c0 0x556f4c27f780 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c27d2c0 2024-04-23T18:30:30.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 20 realm 2024-04-23T18:30:30.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c2802e0 con 0x556f4c27d2c0 2024-04-23T18:30:30.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c27d2c0 2024-04-23T18:30:30.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:30:30.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280bb0 con 0x556f4c27d2c0 2024-04-23T18:30:30.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c27d2c0 2024-04-23T18:30:30.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c27d2c0 2024-04-23T18:30:30.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c27d2c0 2024-04-23T18:30:30.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556f4c281a40 0x556f4c283e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.418+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c284570 con 0x556f4c281a40 2024-04-23T18:30:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.419+0000 7fcbef067640 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556f4c281a40 0x556f4c283e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.419+0000 7fcbef067640 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556f4c281a40 0x556f4c283e30 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.419+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcbe00bc030 con 0x556f4c281a40 2024-04-23T18:30:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.419+0000 7fcbf332e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:30:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.419+0000 7fcbf332e800 20 searching for the correct realm 2024-04-23T18:30:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.419+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556f4c286610 0x556f4c288ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.419+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c2891a0 con 0x556f4c286610 2024-04-23T18:30:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.419+0000 7fcbee866640 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556f4c286610 0x556f4c288ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.419+0000 7fcbee866640 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556f4c286610 0x556f4c288ad0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.420+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.420+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c2891a0 con 0x556f4c281a40 2024-04-23T18:30:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.420+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe00bc030 con 0x556f4c281a40 2024-04-23T18:30:30.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.420+0000 7fcbef067640 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fcbe00bf060 0x7fcbe00b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.420+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c2891a0 con 0x7fcbe00bf060 2024-04-23T18:30:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.420+0000 7fcbef868640 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fcbe00bf060 0x7fcbe00b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.421+0000 7fcbef868640 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fcbe00bf060 0x7fcbe00b5880 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.421+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800a4a0 con 0x7fcbe00bf060 2024-04-23T18:30:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.421+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c27d2c0 2024-04-23T18:30:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.421+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c27d2c0 2024-04-23T18:30:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.421+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c27d2c0 2024-04-23T18:30:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.421+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c27d2c0 2024-04-23T18:30:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.422+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x7fcbe00bf060 2024-04-23T18:30:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.422+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800a4a0 con 0x7fcbe00bf060 2024-04-23T18:30:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.422+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x7fcbe00bf060 2024-04-23T18:30:30.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.422+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcbe800a4a0 con 0x7fcbe00bf060 2024-04-23T18:30:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.422+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c281a40 2024-04-23T18:30:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.422+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe00bc030 con 0x556f4c281a40 2024-04-23T18:30:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.422+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c286610 2024-04-23T18:30:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.422+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.423+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c27d2c0 2024-04-23T18:30:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.423+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c27d2c0 2024-04-23T18:30:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.423+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x7fcbe00bf060 2024-04-23T18:30:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.423+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800a4a0 con 0x7fcbe00bf060 2024-04-23T18:30:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.423+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c27d2c0 2024-04-23T18:30:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.423+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c27d2c0 2024-04-23T18:30:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.423+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c281a40 2024-04-23T18:30:30.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.423+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcbe00bc030 con 0x556f4c281a40 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.423+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c286610 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.424+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.424+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c286610 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.424+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.424+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x7fcbe00bf060 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.424+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800a4a0 con 0x7fcbe00bf060 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.424+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c286610 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.424+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.424+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c286610 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.425+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.425+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c27d2c0 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.425+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c27d2c0 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.425+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c27d2c0 2024-04-23T18:30:30.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.425+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c27d2c0 2024-04-23T18:30:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.425+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x7fcbe00bf060 2024-04-23T18:30:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.425+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800a4a0 con 0x7fcbe00bf060 2024-04-23T18:30:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.425+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c286610 2024-04-23T18:30:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.426+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.426+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c281a40 2024-04-23T18:30:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.426+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcbe00bc030 con 0x556f4c281a40 2024-04-23T18:30:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.426+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c27d2c0 2024-04-23T18:30:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.426+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800a4a0 con 0x556f4c27d2c0 2024-04-23T18:30:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.426+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c281a40 2024-04-23T18:30:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.426+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe00bc030 con 0x556f4c281a40 2024-04-23T18:30:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.426+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c286610 2024-04-23T18:30:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.427+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.427+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x7fcbe00bf060 2024-04-23T18:30:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.427+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800a4a0 con 0x7fcbe00bf060 2024-04-23T18:30:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.427+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c281a40 2024-04-23T18:30:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.427+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe00d4040 con 0x556f4c281a40 2024-04-23T18:30:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.427+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c286610 2024-04-23T18:30:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.427+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.427+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x7fcbe00bf060 2024-04-23T18:30:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.428+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe800a4a0 con 0x7fcbe00bf060 2024-04-23T18:30:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.428+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c27d2c0 2024-04-23T18:30:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.428+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcbe8040080 con 0x556f4c27d2c0 2024-04-23T18:30:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.428+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556f4c280f50 con 0x556f4c281a40 2024-04-23T18:30:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.428+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbe00d4040 con 0x556f4c281a40 2024-04-23T18:30:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.428+0000 7fcbf332e800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:30:30.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.428+0000 7fcbf332e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:30:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.428+0000 7fcbf332e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:30:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.428+0000 7fcbf332e800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:30:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.428+0000 7fcbf332e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:30:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.428+0000 7fcbf332e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:30:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.428+0000 7fcbf332e800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.428+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c284f10 con 0x556f4c27d2c0 2024-04-23T18:30:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x556f4c27d2c0 2024-04-23T18:30:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c285300 con 0x556f4c27d2c0 2024-04-23T18:30:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcbe8040080 con 0x556f4c27d2c0 2024-04-23T18:30:30.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c285300 con 0x7fcbe00bf060 2024-04-23T18:30:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcbe8040080 con 0x7fcbe00bf060 2024-04-23T18:30:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:30:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 20 zone default found 2024-04-23T18:30:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 4 Realm: () 2024-04-23T18:30:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:30:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:30:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:30:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 20 zonegroup default 2024-04-23T18:30:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c285720 con 0x556f4c281a40 2024-04-23T18:30:30.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcbe00d4040 con 0x556f4c281a40 2024-04-23T18:30:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.429+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28b000 con 0x556f4c286610 2024-04-23T18:30:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.430+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.430+0000 7fcbf332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.430+0000 7fcbf332e800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.430+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28b3a0 con 0x556f4c286610 2024-04-23T18:30:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.430+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.430+0000 7fcbf332e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.430+0000 7fcbf332e800 20 started sync module instance, tier type = 2024-04-23T18:30:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.430+0000 7fcbf332e800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:30:30.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.430+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28a4a0 con 0x556f4c281a40 2024-04-23T18:30:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.431+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe00d4040 con 0x556f4c281a40 2024-04-23T18:30:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.431+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93936507463872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28a100 con 0x556f4c281a40 2024-04-23T18:30:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.431+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28c210 con 0x556f4c27d2c0 2024-04-23T18:30:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.432+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93936507463872] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe00d4040 con 0x556f4c281a40 2024-04-23T18:30:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.432+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x556f4c27d2c0 2024-04-23T18:30:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.432+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93936507467584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28c210 con 0x556f4c27d2c0 2024-04-23T18:30:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.432+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28cd20 con 0x556f4c286610 2024-04-23T18:30:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.433+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93936507467584] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x556f4c27d2c0 2024-04-23T18:30:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.434+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.434+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93936507469152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28c180 con 0x556f4c286610 2024-04-23T18:30:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.434+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28dbe0 con 0x556f4c281a40 2024-04-23T18:30:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.435+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe00d4040 con 0x556f4c281a40 2024-04-23T18:30:30.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.435+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93936507476240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28e3a0 con 0x556f4c281a40 2024-04-23T18:30:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.435+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28eec0 con 0x556f4c27d2c0 2024-04-23T18:30:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.435+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93936507469152] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.435+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93936507476240] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe00d4040 con 0x556f4c281a40 2024-04-23T18:30:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.436+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x556f4c27d2c0 2024-04-23T18:30:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.436+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93936507480464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28ee80 con 0x556f4c27d2c0 2024-04-23T18:30:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.436+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28f760 con 0x7fcbe00bf060 2024-04-23T18:30:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.437+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x7fcbe00bf060 2024-04-23T18:30:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.437+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93936507482720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28ee80 con 0x7fcbe00bf060 2024-04-23T18:30:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.437+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c2902b0 con 0x7fcbe00bf060 2024-04-23T18:30:30.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.437+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93936507480464] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x556f4c27d2c0 2024-04-23T18:30:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.438+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93936507482720] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x7fcbe00bf060 2024-04-23T18:30:30.450 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.438+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x7fcbe00bf060 2024-04-23T18:30:30.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.438+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93936507485568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c290270 con 0x7fcbe00bf060 2024-04-23T18:30:30.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.438+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c290b50 con 0x7fcbe00bf060 2024-04-23T18:30:30.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.439+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93936507485568] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x7fcbe00bf060 2024-04-23T18:30:30.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.439+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x7fcbe00bf060 2024-04-23T18:30:30.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.439+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93936507474192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c290270 con 0x7fcbe00bf060 2024-04-23T18:30:30.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.439+0000 7fcbf332e800 20 add_watcher() i=0 2024-04-23T18:30:30.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.439+0000 7fcbf332e800 20 add_watcher() i=1 2024-04-23T18:30:30.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.439+0000 7fcbf332e800 20 add_watcher() i=2 2024-04-23T18:30:30.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.439+0000 7fcbf332e800 20 add_watcher() i=3 2024-04-23T18:30:30.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.439+0000 7fcbf332e800 20 add_watcher() i=4 2024-04-23T18:30:30.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.439+0000 7fcbf332e800 20 add_watcher() i=5 2024-04-23T18:30:30.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.439+0000 7fcbf332e800 20 add_watcher() i=6 2024-04-23T18:30:30.451 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.440+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93936507474192] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x7fcbe00bf060 2024-04-23T18:30:30.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.440+0000 7fcbf332e800 20 add_watcher() i=7 2024-04-23T18:30:30.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.440+0000 7fcbf332e800 2 all 8 watchers are set, enabling cache 2024-04-23T18:30:30.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.440+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c293b80 con 0x556f4c27d2c0 2024-04-23T18:30:30.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.441+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcbe8040080 con 0x556f4c27d2c0 2024-04-23T18:30:30.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.441+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93936507487904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c291040 con 0x556f4c27d2c0 2024-04-23T18:30:30.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.442+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93936507487904] v34'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x556f4c27d2c0 2024-04-23T18:30:30.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.442+0000 7fcaa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.442+0000 7fcbf332e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:30:30.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.442+0000 7fcbf332e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:30:30.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.442+0000 7fcbf332e800 5 note: GC not initialized 2024-04-23T18:30:30.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.442+0000 7fcaa4fe1640 20 reqs_thread_entry: start 2024-04-23T18:30:30.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.442+0000 7fcbf332e800 20 init_complete bucket index max shards: 11 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.442+0000 7fcbf332e800 20 Filter name: none 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.442+0000 7fca1e7fc640 20 reqs_thread_entry: start 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.442+0000 7fcbf332e800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.442+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c2c6e60 con 0x556f4c27d2c0 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.443+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcbe8040080 con 0x556f4c27d2c0 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.443+0000 7fcbf332e800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.443+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556f4c2c83b0 con 0x7fcbe00bf060 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.443+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fcbe8040080 con 0x7fcbe00bf060 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.444+0000 7fcaa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.444+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93936507487904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c2932d0 con 0x556f4c27d2c0 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.445+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93936507487904] v34'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x556f4c27d2c0 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.445+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93936507463872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c290670 con 0x556f4c281a40 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.446+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93936507463872] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe00d4040 con 0x556f4c281a40 2024-04-23T18:30:30.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.446+0000 7fcbf332e800 20 remove_watcher() i=0 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.446+0000 7fcbf332e800 2 removed watcher, disabling cache 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.446+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93936507467584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28a8c0 con 0x556f4c27d2c0 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.447+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93936507467584] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x556f4c27d2c0 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.447+0000 7fcbf332e800 20 remove_watcher() i=1 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.447+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93936507469152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28a8c0 con 0x556f4c286610 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.448+0000 7fcbee866640 1 -- 172.21.15.119:0/3302324452 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93936507469152] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe4009050 con 0x556f4c286610 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.448+0000 7fcbf332e800 20 remove_watcher() i=2 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.448+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93936507476240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28bd60 con 0x556f4c281a40 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.449+0000 7fcbef067640 1 -- 172.21.15.119:0/3302324452 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93936507476240] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe00d4040 con 0x556f4c281a40 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.449+0000 7fcbf332e800 20 remove_watcher() i=3 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.449+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93936507480464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28d910 con 0x556f4c27d2c0 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.450+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93936507480464] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x556f4c27d2c0 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.450+0000 7fcbf332e800 20 remove_watcher() i=4 2024-04-23T18:30:30.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.450+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93936507482720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28bd60 con 0x7fcbe00bf060 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.451+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93936507482720] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x7fcbe00bf060 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.451+0000 7fcbf332e800 20 remove_watcher() i=5 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.451+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93936507485568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28e990 con 0x7fcbe00bf060 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.452+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93936507485568] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x7fcbe00bf060 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.452+0000 7fcbf332e800 20 remove_watcher() i=6 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.452+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93936507474192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556f4c28d910 con 0x7fcbe00bf060 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93936507474192] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbe8040080 con 0x7fcbe00bf060 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 20 remove_watcher() i=7 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fcbe00bf060 msgr2=0x7fcbe00b5880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fcbe00bf060 0x7fcbe00b5880 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556f4c27d2c0 msgr2=0x556f4c27f780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556f4c27d2c0 0x556f4c27f780 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556f4c281a40 msgr2=0x556f4c283e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556f4c281a40 0x556f4c283e30 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556f4c286610 msgr2=0x556f4c288ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556f4c286610 0x556f4c288ad0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcab8036e60 msgr2=0x7fcab8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcab8036e60 0x7fcab8039320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4001b60 tx=0x7fcbe4010000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 msgr2=0x556f4c271bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 0x556f4c271bd0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcbe008b590 tx=0x7fcbe005ee40 comp rx=0 tx=0).stop 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbef868640 1 -- 172.21.15.119:0/3302324452 reap_dead start 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 shutdown_connections 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3302324452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c26a800 0x556f4c271bd0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 >> 172.21.15.119:0/3302324452 conn(0x556f4c266b60 msgr2=0x556f4c2641c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 shutdown_connections 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 -- 172.21.15.119:0/3302324452 wait complete. 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 -- 172.21.15.119:0/1348975769 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcac8036eb0 msgr2=0x7fcac8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 --2- 172.21.15.119:0/1348975769 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcac8036eb0 0x7fcac8039370 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400bf50 tx=0x7fcbe400f000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 -- 172.21.15.119:0/1348975769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c25d6e0 msgr2=0x556f4c25db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 --2- 172.21.15.119:0/1348975769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c25d6e0 0x556f4c25db00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fcbe008cb20 tx=0x7fcbe005bc50 comp rx=0 tx=0).stop 2024-04-23T18:30:30.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 -- 172.21.15.119:0/1348975769 shutdown_connections 2024-04-23T18:30:30.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.454+0000 7fcbf332e800 1 --2- 172.21.15.119:0/1348975769 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcac8036eb0 0x7fcac8039370 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 --2- 172.21.15.119:0/1348975769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c25d6e0 0x556f4c25db00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 -- 172.21.15.119:0/1348975769 >> 172.21.15.119:0/1348975769 conn(0x556f4c251780 msgr2=0x556f4c251b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 -- 172.21.15.119:0/1348975769 shutdown_connections 2024-04-23T18:30:30.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 -- 172.21.15.119:0/1348975769 wait complete. 2024-04-23T18:30:30.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556f4c24c5e0 msgr2=0x556f4c24eaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556f4c24c5e0 0x556f4c24eaa0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556f4c143200 msgr2=0x556f4c245e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556f4c143200 0x556f4c245e50 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556f4c2486e0 msgr2=0x556f4c24aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556f4c2486e0 0x556f4c24aad0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcad4036e60 msgr2=0x7fcad4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcad4036e60 0x7fcad4039320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4000f60 tx=0x7fcbe40012b0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 msgr2=0x556f4c23ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 --2- 172.21.15.119:0/3374844578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556f4c1428a0 0x556f4c23ede0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcbe001ce60 tx=0x7fcbe0002fb0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbef868640 1 -- 172.21.15.119:0/3374844578 reap_dead start 2024-04-23T18:30:30.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 shutdown_connections 2024-04-23T18:30:30.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 >> 172.21.15.119:0/3374844578 conn(0x556f4c13e440 msgr2=0x556f4c231700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 shutdown_connections 2024-04-23T18:30:30.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.455+0000 7fcbf332e800 1 -- 172.21.15.119:0/3374844578 wait complete. 2024-04-23T18:30:30.459 INFO:teuthology.orchestra.run.smithi119.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-23T18:30:30.459 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:30:30.460 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-23T18:30:30.460 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-23T18:30:30.460 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-04-23T18:30:30.504 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:30:30.504 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:30:30.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.512+0000 7f25dc61f800 1 Processor -- start 2024-04-23T18:30:30.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.512+0000 7f25dc61f800 1 -- start start 2024-04-23T18:30:30.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.512+0000 7f25dc61f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559e4cbeb070 0x559e4cc7ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.512+0000 7f25dc61f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e4cb28560 con 0x559e4cc7b0c0 2024-04-23T18:30:30.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.512+0000 7f25dc61f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x559e4cb19e20 con 0x559e4cbeb070 2024-04-23T18:30:30.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.512+0000 7f25da11e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559e4cbeb070 0x559e4cc7ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.505 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.512+0000 7f25d991d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x559e4cc7b0c0 0x559e4cc7d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:39348/0 (socket says 172.21.15.119:39348) 2024-04-23T18:30:30.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.512+0000 7f25d991d640 1 -- 172.21.15.119:0/1541663486 learned_addr learned my addr 172.21.15.119:0/1541663486 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:30:30.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.513+0000 7f25da11e640 1 -- 172.21.15.119:0/1541663486 >> v1:172.21.15.62:6789/0 conn(0x559e4cc7b0c0 legacy=0x559e4cc7d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.506 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.513+0000 7f25da11e640 1 -- 172.21.15.119:0/1541663486 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4cb27e60 con 0x559e4cbeb070 2024-04-23T18:30:30.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.515+0000 7f25da11e640 1 --2- 172.21.15.119:0/1541663486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cc7ab20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00a470 tx=0x7f25cc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed64d137364999a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.515+0000 7f25d911c640 1 -- 172.21.15.119:0/1541663486 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc057070 con 0x559e4cbeb070 2024-04-23T18:30:30.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.515+0000 7f25d911c640 1 -- 172.21.15.119:0/1541663486 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc052570 con 0x559e4cbeb070 2024-04-23T18:30:30.507 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.515+0000 7f25d911c640 1 -- 172.21.15.119:0/1541663486 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc052870 con 0x559e4cbeb070 2024-04-23T18:30:30.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.515+0000 7f25dc61f800 1 -- 172.21.15.119:0/1541663486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 msgr2=0x559e4cc7ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.515+0000 7f25dc61f800 1 --2- 172.21.15.119:0/1541663486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cc7ab20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00a470 tx=0x7f25cc01ce90 comp rx=0 tx=0).stop 2024-04-23T18:30:30.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.515+0000 7f25dc61f800 1 -- 172.21.15.119:0/1541663486 shutdown_connections 2024-04-23T18:30:30.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.515+0000 7f25dc61f800 1 --2- 172.21.15.119:0/1541663486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cc7ab20 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.515+0000 7f25dc61f800 1 -- 172.21.15.119:0/1541663486 >> 172.21.15.119:0/1541663486 conn(0x559e4cc72440 msgr2=0x559e4cc74860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.515+0000 7f25dc61f800 1 -- 172.21.15.119:0/1541663486 shutdown_connections 2024-04-23T18:30:30.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.515+0000 7f25dc61f800 1 -- 172.21.15.119:0/1541663486 wait complete. 2024-04-23T18:30:30.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.527+0000 7f25dc61f800 1 Processor -- start 2024-04-23T18:30:30.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.527+0000 7f25dc61f800 1 -- start start 2024-04-23T18:30:30.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.527+0000 7f25dc61f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cd69230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.527+0000 7f25dc61f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559e4cbc35d0 con 0x559e4cbeb070 2024-04-23T18:30:30.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.527+0000 7f25da11e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cd69230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.528+0000 7f25da11e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cd69230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36060/0 (socket says 172.21.15.119:36060) 2024-04-23T18:30:30.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.528+0000 7f25da11e640 1 -- 172.21.15.119:0/3792694154 learned_addr learned my addr 172.21.15.119:0/3792694154 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.528+0000 7f25da11e640 1 -- 172.21.15.119:0/3792694154 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4cb39860 con 0x559e4cbeb070 2024-04-23T18:30:30.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.528+0000 7f25da11e640 1 --2- 172.21.15.119:0/3792694154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cd69230 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f25cc055040 tx=0x7f25cc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed4a1701815586d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.528+0000 7f24c8608640 1 -- 172.21.15.119:0/3792694154 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc057070 con 0x559e4cbeb070 2024-04-23T18:30:30.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.528+0000 7f24c8608640 1 -- 172.21.15.119:0/3792694154 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc063070 con 0x559e4cbeb070 2024-04-23T18:30:30.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.528+0000 7f24c8608640 1 -- 172.21.15.119:0/3792694154 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc052720 con 0x559e4cbeb070 2024-04-23T18:30:30.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.529+0000 7f25dc61f800 1 -- 172.21.15.119:0/3792694154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 msgr2=0x559e4cd69230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.529+0000 7f25dc61f800 1 --2- 172.21.15.119:0/3792694154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cd69230 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f25cc055040 tx=0x7f25cc04c000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.529+0000 7f25dc61f800 1 -- 172.21.15.119:0/3792694154 shutdown_connections 2024-04-23T18:30:30.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.529+0000 7f25dc61f800 1 --2- 172.21.15.119:0/3792694154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cd69230 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.529+0000 7f25dc61f800 1 -- 172.21.15.119:0/3792694154 >> 172.21.15.119:0/3792694154 conn(0x559e4cc72440 msgr2=0x559e4cd64b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.529+0000 7f25dc61f800 1 -- 172.21.15.119:0/3792694154 shutdown_connections 2024-04-23T18:30:30.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.529+0000 7f25dc61f800 1 -- 172.21.15.119:0/3792694154 wait complete. 2024-04-23T18:30:30.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.529+0000 7f25dc61f800 1 Processor -- start 2024-04-23T18:30:30.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.529+0000 7f25dc61f800 1 -- start start 2024-04-23T18:30:30.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.529+0000 7f25dc61f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cd70a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.529+0000 7f25dc61f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559e4cc7efd0 con 0x559e4cbeb070 2024-04-23T18:30:30.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.530+0000 7f25da11e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cd70a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.526 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.530+0000 7f25da11e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cd70a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36072/0 (socket says 172.21.15.119:36072) 2024-04-23T18:30:30.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.530+0000 7f25da11e640 1 -- 172.21.15.119:0/4195266082 learned_addr learned my addr 172.21.15.119:0/4195266082 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.530+0000 7f25da11e640 1 -- 172.21.15.119:0/4195266082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4cb37eb0 con 0x559e4cbeb070 2024-04-23T18:30:30.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.530+0000 7f25da11e640 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cd70a00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f25cc055040 tx=0x7f25cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.530+0000 7f24c6e05640 1 -- 172.21.15.119:0/4195266082 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc05e480 con 0x559e4cbeb070 2024-04-23T18:30:30.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.530+0000 7f24c6e05640 1 -- 172.21.15.119:0/4195266082 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc06c070 con 0x559e4cbeb070 2024-04-23T18:30:30.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.530+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e4cd70f40 con 0x559e4cbeb070 2024-04-23T18:30:30.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.530+0000 7f24c6e05640 1 -- 172.21.15.119:0/4195266082 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc05e750 con 0x559e4cbeb070 2024-04-23T18:30:30.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.530+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e4cd714c0 con 0x559e4cbeb070 2024-04-23T18:30:30.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.531+0000 7f24c6e05640 1 -- 172.21.15.119:0/4195266082 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f25cc05e8f0 con 0x559e4cbeb070 2024-04-23T18:30:30.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.531+0000 7f24c6e05640 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24c0036e60 0x7f24c0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.531+0000 7f24c6e05640 1 -- 172.21.15.119:0/4195266082 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f25cc08f1b0 con 0x559e4cbeb070 2024-04-23T18:30:30.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.532+0000 7f25d991d640 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24c0036e60 0x7f24c0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.527 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.532+0000 7f25dc61f800 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e4cc7b0c0 0x559e4cd77a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.532+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cd78040 con 0x559e4cc7b0c0 2024-04-23T18:30:30.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.532+0000 7f25da91f640 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e4cc7b0c0 0x559e4cd77a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.532+0000 7f25d991d640 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24c0036e60 0x7f24c0039320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f25d0000f60 tx=0x7f25d00012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.532+0000 7f25da91f640 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e4cc7b0c0 0x559e4cd77a70 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.532+0000 7f25da91f640 1 -- 172.21.15.119:0/4195266082 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cc7b0c0 2024-04-23T18:30:30.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.532+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cd75040 con 0x559e4cc7b0c0 2024-04-23T18:30:30.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.533+0000 7f25da91f640 1 -- 172.21.15.119:0/4195266082 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cc7b0c0 2024-04-23T18:30:30.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.533+0000 7f25dc61f800 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e4cd7a370 0x559e4cd7c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.533+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cd7ce00 con 0x559e4cd7a370 2024-04-23T18:30:30.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.533+0000 7f25da11e640 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e4cd7a370 0x559e4cd7c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.533+0000 7f25da11e640 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e4cd7a370 0x559e4cd7c760 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.533+0000 7f25da11e640 1 -- 172.21.15.119:0/4195266082 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f25cc071990 con 0x559e4cd7a370 2024-04-23T18:30:30.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.533+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cd79320 con 0x559e4cc7b0c0 2024-04-23T18:30:30.544 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.533+0000 7f25da91f640 1 -- 172.21.15.119:0/4195266082 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cc7b0c0 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.533+0000 7f25dc61f800 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559e4cd7e2b0 0x559e4cd80700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.533+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cd80e60 con 0x559e4cd7e2b0 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.534+0000 7f25d991d640 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559e4cd7e2b0 0x559e4cd80700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.534+0000 7f25d991d640 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559e4cd7e2b0 0x559e4cd80700 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.534+0000 7f25d991d640 1 -- 172.21.15.119:0/4195266082 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cd7e2b0 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.535+0000 7f25dc61f800 1 Processor -- start 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.535+0000 7f25dc61f800 1 -- start start 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.535+0000 7f25dc61f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cc78690 0x559e4cc76b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.535+0000 7f25dc61f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559e4cb69df0 con 0x559e4cc78690 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.535+0000 7f25da11e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cc78690 0x559e4cc76b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.535+0000 7f25da11e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cc78690 0x559e4cc76b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36086/0 (socket says 172.21.15.119:36086) 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.535+0000 7f25da11e640 1 -- 172.21.15.119:0/631934511 learned_addr learned my addr 172.21.15.119:0/631934511 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.535+0000 7f25da11e640 1 -- 172.21.15.119:0/631934511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4cc77040 con 0x559e4cc78690 2024-04-23T18:30:30.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.536+0000 7f25da11e640 1 --2- 172.21.15.119:0/631934511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cc78690 0x559e4cc76b00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f25cc052460 tx=0x7f25cc071f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.536+0000 7f24bffff640 1 -- 172.21.15.119:0/631934511 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc0667c0 con 0x559e4cc78690 2024-04-23T18:30:30.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.536+0000 7f24bffff640 1 -- 172.21.15.119:0/631934511 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc058040 con 0x559e4cc78690 2024-04-23T18:30:30.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.536+0000 7f25dc61f800 1 -- 172.21.15.119:0/631934511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e4cc77270 con 0x559e4cc78690 2024-04-23T18:30:30.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.536+0000 7f24bffff640 1 -- 172.21.15.119:0/631934511 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc066a90 con 0x559e4cc78690 2024-04-23T18:30:30.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.536+0000 7f25dc61f800 1 -- 172.21.15.119:0/631934511 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e4cc77770 con 0x559e4cc78690 2024-04-23T18:30:30.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.536+0000 7f24bffff640 1 -- 172.21.15.119:0/631934511 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f25cc086070 con 0x559e4cc78690 2024-04-23T18:30:30.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.537+0000 7f24bffff640 1 --2- 172.21.15.119:0/631934511 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24b4036e10 0x7f24b40392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.537+0000 7f24bffff640 1 -- 172.21.15.119:0/631934511 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f25cc090de0 con 0x559e4cc78690 2024-04-23T18:30:30.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.537+0000 7f25d991d640 1 --2- 172.21.15.119:0/631934511 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24b4036e10 0x7f24b40392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.537+0000 7f25dc61f800 1 Processor -- start 2024-04-23T18:30:30.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.537+0000 7f25dc61f800 1 -- start start 2024-04-23T18:30:30.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.537+0000 7f25d991d640 1 --2- 172.21.15.119:0/631934511 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24b4036e10 0x7f24b40392d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f25d000bf50 tx=0x7f25d000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.537+0000 7f25dc61f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cda3060 0x559e4cda5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.537+0000 7f25dc61f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559e4cd698f0 con 0x559e4cda3060 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.537+0000 7f25da11e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cda3060 0x559e4cda5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.537+0000 7f25da11e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cda3060 0x559e4cda5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36096/0 (socket says 172.21.15.119:36096) 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.537+0000 7f25da11e640 1 -- 172.21.15.119:0/454925639 learned_addr learned my addr 172.21.15.119:0/454925639 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.538+0000 7f25da11e640 1 -- 172.21.15.119:0/454925639 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4cda5990 con 0x559e4cda3060 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.538+0000 7f25da11e640 1 --2- 172.21.15.119:0/454925639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cda3060 0x559e4cda5450 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f25cc060040 tx=0x7f25cc08d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792f1e7e243ee7c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.538+0000 7f24bdffb640 1 -- 172.21.15.119:0/454925639 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc0a8070 con 0x559e4cda3060 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.538+0000 7f24bdffb640 1 -- 172.21.15.119:0/454925639 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc07bdd0 con 0x559e4cda3060 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.538+0000 7f24bdffb640 1 -- 172.21.15.119:0/454925639 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc09f040 con 0x559e4cda3060 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.538+0000 7f25dc61f800 1 -- 172.21.15.119:0/454925639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cda3060 msgr2=0x559e4cda5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.538+0000 7f25dc61f800 1 --2- 172.21.15.119:0/454925639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cda3060 0x559e4cda5450 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f25cc060040 tx=0x7f25cc08d950 comp rx=0 tx=0).stop 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.538+0000 7f25dc61f800 1 -- 172.21.15.119:0/454925639 shutdown_connections 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.538+0000 7f25dc61f800 1 --2- 172.21.15.119:0/454925639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cda3060 0x559e4cda5450 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.538+0000 7f25dc61f800 1 -- 172.21.15.119:0/454925639 >> 172.21.15.119:0/454925639 conn(0x559e4cd90e80 msgr2=0x559e4cd8ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.538+0000 7f25dc61f800 1 -- 172.21.15.119:0/454925639 shutdown_connections 2024-04-23T18:30:30.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.538+0000 7f25dc61f800 1 -- 172.21.15.119:0/454925639 wait complete. 2024-04-23T18:30:30.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.539+0000 7f25dc61f800 1 Processor -- start 2024-04-23T18:30:30.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.539+0000 7f25dc61f800 1 -- start start 2024-04-23T18:30:30.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.539+0000 7f25dc61f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cda3060 0x559e4cda9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.539+0000 7f25dc61f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559e4cda5b70 con 0x559e4cda3060 2024-04-23T18:30:30.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.539+0000 7f25da11e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cda3060 0x559e4cda9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.539+0000 7f25da11e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cda3060 0x559e4cda9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36102/0 (socket says 172.21.15.119:36102) 2024-04-23T18:30:30.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.539+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 learned_addr learned my addr 172.21.15.119:0/2739697472 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.539+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e4cdaa320 con 0x559e4cda3060 2024-04-23T18:30:30.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.539+0000 7f25da11e640 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cda3060 0x559e4cda9de0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f25cc079fe0 tx=0x7f25cc079f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.540+0000 7f24abfff640 1 -- 172.21.15.119:0/2739697472 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc0b1020 con 0x559e4cda3060 2024-04-23T18:30:30.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.540+0000 7f24abfff640 1 -- 172.21.15.119:0/2739697472 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc0a9040 con 0x559e4cda3060 2024-04-23T18:30:30.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.540+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e4cdaa320 con 0x559e4cda3060 2024-04-23T18:30:30.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.540+0000 7f24abfff640 1 -- 172.21.15.119:0/2739697472 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc0a8070 con 0x559e4cda3060 2024-04-23T18:30:30.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.540+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e4cdaa320 con 0x559e4cda3060 2024-04-23T18:30:30.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.540+0000 7f24abfff640 1 -- 172.21.15.119:0/2739697472 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f25cc0b4020 con 0x559e4cda3060 2024-04-23T18:30:30.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f24abfff640 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24a4036dc0 0x7f24a4039280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f24abfff640 1 -- 172.21.15.119:0/2739697472 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f25cc0b7d10 con 0x559e4cda3060 2024-04-23T18:30:30.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f25d991d640 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24a4036dc0 0x7f24a4039280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f25dc61f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f25dc61f800 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e4cdb54e0 0x559e4cdb79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb80f0 con 0x559e4cdb54e0 2024-04-23T18:30:30.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f25da91f640 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e4cdb54e0 0x559e4cdb79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f25d991d640 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24a4036dc0 0x7f24a4039280 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f25d0001b60 tx=0x7f25d0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f25da91f640 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e4cdb54e0 0x559e4cdb79a0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cdb54e0 2024-04-23T18:30:30.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f25dc61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f25dc61f800 20 realm 2024-04-23T18:30:30.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f25dc61f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.541+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb8500 con 0x559e4cdb54e0 2024-04-23T18:30:30.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cdb54e0 2024-04-23T18:30:30.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25dc61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25dc61f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:30:30.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25dc61f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb8dd0 con 0x559e4cdb54e0 2024-04-23T18:30:30.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cdb54e0 2024-04-23T18:30:30.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25dc61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25dc61f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb54e0 2024-04-23T18:30:30.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cdb54e0 2024-04-23T18:30:30.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25dc61f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25dc61f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25dc61f800 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e4cdb9c60 0x559e4cdbc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdbc7b0 con 0x559e4cdb9c60 2024-04-23T18:30:30.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.542+0000 7f25da11e640 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e4cdb9c60 0x559e4cdbc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.543+0000 7f25da11e640 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e4cdb9c60 0x559e4cdbc050 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.543+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f25cc0ab070 con 0x559e4cdb9c60 2024-04-23T18:30:30.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.543+0000 7f25dc61f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:30:30.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.543+0000 7f25dc61f800 20 searching for the correct realm 2024-04-23T18:30:30.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.543+0000 7f25dc61f800 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559e4cdbe860 0x559e4cdc0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.543+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc13f0 con 0x559e4cdbe860 2024-04-23T18:30:30.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.543+0000 7f25d991d640 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559e4cdbe860 0x559e4cdc0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.543+0000 7f25d991d640 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559e4cdbe860 0x559e4cdc0d20 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.544+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.544+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc13f0 con 0x559e4cdb9c60 2024-04-23T18:30:30.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.544+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25cc0ab070 con 0x559e4cdb9c60 2024-04-23T18:30:30.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.544+0000 7f25da11e640 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f25cc0b6020 0x7f25cc056170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.544+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc13f0 con 0x7f25cc0b6020 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.544+0000 7f25da91f640 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f25cc0b6020 0x7f25cc056170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.544+0000 7f25da91f640 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f25cc0b6020 0x7f25cc056170 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.545+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d400a4a0 con 0x7f25cc0b6020 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.545+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb54e0 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.545+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cdb54e0 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.545+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb54e0 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.545+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cdb54e0 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.545+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x7f25cc0b6020 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.545+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d400a4a0 con 0x7f25cc0b6020 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.545+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x7f25cc0b6020 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.546+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f25d400a4a0 con 0x7f25cc0b6020 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.546+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb9c60 2024-04-23T18:30:30.553 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.546+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25cc0ab070 con 0x559e4cdb9c60 2024-04-23T18:30:30.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.546+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdbe860 2024-04-23T18:30:30.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.546+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.546+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb54e0 2024-04-23T18:30:30.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.546+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cdb54e0 2024-04-23T18:30:30.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.546+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x7f25cc0b6020 2024-04-23T18:30:30.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.547+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d400a4a0 con 0x7f25cc0b6020 2024-04-23T18:30:30.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.547+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb54e0 2024-04-23T18:30:30.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.547+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cdb54e0 2024-04-23T18:30:30.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.547+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb9c60 2024-04-23T18:30:30.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.548+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f25cc0ab070 con 0x559e4cdb9c60 2024-04-23T18:30:30.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.548+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdbe860 2024-04-23T18:30:30.554 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.548+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.548+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdbe860 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.548+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.548+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x7f25cc0b6020 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.548+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d400a4a0 con 0x7f25cc0b6020 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.548+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdbe860 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.549+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.549+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdbe860 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.549+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.549+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb54e0 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.549+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cdb54e0 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.549+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb54e0 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.549+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cdb54e0 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.549+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x7f25cc0b6020 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.550+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d400a4a0 con 0x7f25cc0b6020 2024-04-23T18:30:30.555 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.550+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdbe860 2024-04-23T18:30:30.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.550+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.550+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb9c60 2024-04-23T18:30:30.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.550+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f25cc0ab070 con 0x559e4cdb9c60 2024-04-23T18:30:30.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.550+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb54e0 2024-04-23T18:30:30.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.551+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d400a4a0 con 0x559e4cdb54e0 2024-04-23T18:30:30.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.551+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb9c60 2024-04-23T18:30:30.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.551+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25cc0ab070 con 0x559e4cdb9c60 2024-04-23T18:30:30.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.551+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdbe860 2024-04-23T18:30:30.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.551+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.551+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x7f25cc0b6020 2024-04-23T18:30:30.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.552+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d400a4a0 con 0x7f25cc0b6020 2024-04-23T18:30:30.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.552+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb9c60 2024-04-23T18:30:30.556 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.552+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25cc0cd040 con 0x559e4cdb9c60 2024-04-23T18:30:30.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.552+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdbe860 2024-04-23T18:30:30.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.552+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.552+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x7f25cc0b6020 2024-04-23T18:30:30.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.552+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d400a4a0 con 0x7f25cc0b6020 2024-04-23T18:30:30.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.552+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb54e0 2024-04-23T18:30:30.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f25d4040080 con 0x559e4cdb54e0 2024-04-23T18:30:30.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdb9170 con 0x559e4cdb9c60 2024-04-23T18:30:30.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25cc0cd040 con 0x559e4cdb9c60 2024-04-23T18:30:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:30:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:30:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:30:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:30:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:30:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:30:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdbd160 con 0x559e4cdb54e0 2024-04-23T18:30:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x559e4cdb54e0 2024-04-23T18:30:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdbd550 con 0x559e4cdb54e0 2024-04-23T18:30:30.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25d4040080 con 0x559e4cdb54e0 2024-04-23T18:30:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.553+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdbd550 con 0x7f25cc0b6020 2024-04-23T18:30:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f25d4040080 con 0x7f25cc0b6020 2024-04-23T18:30:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:30:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 20 zone default found 2024-04-23T18:30:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 4 Realm: () 2024-04-23T18:30:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:30:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:30:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:30:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 20 zonegroup default 2024-04-23T18:30:30.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdbd970 con 0x559e4cdb9c60 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f25cc0cd040 con 0x559e4cdb9c60 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc3250 con 0x559e4cdbe860 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc35f0 con 0x559e4cdbe860 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 20 started sync module instance, tier type = 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.554+0000 7f25dc61f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:30:30.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.555+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc26f0 con 0x559e4cdb9c60 2024-04-23T18:30:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.556+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25cc0cd040 con 0x559e4cdb9c60 2024-04-23T18:30:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.556+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94138382691040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc2350 con 0x559e4cdb9c60 2024-04-23T18:30:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.556+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc44b0 con 0x559e4cdb54e0 2024-04-23T18:30:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.557+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94138382691040] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25cc0cd040 con 0x559e4cdb9c60 2024-04-23T18:30:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.557+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x559e4cdb54e0 2024-04-23T18:30:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.557+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94138382696448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc4420 con 0x559e4cdb54e0 2024-04-23T18:30:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.557+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc5370 con 0x559e4cdbe860 2024-04-23T18:30:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.558+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94138382696448] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x559e4cdb54e0 2024-04-23T18:30:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.558+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.558+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94138382700224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc5760 con 0x559e4cdbe860 2024-04-23T18:30:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.558+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc61a0 con 0x559e4cdb9c60 2024-04-23T18:30:30.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.559+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25cc0cd040 con 0x559e4cdb9c60 2024-04-23T18:30:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.559+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94138382703728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc6a40 con 0x559e4cdb9c60 2024-04-23T18:30:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.559+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94138382700224] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.559+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc48a0 con 0x559e4cdb54e0 2024-04-23T18:30:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.560+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94138382703728] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25cc0cd040 con 0x559e4cdb9c60 2024-04-23T18:30:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.561+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x559e4cdb54e0 2024-04-23T18:30:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.561+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94138382706064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc69b0 con 0x559e4cdb54e0 2024-04-23T18:30:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.561+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc79d0 con 0x7f25cc0b6020 2024-04-23T18:30:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.562+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x7f25cc0b6020 2024-04-23T18:30:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.562+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94138382709984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc7900 con 0x7f25cc0b6020 2024-04-23T18:30:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.562+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc88f0 con 0x7f25cc0b6020 2024-04-23T18:30:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.562+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94138382706064] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x559e4cdb54e0 2024-04-23T18:30:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.563+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94138382709984] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x7f25cc0b6020 2024-04-23T18:30:30.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.563+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x7f25cc0b6020 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.563+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94138382712256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc7030 con 0x7f25cc0b6020 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.563+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc8d60 con 0x7f25cc0b6020 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.564+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94138382712256] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x7f25cc0b6020 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.564+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x7f25cc0b6020 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.564+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94138382713824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc8d60 con 0x7f25cc0b6020 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.564+0000 7f25dc61f800 20 add_watcher() i=0 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.564+0000 7f25dc61f800 20 add_watcher() i=1 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.564+0000 7f25dc61f800 20 add_watcher() i=2 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.564+0000 7f25dc61f800 20 add_watcher() i=3 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.564+0000 7f25dc61f800 20 add_watcher() i=4 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.564+0000 7f25dc61f800 20 add_watcher() i=5 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.564+0000 7f25dc61f800 20 add_watcher() i=6 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.565+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94138382713824] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x7f25cc0b6020 2024-04-23T18:30:30.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.565+0000 7f25dc61f800 20 add_watcher() i=7 2024-04-23T18:30:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.565+0000 7f25dc61f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:30:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.565+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdcc1c0 con 0x559e4cdb54e0 2024-04-23T18:30:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.566+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f25d4040080 con 0x559e4cdb54e0 2024-04-23T18:30:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.566+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94138382715520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc96e0 con 0x559e4cdb54e0 2024-04-23T18:30:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.567+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94138382715520] v34'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x559e4cdb54e0 2024-04-23T18:30:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.567+0000 7f2490fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.567+0000 7f25dc61f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:30:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.567+0000 7f25dc61f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:30:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.567+0000 7f25dc61f800 5 note: GC not initialized 2024-04-23T18:30:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.567+0000 7f240b7fe640 20 reqs_thread_entry: start 2024-04-23T18:30:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.567+0000 7f25dc61f800 20 init_complete bucket index max shards: 11 2024-04-23T18:30:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.567+0000 7f25dc61f800 20 Filter name: none 2024-04-23T18:30:30.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.567+0000 7f24097fa640 20 reqs_thread_entry: start 2024-04-23T18:30:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.567+0000 7f25dc61f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.567+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdff4f0 con 0x559e4cdb54e0 2024-04-23T18:30:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.568+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f25d4040080 con 0x559e4cdb54e0 2024-04-23T18:30:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.568+0000 7f25dc61f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:30:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.568+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e4ce00a40 con 0x7f25cc0b6020 2024-04-23T18:30:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.568+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f25d4040080 con 0x7f25cc0b6020 2024-04-23T18:30:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.569+0000 7f2490fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.569+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94138382715520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdcb490 con 0x559e4cdb54e0 2024-04-23T18:30:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.570+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94138382715520] v34'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x559e4cdb54e0 2024-04-23T18:30:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.570+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94138382691040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc8a50 con 0x559e4cdb9c60 2024-04-23T18:30:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.571+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94138382691040] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25cc0cd040 con 0x559e4cdb9c60 2024-04-23T18:30:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.571+0000 7f25dc61f800 20 remove_watcher() i=0 2024-04-23T18:30:30.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.571+0000 7f25dc61f800 2 removed watcher, disabling cache 2024-04-23T18:30:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.571+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94138382696448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc2ae0 con 0x559e4cdb54e0 2024-04-23T18:30:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.573+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94138382696448] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x559e4cdb54e0 2024-04-23T18:30:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.573+0000 7f25dc61f800 20 remove_watcher() i=1 2024-04-23T18:30:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.573+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94138382700224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc2ae0 con 0x559e4cdbe860 2024-04-23T18:30:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.574+0000 7f25d991d640 1 -- 172.21.15.119:0/2739697472 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94138382700224] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d0009050 con 0x559e4cdbe860 2024-04-23T18:30:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.574+0000 7f25dc61f800 20 remove_watcher() i=2 2024-04-23T18:30:30.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.574+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94138382703728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc4000 con 0x559e4cdb9c60 2024-04-23T18:30:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.575+0000 7f25da11e640 1 -- 172.21.15.119:0/2739697472 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94138382703728] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25cc0cd040 con 0x559e4cdb9c60 2024-04-23T18:30:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.575+0000 7f25dc61f800 20 remove_watcher() i=3 2024-04-23T18:30:30.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.575+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94138382706064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc4000 con 0x559e4cdb54e0 2024-04-23T18:30:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.576+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94138382706064] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x559e4cdb54e0 2024-04-23T18:30:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.576+0000 7f25dc61f800 20 remove_watcher() i=4 2024-04-23T18:30:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.576+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94138382709984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc4000 con 0x7f25cc0b6020 2024-04-23T18:30:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.577+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94138382709984] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x7f25cc0b6020 2024-04-23T18:30:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.577+0000 7f25dc61f800 20 remove_watcher() i=5 2024-04-23T18:30:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.577+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94138382712256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc74e0 con 0x7f25cc0b6020 2024-04-23T18:30:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.578+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94138382712256] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x7f25cc0b6020 2024-04-23T18:30:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.578+0000 7f25dc61f800 20 remove_watcher() i=6 2024-04-23T18:30:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.578+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94138382713824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559e4cdc4000 con 0x7f25cc0b6020 2024-04-23T18:30:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94138382713824] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d4040080 con 0x7f25cc0b6020 2024-04-23T18:30:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 20 remove_watcher() i=7 2024-04-23T18:30:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f25cc0b6020 msgr2=0x7f25cc056170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f25cc0b6020 0x7f25cc056170 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e4cdb54e0 msgr2=0x559e4cdb79a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e4cdb54e0 0x559e4cdb79a0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e4cdb9c60 msgr2=0x559e4cdbc050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e4cdb9c60 0x559e4cdbc050 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559e4cdbe860 msgr2=0x559e4cdc0d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559e4cdbe860 0x559e4cdc0d20 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24a4036dc0 msgr2=0x7f24a4039280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24a4036dc0 0x7f24a4039280 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f25d0001b60 tx=0x7f25d0010000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cda3060 msgr2=0x559e4cda9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 --2- 172.21.15.119:0/2739697472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cda3060 0x559e4cda9de0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f25cc079fe0 tx=0x7f25cc079f70 comp rx=0 tx=0).stop 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 reap_dead start 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25da91f640 1 -- 172.21.15.119:0/2739697472 reap_dead start 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 shutdown_connections 2024-04-23T18:30:30.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 >> 172.21.15.119:0/2739697472 conn(0x559e4cd90e80 msgr2=0x559e4cd97fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.579+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 shutdown_connections 2024-04-23T18:30:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/2739697472 wait complete. 2024-04-23T18:30:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/631934511 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24b4036e10 msgr2=0x7f24b40392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 --2- 172.21.15.119:0/631934511 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24b4036e10 0x7f24b40392d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f25d000bf50 tx=0x7f25d000f000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/631934511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cc78690 msgr2=0x559e4cc76b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 --2- 172.21.15.119:0/631934511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cc78690 0x559e4cc76b00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f25cc052460 tx=0x7f25cc071f10 comp rx=0 tx=0).stop 2024-04-23T18:30:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/631934511 shutdown_connections 2024-04-23T18:30:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 --2- 172.21.15.119:0/631934511 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24b4036e10 0x7f24b40392d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 --2- 172.21.15.119:0/631934511 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cc78690 0x559e4cc76b00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/631934511 >> 172.21.15.119:0/631934511 conn(0x559e4cd83360 msgr2=0x559e4cd83760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/631934511 shutdown_connections 2024-04-23T18:30:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/631934511 wait complete. 2024-04-23T18:30:30.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559e4cd7e2b0 msgr2=0x559e4cd80700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559e4cd7e2b0 0x559e4cd80700 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e4cc7b0c0 msgr2=0x559e4cd77a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559e4cc7b0c0 0x559e4cd77a70 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e4cd7a370 msgr2=0x559e4cd7c760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559e4cd7a370 0x559e4cd7c760 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24c0036e60 msgr2=0x7f24c0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f24c0036e60 0x7f24c0039320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f25d0000f60 tx=0x7f25d00012b0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 msgr2=0x559e4cd70a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 --2- 172.21.15.119:0/4195266082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559e4cbeb070 0x559e4cd70a00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f25cc055040 tx=0x7f25cc002fb0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25da91f640 1 -- 172.21.15.119:0/4195266082 reap_dead start 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 shutdown_connections 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 >> 172.21.15.119:0/4195266082 conn(0x559e4cc72440 msgr2=0x559e4cd67c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 shutdown_connections 2024-04-23T18:30:30.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.580+0000 7f25dc61f800 1 -- 172.21.15.119:0/4195266082 wait complete. 2024-04-23T18:30:30.584 INFO:teuthology.orchestra.run.smithi119.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-23T18:30:30.584 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:30:30.585 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-23T18:30:30.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-23T18:30:30.585 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-04-23T18:30:30.629 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:30:30.629 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:30:30.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.638+0000 7f177911f800 1 Processor -- start 2024-04-23T18:30:30.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.638+0000 7f177911f800 1 -- start start 2024-04-23T18:30:30.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.638+0000 7f177911f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556812695290 0x556812697750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.638+0000 7f177911f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556812541560 con 0x556812604050 2024-04-23T18:30:30.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.638+0000 7f177911f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x556812532e20 con 0x556812695290 2024-04-23T18:30:30.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.638+0000 7f176ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556812695290 0x556812697750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.638+0000 7f1774dc3640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x556812604050 0x556812693b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:39358/0 (socket says 172.21.15.119:39358) 2024-04-23T18:30:30.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.638+0000 7f1774dc3640 1 -- 172.21.15.119:0/3887570022 learned_addr learned my addr 172.21.15.119:0/3887570022 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:30:30.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.639+0000 7f176ffff640 1 -- 172.21.15.119:0/3887570022 >> v1:172.21.15.62:6789/0 conn(0x556812604050 legacy=0x556812693b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.639+0000 7f176ffff640 1 -- 172.21.15.119:0/3887570022 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556812540e60 con 0x556812695290 2024-04-23T18:30:30.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.641+0000 7f176ffff640 1 --2- 172.21.15.119:0/3887570022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812695290 0x556812697750 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f176000a470 tx=0x7f176001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be47947ba1af3037 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.641+0000 7f176f7fe640 1 -- 172.21.15.119:0/3887570022 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1760057070 con 0x556812695290 2024-04-23T18:30:30.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.641+0000 7f176f7fe640 1 -- 172.21.15.119:0/3887570022 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1760052570 con 0x556812695290 2024-04-23T18:30:30.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.641+0000 7f176f7fe640 1 -- 172.21.15.119:0/3887570022 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1760052870 con 0x556812695290 2024-04-23T18:30:30.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.641+0000 7f177911f800 1 -- 172.21.15.119:0/3887570022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812695290 msgr2=0x556812697750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.641+0000 7f177911f800 1 --2- 172.21.15.119:0/3887570022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812695290 0x556812697750 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f176000a470 tx=0x7f176001ce90 comp rx=0 tx=0).stop 2024-04-23T18:30:30.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.641+0000 7f177911f800 1 -- 172.21.15.119:0/3887570022 shutdown_connections 2024-04-23T18:30:30.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.641+0000 7f177911f800 1 --2- 172.21.15.119:0/3887570022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812695290 0x556812697750 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.641+0000 7f177911f800 1 -- 172.21.15.119:0/3887570022 >> 172.21.15.119:0/3887570022 conn(0x55681268b440 msgr2=0x55681268d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.641+0000 7f177911f800 1 -- 172.21.15.119:0/3887570022 shutdown_connections 2024-04-23T18:30:30.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.641+0000 7f177911f800 1 -- 172.21.15.119:0/3887570022 wait complete. 2024-04-23T18:30:30.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.653+0000 7f177911f800 1 Processor -- start 2024-04-23T18:30:30.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.653+0000 7f177911f800 1 -- start start 2024-04-23T18:30:30.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.653+0000 7f177911f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812604050 0x5568127821f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.653+0000 7f177911f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5568125dc5d0 con 0x556812604050 2024-04-23T18:30:30.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.653+0000 7f1774dc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812604050 0x5568127821f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.653+0000 7f1774dc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812604050 0x5568127821f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36130/0 (socket says 172.21.15.119:36130) 2024-04-23T18:30:30.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.653+0000 7f1774dc3640 1 -- 172.21.15.119:0/4261079649 learned_addr learned my addr 172.21.15.119:0/4261079649 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.654+0000 7f1774dc3640 1 -- 172.21.15.119:0/4261079649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556812552860 con 0x556812604050 2024-04-23T18:30:30.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.654+0000 7f1774dc3640 1 --2- 172.21.15.119:0/4261079649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812604050 0x5568127821f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1768001d50 tx=0x7f176800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4867906aecd7d0cc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.654+0000 7f1662e05640 1 -- 172.21.15.119:0/4261079649 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1768013030 con 0x556812604050 2024-04-23T18:30:30.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.654+0000 7f1662e05640 1 -- 172.21.15.119:0/4261079649 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176800e470 con 0x556812604050 2024-04-23T18:30:30.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.654+0000 7f1662e05640 1 -- 172.21.15.119:0/4261079649 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176800e810 con 0x556812604050 2024-04-23T18:30:30.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f177911f800 1 -- 172.21.15.119:0/4261079649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812604050 msgr2=0x5568127821f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f177911f800 1 --2- 172.21.15.119:0/4261079649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812604050 0x5568127821f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1768001d50 tx=0x7f176800b6c0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f177911f800 1 -- 172.21.15.119:0/4261079649 shutdown_connections 2024-04-23T18:30:30.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f177911f800 1 --2- 172.21.15.119:0/4261079649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812604050 0x5568127821f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f177911f800 1 -- 172.21.15.119:0/4261079649 >> 172.21.15.119:0/4261079649 conn(0x55681268b440 msgr2=0x55681277db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f177911f800 1 -- 172.21.15.119:0/4261079649 shutdown_connections 2024-04-23T18:30:30.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f177911f800 1 -- 172.21.15.119:0/4261079649 wait complete. 2024-04-23T18:30:30.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f177911f800 1 Processor -- start 2024-04-23T18:30:30.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f177911f800 1 -- start start 2024-04-23T18:30:30.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f177911f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812604050 0x556812789b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f177911f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556812698100 con 0x556812604050 2024-04-23T18:30:30.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f1774dc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812604050 0x556812789b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f1774dc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812604050 0x556812789b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36134/0 (socket says 172.21.15.119:36134) 2024-04-23T18:30:30.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.655+0000 7f1774dc3640 1 -- 172.21.15.119:0/126535764 learned_addr learned my addr 172.21.15.119:0/126535764 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.656+0000 7f1774dc3640 1 -- 172.21.15.119:0/126535764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556812550eb0 con 0x556812604050 2024-04-23T18:30:30.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.656+0000 7f1774dc3640 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812604050 0x556812789b60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x556812782f80 tx=0x7f1768000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.656+0000 7f1661602640 1 -- 172.21.15.119:0/126535764 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1768027070 con 0x556812604050 2024-04-23T18:30:30.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.656+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55681278a0a0 con 0x556812604050 2024-04-23T18:30:30.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.656+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55681278a5c0 con 0x556812604050 2024-04-23T18:30:30.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.656+0000 7f1661602640 1 -- 172.21.15.119:0/126535764 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1768019900 con 0x556812604050 2024-04-23T18:30:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.656+0000 7f1661602640 1 -- 172.21.15.119:0/126535764 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1768019c20 con 0x556812604050 2024-04-23T18:30:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.657+0000 7f1661602640 1 -- 172.21.15.119:0/126535764 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f176802a070 con 0x556812604050 2024-04-23T18:30:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.657+0000 7f1661602640 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f165c036e60 0x7f165c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.657+0000 7f1661602640 1 -- 172.21.15.119:0/126535764 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f176801f070 con 0x556812604050 2024-04-23T18:30:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.657+0000 7f176ffff640 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f165c036e60 0x7f165c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.657+0000 7f177911f800 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556812695290 0x556812790bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.657+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127911a0 con 0x556812695290 2024-04-23T18:30:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.658+0000 7f17755c4640 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556812695290 0x556812790bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.658+0000 7f176ffff640 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f165c036e60 0x7f165c039320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1760054000 tx=0x7f176004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.658+0000 7f17755c4640 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556812695290 0x556812790bd0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.658+0000 7f17755c4640 1 -- 172.21.15.119:0/126535764 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f177000a4a0 con 0x556812695290 2024-04-23T18:30:30.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.658+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55681278e1a0 con 0x556812695290 2024-04-23T18:30:30.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.658+0000 7f17755c4640 1 -- 172.21.15.119:0/126535764 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f177000a4a0 con 0x556812695290 2024-04-23T18:30:30.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.658+0000 7f177911f800 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5568127934f0 0x5568127958e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.658+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556812795fd0 con 0x5568127934f0 2024-04-23T18:30:30.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.658+0000 7f1774dc3640 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5568127934f0 0x5568127958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.659+0000 7f1774dc3640 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5568127934f0 0x5568127958e0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.659+0000 7f1774dc3640 1 -- 172.21.15.119:0/126535764 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1768029030 con 0x5568127934f0 2024-04-23T18:30:30.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.659+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127924a0 con 0x556812695290 2024-04-23T18:30:30.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.659+0000 7f17755c4640 1 -- 172.21.15.119:0/126535764 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f177000a4a0 con 0x556812695290 2024-04-23T18:30:30.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.659+0000 7f177911f800 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556812797480 0x5568127998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.659+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55681279a030 con 0x556812797480 2024-04-23T18:30:30.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.659+0000 7f176ffff640 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556812797480 0x5568127998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.655 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.660+0000 7f176ffff640 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556812797480 0x5568127998d0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.660+0000 7f176ffff640 1 -- 172.21.15.119:0/126535764 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1760052980 con 0x556812797480 2024-04-23T18:30:30.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.660+0000 7f177911f800 1 Processor -- start 2024-04-23T18:30:30.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.661+0000 7f177911f800 1 -- start start 2024-04-23T18:30:30.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.661+0000 7f177911f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5568127a8490 0x5568127a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.661+0000 7f177911f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556812582df0 con 0x5568127a8490 2024-04-23T18:30:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.661+0000 7f1774dc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5568127a8490 0x5568127a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.661+0000 7f1774dc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5568127a8490 0x5568127a88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36152/0 (socket says 172.21.15.119:36152) 2024-04-23T18:30:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.661+0000 7f1774dc3640 1 -- 172.21.15.119:0/3771586939 learned_addr learned my addr 172.21.15.119:0/3771586939 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.661+0000 7f1774dc3640 1 -- 172.21.15.119:0/3771586939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568127a8df0 con 0x5568127a8490 2024-04-23T18:30:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.661+0000 7f1774dc3640 1 --2- 172.21.15.119:0/3771586939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5568127a8490 0x5568127a88b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1768016520 tx=0x7f176802aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.661+0000 7f165a7fc640 1 -- 172.21.15.119:0/3771586939 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1768034030 con 0x5568127a8490 2024-04-23T18:30:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.661+0000 7f165a7fc640 1 -- 172.21.15.119:0/3771586939 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17680449c0 con 0x5568127a8490 2024-04-23T18:30:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.661+0000 7f177911f800 1 -- 172.21.15.119:0/3771586939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568127a9860 con 0x5568127a8490 2024-04-23T18:30:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.661+0000 7f165a7fc640 1 -- 172.21.15.119:0/3771586939 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1768044ca0 con 0x5568127a8490 2024-04-23T18:30:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.662+0000 7f177911f800 1 -- 172.21.15.119:0/3771586939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568127a9d60 con 0x5568127a8490 2024-04-23T18:30:30.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.662+0000 7f165a7fc640 1 -- 172.21.15.119:0/3771586939 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f176803f060 con 0x5568127a8490 2024-04-23T18:30:30.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.662+0000 7f165a7fc640 1 --2- 172.21.15.119:0/3771586939 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f164c036e60 0x7f164c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.662+0000 7f165a7fc640 1 -- 172.21.15.119:0/3771586939 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f1768035070 con 0x5568127a8490 2024-04-23T18:30:30.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.662+0000 7f176ffff640 1 --2- 172.21.15.119:0/3771586939 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f164c036e60 0x7f164c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.663+0000 7f177911f800 1 Processor -- start 2024-04-23T18:30:30.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.663+0000 7f177911f800 1 -- start start 2024-04-23T18:30:30.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.663+0000 7f176ffff640 1 --2- 172.21.15.119:0/3771586939 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f164c036e60 0x7f164c039320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x556812791aa0 tx=0x7f1760005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.663+0000 7f177911f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 0x556812691540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.663+0000 7f177911f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556812782970 con 0x556812691120 2024-04-23T18:30:30.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.663+0000 7f1774dc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 0x556812691540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.663+0000 7f1774dc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 0x556812691540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36164/0 (socket says 172.21.15.119:36164) 2024-04-23T18:30:30.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.663+0000 7f1774dc3640 1 -- 172.21.15.119:0/2592555737 learned_addr learned my addr 172.21.15.119:0/2592555737 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.675 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.663+0000 7f1774dc3640 1 -- 172.21.15.119:0/2592555737 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55681268f920 con 0x556812691120 2024-04-23T18:30:30.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.664+0000 7f1774dc3640 1 --2- 172.21.15.119:0/2592555737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 0x556812691540 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f176804b080 tx=0x7f176802cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2963c3f5041db193 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.664+0000 7f164bfff640 1 -- 172.21.15.119:0/2592555737 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176805a030 con 0x556812691120 2024-04-23T18:30:30.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.664+0000 7f164bfff640 1 -- 172.21.15.119:0/2592555737 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1768043e80 con 0x556812691120 2024-04-23T18:30:30.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.664+0000 7f164bfff640 1 -- 172.21.15.119:0/2592555737 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176802cc60 con 0x556812691120 2024-04-23T18:30:30.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.664+0000 7f177911f800 1 -- 172.21.15.119:0/2592555737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 msgr2=0x556812691540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.664+0000 7f177911f800 1 --2- 172.21.15.119:0/2592555737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 0x556812691540 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f176804b080 tx=0x7f176802cb40 comp rx=0 tx=0).stop 2024-04-23T18:30:30.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.664+0000 7f177911f800 1 -- 172.21.15.119:0/2592555737 shutdown_connections 2024-04-23T18:30:30.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.664+0000 7f177911f800 1 --2- 172.21.15.119:0/2592555737 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 0x556812691540 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.664+0000 7f177911f800 1 -- 172.21.15.119:0/2592555737 >> 172.21.15.119:0/2592555737 conn(0x5568127b1880 msgr2=0x5568127af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.664+0000 7f177911f800 1 -- 172.21.15.119:0/2592555737 shutdown_connections 2024-04-23T18:30:30.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.664+0000 7f177911f800 1 -- 172.21.15.119:0/2592555737 wait complete. 2024-04-23T18:30:30.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.664+0000 7f177911f800 1 Processor -- start 2024-04-23T18:30:30.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.665+0000 7f177911f800 1 -- start start 2024-04-23T18:30:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.665+0000 7f177911f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 0x5568127beab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.665+0000 7f177911f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55681268fd30 con 0x556812691120 2024-04-23T18:30:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.665+0000 7f1774dc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 0x5568127beab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.665+0000 7f1774dc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 0x5568127beab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36176/0 (socket says 172.21.15.119:36176) 2024-04-23T18:30:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.665+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 learned_addr learned my addr 172.21.15.119:0/3120843900 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.665+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568127beff0 con 0x556812691120 2024-04-23T18:30:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.665+0000 7f1774dc3640 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 0x5568127beab0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f176802e000 tx=0x7f1768006fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.665+0000 7f164a7fc640 1 -- 172.21.15.119:0/3120843900 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176805a040 con 0x556812691120 2024-04-23T18:30:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.665+0000 7f164a7fc640 1 -- 172.21.15.119:0/3120843900 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f176800d3d0 con 0x556812691120 2024-04-23T18:30:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.665+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568127beff0 con 0x556812691120 2024-04-23T18:30:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.665+0000 7f164a7fc640 1 -- 172.21.15.119:0/3120843900 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f176803fdd0 con 0x556812691120 2024-04-23T18:30:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.666+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568127beff0 con 0x556812691120 2024-04-23T18:30:30.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.666+0000 7f164a7fc640 1 -- 172.21.15.119:0/3120843900 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f176805d070 con 0x556812691120 2024-04-23T18:30:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.666+0000 7f164a7fc640 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1640036e60 0x7f1640039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.666+0000 7f164a7fc640 1 -- 172.21.15.119:0/3120843900 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f176805b070 con 0x556812691120 2024-04-23T18:30:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.666+0000 7f177911f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.666+0000 7f176ffff640 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1640036e60 0x7f1640039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f177911f800 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5568127ca1c0 0x5568127cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127ccdd0 con 0x5568127ca1c0 2024-04-23T18:30:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f17755c4640 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5568127ca1c0 0x5568127cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f176ffff640 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1640036e60 0x7f1640039320 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f176001ced0 tx=0x7f176004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f17755c4640 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5568127ca1c0 0x5568127cc680 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f177000a4a0 con 0x5568127ca1c0 2024-04-23T18:30:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f177911f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f177911f800 20 realm 2024-04-23T18:30:30.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f177911f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127cd1e0 con 0x5568127ca1c0 2024-04-23T18:30:30.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f177000a4a0 con 0x5568127ca1c0 2024-04-23T18:30:30.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f177911f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f177911f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:30:30.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f177911f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.667+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127cda80 con 0x5568127ca1c0 2024-04-23T18:30:30.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.668+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f177000a4a0 con 0x5568127ca1c0 2024-04-23T18:30:30.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.668+0000 7f177911f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.668+0000 7f177911f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.668+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ca1c0 2024-04-23T18:30:30.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.668+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f177000a4a0 con 0x5568127ca1c0 2024-04-23T18:30:30.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.668+0000 7f177911f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.668+0000 7f177911f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.668+0000 7f177911f800 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5568127ceb80 0x5568127d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.668+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127d14f0 con 0x5568127ceb80 2024-04-23T18:30:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.668+0000 7f1774dc3640 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5568127ceb80 0x5568127d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.668+0000 7f1774dc3640 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5568127ceb80 0x5568127d0f70 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.669+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1768029030 con 0x5568127ceb80 2024-04-23T18:30:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.669+0000 7f177911f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:30:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.669+0000 7f177911f800 20 searching for the correct realm 2024-04-23T18:30:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.669+0000 7f177911f800 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5568127d3540 0x5568127d5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.669+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127d60d0 con 0x5568127d3540 2024-04-23T18:30:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.669+0000 7f176ffff640 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5568127d3540 0x5568127d5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.669+0000 7f176ffff640 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5568127d3540 0x5568127d5a00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.669+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.669+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127d60d0 con 0x5568127ceb80 2024-04-23T18:30:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.670+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1768029030 con 0x5568127ceb80 2024-04-23T18:30:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.670+0000 7f1774dc3640 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1768038020 0x7f176805f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.670+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127d60d0 con 0x7f1768038020 2024-04-23T18:30:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.670+0000 7f17755c4640 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1768038020 0x7f176805f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.670+0000 7f17755c4640 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1768038020 0x7f176805f450 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.670+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177000a4a0 con 0x7f1768038020 2024-04-23T18:30:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.670+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ca1c0 2024-04-23T18:30:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.671+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177000a4a0 con 0x5568127ca1c0 2024-04-23T18:30:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.671+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ca1c0 2024-04-23T18:30:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.671+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177000a4a0 con 0x5568127ca1c0 2024-04-23T18:30:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.671+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x7f1768038020 2024-04-23T18:30:30.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.671+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177000a4a0 con 0x7f1768038020 2024-04-23T18:30:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.671+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x7f1768038020 2024-04-23T18:30:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.671+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f177000a4a0 con 0x7f1768038020 2024-04-23T18:30:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.671+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ceb80 2024-04-23T18:30:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.672+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1768029030 con 0x5568127ceb80 2024-04-23T18:30:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.672+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127d3540 2024-04-23T18:30:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.672+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.672+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ca1c0 2024-04-23T18:30:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.672+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177000a4a0 con 0x5568127ca1c0 2024-04-23T18:30:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.672+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x7f1768038020 2024-04-23T18:30:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.672+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177000a4a0 con 0x7f1768038020 2024-04-23T18:30:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.672+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ca1c0 2024-04-23T18:30:30.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.673+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177000a4a0 con 0x5568127ca1c0 2024-04-23T18:30:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.673+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ceb80 2024-04-23T18:30:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.673+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1768029030 con 0x5568127ceb80 2024-04-23T18:30:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.673+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127d3540 2024-04-23T18:30:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.673+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.673+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127d3540 2024-04-23T18:30:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.673+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.673+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x7f1768038020 2024-04-23T18:30:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.674+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177000a4a0 con 0x7f1768038020 2024-04-23T18:30:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.674+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127d3540 2024-04-23T18:30:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.674+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.674+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127d3540 2024-04-23T18:30:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.674+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.674+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ca1c0 2024-04-23T18:30:30.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.674+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177000a4a0 con 0x5568127ca1c0 2024-04-23T18:30:30.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.674+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ca1c0 2024-04-23T18:30:30.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.675+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f177000a4a0 con 0x5568127ca1c0 2024-04-23T18:30:30.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.675+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x7f1768038020 2024-04-23T18:30:30.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.675+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177000a4a0 con 0x7f1768038020 2024-04-23T18:30:30.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.675+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127d3540 2024-04-23T18:30:30.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.675+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.675+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ceb80 2024-04-23T18:30:30.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.675+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1768029030 con 0x5568127ceb80 2024-04-23T18:30:30.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.675+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ca1c0 2024-04-23T18:30:30.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.676+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177000a4a0 con 0x5568127ca1c0 2024-04-23T18:30:30.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.676+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ceb80 2024-04-23T18:30:30.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.676+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1768029030 con 0x5568127ceb80 2024-04-23T18:30:30.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.676+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127d3540 2024-04-23T18:30:30.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.676+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.676+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x7f1768038020 2024-04-23T18:30:30.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.676+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177000a4a0 con 0x7f1768038020 2024-04-23T18:30:30.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.676+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ceb80 2024-04-23T18:30:30.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.677+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1768086040 con 0x5568127ceb80 2024-04-23T18:30:30.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.677+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127d3540 2024-04-23T18:30:30.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.677+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.677+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x7f1768038020 2024-04-23T18:30:30.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.677+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177000a4a0 con 0x7f1768038020 2024-04-23T18:30:30.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.677+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ca1c0 2024-04-23T18:30:30.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1770040080 con 0x5568127ca1c0 2024-04-23T18:30:30.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5568127cde20 con 0x5568127ceb80 2024-04-23T18:30:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1768086040 con 0x5568127ceb80 2024-04-23T18:30:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:30:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:30:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:30:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:30:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:30:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:30:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127d1e40 con 0x5568127ca1c0 2024-04-23T18:30:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1770040080 con 0x5568127ca1c0 2024-04-23T18:30:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127d2230 con 0x5568127ca1c0 2024-04-23T18:30:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1770040080 con 0x5568127ca1c0 2024-04-23T18:30:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.678+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127d2230 con 0x7f1768038020 2024-04-23T18:30:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1770040080 con 0x7f1768038020 2024-04-23T18:30:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:30:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 20 zone default found 2024-04-23T18:30:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 4 Realm: () 2024-04-23T18:30:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:30:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:30:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:30:30.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 20 zonegroup default 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127d2650 con 0x5568127ceb80 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1768086040 con 0x5568127ceb80 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127d7f30 con 0x5568127d3540 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127d82d0 con 0x5568127d3540 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 20 started sync module instance, tier type = 2024-04-23T18:30:30.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.679+0000 7f177911f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:30:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.680+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127d73d0 con 0x5568127ceb80 2024-04-23T18:30:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.681+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1768086040 con 0x5568127ceb80 2024-04-23T18:30:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.681+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93905475172288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127d7030 con 0x5568127ceb80 2024-04-23T18:30:30.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.681+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127d9010 con 0x5568127ca1c0 2024-04-23T18:30:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.681+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93905475172288] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1768086040 con 0x5568127ceb80 2024-04-23T18:30:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.682+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x5568127ca1c0 2024-04-23T18:30:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.682+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93905475176048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127d9400 con 0x5568127ca1c0 2024-04-23T18:30:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.682+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127d9e20 con 0x5568127d3540 2024-04-23T18:30:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.683+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93905475176048] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x5568127ca1c0 2024-04-23T18:30:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.683+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.683+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93905475180816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127da210 con 0x5568127d3540 2024-04-23T18:30:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.683+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127dac50 con 0x5568127ceb80 2024-04-23T18:30:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.684+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93905475180816] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.684+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1768086040 con 0x5568127ceb80 2024-04-23T18:30:30.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.684+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93905475184416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127db040 con 0x5568127ceb80 2024-04-23T18:30:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.684+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127dba80 con 0x5568127ca1c0 2024-04-23T18:30:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.685+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93905475184416] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1768086040 con 0x5568127ceb80 2024-04-23T18:30:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.685+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x5568127ca1c0 2024-04-23T18:30:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.685+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93905475188048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127dba40 con 0x5568127ca1c0 2024-04-23T18:30:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.685+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127dc490 con 0x7f1768038020 2024-04-23T18:30:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.687+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93905475188048] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x5568127ca1c0 2024-04-23T18:30:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.688+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x7f1768038020 2024-04-23T18:30:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.688+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93905475177104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127dc490 con 0x7f1768038020 2024-04-23T18:30:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.688+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127dce50 con 0x7f1768038020 2024-04-23T18:30:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.689+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93905475177104] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x7f1768038020 2024-04-23T18:30:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.689+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x7f1768038020 2024-04-23T18:30:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.689+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93905475190752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127dd030 con 0x7f1768038020 2024-04-23T18:30:30.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.689+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127dd880 con 0x7f1768038020 2024-04-23T18:30:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.690+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93905475190752] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x7f1768038020 2024-04-23T18:30:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.691+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x7f1768038020 2024-04-23T18:30:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.691+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93905475194208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127dd710 con 0x7f1768038020 2024-04-23T18:30:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.691+0000 7f177911f800 20 add_watcher() i=0 2024-04-23T18:30:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.691+0000 7f177911f800 20 add_watcher() i=1 2024-04-23T18:30:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.691+0000 7f177911f800 20 add_watcher() i=2 2024-04-23T18:30:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.691+0000 7f177911f800 20 add_watcher() i=3 2024-04-23T18:30:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.691+0000 7f177911f800 20 add_watcher() i=4 2024-04-23T18:30:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.691+0000 7f177911f800 20 add_watcher() i=5 2024-04-23T18:30:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.691+0000 7f177911f800 20 add_watcher() i=6 2024-04-23T18:30:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.692+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93905475194208] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x7f1768038020 2024-04-23T18:30:30.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.692+0000 7f177911f800 20 add_watcher() i=7 2024-04-23T18:30:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.692+0000 7f177911f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:30:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.692+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568127e0c80 con 0x5568127ca1c0 2024-04-23T18:30:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.692+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1770040080 con 0x5568127ca1c0 2024-04-23T18:30:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.692+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93905475195328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127de130 con 0x5568127ca1c0 2024-04-23T18:30:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.693+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93905475195328] v34'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1770040080 con 0x5568127ca1c0 2024-04-23T18:30:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.693+0000 7f162afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.693+0000 7f177911f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:30:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.693+0000 7f177911f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:30:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.693+0000 7f177911f800 5 note: GC not initialized 2024-04-23T18:30:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.693+0000 7f1629fe3640 20 reqs_thread_entry: start 2024-04-23T18:30:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.693+0000 7f177911f800 20 init_complete bucket index max shards: 11 2024-04-23T18:30:30.699 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.693+0000 7f177911f800 20 Filter name: none 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.694+0000 7f159b7fe640 20 reqs_thread_entry: start 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.694+0000 7f177911f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.694+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556812813fa0 con 0x5568127ca1c0 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.694+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1770040080 con 0x5568127ca1c0 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.694+0000 7f177911f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.694+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5568128154f0 con 0x7f1768038020 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.695+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f1770040080 con 0x7f1768038020 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.695+0000 7f162afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.695+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93905475195328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127dff90 con 0x5568127ca1c0 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.696+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93905475195328] v34'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1770040080 con 0x5568127ca1c0 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.696+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93905475172288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127dd180 con 0x5568127ceb80 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.697+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93905475172288] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1768086040 con 0x5568127ceb80 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.697+0000 7f177911f800 20 remove_watcher() i=0 2024-04-23T18:30:30.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.697+0000 7f177911f800 2 removed watcher, disabling cache 2024-04-23T18:30:30.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.697+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93905475176048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127d77c0 con 0x5568127ca1c0 2024-04-23T18:30:30.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.699+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93905475176048] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x5568127ca1c0 2024-04-23T18:30:30.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.699+0000 7f177911f800 20 remove_watcher() i=1 2024-04-23T18:30:30.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.699+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93905475180816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127d77c0 con 0x5568127d3540 2024-04-23T18:30:30.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.700+0000 7f176ffff640 1 -- 172.21.15.119:0/3120843900 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93905475180816] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1760081070 con 0x5568127d3540 2024-04-23T18:30:30.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.700+0000 7f177911f800 20 remove_watcher() i=2 2024-04-23T18:30:30.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.700+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93905475184416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127d9910 con 0x5568127ceb80 2024-04-23T18:30:30.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.701+0000 7f1774dc3640 1 -- 172.21.15.119:0/3120843900 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93905475184416] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1768086040 con 0x5568127ceb80 2024-04-23T18:30:30.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.701+0000 7f177911f800 20 remove_watcher() i=3 2024-04-23T18:30:30.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.701+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93905475188048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127da720 con 0x5568127ca1c0 2024-04-23T18:30:30.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.702+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93905475188048] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x5568127ca1c0 2024-04-23T18:30:30.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.702+0000 7f177911f800 20 remove_watcher() i=4 2024-04-23T18:30:30.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.702+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93905475177104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127d9910 con 0x7f1768038020 2024-04-23T18:30:30.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.703+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93905475177104] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x7f1768038020 2024-04-23T18:30:30.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.703+0000 7f177911f800 20 remove_watcher() i=5 2024-04-23T18:30:30.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.703+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93905475190752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127d9910 con 0x7f1768038020 2024-04-23T18:30:30.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.704+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93905475190752] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x7f1768038020 2024-04-23T18:30:30.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.704+0000 7f177911f800 20 remove_watcher() i=6 2024-04-23T18:30:30.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.704+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93905475194208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5568127dbfe0 con 0x7f1768038020 2024-04-23T18:30:30.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93905475194208] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770040080 con 0x7f1768038020 2024-04-23T18:30:30.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 20 remove_watcher() i=7 2024-04-23T18:30:30.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1768038020 msgr2=0x7f176805f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f1768038020 0x7f176805f450 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5568127ca1c0 msgr2=0x5568127cc680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5568127ca1c0 0x5568127cc680 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5568127ceb80 msgr2=0x5568127d0f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5568127ceb80 0x5568127d0f70 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5568127d3540 msgr2=0x5568127d5a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5568127d3540 0x5568127d5a00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1640036e60 msgr2=0x7f1640039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1640036e60 0x7f1640039320 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f176001ced0 tx=0x7f176004f000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f17755c4640 1 -- 172.21.15.119:0/3120843900 reap_dead start 2024-04-23T18:30:30.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 msgr2=0x5568127beab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 0x5568127beab0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f176802e000 tx=0x7f1768006fd0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 shutdown_connections 2024-04-23T18:30:30.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 --2- 172.21.15.119:0/3120843900 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812691120 0x5568127beab0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 >> 172.21.15.119:0/3120843900 conn(0x5568127b1880 msgr2=0x5568127aeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 shutdown_connections 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.705+0000 7f177911f800 1 -- 172.21.15.119:0/3120843900 wait complete. 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/3771586939 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f164c036e60 msgr2=0x7f164c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 --2- 172.21.15.119:0/3771586939 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f164c036e60 0x7f164c039320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x556812791aa0 tx=0x7f1760005a00 comp rx=0 tx=0).stop 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/3771586939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5568127a8490 msgr2=0x5568127a88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 --2- 172.21.15.119:0/3771586939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5568127a8490 0x5568127a88b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1768016520 tx=0x7f176802aab0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/3771586939 shutdown_connections 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 --2- 172.21.15.119:0/3771586939 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f164c036e60 0x7f164c039320 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 --2- 172.21.15.119:0/3771586939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5568127a8490 0x5568127a88b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/3771586939 >> 172.21.15.119:0/3771586939 conn(0x55681279c530 msgr2=0x55681279c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/3771586939 shutdown_connections 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/3771586939 wait complete. 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556812797480 msgr2=0x5568127998d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556812797480 0x5568127998d0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556812695290 msgr2=0x556812790bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556812695290 0x556812790bd0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5568127934f0 msgr2=0x5568127958e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5568127934f0 0x5568127958e0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f165c036e60 msgr2=0x7f165c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f165c036e60 0x7f165c039320 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1760054000 tx=0x7f176004e000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812604050 msgr2=0x556812789b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 --2- 172.21.15.119:0/126535764 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556812604050 0x556812789b60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x556812782f80 tx=0x7f1768000bc0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f17755c4640 1 -- 172.21.15.119:0/126535764 reap_dead start 2024-04-23T18:30:30.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 shutdown_connections 2024-04-23T18:30:30.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 >> 172.21.15.119:0/126535764 conn(0x55681268b440 msgr2=0x55681277c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 shutdown_connections 2024-04-23T18:30:30.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.706+0000 7f177911f800 1 -- 172.21.15.119:0/126535764 wait complete. 2024-04-23T18:30:30.709 INFO:teuthology.orchestra.run.smithi119.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-23T18:30:30.710 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:30:30.710 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-23T18:30:30.710 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-23T18:30:30.710 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-04-23T18:30:30.754 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:30:30.755 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:30:30.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.763+0000 7f66bf946800 1 Processor -- start 2024-04-23T18:30:30.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.763+0000 7f66bf946800 1 -- start start 2024-04-23T18:30:30.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.763+0000 7f66bf946800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564ff26038d0 0x564ff2603cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.763+0000 7f66bf946800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564ff24b5560 con 0x564ff2604230 2024-04-23T18:30:30.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.763+0000 7f66bf946800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x564ff24a6e20 con 0x564ff26038d0 2024-04-23T18:30:30.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.763+0000 7f66bd445640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564ff26038d0 0x564ff2603cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.763+0000 7f66bcc44640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x564ff2604230 0x564ff26046e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:39364/0 (socket says 172.21.15.119:39364) 2024-04-23T18:30:30.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.763+0000 7f66bcc44640 1 -- 172.21.15.119:0/3688768740 learned_addr learned my addr 172.21.15.119:0/3688768740 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:30:30.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.763+0000 7f66bd445640 1 -- 172.21.15.119:0/3688768740 >> v1:172.21.15.62:6789/0 conn(0x564ff2604230 legacy=0x564ff26046e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.763+0000 7f66bd445640 1 -- 172.21.15.119:0/3688768740 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff24b4e60 con 0x564ff26038d0 2024-04-23T18:30:30.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.765+0000 7f66bd445640 1 --2- 172.21.15.119:0/3688768740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff2603cf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f66b000a470 tx=0x7f66b001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612786564f2c82c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.765+0000 7f66affff640 1 -- 172.21.15.119:0/3688768740 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b0057070 con 0x564ff26038d0 2024-04-23T18:30:30.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.765+0000 7f66affff640 1 -- 172.21.15.119:0/3688768740 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b004adc0 con 0x564ff26038d0 2024-04-23T18:30:30.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.765+0000 7f66affff640 1 -- 172.21.15.119:0/3688768740 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b0052590 con 0x564ff26038d0 2024-04-23T18:30:30.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.766+0000 7f66bf946800 1 -- 172.21.15.119:0/3688768740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 msgr2=0x564ff2603cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.766+0000 7f66bf946800 1 --2- 172.21.15.119:0/3688768740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff2603cf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f66b000a470 tx=0x7f66b001ce90 comp rx=0 tx=0).stop 2024-04-23T18:30:30.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.766+0000 7f66bf946800 1 -- 172.21.15.119:0/3688768740 shutdown_connections 2024-04-23T18:30:30.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.766+0000 7f66bf946800 1 --2- 172.21.15.119:0/3688768740 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff2603cf0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.766+0000 7f66bf946800 1 -- 172.21.15.119:0/3688768740 >> 172.21.15.119:0/3688768740 conn(0x564ff25ff430 msgr2=0x564ff2601850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.766+0000 7f66bf946800 1 -- 172.21.15.119:0/3688768740 shutdown_connections 2024-04-23T18:30:30.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.766+0000 7f66bf946800 1 -- 172.21.15.119:0/3688768740 wait complete. 2024-04-23T18:30:30.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.778+0000 7f66bf946800 1 Processor -- start 2024-04-23T18:30:30.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.778+0000 7f66bf946800 1 -- start start 2024-04-23T18:30:30.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.778+0000 7f66bf946800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff26f8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.778+0000 7f66bf946800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564ff25505d0 con 0x564ff26038d0 2024-04-23T18:30:30.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.778+0000 7f66bd445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff26f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.778+0000 7f66bd445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff26f8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36192/0 (socket says 172.21.15.119:36192) 2024-04-23T18:30:30.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.778+0000 7f66bd445640 1 -- 172.21.15.119:0/3069834 learned_addr learned my addr 172.21.15.119:0/3069834 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.778+0000 7f66bd445640 1 -- 172.21.15.119:0/3069834 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff24c6860 con 0x564ff26038d0 2024-04-23T18:30:30.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.778+0000 7f66bd445640 1 --2- 172.21.15.119:0/3069834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff26f8520 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f66b0055040 tx=0x7f66b004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a12b6f57d15a1e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.779+0000 7f65ab606640 1 -- 172.21.15.119:0/3069834 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b0057040 con 0x564ff26038d0 2024-04-23T18:30:30.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.779+0000 7f65ab606640 1 -- 172.21.15.119:0/3069834 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b0062070 con 0x564ff26038d0 2024-04-23T18:30:30.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.779+0000 7f65ab606640 1 -- 172.21.15.119:0/3069834 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b005d470 con 0x564ff26038d0 2024-04-23T18:30:30.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.779+0000 7f66bf946800 1 -- 172.21.15.119:0/3069834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 msgr2=0x564ff26f8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.779+0000 7f66bf946800 1 --2- 172.21.15.119:0/3069834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff26f8520 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f66b0055040 tx=0x7f66b004c000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.779+0000 7f66bf946800 1 -- 172.21.15.119:0/3069834 shutdown_connections 2024-04-23T18:30:30.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.779+0000 7f66bf946800 1 --2- 172.21.15.119:0/3069834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff26f8520 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.779+0000 7f66bf946800 1 -- 172.21.15.119:0/3069834 >> 172.21.15.119:0/3069834 conn(0x564ff25ff430 msgr2=0x564ff26f3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.779+0000 7f66bf946800 1 -- 172.21.15.119:0/3069834 shutdown_connections 2024-04-23T18:30:30.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.779+0000 7f66bf946800 1 -- 172.21.15.119:0/3069834 wait complete. 2024-04-23T18:30:30.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.780+0000 7f66bf946800 1 Processor -- start 2024-04-23T18:30:30.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.780+0000 7f66bf946800 1 -- start start 2024-04-23T18:30:30.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.780+0000 7f66bf946800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff26ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.780+0000 7f66bf946800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564ff2605030 con 0x564ff26038d0 2024-04-23T18:30:30.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.780+0000 7f66bd445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff26ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.780+0000 7f66bd445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff26ffdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36194/0 (socket says 172.21.15.119:36194) 2024-04-23T18:30:30.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.780+0000 7f66bd445640 1 -- 172.21.15.119:0/2856541426 learned_addr learned my addr 172.21.15.119:0/2856541426 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.780+0000 7f66bd445640 1 -- 172.21.15.119:0/2856541426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff24c4eb0 con 0x564ff26038d0 2024-04-23T18:30:30.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.781+0000 7f66bd445640 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff26ffdd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f66b001ce60 tx=0x7f66b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.781+0000 7f65a9e03640 1 -- 172.21.15.119:0/2856541426 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b006b070 con 0x564ff26038d0 2024-04-23T18:30:30.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.781+0000 7f65a9e03640 1 -- 172.21.15.119:0/2856541426 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b005d970 con 0x564ff26038d0 2024-04-23T18:30:30.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.781+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ff2700310 con 0x564ff26038d0 2024-04-23T18:30:30.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.781+0000 7f65a9e03640 1 -- 172.21.15.119:0/2856541426 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b0057070 con 0x564ff26038d0 2024-04-23T18:30:30.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.781+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ff2700830 con 0x564ff26038d0 2024-04-23T18:30:30.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.782+0000 7f65a9e03640 1 -- 172.21.15.119:0/2856541426 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f66b005dc90 con 0x564ff26038d0 2024-04-23T18:30:30.777 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.782+0000 7f65a9e03640 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f65a4036e60 0x7f65a4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.782+0000 7f65a9e03640 1 -- 172.21.15.119:0/2856541426 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f66b008e940 con 0x564ff26038d0 2024-04-23T18:30:30.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.782+0000 7f66bcc44640 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f65a4036e60 0x7f65a4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.782+0000 7f66bf946800 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ff2604230 0x564ff2706e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.782+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff27073c0 con 0x564ff2604230 2024-04-23T18:30:30.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.782+0000 7f66bdc46640 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ff2604230 0x564ff2706e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.782+0000 7f66bcc44640 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f65a4036e60 0x7f65a4039320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f66b4000f60 tx=0x7f66b40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.782+0000 7f66bdc46640 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ff2604230 0x564ff2706e40 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.783+0000 7f66bdc46640 1 -- 172.21.15.119:0/2856541426 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff2604230 2024-04-23T18:30:30.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.783+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff2704410 con 0x564ff2604230 2024-04-23T18:30:30.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.783+0000 7f66bdc46640 1 -- 172.21.15.119:0/2856541426 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff2604230 2024-04-23T18:30:30.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.783+0000 7f66bf946800 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ff27096f0 0x564ff270bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.783+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff270c180 con 0x564ff27096f0 2024-04-23T18:30:30.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.783+0000 7f66bd445640 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ff27096f0 0x564ff270bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.783+0000 7f66bd445640 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ff27096f0 0x564ff270bae0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.784+0000 7f66bd445640 1 -- 172.21.15.119:0/2856541426 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f66b005a040 con 0x564ff27096f0 2024-04-23T18:30:30.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.784+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff27086a0 con 0x564ff2604230 2024-04-23T18:30:30.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.784+0000 7f66bdc46640 1 -- 172.21.15.119:0/2856541426 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff2604230 2024-04-23T18:30:30.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.784+0000 7f66bf946800 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564ff270d630 0x564ff270fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.784+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff27101e0 con 0x564ff270d630 2024-04-23T18:30:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.784+0000 7f66bcc44640 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564ff270d630 0x564ff270fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.785+0000 7f66bcc44640 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564ff270d630 0x564ff270fa80 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.785+0000 7f66bcc44640 1 -- 172.21.15.119:0/2856541426 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f66b4009050 con 0x564ff270d630 2024-04-23T18:30:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.785+0000 7f66bf946800 1 Processor -- start 2024-04-23T18:30:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.785+0000 7f66bf946800 1 -- start start 2024-04-23T18:30:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.785+0000 7f66bf946800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff271e640 0x564ff271ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.785+0000 7f66bf946800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564ff24f6df0 con 0x564ff271e640 2024-04-23T18:30:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.785+0000 7f66bd445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff271e640 0x564ff271ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.786+0000 7f66bd445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff271e640 0x564ff271ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36206/0 (socket says 172.21.15.119:36206) 2024-04-23T18:30:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.786+0000 7f66bd445640 1 -- 172.21.15.119:0/621425299 learned_addr learned my addr 172.21.15.119:0/621425299 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.786+0000 7f66bd445640 1 -- 172.21.15.119:0/621425299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff271efa0 con 0x564ff271e640 2024-04-23T18:30:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.786+0000 7f66bd445640 1 --2- 172.21.15.119:0/621425299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff271e640 0x564ff271ea60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f66b008cc20 tx=0x7f66b0072de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.786+0000 7f65a2ffd640 1 -- 172.21.15.119:0/621425299 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b0009410 con 0x564ff271e640 2024-04-23T18:30:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.786+0000 7f65a2ffd640 1 -- 172.21.15.119:0/621425299 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b00095b0 con 0x564ff271e640 2024-04-23T18:30:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.786+0000 7f65a2ffd640 1 -- 172.21.15.119:0/621425299 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b0009890 con 0x564ff271e640 2024-04-23T18:30:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.786+0000 7f66bf946800 1 -- 172.21.15.119:0/621425299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ff271fa10 con 0x564ff271e640 2024-04-23T18:30:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.786+0000 7f66bf946800 1 -- 172.21.15.119:0/621425299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ff271ff10 con 0x564ff271e640 2024-04-23T18:30:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.787+0000 7f65a2ffd640 1 -- 172.21.15.119:0/621425299 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f66b0095060 con 0x564ff271e640 2024-04-23T18:30:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.787+0000 7f65a2ffd640 1 --2- 172.21.15.119:0/621425299 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6594036e60 0x7f6594039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.787+0000 7f65a2ffd640 1 -- 172.21.15.119:0/621425299 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f66b0089030 con 0x564ff271e640 2024-04-23T18:30:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.787+0000 7f66bcc44640 1 --2- 172.21.15.119:0/621425299 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6594036e60 0x7f6594039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.787+0000 7f66bf946800 1 Processor -- start 2024-04-23T18:30:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.787+0000 7f66bf946800 1 -- start start 2024-04-23T18:30:30.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.787+0000 7f66bcc44640 1 --2- 172.21.15.119:0/621425299 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6594036e60 0x7f6594039320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f66b400bf50 tx=0x7f66b400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.788+0000 7f66bf946800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff272b760 0x564ff272bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.788+0000 7f66bf946800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564ff26f8be0 con 0x564ff272b760 2024-04-23T18:30:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.788+0000 7f66bd445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff272b760 0x564ff272bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.788+0000 7f66bd445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff272b760 0x564ff272bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36208/0 (socket says 172.21.15.119:36208) 2024-04-23T18:30:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.788+0000 7f66bd445640 1 -- 172.21.15.119:0/3634756419 learned_addr learned my addr 172.21.15.119:0/3634756419 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.788+0000 7f66bd445640 1 -- 172.21.15.119:0/3634756419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff272c150 con 0x564ff272b760 2024-04-23T18:30:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.788+0000 7f66bd445640 1 --2- 172.21.15.119:0/3634756419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff272b760 0x564ff272bb80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f66b008b310 tx=0x7f66b006eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc99db8c3fd6315b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.788+0000 7f65a0ff9640 1 -- 172.21.15.119:0/3634756419 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b00a5020 con 0x564ff272b760 2024-04-23T18:30:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.788+0000 7f65a0ff9640 1 -- 172.21.15.119:0/3634756419 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b006edd0 con 0x564ff272b760 2024-04-23T18:30:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.788+0000 7f65a0ff9640 1 -- 172.21.15.119:0/3634756419 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b006e5f0 con 0x564ff272b760 2024-04-23T18:30:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bf946800 1 -- 172.21.15.119:0/3634756419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff272b760 msgr2=0x564ff272bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bf946800 1 --2- 172.21.15.119:0/3634756419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff272b760 0x564ff272bb80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f66b008b310 tx=0x7f66b006eba0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bf946800 1 -- 172.21.15.119:0/3634756419 shutdown_connections 2024-04-23T18:30:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bf946800 1 --2- 172.21.15.119:0/3634756419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff272b760 0x564ff272bb80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bf946800 1 -- 172.21.15.119:0/3634756419 >> 172.21.15.119:0/3634756419 conn(0x564ff2727ac0 msgr2=0x564ff2725b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bf946800 1 -- 172.21.15.119:0/3634756419 shutdown_connections 2024-04-23T18:30:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bf946800 1 -- 172.21.15.119:0/3634756419 wait complete. 2024-04-23T18:30:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bf946800 1 Processor -- start 2024-04-23T18:30:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bf946800 1 -- start start 2024-04-23T18:30:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bf946800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff272b760 0x564ff2732b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bf946800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564ff272c800 con 0x564ff272b760 2024-04-23T18:30:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bd445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff272b760 0x564ff2732b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bd445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff272b760 0x564ff2732b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36214/0 (socket says 172.21.15.119:36214) 2024-04-23T18:30:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.789+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 learned_addr learned my addr 172.21.15.119:0/1647767757 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.790+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff27330a0 con 0x564ff272b760 2024-04-23T18:30:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.790+0000 7f66bd445640 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff272b760 0x564ff2732b60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f66b006e470 tx=0x7f66b0087f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.790+0000 7f6592ffd640 1 -- 172.21.15.119:0/1647767757 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b00ba070 con 0x564ff272b760 2024-04-23T18:30:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.790+0000 7f6592ffd640 1 -- 172.21.15.119:0/1647767757 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b006e720 con 0x564ff272b760 2024-04-23T18:30:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.790+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ff27330a0 con 0x564ff272b760 2024-04-23T18:30:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.790+0000 7f6592ffd640 1 -- 172.21.15.119:0/1647767757 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b008e690 con 0x564ff272b760 2024-04-23T18:30:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.790+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ff27330a0 con 0x564ff272b760 2024-04-23T18:30:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.791+0000 7f6592ffd640 1 -- 172.21.15.119:0/1647767757 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f66b00bd070 con 0x564ff272b760 2024-04-23T18:30:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.791+0000 7f6592ffd640 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6588036e60 0x7f6588039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.791+0000 7f6592ffd640 1 -- 172.21.15.119:0/1647767757 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f66b00b0030 con 0x564ff272b760 2024-04-23T18:30:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.791+0000 7f66bcc44640 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6588036e60 0x7f6588039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.791+0000 7f66bf946800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.791+0000 7f66bf946800 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ff273e240 0x564ff2740700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.791+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff2740e50 con 0x564ff273e240 2024-04-23T18:30:30.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.791+0000 7f66bdc46640 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ff273e240 0x564ff2740700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bcc44640 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6588036e60 0x7f6588039320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f66b4001b60 tx=0x7f66b4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bdc46640 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ff273e240 0x564ff2740700 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff273e240 2024-04-23T18:30:30.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bf946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bf946800 20 realm 2024-04-23T18:30:30.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bf946800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741260 con 0x564ff273e240 2024-04-23T18:30:30.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff273e240 2024-04-23T18:30:30.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bf946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bf946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:30:30.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bf946800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741b30 con 0x564ff273e240 2024-04-23T18:30:30.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff273e240 2024-04-23T18:30:30.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bf946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bf946800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.792+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff273e240 2024-04-23T18:30:30.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.793+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff273e240 2024-04-23T18:30:30.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.793+0000 7f66bf946800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.793+0000 7f66bf946800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.793+0000 7f66bf946800 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ff27429c0 0x564ff2744db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.793+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff2745510 con 0x564ff27429c0 2024-04-23T18:30:30.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.793+0000 7f66bd445640 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ff27429c0 0x564ff2744db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.793+0000 7f66bd445640 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ff27429c0 0x564ff2744db0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.793+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f66b00bc030 con 0x564ff27429c0 2024-04-23T18:30:30.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.793+0000 7f66bf946800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:30:30.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.793+0000 7f66bf946800 20 searching for the correct realm 2024-04-23T18:30:30.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.793+0000 7f66bf946800 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564ff27475b0 0x564ff2749a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.793+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff274a140 con 0x564ff27475b0 2024-04-23T18:30:30.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.793+0000 7f66bcc44640 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564ff27475b0 0x564ff2749a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.794+0000 7f66bcc44640 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564ff27475b0 0x564ff2749a70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.794+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.794+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff274a140 con 0x564ff27429c0 2024-04-23T18:30:30.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.794+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b00bc030 con 0x564ff27429c0 2024-04-23T18:30:30.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.794+0000 7f66bd445640 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f66b00bf060 0x7f66b0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.794+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff274a140 con 0x7f66b00bf060 2024-04-23T18:30:30.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.795+0000 7f66bdc46640 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f66b00bf060 0x7f66b0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.795+0000 7f66bdc46640 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f66b00bf060 0x7f66b0069530 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.795+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b800a4a0 con 0x7f66b00bf060 2024-04-23T18:30:30.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.795+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff273e240 2024-04-23T18:30:30.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.796+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff273e240 2024-04-23T18:30:30.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.796+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff273e240 2024-04-23T18:30:30.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.796+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff273e240 2024-04-23T18:30:30.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.796+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x7f66b00bf060 2024-04-23T18:30:30.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.796+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b800a4a0 con 0x7f66b00bf060 2024-04-23T18:30:30.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.796+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x7f66b00bf060 2024-04-23T18:30:30.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.796+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f66b800a4a0 con 0x7f66b00bf060 2024-04-23T18:30:30.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.796+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27429c0 2024-04-23T18:30:30.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.797+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b00bc030 con 0x564ff27429c0 2024-04-23T18:30:30.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.797+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27475b0 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.797+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.797+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff273e240 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.797+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff273e240 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.797+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x7f66b00bf060 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.797+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b800a4a0 con 0x7f66b00bf060 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.797+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff273e240 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.798+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff273e240 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.798+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27429c0 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.798+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f66b00bc030 con 0x564ff27429c0 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.798+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27475b0 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.798+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.798+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27475b0 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.798+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.798+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x7f66b00bf060 2024-04-23T18:30:30.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.799+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b800a4a0 con 0x7f66b00bf060 2024-04-23T18:30:30.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.799+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27475b0 2024-04-23T18:30:30.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.799+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.799+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27475b0 2024-04-23T18:30:30.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.799+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.799+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff273e240 2024-04-23T18:30:30.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.799+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff273e240 2024-04-23T18:30:30.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.799+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff273e240 2024-04-23T18:30:30.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.799+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff273e240 2024-04-23T18:30:30.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.799+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x7f66b00bf060 2024-04-23T18:30:30.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.800+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b800a4a0 con 0x7f66b00bf060 2024-04-23T18:30:30.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.800+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27475b0 2024-04-23T18:30:30.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.800+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.800+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27429c0 2024-04-23T18:30:30.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.800+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f66b00bc030 con 0x564ff27429c0 2024-04-23T18:30:30.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.800+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff273e240 2024-04-23T18:30:30.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.800+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b800a4a0 con 0x564ff273e240 2024-04-23T18:30:30.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.800+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27429c0 2024-04-23T18:30:30.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.801+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b00bc030 con 0x564ff27429c0 2024-04-23T18:30:30.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.801+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27475b0 2024-04-23T18:30:30.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.801+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.801+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x7f66b00bf060 2024-04-23T18:30:30.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.801+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b800a4a0 con 0x7f66b00bf060 2024-04-23T18:30:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.801+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27429c0 2024-04-23T18:30:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.801+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b00d3040 con 0x564ff27429c0 2024-04-23T18:30:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.802+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27475b0 2024-04-23T18:30:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.802+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.802+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x7f66b00bf060 2024-04-23T18:30:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.802+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b800a4a0 con 0x7f66b00bf060 2024-04-23T18:30:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.802+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff273e240 2024-04-23T18:30:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f66b8040080 con 0x564ff273e240 2024-04-23T18:30:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564ff2741ed0 con 0x564ff27429c0 2024-04-23T18:30:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66b00d3040 con 0x564ff27429c0 2024-04-23T18:30:30.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:30:30.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:30:30.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:30:30.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:30:30.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:30:30.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:30:30.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff2745eb0 con 0x564ff273e240 2024-04-23T18:30:30.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x564ff273e240 2024-04-23T18:30:30.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff27462a0 con 0x564ff273e240 2024-04-23T18:30:30.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f66b8040080 con 0x564ff273e240 2024-04-23T18:30:30.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.803+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff27462a0 con 0x7f66b00bf060 2024-04-23T18:30:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f66b8040080 con 0x7f66b00bf060 2024-04-23T18:30:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:30:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 20 zone default found 2024-04-23T18:30:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 4 Realm: () 2024-04-23T18:30:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:30:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:30:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:30:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 20 zonegroup default 2024-04-23T18:30:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff27466c0 con 0x564ff27429c0 2024-04-23T18:30:30.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f66b00d3040 con 0x564ff27429c0 2024-04-23T18:30:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff274bfa0 con 0x564ff27475b0 2024-04-23T18:30:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff274c340 con 0x564ff27475b0 2024-04-23T18:30:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 20 started sync module instance, tier type = 2024-04-23T18:30:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:30:30.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.804+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274b440 con 0x564ff27429c0 2024-04-23T18:30:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.806+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b00d3040 con 0x564ff27429c0 2024-04-23T18:30:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.806+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94901370140768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274cb90 con 0x564ff27429c0 2024-04-23T18:30:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.806+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274d3e0 con 0x564ff273e240 2024-04-23T18:30:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.807+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94901370140768] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b00d3040 con 0x564ff27429c0 2024-04-23T18:30:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.807+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x564ff273e240 2024-04-23T18:30:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.807+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94901370144480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274d0f0 con 0x564ff273e240 2024-04-23T18:30:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.807+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274dc10 con 0x564ff27475b0 2024-04-23T18:30:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.808+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94901370144480] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x564ff273e240 2024-04-23T18:30:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.808+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.808+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94901370148576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274e000 con 0x564ff27475b0 2024-04-23T18:30:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.808+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274ea50 con 0x564ff27429c0 2024-04-23T18:30:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.809+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94901370148576] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.809+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b00d3040 con 0x564ff27429c0 2024-04-23T18:30:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.809+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94901370152256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274ee40 con 0x564ff27429c0 2024-04-23T18:30:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.809+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274f860 con 0x564ff273e240 2024-04-23T18:30:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.812+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x564ff273e240 2024-04-23T18:30:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.812+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94901370155856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274f820 con 0x564ff273e240 2024-04-23T18:30:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.812+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff2750840 con 0x7f66b00bf060 2024-04-23T18:30:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.812+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94901370152256] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b00d3040 con 0x564ff27429c0 2024-04-23T18:30:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.813+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94901370155856] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x564ff273e240 2024-04-23T18:30:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.813+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x7f66b00bf060 2024-04-23T18:30:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.813+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94901370145600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274fa00 con 0x7f66b00bf060 2024-04-23T18:30:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.813+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff27510e0 con 0x7f66b00bf060 2024-04-23T18:30:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.814+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94901370145600] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x7f66b00bf060 2024-04-23T18:30:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.814+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x7f66b00bf060 2024-04-23T18:30:30.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.814+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94901370159904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274fa00 con 0x7f66b00bf060 2024-04-23T18:30:30.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.814+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff2751700 con 0x7f66b00bf060 2024-04-23T18:30:30.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.815+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94901370159904] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x7f66b00bf060 2024-04-23T18:30:30.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.815+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x7f66b00bf060 2024-04-23T18:30:30.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.815+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94901370162144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff2751700 con 0x7f66b00bf060 2024-04-23T18:30:30.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.815+0000 7f66bf946800 20 add_watcher() i=0 2024-04-23T18:30:30.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.815+0000 7f66bf946800 20 add_watcher() i=1 2024-04-23T18:30:30.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.815+0000 7f66bf946800 20 add_watcher() i=2 2024-04-23T18:30:30.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.815+0000 7f66bf946800 20 add_watcher() i=3 2024-04-23T18:30:30.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.815+0000 7f66bf946800 20 add_watcher() i=4 2024-04-23T18:30:30.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.815+0000 7f66bf946800 20 add_watcher() i=5 2024-04-23T18:30:30.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.815+0000 7f66bf946800 20 add_watcher() i=6 2024-04-23T18:30:30.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.816+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94901370162144] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x7f66b00bf060 2024-04-23T18:30:30.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.816+0000 7f66bf946800 20 add_watcher() i=7 2024-04-23T18:30:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.816+0000 7f66bf946800 2 all 8 watchers are set, enabling cache 2024-04-23T18:30:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.816+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff27549f0 con 0x564ff273e240 2024-04-23T18:30:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.816+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f66b8040080 con 0x564ff273e240 2024-04-23T18:30:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.817+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94901370164160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff2751c90 con 0x564ff273e240 2024-04-23T18:30:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.818+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94901370164160] v34'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x564ff273e240 2024-04-23T18:30:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.818+0000 7f65737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.818+0000 7f66bf946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:30:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.818+0000 7f66bf946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:30:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.818+0000 7f66bf946800 5 note: GC not initialized 2024-04-23T18:30:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.818+0000 7f65727e4640 20 reqs_thread_entry: start 2024-04-23T18:30:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.818+0000 7f66bf946800 20 init_complete bucket index max shards: 11 2024-04-23T18:30:30.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.818+0000 7f66bf946800 20 Filter name: none 2024-04-23T18:30:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.818+0000 7f64e3fff640 20 reqs_thread_entry: start 2024-04-23T18:30:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.818+0000 7f66bf946800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.818+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff2787d70 con 0x564ff273e240 2024-04-23T18:30:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.819+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f66b8040080 con 0x564ff273e240 2024-04-23T18:30:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.819+0000 7f66bf946800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:30:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.819+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564ff27892c0 con 0x7f66b00bf060 2024-04-23T18:30:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.819+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f66b8040080 con 0x7f66b00bf060 2024-04-23T18:30:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.820+0000 7f65737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.820+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94901370164160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff2753c50 con 0x564ff273e240 2024-04-23T18:30:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.821+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94901370164160] v34'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x564ff273e240 2024-04-23T18:30:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.821+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94901370140768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff27513c0 con 0x564ff27429c0 2024-04-23T18:30:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.822+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94901370140768] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b00d3040 con 0x564ff27429c0 2024-04-23T18:30:30.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.822+0000 7f66bf946800 20 remove_watcher() i=0 2024-04-23T18:30:30.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.822+0000 7f66bf946800 2 removed watcher, disabling cache 2024-04-23T18:30:30.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.822+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94901370144480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff27513c0 con 0x564ff273e240 2024-04-23T18:30:30.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.823+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94901370144480] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x564ff273e240 2024-04-23T18:30:30.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.823+0000 7f66bf946800 20 remove_watcher() i=1 2024-04-23T18:30:30.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.823+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94901370148576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274c6e0 con 0x564ff27475b0 2024-04-23T18:30:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.824+0000 7f66bcc44640 1 -- 172.21.15.119:0/1647767757 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94901370148576] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b4009050 con 0x564ff27475b0 2024-04-23T18:30:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.824+0000 7f66bf946800 20 remove_watcher() i=2 2024-04-23T18:30:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.825+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94901370152256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff27513c0 con 0x564ff27429c0 2024-04-23T18:30:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.826+0000 7f66bd445640 1 -- 172.21.15.119:0/1647767757 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94901370152256] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b00d3040 con 0x564ff27429c0 2024-04-23T18:30:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.826+0000 7f66bf946800 20 remove_watcher() i=3 2024-04-23T18:30:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.826+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94901370155856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274d6e0 con 0x564ff273e240 2024-04-23T18:30:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.827+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94901370155856] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x564ff273e240 2024-04-23T18:30:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.827+0000 7f66bf946800 20 remove_watcher() i=4 2024-04-23T18:30:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.827+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94901370145600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274e540 con 0x7f66b00bf060 2024-04-23T18:30:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.828+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94901370145600] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x7f66b00bf060 2024-04-23T18:30:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.828+0000 7f66bf946800 20 remove_watcher() i=5 2024-04-23T18:30:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.828+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94901370159904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff27513c0 con 0x7f66b00bf060 2024-04-23T18:30:30.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.829+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94901370159904] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x7f66b00bf060 2024-04-23T18:30:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.829+0000 7f66bf946800 20 remove_watcher() i=6 2024-04-23T18:30:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.829+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94901370162144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564ff274f350 con 0x7f66b00bf060 2024-04-23T18:30:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94901370162144] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66b8040080 con 0x7f66b00bf060 2024-04-23T18:30:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 20 remove_watcher() i=7 2024-04-23T18:30:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f66b00bf060 msgr2=0x7f66b0069530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f66b00bf060 0x7f66b0069530 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ff273e240 msgr2=0x564ff2740700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ff273e240 0x564ff2740700 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ff27429c0 msgr2=0x564ff2744db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ff27429c0 0x564ff2744db0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564ff27475b0 msgr2=0x564ff2749a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564ff27475b0 0x564ff2749a70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6588036e60 msgr2=0x7f6588039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6588036e60 0x7f6588039320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f66b4001b60 tx=0x7f66b4010000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff272b760 msgr2=0x564ff2732b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 --2- 172.21.15.119:0/1647767757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff272b760 0x564ff2732b60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f66b006e470 tx=0x7f66b0087f60 comp rx=0 tx=0).stop 2024-04-23T18:30:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 reap_dead start 2024-04-23T18:30:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bdc46640 1 -- 172.21.15.119:0/1647767757 reap_dead start 2024-04-23T18:30:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 shutdown_connections 2024-04-23T18:30:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 >> 172.21.15.119:0/1647767757 conn(0x564ff2727ac0 msgr2=0x564ff2725120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 shutdown_connections 2024-04-23T18:30:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/1647767757 wait complete. 2024-04-23T18:30:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/621425299 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6594036e60 msgr2=0x7f6594039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 --2- 172.21.15.119:0/621425299 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6594036e60 0x7f6594039320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f66b400bf50 tx=0x7f66b400f000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/621425299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff271e640 msgr2=0x564ff271ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 --2- 172.21.15.119:0/621425299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff271e640 0x564ff271ea60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f66b008cc20 tx=0x7f66b0072de0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/621425299 shutdown_connections 2024-04-23T18:30:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 --2- 172.21.15.119:0/621425299 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f6594036e60 0x7f6594039320 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 --2- 172.21.15.119:0/621425299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff271e640 0x564ff271ea60 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/621425299 >> 172.21.15.119:0/621425299 conn(0x564ff27126e0 msgr2=0x564ff2712ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/621425299 shutdown_connections 2024-04-23T18:30:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.830+0000 7f66bf946800 1 -- 172.21.15.119:0/621425299 wait complete. 2024-04-23T18:30:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564ff270d630 msgr2=0x564ff270fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564ff270d630 0x564ff270fa80 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ff2604230 msgr2=0x564ff2706e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564ff2604230 0x564ff2706e40 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ff27096f0 msgr2=0x564ff270bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564ff27096f0 0x564ff270bae0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f65a4036e60 msgr2=0x7f65a4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f65a4036e60 0x7f65a4039320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f66b4000f60 tx=0x7f66b40012b0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 msgr2=0x564ff26ffdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 --2- 172.21.15.119:0/2856541426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564ff26038d0 0x564ff26ffdd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f66b001ce60 tx=0x7f66b0002fb0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bdc46640 1 -- 172.21.15.119:0/2856541426 reap_dead start 2024-04-23T18:30:30.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 shutdown_connections 2024-04-23T18:30:30.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 >> 172.21.15.119:0/2856541426 conn(0x564ff25ff430 msgr2=0x564ff26f26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 shutdown_connections 2024-04-23T18:30:30.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.831+0000 7f66bf946800 1 -- 172.21.15.119:0/2856541426 wait complete. 2024-04-23T18:30:30.834 INFO:teuthology.orchestra.run.smithi119.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-04-23T18:00:00.000000Z","epoch":1713895200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-04-23T18:30:30.834 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:30:30.834 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-23T18:30:30.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-23T18:30:30.835 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-04-23T18:30:30.884 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:30:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:30:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.893+0000 7f516c92b800 1 Processor -- start 2024-04-23T18:30:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.893+0000 7f516c92b800 1 -- start start 2024-04-23T18:30:30.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.893+0000 7f516c92b800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55766a68f400 0x55766a697f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.893+0000 7f516c92b800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55766a53f560 con 0x55766a68d8c0 2024-04-23T18:30:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.893+0000 7f516c92b800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55766a530e20 con 0x55766a68f400 2024-04-23T18:30:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.893+0000 7f5167d51640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55766a68f400 0x55766a697f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.893+0000 7f5168552640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55766a68d8c0 0x55766a68dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:39372/0 (socket says 172.21.15.119:39372) 2024-04-23T18:30:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.893+0000 7f5168552640 1 -- 172.21.15.119:0/1320117765 learned_addr learned my addr 172.21.15.119:0/1320117765 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:30:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.894+0000 7f5167d51640 1 -- 172.21.15.119:0/1320117765 >> v1:172.21.15.62:6789/0 conn(0x55766a68d8c0 legacy=0x55766a68dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.894+0000 7f5167d51640 1 -- 172.21.15.119:0/1320117765 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55766a53ee60 con 0x55766a68f400 2024-04-23T18:30:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.896+0000 7f5167d51640 1 --2- 172.21.15.119:0/1320117765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68f400 0x55766a697f00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f515c00a470 tx=0x7f515c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c3c408cde9ba27 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.896+0000 7f5167550640 1 -- 172.21.15.119:0/1320117765 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f515c057070 con 0x55766a68f400 2024-04-23T18:30:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.896+0000 7f5167550640 1 -- 172.21.15.119:0/1320117765 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f515c04adc0 con 0x55766a68f400 2024-04-23T18:30:30.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.896+0000 7f5167550640 1 -- 172.21.15.119:0/1320117765 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f515c052590 con 0x55766a68f400 2024-04-23T18:30:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.896+0000 7f516c92b800 1 -- 172.21.15.119:0/1320117765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68f400 msgr2=0x55766a697f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.896+0000 7f516c92b800 1 --2- 172.21.15.119:0/1320117765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68f400 0x55766a697f00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f515c00a470 tx=0x7f515c01ce90 comp rx=0 tx=0).stop 2024-04-23T18:30:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.896+0000 7f516c92b800 1 -- 172.21.15.119:0/1320117765 shutdown_connections 2024-04-23T18:30:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.896+0000 7f516c92b800 1 --2- 172.21.15.119:0/1320117765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68f400 0x55766a697f00 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.896+0000 7f516c92b800 1 -- 172.21.15.119:0/1320117765 >> 172.21.15.119:0/1320117765 conn(0x55766a689460 msgr2=0x55766a68b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.896+0000 7f516c92b800 1 -- 172.21.15.119:0/1320117765 shutdown_connections 2024-04-23T18:30:30.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.896+0000 7f516c92b800 1 -- 172.21.15.119:0/1320117765 wait complete. 2024-04-23T18:30:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.908+0000 7f516c92b800 1 Processor -- start 2024-04-23T18:30:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.908+0000 7f516c92b800 1 -- start start 2024-04-23T18:30:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.908+0000 7f516c92b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68d8c0 0x55766a782780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.908+0000 7f516c92b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55766a5da600 con 0x55766a68d8c0 2024-04-23T18:30:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.908+0000 7f5168552640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68d8c0 0x55766a782780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.908+0000 7f5168552640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68d8c0 0x55766a782780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36234/0 (socket says 172.21.15.119:36234) 2024-04-23T18:30:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.908+0000 7f5168552640 1 -- 172.21.15.119:0/2867627197 learned_addr learned my addr 172.21.15.119:0/2867627197 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.909+0000 7f5168552640 1 -- 172.21.15.119:0/2867627197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55766a550860 con 0x55766a68d8c0 2024-04-23T18:30:30.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.909+0000 7f5168552640 1 --2- 172.21.15.119:0/2867627197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68d8c0 0x55766a782780 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5158001d50 tx=0x7f515800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529f914809793229 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.909+0000 7f505660c640 1 -- 172.21.15.119:0/2867627197 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5158013030 con 0x55766a68d8c0 2024-04-23T18:30:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.909+0000 7f505660c640 1 -- 172.21.15.119:0/2867627197 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f515800e470 con 0x55766a68d8c0 2024-04-23T18:30:30.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.909+0000 7f505660c640 1 -- 172.21.15.119:0/2867627197 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f515800e810 con 0x55766a68d8c0 2024-04-23T18:30:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.910+0000 7f516c92b800 1 -- 172.21.15.119:0/2867627197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68d8c0 msgr2=0x55766a782780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.910+0000 7f516c92b800 1 --2- 172.21.15.119:0/2867627197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68d8c0 0x55766a782780 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5158001d50 tx=0x7f515800b6c0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.910+0000 7f516c92b800 1 -- 172.21.15.119:0/2867627197 shutdown_connections 2024-04-23T18:30:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.910+0000 7f516c92b800 1 --2- 172.21.15.119:0/2867627197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68d8c0 0x55766a782780 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.910+0000 7f516c92b800 1 -- 172.21.15.119:0/2867627197 >> 172.21.15.119:0/2867627197 conn(0x55766a689460 msgr2=0x55766a77e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.910+0000 7f516c92b800 1 -- 172.21.15.119:0/2867627197 shutdown_connections 2024-04-23T18:30:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.910+0000 7f516c92b800 1 -- 172.21.15.119:0/2867627197 wait complete. 2024-04-23T18:30:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.910+0000 7f516c92b800 1 Processor -- start 2024-04-23T18:30:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.910+0000 7f516c92b800 1 -- start start 2024-04-23T18:30:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.910+0000 7f516c92b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68d8c0 0x55766a78a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.910+0000 7f516c92b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55766a69a720 con 0x55766a68d8c0 2024-04-23T18:30:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.910+0000 7f5168552640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68d8c0 0x55766a78a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.911+0000 7f5168552640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68d8c0 0x55766a78a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36236/0 (socket says 172.21.15.119:36236) 2024-04-23T18:30:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.911+0000 7f5168552640 1 -- 172.21.15.119:0/1793552070 learned_addr learned my addr 172.21.15.119:0/1793552070 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.911+0000 7f5168552640 1 -- 172.21.15.119:0/1793552070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55766a54eeb0 con 0x55766a68d8c0 2024-04-23T18:30:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.911+0000 7f5168552640 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68d8c0 0x55766a78a150 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5158004000 tx=0x7f5158000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.911+0000 7f5054e09640 1 -- 172.21.15.119:0/1793552070 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5158027070 con 0x55766a68d8c0 2024-04-23T18:30:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.911+0000 7f5054e09640 1 -- 172.21.15.119:0/1793552070 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51580013d0 con 0x55766a68d8c0 2024-04-23T18:30:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.911+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55766a78a690 con 0x55766a68d8c0 2024-04-23T18:30:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.911+0000 7f5054e09640 1 -- 172.21.15.119:0/1793552070 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5158019ac0 con 0x55766a68d8c0 2024-04-23T18:30:30.906 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.911+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55766a78abb0 con 0x55766a68d8c0 2024-04-23T18:30:30.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.912+0000 7f5054e09640 1 -- 172.21.15.119:0/1793552070 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f515802a070 con 0x55766a68d8c0 2024-04-23T18:30:30.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.912+0000 7f5054e09640 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5050036e60 0x7f5050039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.912+0000 7f5054e09640 1 -- 172.21.15.119:0/1793552070 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f515801f070 con 0x55766a68d8c0 2024-04-23T18:30:30.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.912+0000 7f5167d51640 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5050036e60 0x7f5050039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.912+0000 7f516c92b800 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55766a68f400 0x55766a791170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.912+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7916f0 con 0x55766a68f400 2024-04-23T18:30:30.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.913+0000 7f5168d53640 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55766a68f400 0x55766a791170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.913+0000 7f5167d51640 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5050036e60 0x7f5050039320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f515c054000 tx=0x7f515c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.913+0000 7f5168d53640 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55766a68f400 0x55766a791170 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.913+0000 7f5168d53640 1 -- 172.21.15.119:0/1793552070 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a68f400 2024-04-23T18:30:30.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.913+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a78e740 con 0x55766a68f400 2024-04-23T18:30:30.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.913+0000 7f5168d53640 1 -- 172.21.15.119:0/1793552070 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a68f400 2024-04-23T18:30:30.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.913+0000 7f516c92b800 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55766a793a40 0x55766a795e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.913+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a796520 con 0x55766a793a40 2024-04-23T18:30:30.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.914+0000 7f5168552640 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55766a793a40 0x55766a795e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.914+0000 7f5168552640 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55766a793a40 0x55766a795e30 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.914+0000 7f5168552640 1 -- 172.21.15.119:0/1793552070 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5158029030 con 0x55766a793a40 2024-04-23T18:30:30.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.914+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7929f0 con 0x55766a68f400 2024-04-23T18:30:30.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.914+0000 7f5168d53640 1 -- 172.21.15.119:0/1793552070 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a68f400 2024-04-23T18:30:30.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.915+0000 7f516c92b800 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55766a7979d0 0x55766a799e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.915+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a79a580 con 0x55766a7979d0 2024-04-23T18:30:30.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.915+0000 7f5167d51640 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55766a7979d0 0x55766a799e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.915+0000 7f5167d51640 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55766a7979d0 0x55766a799e20 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.916+0000 7f5167d51640 1 -- 172.21.15.119:0/1793552070 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f515c05a040 con 0x55766a7979d0 2024-04-23T18:30:30.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.916+0000 7f516c92b800 1 Processor -- start 2024-04-23T18:30:30.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.916+0000 7f516c92b800 1 -- start start 2024-04-23T18:30:30.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.916+0000 7f516c92b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7a89e0 0x55766a7a8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.916+0000 7f516c92b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55766a580df0 con 0x55766a7a89e0 2024-04-23T18:30:30.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.916+0000 7f5168552640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7a89e0 0x55766a7a8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.916+0000 7f5168552640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7a89e0 0x55766a7a8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36252/0 (socket says 172.21.15.119:36252) 2024-04-23T18:30:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.916+0000 7f5168552640 1 -- 172.21.15.119:0/461082234 learned_addr learned my addr 172.21.15.119:0/461082234 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.917+0000 7f5168552640 1 -- 172.21.15.119:0/461082234 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55766a7a9340 con 0x55766a7a89e0 2024-04-23T18:30:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.917+0000 7f5168552640 1 --2- 172.21.15.119:0/461082234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7a89e0 0x55766a7a8e00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f515804b170 tx=0x7f5158048380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.917+0000 7f504dffb640 1 -- 172.21.15.119:0/461082234 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f515802a790 con 0x55766a7a89e0 2024-04-23T18:30:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.917+0000 7f504dffb640 1 -- 172.21.15.119:0/461082234 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f515802a930 con 0x55766a7a89e0 2024-04-23T18:30:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.917+0000 7f516c92b800 1 -- 172.21.15.119:0/461082234 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55766a7a9db0 con 0x55766a7a89e0 2024-04-23T18:30:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.917+0000 7f504dffb640 1 -- 172.21.15.119:0/461082234 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f515802ac10 con 0x55766a7a89e0 2024-04-23T18:30:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.917+0000 7f516c92b800 1 -- 172.21.15.119:0/461082234 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55766a7aa2b0 con 0x55766a7a89e0 2024-04-23T18:30:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.918+0000 7f504dffb640 1 -- 172.21.15.119:0/461082234 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5158016070 con 0x55766a7a89e0 2024-04-23T18:30:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.918+0000 7f504dffb640 1 --2- 172.21.15.119:0/461082234 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5040036eb0 0x7f5040039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.918+0000 7f504dffb640 1 -- 172.21.15.119:0/461082234 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f5158014070 con 0x55766a7a89e0 2024-04-23T18:30:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.918+0000 7f5167d51640 1 --2- 172.21.15.119:0/461082234 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5040036eb0 0x7f5040039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.918+0000 7f516c92b800 1 Processor -- start 2024-04-23T18:30:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.918+0000 7f516c92b800 1 -- start start 2024-04-23T18:30:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.918+0000 7f5167d51640 1 --2- 172.21.15.119:0/461082234 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5040036eb0 0x7f5040039370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55766a791ff0 tx=0x7f515c005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.918+0000 7f516c92b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7b5c00 0x55766a7b6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.918+0000 7f516c92b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55766a782f00 con 0x55766a7b5c00 2024-04-23T18:30:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.919+0000 7f5168552640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7b5c00 0x55766a7b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.919+0000 7f5168552640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7b5c00 0x55766a7b6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36266/0 (socket says 172.21.15.119:36266) 2024-04-23T18:30:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.919+0000 7f5168552640 1 -- 172.21.15.119:0/3105999611 learned_addr learned my addr 172.21.15.119:0/3105999611 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.919+0000 7f5168552640 1 -- 172.21.15.119:0/3105999611 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55766a7b65f0 con 0x55766a7b5c00 2024-04-23T18:30:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.919+0000 7f5168552640 1 --2- 172.21.15.119:0/3105999611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7b5c00 0x55766a7b6020 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f515804cd40 tx=0x7f515800b240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73cb0dff60dd8960 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.919+0000 7f50477fe640 1 -- 172.21.15.119:0/3105999611 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5158044030 con 0x55766a7b5c00 2024-04-23T18:30:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.919+0000 7f50477fe640 1 -- 172.21.15.119:0/3105999611 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5158037420 con 0x55766a7b5c00 2024-04-23T18:30:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.919+0000 7f50477fe640 1 -- 172.21.15.119:0/3105999611 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f515804e070 con 0x55766a7b5c00 2024-04-23T18:30:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f516c92b800 1 -- 172.21.15.119:0/3105999611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7b5c00 msgr2=0x55766a7b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f516c92b800 1 --2- 172.21.15.119:0/3105999611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7b5c00 0x55766a7b6020 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f515804cd40 tx=0x7f515800b240 comp rx=0 tx=0).stop 2024-04-23T18:30:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f516c92b800 1 -- 172.21.15.119:0/3105999611 shutdown_connections 2024-04-23T18:30:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f516c92b800 1 --2- 172.21.15.119:0/3105999611 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7b5c00 0x55766a7b6020 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f516c92b800 1 -- 172.21.15.119:0/3105999611 >> 172.21.15.119:0/3105999611 conn(0x55766a7b1e80 msgr2=0x55766a7afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f516c92b800 1 -- 172.21.15.119:0/3105999611 shutdown_connections 2024-04-23T18:30:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f516c92b800 1 -- 172.21.15.119:0/3105999611 wait complete. 2024-04-23T18:30:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f516c92b800 1 Processor -- start 2024-04-23T18:30:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f516c92b800 1 -- start start 2024-04-23T18:30:30.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f516c92b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7b5c00 0x55766a7bcf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f516c92b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55766a7b6c60 con 0x55766a7b5c00 2024-04-23T18:30:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f5168552640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7b5c00 0x55766a7bcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f5168552640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7b5c00 0x55766a7bcf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36270/0 (socket says 172.21.15.119:36270) 2024-04-23T18:30:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.920+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 learned_addr learned my addr 172.21.15.119:0/3163722387 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.921+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55766a7bd480 con 0x55766a7b5c00 2024-04-23T18:30:30.919 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.921+0000 7f5168552640 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7b5c00 0x55766a7bcf40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f515800d010 tx=0x7f5158031f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.921+0000 7f5045ffb640 1 -- 172.21.15.119:0/3163722387 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f515804c2c0 con 0x55766a7b5c00 2024-04-23T18:30:30.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.921+0000 7f5045ffb640 1 -- 172.21.15.119:0/3163722387 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5158066070 con 0x55766a7b5c00 2024-04-23T18:30:30.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.921+0000 7f5045ffb640 1 -- 172.21.15.119:0/3163722387 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f515802c9a0 con 0x55766a7b5c00 2024-04-23T18:30:30.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.921+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55766a7bd480 con 0x55766a7b5c00 2024-04-23T18:30:30.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.921+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55766a7bd480 con 0x55766a7b5c00 2024-04-23T18:30:30.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.922+0000 7f5045ffb640 1 -- 172.21.15.119:0/3163722387 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f515802cc00 con 0x55766a7b5c00 2024-04-23T18:30:30.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.922+0000 7f5045ffb640 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5038036e60 0x7f5038039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.922+0000 7f5045ffb640 1 -- 172.21.15.119:0/3163722387 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f515806cd80 con 0x55766a7b5c00 2024-04-23T18:30:30.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.922+0000 7f5167d51640 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5038036e60 0x7f5038039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.923+0000 7f5167d51640 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5038036e60 0x7f5038039320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55766a79a980 tx=0x7f515c060040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.923+0000 7f516c92b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.923+0000 7f516c92b800 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55766a7c86d0 0x55766a7cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.923+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cb2e0 con 0x55766a7c86d0 2024-04-23T18:30:30.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.923+0000 7f5168d53640 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55766a7c86d0 0x55766a7cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.923+0000 7f5168d53640 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55766a7c86d0 0x55766a7cab90 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.923+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a7c86d0 2024-04-23T18:30:30.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 20 realm 2024-04-23T18:30:30.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cb6f0 con 0x55766a7c86d0 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a7c86d0 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cbfc0 con 0x55766a7c86d0 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a7c86d0 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7c86d0 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a7c86d0 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.936 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55766a7cd0c0 0x55766a7cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cfac0 con 0x55766a7cd0c0 2024-04-23T18:30:30.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.924+0000 7f5168552640 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55766a7cd0c0 0x55766a7cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.925+0000 7f5168552640 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55766a7cd0c0 0x55766a7cf4b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.925+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f515803d070 con 0x55766a7cd0c0 2024-04-23T18:30:30.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.925+0000 7f516c92b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:30:30.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.925+0000 7f516c92b800 20 searching for the correct realm 2024-04-23T18:30:30.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.925+0000 7f516c92b800 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55766a7d1a50 0x55766a7d3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.925+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d45e0 con 0x55766a7d1a50 2024-04-23T18:30:30.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.925+0000 7f5167d51640 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55766a7d1a50 0x55766a7d3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.925+0000 7f5167d51640 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55766a7d1a50 0x55766a7d3f10 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.926+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.926+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d45e0 con 0x55766a7cd0c0 2024-04-23T18:30:30.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.926+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515803d070 con 0x55766a7cd0c0 2024-04-23T18:30:30.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.926+0000 7f5168552640 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5158061050 0x7f5158048980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:30.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.926+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d45e0 con 0x7f5158061050 2024-04-23T18:30:30.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.926+0000 7f5168d53640 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5158061050 0x7f5158048980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:30.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.927+0000 7f5168d53640 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5158061050 0x7f5158048980 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:30.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.927+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516000a4a0 con 0x7f5158061050 2024-04-23T18:30:30.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.927+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7c86d0 2024-04-23T18:30:30.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.927+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a7c86d0 2024-04-23T18:30:30.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.927+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7c86d0 2024-04-23T18:30:30.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.927+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a7c86d0 2024-04-23T18:30:30.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.927+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x7f5158061050 2024-04-23T18:30:30.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.928+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516000a4a0 con 0x7f5158061050 2024-04-23T18:30:30.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.928+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x7f5158061050 2024-04-23T18:30:30.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.928+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f516000a4a0 con 0x7f5158061050 2024-04-23T18:30:30.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.928+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7cd0c0 2024-04-23T18:30:30.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.928+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515803d070 con 0x55766a7cd0c0 2024-04-23T18:30:30.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.928+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7d1a50 2024-04-23T18:30:30.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.928+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.928+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7c86d0 2024-04-23T18:30:30.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.929+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a7c86d0 2024-04-23T18:30:30.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.929+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x7f5158061050 2024-04-23T18:30:30.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.929+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516000a4a0 con 0x7f5158061050 2024-04-23T18:30:30.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.929+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7c86d0 2024-04-23T18:30:30.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.929+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a7c86d0 2024-04-23T18:30:30.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.929+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7cd0c0 2024-04-23T18:30:30.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.929+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f515803d070 con 0x55766a7cd0c0 2024-04-23T18:30:30.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.929+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7d1a50 2024-04-23T18:30:30.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.930+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.930+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7d1a50 2024-04-23T18:30:30.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.930+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.930+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x7f5158061050 2024-04-23T18:30:30.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.930+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516000a4a0 con 0x7f5158061050 2024-04-23T18:30:30.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.930+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7d1a50 2024-04-23T18:30:30.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.930+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.930+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7d1a50 2024-04-23T18:30:30.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.931+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.931+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7c86d0 2024-04-23T18:30:30.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.931+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a7c86d0 2024-04-23T18:30:30.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.931+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7c86d0 2024-04-23T18:30:30.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.931+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a7c86d0 2024-04-23T18:30:30.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.931+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x7f5158061050 2024-04-23T18:30:30.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.931+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516000a4a0 con 0x7f5158061050 2024-04-23T18:30:30.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.931+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7d1a50 2024-04-23T18:30:30.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.932+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.932+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7cd0c0 2024-04-23T18:30:30.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.932+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f515803d070 con 0x55766a7cd0c0 2024-04-23T18:30:30.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.932+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7c86d0 2024-04-23T18:30:30.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.932+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516000a4a0 con 0x55766a7c86d0 2024-04-23T18:30:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.932+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7cd0c0 2024-04-23T18:30:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.932+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515803d070 con 0x55766a7cd0c0 2024-04-23T18:30:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.932+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7d1a50 2024-04-23T18:30:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.933+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.933+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x7f5158061050 2024-04-23T18:30:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.933+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516000a4a0 con 0x7f5158061050 2024-04-23T18:30:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.933+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7cd0c0 2024-04-23T18:30:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.933+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5158088040 con 0x55766a7cd0c0 2024-04-23T18:30:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.933+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7d1a50 2024-04-23T18:30:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.934+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.934+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x7f5158061050 2024-04-23T18:30:30.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.934+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516000a4a0 con 0x7f5158061050 2024-04-23T18:30:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.934+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7c86d0 2024-04-23T18:30:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.934+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.934+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55766a7cc360 con 0x55766a7cd0c0 2024-04-23T18:30:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5158088040 con 0x55766a7cd0c0 2024-04-23T18:30:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:30:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:30:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:30:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:30:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:30:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:30:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d0380 con 0x55766a7c86d0 2024-04-23T18:30:30.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d0770 con 0x55766a7c86d0 2024-04-23T18:30:30.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:30.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.935+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d0770 con 0x7f5158061050 2024-04-23T18:30:30.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:30:30.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 20 zone default found 2024-04-23T18:30:30.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 4 Realm: () 2024-04-23T18:30:30.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:30:30.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:30:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:30:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 20 zonegroup default 2024-04-23T18:30:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d4a60 con 0x55766a7cd0c0 2024-04-23T18:30:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5158088040 con 0x55766a7cd0c0 2024-04-23T18:30:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d67e0 con 0x55766a7d1a50 2024-04-23T18:30:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d6b80 con 0x55766a7d1a50 2024-04-23T18:30:30.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 20 started sync module instance, tier type = 2024-04-23T18:30:30.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:30:30.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.936+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d5c80 con 0x55766a7cd0c0 2024-04-23T18:30:30.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.937+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5158088040 con 0x55766a7cd0c0 2024-04-23T18:30:30.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.938+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93967081101264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d6f20 con 0x55766a7cd0c0 2024-04-23T18:30:30.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.938+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d77d0 con 0x55766a7c86d0 2024-04-23T18:30:30.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.939+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93967081101264] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5158088040 con 0x55766a7cd0c0 2024-04-23T18:30:30.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.939+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.939+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93967081103472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d73d0 con 0x55766a7c86d0 2024-04-23T18:30:30.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.939+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d8270 con 0x55766a7d1a50 2024-04-23T18:30:30.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.940+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93967081103472] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.940+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.940+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93967081107232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d7340 con 0x55766a7d1a50 2024-04-23T18:30:30.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.940+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d9160 con 0x55766a7cd0c0 2024-04-23T18:30:30.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.941+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93967081107232] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.941+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5158088040 con 0x55766a7cd0c0 2024-04-23T18:30:30.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.941+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93967081114800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d90d0 con 0x55766a7cd0c0 2024-04-23T18:30:30.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.941+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7da020 con 0x55766a7c86d0 2024-04-23T18:30:30.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.942+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93967081114800] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5158088040 con 0x55766a7cd0c0 2024-04-23T18:30:30.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.942+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.942+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93967081117008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7da020 con 0x55766a7c86d0 2024-04-23T18:30:30.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.943+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7da9e0 con 0x7f5158061050 2024-04-23T18:30:30.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.944+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.944+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93967081121072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7da950 con 0x7f5158061050 2024-04-23T18:30:30.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.944+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7db950 con 0x7f5158061050 2024-04-23T18:30:30.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.944+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93967081117008] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.945+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93967081121072] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.945+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.945+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93967081118576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7db4a0 con 0x7f5158061050 2024-04-23T18:30:30.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.945+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7dbe60 con 0x7f5158061050 2024-04-23T18:30:30.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.946+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(58 notify.7 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.946+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93967081118576] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.946+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93967081126320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7dc280 con 0x7f5158061050 2024-04-23T18:30:30.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.946+0000 7f516c92b800 20 add_watcher() i=0 2024-04-23T18:30:30.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.946+0000 7f516c92b800 20 add_watcher() i=1 2024-04-23T18:30:30.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.946+0000 7f516c92b800 20 add_watcher() i=2 2024-04-23T18:30:30.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.946+0000 7f516c92b800 20 add_watcher() i=3 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.946+0000 7f516c92b800 20 add_watcher() i=4 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.946+0000 7f516c92b800 20 add_watcher() i=5 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.946+0000 7f516c92b800 20 add_watcher() i=6 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.947+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93967081126320] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.947+0000 7f516c92b800 20 add_watcher() i=7 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.947+0000 7f516c92b800 2 all 8 watchers are set, enabling cache 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.947+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a7dc280 con 0x55766a7c86d0 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.947+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.947+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93967081127376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7dc230 con 0x55766a7c86d0 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.948+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93967081127376] v34'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.948+0000 7f501e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.948+0000 7f516c92b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.948+0000 7f516c92b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:30:30.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.949+0000 7f516c92b800 5 note: GC not initialized 2024-04-23T18:30:30.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.949+0000 7f501d7e2640 20 reqs_thread_entry: start 2024-04-23T18:30:30.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.949+0000 7f516c92b800 20 init_complete bucket index max shards: 11 2024-04-23T18:30:30.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.949+0000 7f516c92b800 20 Filter name: none 2024-04-23T18:30:30.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.949+0000 7f4f8effd640 20 reqs_thread_entry: start 2024-04-23T18:30:30.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.949+0000 7f516c92b800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-23T18:30:30.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.949+0000 7f516c92b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.949+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a812a60 con 0x7f5158061050 2024-04-23T18:30:30.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.949+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.950+0000 7f516c92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.950+0000 7f516c92b800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-23T18:30:30.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.950+0000 7f516c92b800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-23T18:30:30.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.950+0000 7f516c92b800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-04-23T18:30:30.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.950+0000 7f516c92b800 20 rados->read ofs=0 len=0 2024-04-23T18:30:30.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.950+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a8110a0 con 0x55766a7c86d0 2024-04-23T18:30:30.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.950+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.950+0000 7f516c92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:30.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.950+0000 7f516c92b800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-04-23T18:30:30.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.950+0000 7f516c92b800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-23T18:30:30.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.950+0000 7f516c92b800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-23T18:30:30.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.950+0000 7f516c92b800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-23T18:30:30.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.950+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a811970 con 0x7f5158061050 2024-04-23T18:30:30.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.951+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.951+0000 7f516c92b800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-23T18:30:30.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.951+0000 7f516c92b800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-23T18:30:30.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.951+0000 7f516c92b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-23T18:30:30.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.951+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 93967081346240 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a816500 con 0x7f5158061050 2024-04-23T18:30:30.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.951+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== watch-notify(notify (1) cookie 93967081126320 notify 146028888095 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55766a811d10 con 0x7f5158061050 2024-04-23T18:30:30.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.951+0000 7f50477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 93967081126320 notifier 4721 bl.length()=556 2024-04-23T18:30:30.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.951+0000 7f50477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-23T18:30:30.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.951+0000 7f50477fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-23T18:30:30.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.951+0000 7f50477fe640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f502c003ea0 con 0x7f5158061050 2024-04-23T18:30:30.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.951+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(65 notify.7 [notify cookie 93967081346240 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.952+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.952+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== watch-notify(notify_complete (2) cookie 93967081346240 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55766a8124b0 con 0x7f5158061050 2024-04-23T18:30:30.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.952+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a811470 con 0x55766a7c86d0 2024-04-23T18:30:30.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.953+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.953+0000 7f516c92b800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-23T18:30:30.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.953+0000 7f516c92b800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-23T18:30:30.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.953+0000 7f516c92b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-23T18:30:30.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.953+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93967081346160 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55766a816500 con 0x7f5158061050 2024-04-23T18:30:30.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.953+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== watch-notify(notify (1) cookie 93967081121072 notify 146028888096 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55766a8124b0 con 0x7f5158061050 2024-04-23T18:30:30.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.953+0000 7f5046ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888096 cookie 93967081121072 notifier 4721 bl.length()=177 2024-04-23T18:30:30.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.953+0000 7f5046ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-23T18:30:30.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.953+0000 7f5046ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-23T18:30:30.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.953+0000 7f5046ffd640 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4f9c003400 con 0x7f5158061050 2024-04-23T18:30:30.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.953+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(68 notify.5 [notify cookie 93967081346160 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.954+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== watch-notify(notify_complete (2) cookie 93967081346160 notify 146028888096 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5160005320 con 0x7f5158061050 2024-04-23T18:30:30.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.954+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.959 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-23T18:30:30.951195Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:30:30.951182Z","tags":[],"group_ids":[]} 2024-04-23T18:30:30.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.954+0000 7f501e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:30.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.954+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93967081127376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7c4b00 con 0x55766a7c86d0 2024-04-23T18:30:30.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.955+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93967081127376] v34'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.955+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93967081101264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7dbdd0 con 0x55766a7cd0c0 2024-04-23T18:30:30.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.956+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93967081101264] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5158088040 con 0x55766a7cd0c0 2024-04-23T18:30:30.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.956+0000 7f516c92b800 20 remove_watcher() i=0 2024-04-23T18:30:30.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.956+0000 7f516c92b800 2 removed watcher, disabling cache 2024-04-23T18:30:30.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.956+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93967081103472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7dbdd0 con 0x55766a7c86d0 2024-04-23T18:30:30.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.957+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93967081103472] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.958+0000 7f516c92b800 20 remove_watcher() i=1 2024-04-23T18:30:30.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.958+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93967081107232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7dbdd0 con 0x55766a7d1a50 2024-04-23T18:30:30.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.959+0000 7f5167d51640 1 -- 172.21.15.119:0/3163722387 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93967081107232] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f515c070070 con 0x55766a7d1a50 2024-04-23T18:30:30.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.959+0000 7f516c92b800 20 remove_watcher() i=2 2024-04-23T18:30:30.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.959+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93967081114800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d6f20 con 0x55766a7cd0c0 2024-04-23T18:30:30.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.960+0000 7f5168552640 1 -- 172.21.15.119:0/3163722387 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93967081114800] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5158088040 con 0x55766a7cd0c0 2024-04-23T18:30:30.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.960+0000 7f516c92b800 20 remove_watcher() i=3 2024-04-23T18:30:30.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.960+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93967081117008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d8cb0 con 0x55766a7c86d0 2024-04-23T18:30:30.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.961+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93967081117008] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x55766a7c86d0 2024-04-23T18:30:30.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.961+0000 7f516c92b800 20 remove_watcher() i=4 2024-04-23T18:30:30.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.961+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93967081121072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d6f20 con 0x7f5158061050 2024-04-23T18:30:30.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.962+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93967081121072] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.962+0000 7f516c92b800 20 remove_watcher() i=5 2024-04-23T18:30:30.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.962+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93967081118576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d9550 con 0x7f5158061050 2024-04-23T18:30:30.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.963+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93967081118576] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.963+0000 7f516c92b800 20 remove_watcher() i=6 2024-04-23T18:30:30.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.963+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93967081126320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55766a7d8cb0 con 0x7f5158061050 2024-04-23T18:30:30.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93967081126320] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5160040080 con 0x7f5158061050 2024-04-23T18:30:30.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 20 remove_watcher() i=7 2024-04-23T18:30:30.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5158061050 msgr2=0x7f5158048980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f5158061050 0x7f5158048980 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55766a7c86d0 msgr2=0x55766a7cab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55766a7c86d0 0x55766a7cab90 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55766a7cd0c0 msgr2=0x55766a7cf4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55766a7cd0c0 0x55766a7cf4b0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55766a7d1a50 msgr2=0x55766a7d3f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55766a7d1a50 0x55766a7d3f10 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5038036e60 msgr2=0x7f5038039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5038036e60 0x7f5038039320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55766a79a980 tx=0x7f515c060040 comp rx=0 tx=0).stop 2024-04-23T18:30:30.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7b5c00 msgr2=0x55766a7bcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 --2- 172.21.15.119:0/3163722387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7b5c00 0x55766a7bcf40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f515800d010 tx=0x7f5158031f60 comp rx=0 tx=0).stop 2024-04-23T18:30:30.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 reap_dead start 2024-04-23T18:30:30.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f5168d53640 1 -- 172.21.15.119:0/3163722387 reap_dead start 2024-04-23T18:30:30.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 shutdown_connections 2024-04-23T18:30:30.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 >> 172.21.15.119:0/3163722387 conn(0x55766a7b1e80 msgr2=0x55766a7af4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 shutdown_connections 2024-04-23T18:30:30.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/3163722387 wait complete. 2024-04-23T18:30:30.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/461082234 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5040036eb0 msgr2=0x7f5040039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 --2- 172.21.15.119:0/461082234 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5040036eb0 0x7f5040039370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55766a791ff0 tx=0x7f515c005a00 comp rx=0 tx=0).stop 2024-04-23T18:30:30.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/461082234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7a89e0 msgr2=0x55766a7a8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 --2- 172.21.15.119:0/461082234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7a89e0 0x55766a7a8e00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f515804b170 tx=0x7f5158048380 comp rx=0 tx=0).stop 2024-04-23T18:30:30.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/461082234 shutdown_connections 2024-04-23T18:30:30.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 --2- 172.21.15.119:0/461082234 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5040036eb0 0x7f5040039370 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.969 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 --2- 172.21.15.119:0/461082234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a7a89e0 0x55766a7a8e00 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/461082234 >> 172.21.15.119:0/461082234 conn(0x55766a79ca80 msgr2=0x55766a79ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/461082234 shutdown_connections 2024-04-23T18:30:30.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.964+0000 7f516c92b800 1 -- 172.21.15.119:0/461082234 wait complete. 2024-04-23T18:30:30.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55766a7979d0 msgr2=0x55766a799e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55766a7979d0 0x55766a799e20 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55766a68f400 msgr2=0x55766a791170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55766a68f400 0x55766a791170 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55766a793a40 msgr2=0x55766a795e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55766a793a40 0x55766a795e30 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5050036e60 msgr2=0x7f5050039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5050036e60 0x7f5050039320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f515c054000 tx=0x7f515c04e000 comp rx=0 tx=0).stop 2024-04-23T18:30:30.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68d8c0 msgr2=0x55766a78a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:30.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 --2- 172.21.15.119:0/1793552070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55766a68d8c0 0x55766a78a150 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5158004000 tx=0x7f5158000bc0 comp rx=0 tx=0).stop 2024-04-23T18:30:30.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f5168d53640 1 -- 172.21.15.119:0/1793552070 reap_dead start 2024-04-23T18:30:30.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 shutdown_connections 2024-04-23T18:30:30.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 >> 172.21.15.119:0/1793552070 conn(0x55766a689460 msgr2=0x55766a77c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:30.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 shutdown_connections 2024-04-23T18:30:30.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:30.965+0000 7f516c92b800 1 -- 172.21.15.119:0/1793552070 wait complete. 2024-04-23T18:30:30.971 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-23T18:30:30.951195Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:30:30.951182Z', 'tags': [], 'group_ids': []} 2024-04-23T18:30:30.984 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:30:30.988 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-04-23T18:30:30.988 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-23T18:30:30.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-23T18:30:30.989 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-04-23T18:30:31.033 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:30:31.033 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:30:31.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.041+0000 7fe73083f800 1 Processor -- start 2024-04-23T18:30:31.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.041+0000 7fe73083f800 1 -- start start 2024-04-23T18:30:31.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.041+0000 7fe73083f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55eefcc44420 0x55eefcc46810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.041+0000 7fe73083f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eefcaf0560 con 0x55eefcc3ff90 2024-04-23T18:30:31.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.041+0000 7fe73083f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55eefcae1e20 con 0x55eefcc44420 2024-04-23T18:30:31.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.042+0000 7fe725b3d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55eefcc44420 0x55eefcc46810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.042+0000 7fe725b3d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55eefcc44420 0x55eefcc46810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36286/0 (socket says 172.21.15.119:36286) 2024-04-23T18:30:31.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.042+0000 7fe725b3d640 1 -- 172.21.15.119:0/3955030224 learned_addr learned my addr 172.21.15.119:0/3955030224 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:31.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.042+0000 7fe72e33e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55eefcc3ff90 0x55eefcc403b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:39388/0 (socket says 172.21.15.119:39388) 2024-04-23T18:30:31.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.042+0000 7fe725b3d640 1 -- 172.21.15.119:0/3955030224 >> v1:172.21.15.62:6789/0 conn(0x55eefcc3ff90 legacy=0x55eefcc403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.042+0000 7fe725b3d640 1 -- 172.21.15.119:0/3955030224 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefcaefe60 con 0x55eefcc44420 2024-04-23T18:30:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.044+0000 7fe725b3d640 1 --2- 172.21.15.119:0/3955030224 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc44420 0x55eefcc46810 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe71800a520 tx=0x7fe71801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc062133fcfda8d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.044+0000 7fe72db3d640 1 -- 172.21.15.119:0/3955030224 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe718057070 con 0x55eefcc44420 2024-04-23T18:30:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.044+0000 7fe72db3d640 1 -- 172.21.15.119:0/3955030224 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe718052570 con 0x55eefcc44420 2024-04-23T18:30:31.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.044+0000 7fe72db3d640 1 -- 172.21.15.119:0/3955030224 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe71804ae60 con 0x55eefcc44420 2024-04-23T18:30:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.045+0000 7fe73083f800 1 -- 172.21.15.119:0/3955030224 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc44420 msgr2=0x55eefcc46810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.045+0000 7fe73083f800 1 --2- 172.21.15.119:0/3955030224 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc44420 0x55eefcc46810 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe71800a520 tx=0x7fe71801d010 comp rx=0 tx=0).stop 2024-04-23T18:30:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.045+0000 7fe73083f800 1 -- 172.21.15.119:0/3955030224 shutdown_connections 2024-04-23T18:30:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.045+0000 7fe73083f800 1 --2- 172.21.15.119:0/3955030224 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc44420 0x55eefcc46810 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.045+0000 7fe73083f800 1 -- 172.21.15.119:0/3955030224 >> 172.21.15.119:0/3955030224 conn(0x55eefcc3b550 msgr2=0x55eefcc3d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.045+0000 7fe73083f800 1 -- 172.21.15.119:0/3955030224 shutdown_connections 2024-04-23T18:30:31.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.045+0000 7fe73083f800 1 -- 172.21.15.119:0/3955030224 wait complete. 2024-04-23T18:30:31.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.056+0000 7fe73083f800 1 Processor -- start 2024-04-23T18:30:31.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.056+0000 7fe73083f800 1 -- start start 2024-04-23T18:30:31.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.056+0000 7fe73083f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc3ff90 0x55eefcbb4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.056+0000 7fe73083f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55eefcb8b5d0 con 0x55eefcc3ff90 2024-04-23T18:30:31.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.057+0000 7fe72e33e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc3ff90 0x55eefcbb4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.057+0000 7fe72e33e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc3ff90 0x55eefcbb4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36300/0 (socket says 172.21.15.119:36300) 2024-04-23T18:30:31.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.057+0000 7fe72e33e640 1 -- 172.21.15.119:0/778537134 learned_addr learned my addr 172.21.15.119:0/778537134 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:31.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.057+0000 7fe72e33e640 1 -- 172.21.15.119:0/778537134 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefcb01860 con 0x55eefcc3ff90 2024-04-23T18:30:31.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.057+0000 7fe72e33e640 1 --2- 172.21.15.119:0/778537134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc3ff90 0x55eefcbb4fa0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe72000b230 tx=0x7fe72000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4fda3a2bc27a1c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.057+0000 7fe61c608640 1 -- 172.21.15.119:0/778537134 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe72000e5c0 con 0x55eefcc3ff90 2024-04-23T18:30:31.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.058+0000 7fe61c608640 1 -- 172.21.15.119:0/778537134 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720006070 con 0x55eefcc3ff90 2024-04-23T18:30:31.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.058+0000 7fe61c608640 1 -- 172.21.15.119:0/778537134 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe72000e890 con 0x55eefcc3ff90 2024-04-23T18:30:31.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.058+0000 7fe73083f800 1 -- 172.21.15.119:0/778537134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc3ff90 msgr2=0x55eefcbb4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.058+0000 7fe73083f800 1 --2- 172.21.15.119:0/778537134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc3ff90 0x55eefcbb4fa0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe72000b230 tx=0x7fe72000b6f0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.058+0000 7fe73083f800 1 -- 172.21.15.119:0/778537134 shutdown_connections 2024-04-23T18:30:31.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.058+0000 7fe73083f800 1 --2- 172.21.15.119:0/778537134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc3ff90 0x55eefcbb4fa0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.058+0000 7fe73083f800 1 -- 172.21.15.119:0/778537134 >> 172.21.15.119:0/778537134 conn(0x55eefcc3b550 msgr2=0x55eefcd2cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:31.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.058+0000 7fe73083f800 1 -- 172.21.15.119:0/778537134 shutdown_connections 2024-04-23T18:30:31.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.058+0000 7fe73083f800 1 -- 172.21.15.119:0/778537134 wait complete. 2024-04-23T18:30:31.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.059+0000 7fe73083f800 1 Processor -- start 2024-04-23T18:30:31.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.059+0000 7fe73083f800 1 -- start start 2024-04-23T18:30:31.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.059+0000 7fe73083f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc3ff90 0x55eefcd3ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.059+0000 7fe73083f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55eefcc470e0 con 0x55eefcc3ff90 2024-04-23T18:30:31.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.059+0000 7fe72e33e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc3ff90 0x55eefcd3ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.059+0000 7fe72e33e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc3ff90 0x55eefcd3ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36310/0 (socket says 172.21.15.119:36310) 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.059+0000 7fe72e33e640 1 -- 172.21.15.119:0/82534943 learned_addr learned my addr 172.21.15.119:0/82534943 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.059+0000 7fe72e33e640 1 -- 172.21.15.119:0/82534943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefcaffeb0 con 0x55eefcc3ff90 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.059+0000 7fe72e33e640 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc3ff90 0x55eefcd3ad80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe720000c00 tx=0x7fe720000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.060+0000 7fe61ae05640 1 -- 172.21.15.119:0/82534943 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe72000f8d0 con 0x55eefcc3ff90 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.060+0000 7fe61ae05640 1 -- 172.21.15.119:0/82534943 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72000fa90 con 0x55eefcc3ff90 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.060+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eefcd3b2c0 con 0x55eefcc3ff90 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.060+0000 7fe61ae05640 1 -- 172.21.15.119:0/82534943 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe72000fdb0 con 0x55eefcc3ff90 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.060+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eefcd3b7e0 con 0x55eefcc3ff90 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.060+0000 7fe61ae05640 1 -- 172.21.15.119:0/82534943 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe720017070 con 0x55eefcc3ff90 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.061+0000 7fe61ae05640 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe614036e60 0x7fe614039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.061+0000 7fe61ae05640 1 -- 172.21.15.119:0/82534943 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fe720015020 con 0x55eefcc3ff90 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.061+0000 7fe725b3d640 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe614036e60 0x7fe614039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.061+0000 7fe73083f800 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55eefcc44420 0x55eefcd41df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.061+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd423c0 con 0x55eefcc44420 2024-04-23T18:30:31.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.061+0000 7fe72eb3f640 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55eefcc44420 0x55eefcd41df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.061+0000 7fe725b3d640 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe614036e60 0x7fe614039320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe718054000 tx=0x7fe71804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.061+0000 7fe72eb3f640 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55eefcc44420 0x55eefcd41df0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.061+0000 7fe72eb3f640 1 -- 172.21.15.119:0/82534943 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcc44420 2024-04-23T18:30:31.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.061+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd3f3c0 con 0x55eefcc44420 2024-04-23T18:30:31.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.062+0000 7fe72eb3f640 1 -- 172.21.15.119:0/82534943 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcc44420 2024-04-23T18:30:31.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.062+0000 7fe73083f800 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55eefcd446d0 0x55eefcd46ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.062+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd47160 con 0x55eefcd446d0 2024-04-23T18:30:31.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.062+0000 7fe72e33e640 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55eefcd446d0 0x55eefcd46ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.062+0000 7fe72e33e640 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55eefcd446d0 0x55eefcd46ac0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.062+0000 7fe72e33e640 1 -- 172.21.15.119:0/82534943 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe72002e070 con 0x55eefcd446d0 2024-04-23T18:30:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.062+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd43650 con 0x55eefcc44420 2024-04-23T18:30:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.063+0000 7fe72eb3f640 1 -- 172.21.15.119:0/82534943 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcc44420 2024-04-23T18:30:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.063+0000 7fe73083f800 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55eefcd485c0 0x55eefcd4aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.063+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd4b190 con 0x55eefcd485c0 2024-04-23T18:30:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.063+0000 7fe725b3d640 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55eefcd485c0 0x55eefcd4aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.063+0000 7fe725b3d640 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55eefcd485c0 0x55eefcd4aa30 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.064+0000 7fe725b3d640 1 -- 172.21.15.119:0/82534943 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe71805a040 con 0x55eefcd485c0 2024-04-23T18:30:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.064+0000 7fe73083f800 1 Processor -- start 2024-04-23T18:30:31.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.064+0000 7fe73083f800 1 -- start start 2024-04-23T18:30:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.064+0000 7fe73083f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd595f0 0x55eefcd59a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.064+0000 7fe73083f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55eefcb31df0 con 0x55eefcd595f0 2024-04-23T18:30:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.064+0000 7fe72e33e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd595f0 0x55eefcd59a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.064+0000 7fe72e33e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd595f0 0x55eefcd59a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36312/0 (socket says 172.21.15.119:36312) 2024-04-23T18:30:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.064+0000 7fe72e33e640 1 -- 172.21.15.119:0/3622059868 learned_addr learned my addr 172.21.15.119:0/3622059868 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.065+0000 7fe72e33e640 1 -- 172.21.15.119:0/3622059868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefcd59f50 con 0x55eefcd595f0 2024-04-23T18:30:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.065+0000 7fe72e33e640 1 --2- 172.21.15.119:0/3622059868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd595f0 0x55eefcd59a10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe72000ff70 tx=0x7fe720017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.065+0000 7fe613fff640 1 -- 172.21.15.119:0/3622059868 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7200481f0 con 0x55eefcd595f0 2024-04-23T18:30:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.065+0000 7fe613fff640 1 -- 172.21.15.119:0/3622059868 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720045160 con 0x55eefcd595f0 2024-04-23T18:30:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.065+0000 7fe613fff640 1 -- 172.21.15.119:0/3622059868 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe720045440 con 0x55eefcd595f0 2024-04-23T18:30:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.065+0000 7fe73083f800 1 -- 172.21.15.119:0/3622059868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eefcd5a9c0 con 0x55eefcd595f0 2024-04-23T18:30:31.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.065+0000 7fe73083f800 1 -- 172.21.15.119:0/3622059868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eefcd5aec0 con 0x55eefcd595f0 2024-04-23T18:30:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.066+0000 7fe613fff640 1 -- 172.21.15.119:0/3622059868 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe72004d0b0 con 0x55eefcd595f0 2024-04-23T18:30:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.066+0000 7fe613fff640 1 --2- 172.21.15.119:0/3622059868 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe608036e60 0x7fe608039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.066+0000 7fe613fff640 1 -- 172.21.15.119:0/3622059868 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fe72003bd90 con 0x55eefcd595f0 2024-04-23T18:30:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.066+0000 7fe725b3d640 1 --2- 172.21.15.119:0/3622059868 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe608036e60 0x7fe608039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.066+0000 7fe73083f800 1 Processor -- start 2024-04-23T18:30:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.066+0000 7fe73083f800 1 -- start start 2024-04-23T18:30:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.066+0000 7fe725b3d640 1 --2- 172.21.15.119:0/3622059868 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe608036e60 0x7fe608039320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55eefcd3f2e0 tx=0x7fe718005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.066+0000 7fe73083f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 0x55eefcd66bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.066+0000 7fe73083f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55eefcbb3620 con 0x55eefcd667a0 2024-04-23T18:30:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.067+0000 7fe72e33e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 0x55eefcd66bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.067+0000 7fe72e33e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 0x55eefcd66bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36318/0 (socket says 172.21.15.119:36318) 2024-04-23T18:30:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.067+0000 7fe72e33e640 1 -- 172.21.15.119:0/759583030 learned_addr learned my addr 172.21.15.119:0/759583030 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:31.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.067+0000 7fe72e33e640 1 -- 172.21.15.119:0/759583030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefcd67190 con 0x55eefcd667a0 2024-04-23T18:30:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.067+0000 7fe72e33e640 1 --2- 172.21.15.119:0/759583030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 0x55eefcd66bc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe720045ff0 tx=0x7fe720048bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35750729567f08a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.067+0000 7fe611ffb640 1 -- 172.21.15.119:0/759583030 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe72005f070 con 0x55eefcd667a0 2024-04-23T18:30:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.067+0000 7fe611ffb640 1 -- 172.21.15.119:0/759583030 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720018c40 con 0x55eefcd667a0 2024-04-23T18:30:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.067+0000 7fe611ffb640 1 -- 172.21.15.119:0/759583030 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe72003f030 con 0x55eefcd667a0 2024-04-23T18:30:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.067+0000 7fe73083f800 1 -- 172.21.15.119:0/759583030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 msgr2=0x55eefcd66bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.067+0000 7fe73083f800 1 --2- 172.21.15.119:0/759583030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 0x55eefcd66bc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe720045ff0 tx=0x7fe720048bf0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.068+0000 7fe73083f800 1 -- 172.21.15.119:0/759583030 shutdown_connections 2024-04-23T18:30:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.068+0000 7fe73083f800 1 --2- 172.21.15.119:0/759583030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 0x55eefcd66bc0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.068+0000 7fe73083f800 1 -- 172.21.15.119:0/759583030 >> 172.21.15.119:0/759583030 conn(0x55eefcd62a70 msgr2=0x55eefcd60ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.068+0000 7fe73083f800 1 -- 172.21.15.119:0/759583030 shutdown_connections 2024-04-23T18:30:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.068+0000 7fe73083f800 1 -- 172.21.15.119:0/759583030 wait complete. 2024-04-23T18:30:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.068+0000 7fe73083f800 1 Processor -- start 2024-04-23T18:30:31.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.068+0000 7fe73083f800 1 -- start start 2024-04-23T18:30:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.068+0000 7fe73083f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 0x55eefcd6daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.068+0000 7fe73083f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55eefcd677f0 con 0x55eefcd667a0 2024-04-23T18:30:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.068+0000 7fe72e33e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 0x55eefcd6daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.068+0000 7fe72e33e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 0x55eefcd6daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36334/0 (socket says 172.21.15.119:36334) 2024-04-23T18:30:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.068+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 learned_addr learned my addr 172.21.15.119:0/2875487002 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.068+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eefcd6dfe0 con 0x55eefcd667a0 2024-04-23T18:30:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.069+0000 7fe72e33e640 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 0x55eefcd6daa0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe72004bdf0 tx=0x7fe720022eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.069+0000 7fe5fffff640 1 -- 172.21.15.119:0/2875487002 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe72006a020 con 0x55eefcd667a0 2024-04-23T18:30:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.069+0000 7fe5fffff640 1 -- 172.21.15.119:0/2875487002 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720060040 con 0x55eefcd667a0 2024-04-23T18:30:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.069+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eefcd6dfe0 con 0x55eefcd667a0 2024-04-23T18:30:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.069+0000 7fe5fffff640 1 -- 172.21.15.119:0/2875487002 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe72005f070 con 0x55eefcd667a0 2024-04-23T18:30:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.069+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eefcd6dfe0 con 0x55eefcd667a0 2024-04-23T18:30:31.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.070+0000 7fe5fffff640 1 -- 172.21.15.119:0/2875487002 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe72006d020 con 0x55eefcd667a0 2024-04-23T18:30:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.070+0000 7fe5fffff640 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe5f8036dc0 0x7fe5f8039280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.070+0000 7fe5fffff640 1 -- 172.21.15.119:0/2875487002 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fe720069170 con 0x55eefcd667a0 2024-04-23T18:30:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.070+0000 7fe725b3d640 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe5f8036dc0 0x7fe5f8039280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.070+0000 7fe73083f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.070+0000 7fe73083f800 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55eefcd792f0 0x55eefcd7b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.070+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7bf00 con 0x55eefcd792f0 2024-04-23T18:30:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.070+0000 7fe725b3d640 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe5f8036dc0 0x7fe5f8039280 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe718000c00 tx=0x7fe71804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.070+0000 7fe72eb3f640 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55eefcd792f0 0x55eefcd7b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe72eb3f640 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55eefcd792f0 0x55eefcd7b7b0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcd792f0 2024-04-23T18:30:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe73083f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:31.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe73083f800 20 realm 2024-04-23T18:30:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe73083f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7c310 con 0x55eefcd792f0 2024-04-23T18:30:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcd792f0 2024-04-23T18:30:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe73083f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe73083f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:30:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe73083f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cbe0 con 0x55eefcd792f0 2024-04-23T18:30:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcd792f0 2024-04-23T18:30:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe73083f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe73083f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.071+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd792f0 2024-04-23T18:30:31.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.072+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcd792f0 2024-04-23T18:30:31.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.072+0000 7fe73083f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:31.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.072+0000 7fe73083f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:31.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.072+0000 7fe73083f800 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55eefcd7dce0 0x55eefcd800d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.072+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd806e0 con 0x55eefcd7dce0 2024-04-23T18:30:31.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.072+0000 7fe72e33e640 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55eefcd7dce0 0x55eefcd800d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.072+0000 7fe72e33e640 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55eefcd7dce0 0x55eefcd800d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.072+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.072+0000 7fe73083f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:30:31.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.072+0000 7fe73083f800 20 searching for the correct realm 2024-04-23T18:30:31.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.072+0000 7fe73083f800 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55eefcd82690 0x55eefcd84b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.072+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd85220 con 0x55eefcd82690 2024-04-23T18:30:31.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.072+0000 7fe725b3d640 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55eefcd82690 0x55eefcd84b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.073+0000 7fe725b3d640 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55eefcd82690 0x55eefcd84b50 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.073+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.073+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd85220 con 0x55eefcd7dce0 2024-04-23T18:30:31.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.073+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.073+0000 7fe72e33e640 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe72006f020 0x7fe720066480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:31.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.073+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd85220 con 0x7fe72006f020 2024-04-23T18:30:31.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.073+0000 7fe72eb3f640 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe72006f020 0x7fe720066480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:31.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.074+0000 7fe72eb3f640 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe72006f020 0x7fe720066480 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:31.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.074+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe72800a4a0 con 0x7fe72006f020 2024-04-23T18:30:31.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.074+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd792f0 2024-04-23T18:30:31.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.074+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcd792f0 2024-04-23T18:30:31.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.074+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd792f0 2024-04-23T18:30:31.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.074+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcd792f0 2024-04-23T18:30:31.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.074+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x7fe72006f020 2024-04-23T18:30:31.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.075+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe72800a4a0 con 0x7fe72006f020 2024-04-23T18:30:31.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.075+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x7fe72006f020 2024-04-23T18:30:31.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.075+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe72800a4a0 con 0x7fe72006f020 2024-04-23T18:30:31.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.075+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd7dce0 2024-04-23T18:30:31.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.075+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.075+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd82690 2024-04-23T18:30:31.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.075+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.076+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd792f0 2024-04-23T18:30:31.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.076+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcd792f0 2024-04-23T18:30:31.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.076+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x7fe72006f020 2024-04-23T18:30:31.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.076+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe72800a4a0 con 0x7fe72006f020 2024-04-23T18:30:31.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.076+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd792f0 2024-04-23T18:30:31.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.076+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcd792f0 2024-04-23T18:30:31.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.076+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd7dce0 2024-04-23T18:30:31.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.077+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.077+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd82690 2024-04-23T18:30:31.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.077+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.077+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd82690 2024-04-23T18:30:31.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.077+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.077+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x7fe72006f020 2024-04-23T18:30:31.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.077+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe72800a4a0 con 0x7fe72006f020 2024-04-23T18:30:31.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.077+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd82690 2024-04-23T18:30:31.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.077+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.078+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd82690 2024-04-23T18:30:31.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.078+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.078+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd792f0 2024-04-23T18:30:31.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.078+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcd792f0 2024-04-23T18:30:31.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.078+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd792f0 2024-04-23T18:30:31.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.078+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcd792f0 2024-04-23T18:30:31.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.078+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x7fe72006f020 2024-04-23T18:30:31.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.079+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe72800a4a0 con 0x7fe72006f020 2024-04-23T18:30:31.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.079+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd82690 2024-04-23T18:30:31.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.079+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.079+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd7dce0 2024-04-23T18:30:31.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.079+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.079+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd792f0 2024-04-23T18:30:31.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.079+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe72800a4a0 con 0x55eefcd792f0 2024-04-23T18:30:31.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.079+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd7dce0 2024-04-23T18:30:31.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.080+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.080+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd82690 2024-04-23T18:30:31.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.080+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.080+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x7fe72006f020 2024-04-23T18:30:31.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.080+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe72800a4a0 con 0x7fe72006f020 2024-04-23T18:30:31.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.080+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd7dce0 2024-04-23T18:30:31.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.080+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.080+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd82690 2024-04-23T18:30:31.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x7fe72006f020 2024-04-23T18:30:31.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe72800a4a0 con 0x7fe72006f020 2024-04-23T18:30:31.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd792f0 2024-04-23T18:30:31.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe728040080 con 0x55eefcd792f0 2024-04-23T18:30:31.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd7cf80 con 0x55eefcd7dce0 2024-04-23T18:30:31.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe73083f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:30:31.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe73083f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:30:31.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe73083f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:30:31.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe73083f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:30:31.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe73083f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:30:31.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe73083f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:30:31.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe73083f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:31.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.081+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd80fa0 con 0x55eefcd792f0 2024-04-23T18:30:31.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe728040080 con 0x55eefcd792f0 2024-04-23T18:30:31.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:31.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:31.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd81390 con 0x55eefcd792f0 2024-04-23T18:30:31.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe728040080 con 0x55eefcd792f0 2024-04-23T18:30:31.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:31.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:31.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd81390 con 0x7fe72006f020 2024-04-23T18:30:31.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe728040080 con 0x7fe72006f020 2024-04-23T18:30:31.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:30:31.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 20 zone default found 2024-04-23T18:30:31.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 4 Realm: () 2024-04-23T18:30:31.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:30:31.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:30:31.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:30:31.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 20 zonegroup default 2024-04-23T18:30:31.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:31.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd856a0 con 0x55eefcd7dce0 2024-04-23T18:30:31.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:31.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:31.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.082+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd87420 con 0x55eefcd82690 2024-04-23T18:30:31.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.083+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.083+0000 7fe73083f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:31.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.083+0000 7fe73083f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:31.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.083+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd877c0 con 0x55eefcd82690 2024-04-23T18:30:31.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.083+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.083+0000 7fe73083f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:31.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.083+0000 7fe73083f800 20 started sync module instance, tier type = 2024-04-23T18:30:31.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.083+0000 7fe73083f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:30:31.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.083+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd868c0 con 0x55eefcd7dce0 2024-04-23T18:30:31.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.084+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.084+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94484932617232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd87b60 con 0x55eefcd7dce0 2024-04-23T18:30:31.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.084+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd883f0 con 0x55eefcd792f0 2024-04-23T18:30:31.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.085+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94484932617232] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.085+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728040080 con 0x55eefcd792f0 2024-04-23T18:30:31.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.085+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94484932619440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd887e0 con 0x55eefcd792f0 2024-04-23T18:30:31.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.085+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd89240 con 0x55eefcd82690 2024-04-23T18:30:31.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.087+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94484932619440] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728040080 con 0x55eefcd792f0 2024-04-23T18:30:31.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.087+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.087+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94484932624128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd89630 con 0x55eefcd82690 2024-04-23T18:30:31.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.087+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd8a090 con 0x55eefcd7dce0 2024-04-23T18:30:31.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.088+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94484932624128] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.088+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.088+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94484932627744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd8a930 con 0x55eefcd7dce0 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.088+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd8b2f0 con 0x55eefcd792f0 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.089+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94484932627744] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.089+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728040080 con 0x55eefcd792f0 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.089+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94484932634208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd8b2f0 con 0x55eefcd792f0 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.089+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd8bcb0 con 0x7fe72006f020 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.090+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728040080 con 0x7fe72006f020 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.090+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94484932638720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd8c0d0 con 0x7fe72006f020 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.090+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd8cb70 con 0x7fe72006f020 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.090+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94484932634208] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728040080 con 0x55eefcd792f0 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.091+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94484932638720] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728040080 con 0x7fe72006f020 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.091+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728040080 con 0x7fe72006f020 2024-04-23T18:30:31.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.091+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94484932642368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd8bc20 con 0x7fe72006f020 2024-04-23T18:30:31.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.091+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd8d200 con 0x7fe72006f020 2024-04-23T18:30:31.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.092+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94484932642368] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728040080 con 0x7fe72006f020 2024-04-23T18:30:31.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.092+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728040080 con 0x7fe72006f020 2024-04-23T18:30:31.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.092+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94484932636224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd8d200 con 0x7fe72006f020 2024-04-23T18:30:31.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.092+0000 7fe73083f800 20 add_watcher() i=0 2024-04-23T18:30:31.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.092+0000 7fe73083f800 20 add_watcher() i=1 2024-04-23T18:30:31.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.092+0000 7fe73083f800 20 add_watcher() i=2 2024-04-23T18:30:31.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.092+0000 7fe73083f800 20 add_watcher() i=3 2024-04-23T18:30:31.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.093+0000 7fe73083f800 20 add_watcher() i=4 2024-04-23T18:30:31.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.093+0000 7fe73083f800 20 add_watcher() i=5 2024-04-23T18:30:31.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.093+0000 7fe73083f800 20 add_watcher() i=6 2024-04-23T18:30:31.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.093+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94484932636224] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728040080 con 0x7fe72006f020 2024-04-23T18:30:31.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.093+0000 7fe73083f800 20 add_watcher() i=7 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.093+0000 7fe73083f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.093+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd903a0 con 0x55eefcd792f0 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.094+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe728040080 con 0x55eefcd792f0 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.094+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94484932644176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcd8d620 con 0x55eefcd792f0 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.095+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94484932644176] v34'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe728040080 con 0x55eefcd792f0 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.095+0000 7fe5e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.095+0000 7fe73083f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.095+0000 7fe73083f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.095+0000 7fe73083f800 5 note: GC not initialized 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.095+0000 7fe55f7fe640 20 reqs_thread_entry: start 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.095+0000 7fe73083f800 20 init_complete bucket index max shards: 11 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.095+0000 7fe73083f800 20 Filter name: none 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.096+0000 7fe55d7fa640 20 reqs_thread_entry: start 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.096+0000 7fe73083f800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-23T18:30:31.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.096+0000 7fe73083f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:31.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.096+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdc3c00 con 0x7fe72006f020 2024-04-23T18:30:31.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.096+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fe728040080 con 0x7fe72006f020 2024-04-23T18:30:31.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.096+0000 7fe73083f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-23T18:30:31.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.096+0000 7fe73083f800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-04-23T18:30:31.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.096+0000 7fe73083f800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-23T18:30:31.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.096+0000 7fe73083f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:30:31.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.096+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdc7fa0 con 0x55eefcd7dce0 2024-04-23T18:30:31.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.097+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.097+0000 7fe73083f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-23T18:30:31.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.097+0000 7fe73083f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-23T18:30:31.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.097+0000 7fe73083f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-23T18:30:31.106 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.097+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94484932885104 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdc8c10 con 0x7fe72006f020 2024-04-23T18:30:31.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.098+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== watch-notify(notify (1) cookie 94484932638720 notify 146028888097 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7fe728018c30 con 0x7fe72006f020 2024-04-23T18:30:31.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.098+0000 7fe611ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94484932638720 notifier 4728 bl.length()=382 2024-04-23T18:30:31.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.098+0000 7fe611ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-23T18:30:31.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.098+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(64 notify.5 [notify cookie 94484932885104 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe728040080 con 0x7fe72006f020 2024-04-23T18:30:31.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.098+0000 7fe611ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-23T18:30:31.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.098+0000 7fe611ffb640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe5f4003ea0 con 0x7fe72006f020 2024-04-23T18:30:31.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.098+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728040080 con 0x7fe72006f020 2024-04-23T18:30:31.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.098+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== watch-notify(notify_complete (2) cookie 94484932885104 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe7280455c0 con 0x7fe72006f020 2024-04-23T18:30:31.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.098+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdc7a70 con 0x55eefcd792f0 2024-04-23T18:30:31.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.099+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.099+0000 7fe73083f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 : miss 2024-04-23T18:30:31.107 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.099+0000 7fe73083f800 20 rados->read ofs=0 len=0 2024-04-23T18:30:31.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.099+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 8.d 8:b5935409:root::.bucket.meta.myfoo6%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdc5da0 con 0x55eefcd7dce0 2024-04-23T18:30:31.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.099+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(67 .bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.099+0000 7fe73083f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-23T18:30:31.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.099+0000 7fe73083f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 info.flags=0x17 2024-04-23T18:30:31.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.099+0000 7fe73083f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 to cache LRU end 2024-04-23T18:30:31.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.099+0000 7fe73083f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:30:31.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.099+0000 7fe73083f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:30:31.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.099+0000 7fe73083f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 2024-04-23T18:30:31.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.099+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 8.d 8:b5935409:root::.bucket.meta.myfoo6%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdcfb80 con 0x55eefcd7dce0 2024-04-23T18:30:31.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.101+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(68 .bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v34'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.101+0000 7fe73083f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 info.flags=0x17 2024-04-23T18:30:31.108 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.101+0000 7fe73083f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 to cache LRU end 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.101+0000 7fe73083f800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.101+0000 7fe73083f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9, ofs0, ns] 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.101+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify cookie 94484932872416 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdca050 con 0x55eefcd792f0 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.101+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== watch-notify(notify (1) cookie 94484932619440 notify 146028888089 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7fe7280455c0 con 0x55eefcd792f0 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.101+0000 7fe611ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94484932619440 notifier 4728 bl.length()=748 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.101+0000 7fe611ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 info.flags=0x17 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.101+0000 7fe611ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 to cache LRU end 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.101+0000 7fe611ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.101+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(69 notify.1 [notify cookie 94484932872416 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.101+0000 7fe611ffb640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe5f4003ea0 con 0x55eefcd792f0 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.102+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== watch-notify(notify_complete (2) cookie 94484932872416 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe728045860 con 0x55eefcd792f0 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.102+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(70 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.102+0000 7fe73083f800 20 handle_bi_update(): bucket=:myfoo6[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9]): orig_sources= new_sources= 2024-04-23T18:30:31.109 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.102+0000 7fe73083f800 20 handle_bi_update(): bucket=:myfoo6[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9]): potential sources added=[] removed=[] 2024-04-23T18:30:31.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.102+0000 7fe73083f800 20 handle_bi_update(): bucket=:myfoo6[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9]): orig_dests= new_dests= 2024-04-23T18:30:31.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.102+0000 7fe73083f800 20 handle_bi_update(): bucket=:myfoo6[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9]): potential dests added=[] removed=[] 2024-04-23T18:30:31.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.102+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdc48e0 con 0x55eefcd792f0 2024-04-23T18:30:31.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.102+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(71 bud.buckets [call] v34'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.103+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdc48e0 con 0x55eefcd792f0 2024-04-23T18:30:31.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.103+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(72 bud.buckets [call] v34'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.103+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdcf350 con 0x55eefcd792f0 2024-04-23T18:30:31.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v34'19 uv19 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe73083f800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-23T18:30:31.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe73083f800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-23T18:30:31.110 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe73083f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-23T18:30:31.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94484932872416 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdcf350 con 0x55eefcd7dce0 2024-04-23T18:30:31.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== watch-notify(notify (1) cookie 94484932627744 notify 146028888079 ret 0) ==== 358+0+0 (crc 0 0 0) 0x55eefcd59f50 con 0x55eefcd7dce0 2024-04-23T18:30:31.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe6117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94484932627744 notifier 4728 bl.length()=316 2024-04-23T18:30:31.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe6117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-23T18:30:31.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe6117fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-23T18:30:31.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(74 notify.3 [notify cookie 94484932872416 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe6117fa640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe564003400 con 0x55eefcd7dce0 2024-04-23T18:30:31.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== watch-notify(notify_complete (2) cookie 94484932872416 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55eefcd3b7e0 con 0x55eefcd7dce0 2024-04-23T18:30:31.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe73083f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 : hit (requested=0x17, cached=0x17) 2024-04-23T18:30:31.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe73083f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 2024-04-23T18:30:31.111 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.105+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:76 8.d 8:b5935409:root::.bucket.meta.myfoo6%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdcd810 con 0x55eefcd7dce0 2024-04-23T18:30:31.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.106+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(76 .bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v34'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.106+0000 7fe73083f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 info.flags=0x17 2024-04-23T18:30:31.119 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.106+0000 7fe73083f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 to cache LRU end 2024-04-23T18:30:31.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.106+0000 7fe73083f800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-23T18:30:31.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.106+0000 7fe73083f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9, ofs0, ns] 2024-04-23T18:30:31.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 94484932876528 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdcd7d0 con 0x55eefcd792f0 2024-04-23T18:30:31.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== watch-notify(notify (1) cookie 94484932619440 notify 146028888090 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7fe728045860 con 0x55eefcd792f0 2024-04-23T18:30:31.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe611ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94484932619440 notifier 4728 bl.length()=748 2024-04-23T18:30:31.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe611ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 info.flags=0x17 2024-04-23T18:30:31.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe611ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 to cache LRU end 2024-04-23T18:30:31.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(77 notify.1 [notify cookie 94484932876528 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe611ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-23T18:30:31.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe611ffb640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe5f4003ea0 con 0x55eefcd792f0 2024-04-23T18:30:31.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== watch-notify(notify_complete (2) cookie 94484932876528 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55eefcdc60a0 con 0x55eefcd792f0 2024-04-23T18:30:31.120 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe73083f800 20 handle_bi_update(): bucket=:myfoo6[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9]): orig_sources= new_sources= 2024-04-23T18:30:31.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe73083f800 20 handle_bi_update(): bucket=:myfoo6[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9]): potential sources added=[] removed=[] 2024-04-23T18:30:31.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe73083f800 20 handle_bi_update(): bucket=:myfoo6[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9]): orig_dests= new_dests= 2024-04-23T18:30:31.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe73083f800 20 handle_bi_update(): bucket=:myfoo6[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9]): potential dests added=[] removed=[] 2024-04-23T18:30:31.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:79 4.9 4:91f04a44:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdc58f0 con 0x55eefcd792f0 2024-04-23T18:30:31.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.107+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(79 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.108+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:80 4.10 4:0b14c5fc:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdc58f0 con 0x55eefcd82690 2024-04-23T18:30:31.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.108+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(80 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.1 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.108+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:81 4.25 4:a7b6d1d1:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdcc780 con 0x55eefcd82690 2024-04-23T18:30:31.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.108+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(81 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.108+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:82 4.2a 4:547ccc58:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdccbb0 con 0x55eefcd792f0 2024-04-23T18:30:31.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.108+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 34 ==== osd_op_reply(82 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.121 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.108+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:83 4.6 4:615a9a97:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdccbb0 con 0x55eefcd82690 2024-04-23T18:30:31.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.109+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(83 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.109+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 4.10 4:09ecb195:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdccbb0 con 0x55eefcd82690 2024-04-23T18:30:31.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.109+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(84 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.5 [call out=85b] v0'0 uv16 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.109+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:85 4.c 4:30c4b246:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdccbb0 con 0x55eefcd792f0 2024-04-23T18:30:31.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.109+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 35 ==== osd_op_reply(85 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.109+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:86 4.e 4:7376e66b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdccbb0 con 0x55eefcd7dce0 2024-04-23T18:30:31.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.110+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(86 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.110+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:87 4.37 4:ec842c10:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdccbb0 con 0x7fe72006f020 2024-04-23T18:30:31.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.110+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(87 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe728050040 con 0x7fe72006f020 2024-04-23T18:30:31.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.110+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:88 4.28 4:14e73ec2:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdccbb0 con 0x55eefcd792f0 2024-04-23T18:30:31.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.110+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 36 ==== osd_op_reply(88 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9 [call out=378b] v0'0 uv5 ondisk = 0) ==== 194+0+378 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.122 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.110+0000 7fe73083f800 10 cls_bucket_list_unordered: got thirteen 2024-04-23T18:30:31.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.110+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 4.29 4:956972a6:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdccbb0 con 0x55eefcd82690 2024-04-23T18:30:31.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(89 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 20 get_obj_state: octx=0x7fe72800ab10 obj=myfoo6:thirteen state=0x55eefcdc4ac8 s->prefetch_data=0 2024-04-23T18:30:31.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:90 3.fs0 3:f0130d93:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdccbb0 con 0x55eefcd7dce0 2024-04-23T18:30:31.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== osd_op_reply(90 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 10 manifest: total_size = 8 2024-04-23T18:30:31.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 20 get_obj_state: setting s->obj_tag to b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.17435481774526758988 2024-04-23T18:30:31.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 20 Read xattr rgw_rados: user.rgw.acl 2024-04-23T18:30:31.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 20 Read xattr rgw_rados: user.rgw.content_type 2024-04-23T18:30:31.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 20 Read xattr rgw_rados: user.rgw.etag 2024-04-23T18:30:31.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 20 Read xattr rgw_rados: user.rgw.idtag 2024-04-23T18:30:31.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 20 Read xattr rgw_rados: user.rgw.manifest 2024-04-23T18:30:31.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-04-23T18:30:31.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-04-23T18:30:31.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-04-23T18:30:31.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 20 get_obj_state: octx=0x7fe72800ab10 obj=myfoo6:thirteen state=0x55eefcdc4ac8 s->prefetch_data=0 2024-04-23T18:30:31.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 : hit (requested=0x17, cached=0x17) 2024-04-23T18:30:31.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 2024-04-23T18:30:31.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 20 bucket index object: :.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9 2024-04-23T18:30:31.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.111+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:91 4.28 4:14e73ec2:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdd3780 con 0x55eefcd792f0 2024-04-23T18:30:31.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.112+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 37 ==== osd_op_reply(91 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.112+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:92 3.fs0 3:f0130d93:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdd18c0 con 0x55eefcd7dce0 2024-04-23T18:30:31.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.114+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 24 ==== osd_op_reply(92 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v34'4 uv4 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.114+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:93 4.28 4:14e73ec2:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdd3340 con 0x55eefcd792f0 2024-04-23T18:30:31.124 INFO:teuthology.orchestra.run.smithi119.stderr:1 objects processed in :myfoo6[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9]). Next marker thirteen 2024-04-23T18:30:31.124 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.114+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdd3340 con 0x55eefcd7dce0 2024-04-23T18:30:31.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.115+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 25 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.115+0000 7fe73083f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-23T18:30:31.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.115+0000 7fe73083f800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-23T18:30:31.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.115+0000 7fe73083f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-23T18:30:31.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.115+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94484932907072 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdd3340 con 0x7fe72006f020 2024-04-23T18:30:31.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.115+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== watch-notify(notify (1) cookie 94484932638720 notify 146028888098 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55eefcdc60a0 con 0x7fe72006f020 2024-04-23T18:30:31.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.115+0000 7fe611ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94484932638720 notifier 4728 bl.length()=556 2024-04-23T18:30:31.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.115+0000 7fe611ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-23T18:30:31.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.115+0000 7fe611ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-23T18:30:31.125 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.115+0000 7fe611ffb640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe5f4003ea0 con 0x7fe72006f020 2024-04-23T18:30:31.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.115+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(95 notify.5 [notify cookie 94484932907072 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe728050040 con 0x7fe72006f020 2024-04-23T18:30:31.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.115+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 38 ==== osd_op_reply(93 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.115+0000 7fe611ffb640 20 handle_completion(): completion ok for obj=thirteen 2024-04-23T18:30:31.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.116+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== watch-notify(notify_complete (2) cookie 94484932907072 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe728056450 con 0x7fe72006f020 2024-04-23T18:30:31.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.116+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728050040 con 0x7fe72006f020 2024-04-23T18:30:31.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.116+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdc85e0 con 0x55eefcd792f0 2024-04-23T18:30:31.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 39 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe73083f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-23T18:30:31.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe73083f800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-23T18:30:31.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe73083f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-23T18:30:31.126 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94484932907072 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdc48e0 con 0x7fe72006f020 2024-04-23T18:30:31.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== watch-notify(notify (1) cookie 94484932638720 notify 146028888099 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fe728056450 con 0x7fe72006f020 2024-04-23T18:30:31.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe611ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94484932638720 notifier 4728 bl.length()=177 2024-04-23T18:30:31.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe611ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-23T18:30:31.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe611ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-23T18:30:31.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(98 notify.5 [notify cookie 94484932907072 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe728050040 con 0x7fe72006f020 2024-04-23T18:30:31.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe611ffb640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe5f4003ea0 con 0x7fe72006f020 2024-04-23T18:30:31.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728050040 con 0x7fe72006f020 2024-04-23T18:30:31.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== watch-notify(notify_complete (2) cookie 94484932907072 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe728056620 con 0x7fe72006f020 2024-04-23T18:30:31.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe73083f800 10 removing user index: bar 2024-04-23T18:30:31.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.117+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdc85e0 con 0x7fe72006f020 2024-04-23T18:30:31.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.118+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== osd_op_reply(100 bar [delete] v34'6 uv6 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fe728050040 con 0x7fe72006f020 2024-04-23T18:30:31.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.118+0000 7fe73083f800 10 removing default.rgw.meta+users.uid+bar from cache 2024-04-23T18:30:31.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.118+0000 7fe73083f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-23T18:30:31.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.118+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94484932907072 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdc48e0 con 0x7fe72006f020 2024-04-23T18:30:31.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.119+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 31 ==== watch-notify(notify (1) cookie 94484932636224 notify 146028888100 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7fe728056620 con 0x7fe72006f020 2024-04-23T18:30:31.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.119+0000 7fe611ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888100 cookie 94484932636224 notifier 4728 bl.length()=152 2024-04-23T18:30:31.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.119+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 32 ==== osd_op_reply(101 notify.7 [notify cookie 94484932907072 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe728050040 con 0x7fe72006f020 2024-04-23T18:30:31.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.119+0000 7fe611ffb640 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe5f4003ea0 con 0x7fe72006f020 2024-04-23T18:30:31.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.119+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 33 ==== watch-notify(notify_complete (2) cookie 94484932907072 notify 146028888100 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe7280567f0 con 0x7fe72006f020 2024-04-23T18:30:31.128 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.119+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 34 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728050040 con 0x7fe72006f020 2024-04-23T18:30:31.128 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-23T18:30:30.951195Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:30:30.951182Z","tags":[],"group_ids":[]} 2024-04-23T18:30:31.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.120+0000 7fe5e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:31.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.120+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94484932644176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdac3a0 con 0x55eefcd792f0 2024-04-23T18:30:31.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.121+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 40 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94484932644176] v34'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.121+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94484932617232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdac3a0 con 0x55eefcd7dce0 2024-04-23T18:30:31.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.122+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 26 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94484932617232] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.122+0000 7fe73083f800 20 remove_watcher() i=0 2024-04-23T18:30:31.134 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.122+0000 7fe73083f800 2 removed watcher, disabling cache 2024-04-23T18:30:31.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.122+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94484932619440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdccc20 con 0x55eefcd792f0 2024-04-23T18:30:31.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.123+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 41 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94484932619440] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.123+0000 7fe73083f800 20 remove_watcher() i=1 2024-04-23T18:30:31.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.123+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94484932624128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdac3a0 con 0x55eefcd82690 2024-04-23T18:30:31.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.124+0000 7fe725b3d640 1 -- 172.21.15.119:0/2875487002 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94484932624128] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe71807f070 con 0x55eefcd82690 2024-04-23T18:30:31.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.124+0000 7fe73083f800 20 remove_watcher() i=2 2024-04-23T18:30:31.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.124+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94484932627744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdac3a0 con 0x55eefcd7dce0 2024-04-23T18:30:31.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.125+0000 7fe72e33e640 1 -- 172.21.15.119:0/2875487002 <== osd.2 v2:172.21.15.119:6800/2624052101 27 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94484932627744] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe720058070 con 0x55eefcd7dce0 2024-04-23T18:30:31.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.125+0000 7fe73083f800 20 remove_watcher() i=3 2024-04-23T18:30:31.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.125+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94484932634208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdac3a0 con 0x55eefcd792f0 2024-04-23T18:30:31.135 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.127+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.1 v2:172.21.15.119:6808/2736386629 42 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94484932634208] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728050040 con 0x55eefcd792f0 2024-04-23T18:30:31.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.127+0000 7fe73083f800 20 remove_watcher() i=4 2024-04-23T18:30:31.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.127+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94484932638720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdac3a0 con 0x7fe72006f020 2024-04-23T18:30:31.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.128+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 35 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94484932638720] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728050040 con 0x7fe72006f020 2024-04-23T18:30:31.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.128+0000 7fe73083f800 20 remove_watcher() i=5 2024-04-23T18:30:31.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.128+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94484932642368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdac3a0 con 0x7fe72006f020 2024-04-23T18:30:31.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.129+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 36 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94484932642368] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728050040 con 0x7fe72006f020 2024-04-23T18:30:31.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.129+0000 7fe73083f800 20 remove_watcher() i=6 2024-04-23T18:30:31.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.129+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94484932636224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eefcdac3a0 con 0x7fe72006f020 2024-04-23T18:30:31.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 <== osd.0 v2:172.21.15.62:6800/2641588406 37 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94484932636224] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe728050040 con 0x7fe72006f020 2024-04-23T18:30:31.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 20 remove_watcher() i=7 2024-04-23T18:30:31.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe72006f020 msgr2=0x7fe720066480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe72006f020 0x7fe720066480 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.136 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55eefcd792f0 msgr2=0x55eefcd7b7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55eefcd792f0 0x55eefcd7b7b0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55eefcd7dce0 msgr2=0x55eefcd800d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55eefcd7dce0 0x55eefcd800d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55eefcd82690 msgr2=0x55eefcd84b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55eefcd82690 0x55eefcd84b50 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe5f8036dc0 msgr2=0x7fe5f8039280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe5f8036dc0 0x7fe5f8039280 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe718000c00 tx=0x7fe71804f000 comp rx=0 tx=0).stop 2024-04-23T18:30:31.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 msgr2=0x55eefcd6daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe72eb3f640 1 -- 172.21.15.119:0/2875487002 reap_dead start 2024-04-23T18:30:31.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 0x55eefcd6daa0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe72004bdf0 tx=0x7fe720022eb0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 shutdown_connections 2024-04-23T18:30:31.137 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 --2- 172.21.15.119:0/2875487002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd667a0 0x55eefcd6daa0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 >> 172.21.15.119:0/2875487002 conn(0x55eefcd62a70 msgr2=0x55eefcd600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:31.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 shutdown_connections 2024-04-23T18:30:31.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.130+0000 7fe73083f800 1 -- 172.21.15.119:0/2875487002 wait complete. 2024-04-23T18:30:31.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/3622059868 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe608036e60 msgr2=0x7fe608039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 --2- 172.21.15.119:0/3622059868 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe608036e60 0x7fe608039320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55eefcd3f2e0 tx=0x7fe718005ac0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/3622059868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd595f0 msgr2=0x55eefcd59a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 --2- 172.21.15.119:0/3622059868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd595f0 0x55eefcd59a10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe72000ff70 tx=0x7fe720017d50 comp rx=0 tx=0).stop 2024-04-23T18:30:31.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/3622059868 shutdown_connections 2024-04-23T18:30:31.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 --2- 172.21.15.119:0/3622059868 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe608036e60 0x7fe608039320 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 --2- 172.21.15.119:0/3622059868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcd595f0 0x55eefcd59a10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/3622059868 >> 172.21.15.119:0/3622059868 conn(0x55eefcd4d690 msgr2=0x55eefcd4da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:31.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/3622059868 shutdown_connections 2024-04-23T18:30:31.138 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/3622059868 wait complete. 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55eefcd485c0 msgr2=0x55eefcd4aa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55eefcd485c0 0x55eefcd4aa30 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55eefcc44420 msgr2=0x55eefcd41df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55eefcc44420 0x55eefcd41df0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55eefcd446d0 msgr2=0x55eefcd46ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55eefcd446d0 0x55eefcd46ac0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe614036e60 msgr2=0x7fe614039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe614036e60 0x7fe614039320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe718054000 tx=0x7fe71804e000 comp rx=0 tx=0).stop 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc3ff90 msgr2=0x55eefcd3ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 --2- 172.21.15.119:0/82534943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55eefcc3ff90 0x55eefcd3ad80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe720000c00 tx=0x7fe720000ed0 comp rx=0 tx=0).stop 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe72eb3f640 1 -- 172.21.15.119:0/82534943 reap_dead start 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 shutdown_connections 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 >> 172.21.15.119:0/82534943 conn(0x55eefcc3b550 msgr2=0x55eefcd2c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 shutdown_connections 2024-04-23T18:30:31.139 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:31.131+0000 7fe73083f800 1 -- 172.21.15.119:0/82534943 wait complete. 2024-04-23T18:30:31.140 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-23T18:30:30.951195Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:30:30.951182Z', 'tags': [], 'group_ids': []} 2024-04-23T18:30:36.147 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:30:36.147 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-23T18:30:36.148 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-23T18:30:36.148 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-23T18:30:36.148 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-04-23T18:30:36.210 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:30:36.210 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:30:36.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.215+0000 7fb611ba2800 1 Processor -- start 2024-04-23T18:30:36.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.215+0000 7fb611ba2800 1 -- start start 2024-04-23T18:30:36.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.215+0000 7fb611ba2800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559ef7c633f0 0x559ef7c657e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.215+0000 7fb611ba2800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559ef7b0f560 con 0x559ef7c5efb0 2024-04-23T18:30:36.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.215+0000 7fb611ba2800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x559ef7b00e20 con 0x559ef7c633f0 2024-04-23T18:30:36.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.215+0000 7fb60eea0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559ef7c633f0 0x559ef7c657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.215+0000 7fb60f6a1640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x559ef7c5efb0 0x559ef7c5f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:39402/0 (socket says 172.21.15.119:39402) 2024-04-23T18:30:36.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.215+0000 7fb60f6a1640 1 -- 172.21.15.119:0/3412672327 learned_addr learned my addr 172.21.15.119:0/3412672327 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:30:36.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.216+0000 7fb60eea0640 1 -- 172.21.15.119:0/3412672327 >> v1:172.21.15.62:6789/0 conn(0x559ef7c5efb0 legacy=0x559ef7c5f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.216+0000 7fb60eea0640 1 -- 172.21.15.119:0/3412672327 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef7b0ee60 con 0x559ef7c633f0 2024-04-23T18:30:36.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.218+0000 7fb60eea0640 1 --2- 172.21.15.119:0/3412672327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c633f0 0x559ef7c657e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb60400a470 tx=0x7fb60401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92503bff59e777fb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.218+0000 7fb60e69f640 1 -- 172.21.15.119:0/3412672327 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb604057070 con 0x559ef7c633f0 2024-04-23T18:30:36.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.218+0000 7fb60e69f640 1 -- 172.21.15.119:0/3412672327 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb604052570 con 0x559ef7c633f0 2024-04-23T18:30:36.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.218+0000 7fb60e69f640 1 -- 172.21.15.119:0/3412672327 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb604052870 con 0x559ef7c633f0 2024-04-23T18:30:36.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.218+0000 7fb611ba2800 1 -- 172.21.15.119:0/3412672327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c633f0 msgr2=0x559ef7c657e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.218+0000 7fb611ba2800 1 --2- 172.21.15.119:0/3412672327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c633f0 0x559ef7c657e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb60400a470 tx=0x7fb60401ce90 comp rx=0 tx=0).stop 2024-04-23T18:30:36.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.218+0000 7fb611ba2800 1 -- 172.21.15.119:0/3412672327 shutdown_connections 2024-04-23T18:30:36.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.219+0000 7fb611ba2800 1 --2- 172.21.15.119:0/3412672327 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c633f0 0x559ef7c657e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.219+0000 7fb611ba2800 1 -- 172.21.15.119:0/3412672327 >> 172.21.15.119:0/3412672327 conn(0x559ef7c5a590 msgr2=0x559ef7c5c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.219+0000 7fb611ba2800 1 -- 172.21.15.119:0/3412672327 shutdown_connections 2024-04-23T18:30:36.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.219+0000 7fb611ba2800 1 -- 172.21.15.119:0/3412672327 wait complete. 2024-04-23T18:30:36.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.232+0000 7fb611ba2800 1 Processor -- start 2024-04-23T18:30:36.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.232+0000 7fb611ba2800 1 -- start start 2024-04-23T18:30:36.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.232+0000 7fb611ba2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c5efb0 0x559ef7d50240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.232+0000 7fb611ba2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559ef7baa600 con 0x559ef7c5efb0 2024-04-23T18:30:36.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.232+0000 7fb60f6a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c5efb0 0x559ef7d50240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.232+0000 7fb60f6a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c5efb0 0x559ef7d50240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36350/0 (socket says 172.21.15.119:36350) 2024-04-23T18:30:36.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.232+0000 7fb60f6a1640 1 -- 172.21.15.119:0/4127662912 learned_addr learned my addr 172.21.15.119:0/4127662912 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.233+0000 7fb60f6a1640 1 -- 172.21.15.119:0/4127662912 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef7b20860 con 0x559ef7c5efb0 2024-04-23T18:30:36.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.233+0000 7fb60f6a1640 1 --2- 172.21.15.119:0/4127662912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c5efb0 0x559ef7d50240 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb600001d80 tx=0x7fb600001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30e7104660561c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.233+0000 7fb4fd60a640 1 -- 172.21.15.119:0/4127662912 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb600013030 con 0x559ef7c5efb0 2024-04-23T18:30:36.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.233+0000 7fb4fd60a640 1 -- 172.21.15.119:0/4127662912 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb60000e470 con 0x559ef7c5efb0 2024-04-23T18:30:36.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.233+0000 7fb4fd60a640 1 -- 172.21.15.119:0/4127662912 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb60000e810 con 0x559ef7c5efb0 2024-04-23T18:30:36.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.234+0000 7fb611ba2800 1 -- 172.21.15.119:0/4127662912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c5efb0 msgr2=0x559ef7d50240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.234+0000 7fb611ba2800 1 --2- 172.21.15.119:0/4127662912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c5efb0 0x559ef7d50240 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb600001d80 tx=0x7fb600001e70 comp rx=0 tx=0).stop 2024-04-23T18:30:36.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.234+0000 7fb611ba2800 1 -- 172.21.15.119:0/4127662912 shutdown_connections 2024-04-23T18:30:36.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.234+0000 7fb611ba2800 1 --2- 172.21.15.119:0/4127662912 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c5efb0 0x559ef7d50240 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.234+0000 7fb611ba2800 1 -- 172.21.15.119:0/4127662912 >> 172.21.15.119:0/4127662912 conn(0x559ef7c5a590 msgr2=0x559ef7d4bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.234+0000 7fb611ba2800 1 -- 172.21.15.119:0/4127662912 shutdown_connections 2024-04-23T18:30:36.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.234+0000 7fb611ba2800 1 -- 172.21.15.119:0/4127662912 wait complete. 2024-04-23T18:30:36.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.234+0000 7fb611ba2800 1 Processor -- start 2024-04-23T18:30:36.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.234+0000 7fb611ba2800 1 -- start start 2024-04-23T18:30:36.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.234+0000 7fb611ba2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c5efb0 0x559ef7bd4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.234+0000 7fb611ba2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559ef7c660b0 con 0x559ef7c5efb0 2024-04-23T18:30:36.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.235+0000 7fb60f6a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c5efb0 0x559ef7bd4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.235+0000 7fb60f6a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c5efb0 0x559ef7bd4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36352/0 (socket says 172.21.15.119:36352) 2024-04-23T18:30:36.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.235+0000 7fb60f6a1640 1 -- 172.21.15.119:0/574308245 learned_addr learned my addr 172.21.15.119:0/574308245 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.235+0000 7fb60f6a1640 1 -- 172.21.15.119:0/574308245 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef7b1eeb0 con 0x559ef7c5efb0 2024-04-23T18:30:36.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.235+0000 7fb60f6a1640 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c5efb0 0x559ef7bd4860 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb600004000 tx=0x7fb600000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.235+0000 7fb4fbe07640 1 -- 172.21.15.119:0/574308245 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb600027070 con 0x559ef7c5efb0 2024-04-23T18:30:36.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.235+0000 7fb4fbe07640 1 -- 172.21.15.119:0/574308245 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb600019900 con 0x559ef7c5efb0 2024-04-23T18:30:36.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.235+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ef7bd2f50 con 0x559ef7c5efb0 2024-04-23T18:30:36.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.235+0000 7fb4fbe07640 1 -- 172.21.15.119:0/574308245 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb600019c60 con 0x559ef7c5efb0 2024-04-23T18:30:36.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.235+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ef7bd3470 con 0x559ef7c5efb0 2024-04-23T18:30:36.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.236+0000 7fb4fbe07640 1 -- 172.21.15.119:0/574308245 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb60002a070 con 0x559ef7c5efb0 2024-04-23T18:30:36.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.236+0000 7fb4fbe07640 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4f4036e60 0x7fb4f4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.236+0000 7fb4fbe07640 1 -- 172.21.15.119:0/574308245 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb60001f070 con 0x559ef7c5efb0 2024-04-23T18:30:36.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.237+0000 7fb60eea0640 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4f4036e60 0x7fb4f4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.237+0000 7fb611ba2800 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559ef7c633f0 0x559ef7d61040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.237+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d61580 con 0x559ef7c633f0 2024-04-23T18:30:36.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.237+0000 7fb60fea2640 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559ef7c633f0 0x559ef7d61040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.237+0000 7fb60eea0640 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4f4036e60 0x7fb4f4039320 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb604054000 tx=0x7fb60404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.237+0000 7fb60fea2640 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559ef7c633f0 0x559ef7d61040 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.237+0000 7fb60fea2640 1 -- 172.21.15.119:0/574308245 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7c633f0 2024-04-23T18:30:36.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.237+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d61dd0 con 0x559ef7c633f0 2024-04-23T18:30:36.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.238+0000 7fb60fea2640 1 -- 172.21.15.119:0/574308245 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7c633f0 2024-04-23T18:30:36.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.238+0000 7fb611ba2800 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559ef7d63800 0x559ef7d65c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.238+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d66400 con 0x559ef7d63800 2024-04-23T18:30:36.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.238+0000 7fb60f6a1640 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559ef7d63800 0x559ef7d65c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.238+0000 7fb60f6a1640 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559ef7d63800 0x559ef7d65c70 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.238+0000 7fb60f6a1640 1 -- 172.21.15.119:0/574308245 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb600029030 con 0x559ef7d63800 2024-04-23T18:30:36.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.239+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d62620 con 0x559ef7c633f0 2024-04-23T18:30:36.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.239+0000 7fb60fea2640 1 -- 172.21.15.119:0/574308245 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7c633f0 2024-04-23T18:30:36.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.239+0000 7fb611ba2800 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559ef7d67860 0x559ef7d69cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.239+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d6a430 con 0x559ef7d67860 2024-04-23T18:30:36.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.239+0000 7fb60eea0640 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559ef7d67860 0x559ef7d69cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.239+0000 7fb60eea0640 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559ef7d67860 0x559ef7d69cd0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.240+0000 7fb60eea0640 1 -- 172.21.15.119:0/574308245 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb604052980 con 0x559ef7d67860 2024-04-23T18:30:36.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.240+0000 7fb611ba2800 1 Processor -- start 2024-04-23T18:30:36.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.240+0000 7fb611ba2800 1 -- start start 2024-04-23T18:30:36.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.240+0000 7fb611ba2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d78820 0x559ef7d78c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.240+0000 7fb611ba2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559ef7bd4da0 con 0x559ef7d78820 2024-04-23T18:30:36.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.241+0000 7fb60f6a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d78820 0x559ef7d78c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.241+0000 7fb60f6a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d78820 0x559ef7d78c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36358/0 (socket says 172.21.15.119:36358) 2024-04-23T18:30:36.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.241+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2128754242 learned_addr learned my addr 172.21.15.119:0/2128754242 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.241+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2128754242 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef7d79180 con 0x559ef7d78820 2024-04-23T18:30:36.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.241+0000 7fb60f6a1640 1 --2- 172.21.15.119:0/2128754242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d78820 0x559ef7d78c40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb60000dfd0 tx=0x7fb6000177a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.241+0000 7fb4f9602640 1 -- 172.21.15.119:0/2128754242 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6000441f0 con 0x559ef7d78820 2024-04-23T18:30:36.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.241+0000 7fb4f9602640 1 -- 172.21.15.119:0/2128754242 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb600044390 con 0x559ef7d78820 2024-04-23T18:30:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.241+0000 7fb611ba2800 1 -- 172.21.15.119:0/2128754242 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ef7d79bf0 con 0x559ef7d78820 2024-04-23T18:30:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.241+0000 7fb4f9602640 1 -- 172.21.15.119:0/2128754242 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb60002a580 con 0x559ef7d78820 2024-04-23T18:30:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.241+0000 7fb611ba2800 1 -- 172.21.15.119:0/2128754242 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ef7d7a0f0 con 0x559ef7d78820 2024-04-23T18:30:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.242+0000 7fb4f9602640 1 -- 172.21.15.119:0/2128754242 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb60003b060 con 0x559ef7d78820 2024-04-23T18:30:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.242+0000 7fb4f9602640 1 --2- 172.21.15.119:0/2128754242 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4e8036e60 0x7fb4e8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.242+0000 7fb4f9602640 1 -- 172.21.15.119:0/2128754242 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb600014070 con 0x559ef7d78820 2024-04-23T18:30:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.242+0000 7fb60eea0640 1 --2- 172.21.15.119:0/2128754242 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4e8036e60 0x7fb4e8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.243+0000 7fb611ba2800 1 Processor -- start 2024-04-23T18:30:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.243+0000 7fb611ba2800 1 -- start start 2024-04-23T18:30:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.243+0000 7fb60eea0640 1 --2- 172.21.15.119:0/2128754242 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4e8036e60 0x7fb4e8039320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x559ef7bd3f90 tx=0x7fb604005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.243+0000 7fb611ba2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 0x559ef7d85d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.243+0000 7fb611ba2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559ef7b50df0 con 0x559ef7d85930 2024-04-23T18:30:36.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.243+0000 7fb60f6a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 0x559ef7d85d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.243+0000 7fb60f6a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 0x559ef7d85d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36360/0 (socket says 172.21.15.119:36360) 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.243+0000 7fb60f6a1640 1 -- 172.21.15.119:0/3411911690 learned_addr learned my addr 172.21.15.119:0/3411911690 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.243+0000 7fb60f6a1640 1 -- 172.21.15.119:0/3411911690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef7d86320 con 0x559ef7d85930 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.243+0000 7fb60f6a1640 1 --2- 172.21.15.119:0/3411911690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 0x559ef7d85d50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb60003f220 tx=0x7fb600021430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac0dd25ccec7735 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.244+0000 7fb4f2ffd640 1 -- 172.21.15.119:0/3411911690 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb60005d070 con 0x559ef7d85930 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.244+0000 7fb4f2ffd640 1 -- 172.21.15.119:0/3411911690 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb60000ce70 con 0x559ef7d85930 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.244+0000 7fb4f2ffd640 1 -- 172.21.15.119:0/3411911690 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb60002a850 con 0x559ef7d85930 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.244+0000 7fb611ba2800 1 -- 172.21.15.119:0/3411911690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 msgr2=0x559ef7d85d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.244+0000 7fb611ba2800 1 --2- 172.21.15.119:0/3411911690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 0x559ef7d85d50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb60003f220 tx=0x7fb600021430 comp rx=0 tx=0).stop 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.244+0000 7fb611ba2800 1 -- 172.21.15.119:0/3411911690 shutdown_connections 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.244+0000 7fb611ba2800 1 --2- 172.21.15.119:0/3411911690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 0x559ef7d85d50 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.244+0000 7fb611ba2800 1 -- 172.21.15.119:0/3411911690 >> 172.21.15.119:0/3411911690 conn(0x559ef7d81c50 msgr2=0x559ef7d7fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.244+0000 7fb611ba2800 1 -- 172.21.15.119:0/3411911690 shutdown_connections 2024-04-23T18:30:36.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.244+0000 7fb611ba2800 1 -- 172.21.15.119:0/3411911690 wait complete. 2024-04-23T18:30:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.245+0000 7fb611ba2800 1 Processor -- start 2024-04-23T18:30:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.245+0000 7fb611ba2800 1 -- start start 2024-04-23T18:30:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.245+0000 7fb611ba2800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 0x559ef7d8cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.245+0000 7fb611ba2800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559ef7d868c0 con 0x559ef7d85930 2024-04-23T18:30:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.245+0000 7fb60f6a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 0x559ef7d8cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.245+0000 7fb60f6a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 0x559ef7d8cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36370/0 (socket says 172.21.15.119:36370) 2024-04-23T18:30:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.245+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 learned_addr learned my addr 172.21.15.119:0/2818013272 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.246+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef7d8d190 con 0x559ef7d85930 2024-04-23T18:30:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.246+0000 7fb60f6a1640 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 0x559ef7d8cc50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb600021530 tx=0x7fb600015fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.246+0000 7fb4f17fa640 1 -- 172.21.15.119:0/2818013272 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb600068020 con 0x559ef7d85930 2024-04-23T18:30:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.246+0000 7fb4f17fa640 1 -- 172.21.15.119:0/2818013272 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb60002c920 con 0x559ef7d85930 2024-04-23T18:30:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.246+0000 7fb4f17fa640 1 -- 172.21.15.119:0/2818013272 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb60005d040 con 0x559ef7d85930 2024-04-23T18:30:36.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.246+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ef7d8d190 con 0x559ef7d85930 2024-04-23T18:30:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.246+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ef7d8d190 con 0x559ef7d85930 2024-04-23T18:30:36.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.247+0000 7fb4f17fa640 1 -- 172.21.15.119:0/2818013272 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb60006b020 con 0x559ef7d85930 2024-04-23T18:30:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.247+0000 7fb4f17fa640 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4d8036e60 0x7fb4d8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.247+0000 7fb4f17fa640 1 -- 172.21.15.119:0/2818013272 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb60006ed10 con 0x559ef7d85930 2024-04-23T18:30:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.247+0000 7fb60eea0640 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4d8036e60 0x7fb4d8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.248+0000 7fb611ba2800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.248+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559ef7d98320 0x559ef7d9a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.248+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9af30 con 0x559ef7d98320 2024-04-23T18:30:36.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.248+0000 7fb60eea0640 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4d8036e60 0x7fb4d8039320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb60401ced0 tx=0x7fb60404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.248+0000 7fb60fea2640 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559ef7d98320 0x559ef7d9a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.248+0000 7fb60fea2640 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559ef7d98320 0x559ef7d9a7e0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.248+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7d98320 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.248+0000 7fb611ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.248+0000 7fb611ba2800 20 realm 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.248+0000 7fb611ba2800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.248+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9b340 con 0x559ef7d98320 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7d98320 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb611ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb611ba2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb611ba2800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bc10 con 0x559ef7d98320 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7d98320 2024-04-23T18:30:36.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb611ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb611ba2800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d98320 2024-04-23T18:30:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7d98320 2024-04-23T18:30:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb611ba2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb611ba2800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559ef7d9cd10 0x559ef7d9f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9f750 con 0x559ef7d9cd10 2024-04-23T18:30:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.249+0000 7fb60f6a1640 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559ef7d9cd10 0x559ef7d9f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.250+0000 7fb60f6a1640 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559ef7d9cd10 0x559ef7d9f100 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.250+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb600029030 con 0x559ef7d9cd10 2024-04-23T18:30:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.250+0000 7fb611ba2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:30:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.250+0000 7fb611ba2800 20 searching for the correct realm 2024-04-23T18:30:36.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.250+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559ef7da1720 0x559ef7da3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.250+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da4260 con 0x559ef7da1720 2024-04-23T18:30:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.250+0000 7fb60eea0640 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559ef7da1720 0x559ef7da3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.250+0000 7fb60eea0640 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559ef7da1720 0x559ef7da3be0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.251+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.251+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da4260 con 0x559ef7d9cd10 2024-04-23T18:30:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.251+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb600029030 con 0x559ef7d9cd10 2024-04-23T18:30:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.251+0000 7fb60f6a1640 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb60006d020 0x7fb600005850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.251+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da4260 con 0x7fb60006d020 2024-04-23T18:30:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.251+0000 7fb60fea2640 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb60006d020 0x7fb600005850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.252+0000 7fb60fea2640 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb60006d020 0x7fb600005850 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.252+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb60800a4a0 con 0x7fb60006d020 2024-04-23T18:30:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.252+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d98320 2024-04-23T18:30:36.261 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.252+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7d98320 2024-04-23T18:30:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.252+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d98320 2024-04-23T18:30:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.253+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7d98320 2024-04-23T18:30:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.253+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x7fb60006d020 2024-04-23T18:30:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.253+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb60800a4a0 con 0x7fb60006d020 2024-04-23T18:30:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.253+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x7fb60006d020 2024-04-23T18:30:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.253+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb60800a4a0 con 0x7fb60006d020 2024-04-23T18:30:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.253+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d9cd10 2024-04-23T18:30:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.254+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb600029030 con 0x559ef7d9cd10 2024-04-23T18:30:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.254+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7da1720 2024-04-23T18:30:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.254+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.254+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d98320 2024-04-23T18:30:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.254+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7d98320 2024-04-23T18:30:36.262 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.254+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x7fb60006d020 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.254+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb60800a4a0 con 0x7fb60006d020 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.254+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d98320 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.255+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7d98320 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.255+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d9cd10 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.255+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb600029030 con 0x559ef7d9cd10 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.255+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7da1720 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.255+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.255+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7da1720 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.255+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.255+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x7fb60006d020 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.256+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb60800a4a0 con 0x7fb60006d020 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.256+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7da1720 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.256+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.263 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.256+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7da1720 2024-04-23T18:30:36.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.256+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.256+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d98320 2024-04-23T18:30:36.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.257+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7d98320 2024-04-23T18:30:36.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.257+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d98320 2024-04-23T18:30:36.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.257+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7d98320 2024-04-23T18:30:36.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.257+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x7fb60006d020 2024-04-23T18:30:36.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.257+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb60800a4a0 con 0x7fb60006d020 2024-04-23T18:30:36.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.257+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7da1720 2024-04-23T18:30:36.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.257+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.257+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d9cd10 2024-04-23T18:30:36.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.258+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb600029030 con 0x559ef7d9cd10 2024-04-23T18:30:36.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.258+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d98320 2024-04-23T18:30:36.264 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.258+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb60800a4a0 con 0x559ef7d98320 2024-04-23T18:30:36.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.258+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d9cd10 2024-04-23T18:30:36.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.258+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb600029030 con 0x559ef7d9cd10 2024-04-23T18:30:36.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.258+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7da1720 2024-04-23T18:30:36.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.258+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.258+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x7fb60006d020 2024-04-23T18:30:36.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.259+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb60800a4a0 con 0x7fb60006d020 2024-04-23T18:30:36.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.259+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d9cd10 2024-04-23T18:30:36.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.259+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb600089040 con 0x559ef7d9cd10 2024-04-23T18:30:36.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.259+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7da1720 2024-04-23T18:30:36.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.259+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.259+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x7fb60006d020 2024-04-23T18:30:36.265 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.260+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb60800a4a0 con 0x7fb60006d020 2024-04-23T18:30:36.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.260+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d98320 2024-04-23T18:30:36.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.260+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb608040080 con 0x559ef7d98320 2024-04-23T18:30:36.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.260+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9bfb0 con 0x559ef7d9cd10 2024-04-23T18:30:36.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.260+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb600089040 con 0x559ef7d9cd10 2024-04-23T18:30:36.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.260+0000 7fb611ba2800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:30:36.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.260+0000 7fb611ba2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:30:36.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.260+0000 7fb611ba2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:30:36.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.260+0000 7fb611ba2800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:30:36.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.260+0000 7fb611ba2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:30:36.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.260+0000 7fb611ba2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:30:36.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.260+0000 7fb611ba2800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.266 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.260+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da0010 con 0x559ef7d98320 2024-04-23T18:30:36.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.261+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb608040080 con 0x559ef7d98320 2024-04-23T18:30:36.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.261+0000 7fb611ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.261+0000 7fb611ba2800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.261+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da0400 con 0x559ef7d98320 2024-04-23T18:30:36.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.261+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb608040080 con 0x559ef7d98320 2024-04-23T18:30:36.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.261+0000 7fb611ba2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:36.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.261+0000 7fb611ba2800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.261+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da0400 con 0x7fb60006d020 2024-04-23T18:30:36.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.261+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.261+0000 7fb611ba2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:30:36.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 20 zone default found 2024-04-23T18:30:36.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 4 Realm: () 2024-04-23T18:30:36.267 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:30:36.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:30:36.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:30:36.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 20 zonegroup default 2024-04-23T18:30:36.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7d9fc40 con 0x559ef7d9cd10 2024-04-23T18:30:36.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb600089040 con 0x559ef7d9cd10 2024-04-23T18:30:36.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da6110 con 0x559ef7da1720 2024-04-23T18:30:36.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da65a0 con 0x559ef7da1720 2024-04-23T18:30:36.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 20 started sync module instance, tier type = 2024-04-23T18:30:36.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:30:36.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.262+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da5560 con 0x559ef7d9cd10 2024-04-23T18:30:36.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.263+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb600089040 con 0x559ef7d9cd10 2024-04-23T18:30:36.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.263+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94141251475792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da6e90 con 0x559ef7d9cd10 2024-04-23T18:30:36.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.263+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da76e0 con 0x559ef7d98320 2024-04-23T18:30:36.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.264+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94141251475792] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb600089040 con 0x559ef7d9cd10 2024-04-23T18:30:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.265+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x559ef7d98320 2024-04-23T18:30:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.265+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94141251480032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da73b0 con 0x559ef7d98320 2024-04-23T18:30:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.265+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da7ed0 con 0x559ef7da1720 2024-04-23T18:30:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.266+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94141251480032] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x559ef7d98320 2024-04-23T18:30:36.277 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.267+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.267+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94141251484064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da82c0 con 0x559ef7da1720 2024-04-23T18:30:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.267+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da8d00 con 0x559ef7d9cd10 2024-04-23T18:30:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.268+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94141251484064] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.268+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb600089040 con 0x559ef7d9cd10 2024-04-23T18:30:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.268+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94141251487696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da90f0 con 0x559ef7d9cd10 2024-04-23T18:30:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.268+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da9b30 con 0x559ef7d98320 2024-04-23T18:30:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.269+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94141251487696] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb600089040 con 0x559ef7d9cd10 2024-04-23T18:30:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.269+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x559ef7d98320 2024-04-23T18:30:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.269+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94141251491328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da9af0 con 0x559ef7d98320 2024-04-23T18:30:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.269+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7daa540 con 0x7fb60006d020 2024-04-23T18:30:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.270+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94141251491328] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x559ef7d98320 2024-04-23T18:30:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.270+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.278 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.270+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94141251481088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7daa540 con 0x7fb60006d020 2024-04-23T18:30:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.270+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7daaf80 con 0x7fb60006d020 2024-04-23T18:30:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.271+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94141251481088] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.272+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.272+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94141251494512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7daaf80 con 0x7fb60006d020 2024-04-23T18:30:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.272+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7dab940 con 0x7fb60006d020 2024-04-23T18:30:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.273+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94141251494512] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.273+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.273+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94141251497136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7dab940 con 0x7fb60006d020 2024-04-23T18:30:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.273+0000 7fb611ba2800 20 add_watcher() i=0 2024-04-23T18:30:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.273+0000 7fb611ba2800 20 add_watcher() i=1 2024-04-23T18:30:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.273+0000 7fb611ba2800 20 add_watcher() i=2 2024-04-23T18:30:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.273+0000 7fb611ba2800 20 add_watcher() i=3 2024-04-23T18:30:36.279 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.273+0000 7fb611ba2800 20 add_watcher() i=4 2024-04-23T18:30:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.273+0000 7fb611ba2800 20 add_watcher() i=5 2024-04-23T18:30:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.273+0000 7fb611ba2800 20 add_watcher() i=6 2024-04-23T18:30:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.275+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94141251497136] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.275+0000 7fb611ba2800 20 add_watcher() i=7 2024-04-23T18:30:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.275+0000 7fb611ba2800 2 all 8 watchers are set, enabling cache 2024-04-23T18:30:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.275+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7daeca0 con 0x559ef7d98320 2024-04-23T18:30:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.275+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb608040080 con 0x559ef7d98320 2024-04-23T18:30:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.275+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94141251499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7dabed0 con 0x559ef7d98320 2024-04-23T18:30:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.276+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94141251499520] v34'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb608040080 con 0x559ef7d98320 2024-04-23T18:30:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.276+0000 7fb4c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.276+0000 7fb611ba2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:30:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.276+0000 7fb611ba2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:30:36.280 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.276+0000 7fb611ba2800 5 note: GC not initialized 2024-04-23T18:30:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb4c4fe1640 20 reqs_thread_entry: start 2024-04-23T18:30:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb611ba2800 20 init_complete bucket index max shards: 11 2024-04-23T18:30:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb611ba2800 20 Filter name: none 2024-04-23T18:30:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb43e7fc640 20 reqs_thread_entry: start 2024-04-23T18:30:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb611ba2800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-23T18:30:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb611ba2800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7de24b0 con 0x7fb60006d020 2024-04-23T18:30:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb611ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb611ba2800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-23T18:30:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb611ba2800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-23T18:30:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb611ba2800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-23T18:30:36.281 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb611ba2800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.277+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7de0af0 con 0x7fb60006d020 2024-04-23T18:30:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.278+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.278+0000 7fb611ba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.278+0000 7fb611ba2800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-23T18:30:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.278+0000 7fb611ba2800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-23T18:30:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.278+0000 7fb611ba2800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-23T18:30:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.278+0000 7fb611ba2800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-23T18:30:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.278+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7de13c0 con 0x7fb60006d020 2024-04-23T18:30:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.279+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'7 uv7 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.279+0000 7fb611ba2800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-23T18:30:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.279+0000 7fb611ba2800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-23T18:30:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.279+0000 7fb611ba2800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-23T18:30:36.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.279+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94141251718928 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7de5f50 con 0x7fb60006d020 2024-04-23T18:30:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.280+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== watch-notify(notify (1) cookie 94141251481088 notify 146028888101 ret 0) ==== 598+0+0 (crc 0 0 0) 0x559ef7de1760 con 0x7fb60006d020 2024-04-23T18:30:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.280+0000 7fb4f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 94141251481088 notifier 4735 bl.length()=556 2024-04-23T18:30:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.280+0000 7fb4f2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-23T18:30:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.280+0000 7fb4f2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-23T18:30:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.280+0000 7fb4f2ffd640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb4d4003ea0 con 0x7fb60006d020 2024-04-23T18:30:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.280+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(65 notify.5 [notify cookie 94141251718928 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.280+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.280+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== watch-notify(notify_complete (2) cookie 94141251718928 notify 146028888101 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559ef7de1f00 con 0x7fb60006d020 2024-04-23T18:30:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.280+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7de3a80 con 0x7fb60006d020 2024-04-23T18:30:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.282+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.282+0000 7fb611ba2800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-23T18:30:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.282+0000 7fb611ba2800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-23T18:30:36.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.282+0000 7fb611ba2800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-23T18:30:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.282+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94141251718848 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ef7de5f50 con 0x559ef7da1720 2024-04-23T18:30:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.282+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== watch-notify(notify (1) cookie 94141251484064 notify 146028888070 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fb60408a040 con 0x559ef7da1720 2024-04-23T18:30:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.282+0000 7fb4f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888070 cookie 94141251484064 notifier 4735 bl.length()=177 2024-04-23T18:30:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.282+0000 7fb4f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-23T18:30:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.282+0000 7fb4f27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-23T18:30:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.282+0000 7fb4f27fc640 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb444003400 con 0x559ef7da1720 2024-04-23T18:30:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.282+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(68 notify.2 [notify cookie 94141251718848 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.282+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.282+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== watch-notify(notify_complete (2) cookie 94141251718848 notify 146028888070 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559ef7b0ee60 con 0x559ef7da1720 2024-04-23T18:30:36.284 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-23T18:30:36.280256Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:30:36.280239Z","tags":[],"group_ids":[]} 2024-04-23T18:30:36.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.283+0000 7fb4c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:36.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.283+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94141251499520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7dae350 con 0x559ef7d98320 2024-04-23T18:30:36.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.284+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94141251499520] v34'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb608040080 con 0x559ef7d98320 2024-04-23T18:30:36.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.284+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94141251475792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7dab600 con 0x559ef7d9cd10 2024-04-23T18:30:36.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.285+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94141251475792] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb600089040 con 0x559ef7d9cd10 2024-04-23T18:30:36.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.285+0000 7fb611ba2800 20 remove_watcher() i=0 2024-04-23T18:30:36.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.285+0000 7fb611ba2800 2 removed watcher, disabling cache 2024-04-23T18:30:36.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.285+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94141251480032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7dab600 con 0x559ef7d98320 2024-04-23T18:30:36.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.287+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94141251480032] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x559ef7d98320 2024-04-23T18:30:36.290 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.287+0000 7fb611ba2800 20 remove_watcher() i=1 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.287+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94141251484064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da69e0 con 0x559ef7da1720 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.288+0000 7fb60eea0640 1 -- 172.21.15.119:0/2818013272 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94141251484064] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb604081070 con 0x559ef7da1720 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.288+0000 7fb611ba2800 20 remove_watcher() i=2 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.288+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94141251487696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7dab600 con 0x559ef7d9cd10 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.289+0000 7fb60f6a1640 1 -- 172.21.15.119:0/2818013272 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94141251487696] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb600089040 con 0x559ef7d9cd10 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.289+0000 7fb611ba2800 20 remove_watcher() i=3 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.289+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94141251491328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da79a0 con 0x559ef7d98320 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.291+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94141251491328] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x559ef7d98320 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.291+0000 7fb611ba2800 20 remove_watcher() i=4 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.291+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94141251481088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da69e0 con 0x7fb60006d020 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.292+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94141251481088] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.292+0000 7fb611ba2800 20 remove_watcher() i=5 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.292+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94141251494512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7dab600 con 0x7fb60006d020 2024-04-23T18:30:36.291 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.293+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94141251494512] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.293+0000 7fb611ba2800 20 remove_watcher() i=6 2024-04-23T18:30:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.293+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94141251497136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ef7da79a0 con 0x7fb60006d020 2024-04-23T18:30:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94141251497136] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb608040080 con 0x7fb60006d020 2024-04-23T18:30:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 20 remove_watcher() i=7 2024-04-23T18:30:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb60006d020 msgr2=0x7fb600005850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb60006d020 0x7fb600005850 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559ef7d98320 msgr2=0x559ef7d9a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559ef7d98320 0x559ef7d9a7e0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559ef7d9cd10 msgr2=0x559ef7d9f100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559ef7d9cd10 0x559ef7d9f100 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559ef7da1720 msgr2=0x559ef7da3be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x559ef7da1720 0x559ef7da3be0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4d8036e60 msgr2=0x7fb4d8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4d8036e60 0x7fb4d8039320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb60401ced0 tx=0x7fb60404f000 comp rx=0 tx=0).stop 2024-04-23T18:30:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb60fea2640 1 -- 172.21.15.119:0/2818013272 reap_dead start 2024-04-23T18:30:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 msgr2=0x559ef7d8cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 0x559ef7d8cc50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb600021530 tx=0x7fb600015fc0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 shutdown_connections 2024-04-23T18:30:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2818013272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d85930 0x559ef7d8cc50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 >> 172.21.15.119:0/2818013272 conn(0x559ef7d81c50 msgr2=0x559ef7d7f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 shutdown_connections 2024-04-23T18:30:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.294+0000 7fb611ba2800 1 -- 172.21.15.119:0/2818013272 wait complete. 2024-04-23T18:30:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/2128754242 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4e8036e60 msgr2=0x7fb4e8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2128754242 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4e8036e60 0x7fb4e8039320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x559ef7bd3f90 tx=0x7fb604005a00 comp rx=0 tx=0).stop 2024-04-23T18:30:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/2128754242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d78820 msgr2=0x559ef7d78c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2128754242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d78820 0x559ef7d78c40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb60000dfd0 tx=0x7fb6000177a0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/2128754242 shutdown_connections 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2128754242 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4e8036e60 0x7fb4e8039320 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 --2- 172.21.15.119:0/2128754242 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7d78820 0x559ef7d78c40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/2128754242 >> 172.21.15.119:0/2128754242 conn(0x559ef7d6c8c0 msgr2=0x559ef7d6ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/2128754242 shutdown_connections 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/2128754242 wait complete. 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559ef7d67860 msgr2=0x559ef7d69cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559ef7d67860 0x559ef7d69cd0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559ef7c633f0 msgr2=0x559ef7d61040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559ef7c633f0 0x559ef7d61040 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559ef7d63800 msgr2=0x559ef7d65c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559ef7d63800 0x559ef7d65c70 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4f4036e60 msgr2=0x7fb4f4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb4f4036e60 0x7fb4f4039320 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb604054000 tx=0x7fb60404e000 comp rx=0 tx=0).stop 2024-04-23T18:30:36.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c5efb0 msgr2=0x559ef7bd4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 --2- 172.21.15.119:0/574308245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ef7c5efb0 0x559ef7bd4860 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb600004000 tx=0x7fb600000bc0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb60fea2640 1 -- 172.21.15.119:0/574308245 reap_dead start 2024-04-23T18:30:36.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 shutdown_connections 2024-04-23T18:30:36.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 >> 172.21.15.119:0/574308245 conn(0x559ef7c5a590 msgr2=0x559ef7d4ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 shutdown_connections 2024-04-23T18:30:36.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.295+0000 7fb611ba2800 1 -- 172.21.15.119:0/574308245 wait complete. 2024-04-23T18:30:36.296 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-23T18:30:36.280256Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:30:36.280239Z', 'tags': [], 'group_ids': []} 2024-04-23T18:30:36.314 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:30:36.318 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-04-23T18:30:36.319 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-23T18:30:36.319 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-23T18:30:36.319 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-04-23T18:30:36.363 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:30:36.364 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:30:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.371+0000 7f3f0b616800 1 Processor -- start 2024-04-23T18:30:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.371+0000 7f3f0b616800 1 -- start start 2024-04-23T18:30:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.371+0000 7f3f0b616800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557e27ae33c0 0x557e27ae57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.371+0000 7f3f0b616800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557e2798f560 con 0x557e27adef80 2024-04-23T18:30:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.371+0000 7f3f0b616800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x557e27980e20 con 0x557e27ae33c0 2024-04-23T18:30:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.371+0000 7f3f06483640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557e27ae33c0 0x557e27ae57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.371+0000 7f3f06483640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557e27ae33c0 0x557e27ae57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36380/0 (socket says 172.21.15.119:36380) 2024-04-23T18:30:36.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.371+0000 7f3f06483640 1 -- 172.21.15.119:0/1538986937 learned_addr learned my addr 172.21.15.119:0/1538986937 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.372+0000 7f3f06483640 1 -- 172.21.15.119:0/1538986937 >> v1:172.21.15.62:6789/0 conn(0x557e27adef80 legacy=0x557e27adf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.372+0000 7f3f06483640 1 -- 172.21.15.119:0/1538986937 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e2798ee60 con 0x557e27ae33c0 2024-04-23T18:30:36.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.373+0000 7f3f06483640 1 --2- 172.21.15.119:0/1538986937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27ae33c0 0x557e27ae57b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800a520 tx=0x7f3ef801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a146942cbc3c4cfb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.374+0000 7f3f05c82640 1 -- 172.21.15.119:0/1538986937 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef8057070 con 0x557e27ae33c0 2024-04-23T18:30:36.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.374+0000 7f3f05c82640 1 -- 172.21.15.119:0/1538986937 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef8052570 con 0x557e27ae33c0 2024-04-23T18:30:36.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.374+0000 7f3f05c82640 1 -- 172.21.15.119:0/1538986937 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef804ae60 con 0x557e27ae33c0 2024-04-23T18:30:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.374+0000 7f3f0b616800 1 -- 172.21.15.119:0/1538986937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27ae33c0 msgr2=0x557e27ae57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.374+0000 7f3f0b616800 1 --2- 172.21.15.119:0/1538986937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27ae33c0 0x557e27ae57b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800a520 tx=0x7f3ef801d010 comp rx=0 tx=0).stop 2024-04-23T18:30:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.374+0000 7f3f0b616800 1 -- 172.21.15.119:0/1538986937 shutdown_connections 2024-04-23T18:30:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.374+0000 7f3f0b616800 1 --2- 172.21.15.119:0/1538986937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27ae33c0 0x557e27ae57b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.374+0000 7f3f0b616800 1 -- 172.21.15.119:0/1538986937 >> 172.21.15.119:0/1538986937 conn(0x557e27ada560 msgr2=0x557e27adc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.374+0000 7f3f0b616800 1 -- 172.21.15.119:0/1538986937 shutdown_connections 2024-04-23T18:30:36.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.374+0000 7f3f0b616800 1 -- 172.21.15.119:0/1538986937 wait complete. 2024-04-23T18:30:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.386+0000 7f3f0b616800 1 Processor -- start 2024-04-23T18:30:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.386+0000 7f3f0b616800 1 -- start start 2024-04-23T18:30:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.386+0000 7f3f0b616800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27adef80 0x557e27bd0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.386+0000 7f3f0b616800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557e27a2a5d0 con 0x557e27adef80 2024-04-23T18:30:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.386+0000 7f3f06c84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27adef80 0x557e27bd0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.386+0000 7f3f06c84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27adef80 0x557e27bd0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36396/0 (socket says 172.21.15.119:36396) 2024-04-23T18:30:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.386+0000 7f3f06c84640 1 -- 172.21.15.119:0/3356437731 learned_addr learned my addr 172.21.15.119:0/3356437731 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.387+0000 7f3f06c84640 1 -- 172.21.15.119:0/3356437731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e279a0860 con 0x557e27adef80 2024-04-23T18:30:36.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.387+0000 7f3f06c84640 1 --2- 172.21.15.119:0/3356437731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27adef80 0x557e27bd0150 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0001d00 tx=0x7f3ef000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb2d4d9d8a0eb62 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.387+0000 7f3df4e09640 1 -- 172.21.15.119:0/3356437731 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef000f400 con 0x557e27adef80 2024-04-23T18:30:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.387+0000 7f3df4e09640 1 -- 172.21.15.119:0/3356437731 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef0001e50 con 0x557e27adef80 2024-04-23T18:30:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.387+0000 7f3df4e09640 1 -- 172.21.15.119:0/3356437731 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef000f600 con 0x557e27adef80 2024-04-23T18:30:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.388+0000 7f3f0b616800 1 -- 172.21.15.119:0/3356437731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27adef80 msgr2=0x557e27bd0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.388+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3356437731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27adef80 0x557e27bd0150 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0001d00 tx=0x7f3ef000b5b0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.388+0000 7f3f0b616800 1 -- 172.21.15.119:0/3356437731 shutdown_connections 2024-04-23T18:30:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.388+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3356437731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27adef80 0x557e27bd0150 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.388+0000 7f3f0b616800 1 -- 172.21.15.119:0/3356437731 >> 172.21.15.119:0/3356437731 conn(0x557e27ada560 msgr2=0x557e27bcba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.388+0000 7f3f0b616800 1 -- 172.21.15.119:0/3356437731 shutdown_connections 2024-04-23T18:30:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.388+0000 7f3f0b616800 1 -- 172.21.15.119:0/3356437731 wait complete. 2024-04-23T18:30:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.388+0000 7f3f0b616800 1 Processor -- start 2024-04-23T18:30:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.388+0000 7f3f0b616800 1 -- start start 2024-04-23T18:30:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.388+0000 7f3f0b616800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27adef80 0x557e27bd7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.388+0000 7f3f0b616800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557e27ae6080 con 0x557e27adef80 2024-04-23T18:30:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.389+0000 7f3f06c84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27adef80 0x557e27bd7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.389+0000 7f3f06c84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27adef80 0x557e27bd7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36408/0 (socket says 172.21.15.119:36408) 2024-04-23T18:30:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.389+0000 7f3f06c84640 1 -- 172.21.15.119:0/3540364362 learned_addr learned my addr 172.21.15.119:0/3540364362 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.389+0000 7f3f06c84640 1 -- 172.21.15.119:0/3540364362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e2799eeb0 con 0x557e27adef80 2024-04-23T18:30:36.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.389+0000 7f3f06c84640 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27adef80 0x557e27bd7ae0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0002000 tx=0x7f3ef0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.389+0000 7f3df3606640 1 -- 172.21.15.119:0/3540364362 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef001a5b0 con 0x557e27adef80 2024-04-23T18:30:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.389+0000 7f3df3606640 1 -- 172.21.15.119:0/3540364362 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef001a750 con 0x557e27adef80 2024-04-23T18:30:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.389+0000 7f3df3606640 1 -- 172.21.15.119:0/3540364362 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef001aab0 con 0x557e27adef80 2024-04-23T18:30:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.389+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e27bd8020 con 0x557e27adef80 2024-04-23T18:30:36.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.389+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e27bd85a0 con 0x557e27adef80 2024-04-23T18:30:36.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.390+0000 7f3df3606640 1 -- 172.21.15.119:0/3540364362 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3ef0017070 con 0x557e27adef80 2024-04-23T18:30:36.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.390+0000 7f3df3606640 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3dec036eb0 0x7f3dec039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.390+0000 7f3df3606640 1 -- 172.21.15.119:0/3540364362 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f3ef0015020 con 0x557e27adef80 2024-04-23T18:30:36.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.390+0000 7f3f06483640 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3dec036eb0 0x7f3dec039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.391+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557e27ae33c0 0x557e27bdebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.391+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27bdf0f0 con 0x557e27ae33c0 2024-04-23T18:30:36.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.391+0000 7f3f07485640 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557e27ae33c0 0x557e27bdebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.391+0000 7f3f06483640 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3dec036eb0 0x7f3dec039370 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8054000 tx=0x7f3ef804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.391+0000 7f3f07485640 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557e27ae33c0 0x557e27bdebb0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.391+0000 7f3f07485640 1 -- 172.21.15.119:0/3540364362 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27ae33c0 2024-04-23T18:30:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.391+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27bdc180 con 0x557e27ae33c0 2024-04-23T18:30:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.391+0000 7f3f07485640 1 -- 172.21.15.119:0/3540364362 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27ae33c0 2024-04-23T18:30:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.391+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557e27be1420 0x557e27be3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.391+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27be3f00 con 0x557e27be1420 2024-04-23T18:30:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.392+0000 7f3f06c84640 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557e27be1420 0x557e27be3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.392+0000 7f3f06c84640 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557e27be1420 0x557e27be3810 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.392+0000 7f3f06c84640 1 -- 172.21.15.119:0/3540364362 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3ef002e070 con 0x557e27be1420 2024-04-23T18:30:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.392+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27be03d0 con 0x557e27ae33c0 2024-04-23T18:30:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.392+0000 7f3f07485640 1 -- 172.21.15.119:0/3540364362 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27ae33c0 2024-04-23T18:30:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.392+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x557e27be53b0 0x557e27be7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.392+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27be7f60 con 0x557e27be53b0 2024-04-23T18:30:36.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.393+0000 7f3f06483640 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x557e27be53b0 0x557e27be7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.393+0000 7f3f06483640 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x557e27be53b0 0x557e27be7800 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.394+0000 7f3f06483640 1 -- 172.21.15.119:0/3540364362 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3ef805a040 con 0x557e27be53b0 2024-04-23T18:30:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.394+0000 7f3f0b616800 1 Processor -- start 2024-04-23T18:30:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.394+0000 7f3f0b616800 1 -- start start 2024-04-23T18:30:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.394+0000 7f3f0b616800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27bf63c0 0x557e27bf67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.394+0000 7f3f0b616800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557e279d0df0 con 0x557e27bf63c0 2024-04-23T18:30:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.394+0000 7f3f06c84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27bf63c0 0x557e27bf67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.394+0000 7f3f06c84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27bf63c0 0x557e27bf67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36412/0 (socket says 172.21.15.119:36412) 2024-04-23T18:30:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.394+0000 7f3f06c84640 1 -- 172.21.15.119:0/3401030960 learned_addr learned my addr 172.21.15.119:0/3401030960 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.395+0000 7f3f06c84640 1 -- 172.21.15.119:0/3401030960 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e27bf6d20 con 0x557e27bf63c0 2024-04-23T18:30:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.395+0000 7f3f06c84640 1 --2- 172.21.15.119:0/3401030960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27bf63c0 0x557e27bf67e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3ef004b6d0 tx=0x7f3ef003ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.395+0000 7f3df0e01640 1 -- 172.21.15.119:0/3401030960 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef002c040 con 0x557e27bf63c0 2024-04-23T18:30:36.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.395+0000 7f3df0e01640 1 -- 172.21.15.119:0/3401030960 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef0017490 con 0x557e27bf63c0 2024-04-23T18:30:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.395+0000 7f3f0b616800 1 -- 172.21.15.119:0/3401030960 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e27bf7790 con 0x557e27bf63c0 2024-04-23T18:30:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.395+0000 7f3df0e01640 1 -- 172.21.15.119:0/3401030960 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef0044e60 con 0x557e27bf63c0 2024-04-23T18:30:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.395+0000 7f3f0b616800 1 -- 172.21.15.119:0/3401030960 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e27bf7790 con 0x557e27bf63c0 2024-04-23T18:30:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.396+0000 7f3df0e01640 1 -- 172.21.15.119:0/3401030960 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3ef000e070 con 0x557e27bf63c0 2024-04-23T18:30:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.396+0000 7f3df0e01640 1 --2- 172.21.15.119:0/3401030960 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3de0036e60 0x7f3de0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.396+0000 7f3df0e01640 1 -- 172.21.15.119:0/3401030960 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f3ef0049470 con 0x557e27bf63c0 2024-04-23T18:30:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.396+0000 7f3f06483640 1 --2- 172.21.15.119:0/3401030960 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3de0036e60 0x7f3de0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.396+0000 7f3f0b616800 1 Processor -- start 2024-04-23T18:30:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.396+0000 7f3f0b616800 1 -- start start 2024-04-23T18:30:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.396+0000 7f3f06483640 1 --2- 172.21.15.119:0/3401030960 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3de0036e60 0x7f3de0039320 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x557e27bdf9d0 tx=0x7f3ef8005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.396+0000 7f3f0b616800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 0x557e27c03750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.396+0000 7f3f0b616800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557e27bd08d0 con 0x557e27c03330 2024-04-23T18:30:36.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.397+0000 7f3f06c84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 0x557e27c03750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.397+0000 7f3f06c84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 0x557e27c03750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36422/0 (socket says 172.21.15.119:36422) 2024-04-23T18:30:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.397+0000 7f3f06c84640 1 -- 172.21.15.119:0/2226609648 learned_addr learned my addr 172.21.15.119:0/2226609648 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.397+0000 7f3f06c84640 1 -- 172.21.15.119:0/2226609648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e27c03d20 con 0x557e27c03330 2024-04-23T18:30:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.397+0000 7f3f06c84640 1 --2- 172.21.15.119:0/2226609648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 0x557e27c03750 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3ef003bff0 tx=0x7f3ef004b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254d82caf256593e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.397+0000 7f3dea7fc640 1 -- 172.21.15.119:0/2226609648 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef005e070 con 0x557e27c03330 2024-04-23T18:30:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.397+0000 7f3dea7fc640 1 -- 172.21.15.119:0/2226609648 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef0049260 con 0x557e27c03330 2024-04-23T18:30:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.397+0000 7f3dea7fc640 1 -- 172.21.15.119:0/2226609648 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef0053040 con 0x557e27c03330 2024-04-23T18:30:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.398+0000 7f3f0b616800 1 -- 172.21.15.119:0/2226609648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 msgr2=0x557e27c03750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.398+0000 7f3f0b616800 1 --2- 172.21.15.119:0/2226609648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 0x557e27c03750 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3ef003bff0 tx=0x7f3ef004b8e0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.398+0000 7f3f0b616800 1 -- 172.21.15.119:0/2226609648 shutdown_connections 2024-04-23T18:30:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.398+0000 7f3f0b616800 1 --2- 172.21.15.119:0/2226609648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 0x557e27c03750 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.398+0000 7f3f0b616800 1 -- 172.21.15.119:0/2226609648 >> 172.21.15.119:0/2226609648 conn(0x557e27bff690 msgr2=0x557e27bfd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.398+0000 7f3f0b616800 1 -- 172.21.15.119:0/2226609648 shutdown_connections 2024-04-23T18:30:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.398+0000 7f3f0b616800 1 -- 172.21.15.119:0/2226609648 wait complete. 2024-04-23T18:30:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.398+0000 7f3f0b616800 1 Processor -- start 2024-04-23T18:30:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.398+0000 7f3f0b616800 1 -- start start 2024-04-23T18:30:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.398+0000 7f3f0b616800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 0x557e27c0a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.399+0000 7f3f0b616800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557e27c04250 con 0x557e27c03330 2024-04-23T18:30:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.399+0000 7f3f06c84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 0x557e27c0a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.399+0000 7f3f06c84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 0x557e27c0a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:36432/0 (socket says 172.21.15.119:36432) 2024-04-23T18:30:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.399+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 learned_addr learned my addr 172.21.15.119:0/312522637 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.399+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e27c0aad0 con 0x557e27c03330 2024-04-23T18:30:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.399+0000 7f3f06c84640 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 0x557e27c0a590 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3ef001bc80 tx=0x7f3ef00491a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.399+0000 7f3de8ff9640 1 -- 172.21.15.119:0/312522637 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef005e030 con 0x557e27c03330 2024-04-23T18:30:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.399+0000 7f3de8ff9640 1 -- 172.21.15.119:0/312522637 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef0031480 con 0x557e27c03330 2024-04-23T18:30:36.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.399+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e27c0aad0 con 0x557e27c03330 2024-04-23T18:30:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.399+0000 7f3de8ff9640 1 -- 172.21.15.119:0/312522637 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef00445a0 con 0x557e27c03330 2024-04-23T18:30:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.399+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e27c0aad0 con 0x557e27c03330 2024-04-23T18:30:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.400+0000 7f3de8ff9640 1 -- 172.21.15.119:0/312522637 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3ef006c020 con 0x557e27c03330 2024-04-23T18:30:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.400+0000 7f3de8ff9640 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3dd0036e60 0x7f3dd0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.400+0000 7f3de8ff9640 1 -- 172.21.15.119:0/312522637 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f3ef006a020 con 0x557e27c03330 2024-04-23T18:30:36.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.400+0000 7f3f06483640 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3dd0036e60 0x7f3dd0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.401+0000 7f3f0b616800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.401+0000 7f3f0b616800 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557e27c15be0 0x557e27c180a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.401+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27c187f0 con 0x557e27c15be0 2024-04-23T18:30:36.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.401+0000 7f3f06483640 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3dd0036e60 0x7f3dd0039320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8055040 tx=0x7f3ef804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.401+0000 7f3f07485640 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557e27c15be0 0x557e27c180a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.401+0000 7f3f07485640 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557e27c15be0 0x557e27c180a0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.401+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27c15be0 2024-04-23T18:30:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.401+0000 7f3f0b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.401+0000 7f3f0b616800 20 realm 2024-04-23T18:30:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.401+0000 7f3f0b616800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.401+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27c18c00 con 0x557e27c15be0 2024-04-23T18:30:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27c15be0 2024-04-23T18:30:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f0b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f0b616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:30:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f0b616800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27c194d0 con 0x557e27c15be0 2024-04-23T18:30:36.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27c15be0 2024-04-23T18:30:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f0b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f0b616800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c15be0 2024-04-23T18:30:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27c15be0 2024-04-23T18:30:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f0b616800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f0b616800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f0b616800 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557e27c1a5d0 0x557e27c1c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27c1cfd0 con 0x557e27c1a5d0 2024-04-23T18:30:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f06c84640 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557e27c1a5d0 0x557e27c1c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.402+0000 7f3f06c84640 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557e27c1a5d0 0x557e27c1c9c0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.403+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ef0056040 con 0x557e27c1a5d0 2024-04-23T18:30:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.403+0000 7f3f0b616800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:30:36.417 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.403+0000 7f3f0b616800 20 searching for the correct realm 2024-04-23T18:30:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.403+0000 7f3f0b616800 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x557e27c1ef80 0x557e27c21440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.403+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c21b10 con 0x557e27c1ef80 2024-04-23T18:30:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.403+0000 7f3f06483640 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x557e27c1ef80 0x557e27c21440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.403+0000 7f3f06483640 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x557e27c1ef80 0x557e27c21440 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.403+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.403+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c21b10 con 0x557e27c1a5d0 2024-04-23T18:30:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.404+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef0056040 con 0x557e27c1a5d0 2024-04-23T18:30:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.404+0000 7f3f06c84640 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3ef004d530 0x7f3ef0006540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.404+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c21b10 con 0x7f3ef004d530 2024-04-23T18:30:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.404+0000 7f3f07485640 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3ef004d530 0x7f3ef0006540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.418 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.404+0000 7f3f07485640 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3ef004d530 0x7f3ef0006540 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.405+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0000a4a0 con 0x7f3ef004d530 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.405+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c15be0 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.405+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27c15be0 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.405+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c15be0 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.405+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27c15be0 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.405+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x7f3ef004d530 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.405+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0000a4a0 con 0x7f3ef004d530 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.405+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x7f3ef004d530 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.406+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3f0000a4a0 con 0x7f3ef004d530 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.406+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1a5d0 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.406+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef0056040 con 0x557e27c1a5d0 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.406+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1ef80 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.406+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.419 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.406+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c15be0 2024-04-23T18:30:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.406+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27c15be0 2024-04-23T18:30:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.406+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x7f3ef004d530 2024-04-23T18:30:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.407+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0000a4a0 con 0x7f3ef004d530 2024-04-23T18:30:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.407+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c15be0 2024-04-23T18:30:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.407+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27c15be0 2024-04-23T18:30:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.407+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1a5d0 2024-04-23T18:30:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.407+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3ef0056040 con 0x557e27c1a5d0 2024-04-23T18:30:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.407+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1ef80 2024-04-23T18:30:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.407+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.407+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1ef80 2024-04-23T18:30:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.408+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.408+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x7f3ef004d530 2024-04-23T18:30:36.420 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.408+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0000a4a0 con 0x7f3ef004d530 2024-04-23T18:30:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.408+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1ef80 2024-04-23T18:30:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.408+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.408+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1ef80 2024-04-23T18:30:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.408+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.408+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c15be0 2024-04-23T18:30:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.409+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27c15be0 2024-04-23T18:30:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.409+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c15be0 2024-04-23T18:30:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.409+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27c15be0 2024-04-23T18:30:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.409+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x7f3ef004d530 2024-04-23T18:30:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.409+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0000a4a0 con 0x7f3ef004d530 2024-04-23T18:30:36.421 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.409+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1ef80 2024-04-23T18:30:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.409+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.409+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1a5d0 2024-04-23T18:30:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.410+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3ef0056040 con 0x557e27c1a5d0 2024-04-23T18:30:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.410+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c15be0 2024-04-23T18:30:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.410+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0000a4a0 con 0x557e27c15be0 2024-04-23T18:30:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.410+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1a5d0 2024-04-23T18:30:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.410+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef0056040 con 0x557e27c1a5d0 2024-04-23T18:30:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.410+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1ef80 2024-04-23T18:30:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.410+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.410+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x7f3ef004d530 2024-04-23T18:30:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.411+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0000a4a0 con 0x7f3ef004d530 2024-04-23T18:30:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.411+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1a5d0 2024-04-23T18:30:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.411+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef0086040 con 0x557e27c1a5d0 2024-04-23T18:30:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.411+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1ef80 2024-04-23T18:30:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.411+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.411+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x7f3ef004d530 2024-04-23T18:30:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f0000a4a0 con 0x7f3ef004d530 2024-04-23T18:30:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c15be0 2024-04-23T18:30:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3f00040080 con 0x557e27c15be0 2024-04-23T18:30:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557e27c19870 con 0x557e27c1a5d0 2024-04-23T18:30:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ef0086040 con 0x557e27c1a5d0 2024-04-23T18:30:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f0b616800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:30:36.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f0b616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:30:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f0b616800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:30:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f0b616800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:30:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f0b616800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:30:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f0b616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:30:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f0b616800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27c1d890 con 0x557e27c15be0 2024-04-23T18:30:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x557e27c15be0 2024-04-23T18:30:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f0b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f0b616800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27c1dc80 con 0x557e27c15be0 2024-04-23T18:30:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.412+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f00040080 con 0x557e27c15be0 2024-04-23T18:30:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:36.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27c1dc80 con 0x7f3ef004d530 2024-04-23T18:30:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3f00040080 con 0x7f3ef004d530 2024-04-23T18:30:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:30:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 20 zone default found 2024-04-23T18:30:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 4 Realm: () 2024-04-23T18:30:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:30:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:30:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:30:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 20 zonegroup default 2024-04-23T18:30:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27c21f90 con 0x557e27c1a5d0 2024-04-23T18:30:36.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ef0086040 con 0x557e27c1a5d0 2024-04-23T18:30:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27c23d10 con 0x557e27c1ef80 2024-04-23T18:30:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.413+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27c240b0 con 0x557e27c1ef80 2024-04-23T18:30:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.414+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.414+0000 7f3f0b616800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.414+0000 7f3f0b616800 20 started sync module instance, tier type = 2024-04-23T18:30:36.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.414+0000 7f3f0b616800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:30:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.414+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c231b0 con 0x557e27c1a5d0 2024-04-23T18:30:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.415+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef0086040 con 0x557e27c1a5d0 2024-04-23T18:30:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.415+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94000321277184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c24450 con 0x557e27c1a5d0 2024-04-23T18:30:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.415+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c24ce0 con 0x557e27c15be0 2024-04-23T18:30:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.416+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94000321277184] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef0086040 con 0x557e27c1a5d0 2024-04-23T18:30:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.416+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x557e27c15be0 2024-04-23T18:30:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.416+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94000321279440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c24900 con 0x557e27c15be0 2024-04-23T18:30:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.416+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c25790 con 0x557e27c1ef80 2024-04-23T18:30:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.417+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.417+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94000321286816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c26030 con 0x557e27c1ef80 2024-04-23T18:30:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.417+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c26b30 con 0x557e27c1a5d0 2024-04-23T18:30:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.418+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94000321279440] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x557e27c15be0 2024-04-23T18:30:36.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.418+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef0086040 con 0x557e27c1a5d0 2024-04-23T18:30:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.418+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94000321291808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c26f20 con 0x557e27c1a5d0 2024-04-23T18:30:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.418+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c27940 con 0x557e27c15be0 2024-04-23T18:30:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.419+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94000321286816] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.420+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x557e27c15be0 2024-04-23T18:30:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.420+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94000321295408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c27900 con 0x557e27c15be0 2024-04-23T18:30:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.420+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94000321291808] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef0086040 con 0x557e27c1a5d0 2024-04-23T18:30:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.420+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c27ed0 con 0x7f3ef004d530 2024-04-23T18:30:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.421+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x7f3ef004d530 2024-04-23T18:30:36.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.421+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94000321283152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c28380 con 0x7f3ef004d530 2024-04-23T18:30:36.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.421+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c28d40 con 0x7f3ef004d530 2024-04-23T18:30:36.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.421+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94000321295408] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x557e27c15be0 2024-04-23T18:30:36.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.422+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94000321283152] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x7f3ef004d530 2024-04-23T18:30:36.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.422+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x7f3ef004d530 2024-04-23T18:30:36.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.422+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94000321300624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c28380 con 0x7f3ef004d530 2024-04-23T18:30:36.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.422+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c28cb0 con 0x7f3ef004d530 2024-04-23T18:30:36.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.423+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(58 notify.7 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x7f3ef004d530 2024-04-23T18:30:36.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.423+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94000321300624] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x7f3ef004d530 2024-04-23T18:30:36.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.423+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94000321301680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c290d0 con 0x7f3ef004d530 2024-04-23T18:30:36.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.423+0000 7f3f0b616800 20 add_watcher() i=0 2024-04-23T18:30:36.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.423+0000 7f3f0b616800 20 add_watcher() i=1 2024-04-23T18:30:36.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.423+0000 7f3f0b616800 20 add_watcher() i=2 2024-04-23T18:30:36.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.423+0000 7f3f0b616800 20 add_watcher() i=3 2024-04-23T18:30:36.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.423+0000 7f3f0b616800 20 add_watcher() i=4 2024-04-23T18:30:36.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.423+0000 7f3f0b616800 20 add_watcher() i=5 2024-04-23T18:30:36.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.423+0000 7f3f0b616800 20 add_watcher() i=6 2024-04-23T18:30:36.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.424+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94000321301680] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x7f3ef004d530 2024-04-23T18:30:36.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.424+0000 7f3f0b616800 20 add_watcher() i=7 2024-04-23T18:30:36.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.424+0000 7f3f0b616800 2 all 8 watchers are set, enabling cache 2024-04-23T18:30:36.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.424+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27c2c5c0 con 0x557e27c15be0 2024-04-23T18:30:36.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.424+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3f00040080 con 0x557e27c15be0 2024-04-23T18:30:36.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.424+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94000321298128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c29ae0 con 0x557e27c15be0 2024-04-23T18:30:36.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.425+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94000321298128] v34'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x557e27c15be0 2024-04-23T18:30:36.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.425+0000 7f3dbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:36.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.425+0000 7f3f0b616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.425+0000 7f3f0b616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.425+0000 7f3f0b616800 5 note: GC not initialized 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.426+0000 7f3d37fff640 20 reqs_thread_entry: start 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.426+0000 7f3f0b616800 20 init_complete bucket index max shards: 11 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.426+0000 7f3f0b616800 20 Filter name: none 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.426+0000 7f3d35ffb640 20 reqs_thread_entry: start 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.426+0000 7f3f0b616800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.426+0000 7f3f0b616800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.426+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e27c5fdb0 con 0x557e27c1a5d0 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.426+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f3ef0086040 con 0x557e27c1a5d0 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.426+0000 7f3f0b616800 20 rados_obj.operate() r=0 bl.length=380 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.426+0000 7f3f0b616800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.426+0000 7f3f0b616800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.426+0000 7f3f0b616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:30:36.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.426+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c64130 con 0x7f3ef004d530 2024-04-23T18:30:36.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.428+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v34'8 uv7 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x7f3ef004d530 2024-04-23T18:30:36.440 INFO:teuthology.orchestra.run.smithi119.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-04-23T18:30:36.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.428+0000 7f3dbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:36.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.428+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94000321298128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c2bcd0 con 0x557e27c15be0 2024-04-23T18:30:36.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.429+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94000321298128] v34'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x557e27c15be0 2024-04-23T18:30:36.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.429+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94000321277184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c27ed0 con 0x557e27c1a5d0 2024-04-23T18:30:36.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.430+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94000321277184] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef0086040 con 0x557e27c1a5d0 2024-04-23T18:30:36.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.430+0000 7f3f0b616800 20 remove_watcher() i=0 2024-04-23T18:30:36.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.430+0000 7f3f0b616800 2 removed watcher, disabling cache 2024-04-23T18:30:36.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.430+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94000321279440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c22d00 con 0x557e27c15be0 2024-04-23T18:30:36.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.432+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94000321279440] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x557e27c15be0 2024-04-23T18:30:36.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.432+0000 7f3f0b616800 20 remove_watcher() i=1 2024-04-23T18:30:36.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.432+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94000321286816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c22d00 con 0x557e27c1ef80 2024-04-23T18:30:36.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.433+0000 7f3f06483640 1 -- 172.21.15.119:0/312522637 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94000321286816] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef807f070 con 0x557e27c1ef80 2024-04-23T18:30:36.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.433+0000 7f3f0b616800 20 remove_watcher() i=2 2024-04-23T18:30:36.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.433+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94000321291808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c252a0 con 0x557e27c1a5d0 2024-04-23T18:30:36.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.434+0000 7f3f06c84640 1 -- 172.21.15.119:0/312522637 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94000321291808] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ef0086040 con 0x557e27c1a5d0 2024-04-23T18:30:36.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.434+0000 7f3f0b616800 20 remove_watcher() i=3 2024-04-23T18:30:36.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.434+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94000321295408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c26620 con 0x557e27c15be0 2024-04-23T18:30:36.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.435+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94000321295408] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x557e27c15be0 2024-04-23T18:30:36.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.435+0000 7f3f0b616800 20 remove_watcher() i=4 2024-04-23T18:30:36.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.435+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94000321283152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c27430 con 0x7f3ef004d530 2024-04-23T18:30:36.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.436+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94000321283152] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x7f3ef004d530 2024-04-23T18:30:36.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.436+0000 7f3f0b616800 20 remove_watcher() i=5 2024-04-23T18:30:36.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.436+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94000321300624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c27430 con 0x7f3ef004d530 2024-04-23T18:30:36.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.437+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94000321300624] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x7f3ef004d530 2024-04-23T18:30:36.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.437+0000 7f3f0b616800 20 remove_watcher() i=6 2024-04-23T18:30:36.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.437+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94000321301680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557e27c28890 con 0x7f3ef004d530 2024-04-23T18:30:36.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94000321301680] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f00040080 con 0x7f3ef004d530 2024-04-23T18:30:36.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 20 remove_watcher() i=7 2024-04-23T18:30:36.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3ef004d530 msgr2=0x7f3ef0006540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3ef004d530 0x7f3ef0006540 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557e27c15be0 msgr2=0x557e27c180a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557e27c15be0 0x557e27c180a0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557e27c1a5d0 msgr2=0x557e27c1c9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557e27c1a5d0 0x557e27c1c9c0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x557e27c1ef80 msgr2=0x557e27c21440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x557e27c1ef80 0x557e27c21440 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3dd0036e60 msgr2=0x7f3dd0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3dd0036e60 0x7f3dd0039320 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8055040 tx=0x7f3ef804f000 comp rx=0 tx=0).stop 2024-04-23T18:30:36.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 msgr2=0x557e27c0a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f07485640 1 -- 172.21.15.119:0/312522637 reap_dead start 2024-04-23T18:30:36.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 0x557e27c0a590 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3ef001bc80 tx=0x7f3ef00491a0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 shutdown_connections 2024-04-23T18:30:36.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 --2- 172.21.15.119:0/312522637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27c03330 0x557e27c0a590 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 >> 172.21.15.119:0/312522637 conn(0x557e27bff690 msgr2=0x557e27bfccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.438+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 shutdown_connections 2024-04-23T18:30:36.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/312522637 wait complete. 2024-04-23T18:30:36.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3401030960 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3de0036e60 msgr2=0x7f3de0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.443 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3401030960 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3de0036e60 0x7f3de0039320 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x557e27bdf9d0 tx=0x7f3ef8005ac0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3401030960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27bf63c0 msgr2=0x557e27bf67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3401030960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27bf63c0 0x557e27bf67e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3ef004b6d0 tx=0x7f3ef003ff70 comp rx=0 tx=0).stop 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3401030960 shutdown_connections 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3401030960 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3de0036e60 0x7f3de0039320 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3401030960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27bf63c0 0x557e27bf67e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3401030960 >> 172.21.15.119:0/3401030960 conn(0x557e27bea460 msgr2=0x557e27bea860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3401030960 shutdown_connections 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3401030960 wait complete. 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x557e27be53b0 msgr2=0x557e27be7800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x557e27be53b0 0x557e27be7800 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557e27ae33c0 msgr2=0x557e27bdebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x557e27ae33c0 0x557e27bdebb0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557e27be1420 msgr2=0x557e27be3810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.444 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x557e27be1420 0x557e27be3810 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3dec036eb0 msgr2=0x7f3dec039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3dec036eb0 0x7f3dec039370 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8054000 tx=0x7f3ef804e000 comp rx=0 tx=0).stop 2024-04-23T18:30:36.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27adef80 msgr2=0x557e27bd7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 --2- 172.21.15.119:0/3540364362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557e27adef80 0x557e27bd7ae0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0002000 tx=0x7f3ef0000bc0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f07485640 1 -- 172.21.15.119:0/3540364362 reap_dead start 2024-04-23T18:30:36.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 shutdown_connections 2024-04-23T18:30:36.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 >> 172.21.15.119:0/3540364362 conn(0x557e27ada560 msgr2=0x557e27bca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 shutdown_connections 2024-04-23T18:30:36.445 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.439+0000 7f3f0b616800 1 -- 172.21.15.119:0/3540364362 wait complete. 2024-04-23T18:30:36.446 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-23T18:30:36.451 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:30:36.451 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-23T18:30:36.455 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-23T18:30:36.455 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-04-23T18:30:36.455 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-23T18:30:36.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-23T18:30:36.456 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-04-23T18:30:36.499 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:30:36.499 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:30:36.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.506+0000 7fcbbe133800 1 Processor -- start 2024-04-23T18:30:36.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.506+0000 7fcbbe133800 1 -- start start 2024-04-23T18:30:36.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.507+0000 7fcbbe133800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5559defd43d0 0x5559defdced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.507+0000 7fcbbe133800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5559dee84560 con 0x5559defd2890 2024-04-23T18:30:36.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.507+0000 7fcbbe133800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5559dee75e20 con 0x5559defd43d0 2024-04-23T18:30:36.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.507+0000 7fcbb15d0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5559defd43d0 0x5559defdced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.507+0000 7fcbb15d0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5559defd43d0 0x5559defdced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:42294/0 (socket says 172.21.15.119:42294) 2024-04-23T18:30:36.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.507+0000 7fcbb9dd1640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5559defd2890 0x5559defd2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:56744/0 (socket says 172.21.15.119:56744) 2024-04-23T18:30:36.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.507+0000 7fcbb15d0640 1 -- 172.21.15.119:0/2588988107 learned_addr learned my addr 172.21.15.119:0/2588988107 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.507+0000 7fcbb15d0640 1 -- 172.21.15.119:0/2588988107 >> v1:172.21.15.62:6789/0 conn(0x5559defd2890 legacy=0x5559defd2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.507+0000 7fcbb15d0640 1 -- 172.21.15.119:0/2588988107 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559dee83e60 con 0x5559defd43d0 2024-04-23T18:30:36.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.509+0000 7fcbb15d0640 1 --2- 172.21.15.119:0/2588988107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd43d0 0x5559defdced0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcba400a520 tx=0x7fcba401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c17bae4e37fe5b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.509+0000 7fcbb95d0640 1 -- 172.21.15.119:0/2588988107 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcba4057070 con 0x5559defd43d0 2024-04-23T18:30:36.503 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.509+0000 7fcbb95d0640 1 -- 172.21.15.119:0/2588988107 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba4052570 con 0x5559defd43d0 2024-04-23T18:30:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.509+0000 7fcbb95d0640 1 -- 172.21.15.119:0/2588988107 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcba4052870 con 0x5559defd43d0 2024-04-23T18:30:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.510+0000 7fcbbe133800 1 -- 172.21.15.119:0/2588988107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd43d0 msgr2=0x5559defdced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.510+0000 7fcbbe133800 1 --2- 172.21.15.119:0/2588988107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd43d0 0x5559defdced0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcba400a520 tx=0x7fcba401d010 comp rx=0 tx=0).stop 2024-04-23T18:30:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.510+0000 7fcbbe133800 1 -- 172.21.15.119:0/2588988107 shutdown_connections 2024-04-23T18:30:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.510+0000 7fcbbe133800 1 --2- 172.21.15.119:0/2588988107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd43d0 0x5559defdced0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.510+0000 7fcbbe133800 1 -- 172.21.15.119:0/2588988107 >> 172.21.15.119:0/2588988107 conn(0x5559defce430 msgr2=0x5559defd0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.510+0000 7fcbbe133800 1 -- 172.21.15.119:0/2588988107 shutdown_connections 2024-04-23T18:30:36.504 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.510+0000 7fcbbe133800 1 -- 172.21.15.119:0/2588988107 wait complete. 2024-04-23T18:30:36.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.521+0000 7fcbbe133800 1 Processor -- start 2024-04-23T18:30:36.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.522+0000 7fcbbe133800 1 -- start start 2024-04-23T18:30:36.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.522+0000 7fcbbe133800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd2890 0x5559df0c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.522+0000 7fcbbe133800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5559def1f5d0 con 0x5559defd2890 2024-04-23T18:30:36.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.522+0000 7fcbb9dd1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd2890 0x5559df0c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.522+0000 7fcbb9dd1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd2890 0x5559df0c76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:42300/0 (socket says 172.21.15.119:42300) 2024-04-23T18:30:36.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.522+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1035147673 learned_addr learned my addr 172.21.15.119:0/1035147673 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.522+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1035147673 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559dee95860 con 0x5559defd2890 2024-04-23T18:30:36.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.522+0000 7fcbb9dd1640 1 --2- 172.21.15.119:0/1035147673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd2890 0x5559df0c76e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcbac001e90 tx=0x7fcbac00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c5f15ec9bee0b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.523+0000 7fcaa7e07640 1 -- 172.21.15.119:0/1035147673 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac00e5c0 con 0x5559defd2890 2024-04-23T18:30:36.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.523+0000 7fcaa7e07640 1 -- 172.21.15.119:0/1035147673 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac006070 con 0x5559defd2890 2024-04-23T18:30:36.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.523+0000 7fcaa7e07640 1 -- 172.21.15.119:0/1035147673 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac00e890 con 0x5559defd2890 2024-04-23T18:30:36.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.523+0000 7fcbbe133800 1 -- 172.21.15.119:0/1035147673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd2890 msgr2=0x5559df0c76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.523+0000 7fcbbe133800 1 --2- 172.21.15.119:0/1035147673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd2890 0x5559df0c76e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcbac001e90 tx=0x7fcbac00b6c0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.523+0000 7fcbbe133800 1 -- 172.21.15.119:0/1035147673 shutdown_connections 2024-04-23T18:30:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.523+0000 7fcbbe133800 1 --2- 172.21.15.119:0/1035147673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd2890 0x5559df0c76e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.523+0000 7fcbbe133800 1 -- 172.21.15.119:0/1035147673 >> 172.21.15.119:0/1035147673 conn(0x5559defce430 msgr2=0x5559df0c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.523+0000 7fcbbe133800 1 -- 172.21.15.119:0/1035147673 shutdown_connections 2024-04-23T18:30:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.523+0000 7fcbbe133800 1 -- 172.21.15.119:0/1035147673 wait complete. 2024-04-23T18:30:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.524+0000 7fcbbe133800 1 Processor -- start 2024-04-23T18:30:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.524+0000 7fcbbe133800 1 -- start start 2024-04-23T18:30:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.524+0000 7fcbbe133800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd2890 0x5559df0cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.524+0000 7fcbbe133800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5559defdf6f0 con 0x5559defd2890 2024-04-23T18:30:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.524+0000 7fcbb9dd1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd2890 0x5559df0cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.524+0000 7fcbb9dd1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd2890 0x5559df0cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:42312/0 (socket says 172.21.15.119:42312) 2024-04-23T18:30:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.524+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/3575442934 learned_addr learned my addr 172.21.15.119:0/3575442934 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.524+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/3575442934 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559dee93eb0 con 0x5559defd2890 2024-04-23T18:30:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.525+0000 7fcbb9dd1640 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd2890 0x5559df0cf0b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00c010 tx=0x7fcbac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.525+0000 7fcaa6604640 1 -- 172.21.15.119:0/3575442934 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac00f8d0 con 0x5559defd2890 2024-04-23T18:30:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.525+0000 7fcaa6604640 1 -- 172.21.15.119:0/3575442934 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac00fa90 con 0x5559defd2890 2024-04-23T18:30:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.525+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559df0cf5f0 con 0x5559defd2890 2024-04-23T18:30:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.525+0000 7fcaa6604640 1 -- 172.21.15.119:0/3575442934 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac00fdb0 con 0x5559defd2890 2024-04-23T18:30:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.525+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559df0cfb10 con 0x5559defd2890 2024-04-23T18:30:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.526+0000 7fcaa6604640 1 -- 172.21.15.119:0/3575442934 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fcbac017070 con 0x5559defd2890 2024-04-23T18:30:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.526+0000 7fcaa6604640 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcaa0036e60 0x7fcaa0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.526+0000 7fcaa6604640 1 -- 172.21.15.119:0/3575442934 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fcbac015020 con 0x5559defd2890 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.526+0000 7fcbb15d0640 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcaa0036e60 0x7fcaa0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.526+0000 7fcbbe133800 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5559defd43d0 0x5559df0d60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.526+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df0d6650 con 0x5559defd43d0 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.526+0000 7fcbba5d2640 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5559defd43d0 0x5559df0d60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.526+0000 7fcbb15d0640 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcaa0036e60 0x7fcaa0039320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcba4054000 tx=0x7fcba404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.526+0000 7fcbba5d2640 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5559defd43d0 0x5559df0d60d0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.527+0000 7fcbba5d2640 1 -- 172.21.15.119:0/3575442934 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559defd43d0 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.527+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df0d36a0 con 0x5559defd43d0 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.527+0000 7fcbba5d2640 1 -- 172.21.15.119:0/3575442934 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559defd43d0 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.527+0000 7fcbbe133800 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5559df0d89a0 0x5559df0dad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.527+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df0db480 con 0x5559df0d89a0 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.527+0000 7fcbb9dd1640 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5559df0d89a0 0x5559df0dad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.527+0000 7fcbb9dd1640 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5559df0d89a0 0x5559df0dad90 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.528+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/3575442934 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcbac02e070 con 0x5559df0d89a0 2024-04-23T18:30:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.528+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df0d7950 con 0x5559defd43d0 2024-04-23T18:30:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.528+0000 7fcbba5d2640 1 -- 172.21.15.119:0/3575442934 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559defd43d0 2024-04-23T18:30:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.528+0000 7fcbbe133800 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5559df0dc930 0x5559df0ded80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.528+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df0df4e0 con 0x5559df0dc930 2024-04-23T18:30:36.525 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.528+0000 7fcbb15d0640 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5559df0dc930 0x5559df0ded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.529+0000 7fcbb15d0640 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5559df0dc930 0x5559df0ded80 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.529+0000 7fcbb15d0640 1 -- 172.21.15.119:0/3575442934 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcba405a040 con 0x5559df0dc930 2024-04-23T18:30:36.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.529+0000 7fcbbe133800 1 Processor -- start 2024-04-23T18:30:36.557 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.529+0000 7fcbbe133800 1 -- start start 2024-04-23T18:30:36.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.529+0000 7fcbbe133800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0ed940 0x5559df0edd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.529+0000 7fcbbe133800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5559deec5df0 con 0x5559df0ed940 2024-04-23T18:30:36.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.530+0000 7fcbb9dd1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0ed940 0x5559df0edd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.530+0000 7fcbb9dd1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0ed940 0x5559df0edd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:42328/0 (socket says 172.21.15.119:42328) 2024-04-23T18:30:36.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.530+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/3867500139 learned_addr learned my addr 172.21.15.119:0/3867500139 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.530+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/3867500139 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559df0ee2a0 con 0x5559df0ed940 2024-04-23T18:30:36.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.530+0000 7fcbb9dd1640 1 --2- 172.21.15.119:0/3867500139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0ed940 0x5559df0edd60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0012e0 tx=0x7fcbac017d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.530+0000 7fca9f7fe640 1 -- 172.21.15.119:0/3867500139 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac04d1a0 con 0x5559df0ed940 2024-04-23T18:30:36.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.530+0000 7fcbbe133800 1 -- 172.21.15.119:0/3867500139 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559df0eed10 con 0x5559df0ed940 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.530+0000 7fcbbe133800 1 -- 172.21.15.119:0/3867500139 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559df0eed10 con 0x5559df0ed940 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.530+0000 7fca9f7fe640 1 -- 172.21.15.119:0/3867500139 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac04d340 con 0x5559df0ed940 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.531+0000 7fca9f7fe640 1 -- 172.21.15.119:0/3867500139 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac04d9c0 con 0x5559df0ed940 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.531+0000 7fca9f7fe640 1 -- 172.21.15.119:0/3867500139 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fcbac0451b0 con 0x5559df0ed940 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.531+0000 7fca9f7fe640 1 --2- 172.21.15.119:0/3867500139 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fca94036e60 0x7fca94039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.531+0000 7fca9f7fe640 1 -- 172.21.15.119:0/3867500139 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fcbac03dd50 con 0x5559df0ed940 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.532+0000 7fcbb15d0640 1 --2- 172.21.15.119:0/3867500139 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fca94036e60 0x7fca94039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.532+0000 7fcbbe133800 1 Processor -- start 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.532+0000 7fcbbe133800 1 -- start start 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.532+0000 7fcbb15d0640 1 --2- 172.21.15.119:0/3867500139 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fca94036e60 0x7fca94039320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5559df0d6f50 tx=0x7fcba4005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.532+0000 7fcbbe133800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0fa8c0 0x5559df0face0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.532+0000 7fcbbe133800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5559df0c7e60 con 0x5559df0fa8c0 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.532+0000 7fcbb9dd1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0fa8c0 0x5559df0face0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.532+0000 7fcbb9dd1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0fa8c0 0x5559df0face0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:42332/0 (socket says 172.21.15.119:42332) 2024-04-23T18:30:36.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.532+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/496575460 learned_addr learned my addr 172.21.15.119:0/496575460 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.532+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/496575460 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559df0fb2b0 con 0x5559df0fa8c0 2024-04-23T18:30:36.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.533+0000 7fcbb9dd1640 1 --2- 172.21.15.119:0/496575460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0fa8c0 0x5559df0face0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0178a0 tx=0x7fcbac045ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861f9ba871cc8d54 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.533+0000 7fca9d7fa640 1 -- 172.21.15.119:0/496575460 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac05d020 con 0x5559df0fa8c0 2024-04-23T18:30:36.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.533+0000 7fca9d7fa640 1 -- 172.21.15.119:0/496575460 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac042de0 con 0x5559df0fa8c0 2024-04-23T18:30:36.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.533+0000 7fca9d7fa640 1 -- 172.21.15.119:0/496575460 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac045910 con 0x5559df0fa8c0 2024-04-23T18:30:36.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.533+0000 7fcbbe133800 1 -- 172.21.15.119:0/496575460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0fa8c0 msgr2=0x5559df0face0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.533+0000 7fcbbe133800 1 --2- 172.21.15.119:0/496575460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0fa8c0 0x5559df0face0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0178a0 tx=0x7fcbac045ef0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.533+0000 7fcbbe133800 1 -- 172.21.15.119:0/496575460 shutdown_connections 2024-04-23T18:30:36.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.533+0000 7fcbbe133800 1 --2- 172.21.15.119:0/496575460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0fa8c0 0x5559df0face0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.533+0000 7fcbbe133800 1 -- 172.21.15.119:0/496575460 >> 172.21.15.119:0/496575460 conn(0x5559df0f6c20 msgr2=0x5559df0f4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.533+0000 7fcbbe133800 1 -- 172.21.15.119:0/496575460 shutdown_connections 2024-04-23T18:30:36.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.533+0000 7fcbbe133800 1 -- 172.21.15.119:0/496575460 wait complete. 2024-04-23T18:30:36.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.533+0000 7fcbbe133800 1 Processor -- start 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.534+0000 7fcbbe133800 1 -- start start 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.534+0000 7fcbbe133800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0fa8c0 0x5559df101cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.534+0000 7fcbbe133800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5559df0fb960 con 0x5559df0fa8c0 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.534+0000 7fcbb9dd1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0fa8c0 0x5559df101cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.534+0000 7fcbb9dd1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0fa8c0 0x5559df101cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:42344/0 (socket says 172.21.15.119:42344) 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.534+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 learned_addr learned my addr 172.21.15.119:0/1485718349 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.534+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559df1021f0 con 0x5559df0fa8c0 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.534+0000 7fcbb9dd1640 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0fa8c0 0x5559df101cb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0315c0 tx=0x7fcbac028e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.535+0000 7fca8b7fe640 1 -- 172.21.15.119:0/1485718349 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac072070 con 0x5559df0fa8c0 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.535+0000 7fca8b7fe640 1 -- 172.21.15.119:0/1485718349 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac02ae20 con 0x5559df0fa8c0 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.535+0000 7fca8b7fe640 1 -- 172.21.15.119:0/1485718349 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac031c10 con 0x5559df0fa8c0 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.535+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559df1021f0 con 0x5559df0fa8c0 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.535+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559df1021f0 con 0x5559df0fa8c0 2024-04-23T18:30:36.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.535+0000 7fca8b7fe640 1 -- 172.21.15.119:0/1485718349 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fcbac075070 con 0x5559df0fa8c0 2024-04-23T18:30:36.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.536+0000 7fca8b7fe640 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fca84036e60 0x7fca84039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.536+0000 7fca8b7fe640 1 -- 172.21.15.119:0/1485718349 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fcbac06a070 con 0x5559df0fa8c0 2024-04-23T18:30:36.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.536+0000 7fcbb15d0640 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fca84036e60 0x7fca84039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.536+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.536+0000 7fcbbe133800 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5559df10d410 0x5559df10f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.536+0000 7fcbb15d0640 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fca84036e60 0x7fca84039320 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcba4052fd0 tx=0x7fcba404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.536+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df110020 con 0x5559df10d410 2024-04-23T18:30:36.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.536+0000 7fcbba5d2640 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5559df10d410 0x5559df10f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.536+0000 7fcbba5d2640 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5559df10d410 0x5559df10f8d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559df10d410 2024-04-23T18:30:36.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 20 realm 2024-04-23T18:30:36.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df110430 con 0x5559df10d410 2024-04-23T18:30:36.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559df10d410 2024-04-23T18:30:36.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:30:36.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df110d00 con 0x5559df10d410 2024-04-23T18:30:36.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559df10d410 2024-04-23T18:30:36.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df10d410 2024-04-23T18:30:36.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559df10d410 2024-04-23T18:30:36.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5559df111e00 0x5559df1141f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.537+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df114800 con 0x5559df111e00 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.538+0000 7fcbb9dd1640 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5559df111e00 0x5559df1141f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.538+0000 7fcbb9dd1640 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5559df111e00 0x5559df1141f0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.538+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcbac074030 con 0x5559df111e00 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.538+0000 7fcbbe133800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.538+0000 7fcbbe133800 20 searching for the correct realm 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.538+0000 7fcbbe133800 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5559df1167b0 0x5559df118c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.538+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df119340 con 0x5559df1167b0 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.538+0000 7fcbb15d0640 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5559df1167b0 0x5559df118c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.538+0000 7fcbb15d0640 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5559df1167b0 0x5559df118c70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.539+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.564 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.539+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df119340 con 0x5559df111e00 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.539+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac074030 con 0x5559df111e00 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.539+0000 7fcbb9dd1640 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fcbac077060 0x7fcbac059440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.539+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df119340 con 0x7fcbac077060 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.539+0000 7fcbba5d2640 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fcbac077060 0x7fcbac059440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.540+0000 7fcbba5d2640 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fcbac077060 0x7fcbac059440 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.540+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb400a4a0 con 0x7fcbac077060 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.540+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df10d410 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.540+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559df10d410 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.540+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df10d410 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.540+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559df10d410 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.540+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x7fcbac077060 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.541+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb400a4a0 con 0x7fcbac077060 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.541+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x7fcbac077060 2024-04-23T18:30:36.565 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.541+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcbb400a4a0 con 0x7fcbac077060 2024-04-23T18:30:36.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.541+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df111e00 2024-04-23T18:30:36.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.541+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac074030 con 0x5559df111e00 2024-04-23T18:30:36.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.541+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df1167b0 2024-04-23T18:30:36.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.542+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.542+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df10d410 2024-04-23T18:30:36.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.542+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559df10d410 2024-04-23T18:30:36.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.542+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x7fcbac077060 2024-04-23T18:30:36.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.542+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb400a4a0 con 0x7fcbac077060 2024-04-23T18:30:36.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.542+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df10d410 2024-04-23T18:30:36.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.542+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559df10d410 2024-04-23T18:30:36.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.542+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df111e00 2024-04-23T18:30:36.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.542+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcbac074030 con 0x5559df111e00 2024-04-23T18:30:36.566 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.542+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df1167b0 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.543+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.543+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df1167b0 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.543+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.543+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x7fcbac077060 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.543+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb400a4a0 con 0x7fcbac077060 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.543+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df1167b0 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.543+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.543+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df1167b0 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.544+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.544+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df10d410 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.544+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559df10d410 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.544+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df10d410 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.544+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559df10d410 2024-04-23T18:30:36.567 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.544+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x7fcbac077060 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.544+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb400a4a0 con 0x7fcbac077060 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.544+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df1167b0 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.545+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.545+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df111e00 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.545+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcbac074030 con 0x5559df111e00 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.545+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df10d410 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.545+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb400a4a0 con 0x5559df10d410 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.545+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df111e00 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.545+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac074030 con 0x5559df111e00 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.545+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df1167b0 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.546+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.546+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x7fcbac077060 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.546+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb400a4a0 con 0x7fcbac077060 2024-04-23T18:30:36.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.546+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df111e00 2024-04-23T18:30:36.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.546+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.546+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df1167b0 2024-04-23T18:30:36.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.546+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x7fcbac077060 2024-04-23T18:30:36.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb400a4a0 con 0x7fcbac077060 2024-04-23T18:30:36.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df10d410 2024-04-23T18:30:36.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559df1110a0 con 0x5559df111e00 2024-04-23T18:30:36.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbbe133800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:30:36.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbbe133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:30:36.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbbe133800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:30:36.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbbe133800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:30:36.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbbe133800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:30:36.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbbe133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:30:36.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.547+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1150c0 con 0x5559df10d410 2024-04-23T18:30:36.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1154b0 con 0x5559df10d410 2024-04-23T18:30:36.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1154b0 con 0x7fcbac077060 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 20 zone default found 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 4 Realm: () 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 20 zonegroup default 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.548+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1197c0 con 0x5559df111e00 2024-04-23T18:30:36.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.549+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.549+0000 7fcbbe133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.549+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.549+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df11b540 con 0x5559df1167b0 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.549+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.549+0000 7fcbbe133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.549+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.549+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df11b8e0 con 0x5559df1167b0 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.549+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.549+0000 7fcbbe133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.549+0000 7fcbbe133800 20 started sync module instance, tier type = 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.549+0000 7fcbbe133800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.549+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11a9e0 con 0x5559df111e00 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.550+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.550+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93844482925872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11bc80 con 0x5559df111e00 2024-04-23T18:30:36.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.550+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11c550 con 0x5559df10d410 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.551+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93844482925872] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.552+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.552+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93844482928128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11c130 con 0x5559df10d410 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.552+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11d000 con 0x5559df1167b0 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.553+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93844482928128] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.553+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.553+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93844482931840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11c0a0 con 0x5559df1167b0 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.553+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11dec0 con 0x5559df111e00 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.554+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.554+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93844482939888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11e760 con 0x5559df111e00 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.554+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11f230 con 0x5559df10d410 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.554+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93844482931840] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.555+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.555+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93844482944288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11f1f0 con 0x5559df10d410 2024-04-23T18:30:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.555+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93844482939888] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.555+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11fc80 con 0x7fcbac077060 2024-04-23T18:30:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.556+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.556+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93844482941696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11fc80 con 0x7fcbac077060 2024-04-23T18:30:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.556+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df120680 con 0x7fcbac077060 2024-04-23T18:30:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.556+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93844482944288] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.557+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93844482941696] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.558+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.558+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93844482946960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df120190 con 0x7fcbac077060 2024-04-23T18:30:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.558+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df120b50 con 0x7fcbac077060 2024-04-23T18:30:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.559+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93844482946960] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.574 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.559+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.559+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93844482937840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df120b50 con 0x7fcbac077060 2024-04-23T18:30:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.559+0000 7fcbbe133800 20 add_watcher() i=0 2024-04-23T18:30:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.559+0000 7fcbbe133800 20 add_watcher() i=1 2024-04-23T18:30:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.559+0000 7fcbbe133800 20 add_watcher() i=2 2024-04-23T18:30:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.559+0000 7fcbbe133800 20 add_watcher() i=3 2024-04-23T18:30:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.559+0000 7fcbbe133800 20 add_watcher() i=4 2024-04-23T18:30:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.559+0000 7fcbbe133800 20 add_watcher() i=5 2024-04-23T18:30:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.559+0000 7fcbbe133800 20 add_watcher() i=6 2024-04-23T18:30:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.560+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93844482937840] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.560+0000 7fcbbe133800 20 add_watcher() i=7 2024-04-23T18:30:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.560+0000 7fcbbe133800 2 all 8 watchers are set, enabling cache 2024-04-23T18:30:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.560+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df123f90 con 0x5559df10d410 2024-04-23T18:30:36.575 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.560+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.560+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93844482963776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df120d50 con 0x5559df10d410 2024-04-23T18:30:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.561+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93844482963776] v34'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.561+0000 7fca637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.561+0000 7fcbbe133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:30:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.561+0000 7fcbbe133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:30:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.561+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df123250 con 0x5559df10d410 2024-04-23T18:30:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.562+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.576 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.562+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12d200 con 0x7fcbac077060 2024-04-23T18:30:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.564+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.564+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12d620 con 0x5559df1167b0 2024-04-23T18:30:36.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.565+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.565+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12e040 con 0x5559df10d410 2024-04-23T18:30:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.566+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'220 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.566+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12c820 con 0x5559df111e00 2024-04-23T18:30:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.567+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.567+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12c820 con 0x5559df1167b0 2024-04-23T18:30:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.568+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.568+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12eba0 con 0x5559df10d410 2024-04-23T18:30:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.569+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.569+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f050 con 0x7fcbac077060 2024-04-23T18:30:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.570+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.570+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f050 con 0x5559df111e00 2024-04-23T18:30:36.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.571+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.571+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f050 con 0x5559df1167b0 2024-04-23T18:30:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.572+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.572+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f220 con 0x5559df111e00 2024-04-23T18:30:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.573+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.573+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f220 con 0x7fcbac077060 2024-04-23T18:30:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.574+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.574+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f220 con 0x5559df111e00 2024-04-23T18:30:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.575+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.575+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f220 con 0x7fcbac077060 2024-04-23T18:30:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.576+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.576+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f220 con 0x5559df10d410 2024-04-23T18:30:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.577+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'221 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.577+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f220 con 0x5559df1167b0 2024-04-23T18:30:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.578+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'62 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.578+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f910 con 0x5559df111e00 2024-04-23T18:30:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.579+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.579+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12c1a0 con 0x5559df1167b0 2024-04-23T18:30:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.580+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.580+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12c1a0 con 0x5559df10d410 2024-04-23T18:30:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.581+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.581+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12c230 con 0x5559df10d410 2024-04-23T18:30:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.582+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'222 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.582+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12c230 con 0x5559df1167b0 2024-04-23T18:30:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.583+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'63 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.583+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f910 con 0x5559df111e00 2024-04-23T18:30:36.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.584+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.584+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f910 con 0x5559df1167b0 2024-04-23T18:30:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.585+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.585+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f910 con 0x5559df1167b0 2024-04-23T18:30:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.586+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.586+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f910 con 0x5559df1167b0 2024-04-23T18:30:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.587+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.587+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f910 con 0x5559df1167b0 2024-04-23T18:30:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.588+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.585 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.588+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f910 con 0x7fcbac077060 2024-04-23T18:30:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.589+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.589+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f910 con 0x5559df1167b0 2024-04-23T18:30:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.590+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.590+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f910 con 0x7fcbac077060 2024-04-23T18:30:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.591+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'47 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.591+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f910 con 0x5559df1167b0 2024-04-23T18:30:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.592+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'64 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.592+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f910 con 0x7fcbac077060 2024-04-23T18:30:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.593+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.587 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.593+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df12f910 con 0x5559df111e00 2024-04-23T18:30:36.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.594+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.595+0000 7fca627fc640 20 reqs_thread_entry: start 2024-04-23T18:30:36.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.595+0000 7fcbbe133800 20 init_complete bucket index max shards: 11 2024-04-23T18:30:36.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.595+0000 7fcbbe133800 20 Filter name: none 2024-04-23T18:30:36.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.595+0000 7fc9dbfff640 20 reqs_thread_entry: start 2024-04-23T18:30:36.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.595+0000 7fcbbe133800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-23T18:30:36.589 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.595+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.595+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df15a570 con 0x5559df111e00 2024-04-23T18:30:36.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.595+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.595+0000 7fcbbe133800 20 rados_obj.operate() r=0 bl.length=380 2024-04-23T18:30:36.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.595+0000 7fcbbe133800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-23T18:30:36.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.595+0000 7fcbbe133800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-23T18:30:36.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.595+0000 7fcbbe133800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:30:36.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.595+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df15cfc0 con 0x5559df10d410 2024-04-23T18:30:36.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.596+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.596+0000 7fcbbe133800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 : miss 2024-04-23T18:30:36.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.596+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.590 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.596+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:96 8.d 8:b5935409:root::.bucket.meta.myfoo6%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df15ce40 con 0x5559df111e00 2024-04-23T18:30:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.596+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(96 .bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.596+0000 7fcbbe133800 20 rados_obj.operate() r=0 bl.length=380 2024-04-23T18:30:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.596+0000 7fcbbe133800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 info.flags=0x17 2024-04-23T18:30:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.596+0000 7fcbbe133800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 to cache LRU end 2024-04-23T18:30:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.596+0000 7fcbbe133800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:30:36.594 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.596+0000 7fcbbe133800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-23T18:30:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.596+0000 7fcbbe133800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 2024-04-23T18:30:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.596+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:97 4.9 4:91f04a44:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1da390 con 0x5559df10d410 2024-04-23T18:30:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.597+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(97 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.597+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:98 4.10 4:0b14c5fc:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1da390 con 0x5559df1167b0 2024-04-23T18:30:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.597+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(98 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.1 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.597+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:99 4.25 4:a7b6d1d1:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1da390 con 0x5559df1167b0 2024-04-23T18:30:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.597+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(99 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.597+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:100 4.2a 4:547ccc58:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1da3d0 con 0x5559df10d410 2024-04-23T18:30:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.598+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(100 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.598+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:101 4.6 4:615a9a97:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1da410 con 0x5559df1167b0 2024-04-23T18:30:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.598+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 28 ==== osd_op_reply(101 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.598+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:102 4.10 4:09ecb195:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1da410 con 0x5559df1167b0 2024-04-23T18:30:36.595 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.598+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 29 ==== osd_op_reply(102 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.5 [call out=85b] v0'0 uv16 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.598+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:103 4.c 4:30c4b246:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1da410 con 0x5559df10d410 2024-04-23T18:30:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.599+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(103 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.599+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:104 4.e 4:7376e66b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1da410 con 0x5559df111e00 2024-04-23T18:30:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.599+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== osd_op_reply(104 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.599+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:105 4.37 4:ec842c10:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1da410 con 0x7fcbac077060 2024-04-23T18:30:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.600+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(105 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.600+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:106 4.28 4:14e73ec2:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1da3d0 con 0x5559df10d410 2024-04-23T18:30:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.600+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(106 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9 [call out=289b] v0'0 uv7 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.600+0000 7fcbbe133800 10 cls_bucket_list_unordered: got thirteen 2024-04-23T18:30:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.600+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:107 4.29 4:956972a6:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1da3d0 con 0x5559df1167b0 2024-04-23T18:30:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.600+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 30 ==== osd_op_reply(107 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.596 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.600+0000 7fcbbe133800 20 get_obj_state: octx=0x7fcbb400aad0 obj=myfoo6:thirteen state=0x5559df1d8418 s->prefetch_data=0 2024-04-23T18:30:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.600+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:108 3.fs0 3:f0130d93:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1d9240 con 0x5559df111e00 2024-04-23T18:30:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.601+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 24 ==== osd_op_reply(108 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv4 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.601+0000 7fcbbe133800 10 manifest: total_size = 8 2024-04-23T18:30:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.601+0000 7fcbbe133800 20 get_obj_state: setting s->obj_tag to _kr_pEfA4j0hgyJG-eo3olwuYXbWYiIU 2024-04-23T18:30:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.601+0000 7fcbbe133800 20 get_obj_state: octx=0x7fcbb400aad0 obj=myfoo6:thirteen state=0x5559df1d8418 s->prefetch_data=0 2024-04-23T18:30:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.601+0000 7fcbbe133800 20 prepare_atomic_modification: state is not atomic. state=0x5559df1d8418 2024-04-23T18:30:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.601+0000 7fcbbe133800 20 bucket index object: :.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9 2024-04-23T18:30:36.597 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.601+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:109 4.28 4:14e73ec2:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df1d9b00 con 0x5559df10d410 2024-04-23T18:30:36.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.602+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(109 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9 [stat,call,call] v34'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.602+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:110 3.fs0 3:f0130d93:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df1d9b00 con 0x5559df111e00 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.603+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 25 ==== osd_op_reply(110 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9_thirteen [call] v34'5 uv5 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.603+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:111 4.28 4:14e73ec2:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df1619d0 con 0x5559df10d410 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.603+0000 7fcbbe133800 20 list_objects_ordered: starting attempt 1 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.603+0000 7fcbbe133800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.603+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:112 4.9 4:91f04a44:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df163820 con 0x5559df10d410 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.603+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:113 4.10 4:0b14c5fc:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df166120 con 0x5559df1167b0 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.603+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:114 4.25 4:a7b6d1d1:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1619d0 con 0x5559df1167b0 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.603+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:115 4.2a 4:547ccc58:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df166120 con 0x5559df10d410 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.603+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:116 4.6 4:615a9a97:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df16d8e0 con 0x5559df1167b0 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(112 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:117 4.10 4:09ecb195:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df166120 con 0x5559df1167b0 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:118 4.c 4:30c4b246:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df16d8e0 con 0x5559df10d410 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:119 4.e 4:7376e66b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df1727a0 con 0x5559df111e00 2024-04-23T18:30:36.605 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 34 ==== osd_op_reply(115 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:120 4.37 4:ec842c10:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df175620 con 0x7fcbac077060 2024-04-23T18:30:36.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:121 4.28 4:14e73ec2:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df175ef0 con 0x5559df10d410 2024-04-23T18:30:36.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:122 4.29 4:956972a6:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df178c70 con 0x5559df1167b0 2024-04-23T18:30:36.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 31 ==== osd_op_reply(113 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.1 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 32 ==== osd_op_reply(114 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 33 ==== osd_op_reply(116 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 34 ==== osd_op_reply(117 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.5 [call out=85b] v0'0 uv16 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 26 ==== osd_op_reply(119 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 35 ==== osd_op_reply(118 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.604+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 35 ==== osd_op_reply(122 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 36 ==== osd_op_reply(111 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fca9d7fa640 20 handle_completion(): completion ok for obj=thirteen 2024-04-23T18:30:36.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(120 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 37 ==== osd_op_reply(121 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-23T18:30:36.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-23T18:30:36.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-23T18:30:36.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-23T18:30:36.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9])"; uploads.size()=0; is_truncated=0 2024-04-23T18:30:36.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:123 4.9 4:91f04a44:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df16d290 con 0x5559df10d410 2024-04-23T18:30:36.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:124 4.10 4:0b14c5fc:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df175620 con 0x5559df1167b0 2024-04-23T18:30:36.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:125 4.25 4:a7b6d1d1:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df175f00 con 0x5559df1167b0 2024-04-23T18:30:36.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:126 4.2a 4:547ccc58:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df16d290 con 0x5559df10d410 2024-04-23T18:30:36.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:127 4.6 4:615a9a97:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df164a20 con 0x5559df1167b0 2024-04-23T18:30:36.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:128 4.10 4:09ecb195:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df174180 con 0x5559df1167b0 2024-04-23T18:30:36.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:129 4.c 4:30c4b246:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df175620 con 0x5559df10d410 2024-04-23T18:30:36.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:130 4.e 4:7376e66b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df16d290 con 0x5559df111e00 2024-04-23T18:30:36.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 38 ==== osd_op_reply(123 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 39 ==== osd_op_reply(126 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 36 ==== osd_op_reply(124 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.1 [call out=85b] v0'0 uv15 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 40 ==== osd_op_reply(129 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 37 ==== osd_op_reply(125 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 38 ==== osd_op_reply(127 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 39 ==== osd_op_reply(128 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.5 [call out=85b] v0'0 uv16 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:131 4.37 4:ec842c10:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df174180 con 0x7fcbac077060 2024-04-23T18:30:36.608 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:132 4.28 4:14e73ec2:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df175620 con 0x5559df10d410 2024-04-23T18:30:36.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.605+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:133 4.29 4:956972a6:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df164a20 con 0x5559df1167b0 2024-04-23T18:30:36.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.606+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 27 ==== osd_op_reply(130 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.606+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 41 ==== osd_op_reply(132 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.606+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 40 ==== osd_op_reply(133 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.606+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(131 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.606+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df175620 con 0x5559df10d410 2024-04-23T18:30:36.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.607+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 42 ==== osd_op_reply(134 bud.buckets [call] v34'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.607+0000 7fcbbe133800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-04-23T18:30:36.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.607+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.607+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df175620 con 0x5559df10d410 2024-04-23T18:30:36.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.607+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 43 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv19 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.607+0000 7fcbbe133800 20 rados_obj.operate() r=0 bl.length=166 2024-04-23T18:30:36.609 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.607+0000 7fcbbe133800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-04-23T18:30:36.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.607+0000 7fcbbe133800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-23T18:30:36.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.607+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df175620 con 0x5559df10d410 2024-04-23T18:30:36.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.608+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 44 ==== osd_op_reply(136 myfoo6 [call,call,delete] v34'20 uv20 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.608+0000 7fcbbe133800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-04-23T18:30:36.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.608+0000 7fcbbe133800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-23T18:30:36.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.608+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93844483264896 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df175620 con 0x5559df111e00 2024-04-23T18:30:36.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.608+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 28 ==== watch-notify(notify (1) cookie 93844482939888 notify 146028888081 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5559df15c3b0 con 0x5559df111e00 2024-04-23T18:30:36.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.608+0000 7fca9cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 93844482939888 notifier 4749 bl.length()=150 2024-04-23T18:30:36.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.608+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 29 ==== osd_op_reply(137 notify.3 [notify cookie 93844483264896 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.608+0000 7fca9cff9640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc9e40032c0 con 0x5559df111e00 2024-04-23T18:30:36.610 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.609+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.609+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 31 ==== watch-notify(notify_complete (2) cookie 93844483264896 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcbac037030 con 0x5559df111e00 2024-04-23T18:30:36.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.609+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:139 8.d 8:b5935409:root::.bucket.meta.myfoo6%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df175620 con 0x5559df111e00 2024-04-23T18:30:36.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.610+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 32 ==== osd_op_reply(139 .bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 [call,call,delete] v34'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.610+0000 7fcbbe133800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 from cache 2024-04-23T18:30:36.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.610+0000 7fcbbe133800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9, ofs0, ns] 2024-04-23T18:30:36.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.610+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 93844483264896 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df175620 con 0x5559df10d410 2024-04-23T18:30:36.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.610+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 45 ==== watch-notify(notify (1) cookie 93844482928128 notify 146028888092 ret 0) ==== 249+0+0 (crc 0 0 0) 0x5559df12ce70 con 0x5559df10d410 2024-04-23T18:30:36.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.610+0000 7fca9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 93844482928128 notifier 4749 bl.length()=207 2024-04-23T18:30:36.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.610+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 46 ==== osd_op_reply(140 notify.1 [notify cookie 93844483264896 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.610+0000 7fca9d7fa640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fca7c003d60 con 0x5559df10d410 2024-04-23T18:30:36.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.611+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 47 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.611+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 48 ==== watch-notify(notify_complete (2) cookie 93844483264896 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5559df1230a0 con 0x5559df10d410 2024-04-23T18:30:36.611 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.611+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:142 4.9 4:91f04a44:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df175620 con 0x5559df10d410 2024-04-23T18:30:36.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.611+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:143 4.10 4:0b14c5fc:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df175a50 con 0x5559df1167b0 2024-04-23T18:30:36.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.611+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:144 4.25 4:a7b6d1d1:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df15b1a0 con 0x5559df1167b0 2024-04-23T18:30:36.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.611+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:145 4.2a 4:547ccc58:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df15ba70 con 0x5559df10d410 2024-04-23T18:30:36.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.611+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:146 4.6 4:615a9a97:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df16c5a0 con 0x5559df1167b0 2024-04-23T18:30:36.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.611+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:147 4.10 4:09ecb195:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df175620 con 0x5559df1167b0 2024-04-23T18:30:36.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.611+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:148 4.c 4:30c4b246:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df175a50 con 0x5559df10d410 2024-04-23T18:30:36.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.611+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:149 4.e 4:7376e66b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df15b1a0 con 0x5559df111e00 2024-04-23T18:30:36.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.611+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:150 4.37 4:ec842c10:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df16c5a0 con 0x7fcbac077060 2024-04-23T18:30:36.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.611+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:151 4.28 4:14e73ec2:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df175620 con 0x5559df10d410 2024-04-23T18:30:36.612 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.611+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:152 4.29 4:956972a6:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df15ba70 con 0x5559df1167b0 2024-04-23T18:30:36.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.612+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 49 ==== osd_op_reply(142 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.0 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.613+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 41 ==== osd_op_reply(144 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.2 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.613+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 42 ==== osd_op_reply(146 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.4 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.613+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 50 ==== osd_op_reply(145 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.3 [delete] v34'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.613+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 51 ==== osd_op_reply(148 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.6 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.613+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(150 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.8 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.613+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 52 ==== osd_op_reply(151 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.9 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.618 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.613+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 43 ==== osd_op_reply(143 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.1 [delete] v34'17 uv17 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.613+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 33 ==== osd_op_reply(149 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.7 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.613+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 44 ==== osd_op_reply(147 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.5 [delete] v34'18 uv18 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.615+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 45 ==== osd_op_reply(152 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9.10 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.616+0000 7fcbbe133800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 : miss 2024-04-23T18:30:36.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.616+0000 7fcbbe133800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.616+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:153 6.13 6:c8752cca:::pubsub..bucket.myfoo6%2fb69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df16ced0 con 0x7fcbac077060 2024-04-23T18:30:36.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.616+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(153 pubsub..bucket.myfoo6/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.616+0000 7fcbbe133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.616+0000 7fcbbe133800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 info.flags=0x0 2024-04-23T18:30:36.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.616+0000 7fcbbe133800 10 adding default.rgw.log++pubsub..bucket.myfoo6/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 to cache LRU end 2024-04-23T18:30:36.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.616+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:154 6.13 6:c8752cca:::pubsub..bucket.myfoo6%2fb69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df16ced0 con 0x7fcbac077060 2024-04-23T18:30:36.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.617+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(154 pubsub..bucket.myfoo6/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.9 [delete] v34'31 uv29 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.617+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df15cdb0 con 0x5559df10d410 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.618+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 53 ==== osd_op_reply(155 bud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.618+0000 7fcbbe133800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.618+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df16ced0 con 0x5559df10d410 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.619+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 54 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v34'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.619+0000 7fcbbe133800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.619+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 93844483224432 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df15bb00 con 0x7fcbac077060 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.619+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== watch-notify(notify (1) cookie 93844482941696 notify 146028888102 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5559df1230a0 con 0x7fcbac077060 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.619+0000 7fca9cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888102 cookie 93844482941696 notifier 4749 bl.length()=170 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.619+0000 7fca9cff9640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc9e40032a0 con 0x7fcbac077060 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.619+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== osd_op_reply(157 notify.5 [notify cookie 93844483224432 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.619+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 31 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.620+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 32 ==== watch-notify(notify_complete (2) cookie 93844483224432 notify 146028888102 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5559df122ed0 con 0x7fcbac077060 2024-04-23T18:30:36.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.620+0000 7fcbbe133800 10 removing email index: 2024-04-23T18:30:36.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.620+0000 7fcbbe133800 10 removing user buckets index 2024-04-23T18:30:36.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.620+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df16ced0 con 0x5559df10d410 2024-04-23T18:30:36.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.620+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 55 ==== osd_op_reply(159 bud.buckets [delete] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.620+0000 7fcbbe133800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-04-23T18:30:36.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.620+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93844483224432 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df15bb00 con 0x7fcbac077060 2024-04-23T18:30:36.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.621+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 33 ==== watch-notify(notify (1) cookie 93844482946960 notify 146028888103 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5559df122ed0 con 0x7fcbac077060 2024-04-23T18:30:36.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.621+0000 7fca9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 93844482946960 notifier 4749 bl.length()=160 2024-04-23T18:30:36.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.621+0000 7fca9d7fa640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fca7c003d60 con 0x7fcbac077060 2024-04-23T18:30:36.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.621+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 34 ==== osd_op_reply(160 notify.6 [notify cookie 93844483224432 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.621+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 35 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.621 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.621+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 36 ==== watch-notify(notify_complete (2) cookie 93844483224432 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5559df1233c0 con 0x7fcbac077060 2024-04-23T18:30:36.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.621+0000 7fcbbe133800 10 removing user index: bud 2024-04-23T18:30:36.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.621+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df15cdb0 con 0x5559df111e00 2024-04-23T18:30:36.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.622+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 34 ==== osd_op_reply(162 bud [call,call,delete] v34'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.622+0000 7fcbbe133800 10 removing default.rgw.meta+users.uid+bud from cache 2024-04-23T18:30:36.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.622+0000 7fcbbe133800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-23T18:30:36.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.622+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93844483198384 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559df16ced0 con 0x7fcbac077060 2024-04-23T18:30:36.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.622+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 37 ==== watch-notify(notify (1) cookie 93844482941696 notify 146028888104 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5559df1233c0 con 0x7fcbac077060 2024-04-23T18:30:36.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.622+0000 7fca9cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 93844482941696 notifier 4749 bl.length()=152 2024-04-23T18:30:36.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.622+0000 7fca9cff9640 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc9e40032a0 con 0x7fcbac077060 2024-04-23T18:30:36.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.622+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 38 ==== osd_op_reply(163 notify.5 [notify cookie 93844483198384 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.623+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 39 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.622 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.623+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 40 ==== watch-notify(notify_complete (2) cookie 93844483198384 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5559df122d00 con 0x7fcbac077060 2024-04-23T18:30:36.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.624+0000 7fca637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:36.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.624+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93844482963776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df0bf090 con 0x5559df10d410 2024-04-23T18:30:36.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.625+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 56 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93844482963776] v34'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.623 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.625+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93844482925872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df123940 con 0x5559df111e00 2024-04-23T18:30:36.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.626+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 35 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93844482925872] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.626+0000 7fcbbe133800 20 remove_watcher() i=0 2024-04-23T18:30:36.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.626+0000 7fcbbe133800 2 removed watcher, disabling cache 2024-04-23T18:30:36.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.626+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93844482928128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df123940 con 0x5559df10d410 2024-04-23T18:30:36.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.627+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 57 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93844482928128] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.627+0000 7fcbbe133800 20 remove_watcher() i=1 2024-04-23T18:30:36.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.627+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93844482931840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df123940 con 0x5559df1167b0 2024-04-23T18:30:36.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.628+0000 7fcbb15d0640 1 -- 172.21.15.119:0/1485718349 <== osd.3 v2:172.21.15.119:6809/3910610681 46 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93844482931840] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba407f070 con 0x5559df1167b0 2024-04-23T18:30:36.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.628+0000 7fcbbe133800 20 remove_watcher() i=2 2024-04-23T18:30:36.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.628+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93844482939888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11bc80 con 0x5559df111e00 2024-04-23T18:30:36.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.629+0000 7fcbb9dd1640 1 -- 172.21.15.119:0/1485718349 <== osd.2 v2:172.21.15.119:6800/2624052101 36 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93844482939888] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbac08e040 con 0x5559df111e00 2024-04-23T18:30:36.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.629+0000 7fcbbe133800 20 remove_watcher() i=3 2024-04-23T18:30:36.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.629+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93844482944288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11bc80 con 0x5559df10d410 2024-04-23T18:30:36.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.630+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.1 v2:172.21.15.119:6808/2736386629 58 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93844482944288] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x5559df10d410 2024-04-23T18:30:36.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.630+0000 7fcbbe133800 20 remove_watcher() i=4 2024-04-23T18:30:36.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.630+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93844482941696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11ed20 con 0x7fcbac077060 2024-04-23T18:30:36.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.631+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 41 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93844482941696] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4040080 con 0x7fcbac077060 2024-04-23T18:30:36.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.631+0000 7fcbbe133800 20 remove_watcher() i=5 2024-04-23T18:30:36.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.631+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93844482946960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11bc80 con 0x7fcbac077060 2024-04-23T18:30:36.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.632+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 42 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93844482946960] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4079040 con 0x7fcbac077060 2024-04-23T18:30:36.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.632+0000 7fcbbe133800 20 remove_watcher() i=6 2024-04-23T18:30:36.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.632+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93844482937840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559df11e300 con 0x7fcbac077060 2024-04-23T18:30:36.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.633+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 <== osd.0 v2:172.21.15.62:6800/2641588406 43 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93844482937840] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb4079040 con 0x7fcbac077060 2024-04-23T18:30:36.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.633+0000 7fcbbe133800 20 remove_watcher() i=7 2024-04-23T18:30:36.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fcbac077060 msgr2=0x7fcbac059440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fcbac077060 0x7fcbac059440 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5559df10d410 msgr2=0x5559df10f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5559df10d410 0x5559df10f8d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5559df111e00 msgr2=0x5559df1141f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5559df111e00 0x5559df1141f0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5559df1167b0 msgr2=0x5559df118c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5559df1167b0 0x5559df118c70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fca84036e60 msgr2=0x7fca84039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fca84036e60 0x7fca84039320 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcba4052fd0 tx=0x7fcba404f000 comp rx=0 tx=0).stop 2024-04-23T18:30:36.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0fa8c0 msgr2=0x5559df101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 --2- 172.21.15.119:0/1485718349 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0fa8c0 0x5559df101cb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0315c0 tx=0x7fcbac028e50 comp rx=0 tx=0).stop 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbba5d2640 1 -- 172.21.15.119:0/1485718349 reap_dead start 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 shutdown_connections 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 >> 172.21.15.119:0/1485718349 conn(0x5559df0f6c20 msgr2=0x5559df0f4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 shutdown_connections 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/1485718349 wait complete. 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/3867500139 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fca94036e60 msgr2=0x7fca94039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 --2- 172.21.15.119:0/3867500139 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fca94036e60 0x7fca94039320 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5559df0d6f50 tx=0x7fcba4005ac0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/3867500139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0ed940 msgr2=0x5559df0edd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 --2- 172.21.15.119:0/3867500139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0ed940 0x5559df0edd60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0012e0 tx=0x7fcbac017d30 comp rx=0 tx=0).stop 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/3867500139 shutdown_connections 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 --2- 172.21.15.119:0/3867500139 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fca94036e60 0x7fca94039320 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 --2- 172.21.15.119:0/3867500139 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559df0ed940 0x5559df0edd60 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/3867500139 >> 172.21.15.119:0/3867500139 conn(0x5559df0e19e0 msgr2=0x5559df0e1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/3867500139 shutdown_connections 2024-04-23T18:30:36.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.634+0000 7fcbbe133800 1 -- 172.21.15.119:0/3867500139 wait complete. 2024-04-23T18:30:36.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5559df0dc930 msgr2=0x5559df0ded80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5559df0dc930 0x5559df0ded80 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5559defd43d0 msgr2=0x5559df0d60d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5559defd43d0 0x5559df0d60d0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5559df0d89a0 msgr2=0x5559df0dad90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5559df0d89a0 0x5559df0dad90 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcaa0036e60 msgr2=0x7fcaa0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fcaa0036e60 0x7fcaa0039320 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcba4054000 tx=0x7fcba404e000 comp rx=0 tx=0).stop 2024-04-23T18:30:36.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd2890 msgr2=0x5559df0cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 --2- 172.21.15.119:0/3575442934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5559defd2890 0x5559df0cf0b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00c010 tx=0x7fcbac000ed0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbba5d2640 1 -- 172.21.15.119:0/3575442934 reap_dead start 2024-04-23T18:30:36.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 shutdown_connections 2024-04-23T18:30:36.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 >> 172.21.15.119:0/3575442934 conn(0x5559defce430 msgr2=0x5559df0c1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 shutdown_connections 2024-04-23T18:30:36.635 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.635+0000 7fcbbe133800 1 -- 172.21.15.119:0/3575442934 wait complete. 2024-04-23T18:30:36.636 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-23T18:30:36.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-23T18:30:36.636 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-04-23T18:30:36.680 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:30:36.680 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:30:36.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.687+0000 7f3c5c7af800 1 Processor -- start 2024-04-23T18:30:36.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.687+0000 7f3c5c7af800 1 -- start start 2024-04-23T18:30:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.687+0000 7f3c5c7af800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556000fa2a10 0x556000fa4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.687+0000 7f3c5c7af800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556000e52560 con 0x556000fa5340 2024-04-23T18:30:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.687+0000 7f3c5c7af800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x556000e43e20 con 0x556000fa2a10 2024-04-23T18:30:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.688+0000 7f3c5a2b5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556000fa2a10 0x556000fa4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.688+0000 7f3c53fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x556000fa5340 0x556000fa7730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:56752/0 (socket says 172.21.15.119:56752) 2024-04-23T18:30:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.688+0000 7f3c5a2b5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556000fa2a10 0x556000fa4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:42354/0 (socket says 172.21.15.119:42354) 2024-04-23T18:30:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.688+0000 7f3c53fff640 1 -- 172.21.15.119:0/1143270419 learned_addr learned my addr 172.21.15.119:0/1143270419 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:30:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.688+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1143270419 >> v1:172.21.15.62:6789/0 conn(0x556000fa5340 legacy=0x556000fa7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.688+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1143270419 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556000e51e60 con 0x556000fa2a10 2024-04-23T18:30:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.690+0000 7f3c5a2b5640 1 --2- 172.21.15.119:0/1143270419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x556000fa4e00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00a470 tx=0x7f3c4c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beac0105a2412e82 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.690+0000 7f3c59ab4640 1 -- 172.21.15.119:0/1143270419 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c057070 con 0x556000fa2a10 2024-04-23T18:30:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.690+0000 7f3c59ab4640 1 -- 172.21.15.119:0/1143270419 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c052570 con 0x556000fa2a10 2024-04-23T18:30:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.690+0000 7f3c59ab4640 1 -- 172.21.15.119:0/1143270419 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c052870 con 0x556000fa2a10 2024-04-23T18:30:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.690+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1143270419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 msgr2=0x556000fa4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.690+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1143270419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x556000fa4e00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00a470 tx=0x7f3c4c01ce90 comp rx=0 tx=0).stop 2024-04-23T18:30:36.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.691+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1143270419 shutdown_connections 2024-04-23T18:30:36.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.691+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1143270419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x556000fa4e00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.691+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1143270419 >> 172.21.15.119:0/1143270419 conn(0x556000f9c440 msgr2=0x556000f9e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.691+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1143270419 shutdown_connections 2024-04-23T18:30:36.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.691+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1143270419 wait complete. 2024-04-23T18:30:36.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.702+0000 7f3c5c7af800 1 Processor -- start 2024-04-23T18:30:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.702+0000 7f3c5c7af800 1 -- start start 2024-04-23T18:30:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.702+0000 7f3c5c7af800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x5560010931e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.702+0000 7f3c5c7af800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556000eed5d0 con 0x556000fa2a10 2024-04-23T18:30:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.703+0000 7f3c5a2b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x5560010931e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.703+0000 7f3c5a2b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x5560010931e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:42364/0 (socket says 172.21.15.119:42364) 2024-04-23T18:30:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.703+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/3278174652 learned_addr learned my addr 172.21.15.119:0/3278174652 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.703+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/3278174652 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556000e63860 con 0x556000fa2a10 2024-04-23T18:30:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.703+0000 7f3c5a2b5640 1 --2- 172.21.15.119:0/3278174652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x5560010931e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c055040 tx=0x7f3c4c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373f29ffcac0dff8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.703+0000 7f3b48608640 1 -- 172.21.15.119:0/3278174652 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c057070 con 0x556000fa2a10 2024-04-23T18:30:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.703+0000 7f3b48608640 1 -- 172.21.15.119:0/3278174652 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c063070 con 0x556000fa2a10 2024-04-23T18:30:36.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.703+0000 7f3b48608640 1 -- 172.21.15.119:0/3278174652 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c052720 con 0x556000fa2a10 2024-04-23T18:30:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.704+0000 7f3c5c7af800 1 -- 172.21.15.119:0/3278174652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 msgr2=0x5560010931e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.704+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/3278174652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x5560010931e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c055040 tx=0x7f3c4c04c000 comp rx=0 tx=0).stop 2024-04-23T18:30:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.704+0000 7f3c5c7af800 1 -- 172.21.15.119:0/3278174652 shutdown_connections 2024-04-23T18:30:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.704+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/3278174652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x5560010931e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.704+0000 7f3c5c7af800 1 -- 172.21.15.119:0/3278174652 >> 172.21.15.119:0/3278174652 conn(0x556000f9c440 msgr2=0x55600108eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.704+0000 7f3c5c7af800 1 -- 172.21.15.119:0/3278174652 shutdown_connections 2024-04-23T18:30:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.704+0000 7f3c5c7af800 1 -- 172.21.15.119:0/3278174652 wait complete. 2024-04-23T18:30:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.704+0000 7f3c5c7af800 1 Processor -- start 2024-04-23T18:30:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.704+0000 7f3c5c7af800 1 -- start start 2024-04-23T18:30:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.704+0000 7f3c5c7af800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x556000fa2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.704+0000 7f3c5c7af800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556000fa90f0 con 0x556000fa2a10 2024-04-23T18:30:36.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.705+0000 7f3c5a2b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x556000fa2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.705+0000 7f3c5a2b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x556000fa2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:42370/0 (socket says 172.21.15.119:42370) 2024-04-23T18:30:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.705+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1293684937 learned_addr learned my addr 172.21.15.119:0/1293684937 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.705+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1293684937 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556000e61eb0 con 0x556000fa2a10 2024-04-23T18:30:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.705+0000 7f3c5a2b5640 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x556000fa2300 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c060040 tx=0x7f3c4c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.705+0000 7f3b46e05640 1 -- 172.21.15.119:0/1293684937 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c052e30 con 0x556000fa2a10 2024-04-23T18:30:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.705+0000 7f3b46e05640 1 -- 172.21.15.119:0/1293684937 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c06c070 con 0x556000fa2a10 2024-04-23T18:30:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.705+0000 7f3b46e05640 1 -- 172.21.15.119:0/1293684937 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c05e5f0 con 0x556000fa2a10 2024-04-23T18:30:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.705+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556000fa2840 con 0x556000fa2a10 2024-04-23T18:30:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.705+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556000fa0df0 con 0x556000fa2a10 2024-04-23T18:30:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.706+0000 7f3b46e05640 1 -- 172.21.15.119:0/1293684937 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3c4c05e790 con 0x556000fa2a10 2024-04-23T18:30:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.706+0000 7f3b46e05640 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b40036eb0 0x7f3b40039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.706+0000 7f3b46e05640 1 -- 172.21.15.119:0/1293684937 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f3c4c08f060 con 0x556000fa2a10 2024-04-23T18:30:36.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.706+0000 7f3c53fff640 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b40036eb0 0x7f3b40039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.707+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556000fa5340 0x5560010a3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.707+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010a4410 con 0x556000fa5340 2024-04-23T18:30:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.707+0000 7f3c5aab6640 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556000fa5340 0x5560010a3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.707+0000 7f3c53fff640 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b40036eb0 0x7f3b40039370 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3c44000f60 tx=0x7f3c440012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.707+0000 7f3c5aab6640 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556000fa5340 0x5560010a3ed0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.707+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1293684937 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c5400a4a0 con 0x556000fa5340 2024-04-23T18:30:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.707+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010a4810 con 0x556000fa5340 2024-04-23T18:30:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.708+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1293684937 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c5400a4a0 con 0x556000fa5340 2024-04-23T18:30:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.708+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5560010a6620 0x5560010a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.708+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010a90b0 con 0x5560010a6620 2024-04-23T18:30:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.708+0000 7f3c5a2b5640 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5560010a6620 0x5560010a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.708+0000 7f3c5a2b5640 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5560010a6620 0x5560010a8a10 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.708+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1293684937 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3c4c071990 con 0x5560010a6620 2024-04-23T18:30:36.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.708+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010a55d0 con 0x556000fa5340 2024-04-23T18:30:36.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.708+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1293684937 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c5400a4a0 con 0x556000fa5340 2024-04-23T18:30:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.709+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5560010aa560 0x5560010ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.709+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010ad130 con 0x5560010aa560 2024-04-23T18:30:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.709+0000 7f3c53fff640 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5560010aa560 0x5560010ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.709+0000 7f3c53fff640 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5560010aa560 0x5560010ac9d0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.710+0000 7f3c53fff640 1 -- 172.21.15.119:0/1293684937 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3c44009050 con 0x5560010aa560 2024-04-23T18:30:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.710+0000 7f3c5c7af800 1 Processor -- start 2024-04-23T18:30:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.710+0000 7f3c5c7af800 1 -- start start 2024-04-23T18:30:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.710+0000 7f3c5c7af800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010bb560 0x5560010bb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.710+0000 7f3c5c7af800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556000e93df0 con 0x5560010bb560 2024-04-23T18:30:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.710+0000 7f3c5a2b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010bb560 0x5560010bb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.710+0000 7f3c5a2b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010bb560 0x5560010bb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:42372/0 (socket says 172.21.15.119:42372) 2024-04-23T18:30:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.710+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/278175631 learned_addr learned my addr 172.21.15.119:0/278175631 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.710+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/278175631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560010bbec0 con 0x5560010bb560 2024-04-23T18:30:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.711+0000 7f3c5a2b5640 1 --2- 172.21.15.119:0/278175631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010bb560 0x5560010bb980 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c052520 tx=0x7f3c4c066f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.711+0000 7f3b3ffff640 1 -- 172.21.15.119:0/278175631 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c096070 con 0x5560010bb560 2024-04-23T18:30:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.711+0000 7f3b3ffff640 1 -- 172.21.15.119:0/278175631 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c058040 con 0x5560010bb560 2024-04-23T18:30:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.711+0000 7f3b3ffff640 1 -- 172.21.15.119:0/278175631 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c073be0 con 0x5560010bb560 2024-04-23T18:30:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.711+0000 7f3c5c7af800 1 -- 172.21.15.119:0/278175631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560010bc930 con 0x5560010bb560 2024-04-23T18:30:36.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.711+0000 7f3c5c7af800 1 -- 172.21.15.119:0/278175631 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560010bce30 con 0x5560010bb560 2024-04-23T18:30:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.712+0000 7f3b3ffff640 1 -- 172.21.15.119:0/278175631 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3c4c099070 con 0x5560010bb560 2024-04-23T18:30:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.712+0000 7f3b3ffff640 1 --2- 172.21.15.119:0/278175631 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b34036e60 0x7f3b34039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.712+0000 7f3b3ffff640 1 -- 172.21.15.119:0/278175631 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f3c4c09cd50 con 0x5560010bb560 2024-04-23T18:30:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.712+0000 7f3c53fff640 1 --2- 172.21.15.119:0/278175631 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b34036e60 0x7f3b34039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.712+0000 7f3c5c7af800 1 Processor -- start 2024-04-23T18:30:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.712+0000 7f3c5c7af800 1 -- start start 2024-04-23T18:30:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.712+0000 7f3c53fff640 1 --2- 172.21.15.119:0/278175631 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b34036e60 0x7f3b34039320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400bf50 tx=0x7f3c4400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.712+0000 7f3c5c7af800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010c8760 0x5560010c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.712+0000 7f3c5c7af800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5560010938a0 con 0x5560010c8760 2024-04-23T18:30:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.712+0000 7f3c5a2b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010c8760 0x5560010c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.713+0000 7f3c5a2b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010c8760 0x5560010c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:42374/0 (socket says 172.21.15.119:42374) 2024-04-23T18:30:36.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.713+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/3720533574 learned_addr learned my addr 172.21.15.119:0/3720533574 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.713+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/3720533574 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560010c9130 con 0x5560010c8760 2024-04-23T18:30:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.713+0000 7f3c5a2b5640 1 --2- 172.21.15.119:0/3720533574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010c8760 0x5560010c8b60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c07ad10 tx=0x7f3c4c073e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcff5f318f8b8da2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.713+0000 7f3b3dffb640 1 -- 172.21.15.119:0/3720533574 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c060200 con 0x5560010c8760 2024-04-23T18:30:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.713+0000 7f3b3dffb640 1 -- 172.21.15.119:0/3720533574 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c0735e0 con 0x5560010c8760 2024-04-23T18:30:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.713+0000 7f3b3dffb640 1 -- 172.21.15.119:0/3720533574 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c08da60 con 0x5560010c8760 2024-04-23T18:30:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5c7af800 1 -- 172.21.15.119:0/3720533574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010c8760 msgr2=0x5560010c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/3720533574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010c8760 0x5560010c8b60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c07ad10 tx=0x7f3c4c073e40 comp rx=0 tx=0).stop 2024-04-23T18:30:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5c7af800 1 -- 172.21.15.119:0/3720533574 shutdown_connections 2024-04-23T18:30:36.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/3720533574 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010c8760 0x5560010c8b60 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5c7af800 1 -- 172.21.15.119:0/3720533574 >> 172.21.15.119:0/3720533574 conn(0x5560010c49e0 msgr2=0x5560010c2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5c7af800 1 -- 172.21.15.119:0/3720533574 shutdown_connections 2024-04-23T18:30:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5c7af800 1 -- 172.21.15.119:0/3720533574 wait complete. 2024-04-23T18:30:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5c7af800 1 Processor -- start 2024-04-23T18:30:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5c7af800 1 -- start start 2024-04-23T18:30:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5c7af800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010c8760 0x5560010cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5c7af800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5560010c97c0 con 0x5560010c8760 2024-04-23T18:30:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5a2b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010c8760 0x5560010cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5a2b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010c8760 0x5560010cfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:42384/0 (socket says 172.21.15.119:42384) 2024-04-23T18:30:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.714+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 learned_addr learned my addr 172.21.15.119:0/1353926693 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:30:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.715+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560010d0000 con 0x5560010c8760 2024-04-23T18:30:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.715+0000 7f3c5a2b5640 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010c8760 0x5560010cfac0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c07ad10 tx=0x7f3c4c04ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.715+0000 7f3b2bfff640 1 -- 172.21.15.119:0/1353926693 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c091960 con 0x5560010c8760 2024-04-23T18:30:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.715+0000 7f3b2bfff640 1 -- 172.21.15.119:0/1353926693 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c091b00 con 0x5560010c8760 2024-04-23T18:30:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.715+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560010d0000 con 0x5560010c8760 2024-04-23T18:30:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.715+0000 7f3b2bfff640 1 -- 172.21.15.119:0/1353926693 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c4c07a3f0 con 0x5560010c8760 2024-04-23T18:30:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.715+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560010d0000 con 0x5560010c8760 2024-04-23T18:30:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.716+0000 7f3b2bfff640 1 -- 172.21.15.119:0/1353926693 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3c4c07a590 con 0x5560010c8760 2024-04-23T18:30:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.716+0000 7f3b2bfff640 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b24036e60 0x7f3b24039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.716+0000 7f3b2bfff640 1 -- 172.21.15.119:0/1353926693 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f3c4c0bed90 con 0x5560010c8760 2024-04-23T18:30:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.716+0000 7f3c53fff640 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b24036e60 0x7f3b24039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.716+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.716+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5560010db010 0x5560010dd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010ddc20 con 0x5560010db010 2024-04-23T18:30:36.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c53fff640 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b24036e60 0x7f3b24039320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3c44001b60 tx=0x7f3c44010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c5aab6640 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5560010db010 0x5560010dd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c5aab6640 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5560010db010 0x5560010dd4d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c5400a4a0 con 0x5560010db010 2024-04-23T18:30:36.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c5c7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c5c7af800 20 realm 2024-04-23T18:30:36.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010de030 con 0x5560010db010 2024-04-23T18:30:36.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c5400a4a0 con 0x5560010db010 2024-04-23T18:30:36.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c5c7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c5c7af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:30:36.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.717+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010de900 con 0x5560010db010 2024-04-23T18:30:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.718+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c5400a4a0 con 0x5560010db010 2024-04-23T18:30:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.718+0000 7f3c5c7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.718+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.718+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010db010 2024-04-23T18:30:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.718+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c5400a4a0 con 0x5560010db010 2024-04-23T18:30:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.718+0000 7f3c5c7af800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.718+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.718+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5560010dfa00 0x5560010e1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.718+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010e2400 con 0x5560010dfa00 2024-04-23T18:30:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.718+0000 7f3c5a2b5640 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5560010dfa00 0x5560010e1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.718+0000 7f3c5a2b5640 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5560010dfa00 0x5560010e1df0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.718+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3c4c0a6070 con 0x5560010dfa00 2024-04-23T18:30:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.719+0000 7f3c5c7af800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:30:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.719+0000 7f3c5c7af800 20 searching for the correct realm 2024-04-23T18:30:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.719+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5560010e4340 0x5560010e6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.719+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010e6e80 con 0x5560010e4340 2024-04-23T18:30:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.719+0000 7f3c53fff640 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5560010e4340 0x5560010e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.719+0000 7f3c53fff640 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5560010e4340 0x5560010e6800 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.719+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.719+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010e6e80 con 0x5560010dfa00 2024-04-23T18:30:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.720+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4c0a6070 con 0x5560010dfa00 2024-04-23T18:30:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.720+0000 7f3c5a2b5640 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3c4c09b060 0x7f3c4c075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:30:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.720+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010e6e80 con 0x7f3c4c09b060 2024-04-23T18:30:36.728 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.720+0000 7f3c5aab6640 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3c4c09b060 0x7f3c4c075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:30:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.720+0000 7f3c5aab6640 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3c4c09b060 0x7f3c4c075ab0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:30:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.720+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5400a4a0 con 0x7f3c4c09b060 2024-04-23T18:30:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.720+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010db010 2024-04-23T18:30:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.721+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5400a4a0 con 0x5560010db010 2024-04-23T18:30:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.721+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010db010 2024-04-23T18:30:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.721+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5400a4a0 con 0x5560010db010 2024-04-23T18:30:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.721+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x7f3c4c09b060 2024-04-23T18:30:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.721+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5400a4a0 con 0x7f3c4c09b060 2024-04-23T18:30:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.721+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x7f3c4c09b060 2024-04-23T18:30:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.721+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3c5400a4a0 con 0x7f3c4c09b060 2024-04-23T18:30:36.729 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.721+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010dfa00 2024-04-23T18:30:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.722+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4c0a6070 con 0x5560010dfa00 2024-04-23T18:30:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.722+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010e4340 2024-04-23T18:30:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.722+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.722+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010db010 2024-04-23T18:30:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.722+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5400a4a0 con 0x5560010db010 2024-04-23T18:30:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.722+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x7f3c4c09b060 2024-04-23T18:30:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.722+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5400a4a0 con 0x7f3c4c09b060 2024-04-23T18:30:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.722+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010db010 2024-04-23T18:30:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.723+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5400a4a0 con 0x5560010db010 2024-04-23T18:30:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.723+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010dfa00 2024-04-23T18:30:36.730 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.723+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3c4c0a6070 con 0x5560010dfa00 2024-04-23T18:30:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.723+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010e4340 2024-04-23T18:30:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.723+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.723+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010e4340 2024-04-23T18:30:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.723+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.723+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x7f3c4c09b060 2024-04-23T18:30:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.724+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5400a4a0 con 0x7f3c4c09b060 2024-04-23T18:30:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.724+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010e4340 2024-04-23T18:30:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.724+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.724+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010e4340 2024-04-23T18:30:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.724+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.724+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010db010 2024-04-23T18:30:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.724+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5400a4a0 con 0x5560010db010 2024-04-23T18:30:36.731 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.724+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010db010 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.725+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3c5400a4a0 con 0x5560010db010 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.725+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x7f3c4c09b060 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.725+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5400a4a0 con 0x7f3c4c09b060 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.725+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010e4340 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.725+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.725+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010dfa00 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.725+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3c4c0a6070 con 0x5560010dfa00 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.725+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010db010 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.726+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5400a4a0 con 0x5560010db010 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.726+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010dfa00 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.726+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4c0a6070 con 0x5560010dfa00 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.726+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010e4340 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.726+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.732 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.726+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x7f3c4c09b060 2024-04-23T18:30:36.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.726+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5400a4a0 con 0x7f3c4c09b060 2024-04-23T18:30:36.733 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.726+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010dfa00 2024-04-23T18:30:36.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.727+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.727+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010e4340 2024-04-23T18:30:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.727+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.727+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x7f3c4c09b060 2024-04-23T18:30:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.727+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c5400a4a0 con 0x7f3c4c09b060 2024-04-23T18:30:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.727+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010db010 2024-04-23T18:30:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.727+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.727+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5560010deca0 con 0x5560010dfa00 2024-04-23T18:30:36.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:30:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:30:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:30:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:30:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:30:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:30:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010e2c50 con 0x5560010db010 2024-04-23T18:30:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010e3040 con 0x5560010db010 2024-04-23T18:30:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:30:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.728+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010e3040 con 0x7f3c4c09b060 2024-04-23T18:30:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:30:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 20 zone default found 2024-04-23T18:30:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 4 Realm: () 2024-04-23T18:30:36.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:30:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:30:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:30:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 20 zonegroup default 2024-04-23T18:30:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010e7300 con 0x5560010dfa00 2024-04-23T18:30:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010e9080 con 0x5560010e4340 2024-04-23T18:30:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.745 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010e9420 con 0x5560010e4340 2024-04-23T18:30:36.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 20 started sync module instance, tier type = 2024-04-23T18:30:36.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:30:36.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.729+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010e8520 con 0x5560010dfa00 2024-04-23T18:30:36.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.730+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.730+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93870822951184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010e8180 con 0x5560010dfa00 2024-04-23T18:30:36.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.730+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010ea120 con 0x5560010db010 2024-04-23T18:30:36.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.731+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93870822951184] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.732+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.732+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93870822955456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010ea510 con 0x5560010db010 2024-04-23T18:30:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.732+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010eaf80 con 0x5560010e4340 2024-04-23T18:30:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.733+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93870822955456] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.733+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.733+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93870822959696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010eb370 con 0x5560010e4340 2024-04-23T18:30:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.733+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010ebd90 con 0x5560010dfa00 2024-04-23T18:30:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.734+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93870822959696] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.734+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.734+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93870822963328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010ec1b0 con 0x5560010dfa00 2024-04-23T18:30:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.734+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010ecbb0 con 0x5560010db010 2024-04-23T18:30:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.735+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93870822963328] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.735+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.735+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93870822956640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010ecb70 con 0x5560010db010 2024-04-23T18:30:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.735+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010ed5f0 con 0x7f3c4c09b060 2024-04-23T18:30:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.736+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93870822956640] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.737+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.737+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93870822970144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010ecb70 con 0x7f3c4c09b060 2024-04-23T18:30:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.737+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010ee000 con 0x7f3c4c09b060 2024-04-23T18:30:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.738+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93870822970144] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.738+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.738+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93870822967456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010ee000 con 0x7f3c4c09b060 2024-04-23T18:30:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.738+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010ee9c0 con 0x7f3c4c09b060 2024-04-23T18:30:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.739+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93870822967456] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.739+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.739+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93870822972720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010ee9c0 con 0x7f3c4c09b060 2024-04-23T18:30:36.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.739+0000 7f3c5c7af800 20 add_watcher() i=0 2024-04-23T18:30:36.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.739+0000 7f3c5c7af800 20 add_watcher() i=1 2024-04-23T18:30:36.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.739+0000 7f3c5c7af800 20 add_watcher() i=2 2024-04-23T18:30:36.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.739+0000 7f3c5c7af800 20 add_watcher() i=3 2024-04-23T18:30:36.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.739+0000 7f3c5c7af800 20 add_watcher() i=4 2024-04-23T18:30:36.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.739+0000 7f3c5c7af800 20 add_watcher() i=5 2024-04-23T18:30:36.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.739+0000 7f3c5c7af800 20 add_watcher() i=6 2024-04-23T18:30:36.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.740+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93870822972720] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.740+0000 7f3c5c7af800 20 add_watcher() i=7 2024-04-23T18:30:36.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.740+0000 7f3c5c7af800 2 all 8 watchers are set, enabling cache 2024-04-23T18:30:36.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.740+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560010f1df0 con 0x5560010db010 2024-04-23T18:30:36.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.741+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.741+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93870822975200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010ef2a0 con 0x5560010db010 2024-04-23T18:30:36.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.741+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93870822975200] v34'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.742+0000 7f3b10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:36.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.742+0000 7f3c5c7af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:30:36.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.742+0000 7f3c5c7af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:30:36.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.742+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010f1c30 con 0x5560010db010 2024-04-23T18:30:36.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.743+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.743+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fb1b0 con 0x7f3c4c09b060 2024-04-23T18:30:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.744+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.744+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fb660 con 0x5560010e4340 2024-04-23T18:30:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.745+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.745+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fbeb0 con 0x5560010db010 2024-04-23T18:30:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.746+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'225 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.746+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fc310 con 0x5560010dfa00 2024-04-23T18:30:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.747+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.747+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fc310 con 0x5560010e4340 2024-04-23T18:30:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.748+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.748+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fcdd0 con 0x5560010db010 2024-04-23T18:30:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.749+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.749+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fcdd0 con 0x7f3c4c09b060 2024-04-23T18:30:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.750+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'48 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.750+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fcdd0 con 0x5560010dfa00 2024-04-23T18:30:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.751+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.751+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fce60 con 0x5560010e4340 2024-04-23T18:30:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.752+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.752+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd410 con 0x5560010dfa00 2024-04-23T18:30:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.753+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.753+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd3d0 con 0x7f3c4c09b060 2024-04-23T18:30:36.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.754+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.754+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd3a0 con 0x5560010dfa00 2024-04-23T18:30:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.755+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.755+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fc970 con 0x7f3c4c09b060 2024-04-23T18:30:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.757+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.757+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fc970 con 0x5560010db010 2024-04-23T18:30:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.758+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'226 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.758+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fc970 con 0x5560010e4340 2024-04-23T18:30:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.759+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'65 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.759+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fc970 con 0x5560010dfa00 2024-04-23T18:30:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.760+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.760+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fc970 con 0x5560010e4340 2024-04-23T18:30:36.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.761+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.761+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7c0 con 0x5560010db010 2024-04-23T18:30:36.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.762+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.762+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7a0 con 0x5560010db010 2024-04-23T18:30:36.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.763+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'227 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.763+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7a0 con 0x5560010e4340 2024-04-23T18:30:36.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.764+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'66 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.764+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7a0 con 0x5560010dfa00 2024-04-23T18:30:36.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.765+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.765+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7a0 con 0x5560010e4340 2024-04-23T18:30:36.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.766+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.766+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7a0 con 0x5560010e4340 2024-04-23T18:30:36.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.766+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.766+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7a0 con 0x5560010e4340 2024-04-23T18:30:36.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.767+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.767+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7a0 con 0x5560010e4340 2024-04-23T18:30:36.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.768+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.768+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7a0 con 0x7f3c4c09b060 2024-04-23T18:30:36.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.769+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.769+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7a0 con 0x5560010e4340 2024-04-23T18:30:36.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.770+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.770+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7a0 con 0x7f3c4c09b060 2024-04-23T18:30:36.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.772+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'49 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.772+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7a0 con 0x5560010e4340 2024-04-23T18:30:36.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.773+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'67 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.773+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7a0 con 0x7f3c4c09b060 2024-04-23T18:30:36.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.774+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.767 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.774+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010fd7a0 con 0x5560010dfa00 2024-04-23T18:30:36.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.774+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.775+0000 7f3a8b7fe640 20 reqs_thread_entry: start 2024-04-23T18:30:36.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.775+0000 7f3c5c7af800 20 init_complete bucket index max shards: 11 2024-04-23T18:30:36.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.775+0000 7f3c5c7af800 20 Filter name: none 2024-04-23T18:30:36.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.775+0000 7f3a897fa640 20 reqs_thread_entry: start 2024-04-23T18:30:36.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.775+0000 7f3c5c7af800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-23T18:30:36.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.775+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.775+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011285f0 con 0x7f3c4c09b060 2024-04-23T18:30:36.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.776+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.776+0000 7f3c5c7af800 20 rados_obj.operate() r=0 bl.length=380 2024-04-23T18:30:36.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.776+0000 7f3c5c7af800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-23T18:30:36.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.776+0000 7f3c5c7af800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-23T18:30:36.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.776+0000 7f3c5c7af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:30:36.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.776+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600112b080 con 0x7f3c4c09b060 2024-04-23T18:30:36.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.776+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.776+0000 7f3c5c7af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10 : miss 2024-04-23T18:30:36.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.776+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.776+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:96 8.10 8:0c4be13c:root::.bucket.meta.myfoo7%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600112ae70 con 0x5560010e4340 2024-04-23T18:30:36.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.777+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.777+0000 7f3c5c7af800 20 rados_obj.operate() r=0 bl.length=382 2024-04-23T18:30:36.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.777+0000 7f3c5c7af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10 info.flags=0x17 2024-04-23T18:30:36.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.777+0000 7f3c5c7af800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10 to cache LRU end 2024-04-23T18:30:36.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.777+0000 7f3c5c7af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:30:36.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.777+0000 7f3c5c7af800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:30:36.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.777+0000 7f3c5c7af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10 2024-04-23T18:30:36.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.777+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:97 4.2b 4:d7335024:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a83c0 con 0x5560010db010 2024-04-23T18:30:36.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.777+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(97 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.777+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:98 4.2d 4:b49cde6b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a83c0 con 0x7f3c4c09b060 2024-04-23T18:30:36.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.777+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(98 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.777+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:99 4.2a 4:54408ef9:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a8400 con 0x5560010db010 2024-04-23T18:30:36.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.778+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(99 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.778+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:100 4.39 4:9edec952:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a8440 con 0x5560010e4340 2024-04-23T18:30:36.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.778+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(100 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.778+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:101 4.13 4:cb6d02f4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a8440 con 0x5560010dfa00 2024-04-23T18:30:36.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.778+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(101 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.778+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:102 4.8 4:13f43cbc:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a8440 con 0x5560010e4340 2024-04-23T18:30:36.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.779+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 28 ==== osd_op_reply(102 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.5 [call out=377b] v0'0 uv5 ondisk = 0) ==== 195+0+377 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.779+0000 7f3c5c7af800 10 cls_bucket_list_unordered: got fourteen 2024-04-23T18:30:36.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.779+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:103 4.27 4:e628249f:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a8440 con 0x5560010db010 2024-04-23T18:30:36.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.779+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(103 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.779+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:104 4.2b 4:d420325c:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a8440 con 0x5560010db010 2024-04-23T18:30:36.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.779+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(104 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.779+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:105 4.5 4:a0184f65:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a8440 con 0x5560010e4340 2024-04-23T18:30:36.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 29 ==== osd_op_reply(105 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:106 4.9 4:93436f8c:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a8400 con 0x5560010db010 2024-04-23T18:30:36.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(106 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:107 4.2b 4:d7b133e4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a8400 con 0x5560010db010 2024-04-23T18:30:36.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(107 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c5c7af800 20 get_obj_state: octx=0x7f3c5400aaf0 obj=myfoo7:fourteen state=0x5560011a6468 s->prefetch_data=0 2024-04-23T18:30:36.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:108 3.2bs0 3:d5233fcc:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a7290 con 0x5560010db010 2024-04-23T18:30:36.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(108 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c5c7af800 10 manifest: total_size = 8 2024-04-23T18:30:36.783 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c5c7af800 20 get_obj_state: setting s->obj_tag to b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.4435067665475242305 2024-04-23T18:30:36.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c5c7af800 20 get_obj_state: octx=0x7f3c5400aaf0 obj=myfoo7:fourteen state=0x5560011a6468 s->prefetch_data=0 2024-04-23T18:30:36.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c5c7af800 20 prepare_atomic_modification: state is not atomic. state=0x5560011a6468 2024-04-23T18:30:36.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c5c7af800 20 bucket index object: :.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.5 2024-04-23T18:30:36.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.780+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:109 4.8 4:13f43cbc:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560011a7b50 con 0x5560010e4340 2024-04-23T18:30:36.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.781+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 30 ==== osd_op_reply(109 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.5 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.782+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:110 3.2bs0 3:d5233fcc:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560011a7b50 con 0x5560010db010 2024-04-23T18:30:36.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 34 ==== osd_op_reply(110 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10_fourteen [call] v34'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:111 4.8 4:13f43cbc:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600112f570 con 0x5560010e4340 2024-04-23T18:30:36.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 20 list_objects_ordered: starting attempt 1 2024-04-23T18:30:36.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-23T18:30:36.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:112 4.2b 4:d7335024:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600112f570 con 0x5560010db010 2024-04-23T18:30:36.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:113 4.2d 4:b49cde6b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556001133810 con 0x7f3c4c09b060 2024-04-23T18:30:36.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:114 4.2a 4:54408ef9:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556001136170 con 0x5560010db010 2024-04-23T18:30:36.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:115 4.39 4:9edec952:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556001138e10 con 0x5560010e4340 2024-04-23T18:30:36.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:116 4.13 4:cb6d02f4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600113bbe0 con 0x5560010dfa00 2024-04-23T18:30:36.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:117 4.8 4:13f43cbc:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600113ea30 con 0x5560010e4340 2024-04-23T18:30:36.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:118 4.27 4:e628249f:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556001141540 con 0x5560010db010 2024-04-23T18:30:36.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:119 4.2b 4:d420325c:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556001143eb0 con 0x5560010db010 2024-04-23T18:30:36.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:120 4.5 4:a0184f65:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556001146c10 con 0x5560010e4340 2024-04-23T18:30:36.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:121 4.9 4:93436f8c:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011495e0 con 0x5560010db010 2024-04-23T18:30:36.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:122 4.2b 4:d7b133e4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600114c430 con 0x5560010db010 2024-04-23T18:30:36.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(116 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.783+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 31 ==== osd_op_reply(115 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.784+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 32 ==== osd_op_reply(120 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.784+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(113 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.784+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 35 ==== osd_op_reply(112 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.784+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 36 ==== osd_op_reply(114 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.784+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 37 ==== osd_op_reply(118 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.784+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 38 ==== osd_op_reply(121 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.784+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 39 ==== osd_op_reply(119 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.784+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 40 ==== osd_op_reply(122 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 33 ==== osd_op_reply(111 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.5 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3b3dffb640 20 handle_completion(): completion ok for obj=fourteen 2024-04-23T18:30:36.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 34 ==== osd_op_reply(117 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-23T18:30:36.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-23T18:30:36.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-23T18:30:36.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-23T18:30:36.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10])"; uploads.size()=0; is_truncated=0 2024-04-23T18:30:36.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:123 4.2b 4:d7335024:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600113b5f0 con 0x5560010db010 2024-04-23T18:30:36.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:124 4.2d 4:b49cde6b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a7a70 con 0x7f3c4c09b060 2024-04-23T18:30:36.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:125 4.2a 4:54408ef9:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011465c0 con 0x5560010db010 2024-04-23T18:30:36.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:126 4.39 4:9edec952:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556001137610 con 0x5560010e4340 2024-04-23T18:30:36.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:127 4.13 4:cb6d02f4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556001137f00 con 0x5560010dfa00 2024-04-23T18:30:36.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:128 4.8 4:13f43cbc:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556001136170 con 0x5560010e4340 2024-04-23T18:30:36.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:129 4.27 4:e628249f:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600113b5f0 con 0x5560010db010 2024-04-23T18:30:36.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:130 4.2b 4:d420325c:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556001143eb0 con 0x5560010db010 2024-04-23T18:30:36.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:131 4.5 4:a0184f65:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011465c0 con 0x5560010e4340 2024-04-23T18:30:36.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 35 ==== osd_op_reply(126 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== osd_op_reply(127 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(124 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.785+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:132 4.9 4:93436f8c:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600113b5f0 con 0x5560010db010 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.786+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 36 ==== osd_op_reply(128 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.786+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:133 4.2b 4:d7b133e4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a7a70 con 0x5560010db010 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.786+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 41 ==== osd_op_reply(123 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.786+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 42 ==== osd_op_reply(125 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.786+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 43 ==== osd_op_reply(130 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.786+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 44 ==== osd_op_reply(129 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.786+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 37 ==== osd_op_reply(131 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.786+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 45 ==== osd_op_reply(132 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.786+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 46 ==== osd_op_reply(133 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.786+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560011a7a70 con 0x7f3c4c09b060 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.787+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(134 fud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.787+0000 7f3c5c7af800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-04-23T18:30:36.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.787+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.787+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a7a70 con 0x5560010dfa00 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.788+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 24 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.788+0000 7f3c5c7af800 20 rados_obj.operate() r=0 bl.length=168 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.788+0000 7f3c5c7af800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.788+0000 7f3c5c7af800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.788+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560011a7a70 con 0x5560010dfa00 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.789+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 25 ==== osd_op_reply(136 myfoo7 [call,call,delete] v34'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.789+0000 7f3c5c7af800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.789+0000 7f3c5c7af800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.789+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93870823733872 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600114c330 con 0x5560010dfa00 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.789+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 26 ==== watch-notify(notify (1) cookie 93870822963328 notify 146028888082 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5560010fd3a0 con 0x5560010dfa00 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.789+0000 7f3b3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 93870822963328 notifier 4756 bl.length()=150 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.789+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 27 ==== osd_op_reply(137 notify.3 [notify cookie 93870823733872 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.789+0000 7f3b3dffb640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3b20003d60 con 0x5560010dfa00 2024-04-23T18:30:36.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.789+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 28 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.789+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 29 ==== watch-notify(notify_complete (2) cookie 93870823733872 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3c4c0d5020 con 0x5560010dfa00 2024-04-23T18:30:36.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.789+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:139 8.10 8:0c4be13c:root::.bucket.meta.myfoo7%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600114c330 con 0x5560010e4340 2024-04-23T18:30:36.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.790+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 38 ==== osd_op_reply(139 .bucket.meta.myfoo7:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.790+0000 7f3c5c7af800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10 from cache 2024-04-23T18:30:36.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.790+0000 7f3c5c7af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10, ofs0, ns] 2024-04-23T18:30:36.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.790+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 93870823335088 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55600114c330 con 0x5560010db010 2024-04-23T18:30:36.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 47 ==== watch-notify(notify (1) cookie 93870822956640 notify 146028888093 ret 0) ==== 250+0+0 (crc 0 0 0) 0x5560010fbbd0 con 0x5560010db010 2024-04-23T18:30:36.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3b3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 93870822956640 notifier 4756 bl.length()=208 2024-04-23T18:30:36.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 48 ==== osd_op_reply(140 notify.4 [notify cookie 93870823335088 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3b3d7fa640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3a900032c0 con 0x5560010db010 2024-04-23T18:30:36.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 49 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 50 ==== watch-notify(notify_complete (2) cookie 93870823335088 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5560010fb3e0 con 0x5560010db010 2024-04-23T18:30:36.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:142 4.2b 4:d7335024:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600112ade0 con 0x5560010db010 2024-04-23T18:30:36.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:143 4.2d 4:b49cde6b:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600114c180 con 0x7f3c4c09b060 2024-04-23T18:30:36.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:144 4.2a 4:54408ef9:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556001149f80 con 0x5560010db010 2024-04-23T18:30:36.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:145 4.39 4:9edec952:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556001129210 con 0x5560010e4340 2024-04-23T18:30:36.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:146 4.13 4:cb6d02f4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556001129640 con 0x5560010dfa00 2024-04-23T18:30:36.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:147 4.8 4:13f43cbc:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556001149f80 con 0x5560010e4340 2024-04-23T18:30:36.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:148 4.27 4:e628249f:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600114c180 con 0x5560010db010 2024-04-23T18:30:36.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:149 4.2b 4:d420325c:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556001129210 con 0x5560010db010 2024-04-23T18:30:36.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:150 4.5 4:a0184f65:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556001149f80 con 0x5560010e4340 2024-04-23T18:30:36.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.791+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:151 4.9 4:93436f8c:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556001129640 con 0x5560010db010 2024-04-23T18:30:36.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.792+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:152 4.2b 4:d7b133e4:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55600114c180 con 0x5560010db010 2024-04-23T18:30:36.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.793+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 51 ==== osd_op_reply(144 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.2 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.793+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 30 ==== osd_op_reply(146 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.4 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.793+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(143 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.1 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.793+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 39 ==== osd_op_reply(145 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.3 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.793+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 52 ==== osd_op_reply(148 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.6 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.793+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 53 ==== osd_op_reply(142 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.0 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.793+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 54 ==== osd_op_reply(151 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.9 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.793+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 55 ==== osd_op_reply(149 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.7 [delete] v34'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.794+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 40 ==== osd_op_reply(150 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.8 [delete] v34'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.794+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 41 ==== osd_op_reply(147 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.5 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.794+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 56 ==== osd_op_reply(152 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10.10 [delete] v34'8 uv8 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.794+0000 7f3c5c7af800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10 : miss 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.794+0000 7f3c5c7af800 20 rados->read ofs=0 len=0 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.794+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:153 6.1d 6:bad74dba:::pubsub..bucket.myfoo7%2fb69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556001129640 con 0x7f3c4c09b060 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.794+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== osd_op_reply(153 pubsub..bucket.myfoo7/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.794+0000 7f3c5c7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.794+0000 7f3c5c7af800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10 info.flags=0x0 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.794+0000 7f3c5c7af800 10 adding default.rgw.log++pubsub..bucket.myfoo7/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10 to cache LRU end 2024-04-23T18:30:36.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.794+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:154 6.1d 6:bad74dba:::pubsub..bucket.myfoo7%2fb69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556001149f80 con 0x7f3c4c09b060 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.795+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 31 ==== osd_op_reply(154 pubsub..bucket.myfoo7/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.10 [delete] v34'50 uv37 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.795+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556001129210 con 0x7f3c4c09b060 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.796+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 32 ==== osd_op_reply(155 fud.buckets [call] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.796+0000 7f3c5c7af800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.796+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556001129640 con 0x7f3c4c09b060 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.797+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 33 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v34'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.797+0000 7f3c5c7af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.797+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 93870823335088 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556001129640 con 0x5560010e4340 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.797+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 42 ==== watch-notify(notify (1) cookie 93870822959696 notify 146028888071 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55600112a3a0 con 0x5560010e4340 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.797+0000 7f3b3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 93870822959696 notifier 4756 bl.length()=170 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.797+0000 7f3b3d7fa640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3a900032a0 con 0x5560010e4340 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.797+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 43 ==== osd_op_reply(157 notify.2 [notify cookie 93870823335088 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.797+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 44 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.798+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 45 ==== watch-notify(notify_complete (2) cookie 93870823335088 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5560010fc750 con 0x5560010e4340 2024-04-23T18:30:36.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.798+0000 7f3c5c7af800 10 removing email index: 2024-04-23T18:30:36.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.798+0000 7f3c5c7af800 10 removing user buckets index 2024-04-23T18:30:36.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.798+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560011a7bd0 con 0x7f3c4c09b060 2024-04-23T18:30:36.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.799+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 34 ==== osd_op_reply(159 fud.buckets [delete] v34'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.799+0000 7f3c5c7af800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-23T18:30:36.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.799+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93870823335088 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a7bd0 con 0x7f3c4c09b060 2024-04-23T18:30:36.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.799+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 35 ==== watch-notify(notify (1) cookie 93870822967456 notify 146028888105 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5560010fb3e0 con 0x7f3c4c09b060 2024-04-23T18:30:36.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.799+0000 7f3b3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 93870822967456 notifier 4756 bl.length()=160 2024-04-23T18:30:36.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.799+0000 7f3b3dffb640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3b20003d60 con 0x7f3c4c09b060 2024-04-23T18:30:36.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.799+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 36 ==== osd_op_reply(160 notify.6 [notify cookie 93870823335088 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.799+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 37 ==== watch-notify(notify_complete (2) cookie 93870823335088 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5560010fb1b0 con 0x7f3c4c09b060 2024-04-23T18:30:36.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.799+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 38 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.799+0000 7f3c5c7af800 10 removing user index: fud 2024-04-23T18:30:36.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.799+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560011a7bd0 con 0x7f3c4c09b060 2024-04-23T18:30:36.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.800+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 39 ==== osd_op_reply(162 fud [call,call,delete] v34'9 uv9 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.800+0000 7f3c5c7af800 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-23T18:30:36.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.800+0000 7f3c5c7af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-23T18:30:36.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.800+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93870823335088 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560011a7bd0 con 0x7f3c4c09b060 2024-04-23T18:30:36.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.801+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 40 ==== watch-notify(notify (1) cookie 93870822970144 notify 146028888106 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5560010fb1b0 con 0x7f3c4c09b060 2024-04-23T18:30:36.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.801+0000 7f3b3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 93870822970144 notifier 4756 bl.length()=152 2024-04-23T18:30:36.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.801+0000 7f3b3d7fa640 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3a900032a0 con 0x7f3c4c09b060 2024-04-23T18:30:36.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.801+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 41 ==== osd_op_reply(163 notify.5 [notify cookie 93870823335088 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.801+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 42 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.801+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 43 ==== watch-notify(notify_complete (2) cookie 93870823335088 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5560010f1dc0 con 0x7f3c4c09b060 2024-04-23T18:30:36.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.802+0000 7f3b10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:30:36.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.802+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93870822975200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010f7790 con 0x5560010db010 2024-04-23T18:30:36.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.803+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 57 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93870822975200] v34'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.803+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93870822951184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010f7790 con 0x5560010dfa00 2024-04-23T18:30:36.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.804+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 31 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93870822951184] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.804+0000 7f3c5c7af800 20 remove_watcher() i=0 2024-04-23T18:30:36.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.804+0000 7f3c5c7af800 2 removed watcher, disabling cache 2024-04-23T18:30:36.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.804+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93870822955456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010f7790 con 0x5560010db010 2024-04-23T18:30:36.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.805+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 58 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93870822955456] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.805+0000 7f3c5c7af800 20 remove_watcher() i=1 2024-04-23T18:30:36.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.805+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93870822959696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010f7790 con 0x5560010e4340 2024-04-23T18:30:36.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.806+0000 7f3c53fff640 1 -- 172.21.15.119:0/1353926693 <== osd.3 v2:172.21.15.119:6809/3910610681 46 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93870822959696] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c44009050 con 0x5560010e4340 2024-04-23T18:30:36.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.806+0000 7f3c5c7af800 20 remove_watcher() i=2 2024-04-23T18:30:36.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.806+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93870822963328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010f7790 con 0x5560010dfa00 2024-04-23T18:30:36.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.807+0000 7f3c5a2b5640 1 -- 172.21.15.119:0/1353926693 <== osd.2 v2:172.21.15.119:6800/2624052101 32 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93870822963328] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c4c0da040 con 0x5560010dfa00 2024-04-23T18:30:36.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.807+0000 7f3c5c7af800 20 remove_watcher() i=3 2024-04-23T18:30:36.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.807+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93870822956640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010f7790 con 0x5560010db010 2024-04-23T18:30:36.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.808+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.1 v2:172.21.15.119:6808/2736386629 59 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93870822956640] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x5560010db010 2024-04-23T18:30:36.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.808+0000 7f3c5c7af800 20 remove_watcher() i=4 2024-04-23T18:30:36.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.808+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93870822970144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010f7790 con 0x7f3c4c09b060 2024-04-23T18:30:36.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.809+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 44 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93870822970144] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.809+0000 7f3c5c7af800 20 remove_watcher() i=5 2024-04-23T18:30:36.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.809+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93870822967456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010f7790 con 0x7f3c4c09b060 2024-04-23T18:30:36.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.810+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 45 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93870822967456] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.810+0000 7f3c5c7af800 20 remove_watcher() i=6 2024-04-23T18:30:36.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.810+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93870822972720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560010f7790 con 0x7f3c4c09b060 2024-04-23T18:30:36.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.811+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 <== osd.0 v2:172.21.15.62:6800/2641588406 46 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93870822972720] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c54040080 con 0x7f3c4c09b060 2024-04-23T18:30:36.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.811+0000 7f3c5c7af800 20 remove_watcher() i=7 2024-04-23T18:30:36.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.811+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3c4c09b060 msgr2=0x7f3c4c075ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.811+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3c4c09b060 0x7f3c4c075ab0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.811+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5560010db010 msgr2=0x5560010dd4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.811+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5560010db010 0x5560010dd4d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.811+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5560010dfa00 msgr2=0x5560010e1df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.811+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5560010dfa00 0x5560010e1df0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.811+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5560010e4340 msgr2=0x5560010e6800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.811+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5560010e4340 0x5560010e6800 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b24036e60 msgr2=0x7f3b24039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b24036e60 0x7f3b24039320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3c44001b60 tx=0x7f3c44010000 comp rx=0 tx=0).stop 2024-04-23T18:30:36.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010c8760 msgr2=0x5560010cfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1353926693 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010c8760 0x5560010cfac0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c07ad10 tx=0x7f3c4c04ee90 comp rx=0 tx=0).stop 2024-04-23T18:30:36.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1353926693 reap_dead start 2024-04-23T18:30:36.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 shutdown_connections 2024-04-23T18:30:36.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 >> 172.21.15.119:0/1353926693 conn(0x5560010c49e0 msgr2=0x5560010c2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 shutdown_connections 2024-04-23T18:30:36.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1353926693 wait complete. 2024-04-23T18:30:36.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/278175631 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b34036e60 msgr2=0x7f3b34039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/278175631 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b34036e60 0x7f3b34039320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400bf50 tx=0x7f3c4400f000 comp rx=0 tx=0).stop 2024-04-23T18:30:36.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/278175631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010bb560 msgr2=0x5560010bb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/278175631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010bb560 0x5560010bb980 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c052520 tx=0x7f3c4c066f20 comp rx=0 tx=0).stop 2024-04-23T18:30:36.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/278175631 shutdown_connections 2024-04-23T18:30:36.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/278175631 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b34036e60 0x7f3b34039320 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/278175631 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5560010bb560 0x5560010bb980 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/278175631 >> 172.21.15.119:0/278175631 conn(0x5560010af600 msgr2=0x5560010afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/278175631 shutdown_connections 2024-04-23T18:30:36.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/278175631 wait complete. 2024-04-23T18:30:36.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5560010aa560 msgr2=0x5560010ac9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5560010aa560 0x5560010ac9d0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556000fa5340 msgr2=0x5560010a3ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556000fa5340 0x5560010a3ed0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5560010a6620 msgr2=0x5560010a8a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5560010a6620 0x5560010a8a10 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b40036eb0 msgr2=0x7f3b40039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3b40036eb0 0x7f3b40039370 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3c44000f60 tx=0x7f3c440012b0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.812+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 msgr2=0x556000fa2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:30:36.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.813+0000 7f3c5c7af800 1 --2- 172.21.15.119:0/1293684937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556000fa2a10 0x556000fa2300 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c060040 tx=0x7f3c4c002fb0 comp rx=0 tx=0).stop 2024-04-23T18:30:36.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.813+0000 7f3c5aab6640 1 -- 172.21.15.119:0/1293684937 reap_dead start 2024-04-23T18:30:36.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.813+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 shutdown_connections 2024-04-23T18:30:36.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.813+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 >> 172.21.15.119:0/1293684937 conn(0x556000f9c440 msgr2=0x556001091bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:30:36.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.813+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 shutdown_connections 2024-04-23T18:30:36.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:30:36.813+0000 7f3c5c7af800 1 -- 172.21.15.119:0/1293684937 wait complete. 2024-04-23T18:31:16.817 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-04-23T18:31:16.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-04-23T18:31:16.817 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-04-23T18:31:16.868 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:16.868 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:16.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.876+0000 7fd87ea62800 1 Processor -- start 2024-04-23T18:31:16.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.876+0000 7fd87ea62800 1 -- start start 2024-04-23T18:31:16.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.876+0000 7fd87ea62800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5602ad33ef60 0x5602ad33f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.876+0000 7fd87ea62800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5602ad1ef560 con 0x5602ad340170 2024-04-23T18:31:16.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.876+0000 7fd87ea62800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5602ad1e0e20 con 0x5602ad33ef60 2024-04-23T18:31:16.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.877+0000 7fd87c561640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5602ad33ef60 0x5602ad33f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.877+0000 7fd87bd60640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5602ad340170 0x5602ad3405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50470/0 (socket says 172.21.15.119:50470) 2024-04-23T18:31:16.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.877+0000 7fd87c561640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5602ad33ef60 0x5602ad33f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54368/0 (socket says 172.21.15.119:54368) 2024-04-23T18:31:16.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.877+0000 7fd87bd60640 1 -- 172.21.15.119:0/29140266 learned_addr learned my addr 172.21.15.119:0/29140266 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:31:16.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.877+0000 7fd87c561640 1 -- 172.21.15.119:0/29140266 >> v1:172.21.15.62:6789/0 conn(0x5602ad340170 legacy=0x5602ad3405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.877+0000 7fd87c561640 1 -- 172.21.15.119:0/29140266 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ad1eee60 con 0x5602ad33ef60 2024-04-23T18:31:16.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.879+0000 7fd87c561640 1 --2- 172.21.15.119:0/29140266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad33f380 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00a470 tx=0x7fd86c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8837d3b3f17ae70 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.879+0000 7fd87b55f640 1 -- 172.21.15.119:0/29140266 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c057070 con 0x5602ad33ef60 2024-04-23T18:31:16.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.879+0000 7fd87b55f640 1 -- 172.21.15.119:0/29140266 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd86c052570 con 0x5602ad33ef60 2024-04-23T18:31:16.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.879+0000 7fd87b55f640 1 -- 172.21.15.119:0/29140266 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c052870 con 0x5602ad33ef60 2024-04-23T18:31:16.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.880+0000 7fd87ea62800 1 -- 172.21.15.119:0/29140266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 msgr2=0x5602ad33f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.880+0000 7fd87ea62800 1 --2- 172.21.15.119:0/29140266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad33f380 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00a470 tx=0x7fd86c01ce90 comp rx=0 tx=0).stop 2024-04-23T18:31:16.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.880+0000 7fd87ea62800 1 -- 172.21.15.119:0/29140266 shutdown_connections 2024-04-23T18:31:16.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.880+0000 7fd87ea62800 1 --2- 172.21.15.119:0/29140266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad33f380 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.880+0000 7fd87ea62800 1 -- 172.21.15.119:0/29140266 >> 172.21.15.119:0/29140266 conn(0x5602ad33a540 msgr2=0x5602ad33c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:16.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.880+0000 7fd87ea62800 1 -- 172.21.15.119:0/29140266 shutdown_connections 2024-04-23T18:31:16.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.880+0000 7fd87ea62800 1 -- 172.21.15.119:0/29140266 wait complete. 2024-04-23T18:31:16.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.894+0000 7fd87ea62800 1 Processor -- start 2024-04-23T18:31:16.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.894+0000 7fd87ea62800 1 -- start start 2024-04-23T18:31:16.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.894+0000 7fd87ea62800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad430600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.894+0000 7fd87ea62800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5602ad28a5b0 con 0x5602ad33ef60 2024-04-23T18:31:16.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.894+0000 7fd87c561640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad430600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.894+0000 7fd87c561640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad430600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54382/0 (socket says 172.21.15.119:54382) 2024-04-23T18:31:16.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.894+0000 7fd87c561640 1 -- 172.21.15.119:0/1172841838 learned_addr learned my addr 172.21.15.119:0/1172841838 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:16.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.894+0000 7fd87c561640 1 -- 172.21.15.119:0/1172841838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ad200860 con 0x5602ad33ef60 2024-04-23T18:31:16.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.895+0000 7fd87c561640 1 --2- 172.21.15.119:0/1172841838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad430600 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd86c055040 tx=0x7fd86c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814c013f44a0bb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.895+0000 7fd76a60c640 1 -- 172.21.15.119:0/1172841838 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c057070 con 0x5602ad33ef60 2024-04-23T18:31:16.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.895+0000 7fd76a60c640 1 -- 172.21.15.119:0/1172841838 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd86c063070 con 0x5602ad33ef60 2024-04-23T18:31:16.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.895+0000 7fd76a60c640 1 -- 172.21.15.119:0/1172841838 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c052720 con 0x5602ad33ef60 2024-04-23T18:31:16.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87ea62800 1 -- 172.21.15.119:0/1172841838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 msgr2=0x5602ad430600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87ea62800 1 --2- 172.21.15.119:0/1172841838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad430600 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd86c055040 tx=0x7fd86c04c000 comp rx=0 tx=0).stop 2024-04-23T18:31:16.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87ea62800 1 -- 172.21.15.119:0/1172841838 shutdown_connections 2024-04-23T18:31:16.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87ea62800 1 --2- 172.21.15.119:0/1172841838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad430600 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87ea62800 1 -- 172.21.15.119:0/1172841838 >> 172.21.15.119:0/1172841838 conn(0x5602ad33a540 msgr2=0x5602ad42bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:16.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87ea62800 1 -- 172.21.15.119:0/1172841838 shutdown_connections 2024-04-23T18:31:16.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87ea62800 1 -- 172.21.15.119:0/1172841838 wait complete. 2024-04-23T18:31:16.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87ea62800 1 Processor -- start 2024-04-23T18:31:16.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87ea62800 1 -- start start 2024-04-23T18:31:16.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87ea62800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad437e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87ea62800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5602ad3485e0 con 0x5602ad33ef60 2024-04-23T18:31:16.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87c561640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad437e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87c561640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad437e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54396/0 (socket says 172.21.15.119:54396) 2024-04-23T18:31:16.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.896+0000 7fd87c561640 1 -- 172.21.15.119:0/3476752400 learned_addr learned my addr 172.21.15.119:0/3476752400 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:16.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.897+0000 7fd87c561640 1 -- 172.21.15.119:0/3476752400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ad1feeb0 con 0x5602ad33ef60 2024-04-23T18:31:16.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.897+0000 7fd87c561640 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad437e30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd86c055040 tx=0x7fd86c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.897+0000 7fd768e09640 1 -- 172.21.15.119:0/3476752400 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c052cd0 con 0x5602ad33ef60 2024-04-23T18:31:16.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.897+0000 7fd768e09640 1 -- 172.21.15.119:0/3476752400 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd86c06c070 con 0x5602ad33ef60 2024-04-23T18:31:16.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.897+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602ad438370 con 0x5602ad33ef60 2024-04-23T18:31:16.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.897+0000 7fd768e09640 1 -- 172.21.15.119:0/3476752400 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c05e480 con 0x5602ad33ef60 2024-04-23T18:31:16.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.897+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602ad4388f0 con 0x5602ad33ef60 2024-04-23T18:31:16.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.898+0000 7fd768e09640 1 -- 172.21.15.119:0/3476752400 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd86c05e620 con 0x5602ad33ef60 2024-04-23T18:31:16.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.898+0000 7fd768e09640 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd764036e60 0x7fd764039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.898+0000 7fd768e09640 1 -- 172.21.15.119:0/3476752400 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fd86c08ef50 con 0x5602ad33ef60 2024-04-23T18:31:16.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.898+0000 7fd87bd60640 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd764036e60 0x7fd764039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.898+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5602ad340170 0x5602ad43eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.898+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad43f470 con 0x5602ad340170 2024-04-23T18:31:16.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.899+0000 7fd87cd62640 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5602ad340170 0x5602ad43eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.899+0000 7fd87bd60640 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd764036e60 0x7fd764039320 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd870000f60 tx=0x7fd8700012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.899+0000 7fd87cd62640 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5602ad340170 0x5602ad43eea0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.899+0000 7fd87cd62640 1 -- 172.21.15.119:0/3476752400 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad340170 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.899+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad43c450 con 0x5602ad340170 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.899+0000 7fd87cd62640 1 -- 172.21.15.119:0/3476752400 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad340170 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.899+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5602ad4417a0 0x5602ad443b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.899+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad444230 con 0x5602ad4417a0 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.900+0000 7fd87c561640 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5602ad4417a0 0x5602ad443b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.900+0000 7fd87c561640 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5602ad4417a0 0x5602ad443b90 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.900+0000 7fd87c561640 1 -- 172.21.15.119:0/3476752400 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd86c0717f0 con 0x5602ad4417a0 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.900+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad440750 con 0x5602ad340170 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.900+0000 7fd87cd62640 1 -- 172.21.15.119:0/3476752400 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad340170 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.901+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5602ad4456e0 0x5602ad447b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.901+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad448290 con 0x5602ad4456e0 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.901+0000 7fd87bd60640 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5602ad4456e0 0x5602ad447b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.901+0000 7fd87bd60640 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5602ad4456e0 0x5602ad447b30 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.902+0000 7fd87bd60640 1 -- 172.21.15.119:0/3476752400 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd870009050 con 0x5602ad4456e0 2024-04-23T18:31:16.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.902+0000 7fd87ea62800 1 Processor -- start 2024-04-23T18:31:16.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.902+0000 7fd87ea62800 1 -- start start 2024-04-23T18:31:16.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.902+0000 7fd87ea62800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad456680 0x5602ad456aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.902+0000 7fd87ea62800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5602ad230df0 con 0x5602ad456680 2024-04-23T18:31:16.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.902+0000 7fd87c561640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad456680 0x5602ad456aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.902+0000 7fd87c561640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad456680 0x5602ad456aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54404/0 (socket says 172.21.15.119:54404) 2024-04-23T18:31:16.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.902+0000 7fd87c561640 1 -- 172.21.15.119:0/508318667 learned_addr learned my addr 172.21.15.119:0/508318667 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:16.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.903+0000 7fd87c561640 1 -- 172.21.15.119:0/508318667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ad456fe0 con 0x5602ad456680 2024-04-23T18:31:16.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.903+0000 7fd87c561640 1 --2- 172.21.15.119:0/508318667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad456680 0x5602ad456aa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd86c08d300 tx=0x7fd86c009a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.903+0000 7fd761ffb640 1 -- 172.21.15.119:0/508318667 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c096070 con 0x5602ad456680 2024-04-23T18:31:16.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.903+0000 7fd761ffb640 1 -- 172.21.15.119:0/508318667 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd86c058040 con 0x5602ad456680 2024-04-23T18:31:16.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.903+0000 7fd87ea62800 1 -- 172.21.15.119:0/508318667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602ad457a50 con 0x5602ad456680 2024-04-23T18:31:16.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.903+0000 7fd761ffb640 1 -- 172.21.15.119:0/508318667 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c0669f0 con 0x5602ad456680 2024-04-23T18:31:16.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.903+0000 7fd87ea62800 1 -- 172.21.15.119:0/508318667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602ad457f50 con 0x5602ad456680 2024-04-23T18:31:16.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.904+0000 7fd761ffb640 1 -- 172.21.15.119:0/508318667 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd86c099070 con 0x5602ad456680 2024-04-23T18:31:16.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.904+0000 7fd761ffb640 1 --2- 172.21.15.119:0/508318667 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd754036e60 0x7fd754039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.904+0000 7fd761ffb640 1 -- 172.21.15.119:0/508318667 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fd86c09cd50 con 0x5602ad456680 2024-04-23T18:31:16.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.904+0000 7fd87bd60640 1 --2- 172.21.15.119:0/508318667 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd754036e60 0x7fd754039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.905+0000 7fd87ea62800 1 Processor -- start 2024-04-23T18:31:16.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.905+0000 7fd87ea62800 1 -- start start 2024-04-23T18:31:16.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.905+0000 7fd87bd60640 1 --2- 172.21.15.119:0/508318667 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd754036e60 0x7fd754039320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd87000bf50 tx=0x7fd87000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.905+0000 7fd87ea62800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 0x5602ad463b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.905+0000 7fd87ea62800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5602ad430cc0 con 0x5602ad463770 2024-04-23T18:31:16.909 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.905+0000 7fd87c561640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 0x5602ad463b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.905+0000 7fd87c561640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 0x5602ad463b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54416/0 (socket says 172.21.15.119:54416) 2024-04-23T18:31:16.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.905+0000 7fd87c561640 1 -- 172.21.15.119:0/764153936 learned_addr learned my addr 172.21.15.119:0/764153936 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:16.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.905+0000 7fd87c561640 1 -- 172.21.15.119:0/764153936 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ad464160 con 0x5602ad463770 2024-04-23T18:31:16.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.906+0000 7fd87c561640 1 --2- 172.21.15.119:0/764153936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 0x5602ad463b90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd86c07ae80 tx=0x7fd86c08dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd90a0f5ce303f57 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.906+0000 7fd75b7fe640 1 -- 172.21.15.119:0/764153936 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c0af070 con 0x5602ad463770 2024-04-23T18:31:16.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.906+0000 7fd75b7fe640 1 -- 172.21.15.119:0/764153936 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd86c089c00 con 0x5602ad463770 2024-04-23T18:31:16.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.906+0000 7fd75b7fe640 1 -- 172.21.15.119:0/764153936 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c0a6040 con 0x5602ad463770 2024-04-23T18:31:16.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.906+0000 7fd87ea62800 1 -- 172.21.15.119:0/764153936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 msgr2=0x5602ad463b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.906+0000 7fd87ea62800 1 --2- 172.21.15.119:0/764153936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 0x5602ad463b90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd86c07ae80 tx=0x7fd86c08dd20 comp rx=0 tx=0).stop 2024-04-23T18:31:16.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.906+0000 7fd87ea62800 1 -- 172.21.15.119:0/764153936 shutdown_connections 2024-04-23T18:31:16.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.906+0000 7fd87ea62800 1 --2- 172.21.15.119:0/764153936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 0x5602ad463b90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.906+0000 7fd87ea62800 1 -- 172.21.15.119:0/764153936 >> 172.21.15.119:0/764153936 conn(0x5602ad45fad0 msgr2=0x5602ad45db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:16.910 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.906+0000 7fd87ea62800 1 -- 172.21.15.119:0/764153936 shutdown_connections 2024-04-23T18:31:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.906+0000 7fd87ea62800 1 -- 172.21.15.119:0/764153936 wait complete. 2024-04-23T18:31:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.907+0000 7fd87ea62800 1 Processor -- start 2024-04-23T18:31:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.907+0000 7fd87ea62800 1 -- start start 2024-04-23T18:31:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.907+0000 7fd87ea62800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 0x5602ad46ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.907+0000 7fd87ea62800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5602ad464810 con 0x5602ad463770 2024-04-23T18:31:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.907+0000 7fd87c561640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 0x5602ad46ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.907+0000 7fd87c561640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 0x5602ad46ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54420/0 (socket says 172.21.15.119:54420) 2024-04-23T18:31:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.907+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 learned_addr learned my addr 172.21.15.119:0/3760387393 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.907+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ad46b0d0 con 0x5602ad463770 2024-04-23T18:31:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.908+0000 7fd87c561640 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 0x5602ad46ab90 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd86c082010 tx=0x7fd86c08edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.908+0000 7fd759ffb640 1 -- 172.21.15.119:0/3760387393 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c0b8030 con 0x5602ad463770 2024-04-23T18:31:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.908+0000 7fd759ffb640 1 -- 172.21.15.119:0/3760387393 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd86c0b0040 con 0x5602ad463770 2024-04-23T18:31:16.911 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.908+0000 7fd759ffb640 1 -- 172.21.15.119:0/3760387393 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c0af070 con 0x5602ad463770 2024-04-23T18:31:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.908+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5602ad46b0d0 con 0x5602ad463770 2024-04-23T18:31:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.908+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602ad46b570 con 0x5602ad463770 2024-04-23T18:31:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.909+0000 7fd759ffb640 1 -- 172.21.15.119:0/3760387393 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fd86c0bb070 con 0x5602ad463770 2024-04-23T18:31:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.909+0000 7fd759ffb640 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd74c036eb0 0x7fd74c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.909+0000 7fd759ffb640 1 -- 172.21.15.119:0/3760387393 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fd86c0b9070 con 0x5602ad463770 2024-04-23T18:31:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.909+0000 7fd87bd60640 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd74c036eb0 0x7fd74c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.909+0000 7fd87ea62800 20 rados->read ofs=0 len=0 2024-04-23T18:31:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.909+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5602ad4762a0 0x5602ad478760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.909+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad478eb0 con 0x5602ad4762a0 2024-04-23T18:31:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.909+0000 7fd87cd62640 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5602ad4762a0 0x5602ad478760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.909+0000 7fd87bd60640 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd74c036eb0 0x7fd74c039370 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd870001b60 tx=0x7fd870010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87cd62640 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5602ad4762a0 0x5602ad478760 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.912 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad4762a0 2024-04-23T18:31:16.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87ea62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:16.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87ea62800 20 realm 2024-04-23T18:31:16.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87ea62800 20 rados->read ofs=0 len=0 2024-04-23T18:31:16.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4792c0 con 0x5602ad4762a0 2024-04-23T18:31:16.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad4762a0 2024-04-23T18:31:16.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87ea62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:16.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87ea62800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:16.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87ea62800 20 rados->read ofs=0 len=0 2024-04-23T18:31:16.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479b90 con 0x5602ad4762a0 2024-04-23T18:31:16.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad4762a0 2024-04-23T18:31:16.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87ea62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:16.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87ea62800 20 rados->read ofs=0 len=0 2024-04-23T18:31:16.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.910+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad4762a0 2024-04-23T18:31:16.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.911+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad4762a0 2024-04-23T18:31:16.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.911+0000 7fd87ea62800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:16.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.911+0000 7fd87ea62800 20 rados->read ofs=0 len=0 2024-04-23T18:31:16.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.911+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5602ad47ac90 0x5602ad47d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.911+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad47d690 con 0x5602ad47ac90 2024-04-23T18:31:16.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.911+0000 7fd87c561640 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5602ad47ac90 0x5602ad47d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.911+0000 7fd87c561640 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5602ad47ac90 0x5602ad47d080 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.911+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd86c0b2070 con 0x5602ad47ac90 2024-04-23T18:31:16.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.912+0000 7fd87ea62800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:16.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.912+0000 7fd87ea62800 20 searching for the correct realm 2024-04-23T18:31:16.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.912+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5602ad47f640 0x5602ad481b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.914 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.912+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4821d0 con 0x5602ad47f640 2024-04-23T18:31:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.912+0000 7fd87bd60640 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5602ad47f640 0x5602ad481b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.912+0000 7fd87bd60640 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5602ad47f640 0x5602ad481b00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.912+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.912+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4821d0 con 0x5602ad47ac90 2024-04-23T18:31:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.913+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd86c0b2070 con 0x5602ad47ac90 2024-04-23T18:31:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.913+0000 7fd87c561640 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fd86c0bd030 0x7fd86c095170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.913+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4821d0 con 0x7fd86c0bd030 2024-04-23T18:31:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.913+0000 7fd87cd62640 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fd86c0bd030 0x7fd86c095170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.913+0000 7fd87cd62640 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fd86c0bd030 0x7fd86c095170 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.914+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87400a4a0 con 0x7fd86c0bd030 2024-04-23T18:31:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.914+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad4762a0 2024-04-23T18:31:16.915 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.914+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad4762a0 2024-04-23T18:31:16.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.914+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad4762a0 2024-04-23T18:31:16.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.914+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad4762a0 2024-04-23T18:31:16.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.914+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x7fd86c0bd030 2024-04-23T18:31:16.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.915+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87400a4a0 con 0x7fd86c0bd030 2024-04-23T18:31:16.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.915+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x7fd86c0bd030 2024-04-23T18:31:16.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.915+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd87400a4a0 con 0x7fd86c0bd030 2024-04-23T18:31:16.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.915+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47ac90 2024-04-23T18:31:16.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.915+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd86c0b2070 con 0x5602ad47ac90 2024-04-23T18:31:16.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.915+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47f640 2024-04-23T18:31:16.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.915+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.915+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad4762a0 2024-04-23T18:31:16.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.916+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad4762a0 2024-04-23T18:31:16.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.916+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x7fd86c0bd030 2024-04-23T18:31:16.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.916+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87400a4a0 con 0x7fd86c0bd030 2024-04-23T18:31:16.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.916+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad4762a0 2024-04-23T18:31:16.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.916+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad4762a0 2024-04-23T18:31:16.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.916+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47ac90 2024-04-23T18:31:16.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.917+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd86c0b2070 con 0x5602ad47ac90 2024-04-23T18:31:16.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.917+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47f640 2024-04-23T18:31:16.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.917+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.917+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47f640 2024-04-23T18:31:16.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.917+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.917+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x7fd86c0bd030 2024-04-23T18:31:16.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.917+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87400a4a0 con 0x7fd86c0bd030 2024-04-23T18:31:16.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.918+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47f640 2024-04-23T18:31:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.918+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.918+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47f640 2024-04-23T18:31:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.918+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.918+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad4762a0 2024-04-23T18:31:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.918+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad4762a0 2024-04-23T18:31:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.918+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad4762a0 2024-04-23T18:31:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.919+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad4762a0 2024-04-23T18:31:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.919+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x7fd86c0bd030 2024-04-23T18:31:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.919+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87400a4a0 con 0x7fd86c0bd030 2024-04-23T18:31:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.919+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47f640 2024-04-23T18:31:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.919+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.919+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47ac90 2024-04-23T18:31:16.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.919+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd86c0b2070 con 0x5602ad47ac90 2024-04-23T18:31:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.920+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad4762a0 2024-04-23T18:31:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.920+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87400a4a0 con 0x5602ad4762a0 2024-04-23T18:31:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.920+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47ac90 2024-04-23T18:31:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.920+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd86c0b2070 con 0x5602ad47ac90 2024-04-23T18:31:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.920+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47f640 2024-04-23T18:31:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.920+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.920+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x7fd86c0bd030 2024-04-23T18:31:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.921+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87400a4a0 con 0x7fd86c0bd030 2024-04-23T18:31:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.921+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47ac90 2024-04-23T18:31:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.921+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd86c0d7040 con 0x5602ad47ac90 2024-04-23T18:31:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.921+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47f640 2024-04-23T18:31:16.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.921+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.921+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x7fd86c0bd030 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87400a4a0 con 0x7fd86c0bd030 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad4762a0 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd874040080 con 0x5602ad4762a0 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5602ad479f30 con 0x5602ad47ac90 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd86c0d7040 con 0x5602ad47ac90 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87ea62800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87ea62800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87ea62800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87ea62800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87ea62800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87ea62800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87ea62800 20 rados->read ofs=0 len=0 2024-04-23T18:31:16.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad47df50 con 0x5602ad4762a0 2024-04-23T18:31:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd874040080 con 0x5602ad4762a0 2024-04-23T18:31:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87ea62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87ea62800 20 rados->read ofs=0 len=0 2024-04-23T18:31:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.922+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad47e340 con 0x5602ad4762a0 2024-04-23T18:31:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd874040080 con 0x5602ad4762a0 2024-04-23T18:31:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 20 rados->read ofs=0 len=0 2024-04-23T18:31:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad47e340 con 0x7fd86c0bd030 2024-04-23T18:31:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd874040080 con 0x7fd86c0bd030 2024-04-23T18:31:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 20 zone default found 2024-04-23T18:31:16.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 4 Realm: () 2024-04-23T18:31:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 20 zonegroup default 2024-04-23T18:31:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 20 rados->read ofs=0 len=0 2024-04-23T18:31:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad482650 con 0x5602ad47ac90 2024-04-23T18:31:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd86c0d7040 con 0x5602ad47ac90 2024-04-23T18:31:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 20 rados->read ofs=0 len=0 2024-04-23T18:31:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.923+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4843d0 con 0x5602ad47f640 2024-04-23T18:31:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.924+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.924+0000 7fd87ea62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:16.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.924+0000 7fd87ea62800 20 rados->read ofs=0 len=0 2024-04-23T18:31:16.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.924+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad484770 con 0x5602ad47f640 2024-04-23T18:31:16.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.924+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.924+0000 7fd87ea62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:16.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.924+0000 7fd87ea62800 20 started sync module instance, tier type = 2024-04-23T18:31:16.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.924+0000 7fd87ea62800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:16.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.924+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad483870 con 0x5602ad47ac90 2024-04-23T18:31:16.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.925+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd86c0d7040 con 0x5602ad47ac90 2024-04-23T18:31:16.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.925+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94569497113536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad484b10 con 0x5602ad47ac90 2024-04-23T18:31:16.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.925+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4854d0 con 0x5602ad4762a0 2024-04-23T18:31:16.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.926+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94569497113536] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd86c0d7040 con 0x5602ad47ac90 2024-04-23T18:31:16.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.927+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x5602ad4762a0 2024-04-23T18:31:16.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.927+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94569497115792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4854d0 con 0x5602ad4762a0 2024-04-23T18:31:16.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.927+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad485f10 con 0x5602ad47f640 2024-04-23T18:31:16.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.928+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.928+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94569497123296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4867b0 con 0x5602ad47f640 2024-04-23T18:31:16.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.928+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad487290 con 0x5602ad47ac90 2024-04-23T18:31:16.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.928+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94569497115792] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x5602ad4762a0 2024-04-23T18:31:16.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.929+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94569497123296] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.930+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd86c0d7040 con 0x5602ad47ac90 2024-04-23T18:31:16.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.930+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94569497125632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad486da0 con 0x5602ad47ac90 2024-04-23T18:31:16.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.930+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad487cd0 con 0x5602ad4762a0 2024-04-23T18:31:16.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.931+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94569497125632] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd86c0d7040 con 0x5602ad47ac90 2024-04-23T18:31:16.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.931+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x5602ad4762a0 2024-04-23T18:31:16.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.931+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94569497120800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad487cd0 con 0x5602ad4762a0 2024-04-23T18:31:16.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.931+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4885a0 con 0x7fd86c0bd030 2024-04-23T18:31:16.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.932+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94569497120800] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x5602ad4762a0 2024-04-23T18:31:16.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.932+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x7fd86c0bd030 2024-04-23T18:31:16.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.932+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94569497131040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad488560 con 0x7fd86c0bd030 2024-04-23T18:31:16.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.932+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad488fa0 con 0x7fd86c0bd030 2024-04-23T18:31:16.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.933+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(56 notify.6 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x7fd86c0bd030 2024-04-23T18:31:16.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.933+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94569497135728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad489410 con 0x7fd86c0bd030 2024-04-23T18:31:16.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.933+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad489410 con 0x7fd86c0bd030 2024-04-23T18:31:16.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.933+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94569497131040] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x7fd86c0bd030 2024-04-23T18:31:16.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.935+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94569497135728] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x7fd86c0bd030 2024-04-23T18:31:16.937 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.935+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x7fd86c0bd030 2024-04-23T18:31:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.935+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94569497132800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad489410 con 0x7fd86c0bd030 2024-04-23T18:31:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.935+0000 7fd87ea62800 20 add_watcher() i=0 2024-04-23T18:31:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.935+0000 7fd87ea62800 20 add_watcher() i=1 2024-04-23T18:31:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.935+0000 7fd87ea62800 20 add_watcher() i=2 2024-04-23T18:31:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.935+0000 7fd87ea62800 20 add_watcher() i=3 2024-04-23T18:31:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.935+0000 7fd87ea62800 20 add_watcher() i=4 2024-04-23T18:31:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.935+0000 7fd87ea62800 20 add_watcher() i=5 2024-04-23T18:31:16.938 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.935+0000 7fd87ea62800 20 add_watcher() i=6 2024-04-23T18:31:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.936+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94569497132800] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x7fd86c0bd030 2024-04-23T18:31:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.936+0000 7fd87ea62800 20 add_watcher() i=7 2024-04-23T18:31:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.936+0000 7fd87ea62800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.936+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad48cf00 con 0x5602ad4762a0 2024-04-23T18:31:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.936+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd874040080 con 0x5602ad4762a0 2024-04-23T18:31:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.936+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94569497137456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad48a380 con 0x5602ad4762a0 2024-04-23T18:31:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.937+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94569497137456] v34'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd874040080 con 0x5602ad4762a0 2024-04-23T18:31:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.937+0000 7fd7327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:16.939 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd87ea62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd87ea62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd87ea62800 5 note: GC not initialized 2024-04-23T18:31:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd7317e2640 20 reqs_thread_entry: start 2024-04-23T18:31:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd87ea62800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd87ea62800 20 Filter name: none 2024-04-23T18:31:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd6a2ffd640 20 reqs_thread_entry: start 2024-04-23T18:31:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd87ea62800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:31:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd87ea62800 20 rados->read ofs=0 len=0 2024-04-23T18:31:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4c05a0 con 0x5602ad4762a0 2024-04-23T18:31:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd874040080 con 0x5602ad4762a0 2024-04-23T18:31:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd87ea62800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:31:16.940 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd87ea62800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:31:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd87ea62800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:31:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.938+0000 7fd87ea62800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.939+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4c3030 con 0x7fd86c0bd030 2024-04-23T18:31:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.940+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 usage.10 [call] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x7fd86c0bd030 2024-04-23T18:31:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.940+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4c3030 con 0x7fd86c0bd030 2024-04-23T18:31:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.941+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(64 usage.10 [call] v34'34 uv33 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x7fd86c0bd030 2024-04-23T18:31:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.942+0000 7fd7327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.942+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94569497137456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad472310 con 0x5602ad4762a0 2024-04-23T18:31:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.943+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94569497137456] v34'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd874040080 con 0x5602ad4762a0 2024-04-23T18:31:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.943+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94569497113536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad489100 con 0x5602ad47ac90 2024-04-23T18:31:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.944+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94569497113536] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd86c0d7040 con 0x5602ad47ac90 2024-04-23T18:31:16.941 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.944+0000 7fd87ea62800 20 remove_watcher() i=0 2024-04-23T18:31:16.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.944+0000 7fd87ea62800 2 removed watcher, disabling cache 2024-04-23T18:31:16.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.944+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94569497115792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4c0140 con 0x5602ad4762a0 2024-04-23T18:31:16.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.946+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94569497115792] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x5602ad4762a0 2024-04-23T18:31:16.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.946+0000 7fd87ea62800 20 remove_watcher() i=1 2024-04-23T18:31:16.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.946+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94569497123296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4c0140 con 0x5602ad47f640 2024-04-23T18:31:16.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.947+0000 7fd87bd60640 1 -- 172.21.15.119:0/3760387393 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94569497123296] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd870009050 con 0x5602ad47f640 2024-04-23T18:31:16.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.947+0000 7fd87ea62800 20 remove_watcher() i=2 2024-04-23T18:31:16.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.947+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94569497125632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad483c90 con 0x5602ad47ac90 2024-04-23T18:31:16.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.948+0000 7fd87c561640 1 -- 172.21.15.119:0/3760387393 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94569497125632] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd86c0d7040 con 0x5602ad47ac90 2024-04-23T18:31:16.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.948+0000 7fd87ea62800 20 remove_watcher() i=3 2024-04-23T18:31:16.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.948+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94569497120800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad486300 con 0x5602ad4762a0 2024-04-23T18:31:16.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.949+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94569497120800] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x5602ad4762a0 2024-04-23T18:31:16.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.949+0000 7fd87ea62800 20 remove_watcher() i=4 2024-04-23T18:31:16.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.949+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94569497131040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad485020 con 0x7fd86c0bd030 2024-04-23T18:31:16.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.950+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94569497131040] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x7fd86c0bd030 2024-04-23T18:31:16.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.950+0000 7fd87ea62800 20 remove_watcher() i=5 2024-04-23T18:31:16.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.950+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94569497135728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad487820 con 0x7fd86c0bd030 2024-04-23T18:31:16.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.951+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94569497135728] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x7fd86c0bd030 2024-04-23T18:31:16.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.951+0000 7fd87ea62800 20 remove_watcher() i=6 2024-04-23T18:31:16.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.951+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94569497132800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5602ad4859e0 con 0x7fd86c0bd030 2024-04-23T18:31:16.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.952+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94569497132800] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874040080 con 0x7fd86c0bd030 2024-04-23T18:31:16.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.952+0000 7fd87ea62800 20 remove_watcher() i=7 2024-04-23T18:31:16.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fd86c0bd030 msgr2=0x7fd86c095170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fd86c0bd030 0x7fd86c095170 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5602ad4762a0 msgr2=0x5602ad478760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5602ad4762a0 0x5602ad478760 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5602ad47ac90 msgr2=0x5602ad47d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5602ad47ac90 0x5602ad47d080 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5602ad47f640 msgr2=0x5602ad481b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5602ad47f640 0x5602ad481b00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd74c036eb0 msgr2=0x7fd74c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd74c036eb0 0x7fd74c039370 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd870001b60 tx=0x7fd870010000 comp rx=0 tx=0).stop 2024-04-23T18:31:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 msgr2=0x5602ad46ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87cd62640 1 -- 172.21.15.119:0/3760387393 reap_dead start 2024-04-23T18:31:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 0x5602ad46ab90 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd86c082010 tx=0x7fd86c08edd0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 shutdown_connections 2024-04-23T18:31:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3760387393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad463770 0x5602ad46ab90 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 >> 172.21.15.119:0/3760387393 conn(0x5602ad45fad0 msgr2=0x5602ad45d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 shutdown_connections 2024-04-23T18:31:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/3760387393 wait complete. 2024-04-23T18:31:16.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/508318667 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd754036e60 msgr2=0x7fd754039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 --2- 172.21.15.119:0/508318667 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd754036e60 0x7fd754039320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd87000bf50 tx=0x7fd87000f000 comp rx=0 tx=0).stop 2024-04-23T18:31:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/508318667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad456680 msgr2=0x5602ad456aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 --2- 172.21.15.119:0/508318667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad456680 0x5602ad456aa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd86c08d300 tx=0x7fd86c009a80 comp rx=0 tx=0).stop 2024-04-23T18:31:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/508318667 shutdown_connections 2024-04-23T18:31:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 --2- 172.21.15.119:0/508318667 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd754036e60 0x7fd754039320 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 --2- 172.21.15.119:0/508318667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad456680 0x5602ad456aa0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/508318667 >> 172.21.15.119:0/508318667 conn(0x5602ad44a720 msgr2=0x5602ad44ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/508318667 shutdown_connections 2024-04-23T18:31:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.953+0000 7fd87ea62800 1 -- 172.21.15.119:0/508318667 wait complete. 2024-04-23T18:31:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5602ad4456e0 msgr2=0x5602ad447b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5602ad4456e0 0x5602ad447b30 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5602ad340170 msgr2=0x5602ad43eea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5602ad340170 0x5602ad43eea0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5602ad4417a0 msgr2=0x5602ad443b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5602ad4417a0 0x5602ad443b90 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd764036e60 msgr2=0x7fd764039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fd764036e60 0x7fd764039320 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd870000f60 tx=0x7fd8700012b0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 msgr2=0x5602ad437e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 --2- 172.21.15.119:0/3476752400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5602ad33ef60 0x5602ad437e30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd86c055040 tx=0x7fd86c002fb0 comp rx=0 tx=0).stop 2024-04-23T18:31:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87cd62640 1 -- 172.21.15.119:0/3476752400 reap_dead start 2024-04-23T18:31:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 shutdown_connections 2024-04-23T18:31:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 >> 172.21.15.119:0/3476752400 conn(0x5602ad33a540 msgr2=0x5602ad42eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 shutdown_connections 2024-04-23T18:31:16.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:16.954+0000 7fd87ea62800 1 -- 172.21.15.119:0/3476752400 wait complete. 2024-04-23T18:31:16.954 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-23T18:31:16.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-23T18:31:16.955 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-23T18:31:16.998 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:16.998 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:16.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.006+0000 7f7d5db2f800 1 Processor -- start 2024-04-23T18:31:16.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.006+0000 7f7d5db2f800 1 -- start start 2024-04-23T18:31:16.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.006+0000 7f7d5db2f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b58ec44870 0x55b58ec44c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:16.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.006+0000 7f7d5db2f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b58eaf6560 con 0x55b58ec451d0 2024-04-23T18:31:16.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.006+0000 7f7d5db2f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55b58eae7e20 con 0x55b58ec44870 2024-04-23T18:31:16.999 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.007+0000 7f7d597ae640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b58ec44870 0x55b58ec44c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.007+0000 7f7d58fad640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55b58ec451d0 0x55b58ec45680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50482/0 (socket says 172.21.15.119:50482) 2024-04-23T18:31:17.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.007+0000 7f7d597ae640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b58ec44870 0x55b58ec44c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54430/0 (socket says 172.21.15.119:54430) 2024-04-23T18:31:17.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.007+0000 7f7d58fad640 1 -- 172.21.15.119:0/2948470478 learned_addr learned my addr 172.21.15.119:0/2948470478 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:31:17.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.007+0000 7f7d597ae640 1 -- 172.21.15.119:0/2948470478 >> v1:172.21.15.62:6789/0 conn(0x55b58ec451d0 legacy=0x55b58ec45680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.000 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.007+0000 7f7d597ae640 1 -- 172.21.15.119:0/2948470478 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b58eaf5e60 con 0x55b58ec44870 2024-04-23T18:31:17.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.009+0000 7f7d597ae640 1 --2- 172.21.15.119:0/2948470478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ec44c90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c005fd0 tx=0x7f7d4c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4916cdcb4be7af3f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.009+0000 7f7d53fff640 1 -- 172.21.15.119:0/2948470478 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c052560 con 0x55b58ec44870 2024-04-23T18:31:17.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.009+0000 7f7d53fff640 1 -- 172.21.15.119:0/2948470478 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4c052700 con 0x55b58ec44870 2024-04-23T18:31:17.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.009+0000 7f7d53fff640 1 -- 172.21.15.119:0/2948470478 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c052a60 con 0x55b58ec44870 2024-04-23T18:31:17.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.009+0000 7f7d5db2f800 1 -- 172.21.15.119:0/2948470478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 msgr2=0x55b58ec44c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.009+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/2948470478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ec44c90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c005fd0 tx=0x7f7d4c01ccc0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.009+0000 7f7d5db2f800 1 -- 172.21.15.119:0/2948470478 shutdown_connections 2024-04-23T18:31:17.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.009+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/2948470478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ec44c90 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.009+0000 7f7d5db2f800 1 -- 172.21.15.119:0/2948470478 >> 172.21.15.119:0/2948470478 conn(0x55b58ec40410 msgr2=0x55b58ec42830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.009+0000 7f7d5db2f800 1 -- 172.21.15.119:0/2948470478 shutdown_connections 2024-04-23T18:31:17.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.009+0000 7f7d5db2f800 1 -- 172.21.15.119:0/2948470478 wait complete. 2024-04-23T18:31:17.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.021+0000 7f7d5db2f800 1 Processor -- start 2024-04-23T18:31:17.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.021+0000 7f7d5db2f800 1 -- start start 2024-04-23T18:31:17.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.021+0000 7f7d5db2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ed39460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.021+0000 7f7d5db2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b58eb915b0 con 0x55b58ec44870 2024-04-23T18:31:17.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.021+0000 7f7d597ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ed39460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.021+0000 7f7d597ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ed39460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54440/0 (socket says 172.21.15.119:54440) 2024-04-23T18:31:17.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.021+0000 7f7d597ae640 1 -- 172.21.15.119:0/954491556 learned_addr learned my addr 172.21.15.119:0/954491556 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.022+0000 7f7d597ae640 1 -- 172.21.15.119:0/954491556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b58eb07860 con 0x55b58ec44870 2024-04-23T18:31:17.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.022+0000 7f7d597ae640 1 --2- 172.21.15.119:0/954491556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ed39460 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00a3f0 tx=0x7f7d4c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e04125002c2d84 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.022+0000 7f7c47606640 1 -- 172.21.15.119:0/954491556 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c052cd0 con 0x55b58ec44870 2024-04-23T18:31:17.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.022+0000 7f7c47606640 1 -- 172.21.15.119:0/954491556 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0528b0 con 0x55b58ec44870 2024-04-23T18:31:17.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.022+0000 7f7c47606640 1 -- 172.21.15.119:0/954491556 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c05c430 con 0x55b58ec44870 2024-04-23T18:31:17.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.023+0000 7f7d5db2f800 1 -- 172.21.15.119:0/954491556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 msgr2=0x55b58ed39460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.023+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/954491556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ed39460 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00a3f0 tx=0x7f7d4c04c000 comp rx=0 tx=0).stop 2024-04-23T18:31:17.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.023+0000 7f7d5db2f800 1 -- 172.21.15.119:0/954491556 shutdown_connections 2024-04-23T18:31:17.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.023+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/954491556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ed39460 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.023+0000 7f7d5db2f800 1 -- 172.21.15.119:0/954491556 >> 172.21.15.119:0/954491556 conn(0x55b58ec40410 msgr2=0x55b58ed34d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.023+0000 7f7d5db2f800 1 -- 172.21.15.119:0/954491556 shutdown_connections 2024-04-23T18:31:17.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.023+0000 7f7d5db2f800 1 -- 172.21.15.119:0/954491556 wait complete. 2024-04-23T18:31:17.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.023+0000 7f7d5db2f800 1 Processor -- start 2024-04-23T18:31:17.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.023+0000 7f7d5db2f800 1 -- start start 2024-04-23T18:31:17.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.024+0000 7f7d5db2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ed40c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.024+0000 7f7d5db2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b58ec46030 con 0x55b58ec44870 2024-04-23T18:31:17.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.024+0000 7f7d597ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ed40c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.024+0000 7f7d597ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ed40c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54444/0 (socket says 172.21.15.119:54444) 2024-04-23T18:31:17.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.024+0000 7f7d597ae640 1 -- 172.21.15.119:0/205493666 learned_addr learned my addr 172.21.15.119:0/205493666 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.018 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.024+0000 7f7d597ae640 1 -- 172.21.15.119:0/205493666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b58eb05eb0 con 0x55b58ec44870 2024-04-23T18:31:17.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.024+0000 7f7d597ae640 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ed40c40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0526d0 tx=0x7f7d4c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.024+0000 7f7c45e03640 1 -- 172.21.15.119:0/205493666 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c071440 con 0x55b58ec44870 2024-04-23T18:31:17.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.024+0000 7f7c45e03640 1 -- 172.21.15.119:0/205493666 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0715e0 con 0x55b58ec44870 2024-04-23T18:31:17.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.025+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b58ed41180 con 0x55b58ec44870 2024-04-23T18:31:17.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.025+0000 7f7c45e03640 1 -- 172.21.15.119:0/205493666 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c0718e0 con 0x55b58ec44870 2024-04-23T18:31:17.019 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.025+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b58ed416a0 con 0x55b58ec44870 2024-04-23T18:31:17.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.025+0000 7f7c45e03640 1 -- 172.21.15.119:0/205493666 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7d4c07a440 con 0x55b58ec44870 2024-04-23T18:31:17.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.026+0000 7f7c45e03640 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c40036e60 0x7f7c40039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.026+0000 7f7c45e03640 1 -- 172.21.15.119:0/205493666 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f7d4c08fed0 con 0x55b58ec44870 2024-04-23T18:31:17.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.026+0000 7f7d58fad640 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c40036e60 0x7f7c40039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.026+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b58ec451d0 0x55b58ed47b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.026+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed481f0 con 0x55b58ec451d0 2024-04-23T18:31:17.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.026+0000 7f7d59faf640 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b58ec451d0 0x55b58ed47b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.026+0000 7f7d58fad640 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c40036e60 0x7f7c40039320 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7d44000f60 tx=0x7f7d440012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.026+0000 7f7d59faf640 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b58ec451d0 0x55b58ed47b80 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.026+0000 7f7d59faf640 1 -- 172.21.15.119:0/205493666 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d540083e0 con 0x55b58ec451d0 2024-04-23T18:31:17.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.026+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed45260 con 0x55b58ec451d0 2024-04-23T18:31:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.027+0000 7f7d59faf640 1 -- 172.21.15.119:0/205493666 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d540083e0 con 0x55b58ec451d0 2024-04-23T18:31:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.027+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b58ed4a520 0x55b58ed4c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.027+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed4d000 con 0x55b58ed4a520 2024-04-23T18:31:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.027+0000 7f7d597ae640 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b58ed4a520 0x55b58ed4c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.027+0000 7f7d597ae640 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b58ed4a520 0x55b58ed4c910 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.027+0000 7f7d597ae640 1 -- 172.21.15.119:0/205493666 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d4c077020 con 0x55b58ed4a520 2024-04-23T18:31:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.027+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed494d0 con 0x55b58ec451d0 2024-04-23T18:31:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.028+0000 7f7d59faf640 1 -- 172.21.15.119:0/205493666 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d540083e0 con 0x55b58ec451d0 2024-04-23T18:31:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.028+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b58ed4e460 0x55b58ed508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.028+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed51030 con 0x55b58ed4e460 2024-04-23T18:31:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.028+0000 7f7d58fad640 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b58ed4e460 0x55b58ed508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.028+0000 7f7d58fad640 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b58ed4e460 0x55b58ed508d0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.029+0000 7f7d58fad640 1 -- 172.21.15.119:0/205493666 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed4e460 2024-04-23T18:31:17.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.029+0000 7f7d5db2f800 1 Processor -- start 2024-04-23T18:31:17.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.029+0000 7f7d5db2f800 1 -- start start 2024-04-23T18:31:17.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.029+0000 7f7d5db2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed5f4e0 0x55b58ed5f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.029+0000 7f7d5db2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b58eb37df0 con 0x55b58ed5f4e0 2024-04-23T18:31:17.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.029+0000 7f7d597ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed5f4e0 0x55b58ed5f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.029+0000 7f7d597ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed5f4e0 0x55b58ed5f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54450/0 (socket says 172.21.15.119:54450) 2024-04-23T18:31:17.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.029+0000 7f7d597ae640 1 -- 172.21.15.119:0/275938846 learned_addr learned my addr 172.21.15.119:0/275938846 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.030+0000 7f7d597ae640 1 -- 172.21.15.119:0/275938846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b58ed5fe40 con 0x55b58ed5f4e0 2024-04-23T18:31:17.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.030+0000 7f7d597ae640 1 --2- 172.21.15.119:0/275938846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed5f4e0 0x55b58ed5f900 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c08e270 tx=0x7f7d4c051610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.030+0000 7f7c3effd640 1 -- 172.21.15.119:0/275938846 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c065d90 con 0x55b58ed5f4e0 2024-04-23T18:31:17.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.030+0000 7f7c3effd640 1 -- 172.21.15.119:0/275938846 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4c051aa0 con 0x55b58ed5f4e0 2024-04-23T18:31:17.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.030+0000 7f7d5db2f800 1 -- 172.21.15.119:0/275938846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b58ed608b0 con 0x55b58ed5f4e0 2024-04-23T18:31:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.030+0000 7f7c3effd640 1 -- 172.21.15.119:0/275938846 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c051da0 con 0x55b58ed5f4e0 2024-04-23T18:31:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.030+0000 7f7d5db2f800 1 -- 172.21.15.119:0/275938846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b58ed608b0 con 0x55b58ed5f4e0 2024-04-23T18:31:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.031+0000 7f7c3effd640 1 -- 172.21.15.119:0/275938846 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7d4c005030 con 0x55b58ed5f4e0 2024-04-23T18:31:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.031+0000 7f7c3effd640 1 --2- 172.21.15.119:0/275938846 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c30036e60 0x7f7c30039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.031+0000 7f7c3effd640 1 -- 172.21.15.119:0/275938846 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f7d4c087050 con 0x55b58ed5f4e0 2024-04-23T18:31:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.031+0000 7f7d58fad640 1 --2- 172.21.15.119:0/275938846 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c30036e60 0x7f7c30039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.031+0000 7f7d5db2f800 1 Processor -- start 2024-04-23T18:31:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.031+0000 7f7d58fad640 1 --2- 172.21.15.119:0/275938846 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c30036e60 0x7f7c30039320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400bf50 tx=0x7f7d4400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.032+0000 7f7d5db2f800 1 -- start start 2024-04-23T18:31:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.032+0000 7f7d5db2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 0x55b58ed6c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.032+0000 7f7d5db2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b58ed39b20 con 0x55b58ed6c430 2024-04-23T18:31:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.032+0000 7f7d597ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 0x55b58ed6c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.032+0000 7f7d597ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 0x55b58ed6c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54458/0 (socket says 172.21.15.119:54458) 2024-04-23T18:31:17.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.032+0000 7f7d597ae640 1 -- 172.21.15.119:0/1798534220 learned_addr learned my addr 172.21.15.119:0/1798534220 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.032+0000 7f7d597ae640 1 -- 172.21.15.119:0/1798534220 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b58ed6ce20 con 0x55b58ed6c430 2024-04-23T18:31:17.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.032+0000 7f7d597ae640 1 --2- 172.21.15.119:0/1798534220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 0x55b58ed6c850 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c05cfd0 tx=0x7f7d4c08aa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29698afcfaa251e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.032+0000 7f7c3cff9640 1 -- 172.21.15.119:0/1798534220 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c08f360 con 0x55b58ed6c430 2024-04-23T18:31:17.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.032+0000 7f7c3cff9640 1 -- 172.21.15.119:0/1798534220 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4c004600 con 0x55b58ed6c430 2024-04-23T18:31:17.029 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.032+0000 7f7c3cff9640 1 -- 172.21.15.119:0/1798534220 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c05b940 con 0x55b58ed6c430 2024-04-23T18:31:17.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.033+0000 7f7d5db2f800 1 -- 172.21.15.119:0/1798534220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 msgr2=0x55b58ed6c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.033+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/1798534220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 0x55b58ed6c850 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c05cfd0 tx=0x7f7d4c08aa20 comp rx=0 tx=0).stop 2024-04-23T18:31:17.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.033+0000 7f7d5db2f800 1 -- 172.21.15.119:0/1798534220 shutdown_connections 2024-04-23T18:31:17.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.033+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/1798534220 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 0x55b58ed6c850 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.033+0000 7f7d5db2f800 1 -- 172.21.15.119:0/1798534220 >> 172.21.15.119:0/1798534220 conn(0x55b58ed68790 msgr2=0x55b58ed667f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.033+0000 7f7d5db2f800 1 -- 172.21.15.119:0/1798534220 shutdown_connections 2024-04-23T18:31:17.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.033+0000 7f7d5db2f800 1 -- 172.21.15.119:0/1798534220 wait complete. 2024-04-23T18:31:17.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.033+0000 7f7d5db2f800 1 Processor -- start 2024-04-23T18:31:17.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.033+0000 7f7d5db2f800 1 -- start start 2024-04-23T18:31:17.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.033+0000 7f7d5db2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 0x55b58ed73870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.033+0000 7f7d5db2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b58ed6d4d0 con 0x55b58ed6c430 2024-04-23T18:31:17.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.034+0000 7f7d597ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 0x55b58ed73870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.034+0000 7f7d597ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 0x55b58ed73870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54460/0 (socket says 172.21.15.119:54460) 2024-04-23T18:31:17.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.034+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 learned_addr learned my addr 172.21.15.119:0/484986753 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.034+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b58ed73db0 con 0x55b58ed6c430 2024-04-23T18:31:17.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.034+0000 7f7d597ae640 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 0x55b58ed73870 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c08aa60 tx=0x7f7d4c054e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.034+0000 7f7c2effd640 1 -- 172.21.15.119:0/484986753 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c0b7070 con 0x55b58ed6c430 2024-04-23T18:31:17.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.034+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b58ed73db0 con 0x55b58ed6c430 2024-04-23T18:31:17.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.034+0000 7f7c2effd640 1 -- 172.21.15.119:0/484986753 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0ac040 con 0x55b58ed6c430 2024-04-23T18:31:17.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.034+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b58ed73db0 con 0x55b58ed6c430 2024-04-23T18:31:17.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.034+0000 7f7c2effd640 1 -- 172.21.15.119:0/484986753 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c08fcc0 con 0x55b58ed6c430 2024-04-23T18:31:17.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.035+0000 7f7c2effd640 1 -- 172.21.15.119:0/484986753 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7d4c0ba070 con 0x55b58ed6c430 2024-04-23T18:31:17.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.035+0000 7f7d5db2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.035+0000 7f7c2effd640 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c24036fb0 0x7f7c24039470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.035+0000 7f7c2effd640 1 -- 172.21.15.119:0/484986753 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f7d4c0b3d50 con 0x55b58ed6c430 2024-04-23T18:31:17.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d58fad640 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c24036fb0 0x7f7c24039470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b58ed7ee80 0x55b58ed81340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed81a90 con 0x55b58ed7ee80 2024-04-23T18:31:17.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d59faf640 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b58ed7ee80 0x55b58ed81340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d58fad640 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c24036fb0 0x7f7c24039470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7d44001b60 tx=0x7f7d44010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d59faf640 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b58ed7ee80 0x55b58ed81340 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d540083e0 con 0x55b58ed7ee80 2024-04-23T18:31:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d5db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d5db2f800 20 realm 2024-04-23T18:31:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d5db2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed81ec0 con 0x55b58ed7ee80 2024-04-23T18:31:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d540083e0 con 0x55b58ed7ee80 2024-04-23T18:31:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d5db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d5db2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d5db2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.036+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed7ee80 2024-04-23T18:31:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d540083e0 con 0x55b58ed7ee80 2024-04-23T18:31:17.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d5db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d5db2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82b00 con 0x55b58ed7ee80 2024-04-23T18:31:17.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d540083e0 con 0x55b58ed7ee80 2024-04-23T18:31:17.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d5db2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:17.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d5db2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b58ed834c0 0x55b58ed858b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed85df0 con 0x55b58ed834c0 2024-04-23T18:31:17.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d597ae640 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b58ed834c0 0x55b58ed858b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d597ae640 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b58ed834c0 0x55b58ed858b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d5db2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:17.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.037+0000 7f7d5db2f800 20 searching for the correct realm 2024-04-23T18:31:17.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.038+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b58ed87ee0 0x55b58ed8a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.038+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8aa70 con 0x55b58ed87ee0 2024-04-23T18:31:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.038+0000 7f7d58fad640 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b58ed87ee0 0x55b58ed8a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.038+0000 7f7d58fad640 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b58ed87ee0 0x55b58ed8a3a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.038+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.038+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8aa70 con 0x55b58ed834c0 2024-04-23T18:31:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.038+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.038+0000 7f7d597ae640 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f7d4c0bc060 0x7f7d4c06b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.038+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8aa70 con 0x7f7d4c0bc060 2024-04-23T18:31:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.039+0000 7f7d59faf640 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f7d4c0bc060 0x7f7d4c06b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.039+0000 7f7d59faf640 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f7d4c0bc060 0x7f7d4c06b150 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.039+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540083e0 con 0x7f7d4c0bc060 2024-04-23T18:31:17.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.039+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed7ee80 2024-04-23T18:31:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.040+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d540083e0 con 0x55b58ed7ee80 2024-04-23T18:31:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.040+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed7ee80 2024-04-23T18:31:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.040+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54026040 con 0x55b58ed7ee80 2024-04-23T18:31:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.040+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x7f7d4c0bc060 2024-04-23T18:31:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.040+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54026040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.040+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x7f7d4c0bc060 2024-04-23T18:31:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.041+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7d54026040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.041+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed834c0 2024-04-23T18:31:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.041+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.041+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed87ee0 2024-04-23T18:31:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.041+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.041+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed7ee80 2024-04-23T18:31:17.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.041+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54026040 con 0x55b58ed7ee80 2024-04-23T18:31:17.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.041+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x7f7d4c0bc060 2024-04-23T18:31:17.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.042+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54026040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.042+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed7ee80 2024-04-23T18:31:17.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.042+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54026040 con 0x55b58ed7ee80 2024-04-23T18:31:17.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.042+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed834c0 2024-04-23T18:31:17.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.042+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.042+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed87ee0 2024-04-23T18:31:17.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.042+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.042+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed87ee0 2024-04-23T18:31:17.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.042+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.042+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x7f7d4c0bc060 2024-04-23T18:31:17.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.043+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54026040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.043+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed87ee0 2024-04-23T18:31:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.043+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.043+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed87ee0 2024-04-23T18:31:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.043+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.043+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed7ee80 2024-04-23T18:31:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.043+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54026040 con 0x55b58ed7ee80 2024-04-23T18:31:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.043+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed7ee80 2024-04-23T18:31:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.044+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d54026040 con 0x55b58ed7ee80 2024-04-23T18:31:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.044+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x7f7d4c0bc060 2024-04-23T18:31:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.044+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54026040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.044+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed87ee0 2024-04-23T18:31:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.044+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.044+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed834c0 2024-04-23T18:31:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.045+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.045+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed7ee80 2024-04-23T18:31:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.045+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54026040 con 0x55b58ed7ee80 2024-04-23T18:31:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.045+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed834c0 2024-04-23T18:31:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.045+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.045+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed87ee0 2024-04-23T18:31:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.045+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.045+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x7f7d4c0bc060 2024-04-23T18:31:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.046+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54026040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.046+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed834c0 2024-04-23T18:31:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.046+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.046+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed87ee0 2024-04-23T18:31:17.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.046+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.046+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x7f7d4c0bc060 2024-04-23T18:31:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.046+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d54026040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.047+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed7ee80 2024-04-23T18:31:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.047+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d54026040 con 0x55b58ed7ee80 2024-04-23T18:31:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.047+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed82760 con 0x55b58ed834c0 2024-04-23T18:31:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.047+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.047+0000 7f7d5db2f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.047+0000 7f7d5db2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.047+0000 7f7d5db2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.047+0000 7f7d5db2f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.047+0000 7f7d5db2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.047+0000 7f7d5db2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:17.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.047+0000 7f7d5db2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.047+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed867a0 con 0x55b58ed7ee80 2024-04-23T18:31:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d54026040 con 0x55b58ed7ee80 2024-04-23T18:31:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed86b40 con 0x55b58ed7ee80 2024-04-23T18:31:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d54026040 con 0x55b58ed7ee80 2024-04-23T18:31:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed86b40 con 0x7f7d4c0bc060 2024-04-23T18:31:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d54036040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 20 zone default found 2024-04-23T18:31:17.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 4 Realm: () 2024-04-23T18:31:17.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:17.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:17.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:17.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 20 zonegroup default 2024-04-23T18:31:17.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed86f60 con 0x55b58ed834c0 2024-04-23T18:31:17.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.048+0000 7f7d5db2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.049+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8c8d0 con 0x55b58ed87ee0 2024-04-23T18:31:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.049+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.049+0000 7f7d5db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.049+0000 7f7d5db2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.049+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8cc70 con 0x55b58ed87ee0 2024-04-23T18:31:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.049+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.049+0000 7f7d5db2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.049+0000 7f7d5db2f800 20 started sync module instance, tier type = 2024-04-23T18:31:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.049+0000 7f7d5db2f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.049+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8bd70 con 0x55b58ed834c0 2024-04-23T18:31:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.050+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.050+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94238274011536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8b9d0 con 0x55b58ed834c0 2024-04-23T18:31:17.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.050+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8dae0 con 0x55b58ed7ee80 2024-04-23T18:31:17.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.051+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94238274011536] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.052+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x55b58ed7ee80 2024-04-23T18:31:17.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.052+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94238274016816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8df00 con 0x55b58ed7ee80 2024-04-23T18:31:17.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.052+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8e8c0 con 0x55b58ed87ee0 2024-04-23T18:31:17.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.053+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94238274016816] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x55b58ed7ee80 2024-04-23T18:31:17.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.053+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.053+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94238274017872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8de70 con 0x55b58ed87ee0 2024-04-23T18:31:17.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.053+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8f730 con 0x55b58ed834c0 2024-04-23T18:31:17.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.054+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.054+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94238274026272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed903f0 con 0x55b58ed834c0 2024-04-23T18:31:17.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.054+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed90e60 con 0x55b58ed7ee80 2024-04-23T18:31:17.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.054+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94238274017872] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.055+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94238274026272] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.055+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x55b58ed7ee80 2024-04-23T18:31:17.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.055+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94238274029872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8ff40 con 0x55b58ed7ee80 2024-04-23T18:31:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.055+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed91700 con 0x7f7d4c0bc060 2024-04-23T18:31:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.056+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.056+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94238274032032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed91a70 con 0x7f7d4c0bc060 2024-04-23T18:31:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.056+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed922c0 con 0x7f7d4c0bc060 2024-04-23T18:31:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.056+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94238274029872] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x55b58ed7ee80 2024-04-23T18:31:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.057+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94238274032032] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.057+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.057+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94238274033088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed91e90 con 0x7f7d4c0bc060 2024-04-23T18:31:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.057+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed926e0 con 0x7f7d4c0bc060 2024-04-23T18:31:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.059+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(58 notify.7 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.059+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94238274035824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed92aa0 con 0x7f7d4c0bc060 2024-04-23T18:31:17.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.059+0000 7f7d5db2f800 20 add_watcher() i=0 2024-04-23T18:31:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.059+0000 7f7d5db2f800 20 add_watcher() i=1 2024-04-23T18:31:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.059+0000 7f7d5db2f800 20 add_watcher() i=2 2024-04-23T18:31:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.059+0000 7f7d5db2f800 20 add_watcher() i=3 2024-04-23T18:31:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.059+0000 7f7d5db2f800 20 add_watcher() i=4 2024-04-23T18:31:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.059+0000 7f7d5db2f800 20 add_watcher() i=5 2024-04-23T18:31:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.059+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94238274033088] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.059+0000 7f7d5db2f800 20 add_watcher() i=6 2024-04-23T18:31:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.060+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94238274035824] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.060+0000 7f7d5db2f800 20 add_watcher() i=7 2024-04-23T18:31:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.060+0000 7f7d5db2f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.060+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed919e0 con 0x55b58ed7ee80 2024-04-23T18:31:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.060+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d54036040 con 0x55b58ed7ee80 2024-04-23T18:31:17.067 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.060+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94238274037040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed919e0 con 0x55b58ed7ee80 2024-04-23T18:31:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.061+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94238274037040] v34'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x55b58ed7ee80 2024-04-23T18:31:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.061+0000 7f7c0ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.061+0000 7f7d5db2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.061+0000 7f7d5db2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.061+0000 7f7d5db2f800 5 note: GC not initialized 2024-04-23T18:31:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.061+0000 7f7c0efe5640 20 reqs_thread_entry: start 2024-04-23T18:31:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.062+0000 7f7d5db2f800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.062+0000 7f7d5db2f800 20 Filter name: none 2024-04-23T18:31:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.062+0000 7f7c0cfe1640 20 reqs_thread_entry: start 2024-04-23T18:31:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.062+0000 7f7d5db2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.062+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58edc8e00 con 0x55b58ed7ee80 2024-04-23T18:31:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.062+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7d54036040 con 0x55b58ed7ee80 2024-04-23T18:31:17.068 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.062+0000 7f7d5db2f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:31:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.062+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b58edca350 con 0x7f7d4c0bc060 2024-04-23T18:31:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.063+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv33 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f7d54036040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.064+0000 7f7c0ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.064+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94238274037040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed7b3d0 con 0x55b58ed7ee80 2024-04-23T18:31:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.065+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94238274037040] v34'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x55b58ed7ee80 2024-04-23T18:31:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.065+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94238274011536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed924f0 con 0x55b58ed834c0 2024-04-23T18:31:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.066+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94238274011536] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.066+0000 7f7d5db2f800 20 remove_watcher() i=0 2024-04-23T18:31:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.066+0000 7f7d5db2f800 2 removed watcher, disabling cache 2024-04-23T18:31:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.066+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94238274016816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8c190 con 0x55b58ed7ee80 2024-04-23T18:31:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.067+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94238274016816] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x55b58ed7ee80 2024-04-23T18:31:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.067+0000 7f7d5db2f800 20 remove_watcher() i=1 2024-04-23T18:31:17.069 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.067+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94238274017872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8d630 con 0x55b58ed87ee0 2024-04-23T18:31:17.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.068+0000 7f7d58fad640 1 -- 172.21.15.119:0/484986753 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94238274017872] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d44009050 con 0x55b58ed87ee0 2024-04-23T18:31:17.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.068+0000 7f7d5db2f800 20 remove_watcher() i=2 2024-04-23T18:31:17.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.068+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94238274026272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8c190 con 0x55b58ed834c0 2024-04-23T18:31:17.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.069+0000 7f7d597ae640 1 -- 172.21.15.119:0/484986753 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94238274026272] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d4c0b9030 con 0x55b58ed834c0 2024-04-23T18:31:17.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.069+0000 7f7d5db2f800 20 remove_watcher() i=3 2024-04-23T18:31:17.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.069+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94238274029872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed8c190 con 0x55b58ed7ee80 2024-04-23T18:31:17.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.070+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94238274029872] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x55b58ed7ee80 2024-04-23T18:31:17.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.070+0000 7f7d5db2f800 20 remove_watcher() i=4 2024-04-23T18:31:17.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.070+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94238274032032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed90930 con 0x7f7d4c0bc060 2024-04-23T18:31:17.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.071+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94238274032032] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.071+0000 7f7d5db2f800 20 remove_watcher() i=5 2024-04-23T18:31:17.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.071+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94238274033088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed90930 con 0x7f7d4c0bc060 2024-04-23T18:31:17.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.072+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94238274033088] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.072+0000 7f7d5db2f800 20 remove_watcher() i=6 2024-04-23T18:31:17.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.072+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94238274035824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b58ed90930 con 0x7f7d4c0bc060 2024-04-23T18:31:17.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.073+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94238274035824] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d54036040 con 0x7f7d4c0bc060 2024-04-23T18:31:17.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.073+0000 7f7d5db2f800 20 remove_watcher() i=7 2024-04-23T18:31:17.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.073+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f7d4c0bc060 msgr2=0x7f7d4c06b150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.073+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f7d4c0bc060 0x7f7d4c06b150 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.073+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b58ed7ee80 msgr2=0x55b58ed81340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.073+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b58ed7ee80 0x55b58ed81340 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.073+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b58ed834c0 msgr2=0x55b58ed858b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.073+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b58ed834c0 0x55b58ed858b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.073+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b58ed87ee0 msgr2=0x55b58ed8a3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.073+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b58ed87ee0 0x55b58ed8a3a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c24036fb0 msgr2=0x7f7c24039470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c24036fb0 0x7f7c24039470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7d44001b60 tx=0x7f7d44010000 comp rx=0 tx=0).stop 2024-04-23T18:31:17.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d59faf640 1 -- 172.21.15.119:0/484986753 reap_dead start 2024-04-23T18:31:17.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 msgr2=0x55b58ed73870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 0x55b58ed73870 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c08aa60 tx=0x7f7d4c054e80 comp rx=0 tx=0).stop 2024-04-23T18:31:17.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 shutdown_connections 2024-04-23T18:31:17.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/484986753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed6c430 0x55b58ed73870 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 >> 172.21.15.119:0/484986753 conn(0x55b58ed68790 msgr2=0x55b58ed65df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 shutdown_connections 2024-04-23T18:31:17.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/484986753 wait complete. 2024-04-23T18:31:17.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/275938846 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c30036e60 msgr2=0x7f7c30039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/275938846 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c30036e60 0x7f7c30039320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400bf50 tx=0x7f7d4400f000 comp rx=0 tx=0).stop 2024-04-23T18:31:17.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/275938846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed5f4e0 msgr2=0x55b58ed5f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/275938846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed5f4e0 0x55b58ed5f900 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c08e270 tx=0x7f7d4c051610 comp rx=0 tx=0).stop 2024-04-23T18:31:17.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/275938846 shutdown_connections 2024-04-23T18:31:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/275938846 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c30036e60 0x7f7c30039320 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/275938846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ed5f4e0 0x55b58ed5f900 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/275938846 >> 172.21.15.119:0/275938846 conn(0x55b58ed53580 msgr2=0x55b58ed53980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/275938846 shutdown_connections 2024-04-23T18:31:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/275938846 wait complete. 2024-04-23T18:31:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b58ed4e460 msgr2=0x55b58ed508d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b58ed4e460 0x55b58ed508d0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b58ec451d0 msgr2=0x55b58ed47b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b58ec451d0 0x55b58ed47b80 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b58ed4a520 msgr2=0x55b58ed4c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b58ed4a520 0x55b58ed4c910 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c40036e60 msgr2=0x7f7c40039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7c40036e60 0x7f7c40039320 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7d44000f60 tx=0x7f7d440012b0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 msgr2=0x55b58ed40c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 --2- 172.21.15.119:0/205493666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b58ec44870 0x55b58ed40c40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0526d0 tx=0x7f7d4c003330 comp rx=0 tx=0).stop 2024-04-23T18:31:17.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d59faf640 1 -- 172.21.15.119:0/205493666 reap_dead start 2024-04-23T18:31:17.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 shutdown_connections 2024-04-23T18:31:17.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.074+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 >> 172.21.15.119:0/205493666 conn(0x55b58ec40410 msgr2=0x55b58ed33600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.075+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 shutdown_connections 2024-04-23T18:31:17.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.075+0000 7f7d5db2f800 1 -- 172.21.15.119:0/205493666 wait complete. 2024-04-23T18:31:17.078 INFO:teuthology.orchestra.run.smithi119.stdout:{"entries":[],"summary":[]} 2024-04-23T18:31:17.078 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-23T18:31:17.078 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-23T18:31:17.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-23T18:31:17.079 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-04-23T18:31:17.161 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:17.162 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:17.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.169+0000 7fc36f135800 1 Processor -- start 2024-04-23T18:31:17.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.169+0000 7fc36f135800 1 -- start start 2024-04-23T18:31:17.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.169+0000 7fc36f135800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564b81dac8c0 0x564b81dacce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.169+0000 7fc36f135800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b81c5e560 con 0x564b81dad220 2024-04-23T18:31:17.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.169+0000 7fc36f135800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x564b81c4fe20 con 0x564b81dac8c0 2024-04-23T18:31:17.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.169+0000 7fc36adb5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564b81dac8c0 0x564b81dacce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.169+0000 7fc36adb5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564b81dac8c0 0x564b81dacce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54474/0 (socket says 172.21.15.119:54474) 2024-04-23T18:31:17.163 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.169+0000 7fc36adb5640 1 -- 172.21.15.119:0/1888548103 learned_addr learned my addr 172.21.15.119:0/1888548103 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.170+0000 7fc36adb5640 1 -- 172.21.15.119:0/1888548103 >> v1:172.21.15.62:6789/0 conn(0x564b81dad220 legacy=0x564b81dad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.170+0000 7fc36adb5640 1 -- 172.21.15.119:0/1888548103 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b81c5de60 con 0x564b81dac8c0 2024-04-23T18:31:17.164 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.170+0000 7fc369db3640 1 -- 172.21.15.119:0/1888548103 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4139116323 0 0) 0x564b81c5e560 con 0x564b81dad220 2024-04-23T18:31:17.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.172+0000 7fc36adb5640 1 --2- 172.21.15.119:0/1888548103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81dacce0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00a520 tx=0x7fc35c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6d7eff09a59fbc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.172+0000 7fc369db3640 1 -- 172.21.15.119:0/1888548103 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c057070 con 0x564b81dac8c0 2024-04-23T18:31:17.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.172+0000 7fc369db3640 1 -- 172.21.15.119:0/1888548103 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35c052570 con 0x564b81dac8c0 2024-04-23T18:31:17.165 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.172+0000 7fc369db3640 1 -- 172.21.15.119:0/1888548103 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c052870 con 0x564b81dac8c0 2024-04-23T18:31:17.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.172+0000 7fc36f135800 1 -- 172.21.15.119:0/1888548103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 msgr2=0x564b81dacce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.172+0000 7fc36f135800 1 --2- 172.21.15.119:0/1888548103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81dacce0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00a520 tx=0x7fc35c01d010 comp rx=0 tx=0).stop 2024-04-23T18:31:17.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.172+0000 7fc36f135800 1 -- 172.21.15.119:0/1888548103 shutdown_connections 2024-04-23T18:31:17.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.172+0000 7fc36f135800 1 --2- 172.21.15.119:0/1888548103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81dacce0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.172+0000 7fc36f135800 1 -- 172.21.15.119:0/1888548103 >> 172.21.15.119:0/1888548103 conn(0x564b81da8440 msgr2=0x564b81daa860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.172+0000 7fc36f135800 1 -- 172.21.15.119:0/1888548103 shutdown_connections 2024-04-23T18:31:17.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.172+0000 7fc36f135800 1 -- 172.21.15.119:0/1888548103 wait complete. 2024-04-23T18:31:17.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.184+0000 7fc36f135800 1 Processor -- start 2024-04-23T18:31:17.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.184+0000 7fc36f135800 1 -- start start 2024-04-23T18:31:17.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.184+0000 7fc36f135800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81ea1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.184+0000 7fc36f135800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b81cf95d0 con 0x564b81dac8c0 2024-04-23T18:31:17.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.185+0000 7fc36adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81ea1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.185+0000 7fc36adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81ea1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54488/0 (socket says 172.21.15.119:54488) 2024-04-23T18:31:17.178 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.185+0000 7fc36adb5640 1 -- 172.21.15.119:0/2917784719 learned_addr learned my addr 172.21.15.119:0/2917784719 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.185+0000 7fc36adb5640 1 -- 172.21.15.119:0/2917784719 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b81c6f860 con 0x564b81dac8c0 2024-04-23T18:31:17.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.185+0000 7fc36adb5640 1 --2- 172.21.15.119:0/2917784719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81ea1330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc35c055040 tx=0x7fc35c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3abcf24bab1642 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.185+0000 7fc258e09640 1 -- 172.21.15.119:0/2917784719 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c057040 con 0x564b81dac8c0 2024-04-23T18:31:17.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.185+0000 7fc258e09640 1 -- 172.21.15.119:0/2917784719 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35c052870 con 0x564b81dac8c0 2024-04-23T18:31:17.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.185+0000 7fc258e09640 1 -- 172.21.15.119:0/2917784719 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c052b90 con 0x564b81dac8c0 2024-04-23T18:31:17.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.186+0000 7fc36f135800 1 -- 172.21.15.119:0/2917784719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 msgr2=0x564b81ea1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.186+0000 7fc36f135800 1 --2- 172.21.15.119:0/2917784719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81ea1330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc35c055040 tx=0x7fc35c04c000 comp rx=0 tx=0).stop 2024-04-23T18:31:17.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.186+0000 7fc36f135800 1 -- 172.21.15.119:0/2917784719 shutdown_connections 2024-04-23T18:31:17.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.186+0000 7fc36f135800 1 --2- 172.21.15.119:0/2917784719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81ea1330 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.181 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.186+0000 7fc36f135800 1 -- 172.21.15.119:0/2917784719 >> 172.21.15.119:0/2917784719 conn(0x564b81da8440 msgr2=0x564b81e9cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.186+0000 7fc36f135800 1 -- 172.21.15.119:0/2917784719 shutdown_connections 2024-04-23T18:31:17.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.186+0000 7fc36f135800 1 -- 172.21.15.119:0/2917784719 wait complete. 2024-04-23T18:31:17.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.186+0000 7fc36f135800 1 Processor -- start 2024-04-23T18:31:17.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.186+0000 7fc36f135800 1 -- start start 2024-04-23T18:31:17.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.187+0000 7fc36f135800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81ea8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.187+0000 7fc36f135800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b81dae0e0 con 0x564b81dac8c0 2024-04-23T18:31:17.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.187+0000 7fc36adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81ea8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.187+0000 7fc36adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81ea8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54502/0 (socket says 172.21.15.119:54502) 2024-04-23T18:31:17.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.187+0000 7fc36adb5640 1 -- 172.21.15.119:0/348123332 learned_addr learned my addr 172.21.15.119:0/348123332 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.187+0000 7fc36adb5640 1 -- 172.21.15.119:0/348123332 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b81c6deb0 con 0x564b81dac8c0 2024-04-23T18:31:17.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.187+0000 7fc36adb5640 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81ea8af0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0524f0 tx=0x7fc35c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.182 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.187+0000 7fc257606640 1 -- 172.21.15.119:0/348123332 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c073070 con 0x564b81dac8c0 2024-04-23T18:31:17.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.187+0000 7fc257606640 1 -- 172.21.15.119:0/348123332 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35c05d570 con 0x564b81dac8c0 2024-04-23T18:31:17.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.187+0000 7fc257606640 1 -- 172.21.15.119:0/348123332 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c057070 con 0x564b81dac8c0 2024-04-23T18:31:17.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.187+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b81ea9030 con 0x564b81dac8c0 2024-04-23T18:31:17.183 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.188+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b81ea9550 con 0x564b81dac8c0 2024-04-23T18:31:17.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.188+0000 7fc257606640 1 -- 172.21.15.119:0/348123332 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc35c076070 con 0x564b81dac8c0 2024-04-23T18:31:17.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.188+0000 7fc257606640 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc250036e60 0x7fc250039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.188+0000 7fc257606640 1 -- 172.21.15.119:0/348123332 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fc35c08e540 con 0x564b81dac8c0 2024-04-23T18:31:17.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.189+0000 7fc36a5b4640 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc250036e60 0x7fc250039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.189+0000 7fc36f135800 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b81dad220 0x564b81eafb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.189+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81eb00a0 con 0x564b81dad220 2024-04-23T18:31:17.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.189+0000 7fc36b5b6640 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b81dad220 0x564b81eafb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.189+0000 7fc36a5b4640 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc250036e60 0x7fc250039320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc360000f60 tx=0x7fc3600013f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.189+0000 7fc36b5b6640 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b81dad220 0x564b81eafb60 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.189+0000 7fc36b5b6640 1 -- 172.21.15.119:0/348123332 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81dad220 2024-04-23T18:31:17.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.189+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81ead110 con 0x564b81dad220 2024-04-23T18:31:17.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.190+0000 7fc36b5b6640 1 -- 172.21.15.119:0/348123332 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81dad220 2024-04-23T18:31:17.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.190+0000 7fc36f135800 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b81eb23a0 0x564b81eb4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.190+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81eb4e60 con 0x564b81eb23a0 2024-04-23T18:31:17.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.190+0000 7fc36adb5640 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b81eb23a0 0x564b81eb4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.190+0000 7fc36adb5640 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b81eb23a0 0x564b81eb4790 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.190+0000 7fc36adb5640 1 -- 172.21.15.119:0/348123332 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc35c075030 con 0x564b81eb23a0 2024-04-23T18:31:17.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.190+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81eb1350 con 0x564b81dad220 2024-04-23T18:31:17.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.191+0000 7fc36b5b6640 1 -- 172.21.15.119:0/348123332 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81dad220 2024-04-23T18:31:17.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.191+0000 7fc36f135800 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564b81eb62a0 0x564b81eb8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.191+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81eb8ef0 con 0x564b81eb62a0 2024-04-23T18:31:17.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.191+0000 7fc36a5b4640 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564b81eb62a0 0x564b81eb8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.191+0000 7fc36a5b4640 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564b81eb62a0 0x564b81eb8760 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.192+0000 7fc36a5b4640 1 -- 172.21.15.119:0/348123332 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc360010590 con 0x564b81eb62a0 2024-04-23T18:31:17.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.192+0000 7fc36f135800 1 Processor -- start 2024-04-23T18:31:17.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.192+0000 7fc36f135800 1 -- start start 2024-04-23T18:31:17.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.192+0000 7fc36f135800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ec73a0 0x564b81ec77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.192+0000 7fc36f135800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b81c9fdf0 con 0x564b81ec73a0 2024-04-23T18:31:17.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.193+0000 7fc36adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ec73a0 0x564b81ec77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.193+0000 7fc36adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ec73a0 0x564b81ec77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54514/0 (socket says 172.21.15.119:54514) 2024-04-23T18:31:17.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.193+0000 7fc36adb5640 1 -- 172.21.15.119:0/3519769988 learned_addr learned my addr 172.21.15.119:0/3519769988 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.193+0000 7fc36adb5640 1 -- 172.21.15.119:0/3519769988 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b81ec7d00 con 0x564b81ec73a0 2024-04-23T18:31:17.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.193+0000 7fc36adb5640 1 --2- 172.21.15.119:0/3519769988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ec73a0 0x564b81ec77c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc35c006ae0 tx=0x7fc35c077720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.193+0000 7fc254e01640 1 -- 172.21.15.119:0/3519769988 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c077c80 con 0x564b81ec73a0 2024-04-23T18:31:17.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.193+0000 7fc254e01640 1 -- 172.21.15.119:0/3519769988 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35c077e20 con 0x564b81ec73a0 2024-04-23T18:31:17.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.193+0000 7fc254e01640 1 -- 172.21.15.119:0/3519769988 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c08b240 con 0x564b81ec73a0 2024-04-23T18:31:17.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.193+0000 7fc36f135800 1 -- 172.21.15.119:0/3519769988 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b81ec8770 con 0x564b81ec73a0 2024-04-23T18:31:17.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.193+0000 7fc36f135800 1 -- 172.21.15.119:0/3519769988 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b81ec8c70 con 0x564b81ec73a0 2024-04-23T18:31:17.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.194+0000 7fc254e01640 1 -- 172.21.15.119:0/3519769988 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc35c095060 con 0x564b81ec73a0 2024-04-23T18:31:17.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.194+0000 7fc254e01640 1 --2- 172.21.15.119:0/3519769988 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc244036e60 0x7fc244039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.194+0000 7fc254e01640 1 -- 172.21.15.119:0/3519769988 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fc35c08a030 con 0x564b81ec73a0 2024-04-23T18:31:17.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.194+0000 7fc36a5b4640 1 --2- 172.21.15.119:0/3519769988 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc244036e60 0x7fc244039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.194+0000 7fc36f135800 1 Processor -- start 2024-04-23T18:31:17.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.194+0000 7fc36f135800 1 -- start start 2024-04-23T18:31:17.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.194+0000 7fc36a5b4640 1 --2- 172.21.15.119:0/3519769988 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc244036e60 0x7fc244039320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x564b81eb0540 tx=0x7fc360006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.195+0000 7fc36f135800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ed4470 0x564b81ed4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.195+0000 7fc36f135800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b81ea19f0 con 0x564b81ed4470 2024-04-23T18:31:17.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.195+0000 7fc36adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ed4470 0x564b81ed4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.195+0000 7fc36adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ed4470 0x564b81ed4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54518/0 (socket says 172.21.15.119:54518) 2024-04-23T18:31:17.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.195+0000 7fc36adb5640 1 -- 172.21.15.119:0/1172334904 learned_addr learned my addr 172.21.15.119:0/1172334904 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.195+0000 7fc36adb5640 1 -- 172.21.15.119:0/1172334904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b81ed4e60 con 0x564b81ed4470 2024-04-23T18:31:17.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.195+0000 7fc36adb5640 1 --2- 172.21.15.119:0/1172334904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ed4470 0x564b81ed4890 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc35c04cf10 tx=0x7fc35c06e400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8931513e64d6cfd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.195+0000 7fc24e7fc640 1 -- 172.21.15.119:0/1172334904 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c0a8070 con 0x564b81ed4470 2024-04-23T18:31:17.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.195+0000 7fc24e7fc640 1 -- 172.21.15.119:0/1172334904 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35c09c070 con 0x564b81ed4470 2024-04-23T18:31:17.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.195+0000 7fc24e7fc640 1 -- 172.21.15.119:0/1172334904 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c05e8e0 con 0x564b81ed4470 2024-04-23T18:31:17.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36f135800 1 -- 172.21.15.119:0/1172334904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ed4470 msgr2=0x564b81ed4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36f135800 1 --2- 172.21.15.119:0/1172334904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ed4470 0x564b81ed4890 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc35c04cf10 tx=0x7fc35c06e400 comp rx=0 tx=0).stop 2024-04-23T18:31:17.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36f135800 1 -- 172.21.15.119:0/1172334904 shutdown_connections 2024-04-23T18:31:17.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36f135800 1 --2- 172.21.15.119:0/1172334904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ed4470 0x564b81ed4890 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36f135800 1 -- 172.21.15.119:0/1172334904 >> 172.21.15.119:0/1172334904 conn(0x564b81ed07d0 msgr2=0x564b81ece830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36f135800 1 -- 172.21.15.119:0/1172334904 shutdown_connections 2024-04-23T18:31:17.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36f135800 1 -- 172.21.15.119:0/1172334904 wait complete. 2024-04-23T18:31:17.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36f135800 1 Processor -- start 2024-04-23T18:31:17.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36f135800 1 -- start start 2024-04-23T18:31:17.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36f135800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ed4470 0x564b81edb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36f135800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564b81ed5510 con 0x564b81ed4470 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ed4470 0x564b81edb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36adb5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ed4470 0x564b81edb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54530/0 (socket says 172.21.15.119:54530) 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.196+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 learned_addr learned my addr 172.21.15.119:0/218609609 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.197+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b81edbdd0 con 0x564b81ed4470 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.197+0000 7fc36adb5640 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ed4470 0x564b81edb890 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc35c006900 tx=0x7fc35c04cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.197+0000 7fc24cff9640 1 -- 172.21.15.119:0/218609609 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c0b4020 con 0x564b81ed4470 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.197+0000 7fc24cff9640 1 -- 172.21.15.119:0/218609609 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35c0a9040 con 0x564b81ed4470 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.197+0000 7fc24cff9640 1 -- 172.21.15.119:0/218609609 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc35c0a8070 con 0x564b81ed4470 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.197+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b81edbdd0 con 0x564b81ed4470 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.197+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b81edbdd0 con 0x564b81ed4470 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.198+0000 7fc24cff9640 1 -- 172.21.15.119:0/218609609 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc35c0b7020 con 0x564b81ed4470 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.198+0000 7fc24cff9640 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc234036e60 0x7fc234039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.198+0000 7fc24cff9640 1 -- 172.21.15.119:0/218609609 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fc35c0bad50 con 0x564b81ed4470 2024-04-23T18:31:17.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.198+0000 7fc36a5b4640 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc234036e60 0x7fc234039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.198+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.198+0000 7fc36f135800 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b81ee6fd0 0x564b81ee9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81ee9be0 con 0x564b81ee6fd0 2024-04-23T18:31:17.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36a5b4640 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc234036e60 0x7fc234039320 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x564b81eb92f0 tx=0x7fc360022040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36b5b6640 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b81ee6fd0 0x564b81ee9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36b5b6640 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b81ee6fd0 0x564b81ee9490 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81ee6fd0 2024-04-23T18:31:17.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36f135800 20 realm 2024-04-23T18:31:17.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81ee9ff0 con 0x564b81ee6fd0 2024-04-23T18:31:17.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81ee6fd0 2024-04-23T18:31:17.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36f135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:17.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.199+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81eea8c0 con 0x564b81ee6fd0 2024-04-23T18:31:17.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.200+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81ee6fd0 2024-04-23T18:31:17.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.200+0000 7fc36f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.200+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.200+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ee6fd0 2024-04-23T18:31:17.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.200+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81ee6fd0 2024-04-23T18:31:17.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.200+0000 7fc36f135800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:17.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.200+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.200+0000 7fc36f135800 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b81eeb9c0 0x564b81eeddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.200+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81eee370 con 0x564b81eeb9c0 2024-04-23T18:31:17.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.200+0000 7fc36adb5640 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b81eeb9c0 0x564b81eeddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.200+0000 7fc36adb5640 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b81eeb9c0 0x564b81eeddb0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.201+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc35c0c4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.201+0000 7fc36f135800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.201+0000 7fc36f135800 20 searching for the correct realm 2024-04-23T18:31:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.201+0000 7fc36f135800 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564b81ef0320 0x564b81ef27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.201+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef2eb0 con 0x564b81ef0320 2024-04-23T18:31:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.201+0000 7fc36a5b4640 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564b81ef0320 0x564b81ef27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.201+0000 7fc36a5b4640 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564b81ef0320 0x564b81ef27e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.201+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.201+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef2eb0 con 0x564b81eeb9c0 2024-04-23T18:31:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.202+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc35c0c4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.202+0000 7fc36adb5640 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc35c0b9020 0x7fc35c0a3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.202+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef2eb0 con 0x7fc35c0b9020 2024-04-23T18:31:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.202+0000 7fc36b5b6640 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc35c0b9020 0x7fc35c0a3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.202+0000 7fc36b5b6640 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc35c0b9020 0x7fc35c0a3480 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.203+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36400a4a0 con 0x7fc35c0b9020 2024-04-23T18:31:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.203+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ee6fd0 2024-04-23T18:31:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.203+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81ee6fd0 2024-04-23T18:31:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.203+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ee6fd0 2024-04-23T18:31:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.203+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81ee6fd0 2024-04-23T18:31:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.203+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x7fc35c0b9020 2024-04-23T18:31:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.203+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36400a4a0 con 0x7fc35c0b9020 2024-04-23T18:31:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.203+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x7fc35c0b9020 2024-04-23T18:31:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.204+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc36400a4a0 con 0x7fc35c0b9020 2024-04-23T18:31:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.204+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81eeb9c0 2024-04-23T18:31:17.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.204+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc35c0c4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.204+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ef0320 2024-04-23T18:31:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.204+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.204+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ee6fd0 2024-04-23T18:31:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.204+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81ee6fd0 2024-04-23T18:31:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.204+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x7fc35c0b9020 2024-04-23T18:31:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.205+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36400a4a0 con 0x7fc35c0b9020 2024-04-23T18:31:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.205+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ee6fd0 2024-04-23T18:31:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.205+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81ee6fd0 2024-04-23T18:31:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.205+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81eeb9c0 2024-04-23T18:31:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.205+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc35c0c4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.205+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ef0320 2024-04-23T18:31:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.205+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.205+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ef0320 2024-04-23T18:31:17.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.206+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.206+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x7fc35c0b9020 2024-04-23T18:31:17.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.206+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36400a4a0 con 0x7fc35c0b9020 2024-04-23T18:31:17.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.206+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ef0320 2024-04-23T18:31:17.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.206+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.206+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ef0320 2024-04-23T18:31:17.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.206+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.206+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ee6fd0 2024-04-23T18:31:17.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.207+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81ee6fd0 2024-04-23T18:31:17.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.207+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ee6fd0 2024-04-23T18:31:17.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.207+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81ee6fd0 2024-04-23T18:31:17.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.207+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x7fc35c0b9020 2024-04-23T18:31:17.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.207+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36400a4a0 con 0x7fc35c0b9020 2024-04-23T18:31:17.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.207+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ef0320 2024-04-23T18:31:17.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.207+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.207+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81eeb9c0 2024-04-23T18:31:17.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.208+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc35c0c4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.208+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ee6fd0 2024-04-23T18:31:17.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.208+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36400a4a0 con 0x564b81ee6fd0 2024-04-23T18:31:17.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.208+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81eeb9c0 2024-04-23T18:31:17.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.208+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc35c0c4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.208+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ef0320 2024-04-23T18:31:17.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.208+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.208+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x7fc35c0b9020 2024-04-23T18:31:17.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.209+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36400a4a0 con 0x7fc35c0b9020 2024-04-23T18:31:17.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.209+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81eeb9c0 2024-04-23T18:31:17.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.209+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.209+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ef0320 2024-04-23T18:31:17.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.209+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.209+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x7fc35c0b9020 2024-04-23T18:31:17.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.209+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc36400a4a0 con 0x7fc35c0b9020 2024-04-23T18:31:17.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.209+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81ee6fd0 2024-04-23T18:31:17.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeac60 con 0x564b81eeb9c0 2024-04-23T18:31:17.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:17.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81eeec30 con 0x564b81ee6fd0 2024-04-23T18:31:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81eef020 con 0x564b81ee6fd0 2024-04-23T18:31:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:17.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.210+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81eef020 con 0x7fc35c0b9020 2024-04-23T18:31:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36f135800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36f135800 20 zone default found 2024-04-23T18:31:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36f135800 4 Realm: () 2024-04-23T18:31:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36f135800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36f135800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36f135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36f135800 20 zonegroup default 2024-04-23T18:31:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef3330 con 0x564b81eeb9c0 2024-04-23T18:31:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef50b0 con 0x564b81ef0320 2024-04-23T18:31:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.211+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.212+0000 7fc36f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.212+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.212+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef5450 con 0x564b81ef0320 2024-04-23T18:31:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.212+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.212+0000 7fc36f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.212+0000 7fc36f135800 20 started sync module instance, tier type = 2024-04-23T18:31:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.212+0000 7fc36f135800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.212+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef4550 con 0x564b81eeb9c0 2024-04-23T18:31:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.213+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.213+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94882302478656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef41b0 con 0x564b81eeb9c0 2024-04-23T18:31:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.213+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef61d0 con 0x564b81ee6fd0 2024-04-23T18:31:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.214+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94882302478656] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.214+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.214+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94882302482416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef65c0 con 0x564b81ee6fd0 2024-04-23T18:31:17.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.214+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef7000 con 0x564b81ef0320 2024-04-23T18:31:17.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.215+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94882302482416] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.215+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.215+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94882302487248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef73f0 con 0x564b81ef0320 2024-04-23T18:31:17.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.215+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef7e30 con 0x564b81eeb9c0 2024-04-23T18:31:17.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.216+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94882302487248] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.216+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.216+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94882302490880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef8220 con 0x564b81eeb9c0 2024-04-23T18:31:17.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.217+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef8c60 con 0x564b81ee6fd0 2024-04-23T18:31:17.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.217+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94882302490880] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.218+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.218+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94882302494512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef8c20 con 0x564b81ee6fd0 2024-04-23T18:31:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.218+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef9670 con 0x7fc35c0b9020 2024-04-23T18:31:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.219+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.219+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94882302497216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef95e0 con 0x7fc35c0b9020 2024-04-23T18:31:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.219+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81efa590 con 0x7fc35c0b9020 2024-04-23T18:31:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.219+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94882302494512] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.220+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94882302497216] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.220+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.220+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94882302500992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef9a10 con 0x7fc35c0b9020 2024-04-23T18:31:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.220+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81efab70 con 0x7fc35c0b9020 2024-04-23T18:31:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.221+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(58 notify.7 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.221+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94882302502592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81efaf90 con 0x7fc35c0b9020 2024-04-23T18:31:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.221+0000 7fc36f135800 20 add_watcher() i=0 2024-04-23T18:31:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.221+0000 7fc36f135800 20 add_watcher() i=1 2024-04-23T18:31:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.221+0000 7fc36f135800 20 add_watcher() i=2 2024-04-23T18:31:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.221+0000 7fc36f135800 20 add_watcher() i=3 2024-04-23T18:31:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.221+0000 7fc36f135800 20 add_watcher() i=4 2024-04-23T18:31:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.221+0000 7fc36f135800 20 add_watcher() i=5 2024-04-23T18:31:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.221+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94882302500992] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.221+0000 7fc36f135800 20 add_watcher() i=6 2024-04-23T18:31:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.222+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94882302502592] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.222+0000 7fc36f135800 20 add_watcher() i=7 2024-04-23T18:31:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.222+0000 7fc36f135800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.222+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef5c10 con 0x564b81ee6fd0 2024-04-23T18:31:17.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.222+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.222+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94882302503648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81ef5c10 con 0x564b81ee6fd0 2024-04-23T18:31:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.223+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94882302503648] v34'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.223+0000 7fc2217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.224+0000 7fc36f135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.224+0000 7fc36f135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.224+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f06ac0 con 0x564b81ee6fd0 2024-04-23T18:31:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.225+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.225+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f07190 con 0x7fc35c0b9020 2024-04-23T18:31:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.226+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.226+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f075d0 con 0x564b81ef0320 2024-04-23T18:31:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.227+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.227+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f07ff0 con 0x564b81ee6fd0 2024-04-23T18:31:17.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.228+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'234 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.228+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f027b0 con 0x564b81eeb9c0 2024-04-23T18:31:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.229+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.229+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f02750 con 0x564b81ef0320 2024-04-23T18:31:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.230+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.230+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f02750 con 0x564b81ee6fd0 2024-04-23T18:31:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.231+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.231+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f08d40 con 0x7fc35c0b9020 2024-04-23T18:31:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.232+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'51 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.232+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f08d40 con 0x564b81eeb9c0 2024-04-23T18:31:17.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.233+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.233+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f08d40 con 0x564b81ef0320 2024-04-23T18:31:17.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.234+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.234+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f091f0 con 0x564b81eeb9c0 2024-04-23T18:31:17.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.235+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.235+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f091f0 con 0x7fc35c0b9020 2024-04-23T18:31:17.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.236+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.236+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f091f0 con 0x564b81eeb9c0 2024-04-23T18:31:17.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.237+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.237+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f091f0 con 0x7fc35c0b9020 2024-04-23T18:31:17.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.238+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.238+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f091f0 con 0x564b81ee6fd0 2024-04-23T18:31:17.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.239+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'235 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.239+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f091f0 con 0x564b81ef0320 2024-04-23T18:31:17.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.241+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'68 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.241+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f09820 con 0x564b81eeb9c0 2024-04-23T18:31:17.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.242+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.242+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f09740 con 0x564b81ef0320 2024-04-23T18:31:17.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.243+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.243+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f09740 con 0x564b81ee6fd0 2024-04-23T18:31:17.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.244+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.244+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f020d0 con 0x564b81ee6fd0 2024-04-23T18:31:17.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.245+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'236 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.245+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f020d0 con 0x564b81ef0320 2024-04-23T18:31:17.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.246+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'69 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.246+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f020d0 con 0x564b81eeb9c0 2024-04-23T18:31:17.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.247+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.247+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f020d0 con 0x564b81ef0320 2024-04-23T18:31:17.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.248+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.248+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f020d0 con 0x564b81ef0320 2024-04-23T18:31:17.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.249+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.249+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f020d0 con 0x564b81ef0320 2024-04-23T18:31:17.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.250+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.250+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f020d0 con 0x564b81ef0320 2024-04-23T18:31:17.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.251+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.251+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f020d0 con 0x7fc35c0b9020 2024-04-23T18:31:17.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.252+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.252+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f020d0 con 0x564b81ef0320 2024-04-23T18:31:17.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.253+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.253+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f020d0 con 0x7fc35c0b9020 2024-04-23T18:31:17.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.254+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'52 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.254+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f020d0 con 0x564b81ef0320 2024-04-23T18:31:17.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.255+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'70 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.248 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.255+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f020d0 con 0x7fc35c0b9020 2024-04-23T18:31:17.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.256+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.249 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.256+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f020d0 con 0x564b81eeb9c0 2024-04-23T18:31:17.250 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.257+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.258+0000 7fc19bfff640 20 reqs_thread_entry: start 2024-04-23T18:31:17.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.258+0000 7fc36f135800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:17.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.258+0000 7fc36f135800 20 Filter name: none 2024-04-23T18:31:17.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.258+0000 7fc199ffb640 20 reqs_thread_entry: start 2024-04-23T18:31:17.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.258+0000 7fc36f135800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-23T18:31:17.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.258+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.258+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f346e0 con 0x564b81ee6fd0 2024-04-23T18:31:17.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.258+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.258+0000 7fc36f135800 20 rados_obj.operate() r=0 bl.length=391 2024-04-23T18:31:17.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.258+0000 7fc36f135800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-23T18:31:17.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.258+0000 7fc36f135800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-23T18:31:17.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.258+0000 7fc36f135800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:17.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.258+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f37170 con 0x564b81eeb9c0 2024-04-23T18:31:17.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.259+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.259+0000 7fc36f135800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7 : miss 2024-04-23T18:31:17.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.259+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.259+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:96 8.4 8:26f25f92:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f36e10 con 0x564b81eeb9c0 2024-04-23T18:31:17.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.259+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(96 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.259+0000 7fc36f135800 20 rados_obj.operate() r=0 bl.length=379 2024-04-23T18:31:17.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.259+0000 7fc36f135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7 info.flags=0x17 2024-04-23T18:31:17.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.259+0000 7fc36f135800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7 to cache LRU end 2024-04-23T18:31:17.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.259+0000 7fc36f135800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:17.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.259+0000 7fc36f135800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-23T18:31:17.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.259+0000 7fc36f135800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7 2024-04-23T18:31:17.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.259+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:97 4.29 4:97384a37:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb4610 con 0x564b81ef0320 2024-04-23T18:31:17.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.260+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(97 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.260+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:98 4.29 4:948c0a73:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb4610 con 0x564b81ef0320 2024-04-23T18:31:17.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.260+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(98 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.1 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.260+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:99 4.24 4:26eee199:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb4610 con 0x7fc35c0b9020 2024-04-23T18:31:17.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.261+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(99 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.261+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:100 4.17 4:eb42a99e:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb4610 con 0x7fc35c0b9020 2024-04-23T18:31:17.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.261+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(100 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.261+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:101 4.24 4:2567852f:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb4040 con 0x7fc35c0b9020 2024-04-23T18:31:17.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.262+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(101 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.4 [call out=424b] v0'0 uv8 ondisk = 0) ==== 194+0+424 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.262+0000 7fc36f135800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-04-23T18:31:17.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.262+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:102 4.2e 4:764532c1:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb4040 con 0x564b81ef0320 2024-04-23T18:31:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.262+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 28 ==== osd_op_reply(102 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.262+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:103 4.5 4:a26f00d1:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb4040 con 0x564b81ef0320 2024-04-23T18:31:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.262+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 29 ==== osd_op_reply(103 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.262+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:104 4.15 4:a893b9ba:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb4040 con 0x564b81ef0320 2024-04-23T18:31:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.263+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 30 ==== osd_op_reply(104 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.263+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:105 4.22 4:46564cc6:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb4000 con 0x564b81ee6fd0 2024-04-23T18:31:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.263+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(105 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.263+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:106 4.32 4:4eb496ab:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb4040 con 0x564b81ee6fd0 2024-04-23T18:31:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.263+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(106 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.263+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:107 4.35 4:addc0d0d:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb4040 con 0x564b81ee6fd0 2024-04-23T18:31:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.264+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(107 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc364040080 con 0x564b81ee6fd0 2024-04-23T18:31:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.264+0000 7fc36f135800 20 get_obj_state: octx=0x7fc35c0a39c0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x564b81fb2678 s->prefetch_data=0 2024-04-23T18:31:17.259 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.264+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:108 3.1es0 3:79174abf:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb34a0 con 0x7fc35c0b9020 2024-04-23T18:31:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.264+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(108 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+891 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.264+0000 7fc36f135800 10 manifest: total_size = 6 2024-04-23T18:31:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.264+0000 7fc36f135800 20 get_obj_state: setting s->obj_tag to b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.725803136402496110 2024-04-23T18:31:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.264+0000 7fc36f135800 20 get_obj_state: octx=0x7fc35c0a39c0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x564b81fb2678 s->prefetch_data=0 2024-04-23T18:31:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.264+0000 7fc36f135800 20 prepare_atomic_modification: state is not atomic. state=0x564b81fb2678 2024-04-23T18:31:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.264+0000 7fc36f135800 20 bucket index object: :.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.4 2024-04-23T18:31:17.260 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.264+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:109 4.24 4:2567852f:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb34a0 con 0x7fc35c0b9020 2024-04-23T18:31:17.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.265+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(109 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.4 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc364040080 con 0x7fc35c0b9020 2024-04-23T18:31:17.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.265+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:110 3.1es0 3:79174abf:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb34a0 con 0x7fc35c0b9020 2024-04-23T18:31:17.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(110 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7_15f6f8dc036519d7fe15b39338f6e5db [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fc36405c040 con 0x7fc35c0b9020 2024-04-23T18:31:17.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:111 4.24 4:2567852f:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f3bbc0 con 0x7fc35c0b9020 2024-04-23T18:31:17.268 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 20 list_objects_ordered: starting attempt 1 2024-04-23T18:31:17.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-23T18:31:17.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:112 4.29 4:97384a37:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f3d510 con 0x564b81ef0320 2024-04-23T18:31:17.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:113 4.29 4:948c0a73:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f3d510 con 0x564b81ef0320 2024-04-23T18:31:17.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:114 4.24 4:26eee199:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f3d510 con 0x7fc35c0b9020 2024-04-23T18:31:17.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:115 4.17 4:eb42a99e:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f3d510 con 0x7fc35c0b9020 2024-04-23T18:31:17.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:116 4.24 4:2567852f:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f46f50 con 0x7fc35c0b9020 2024-04-23T18:31:17.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:117 4.2e 4:764532c1:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f49d50 con 0x564b81ef0320 2024-04-23T18:31:17.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:118 4.5 4:a26f00d1:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f49d90 con 0x564b81ef0320 2024-04-23T18:31:17.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 31 ==== osd_op_reply(112 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:119 4.15 4:a893b9ba:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f3bbc0 con 0x564b81ef0320 2024-04-23T18:31:17.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:120 4.22 4:46564cc6:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb27e0 con 0x564b81ee6fd0 2024-04-23T18:31:17.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:121 4.32 4:4eb496ab:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f523b0 con 0x564b81ee6fd0 2024-04-23T18:31:17.269 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:122 4.35 4:addc0d0d:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f551d0 con 0x564b81ee6fd0 2024-04-23T18:31:17.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.267+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(115 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc36405c040 con 0x7fc35c0b9020 2024-04-23T18:31:17.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== osd_op_reply(114 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc36405c040 con 0x7fc35c0b9020 2024-04-23T18:31:17.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 32 ==== osd_op_reply(113 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.1 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 33 ==== osd_op_reply(117 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(121 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc36405c040 con 0x564b81ee6fd0 2024-04-23T18:31:17.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(120 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc36405c040 con 0x564b81ee6fd0 2024-04-23T18:31:17.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 34 ==== osd_op_reply(118 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(122 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc36405c040 con 0x564b81ee6fd0 2024-04-23T18:31:17.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 35 ==== osd_op_reply(119 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 31 ==== osd_op_reply(111 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.4 [stat,call,call] v34'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc36405c040 con 0x7fc35c0b9020 2024-04-23T18:31:17.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc24dffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-04-23T18:31:17.270 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 32 ==== osd_op_reply(116 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.4 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc36405c040 con 0x7fc35c0b9020 2024-04-23T18:31:17.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-23T18:31:17.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-23T18:31:17.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-23T18:31:17.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-23T18:31:17.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7])"; uploads.size()=0; is_truncated=0 2024-04-23T18:31:17.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:123 4.29 4:97384a37:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x564b81ef0320 2024-04-23T18:31:17.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:124 4.29 4:948c0a73:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f523b0 con 0x564b81ef0320 2024-04-23T18:31:17.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:125 4.24 4:26eee199:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2190 con 0x7fc35c0b9020 2024-04-23T18:31:17.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:126 4.17 4:eb42a99e:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f3bbc0 con 0x7fc35c0b9020 2024-04-23T18:31:17.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:127 4.24 4:2567852f:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x7fc35c0b9020 2024-04-23T18:31:17.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:128 4.2e 4:764532c1:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2190 con 0x564b81ef0320 2024-04-23T18:31:17.271 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:129 4.5 4:a26f00d1:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f523b0 con 0x564b81ef0320 2024-04-23T18:31:17.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:130 4.15 4:a893b9ba:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x564b81ef0320 2024-04-23T18:31:17.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:131 4.22 4:46564cc6:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2190 con 0x564b81ee6fd0 2024-04-23T18:31:17.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.268+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:132 4.32 4:4eb496ab:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f523b0 con 0x564b81ee6fd0 2024-04-23T18:31:17.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.269+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:133 4.35 4:addc0d0d:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x564b81ee6fd0 2024-04-23T18:31:17.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.269+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 33 ==== osd_op_reply(125 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.269+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 34 ==== osd_op_reply(126 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.269+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 36 ==== osd_op_reply(123 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.269+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 34 ==== osd_op_reply(131 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc364065040 con 0x564b81ee6fd0 2024-04-23T18:31:17.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.269+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 37 ==== osd_op_reply(128 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.269+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 35 ==== osd_op_reply(132 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc364065040 con 0x564b81ee6fd0 2024-04-23T18:31:17.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.269+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 38 ==== osd_op_reply(129 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.272 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.269+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 35 ==== osd_op_reply(127 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.4 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.269+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 39 ==== osd_op_reply(124 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.1 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.269+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 40 ==== osd_op_reply(130 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.269+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 36 ==== osd_op_reply(133 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc364065040 con 0x564b81ee6fd0 2024-04-23T18:31:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.269+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f523b0 con 0x564b81eeb9c0 2024-04-23T18:31:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.270+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== osd_op_reply(134 foo.buckets [call] v34'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.270+0000 7fc36f135800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-23T18:31:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.270+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.270+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f523b0 con 0x564b81eeb9c0 2024-04-23T18:31:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.271+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 24 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.271+0000 7fc36f135800 20 rados_obj.operate() r=0 bl.length=165 2024-04-23T18:31:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.271+0000 7fc36f135800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-23T18:31:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.271+0000 7fc36f135800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-23T18:31:17.273 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.271+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f523b0 con 0x564b81eeb9c0 2024-04-23T18:31:17.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.272+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 25 ==== osd_op_reply(136 myfoo [call,call,delete] v34'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.272+0000 7fc36f135800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-23T18:31:17.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.272+0000 7fc36f135800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-23T18:31:17.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.272+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94882302814464 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f523b0 con 0x7fc35c0b9020 2024-04-23T18:31:17.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.272+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 36 ==== watch-notify(notify (1) cookie 94882302500992 notify 146028888107 ret 0) ==== 191+0+0 (crc 0 0 0) 0x564b81f09b60 con 0x7fc35c0b9020 2024-04-23T18:31:17.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.272+0000 7fc24e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94882302500992 notifier 4777 bl.length()=149 2024-04-23T18:31:17.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.272+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 37 ==== osd_op_reply(137 notify.6 [notify cookie 94882302814464 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.272+0000 7fc24e7fc640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc230003d60 con 0x7fc35c0b9020 2024-04-23T18:31:17.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.272+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 38 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.272+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 39 ==== watch-notify(notify_complete (2) cookie 94882302814464 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564b81f06610 con 0x7fc35c0b9020 2024-04-23T18:31:17.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.272+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:139 8.4 8:26f25f92:root::.bucket.meta.myfoo%3ab69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f523b0 con 0x564b81eeb9c0 2024-04-23T18:31:17.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.273+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 26 ==== osd_op_reply(139 .bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7 [call,call,delete] v34'7 uv7 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.274 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.273+0000 7fc36f135800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7 from cache 2024-04-23T18:31:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.273+0000 7fc36f135800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7, ofs0, ns] 2024-04-23T18:31:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.273+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94882302748352 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f523b0 con 0x7fc35c0b9020 2024-04-23T18:31:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 40 ==== watch-notify(notify (1) cookie 94882302500992 notify 146028888108 ret 0) ==== 248+0+0 (crc 0 0 0) 0x564b81f06610 con 0x7fc35c0b9020 2024-04-23T18:31:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc24dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888108 cookie 94882302500992 notifier 4777 bl.length()=206 2024-04-23T18:31:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 41 ==== osd_op_reply(140 notify.6 [notify cookie 94882302748352 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc24dffb640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc1a00032c0 con 0x7fc35c0b9020 2024-04-23T18:31:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 42 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 43 ==== watch-notify(notify_complete (2) cookie 94882302748352 notify 146028888108 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564b81f06440 con 0x7fc35c0b9020 2024-04-23T18:31:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:142 4.29 4:97384a37:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f523b0 con 0x564b81ef0320 2024-04-23T18:31:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:143 4.29 4:948c0a73:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x564b81ef0320 2024-04-23T18:31:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:144 4.24 4:26eee199:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f3b710 con 0x7fc35c0b9020 2024-04-23T18:31:17.275 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:145 4.17 4:eb42a99e:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f3c9b0 con 0x7fc35c0b9020 2024-04-23T18:31:17.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:146 4.24 4:2567852f:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f35300 con 0x7fc35c0b9020 2024-04-23T18:31:17.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:147 4.2e 4:764532c1:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f523b0 con 0x564b81ef0320 2024-04-23T18:31:17.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:148 4.5 4:a26f00d1:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f3b710 con 0x564b81ef0320 2024-04-23T18:31:17.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:149 4.15 4:a893b9ba:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f3c9b0 con 0x564b81ef0320 2024-04-23T18:31:17.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:150 4.22 4:46564cc6:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f35300 con 0x564b81ee6fd0 2024-04-23T18:31:17.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:151 4.32 4:4eb496ab:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f523b0 con 0x564b81ee6fd0 2024-04-23T18:31:17.276 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.274+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:152 4.35 4:addc0d0d:::.dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81f3b710 con 0x564b81ee6fd0 2024-04-23T18:31:17.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.275+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 37 ==== osd_op_reply(152 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.10 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc364065040 con 0x564b81ee6fd0 2024-04-23T18:31:17.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.276+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 44 ==== osd_op_reply(144 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.2 [delete] v34'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.276+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 45 ==== osd_op_reply(145 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.3 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.276+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 41 ==== osd_op_reply(148 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.6 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.276+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 46 ==== osd_op_reply(146 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.4 [delete] v34'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.282 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.276+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 42 ==== osd_op_reply(142 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.0 [delete] v34'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.276+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 43 ==== osd_op_reply(147 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.5 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.276+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 44 ==== osd_op_reply(149 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.7 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.276+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 38 ==== osd_op_reply(151 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.9 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc364065040 con 0x564b81ee6fd0 2024-04-23T18:31:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.276+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 39 ==== osd_op_reply(150 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.8 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc364065040 con 0x564b81ee6fd0 2024-04-23T18:31:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.276+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 45 ==== osd_op_reply(143 .dir.b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7.1 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.276+0000 7fc36f135800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7 : miss 2024-04-23T18:31:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.276+0000 7fc36f135800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.277+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:153 6.1d 6:bf798d24:::pubsub..bucket.myfoo%2fb69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81f3c9b0 con 0x7fc35c0b9020 2024-04-23T18:31:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.277+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 47 ==== osd_op_reply(153 pubsub..bucket.myfoo/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.277+0000 7fc36f135800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.277+0000 7fc36f135800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7 info.flags=0x0 2024-04-23T18:31:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.277+0000 7fc36f135800 10 adding default.rgw.log++pubsub..bucket.myfoo/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7 to cache LRU end 2024-04-23T18:31:17.283 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.277+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:154 6.1d 6:bf798d24:::pubsub..bucket.myfoo%2fb69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x7fc35c0b9020 2024-04-23T18:31:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.278+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 48 ==== osd_op_reply(154 pubsub..bucket.myfoo/b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.7 [delete] v34'53 uv37 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.278+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x564b81eeb9c0 2024-04-23T18:31:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.279+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 27 ==== osd_op_reply(155 foo.buckets [call] v34'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.279+0000 7fc36f135800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-04-23T18:31:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.279+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x7fc35c0b9020 2024-04-23T18:31:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.280+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 49 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v34'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.280+0000 7fc36f135800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-23T18:31:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.280+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94882302748224 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x564b81eeb9c0 2024-04-23T18:31:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.280+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 28 ==== watch-notify(notify (1) cookie 94882302490880 notify 146028888083 ret 0) ==== 212+0+0 (crc 0 0 0) 0x564b81f36470 con 0x564b81eeb9c0 2024-04-23T18:31:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.280+0000 7fc24e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 94882302490880 notifier 4777 bl.length()=170 2024-04-23T18:31:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.280+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 29 ==== osd_op_reply(157 notify.3 [notify cookie 94882302748224 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.280+0000 7fc24e7fc640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc230003d60 con 0x564b81eeb9c0 2024-04-23T18:31:17.284 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.280+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 30 ==== watch-notify(notify_complete (2) cookie 94882302748224 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564b81ec7d00 con 0x564b81eeb9c0 2024-04-23T18:31:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.280+0000 7fc36f135800 10 removing email index: foo@foo.com 2024-04-23T18:31:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.280+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 31 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.280+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x564b81ee6fd0 2024-04-23T18:31:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.281+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 40 ==== osd_op_reply(159 foo@foo.com [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc364065040 con 0x564b81ee6fd0 2024-04-23T18:31:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.282+0000 7fc36f135800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-23T18:31:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.282+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94882302748224 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x564b81eeb9c0 2024-04-23T18:31:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.282+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 32 ==== watch-notify(notify (1) cookie 94882302490880 notify 146028888084 ret 0) ==== 204+0+0 (crc 0 0 0) 0x564b81ec7d00 con 0x564b81eeb9c0 2024-04-23T18:31:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.282+0000 7fc24dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 94882302490880 notifier 4777 bl.length()=162 2024-04-23T18:31:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.282+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 33 ==== osd_op_reply(160 notify.3 [notify cookie 94882302748224 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.282+0000 7fc24dffb640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc1a00032c0 con 0x564b81eeb9c0 2024-04-23T18:31:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.282+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 34 ==== watch-notify(notify_complete (2) cookie 94882302748224 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564b81ea9550 con 0x564b81eeb9c0 2024-04-23T18:31:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.282+0000 7fc36f135800 10 removing user buckets index 2024-04-23T18:31:17.285 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.282+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 35 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.282+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x564b81eeb9c0 2024-04-23T18:31:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.283+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 36 ==== osd_op_reply(162 foo.buckets [delete] v34'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.283+0000 7fc36f135800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-04-23T18:31:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.283+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94882302748224 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x7fc35c0b9020 2024-04-23T18:31:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.283+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 50 ==== watch-notify(notify (1) cookie 94882302497216 notify 146028888109 ret 0) ==== 202+0+0 (crc 0 0 0) 0x564b81f06440 con 0x7fc35c0b9020 2024-04-23T18:31:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.283+0000 7fc24e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888109 cookie 94882302497216 notifier 4777 bl.length()=160 2024-04-23T18:31:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.283+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 51 ==== osd_op_reply(163 notify.5 [notify cookie 94882302748224 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.283+0000 7fc24e7fc640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc230003d60 con 0x7fc35c0b9020 2024-04-23T18:31:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.284+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 52 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.284+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 53 ==== watch-notify(notify_complete (2) cookie 94882302748224 notify 146028888109 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564b81f06c50 con 0x7fc35c0b9020 2024-04-23T18:31:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.284+0000 7fc36f135800 10 removing user index: foo 2024-04-23T18:31:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.284+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x564b81ee6fd0 2024-04-23T18:31:17.286 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.285+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 41 ==== osd_op_reply(165 foo [call,call,delete] v34'21 uv21 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc364065040 con 0x564b81ee6fd0 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.285+0000 7fc36f135800 10 removing default.rgw.meta+users.uid+foo from cache 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.285+0000 7fc36f135800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.285+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94882302748224 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x564b81ee6fd0 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.285+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 42 ==== watch-notify(notify (1) cookie 94882302494512 notify 146028888094 ret 0) ==== 194+0+0 (crc 0 0 0) 0x564b81f06c50 con 0x564b81ee6fd0 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.285+0000 7fc24dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888094 cookie 94882302494512 notifier 4777 bl.length()=152 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.285+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 43 ==== osd_op_reply(166 notify.4 [notify cookie 94882302748224 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc364065040 con 0x564b81ee6fd0 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.285+0000 7fc24dffb640 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc1a00032c0 con 0x564b81ee6fd0 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.285+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 44 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364065040 con 0x564b81ee6fd0 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.286+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 45 ==== watch-notify(notify_complete (2) cookie 94882302748224 notify 146028888094 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564b81f06a80 con 0x564b81ee6fd0 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.286+0000 7fc2217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.286+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94882302503648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x564b81ee6fd0 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.287+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 46 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94882302503648] v34'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc364065040 con 0x564b81ee6fd0 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.287+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94882302478656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb2860 con 0x564b81eeb9c0 2024-04-23T18:31:17.287 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.288+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 37 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94882302478656] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.288+0000 7fc36f135800 20 remove_watcher() i=0 2024-04-23T18:31:17.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.288+0000 7fc36f135800 2 removed watcher, disabling cache 2024-04-23T18:31:17.288 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.288+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94882302482416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb39c0 con 0x564b81ee6fd0 2024-04-23T18:31:17.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.290+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 47 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94882302482416] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364065040 con 0x564b81ee6fd0 2024-04-23T18:31:17.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.290+0000 7fc36f135800 20 remove_watcher() i=1 2024-04-23T18:31:17.292 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.290+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94882302487248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb39c0 con 0x564b81ef0320 2024-04-23T18:31:17.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.291+0000 7fc36a5b4640 1 -- 172.21.15.119:0/218609609 <== osd.3 v2:172.21.15.119:6809/3910610681 46 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94882302487248] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc360036040 con 0x564b81ef0320 2024-04-23T18:31:17.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.291+0000 7fc36f135800 20 remove_watcher() i=2 2024-04-23T18:31:17.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.291+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94882302490880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb39c0 con 0x564b81eeb9c0 2024-04-23T18:31:17.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.292+0000 7fc36adb5640 1 -- 172.21.15.119:0/218609609 <== osd.2 v2:172.21.15.119:6800/2624052101 38 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94882302490880] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc35c0d4040 con 0x564b81eeb9c0 2024-04-23T18:31:17.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.292+0000 7fc36f135800 20 remove_watcher() i=3 2024-04-23T18:31:17.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.292+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94882302494512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb39c0 con 0x564b81ee6fd0 2024-04-23T18:31:17.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.293+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.1 v2:172.21.15.119:6808/2736386629 48 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94882302494512] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364065040 con 0x564b81ee6fd0 2024-04-23T18:31:17.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.293+0000 7fc36f135800 20 remove_watcher() i=4 2024-04-23T18:31:17.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.293+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94882302497216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb39c0 con 0x7fc35c0b9020 2024-04-23T18:31:17.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.294+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 54 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94882302497216] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.294+0000 7fc36f135800 20 remove_watcher() i=5 2024-04-23T18:31:17.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.294+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94882302500992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb39c0 con 0x7fc35c0b9020 2024-04-23T18:31:17.293 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.295+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 55 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94882302500992] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.295+0000 7fc36f135800 20 remove_watcher() i=6 2024-04-23T18:31:17.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.295+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94882302502592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564b81fb39c0 con 0x7fc35c0b9020 2024-04-23T18:31:17.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 <== osd.0 v2:172.21.15.62:6800/2641588406 56 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94882302502592] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc364065040 con 0x7fc35c0b9020 2024-04-23T18:31:17.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 20 remove_watcher() i=7 2024-04-23T18:31:17.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc35c0b9020 msgr2=0x7fc35c0a3480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc35c0b9020 0x7fc35c0a3480 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b81ee6fd0 msgr2=0x564b81ee9490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b81ee6fd0 0x564b81ee9490 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b81eeb9c0 msgr2=0x564b81eeddb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b81eeb9c0 0x564b81eeddb0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564b81ef0320 msgr2=0x564b81ef27e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x564b81ef0320 0x564b81ef27e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.294 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc234036e60 msgr2=0x7fc234039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc234036e60 0x7fc234039320 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x564b81eb92f0 tx=0x7fc360022040 comp rx=0 tx=0).stop 2024-04-23T18:31:17.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ed4470 msgr2=0x564b81edb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 --2- 172.21.15.119:0/218609609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ed4470 0x564b81edb890 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc35c006900 tx=0x7fc35c04cea0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 reap_dead start 2024-04-23T18:31:17.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36b5b6640 1 -- 172.21.15.119:0/218609609 reap_dead start 2024-04-23T18:31:17.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 shutdown_connections 2024-04-23T18:31:17.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 >> 172.21.15.119:0/218609609 conn(0x564b81ed07d0 msgr2=0x564b81ecde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 shutdown_connections 2024-04-23T18:31:17.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.296+0000 7fc36f135800 1 -- 172.21.15.119:0/218609609 wait complete. 2024-04-23T18:31:17.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/3519769988 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc244036e60 msgr2=0x7fc244039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 --2- 172.21.15.119:0/3519769988 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc244036e60 0x7fc244039320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x564b81eb0540 tx=0x7fc360006000 comp rx=0 tx=0).stop 2024-04-23T18:31:17.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/3519769988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ec73a0 msgr2=0x564b81ec77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.295 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 --2- 172.21.15.119:0/3519769988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ec73a0 0x564b81ec77c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc35c006ae0 tx=0x7fc35c077720 comp rx=0 tx=0).stop 2024-04-23T18:31:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/3519769988 shutdown_connections 2024-04-23T18:31:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 --2- 172.21.15.119:0/3519769988 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc244036e60 0x7fc244039320 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 --2- 172.21.15.119:0/3519769988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81ec73a0 0x564b81ec77c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/3519769988 >> 172.21.15.119:0/3519769988 conn(0x564b81ebb440 msgr2=0x564b81ebb840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/3519769988 shutdown_connections 2024-04-23T18:31:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/3519769988 wait complete. 2024-04-23T18:31:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564b81eb62a0 msgr2=0x564b81eb8760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x564b81eb62a0 0x564b81eb8760 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b81dad220 msgr2=0x564b81eafb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x564b81dad220 0x564b81eafb60 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b81eb23a0 msgr2=0x564b81eb4790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x564b81eb23a0 0x564b81eb4790 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.296 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc250036e60 msgr2=0x7fc250039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc250036e60 0x7fc250039320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc360000f60 tx=0x7fc3600013f0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 msgr2=0x564b81ea8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 --2- 172.21.15.119:0/348123332 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564b81dac8c0 0x564b81ea8af0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0524f0 tx=0x7fc35c003020 comp rx=0 tx=0).stop 2024-04-23T18:31:17.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36b5b6640 1 -- 172.21.15.119:0/348123332 reap_dead start 2024-04-23T18:31:17.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 shutdown_connections 2024-04-23T18:31:17.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 >> 172.21.15.119:0/348123332 conn(0x564b81da8440 msgr2=0x564b81e9b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 shutdown_connections 2024-04-23T18:31:17.297 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.297+0000 7fc36f135800 1 -- 172.21.15.119:0/348123332 wait complete. 2024-04-23T18:31:17.299 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-23T18:31:17.299 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-23T18:31:17.299 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-23T18:31:17.382 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:17.382 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:17.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.389+0000 7fae2e10c800 1 Processor -- start 2024-04-23T18:31:17.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.389+0000 7fae2e10c800 1 -- start start 2024-04-23T18:31:17.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.389+0000 7fae2e10c800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556a31218890 0x556a31218cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.389+0000 7fae2e10c800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556a310ca560 con 0x556a312191f0 2024-04-23T18:31:17.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.389+0000 7fae2e10c800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x556a310bbe20 con 0x556a31218890 2024-04-23T18:31:17.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.390+0000 7fae2bc12640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556a31218890 0x556a31218cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.390+0000 7fae23fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x556a312191f0 0x556a312196a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50494/0 (socket says 172.21.15.119:50494) 2024-04-23T18:31:17.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.390+0000 7fae23fff640 1 -- 172.21.15.119:0/562560997 learned_addr learned my addr 172.21.15.119:0/562560997 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:31:17.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.390+0000 7fae2bc12640 1 -- 172.21.15.119:0/562560997 >> v1:172.21.15.62:6789/0 conn(0x556a312191f0 legacy=0x556a312196a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.390+0000 7fae2bc12640 1 -- 172.21.15.119:0/562560997 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a310c9e60 con 0x556a31218890 2024-04-23T18:31:17.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.392+0000 7fae2bc12640 1 --2- 172.21.15.119:0/562560997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a31218cb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00a470 tx=0x7fae1c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f46bd907d758811 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.392+0000 7fae2b411640 1 -- 172.21.15.119:0/562560997 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c057070 con 0x556a31218890 2024-04-23T18:31:17.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.392+0000 7fae2b411640 1 -- 172.21.15.119:0/562560997 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae1c04adc0 con 0x556a31218890 2024-04-23T18:31:17.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.392+0000 7fae2b411640 1 -- 172.21.15.119:0/562560997 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c052590 con 0x556a31218890 2024-04-23T18:31:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.392+0000 7fae2e10c800 1 -- 172.21.15.119:0/562560997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 msgr2=0x556a31218cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.392+0000 7fae2e10c800 1 --2- 172.21.15.119:0/562560997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a31218cb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fae1c00a470 tx=0x7fae1c01ce90 comp rx=0 tx=0).stop 2024-04-23T18:31:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.392+0000 7fae2e10c800 1 -- 172.21.15.119:0/562560997 shutdown_connections 2024-04-23T18:31:17.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.392+0000 7fae2e10c800 1 --2- 172.21.15.119:0/562560997 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a31218cb0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.392+0000 7fae2e10c800 1 -- 172.21.15.119:0/562560997 >> 172.21.15.119:0/562560997 conn(0x556a31214410 msgr2=0x556a31216830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.392+0000 7fae2e10c800 1 -- 172.21.15.119:0/562560997 shutdown_connections 2024-04-23T18:31:17.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.392+0000 7fae2e10c800 1 -- 172.21.15.119:0/562560997 wait complete. 2024-04-23T18:31:17.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.404+0000 7fae2e10c800 1 Processor -- start 2024-04-23T18:31:17.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.404+0000 7fae2e10c800 1 -- start start 2024-04-23T18:31:17.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.404+0000 7fae2e10c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a3130d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.404+0000 7fae2e10c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556a311655b0 con 0x556a31218890 2024-04-23T18:31:17.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.405+0000 7fae2bc12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a3130d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.405+0000 7fae2bc12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a3130d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54534/0 (socket says 172.21.15.119:54534) 2024-04-23T18:31:17.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.405+0000 7fae2bc12640 1 -- 172.21.15.119:0/1748201190 learned_addr learned my addr 172.21.15.119:0/1748201190 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.405+0000 7fae2bc12640 1 -- 172.21.15.119:0/1748201190 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a310db860 con 0x556a31218890 2024-04-23T18:31:17.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.405+0000 7fae2bc12640 1 --2- 172.21.15.119:0/1748201190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a3130d460 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fae1c055040 tx=0x7fae1c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03932be1585ebf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.405+0000 7fad19e0b640 1 -- 172.21.15.119:0/1748201190 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c057040 con 0x556a31218890 2024-04-23T18:31:17.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.405+0000 7fad19e0b640 1 -- 172.21.15.119:0/1748201190 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae1c062070 con 0x556a31218890 2024-04-23T18:31:17.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.405+0000 7fad19e0b640 1 -- 172.21.15.119:0/1748201190 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c05d470 con 0x556a31218890 2024-04-23T18:31:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.406+0000 7fae2e10c800 1 -- 172.21.15.119:0/1748201190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 msgr2=0x556a3130d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.406+0000 7fae2e10c800 1 --2- 172.21.15.119:0/1748201190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a3130d460 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fae1c055040 tx=0x7fae1c04c000 comp rx=0 tx=0).stop 2024-04-23T18:31:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.406+0000 7fae2e10c800 1 -- 172.21.15.119:0/1748201190 shutdown_connections 2024-04-23T18:31:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.406+0000 7fae2e10c800 1 --2- 172.21.15.119:0/1748201190 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a3130d460 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.406+0000 7fae2e10c800 1 -- 172.21.15.119:0/1748201190 >> 172.21.15.119:0/1748201190 conn(0x556a31214410 msgr2=0x556a31308d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.406+0000 7fae2e10c800 1 -- 172.21.15.119:0/1748201190 shutdown_connections 2024-04-23T18:31:17.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.406+0000 7fae2e10c800 1 -- 172.21.15.119:0/1748201190 wait complete. 2024-04-23T18:31:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.406+0000 7fae2e10c800 1 Processor -- start 2024-04-23T18:31:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.406+0000 7fae2e10c800 1 -- start start 2024-04-23T18:31:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.407+0000 7fae2e10c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a31314d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.407+0000 7fae2e10c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556a3121a050 con 0x556a31218890 2024-04-23T18:31:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.407+0000 7fae2bc12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a31314d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.407+0000 7fae2bc12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a31314d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54538/0 (socket says 172.21.15.119:54538) 2024-04-23T18:31:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.407+0000 7fae2bc12640 1 -- 172.21.15.119:0/2357100962 learned_addr learned my addr 172.21.15.119:0/2357100962 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.407+0000 7fae2bc12640 1 -- 172.21.15.119:0/2357100962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a310d9eb0 con 0x556a31218890 2024-04-23T18:31:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.407+0000 7fae2bc12640 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a31314d10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fae1c005870 tx=0x7fae1c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.407+0000 7fad13fff640 1 -- 172.21.15.119:0/2357100962 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c06b070 con 0x556a31218890 2024-04-23T18:31:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.407+0000 7fad13fff640 1 -- 172.21.15.119:0/2357100962 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae1c05d940 con 0x556a31218890 2024-04-23T18:31:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.407+0000 7fad13fff640 1 -- 172.21.15.119:0/2357100962 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c057070 con 0x556a31218890 2024-04-23T18:31:17.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.407+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a31315250 con 0x556a31218890 2024-04-23T18:31:17.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.407+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a31315770 con 0x556a31218890 2024-04-23T18:31:17.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.408+0000 7fad13fff640 1 -- 172.21.15.119:0/2357100962 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fae1c05dc20 con 0x556a31218890 2024-04-23T18:31:17.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.408+0000 7fad13fff640 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fad14036eb0 0x7fad14039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.408+0000 7fad13fff640 1 -- 172.21.15.119:0/2357100962 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fae1c08e970 con 0x556a31218890 2024-04-23T18:31:17.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.409+0000 7fae23fff640 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fad14036eb0 0x7fad14039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.409+0000 7fae2e10c800 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556a312191f0 0x556a3131bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.409+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a3131c2c0 con 0x556a312191f0 2024-04-23T18:31:17.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.409+0000 7fae2c413640 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556a312191f0 0x556a3131bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.409+0000 7fae23fff640 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fad14036eb0 0x7fad14039370 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fae14000f60 tx=0x7fae140012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.409+0000 7fae2c413640 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556a312191f0 0x556a3131bd80 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.409+0000 7fae2c413640 1 -- 172.21.15.119:0/2357100962 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a312191f0 2024-04-23T18:31:17.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.409+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a31319330 con 0x556a312191f0 2024-04-23T18:31:17.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.409+0000 7fae2c413640 1 -- 172.21.15.119:0/2357100962 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a312191f0 2024-04-23T18:31:17.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.409+0000 7fae2e10c800 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556a3131e5b0 0x556a313209a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.410+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a31321040 con 0x556a3131e5b0 2024-04-23T18:31:17.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.410+0000 7fae2bc12640 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556a3131e5b0 0x556a313209a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.410+0000 7fae2bc12640 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556a3131e5b0 0x556a313209a0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.410+0000 7fae2bc12640 1 -- 172.21.15.119:0/2357100962 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fae1c05a040 con 0x556a3131e5b0 2024-04-23T18:31:17.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.410+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a3131d560 con 0x556a312191f0 2024-04-23T18:31:17.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.410+0000 7fae2c413640 1 -- 172.21.15.119:0/2357100962 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a312191f0 2024-04-23T18:31:17.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.411+0000 7fae2e10c800 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556a313224f0 0x556a31324940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.411+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a313250a0 con 0x556a313224f0 2024-04-23T18:31:17.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.411+0000 7fae23fff640 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556a313224f0 0x556a31324940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.411+0000 7fae23fff640 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556a313224f0 0x556a31324940 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.411+0000 7fae23fff640 1 -- 172.21.15.119:0/2357100962 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fae14009050 con 0x556a313224f0 2024-04-23T18:31:17.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.412+0000 7fae2e10c800 1 Processor -- start 2024-04-23T18:31:17.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.412+0000 7fae2e10c800 1 -- start start 2024-04-23T18:31:17.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.412+0000 7fae2e10c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31333500 0x556a31333920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.412+0000 7fae2e10c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556a3110bdf0 con 0x556a31333500 2024-04-23T18:31:17.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.412+0000 7fae2bc12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31333500 0x556a31333920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.412+0000 7fae2bc12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31333500 0x556a31333920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54544/0 (socket says 172.21.15.119:54544) 2024-04-23T18:31:17.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.412+0000 7fae2bc12640 1 -- 172.21.15.119:0/1751941833 learned_addr learned my addr 172.21.15.119:0/1751941833 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.412+0000 7fae2bc12640 1 -- 172.21.15.119:0/1751941833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a31333e60 con 0x556a31333500 2024-04-23T18:31:17.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.412+0000 7fae2bc12640 1 --2- 172.21.15.119:0/1751941833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31333500 0x556a31333920 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fae1c067fd0 tx=0x7fae1c009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.413+0000 7fad117fa640 1 -- 172.21.15.119:0/1751941833 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c0783a0 con 0x556a31333500 2024-04-23T18:31:17.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.413+0000 7fad117fa640 1 -- 172.21.15.119:0/1751941833 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae1c066b70 con 0x556a31333500 2024-04-23T18:31:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.413+0000 7fae2e10c800 1 -- 172.21.15.119:0/1751941833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a313348d0 con 0x556a31333500 2024-04-23T18:31:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.413+0000 7fad117fa640 1 -- 172.21.15.119:0/1751941833 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c078540 con 0x556a31333500 2024-04-23T18:31:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.413+0000 7fae2e10c800 1 -- 172.21.15.119:0/1751941833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a31334dd0 con 0x556a31333500 2024-04-23T18:31:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.413+0000 7fad117fa640 1 -- 172.21.15.119:0/1751941833 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fae1c078700 con 0x556a31333500 2024-04-23T18:31:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.413+0000 7fad117fa640 1 --2- 172.21.15.119:0/1751941833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fad04036eb0 0x7fad04039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.414+0000 7fad117fa640 1 -- 172.21.15.119:0/1751941833 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fae1c085070 con 0x556a31333500 2024-04-23T18:31:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.414+0000 7fae23fff640 1 --2- 172.21.15.119:0/1751941833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fad04036eb0 0x7fad04039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.414+0000 7fae2e10c800 1 Processor -- start 2024-04-23T18:31:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.414+0000 7fae2e10c800 1 -- start start 2024-04-23T18:31:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.414+0000 7fae23fff640 1 --2- 172.21.15.119:0/1751941833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fad04036eb0 0x7fad04039370 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fae1400bf50 tx=0x7fae1400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.414+0000 7fae2e10c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 0x556a313409f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.414+0000 7fae2e10c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556a3130db20 con 0x556a313405d0 2024-04-23T18:31:17.428 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.414+0000 7fae2bc12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 0x556a313409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.414+0000 7fae2bc12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 0x556a313409f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54552/0 (socket says 172.21.15.119:54552) 2024-04-23T18:31:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.414+0000 7fae2bc12640 1 -- 172.21.15.119:0/3987538410 learned_addr learned my addr 172.21.15.119:0/3987538410 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.414+0000 7fae2bc12640 1 -- 172.21.15.119:0/3987538410 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a31340fc0 con 0x556a313405d0 2024-04-23T18:31:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.415+0000 7fae2bc12640 1 --2- 172.21.15.119:0/3987538410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 0x556a313409f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fae1c07e990 tx=0x7fae1c04bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8783bdb6962b90cd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.415+0000 7fad0affd640 1 -- 172.21.15.119:0/3987538410 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c052620 con 0x556a313405d0 2024-04-23T18:31:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.415+0000 7fad0affd640 1 -- 172.21.15.119:0/3987538410 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae1c009af0 con 0x556a313405d0 2024-04-23T18:31:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.415+0000 7fad0affd640 1 -- 172.21.15.119:0/3987538410 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c0527c0 con 0x556a313405d0 2024-04-23T18:31:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.415+0000 7fae2e10c800 1 -- 172.21.15.119:0/3987538410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 msgr2=0x556a313409f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.415+0000 7fae2e10c800 1 --2- 172.21.15.119:0/3987538410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 0x556a313409f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fae1c07e990 tx=0x7fae1c04bd50 comp rx=0 tx=0).stop 2024-04-23T18:31:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.415+0000 7fae2e10c800 1 -- 172.21.15.119:0/3987538410 shutdown_connections 2024-04-23T18:31:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.415+0000 7fae2e10c800 1 --2- 172.21.15.119:0/3987538410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 0x556a313409f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.415+0000 7fae2e10c800 1 -- 172.21.15.119:0/3987538410 >> 172.21.15.119:0/3987538410 conn(0x556a3133c930 msgr2=0x556a3133a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.429 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.415+0000 7fae2e10c800 1 -- 172.21.15.119:0/3987538410 shutdown_connections 2024-04-23T18:31:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.415+0000 7fae2e10c800 1 -- 172.21.15.119:0/3987538410 wait complete. 2024-04-23T18:31:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.416+0000 7fae2e10c800 1 Processor -- start 2024-04-23T18:31:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.416+0000 7fae2e10c800 1 -- start start 2024-04-23T18:31:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.416+0000 7fae2e10c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 0x556a31347a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.416+0000 7fae2e10c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556a31341670 con 0x556a313405d0 2024-04-23T18:31:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.416+0000 7fae2bc12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 0x556a31347a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.416+0000 7fae2bc12640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 0x556a31347a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54562/0 (socket says 172.21.15.119:54562) 2024-04-23T18:31:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.416+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 learned_addr learned my addr 172.21.15.119:0/4216445312 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.416+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a31347f50 con 0x556a313405d0 2024-04-23T18:31:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.417+0000 7fae2bc12640 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 0x556a31347a10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0057d0 tx=0x7fae1c04fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.417+0000 7fad097fa640 1 -- 172.21.15.119:0/4216445312 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c07ea00 con 0x556a313405d0 2024-04-23T18:31:17.430 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.417+0000 7fad097fa640 1 -- 172.21.15.119:0/4216445312 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae1c07eba0 con 0x556a313405d0 2024-04-23T18:31:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.417+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556a31347f50 con 0x556a313405d0 2024-04-23T18:31:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.417+0000 7fad097fa640 1 -- 172.21.15.119:0/4216445312 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae1c08b340 con 0x556a313405d0 2024-04-23T18:31:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.417+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a31347f50 con 0x556a313405d0 2024-04-23T18:31:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.417+0000 7fad097fa640 1 -- 172.21.15.119:0/4216445312 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fae1c0b4020 con 0x556a313405d0 2024-04-23T18:31:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.418+0000 7fad097fa640 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7facf4036e60 0x7facf4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.418+0000 7fae2e10c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.418+0000 7fad097fa640 1 -- 172.21.15.119:0/4216445312 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fae1c0b2020 con 0x556a313405d0 2024-04-23T18:31:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.418+0000 7fae23fff640 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7facf4036e60 0x7facf4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.418+0000 7fae2e10c800 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556a31352f50 0x556a31355410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.418+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a31355b60 con 0x556a31352f50 2024-04-23T18:31:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.418+0000 7fae2c413640 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556a31352f50 0x556a31355410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.418+0000 7fae23fff640 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7facf4036e60 0x7facf4039320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fae14001b60 tx=0x7fae14010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.431 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.418+0000 7fae2c413640 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556a31352f50 0x556a31355410 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a31352f50 2024-04-23T18:31:17.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 20 realm 2024-04-23T18:31:17.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a31355f70 con 0x556a31352f50 2024-04-23T18:31:17.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a31352f50 2024-04-23T18:31:17.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:17.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a31356810 con 0x556a31352f50 2024-04-23T18:31:17.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a31352f50 2024-04-23T18:31:17.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.432 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31352f50 2024-04-23T18:31:17.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a31352f50 2024-04-23T18:31:17.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:17.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556a31357910 0x556a31359d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a3135a240 con 0x556a31357910 2024-04-23T18:31:17.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.419+0000 7fae2bc12640 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556a31357910 0x556a31359d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.420+0000 7fae2bc12640 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556a31357910 0x556a31359d00 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.420+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fae1c095070 con 0x556a31357910 2024-04-23T18:31:17.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.420+0000 7fae2e10c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:17.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.420+0000 7fae2e10c800 20 searching for the correct realm 2024-04-23T18:31:17.433 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.420+0000 7fae2e10c800 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556a3135c2c0 0x556a3135e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.420+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a3135ee50 con 0x556a3135c2c0 2024-04-23T18:31:17.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.420+0000 7fae23fff640 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556a3135c2c0 0x556a3135e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.420+0000 7fae23fff640 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556a3135c2c0 0x556a3135e780 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.421+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.421+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a3135ee50 con 0x556a31357910 2024-04-23T18:31:17.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.421+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae1c095070 con 0x556a31357910 2024-04-23T18:31:17.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.421+0000 7fae2bc12640 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fae1c088030 0x7fae1c098440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.421+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a3135ee50 con 0x7fae1c088030 2024-04-23T18:31:17.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.421+0000 7fae2c413640 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fae1c088030 0x7fae1c098440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.421+0000 7fae2c413640 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fae1c088030 0x7fae1c098440 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.422+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2400a4a0 con 0x7fae1c088030 2024-04-23T18:31:17.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.422+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31352f50 2024-04-23T18:31:17.434 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.422+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a31352f50 2024-04-23T18:31:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.422+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31352f50 2024-04-23T18:31:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.422+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a31352f50 2024-04-23T18:31:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.422+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x7fae1c088030 2024-04-23T18:31:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.422+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2400a4a0 con 0x7fae1c088030 2024-04-23T18:31:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.422+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x7fae1c088030 2024-04-23T18:31:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.423+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fae2400a4a0 con 0x7fae1c088030 2024-04-23T18:31:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.423+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31357910 2024-04-23T18:31:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.423+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae1c095070 con 0x556a31357910 2024-04-23T18:31:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.423+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a3135c2c0 2024-04-23T18:31:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.423+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.423+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31352f50 2024-04-23T18:31:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.423+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a31352f50 2024-04-23T18:31:17.435 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.423+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x7fae1c088030 2024-04-23T18:31:17.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.424+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2400a4a0 con 0x7fae1c088030 2024-04-23T18:31:17.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.424+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31352f50 2024-04-23T18:31:17.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.424+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a31352f50 2024-04-23T18:31:17.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.424+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31357910 2024-04-23T18:31:17.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.424+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fae1c095070 con 0x556a31357910 2024-04-23T18:31:17.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.424+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a3135c2c0 2024-04-23T18:31:17.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.424+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.424+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a3135c2c0 2024-04-23T18:31:17.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.424+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.424+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x7fae1c088030 2024-04-23T18:31:17.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.425+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2400a4a0 con 0x7fae1c088030 2024-04-23T18:31:17.436 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.425+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a3135c2c0 2024-04-23T18:31:17.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.425+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.425+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a3135c2c0 2024-04-23T18:31:17.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.425+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.425+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31352f50 2024-04-23T18:31:17.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.425+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a31352f50 2024-04-23T18:31:17.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.425+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31352f50 2024-04-23T18:31:17.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.426+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a31352f50 2024-04-23T18:31:17.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.426+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x7fae1c088030 2024-04-23T18:31:17.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.426+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2400a4a0 con 0x7fae1c088030 2024-04-23T18:31:17.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.426+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a3135c2c0 2024-04-23T18:31:17.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.426+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.426+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31357910 2024-04-23T18:31:17.437 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.426+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fae1c095070 con 0x556a31357910 2024-04-23T18:31:17.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.426+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31352f50 2024-04-23T18:31:17.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.427+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2400a4a0 con 0x556a31352f50 2024-04-23T18:31:17.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.427+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31357910 2024-04-23T18:31:17.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.427+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae1c095070 con 0x556a31357910 2024-04-23T18:31:17.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.427+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a3135c2c0 2024-04-23T18:31:17.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.427+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.427+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x7fae1c088030 2024-04-23T18:31:17.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.427+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2400a4a0 con 0x7fae1c088030 2024-04-23T18:31:17.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.427+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31357910 2024-04-23T18:31:17.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.428+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae1c0cf040 con 0x556a31357910 2024-04-23T18:31:17.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.428+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a3135c2c0 2024-04-23T18:31:17.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.428+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.438 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.428+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x7fae1c088030 2024-04-23T18:31:17.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.428+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae2400a4a0 con 0x7fae1c088030 2024-04-23T18:31:17.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.428+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31352f50 2024-04-23T18:31:17.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.428+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fae24040080 con 0x556a31352f50 2024-04-23T18:31:17.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.428+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556a31356bb0 con 0x556a31357910 2024-04-23T18:31:17.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae1c0cf040 con 0x556a31357910 2024-04-23T18:31:17.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:17.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:17.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:17.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:17.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:17.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:17.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.439 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a3135abc0 con 0x556a31352f50 2024-04-23T18:31:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae24040080 con 0x556a31352f50 2024-04-23T18:31:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a3135afb0 con 0x556a31352f50 2024-04-23T18:31:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae24040080 con 0x556a31352f50 2024-04-23T18:31:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.429+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a3135afb0 con 0x7fae1c088030 2024-04-23T18:31:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fae24040080 con 0x7fae1c088030 2024-04-23T18:31:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 20 zone default found 2024-04-23T18:31:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 4 Realm: () 2024-04-23T18:31:17.440 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:17.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:17.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:17.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 20 zonegroup default 2024-04-23T18:31:17.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a3135b3d0 con 0x556a31357910 2024-04-23T18:31:17.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fae1c0cf040 con 0x556a31357910 2024-04-23T18:31:17.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a3135b3d0 con 0x556a3135c2c0 2024-04-23T18:31:17.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.441 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a31360cb0 con 0x556a3135c2c0 2024-04-23T18:31:17.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 20 started sync module instance, tier type = 2024-04-23T18:31:17.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:17.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.430+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31360150 con 0x556a31357910 2024-04-23T18:31:17.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.431+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae1c0cf040 con 0x556a31357910 2024-04-23T18:31:17.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.431+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93914580518512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31360150 con 0x556a31357910 2024-04-23T18:31:17.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.431+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a313616f0 con 0x556a31352f50 2024-04-23T18:31:17.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.432+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93914580518512] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae1c0cf040 con 0x556a31357910 2024-04-23T18:31:17.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.433+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x556a31352f50 2024-04-23T18:31:17.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.433+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93914580521408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31360150 con 0x556a31352f50 2024-04-23T18:31:17.442 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.433+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a313621a0 con 0x556a3135c2c0 2024-04-23T18:31:17.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.434+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93914580521408] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x556a31352f50 2024-04-23T18:31:17.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.434+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.434+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93914580516000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31362540 con 0x556a3135c2c0 2024-04-23T18:31:17.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.434+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31362fc0 con 0x556a31357910 2024-04-23T18:31:17.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.435+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93914580516000] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.435+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae1c0cf040 con 0x556a31357910 2024-04-23T18:31:17.452 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.435+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93914580527792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a313633e0 con 0x556a31357910 2024-04-23T18:31:17.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.435+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31363e00 con 0x556a31352f50 2024-04-23T18:31:17.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.436+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93914580527792] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae1c0cf040 con 0x556a31357910 2024-04-23T18:31:17.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.436+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x556a31352f50 2024-04-23T18:31:17.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.436+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93914580531440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31363dc0 con 0x556a31352f50 2024-04-23T18:31:17.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.436+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31364810 con 0x7fae1c088030 2024-04-23T18:31:17.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.437+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x7fae1c088030 2024-04-23T18:31:17.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.437+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93914580534112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31364780 con 0x7fae1c088030 2024-04-23T18:31:17.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.437+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31365790 con 0x7fae1c088030 2024-04-23T18:31:17.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.437+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93914580531440] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x556a31352f50 2024-04-23T18:31:17.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.438+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93914580534112] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x7fae1c088030 2024-04-23T18:31:17.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.438+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x7fae1c088030 2024-04-23T18:31:17.453 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.438+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93914580537984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31365750 con 0x7fae1c088030 2024-04-23T18:31:17.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.438+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31365bf0 con 0x7fae1c088030 2024-04-23T18:31:17.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.439+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93914580537984] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x7fae1c088030 2024-04-23T18:31:17.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.439+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x7fae1c088030 2024-04-23T18:31:17.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.440+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93914580524208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31365bb0 con 0x7fae1c088030 2024-04-23T18:31:17.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.440+0000 7fae2e10c800 20 add_watcher() i=0 2024-04-23T18:31:17.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.440+0000 7fae2e10c800 20 add_watcher() i=1 2024-04-23T18:31:17.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.440+0000 7fae2e10c800 20 add_watcher() i=2 2024-04-23T18:31:17.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.440+0000 7fae2e10c800 20 add_watcher() i=3 2024-04-23T18:31:17.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.440+0000 7fae2e10c800 20 add_watcher() i=4 2024-04-23T18:31:17.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.440+0000 7fae2e10c800 20 add_watcher() i=5 2024-04-23T18:31:17.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.440+0000 7fae2e10c800 20 add_watcher() i=6 2024-04-23T18:31:17.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.440+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93914580524208] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x7fae1c088030 2024-04-23T18:31:17.454 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.440+0000 7fae2e10c800 20 add_watcher() i=7 2024-04-23T18:31:17.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.440+0000 7fae2e10c800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:17.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.440+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a31369010 con 0x556a31352f50 2024-04-23T18:31:17.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.441+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fae24040080 con 0x556a31352f50 2024-04-23T18:31:17.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.441+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93914580536240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a313664d0 con 0x556a31352f50 2024-04-23T18:31:17.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.442+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93914580536240] v34'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae24040080 con 0x556a31352f50 2024-04-23T18:31:17.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.442+0000 7face1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:17.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.442+0000 7fae2e10c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:17.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.442+0000 7fae2e10c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:17.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.442+0000 7fae2e10c800 5 note: GC not initialized 2024-04-23T18:31:17.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.442+0000 7face0fe1640 20 reqs_thread_entry: start 2024-04-23T18:31:17.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.442+0000 7fae2e10c800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:17.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.442+0000 7fae2e10c800 20 Filter name: none 2024-04-23T18:31:17.455 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.442+0000 7fac5a7fc640 20 reqs_thread_entry: start 2024-04-23T18:31:17.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.442+0000 7fae2e10c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:17.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.442+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556a3139c3a0 con 0x556a31352f50 2024-04-23T18:31:17.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.443+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fae24040080 con 0x556a31352f50 2024-04-23T18:31:17.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.443+0000 7fae2e10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:17.456 INFO:teuthology.orchestra.run.smithi119.stderr:could not fetch user info: no user info saved 2024-04-23T18:31:17.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.443+0000 7face1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:17.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.443+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93914580536240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a3139c360 con 0x556a31352f50 2024-04-23T18:31:17.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.444+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93914580536240] v34'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae24040080 con 0x556a31352f50 2024-04-23T18:31:17.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.445+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93914580518512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a3139c360 con 0x556a31357910 2024-04-23T18:31:17.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.446+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93914580518512] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae1c0cf040 con 0x556a31357910 2024-04-23T18:31:17.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.446+0000 7fae2e10c800 20 remove_watcher() i=0 2024-04-23T18:31:17.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.446+0000 7fae2e10c800 2 removed watcher, disabling cache 2024-04-23T18:31:17.456 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.446+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93914580521408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a3139c360 con 0x556a31352f50 2024-04-23T18:31:17.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.447+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93914580521408] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x556a31352f50 2024-04-23T18:31:17.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.447+0000 7fae2e10c800 20 remove_watcher() i=1 2024-04-23T18:31:17.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.447+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93914580516000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a3139c360 con 0x556a3135c2c0 2024-04-23T18:31:17.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.448+0000 7fae23fff640 1 -- 172.21.15.119:0/4216445312 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93914580516000] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae14009050 con 0x556a3135c2c0 2024-04-23T18:31:17.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.448+0000 7fae2e10c800 20 remove_watcher() i=2 2024-04-23T18:31:17.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.448+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93914580527792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a3135fca0 con 0x556a31357910 2024-04-23T18:31:17.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.449+0000 7fae2bc12640 1 -- 172.21.15.119:0/4216445312 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93914580527792] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae1c0cf040 con 0x556a31357910 2024-04-23T18:31:17.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.449+0000 7fae2e10c800 20 remove_watcher() i=3 2024-04-23T18:31:17.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.449+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93914580531440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31362ab0 con 0x556a31352f50 2024-04-23T18:31:17.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.450+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93914580531440] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x556a31352f50 2024-04-23T18:31:17.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.450+0000 7fae2e10c800 20 remove_watcher() i=4 2024-04-23T18:31:17.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.450+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93914580534112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a3135fca0 con 0x7fae1c088030 2024-04-23T18:31:17.457 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.451+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93914580534112] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x7fae1c088030 2024-04-23T18:31:17.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.451+0000 7fae2e10c800 20 remove_watcher() i=5 2024-04-23T18:31:17.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.451+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93914580537984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a313638f0 con 0x7fae1c088030 2024-04-23T18:31:17.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.453+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93914580537984] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x7fae1c088030 2024-04-23T18:31:17.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.453+0000 7fae2e10c800 20 remove_watcher() i=6 2024-04-23T18:31:17.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.453+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93914580524208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556a31364360 con 0x7fae1c088030 2024-04-23T18:31:17.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.454+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93914580524208] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae24040080 con 0x7fae1c088030 2024-04-23T18:31:17.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.454+0000 7fae2e10c800 20 remove_watcher() i=7 2024-04-23T18:31:17.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fae1c088030 msgr2=0x7fae1c098440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fae1c088030 0x7fae1c098440 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556a31352f50 msgr2=0x556a31355410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556a31352f50 0x556a31355410 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.458 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556a31357910 msgr2=0x556a31359d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556a31357910 0x556a31359d00 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556a3135c2c0 msgr2=0x556a3135e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x556a3135c2c0 0x556a3135e780 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7facf4036e60 msgr2=0x7facf4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7facf4036e60 0x7facf4039320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fae14001b60 tx=0x7fae14010000 comp rx=0 tx=0).stop 2024-04-23T18:31:17.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 msgr2=0x556a31347a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2c413640 1 -- 172.21.15.119:0/4216445312 reap_dead start 2024-04-23T18:31:17.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 0x556a31347a10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0057d0 tx=0x7fae1c04fe80 comp rx=0 tx=0).stop 2024-04-23T18:31:17.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 shutdown_connections 2024-04-23T18:31:17.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 --2- 172.21.15.119:0/4216445312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a313405d0 0x556a31347a10 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 >> 172.21.15.119:0/4216445312 conn(0x556a3133c930 msgr2=0x556a31339f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 shutdown_connections 2024-04-23T18:31:17.459 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/4216445312 wait complete. 2024-04-23T18:31:17.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/1751941833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fad04036eb0 msgr2=0x7fad04039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 --2- 172.21.15.119:0/1751941833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fad04036eb0 0x7fad04039370 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fae1400bf50 tx=0x7fae1400f000 comp rx=0 tx=0).stop 2024-04-23T18:31:17.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/1751941833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31333500 msgr2=0x556a31333920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 --2- 172.21.15.119:0/1751941833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31333500 0x556a31333920 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fae1c067fd0 tx=0x7fae1c009970 comp rx=0 tx=0).stop 2024-04-23T18:31:17.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/1751941833 shutdown_connections 2024-04-23T18:31:17.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 --2- 172.21.15.119:0/1751941833 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fad04036eb0 0x7fad04039370 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 --2- 172.21.15.119:0/1751941833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31333500 0x556a31333920 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/1751941833 >> 172.21.15.119:0/1751941833 conn(0x556a313275a0 msgr2=0x556a313279a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/1751941833 shutdown_connections 2024-04-23T18:31:17.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.455+0000 7fae2e10c800 1 -- 172.21.15.119:0/1751941833 wait complete. 2024-04-23T18:31:17.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556a313224f0 msgr2=0x556a31324940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x556a313224f0 0x556a31324940 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.460 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556a312191f0 msgr2=0x556a3131bd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x556a312191f0 0x556a3131bd80 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556a3131e5b0 msgr2=0x556a313209a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x556a3131e5b0 0x556a313209a0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fad14036eb0 msgr2=0x7fad14039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fad14036eb0 0x7fad14039370 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fae14000f60 tx=0x7fae140012b0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 msgr2=0x556a31314d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 --2- 172.21.15.119:0/2357100962 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556a31218890 0x556a31314d10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fae1c005870 tx=0x7fae1c002fb0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2c413640 1 -- 172.21.15.119:0/2357100962 reap_dead start 2024-04-23T18:31:17.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 shutdown_connections 2024-04-23T18:31:17.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 >> 172.21.15.119:0/2357100962 conn(0x556a31214410 msgr2=0x556a3130be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 shutdown_connections 2024-04-23T18:31:17.461 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.456+0000 7fae2e10c800 1 -- 172.21.15.119:0/2357100962 wait complete. 2024-04-23T18:31:17.462 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T18:31:17.462 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-04-23T18:31:17.463 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-04-23T18:31:17.463 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-04-23T18:31:17.545 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:17.545 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:17.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.552+0000 7f8724813800 1 Processor -- start 2024-04-23T18:31:17.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.552+0000 7f8724813800 1 -- start start 2024-04-23T18:31:17.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.552+0000 7f8724813800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e05cd5e4c0 0x55e05cd608b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.552+0000 7f8724813800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e05cc0a560 con 0x55e05cd5a080 2024-04-23T18:31:17.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.552+0000 7f8724813800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55e05cbfbe20 con 0x55e05cd5e4c0 2024-04-23T18:31:17.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.553+0000 7f8717627640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e05cd5e4c0 0x55e05cd608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.553+0000 7f8717627640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e05cd5e4c0 0x55e05cd608b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54566/0 (socket says 172.21.15.119:54566) 2024-04-23T18:31:17.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.553+0000 7f8717627640 1 -- 172.21.15.119:0/1826423756 learned_addr learned my addr 172.21.15.119:0/1826423756 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.553+0000 7f871fe28640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55e05cd5a080 0x55e05cd5a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50498/0 (socket says 172.21.15.119:50498) 2024-04-23T18:31:17.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.553+0000 7f8717627640 1 -- 172.21.15.119:0/1826423756 >> v1:172.21.15.62:6789/0 conn(0x55e05cd5a080 legacy=0x55e05cd5a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.553+0000 7f8717627640 1 -- 172.21.15.119:0/1826423756 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05cc09e60 con 0x55e05cd5e4c0 2024-04-23T18:31:17.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.555+0000 7f8717627640 1 --2- 172.21.15.119:0/1826423756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5e4c0 0x55e05cd608b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f870800a520 tx=0x7f870801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d32fab227063f1d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.555+0000 7f871f627640 1 -- 172.21.15.119:0/1826423756 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8708057070 con 0x55e05cd5e4c0 2024-04-23T18:31:17.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.555+0000 7f871f627640 1 -- 172.21.15.119:0/1826423756 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8708052570 con 0x55e05cd5e4c0 2024-04-23T18:31:17.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.555+0000 7f871f627640 1 -- 172.21.15.119:0/1826423756 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f870804ae60 con 0x55e05cd5e4c0 2024-04-23T18:31:17.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.555+0000 7f8724813800 1 -- 172.21.15.119:0/1826423756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5e4c0 msgr2=0x55e05cd608b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.555+0000 7f8724813800 1 --2- 172.21.15.119:0/1826423756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5e4c0 0x55e05cd608b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f870800a520 tx=0x7f870801d010 comp rx=0 tx=0).stop 2024-04-23T18:31:17.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.556+0000 7f8724813800 1 -- 172.21.15.119:0/1826423756 shutdown_connections 2024-04-23T18:31:17.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.556+0000 7f8724813800 1 --2- 172.21.15.119:0/1826423756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5e4c0 0x55e05cd608b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.556+0000 7f8724813800 1 -- 172.21.15.119:0/1826423756 >> 172.21.15.119:0/1826423756 conn(0x55e05cd55700 msgr2=0x55e05cd57b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.556+0000 7f8724813800 1 -- 172.21.15.119:0/1826423756 shutdown_connections 2024-04-23T18:31:17.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.556+0000 7f8724813800 1 -- 172.21.15.119:0/1826423756 wait complete. 2024-04-23T18:31:17.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.567+0000 7f8724813800 1 Processor -- start 2024-04-23T18:31:17.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.567+0000 7f8724813800 1 -- start start 2024-04-23T18:31:17.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.567+0000 7f8724813800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 0x55e05ce4b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.567+0000 7f8724813800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e05cca55b0 con 0x55e05cd5a080 2024-04-23T18:31:17.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.568+0000 7f871fe28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 0x55e05ce4b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.568+0000 7f871fe28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 0x55e05ce4b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54568/0 (socket says 172.21.15.119:54568) 2024-04-23T18:31:17.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.568+0000 7f871fe28640 1 -- 172.21.15.119:0/227272724 learned_addr learned my addr 172.21.15.119:0/227272724 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.568+0000 7f871fe28640 1 -- 172.21.15.119:0/227272724 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05cc1b860 con 0x55e05cd5a080 2024-04-23T18:31:17.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.568+0000 7f871fe28640 1 --2- 172.21.15.119:0/227272724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 0x55e05ce4b200 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8710001e40 tx=0x7f8710001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b9e7c7155ba0a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.568+0000 7f860de0b640 1 -- 172.21.15.119:0/227272724 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871000e5c0 con 0x55e05cd5a080 2024-04-23T18:31:17.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.568+0000 7f860de0b640 1 -- 172.21.15.119:0/227272724 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8710006070 con 0x55e05cd5a080 2024-04-23T18:31:17.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.568+0000 7f860de0b640 1 -- 172.21.15.119:0/227272724 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871000e910 con 0x55e05cd5a080 2024-04-23T18:31:17.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.569+0000 7f8724813800 1 -- 172.21.15.119:0/227272724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 msgr2=0x55e05ce4b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.569+0000 7f8724813800 1 --2- 172.21.15.119:0/227272724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 0x55e05ce4b200 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8710001e40 tx=0x7f8710001e70 comp rx=0 tx=0).stop 2024-04-23T18:31:17.568 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.569+0000 7f8724813800 1 -- 172.21.15.119:0/227272724 shutdown_connections 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.569+0000 7f8724813800 1 --2- 172.21.15.119:0/227272724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 0x55e05ce4b200 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.569+0000 7f8724813800 1 -- 172.21.15.119:0/227272724 >> 172.21.15.119:0/227272724 conn(0x55e05cd55700 msgr2=0x55e05ce46b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.569+0000 7f8724813800 1 -- 172.21.15.119:0/227272724 shutdown_connections 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.569+0000 7f8724813800 1 -- 172.21.15.119:0/227272724 wait complete. 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.569+0000 7f8724813800 1 Processor -- start 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.569+0000 7f8724813800 1 -- start start 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.570+0000 7f8724813800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 0x55e05ce52b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.570+0000 7f8724813800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e05cd61180 con 0x55e05cd5a080 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.570+0000 7f871fe28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 0x55e05ce52b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.570+0000 7f871fe28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 0x55e05ce52b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54580/0 (socket says 172.21.15.119:54580) 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.570+0000 7f871fe28640 1 -- 172.21.15.119:0/2289510165 learned_addr learned my addr 172.21.15.119:0/2289510165 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.570+0000 7f871fe28640 1 -- 172.21.15.119:0/2289510165 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05cc19eb0 con 0x55e05cd5a080 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.570+0000 7f871fe28640 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 0x55e05ce52b90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8710000f60 tx=0x7f8710000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.569 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.570+0000 7f8607fff640 1 -- 172.21.15.119:0/2289510165 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871000f8d0 con 0x55e05cd5a080 2024-04-23T18:31:17.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.570+0000 7f8607fff640 1 -- 172.21.15.119:0/2289510165 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871000fa70 con 0x55e05cd5a080 2024-04-23T18:31:17.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.570+0000 7f8724813800 1 -- 172.21.15.119:0/2289510165 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e05ce530d0 con 0x55e05cd5a080 2024-04-23T18:31:17.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.570+0000 7f8607fff640 1 -- 172.21.15.119:0/2289510165 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871000fd90 con 0x55e05cd5a080 2024-04-23T18:31:17.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.570+0000 7f8724813800 1 -- 172.21.15.119:0/2289510165 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e05ce535f0 con 0x55e05cd5a080 2024-04-23T18:31:17.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.571+0000 7f8724813800 1 Processor -- start 2024-04-23T18:31:17.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.571+0000 7f8724813800 1 -- start start 2024-04-23T18:31:17.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.571+0000 7f8607fff640 1 -- 172.21.15.119:0/2289510165 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8710017070 con 0x55e05cd5a080 2024-04-23T18:31:17.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.571+0000 7f8724813800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 0x55e05ce60690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.571+0000 7f8724813800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e05cc4bdf0 con 0x55e05ce60270 2024-04-23T18:31:17.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.571+0000 7f8607fff640 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8608036e10 0x7f86080392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.571+0000 7f8607fff640 1 -- 172.21.15.119:0/2289510165 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f8710015020 con 0x55e05cd5a080 2024-04-23T18:31:17.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.571+0000 7f8720629640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 0x55e05ce60690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.570 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.571+0000 7f8720629640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 0x55e05ce60690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54592/0 (socket says 172.21.15.119:54592) 2024-04-23T18:31:17.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.571+0000 7f8720629640 1 -- 172.21.15.119:0/2224423725 learned_addr learned my addr 172.21.15.119:0/2224423725 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.572+0000 7f871fe28640 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8608036e10 0x7f86080392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.572+0000 7f8720629640 1 -- 172.21.15.119:0/2224423725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05ce60bd0 con 0x55e05ce60270 2024-04-23T18:31:17.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.572+0000 7f871fe28640 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8608036e10 0x7f86080392d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f87100178f0 tx=0x7f8710009f70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.572+0000 7f8720629640 1 --2- 172.21.15.119:0/2224423725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 0x55e05ce60690 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f871800a430 tx=0x7f871800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d68bb80383964e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.572+0000 7f8605ffb640 1 -- 172.21.15.119:0/2224423725 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8718015070 con 0x55e05ce60270 2024-04-23T18:31:17.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.572+0000 7f8605ffb640 1 -- 172.21.15.119:0/2224423725 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8718001670 con 0x55e05ce60270 2024-04-23T18:31:17.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.572+0000 7f8605ffb640 1 -- 172.21.15.119:0/2224423725 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8718001990 con 0x55e05ce60270 2024-04-23T18:31:17.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8724813800 1 -- 172.21.15.119:0/2224423725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 msgr2=0x55e05ce60690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8724813800 1 --2- 172.21.15.119:0/2224423725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 0x55e05ce60690 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f871800a430 tx=0x7f871800a8f0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8724813800 1 -- 172.21.15.119:0/2224423725 shutdown_connections 2024-04-23T18:31:17.571 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8724813800 1 --2- 172.21.15.119:0/2224423725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 0x55e05ce60690 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8724813800 1 -- 172.21.15.119:0/2224423725 >> 172.21.15.119:0/2224423725 conn(0x55e05cd5e4c0 msgr2=0x55e05ce5cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8724813800 1 -- 172.21.15.119:0/2224423725 shutdown_connections 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8724813800 1 -- 172.21.15.119:0/2224423725 wait complete. 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8724813800 1 Processor -- start 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8724813800 1 -- start start 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8724813800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 0x55e05ce67700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8724813800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e05ce61560 con 0x55e05ce60270 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8720629640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 0x55e05ce67700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8720629640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 0x55e05ce67700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54600/0 (socket says 172.21.15.119:54600) 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.573+0000 7f8720629640 1 -- 172.21.15.119:0/1918280688 learned_addr learned my addr 172.21.15.119:0/1918280688 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.574+0000 7f8720629640 1 -- 172.21.15.119:0/1918280688 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05ce67c40 con 0x55e05ce60270 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.574+0000 7f8720629640 1 --2- 172.21.15.119:0/1918280688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 0x55e05ce67700 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8718013040 tx=0x7f8718003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.574+0000 7f85fffff640 1 -- 172.21.15.119:0/1918280688 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8718020020 con 0x55e05ce60270 2024-04-23T18:31:17.572 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.574+0000 7f85fffff640 1 -- 172.21.15.119:0/1918280688 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87180108e0 con 0x55e05ce60270 2024-04-23T18:31:17.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.574+0000 7f8724813800 1 -- 172.21.15.119:0/1918280688 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e05ce67ed0 con 0x55e05ce60270 2024-04-23T18:31:17.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.574+0000 7f85fffff640 1 -- 172.21.15.119:0/1918280688 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8718015040 con 0x55e05ce60270 2024-04-23T18:31:17.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.574+0000 7f8724813800 1 -- 172.21.15.119:0/1918280688 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e05ce6ab80 con 0x55e05ce60270 2024-04-23T18:31:17.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.575+0000 7f85fffff640 1 -- 172.21.15.119:0/1918280688 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8718023020 con 0x55e05ce60270 2024-04-23T18:31:17.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.575+0000 7f85fffff640 1 --2- 172.21.15.119:0/1918280688 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f85f8036e60 0x7f85f8039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.575+0000 7f85fffff640 1 -- 172.21.15.119:0/1918280688 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f871804c880 con 0x55e05ce60270 2024-04-23T18:31:17.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.575+0000 7f8717627640 1 --2- 172.21.15.119:0/1918280688 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f85f8036e60 0x7f85f8039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.575+0000 7f8724813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:17.573 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.575+0000 7f8724813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:17.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.575+0000 7f8724813800 1 Processor -- start 2024-04-23T18:31:17.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.576+0000 7f8717627640 1 --2- 172.21.15.119:0/1918280688 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f85f8036e60 0x7f85f8039320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8708054000 tx=0x7f870804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.576+0000 7f8724813800 1 -- start start 2024-04-23T18:31:17.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.576+0000 7f8724813800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce81e10 0x55e05ce82230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.576+0000 7f8724813800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e05ce4b980 con 0x55e05ce81e10 2024-04-23T18:31:17.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.576+0000 7f871fe28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce81e10 0x55e05ce82230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.576+0000 7f871fe28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce81e10 0x55e05ce82230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54604/0 (socket says 172.21.15.119:54604) 2024-04-23T18:31:17.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.576+0000 7f871fe28640 1 -- 172.21.15.119:0/3352532689 learned_addr learned my addr 172.21.15.119:0/3352532689 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.576+0000 7f871fe28640 1 -- 172.21.15.119:0/3352532689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e05ce82770 con 0x55e05ce81e10 2024-04-23T18:31:17.579 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.576+0000 7f871fe28640 1 --2- 172.21.15.119:0/3352532689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce81e10 0x55e05ce82230 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f871004bb70 tx=0x7f8710019b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.576+0000 7f858ffff640 1 -- 172.21.15.119:0/3352532689 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8710043020 con 0x55e05ce81e10 2024-04-23T18:31:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.576+0000 7f858ffff640 1 -- 172.21.15.119:0/3352532689 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8710022e40 con 0x55e05ce81e10 2024-04-23T18:31:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.576+0000 7f8724813800 1 -- 172.21.15.119:0/3352532689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e05ce831e0 con 0x55e05ce81e10 2024-04-23T18:31:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.576+0000 7f858ffff640 1 -- 172.21.15.119:0/3352532689 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8710022230 con 0x55e05ce81e10 2024-04-23T18:31:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.577+0000 7f8724813800 1 -- 172.21.15.119:0/3352532689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e05ce836e0 con 0x55e05ce81e10 2024-04-23T18:31:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.577+0000 7f858ffff640 1 -- 172.21.15.119:0/3352532689 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f8710046020 con 0x55e05ce81e10 2024-04-23T18:31:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.577+0000 7f858ffff640 1 --2- 172.21.15.119:0/3352532689 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8558036e10 0x7f85580392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.577+0000 7f858ffff640 1 -- 172.21.15.119:0/3352532689 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f8710038040 con 0x55e05ce81e10 2024-04-23T18:31:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.577+0000 7f8717627640 1 --2- 172.21.15.119:0/3352532689 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8558036e10 0x7f85580392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.578+0000 7f858dffb640 20 reqs_thread_entry: start 2024-04-23T18:31:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.578+0000 7f8724813800 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e05ce8f860 0x55e05ce91cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.578+0000 7f8724813800 1 -- 172.21.15.119:0/2289510165 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e05ce92380 con 0x55e05ce8f860 2024-04-23T18:31:17.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.578+0000 7f8717627640 1 --2- 172.21.15.119:0/3352532689 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8558036e10 0x7f85580392d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8708000c00 tx=0x7f8708005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.578+0000 7f8720629640 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e05ce8f860 0x55e05ce91cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.578+0000 7f8720629640 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e05ce8f860 0x55e05ce91cb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.578+0000 7f8720629640 1 -- 172.21.15.119:0/2289510165 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f871800e070 con 0x55e05ce8f860 2024-04-23T18:31:17.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.578+0000 7f8724813800 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e05ce941a0 0x55e05ce96590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.578+0000 7f8724813800 1 -- 172.21.15.119:0/2289510165 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:2 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e05ce96c60 con 0x55e05ce941a0 2024-04-23T18:31:17.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.579+0000 7f871fe28640 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e05ce941a0 0x55e05ce96590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.579+0000 7f871fe28640 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e05ce941a0 0x55e05ce96590 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.579+0000 7f871fe28640 1 -- 172.21.15.119:0/2289510165 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(2 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8710055040 con 0x55e05ce941a0 2024-04-23T18:31:17.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 -- 172.21.15.119:0/1918280688 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f85f8036e60 msgr2=0x7f85f8039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 --2- 172.21.15.119:0/1918280688 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f85f8036e60 0x7f85f8039320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8708054000 tx=0x7f870804e000 comp rx=0 tx=0).stop 2024-04-23T18:31:17.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 -- 172.21.15.119:0/1918280688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 msgr2=0x55e05ce67700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 --2- 172.21.15.119:0/1918280688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 0x55e05ce67700 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8718013040 tx=0x7f8718003370 comp rx=0 tx=0).stop 2024-04-23T18:31:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 -- 172.21.15.119:0/1918280688 shutdown_connections 2024-04-23T18:31:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 --2- 172.21.15.119:0/1918280688 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f85f8036e60 0x7f85f8039320 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 --2- 172.21.15.119:0/1918280688 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce60270 0x55e05ce67700 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 -- 172.21.15.119:0/1918280688 >> 172.21.15.119:0/1918280688 conn(0x55e05cd5e4c0 msgr2=0x55e05ce5a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 -- 172.21.15.119:0/1918280688 shutdown_connections 2024-04-23T18:31:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 -- 172.21.15.119:0/1918280688 wait complete. 2024-04-23T18:31:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 -- 172.21.15.119:0/3352532689 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8558036e10 msgr2=0x7f85580392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 --2- 172.21.15.119:0/3352532689 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8558036e10 0x7f85580392d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8708000c00 tx=0x7f8708005ac0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 -- 172.21.15.119:0/3352532689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce81e10 msgr2=0x55e05ce82230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 --2- 172.21.15.119:0/3352532689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce81e10 0x55e05ce82230 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f871004bb70 tx=0x7f8710019b40 comp rx=0 tx=0).stop 2024-04-23T18:31:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 -- 172.21.15.119:0/3352532689 shutdown_connections 2024-04-23T18:31:17.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 --2- 172.21.15.119:0/3352532689 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8558036e10 0x7f85580392d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 --2- 172.21.15.119:0/3352532689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05ce81e10 0x55e05ce82230 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 -- 172.21.15.119:0/3352532689 >> 172.21.15.119:0/3352532689 conn(0x55e05ce768c0 msgr2=0x55e05ce772e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 -- 172.21.15.119:0/3352532689 shutdown_connections 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 -- 172.21.15.119:0/3352532689 wait complete. 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 -- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e05ce8f860 msgr2=0x55e05ce91cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.580+0000 7f8724813800 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e05ce8f860 0x55e05ce91cb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 -- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e05ce941a0 msgr2=0x55e05ce96590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e05ce941a0 0x55e05ce96590 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 -- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8608036e10 msgr2=0x7f86080392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8608036e10 0x7f86080392d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f87100178f0 tx=0x7f8710009f70 comp rx=0 tx=0).stop 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 -- 172.21.15.119:0/2289510165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 msgr2=0x55e05ce52b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 0x55e05ce52b90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8710000f60 tx=0x7f8710000bc0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 -- 172.21.15.119:0/2289510165 shutdown_connections 2024-04-23T18:31:17.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e05ce941a0 0x55e05ce96590 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e05ce8f860 0x55e05ce91cb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f8608036e10 0x7f86080392d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 --2- 172.21.15.119:0/2289510165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e05cd5a080 0x55e05ce52b90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 -- 172.21.15.119:0/2289510165 >> 172.21.15.119:0/2289510165 conn(0x55e05cd55700 msgr2=0x55e05ce45380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 -- 172.21.15.119:0/2289510165 shutdown_connections 2024-04-23T18:31:17.584 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.581+0000 7f8724813800 1 -- 172.21.15.119:0/2289510165 wait complete. 2024-04-23T18:31:17.585 INFO:teuthology.orchestra.run.smithi119.stdout:{"id":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-23T18:31:17.585 DEBUG:tasks.util.rgw: json result: {'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-23T18:31:17.585 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-04-23T18:31:17.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-04-23T18:31:17.586 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-04-23T18:31:17.666 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:17.666 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:17.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.673+0000 7ff0d8719800 1 Processor -- start 2024-04-23T18:31:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.673+0000 7ff0d8719800 1 -- start start 2024-04-23T18:31:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.674+0000 7ff0d8719800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d9b99253c0 0x55d9b992dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.674+0000 7ff0d8719800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d9b97d5560 con 0x55d9b9923880 2024-04-23T18:31:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.674+0000 7ff0d8719800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55d9b97c6e20 con 0x55d9b99253c0 2024-04-23T18:31:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.674+0000 7ff0d5a1e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d9b99253c0 0x55d9b992dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.674+0000 7ff0d5a1e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d9b99253c0 0x55d9b992dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54624/0 (socket says 172.21.15.119:54624) 2024-04-23T18:31:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.674+0000 7ff0d621f640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55d9b9923880 0x55d9b9923ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50502/0 (socket says 172.21.15.119:50502) 2024-04-23T18:31:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.674+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/1393165728 learned_addr learned my addr 172.21.15.119:0/1393165728 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.674+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/1393165728 >> v1:172.21.15.62:6789/0 conn(0x55d9b9923880 legacy=0x55d9b9923ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.674+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/1393165728 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b97d4e60 con 0x55d9b99253c0 2024-04-23T18:31:17.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.676+0000 7ff0d5a1e640 1 --2- 172.21.15.119:0/1393165728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b99253c0 0x55d9b992dec0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00a520 tx=0x7ff0cc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2955cc9edaba94c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.676+0000 7ff0d521d640 1 -- 172.21.15.119:0/1393165728 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0cc057070 con 0x55d9b99253c0 2024-04-23T18:31:17.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.676+0000 7ff0d521d640 1 -- 172.21.15.119:0/1393165728 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0cc052440 con 0x55d9b99253c0 2024-04-23T18:31:17.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.676+0000 7ff0d521d640 1 -- 172.21.15.119:0/1393165728 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0cc04ae60 con 0x55d9b99253c0 2024-04-23T18:31:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.677+0000 7ff0d8719800 1 -- 172.21.15.119:0/1393165728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b99253c0 msgr2=0x55d9b992dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.677+0000 7ff0d8719800 1 --2- 172.21.15.119:0/1393165728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b99253c0 0x55d9b992dec0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00a520 tx=0x7ff0cc01d010 comp rx=0 tx=0).stop 2024-04-23T18:31:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.677+0000 7ff0d8719800 1 -- 172.21.15.119:0/1393165728 shutdown_connections 2024-04-23T18:31:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.677+0000 7ff0d8719800 1 --2- 172.21.15.119:0/1393165728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b99253c0 0x55d9b992dec0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.677+0000 7ff0d8719800 1 -- 172.21.15.119:0/1393165728 >> 172.21.15.119:0/1393165728 conn(0x55d9b991f400 msgr2=0x55d9b9921820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.677+0000 7ff0d8719800 1 -- 172.21.15.119:0/1393165728 shutdown_connections 2024-04-23T18:31:17.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.677+0000 7ff0d8719800 1 -- 172.21.15.119:0/1393165728 wait complete. 2024-04-23T18:31:17.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.689+0000 7ff0d8719800 1 Processor -- start 2024-04-23T18:31:17.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.689+0000 7ff0d8719800 1 -- start start 2024-04-23T18:31:17.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.689+0000 7ff0d8719800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9923880 0x55d9b9a18560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.689+0000 7ff0d8719800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d9b98705a0 con 0x55d9b9923880 2024-04-23T18:31:17.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.689+0000 7ff0d621f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9923880 0x55d9b9a18560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.689+0000 7ff0d621f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9923880 0x55d9b9a18560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54636/0 (socket says 172.21.15.119:54636) 2024-04-23T18:31:17.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.689+0000 7ff0d621f640 1 -- 172.21.15.119:0/569743265 learned_addr learned my addr 172.21.15.119:0/569743265 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.689+0000 7ff0d621f640 1 -- 172.21.15.119:0/569743265 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b97e6860 con 0x55d9b9923880 2024-04-23T18:31:17.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.689+0000 7ff0d621f640 1 --2- 172.21.15.119:0/569743265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9923880 0x55d9b9a18560 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8001e10 tx=0x7ff0c800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e49093180d35a4d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.690+0000 7fefc4608640 1 -- 172.21.15.119:0/569743265 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c800e5c0 con 0x55d9b9923880 2024-04-23T18:31:17.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.690+0000 7fefc4608640 1 -- 172.21.15.119:0/569743265 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c8006070 con 0x55d9b9923880 2024-04-23T18:31:17.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.690+0000 7fefc4608640 1 -- 172.21.15.119:0/569743265 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c800e930 con 0x55d9b9923880 2024-04-23T18:31:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.690+0000 7ff0d8719800 1 -- 172.21.15.119:0/569743265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9923880 msgr2=0x55d9b9a18560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.690+0000 7ff0d8719800 1 --2- 172.21.15.119:0/569743265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9923880 0x55d9b9a18560 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8001e10 tx=0x7ff0c800b6c0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.690+0000 7ff0d8719800 1 -- 172.21.15.119:0/569743265 shutdown_connections 2024-04-23T18:31:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.690+0000 7ff0d8719800 1 --2- 172.21.15.119:0/569743265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9923880 0x55d9b9a18560 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.690+0000 7ff0d8719800 1 -- 172.21.15.119:0/569743265 >> 172.21.15.119:0/569743265 conn(0x55d9b991f400 msgr2=0x55d9b9a13e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.690+0000 7ff0d8719800 1 -- 172.21.15.119:0/569743265 shutdown_connections 2024-04-23T18:31:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.690+0000 7ff0d8719800 1 -- 172.21.15.119:0/569743265 wait complete. 2024-04-23T18:31:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.691+0000 7ff0d8719800 1 Processor -- start 2024-04-23T18:31:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.691+0000 7ff0d8719800 1 -- start start 2024-04-23T18:31:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.691+0000 7ff0d8719800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9923880 0x55d9b9a1ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.691+0000 7ff0d8719800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d9b99306e0 con 0x55d9b9923880 2024-04-23T18:31:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.691+0000 7ff0d621f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9923880 0x55d9b9a1ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.691+0000 7ff0d621f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9923880 0x55d9b9a1ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54652/0 (socket says 172.21.15.119:54652) 2024-04-23T18:31:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.691+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 learned_addr learned my addr 172.21.15.119:0/3833565971 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.691+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b97e4eb0 con 0x55d9b9923880 2024-04-23T18:31:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.691+0000 7ff0d621f640 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9923880 0x55d9b9a1ff30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800b700 tx=0x7ff0c8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.692+0000 7fefc2e05640 1 -- 172.21.15.119:0/3833565971 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c800f8d0 con 0x55d9b9923880 2024-04-23T18:31:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.692+0000 7fefc2e05640 1 -- 172.21.15.119:0/3833565971 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c800fa70 con 0x55d9b9923880 2024-04-23T18:31:17.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.692+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9b9a20470 con 0x55d9b9923880 2024-04-23T18:31:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.692+0000 7fefc2e05640 1 -- 172.21.15.119:0/3833565971 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c800fd50 con 0x55d9b9923880 2024-04-23T18:31:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.692+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b9a20990 con 0x55d9b9923880 2024-04-23T18:31:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.692+0000 7ff0d8719800 1 Processor -- start 2024-04-23T18:31:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.692+0000 7ff0d8719800 1 -- start start 2024-04-23T18:31:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.692+0000 7ff0d8719800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 0x55d9b9a2d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.692+0000 7ff0d8719800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9816df0 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.692+0000 7fefc2e05640 1 -- 172.21.15.119:0/3833565971 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff0c8017070 con 0x55d9b9923880 2024-04-23T18:31:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.693+0000 7ff0d6a20640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 0x55d9b9a2d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.693+0000 7fefc2e05640 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fefbc036e60 0x7fefbc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.693+0000 7ff0d6a20640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 0x55d9b9a2d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54654/0 (socket says 172.21.15.119:54654) 2024-04-23T18:31:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.693+0000 7ff0d6a20640 1 -- 172.21.15.119:0/2595595444 learned_addr learned my addr 172.21.15.119:0/2595595444 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.693+0000 7fefc2e05640 1 -- 172.21.15.119:0/3833565971 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7ff0c8015020 con 0x55d9b9923880 2024-04-23T18:31:17.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.693+0000 7ff0d621f640 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fefbc036e60 0x7fefbc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.693+0000 7ff0d6a20640 1 -- 172.21.15.119:0/2595595444 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b9a2df20 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.693+0000 7ff0d6a20640 1 --2- 172.21.15.119:0/2595595444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 0x55d9b9a2d9e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000a430 tx=0x7ff0d000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50506d45df2bc137 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.693+0000 7ff0d621f640 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fefbc036e60 0x7fefbc039320 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800ffd0 tx=0x7ff0c801bd60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.693+0000 7fefc0e01640 1 -- 172.21.15.119:0/2595595444 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0d0015070 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.693+0000 7fefc0e01640 1 -- 172.21.15.119:0/2595595444 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d0001670 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.693+0000 7fefc0e01640 1 -- 172.21.15.119:0/2595595444 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0d0001990 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d8719800 1 -- 172.21.15.119:0/2595595444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 msgr2=0x55d9b9a2d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d8719800 1 --2- 172.21.15.119:0/2595595444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 0x55d9b9a2d9e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000a430 tx=0x7ff0d000a8f0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d8719800 1 -- 172.21.15.119:0/2595595444 shutdown_connections 2024-04-23T18:31:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d8719800 1 --2- 172.21.15.119:0/2595595444 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 0x55d9b9a2d9e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d8719800 1 -- 172.21.15.119:0/2595595444 >> 172.21.15.119:0/2595595444 conn(0x55d9b99253c0 msgr2=0x55d9b9a2a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d8719800 1 -- 172.21.15.119:0/2595595444 shutdown_connections 2024-04-23T18:31:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d8719800 1 -- 172.21.15.119:0/2595595444 wait complete. 2024-04-23T18:31:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d8719800 1 Processor -- start 2024-04-23T18:31:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d8719800 1 -- start start 2024-04-23T18:31:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d8719800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 0x55d9b9a349e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d8719800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9a2e8b0 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d6a20640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 0x55d9b9a349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d6a20640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 0x55d9b9a349e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54664/0 (socket says 172.21.15.119:54664) 2024-04-23T18:31:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.694+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3140357829 learned_addr learned my addr 172.21.15.119:0/3140357829 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.695+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3140357829 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b9a34f20 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.695+0000 7ff0d6a20640 1 --2- 172.21.15.119:0/3140357829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 0x55d9b9a349e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0013040 tx=0x7ff0d0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.695+0000 7fefbaffd640 1 -- 172.21.15.119:0/3140357829 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0d0020020 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.695+0000 7fefbaffd640 1 -- 172.21.15.119:0/3140357829 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0d00108e0 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.695+0000 7ff0d8719800 1 -- 172.21.15.119:0/3140357829 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9b9a351b0 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.695+0000 7fefbaffd640 1 -- 172.21.15.119:0/3140357829 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0d0015040 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.695+0000 7ff0d8719800 1 -- 172.21.15.119:0/3140357829 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b9a37e60 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.696+0000 7fefbaffd640 1 -- 172.21.15.119:0/3140357829 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff0d0023020 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.696+0000 7fefbaffd640 1 --2- 172.21.15.119:0/3140357829 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fefb0036e60 0x7fefb0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.696+0000 7fefbaffd640 1 -- 172.21.15.119:0/3140357829 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7ff0d004c7c0 con 0x55d9b9a2d5c0 2024-04-23T18:31:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.696+0000 7ff0d8719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.696+0000 7ff0d8719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.696+0000 7ff0d5a1e640 1 --2- 172.21.15.119:0/3140357829 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fefb0036e60 0x7fefb0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.696+0000 7ff0d8719800 1 Processor -- start 2024-04-23T18:31:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7ff0d8719800 1 -- start start 2024-04-23T18:31:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7ff0d5a1e640 1 --2- 172.21.15.119:0/3140357829 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fefb0036e60 0x7fefb0039320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc054000 tx=0x7ff0cc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7ff0d8719800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a4f070 0x55d9b9a4f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7ff0d8719800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d9b9a18ce0 con 0x55d9b9a4f070 2024-04-23T18:31:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7ff0d621f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a4f070 0x55d9b9a4f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7ff0d621f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a4f070 0x55d9b9a4f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54676/0 (socket says 172.21.15.119:54676) 2024-04-23T18:31:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7ff0d621f640 1 -- 172.21.15.119:0/1980890667 learned_addr learned my addr 172.21.15.119:0/1980890667 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7ff0d621f640 1 -- 172.21.15.119:0/1980890667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b9a4f9d0 con 0x55d9b9a4f070 2024-04-23T18:31:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7ff0d621f640 1 --2- 172.21.15.119:0/1980890667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a4f070 0x55d9b9a4f490 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff0c801cfd0 tx=0x7ff0c804d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7fef9afe5640 1 -- 172.21.15.119:0/1980890667 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c8017540 con 0x55d9b9a4f070 2024-04-23T18:31:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7fef9afe5640 1 -- 172.21.15.119:0/1980890667 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c8019cb0 con 0x55d9b9a4f070 2024-04-23T18:31:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7ff0d8719800 1 -- 172.21.15.119:0/1980890667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9b9a50440 con 0x55d9b9a4f070 2024-04-23T18:31:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7fef9afe5640 1 -- 172.21.15.119:0/1980890667 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0c801d5f0 con 0x55d9b9a4f070 2024-04-23T18:31:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.697+0000 7ff0d8719800 1 -- 172.21.15.119:0/1980890667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b9a50940 con 0x55d9b9a4f070 2024-04-23T18:31:17.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.698+0000 7fef9afe5640 1 -- 172.21.15.119:0/1980890667 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff0c804db30 con 0x55d9b9a4f070 2024-04-23T18:31:17.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.698+0000 7fef9afe5640 1 --2- 172.21.15.119:0/1980890667 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fef18036e60 0x7fef18039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.698+0000 7fef9afe5640 1 -- 172.21.15.119:0/1980890667 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7ff0c8038070 con 0x55d9b9a4f070 2024-04-23T18:31:17.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.698+0000 7ff0d5a1e640 1 --2- 172.21.15.119:0/1980890667 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fef18036e60 0x7fef18039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.699+0000 7fef98fe1640 20 reqs_thread_entry: start 2024-04-23T18:31:17.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.699+0000 7ff0d8719800 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d9b9a5ca70 0x55d9b9a5eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.699+0000 7ff0d5a1e640 1 --2- 172.21.15.119:0/1980890667 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fef18036e60 0x7fef18039320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc000c00 tx=0x7ff0cc005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.699+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a5f540 con 0x55d9b9a5ca70 2024-04-23T18:31:17.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.699+0000 7ff0d6a20640 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d9b9a5ca70 0x55d9b9a5eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.699+0000 7ff0d6a20640 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d9b9a5ca70 0x55d9b9a5eec0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.699+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.699+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a5fe20 con 0x55d9b9a5ca70 2024-04-23T18:31:17.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.700+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.700+0000 7ff0d8719800 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d9b9a61730 0x55d9b9a63bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.700+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a64350 con 0x55d9b9a61730 2024-04-23T18:31:17.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.700+0000 7ff0d621f640 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d9b9a61730 0x55d9b9a63bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.700+0000 7ff0d621f640 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d9b9a61730 0x55d9b9a63bc0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.700+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0c8046020 con 0x55d9b9a61730 2024-04-23T18:31:17.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.701+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a71470 con 0x55d9b9a5ca70 2024-04-23T18:31:17.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.701+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.709 INFO:teuthology.orchestra.run.smithi119.stderr:NOTICE: set zone's realm_id= 2024-04-23T18:31:17.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.701+0000 7ff0d8719800 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d9b9a68830 0x55d9b9a6b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.701+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a68830 2024-04-23T18:31:17.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.701+0000 7ff0d5a1e640 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d9b9a68830 0x55d9b9a6b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.701+0000 7ff0d5a1e640 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d9b9a68830 0x55d9b9a6b760 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.702+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(5 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc066030 con 0x55d9b9a68830 2024-04-23T18:31:17.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.702+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a61730 2024-04-23T18:31:17.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.702+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c8046020 con 0x55d9b9a61730 2024-04-23T18:31:17.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.702+0000 7ff0d621f640 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ff0c8049020 0x7ff0c8031940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.702+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x7ff0c8049020 2024-04-23T18:31:17.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.702+0000 7ff0d6a20640 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ff0c8049020 0x7ff0c8031940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.702+0000 7ff0d6a20640 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ff0c8049020 0x7ff0c8031940 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.703+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d000e070 con 0x7ff0c8049020 2024-04-23T18:31:17.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.703+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a5ca70 2024-04-23T18:31:17.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.703+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.703+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a5ca70 2024-04-23T18:31:17.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.703+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.703+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x7ff0c8049020 2024-04-23T18:31:17.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.703+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d000e070 con 0x7ff0c8049020 2024-04-23T18:31:17.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.704+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x7ff0c8049020 2024-04-23T18:31:17.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.704+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff0d000e070 con 0x7ff0c8049020 2024-04-23T18:31:17.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.704+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a61730 2024-04-23T18:31:17.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.704+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c8046020 con 0x55d9b9a61730 2024-04-23T18:31:17.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.704+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a68830 2024-04-23T18:31:17.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.704+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc066030 con 0x55d9b9a68830 2024-04-23T18:31:17.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.704+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a5ca70 2024-04-23T18:31:17.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.704+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.704+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x7ff0c8049020 2024-04-23T18:31:17.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.705+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d000e070 con 0x7ff0c8049020 2024-04-23T18:31:17.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.705+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a5ca70 2024-04-23T18:31:17.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.705+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.705+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a61730 2024-04-23T18:31:17.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.705+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(17 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff0c8046020 con 0x55d9b9a61730 2024-04-23T18:31:17.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.705+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a68830 2024-04-23T18:31:17.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.706+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc066030 con 0x55d9b9a68830 2024-04-23T18:31:17.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.706+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a68830 2024-04-23T18:31:17.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.706+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc066030 con 0x55d9b9a68830 2024-04-23T18:31:17.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.706+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x7ff0c8049020 2024-04-23T18:31:17.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.706+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d000e070 con 0x7ff0c8049020 2024-04-23T18:31:17.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.706+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a68830 2024-04-23T18:31:17.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.706+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc066030 con 0x55d9b9a68830 2024-04-23T18:31:17.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.706+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a68830 2024-04-23T18:31:17.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.707+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc066030 con 0x55d9b9a68830 2024-04-23T18:31:17.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.707+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a5ca70 2024-04-23T18:31:17.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.707+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.707+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a5ca70 2024-04-23T18:31:17.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.707+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.707+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x7ff0c8049020 2024-04-23T18:31:17.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.708+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(25 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d000e070 con 0x7ff0c8049020 2024-04-23T18:31:17.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.708+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a68830 2024-04-23T18:31:17.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.708+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc066030 con 0x55d9b9a68830 2024-04-23T18:31:17.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.708+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a61730 2024-04-23T18:31:17.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.708+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff0c8046020 con 0x55d9b9a61730 2024-04-23T18:31:17.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.708+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a5ca70 2024-04-23T18:31:17.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.708+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.708+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a61730 2024-04-23T18:31:17.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.709+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c8046020 con 0x55d9b9a61730 2024-04-23T18:31:17.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.709+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a68830 2024-04-23T18:31:17.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.709+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc066030 con 0x55d9b9a68830 2024-04-23T18:31:17.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.709+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x7ff0c8049020 2024-04-23T18:31:17.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.709+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d000e070 con 0x7ff0c8049020 2024-04-23T18:31:17.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.709+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a61730 2024-04-23T18:31:17.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.709+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c8046020 con 0x55d9b9a61730 2024-04-23T18:31:17.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.709+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a68830 2024-04-23T18:31:17.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.710+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0cc066030 con 0x55d9b9a68830 2024-04-23T18:31:17.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.710+0000 7ff0d5a1e640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x7ff0c8049020 2024-04-23T18:31:17.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.710+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0d000e070 con 0x7ff0c8049020 2024-04-23T18:31:17.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.710+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a5ca70 2024-04-23T18:31:17.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.710+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(35 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.710+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6b2e0 con 0x55d9b9a61730 2024-04-23T18:31:17.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.711+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(36 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c8046020 con 0x55d9b9a61730 2024-04-23T18:31:17.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.711+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6f340 con 0x55d9b9a5ca70 2024-04-23T18:31:17.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.711+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.711+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:38 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6dcc0 con 0x55d9b9a61730 2024-04-23T18:31:17.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.711+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(38 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0c8046020 con 0x55d9b9a61730 2024-04-23T18:31:17.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.711+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:39 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6ab70 con 0x55d9b9a61730 2024-04-23T18:31:17.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.712+0000 7ff0d621f640 1 -- 172.21.15.119:0/3833565971 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(39 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [create,call,writefull 0~1155] v34'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7ff0c8046020 con 0x55d9b9a61730 2024-04-23T18:31:17.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.712+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6c910 con 0x55d9b9a5ca70 2024-04-23T18:31:17.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.714+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v34'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.714+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d9b9a6d190 con 0x55d9b9a5ca70 2024-04-23T18:31:17.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.715+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v34'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7ff0d000e070 con 0x55d9b9a5ca70 2024-04-23T18:31:17.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.715+0000 7ff0d8719800 1 -- 172.21.15.119:0/3140357829 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fefb0036e60 msgr2=0x7fefb0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.715+0000 7ff0d8719800 1 --2- 172.21.15.119:0/3140357829 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fefb0036e60 0x7fefb0039320 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc054000 tx=0x7ff0cc04e000 comp rx=0 tx=0).stop 2024-04-23T18:31:17.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.715+0000 7ff0d8719800 1 -- 172.21.15.119:0/3140357829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 msgr2=0x55d9b9a349e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.715+0000 7ff0d8719800 1 --2- 172.21.15.119:0/3140357829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 0x55d9b9a349e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0013040 tx=0x7ff0d0003370 comp rx=0 tx=0).stop 2024-04-23T18:31:17.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.715+0000 7ff0d8719800 1 -- 172.21.15.119:0/3140357829 shutdown_connections 2024-04-23T18:31:17.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.715+0000 7ff0d8719800 1 --2- 172.21.15.119:0/3140357829 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fefb0036e60 0x7fefb0039320 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.715+0000 7ff0d8719800 1 --2- 172.21.15.119:0/3140357829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a2d5c0 0x55d9b9a349e0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.715+0000 7ff0d8719800 1 -- 172.21.15.119:0/3140357829 >> 172.21.15.119:0/3140357829 conn(0x55d9b99253c0 msgr2=0x55d9b9a276a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/3140357829 shutdown_connections 2024-04-23T18:31:17.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/3140357829 wait complete. 2024-04-23T18:31:17.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/1980890667 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fef18036e60 msgr2=0x7fef18039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 --2- 172.21.15.119:0/1980890667 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fef18036e60 0x7fef18039320 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc000c00 tx=0x7ff0cc005ac0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/1980890667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a4f070 msgr2=0x55d9b9a4f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 --2- 172.21.15.119:0/1980890667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a4f070 0x55d9b9a4f490 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff0c801cfd0 tx=0x7ff0c804d420 comp rx=0 tx=0).stop 2024-04-23T18:31:17.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/1980890667 shutdown_connections 2024-04-23T18:31:17.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 --2- 172.21.15.119:0/1980890667 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fef18036e60 0x7fef18039320 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 --2- 172.21.15.119:0/1980890667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9a4f070 0x55d9b9a4f490 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/1980890667 >> 172.21.15.119:0/1980890667 conn(0x55d9b9a43b10 msgr2=0x55d9b9a44580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/1980890667 shutdown_connections 2024-04-23T18:31:17.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/1980890667 wait complete. 2024-04-23T18:31:17.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ff0c8049020 msgr2=0x7ff0c8031940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7ff0c8049020 0x7ff0c8031940 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d9b9a5ca70 msgr2=0x55d9b9a5eec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d9b9a5ca70 0x55d9b9a5eec0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d9b9a61730 msgr2=0x55d9b9a63bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d9b9a61730 0x55d9b9a63bc0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d9b9a68830 msgr2=0x55d9b9a6b760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d9b9a68830 0x55d9b9a6b760 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fefbc036e60 msgr2=0x7fefbc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fefbc036e60 0x7fefbc039320 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800ffd0 tx=0x7ff0c801bd60 comp rx=0 tx=0).stop 2024-04-23T18:31:17.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9923880 msgr2=0x55d9b9a1ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 --2- 172.21.15.119:0/3833565971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d9b9923880 0x55d9b9a1ff30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800b700 tx=0x7ff0c8000bc0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d6a20640 1 -- 172.21.15.119:0/3833565971 reap_dead start 2024-04-23T18:31:17.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 shutdown_connections 2024-04-23T18:31:17.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 >> 172.21.15.119:0/3833565971 conn(0x55d9b991f400 msgr2=0x55d9b9a16f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 shutdown_connections 2024-04-23T18:31:17.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.716+0000 7ff0d8719800 1 -- 172.21.15.119:0/3833565971 wait complete. 2024-04-23T18:31:17.722 INFO:teuthology.orchestra.run.smithi119.stdout:{"id":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-23T18:31:17.722 DEBUG:tasks.util.rgw: json result: {'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-23T18:31:17.722 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-04-23T18:31:17.722 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-04-23T18:31:17.723 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-04-23T18:31:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:17.803 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:17.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.810+0000 7f72a3946800 1 Processor -- start 2024-04-23T18:31:17.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.810+0000 7f72a3946800 1 -- start start 2024-04-23T18:31:17.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.810+0000 7f72a3946800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561861365580 0x561861367970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.804 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.810+0000 7f72a3946800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56186120f560 con 0x561861361140 2024-04-23T18:31:17.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.810+0000 7f72a3946800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x561861200e20 con 0x561861365580 2024-04-23T18:31:17.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.810+0000 7f7298c44640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561861365580 0x561861367970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.811+0000 7f72a1445640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x561861361140 0x561861361560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50518/0 (socket says 172.21.15.119:50518) 2024-04-23T18:31:17.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.811+0000 7f7298c44640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561861365580 0x561861367970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54690/0 (socket says 172.21.15.119:54690) 2024-04-23T18:31:17.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.811+0000 7f72a1445640 1 -- 172.21.15.119:0/850514756 learned_addr learned my addr 172.21.15.119:0/850514756 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:31:17.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.811+0000 7f7298c44640 1 -- 172.21.15.119:0/850514756 >> v1:172.21.15.62:6789/0 conn(0x561861361140 legacy=0x561861361560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.805 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.811+0000 7f7298c44640 1 -- 172.21.15.119:0/850514756 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56186120ee60 con 0x561861365580 2024-04-23T18:31:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.813+0000 7f7298c44640 1 --2- 172.21.15.119:0/850514756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861365580 0x561861367970 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f728c00a470 tx=0x7f728c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb759b1dde75bd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.813+0000 7f72a0c44640 1 -- 172.21.15.119:0/850514756 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c057070 con 0x561861365580 2024-04-23T18:31:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.813+0000 7f72a0c44640 1 -- 172.21.15.119:0/850514756 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c052570 con 0x561861365580 2024-04-23T18:31:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.813+0000 7f72a0c44640 1 -- 172.21.15.119:0/850514756 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c052870 con 0x561861365580 2024-04-23T18:31:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.813+0000 7f72a3946800 1 -- 172.21.15.119:0/850514756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861365580 msgr2=0x561861367970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.813+0000 7f72a3946800 1 --2- 172.21.15.119:0/850514756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861365580 0x561861367970 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f728c00a470 tx=0x7f728c01ce90 comp rx=0 tx=0).stop 2024-04-23T18:31:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.813+0000 7f72a3946800 1 -- 172.21.15.119:0/850514756 shutdown_connections 2024-04-23T18:31:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.813+0000 7f72a3946800 1 --2- 172.21.15.119:0/850514756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861365580 0x561861367970 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.813+0000 7f72a3946800 1 -- 172.21.15.119:0/850514756 >> 172.21.15.119:0/850514756 conn(0x56186135c800 msgr2=0x56186135ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.813+0000 7f72a3946800 1 -- 172.21.15.119:0/850514756 shutdown_connections 2024-04-23T18:31:17.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.813+0000 7f72a3946800 1 -- 172.21.15.119:0/850514756 wait complete. 2024-04-23T18:31:17.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.825+0000 7f72a3946800 1 Processor -- start 2024-04-23T18:31:17.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.825+0000 7f72a3946800 1 -- start start 2024-04-23T18:31:17.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.825+0000 7f72a3946800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 0x561861452330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.825+0000 7f72a3946800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5618612aa5a0 con 0x561861361140 2024-04-23T18:31:17.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.825+0000 7f72a1445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 0x561861452330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.826+0000 7f72a1445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 0x561861452330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54706/0 (socket says 172.21.15.119:54706) 2024-04-23T18:31:17.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.826+0000 7f72a1445640 1 -- 172.21.15.119:0/3565972960 learned_addr learned my addr 172.21.15.119:0/3565972960 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.826+0000 7f72a1445640 1 -- 172.21.15.119:0/3565972960 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561861220860 con 0x561861361140 2024-04-23T18:31:17.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.826+0000 7f72a1445640 1 --2- 172.21.15.119:0/3565972960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 0x561861452330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7294001d80 tx=0x7f7294001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf9b0a45b919b66 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.826+0000 7f718f606640 1 -- 172.21.15.119:0/3565972960 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7294013030 con 0x561861361140 2024-04-23T18:31:17.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.826+0000 7f718f606640 1 -- 172.21.15.119:0/3565972960 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f729400e470 con 0x561861361140 2024-04-23T18:31:17.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.826+0000 7f718f606640 1 -- 172.21.15.119:0/3565972960 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f729400e810 con 0x561861361140 2024-04-23T18:31:17.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.827+0000 7f72a3946800 1 -- 172.21.15.119:0/3565972960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 msgr2=0x561861452330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.827+0000 7f72a3946800 1 --2- 172.21.15.119:0/3565972960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 0x561861452330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7294001d80 tx=0x7f7294001e70 comp rx=0 tx=0).stop 2024-04-23T18:31:17.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.827+0000 7f72a3946800 1 -- 172.21.15.119:0/3565972960 shutdown_connections 2024-04-23T18:31:17.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.827+0000 7f72a3946800 1 --2- 172.21.15.119:0/3565972960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 0x561861452330 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.827+0000 7f72a3946800 1 -- 172.21.15.119:0/3565972960 >> 172.21.15.119:0/3565972960 conn(0x56186135c800 msgr2=0x56186144dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.827+0000 7f72a3946800 1 -- 172.21.15.119:0/3565972960 shutdown_connections 2024-04-23T18:31:17.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.827+0000 7f72a3946800 1 -- 172.21.15.119:0/3565972960 wait complete. 2024-04-23T18:31:17.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.827+0000 7f72a3946800 1 Processor -- start 2024-04-23T18:31:17.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.827+0000 7f72a3946800 1 -- start start 2024-04-23T18:31:17.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.827+0000 7f72a3946800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 0x561861459cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.827+0000 7f72a3946800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561861368240 con 0x561861361140 2024-04-23T18:31:17.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.828+0000 7f72a1445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 0x561861459cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.828+0000 7f72a1445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 0x561861459cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54712/0 (socket says 172.21.15.119:54712) 2024-04-23T18:31:17.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.828+0000 7f72a1445640 1 -- 172.21.15.119:0/4012284782 learned_addr learned my addr 172.21.15.119:0/4012284782 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.828+0000 7f72a1445640 1 -- 172.21.15.119:0/4012284782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56186121eeb0 con 0x561861361140 2024-04-23T18:31:17.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.828+0000 7f72a1445640 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 0x561861459cc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7294004000 tx=0x7f7294000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.828+0000 7f718de03640 1 -- 172.21.15.119:0/4012284782 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7294027070 con 0x561861361140 2024-04-23T18:31:17.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.828+0000 7f718de03640 1 -- 172.21.15.119:0/4012284782 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7294019900 con 0x561861361140 2024-04-23T18:31:17.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.828+0000 7f72a3946800 1 -- 172.21.15.119:0/4012284782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56186145a200 con 0x561861361140 2024-04-23T18:31:17.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.828+0000 7f718de03640 1 -- 172.21.15.119:0/4012284782 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7294019c60 con 0x561861361140 2024-04-23T18:31:17.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.828+0000 7f72a3946800 1 -- 172.21.15.119:0/4012284782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56186145a720 con 0x561861361140 2024-04-23T18:31:17.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.829+0000 7f72a3946800 1 Processor -- start 2024-04-23T18:31:17.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.829+0000 7f72a3946800 1 -- start start 2024-04-23T18:31:17.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.829+0000 7f72a3946800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 0x5618614677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.829+0000 7f718de03640 1 -- 172.21.15.119:0/4012284782 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f729402a070 con 0x561861361140 2024-04-23T18:31:17.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.829+0000 7f72a3946800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561861250df0 con 0x5618614673a0 2024-04-23T18:31:17.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.829+0000 7f718de03640 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7188036e60 0x7f7188039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.829+0000 7f72a1c46640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 0x5618614677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.829+0000 7f718de03640 1 -- 172.21.15.119:0/4012284782 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f729401f070 con 0x561861361140 2024-04-23T18:31:17.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.829+0000 7f72a1c46640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 0x5618614677c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54716/0 (socket says 172.21.15.119:54716) 2024-04-23T18:31:17.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.829+0000 7f72a1c46640 1 -- 172.21.15.119:0/755170140 learned_addr learned my addr 172.21.15.119:0/755170140 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.829+0000 7f72a1445640 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7188036e60 0x7f7188039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.829+0000 7f72a1c46640 1 -- 172.21.15.119:0/755170140 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561861467d00 con 0x5618614673a0 2024-04-23T18:31:17.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.830+0000 7f72a1445640 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7188036e60 0x7f7188039320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f729400efd0 tx=0x7f729400df30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.830+0000 7f72a1c46640 1 --2- 172.21.15.119:0/755170140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 0x5618614677c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f729c00a430 tx=0x7f729c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26d9fdf0c830ddb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.830+0000 7f71877fe640 1 -- 172.21.15.119:0/755170140 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f729c015070 con 0x5618614673a0 2024-04-23T18:31:17.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.830+0000 7f71877fe640 1 -- 172.21.15.119:0/755170140 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f729c001670 con 0x5618614673a0 2024-04-23T18:31:17.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.830+0000 7f71877fe640 1 -- 172.21.15.119:0/755170140 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f729c001990 con 0x5618614673a0 2024-04-23T18:31:17.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.830+0000 7f72a3946800 1 -- 172.21.15.119:0/755170140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 msgr2=0x5618614677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.830+0000 7f72a3946800 1 --2- 172.21.15.119:0/755170140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 0x5618614677c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f729c00a430 tx=0x7f729c00a8f0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.830+0000 7f72a3946800 1 -- 172.21.15.119:0/755170140 shutdown_connections 2024-04-23T18:31:17.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.830+0000 7f72a3946800 1 --2- 172.21.15.119:0/755170140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 0x5618614677c0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.830+0000 7f72a3946800 1 -- 172.21.15.119:0/755170140 >> 172.21.15.119:0/755170140 conn(0x561861365580 msgr2=0x561861463e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.830+0000 7f72a3946800 1 -- 172.21.15.119:0/755170140 shutdown_connections 2024-04-23T18:31:17.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.830+0000 7f72a3946800 1 -- 172.21.15.119:0/755170140 wait complete. 2024-04-23T18:31:17.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.831+0000 7f72a3946800 1 Processor -- start 2024-04-23T18:31:17.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.831+0000 7f72a3946800 1 -- start start 2024-04-23T18:31:17.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.831+0000 7f72a3946800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 0x56186146e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.831+0000 7f72a3946800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561861468690 con 0x5618614673a0 2024-04-23T18:31:17.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.831+0000 7f72a1c46640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 0x56186146e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.831+0000 7f72a1c46640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 0x56186146e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54720/0 (socket says 172.21.15.119:54720) 2024-04-23T18:31:17.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.831+0000 7f72a1c46640 1 -- 172.21.15.119:0/1460186628 learned_addr learned my addr 172.21.15.119:0/1460186628 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.831+0000 7f72a1c46640 1 -- 172.21.15.119:0/1460186628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56186146ed00 con 0x5618614673a0 2024-04-23T18:31:17.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.831+0000 7f72a1c46640 1 --2- 172.21.15.119:0/1460186628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 0x56186146e7c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f729c013040 tx=0x7f729c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.831+0000 7f7185ffb640 1 -- 172.21.15.119:0/1460186628 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f729c020020 con 0x5618614673a0 2024-04-23T18:31:17.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.831+0000 7f7185ffb640 1 -- 172.21.15.119:0/1460186628 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f729c0108e0 con 0x5618614673a0 2024-04-23T18:31:17.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.832+0000 7f72a3946800 1 -- 172.21.15.119:0/1460186628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56186146ef90 con 0x5618614673a0 2024-04-23T18:31:17.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.832+0000 7f7185ffb640 1 -- 172.21.15.119:0/1460186628 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f729c015040 con 0x5618614673a0 2024-04-23T18:31:17.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.832+0000 7f72a3946800 1 -- 172.21.15.119:0/1460186628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561861471c40 con 0x5618614673a0 2024-04-23T18:31:17.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.832+0000 7f7185ffb640 1 -- 172.21.15.119:0/1460186628 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f729c023020 con 0x5618614673a0 2024-04-23T18:31:17.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.832+0000 7f7185ffb640 1 --2- 172.21.15.119:0/1460186628 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7178036e60 0x7f7178039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.833+0000 7f7185ffb640 1 -- 172.21.15.119:0/1460186628 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f729c04c7c0 con 0x5618614673a0 2024-04-23T18:31:17.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.833+0000 7f7298c44640 1 --2- 172.21.15.119:0/1460186628 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7178036e60 0x7f7178039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.833+0000 7f72a3946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:17.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.833+0000 7f72a3946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:17.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.833+0000 7f7298c44640 1 --2- 172.21.15.119:0/1460186628 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7178036e60 0x7f7178039320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f728c054000 tx=0x7f728c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.833+0000 7f72a3946800 1 Processor -- start 2024-04-23T18:31:17.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.833+0000 7f72a3946800 1 -- start start 2024-04-23T18:31:17.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.833+0000 7f72a3946800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861488e70 0x561861489290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.833+0000 7f72a3946800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561861452ab0 con 0x561861488e70 2024-04-23T18:31:17.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.833+0000 7f72a1445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861488e70 0x561861489290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.833+0000 7f72a1445640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861488e70 0x561861489290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54726/0 (socket says 172.21.15.119:54726) 2024-04-23T18:31:17.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.833+0000 7f72a1445640 1 -- 172.21.15.119:0/3729733537 learned_addr learned my addr 172.21.15.119:0/3729733537 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.834+0000 7f72a1445640 1 -- 172.21.15.119:0/3729733537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618614897d0 con 0x561861488e70 2024-04-23T18:31:17.833 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.834+0000 7f72a1445640 1 --2- 172.21.15.119:0/3729733537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861488e70 0x561861489290 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7294016fd0 tx=0x7f729400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.834+0000 7f7165fe3640 1 -- 172.21.15.119:0/3729733537 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7294019e00 con 0x561861488e70 2024-04-23T18:31:17.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.834+0000 7f7165fe3640 1 -- 172.21.15.119:0/3729733537 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7294047070 con 0x561861488e70 2024-04-23T18:31:17.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.834+0000 7f7165fe3640 1 -- 172.21.15.119:0/3729733537 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f729402ac20 con 0x561861488e70 2024-04-23T18:31:17.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.834+0000 7f72a3946800 1 -- 172.21.15.119:0/3729733537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56186148a240 con 0x561861488e70 2024-04-23T18:31:17.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.834+0000 7f72a3946800 1 -- 172.21.15.119:0/3729733537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56186148a740 con 0x561861488e70 2024-04-23T18:31:17.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.835+0000 7f7165fe3640 1 -- 172.21.15.119:0/3729733537 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7294016070 con 0x561861488e70 2024-04-23T18:31:17.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.835+0000 7f7165fe3640 1 --2- 172.21.15.119:0/3729733537 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f70e4036e60 0x7f70e4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.835+0000 7f7165fe3640 1 -- 172.21.15.119:0/3729733537 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f7294014070 con 0x561861488e70 2024-04-23T18:31:17.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.835+0000 7f7298c44640 1 --2- 172.21.15.119:0/3729733537 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f70e4036e60 0x7f70e4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.835+0000 7f70df7fe640 20 reqs_thread_entry: start 2024-04-23T18:31:17.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.835+0000 7f72a3946800 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561861496870 0x561861498c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.835+0000 7f7298c44640 1 --2- 172.21.15.119:0/3729733537 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f70e4036e60 0x7f70e4039320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f728c055040 tx=0x7f728c005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.835+0000 7f72a3946800 1 -- 172.21.15.119:0/4012284782 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561861499300 con 0x561861496870 2024-04-23T18:31:17.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.835+0000 7f72a1c46640 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561861496870 0x561861498c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.836+0000 7f72a1c46640 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561861496870 0x561861498c80 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.836+0000 7f72a1c46640 1 -- 172.21.15.119:0/4012284782 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f729c00e070 con 0x561861496870 2024-04-23T18:31:17.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.836+0000 7f72a3946800 1 -- 172.21.15.119:0/4012284782 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561861499be0 con 0x561861496870 2024-04-23T18:31:17.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.836+0000 7f72a1c46640 1 -- 172.21.15.119:0/4012284782 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f729c00e070 con 0x561861496870 2024-04-23T18:31:17.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.836+0000 7f72a3946800 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56186149b4f0 0x56186149d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.839 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.836+0000 7f72a3946800 1 -- 172.21.15.119:0/4012284782 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56186149e110 con 0x56186149b4f0 2024-04-23T18:31:17.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.836+0000 7f72a1445640 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56186149b4f0 0x56186149d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.837+0000 7f72a1445640 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56186149b4f0 0x56186149d980 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.837+0000 7f72a1445640 1 -- 172.21.15.119:0/4012284782 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f7294053070 con 0x56186149b4f0 2024-04-23T18:31:17.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/1460186628 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7178036e60 msgr2=0x7f7178039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 --2- 172.21.15.119:0/1460186628 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7178036e60 0x7f7178039320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f728c054000 tx=0x7f728c04e000 comp rx=0 tx=0).stop 2024-04-23T18:31:17.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/1460186628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 msgr2=0x56186146e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 --2- 172.21.15.119:0/1460186628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 0x56186146e7c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f729c013040 tx=0x7f729c003370 comp rx=0 tx=0).stop 2024-04-23T18:31:17.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/1460186628 shutdown_connections 2024-04-23T18:31:17.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 --2- 172.21.15.119:0/1460186628 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7178036e60 0x7f7178039320 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 --2- 172.21.15.119:0/1460186628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5618614673a0 0x56186146e7c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/1460186628 >> 172.21.15.119:0/1460186628 conn(0x561861365580 msgr2=0x561861461480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/1460186628 shutdown_connections 2024-04-23T18:31:17.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/1460186628 wait complete. 2024-04-23T18:31:17.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/3729733537 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f70e4036e60 msgr2=0x7f70e4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 --2- 172.21.15.119:0/3729733537 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f70e4036e60 0x7f70e4039320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f728c055040 tx=0x7f728c005a00 comp rx=0 tx=0).stop 2024-04-23T18:31:17.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/3729733537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861488e70 msgr2=0x561861489290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 --2- 172.21.15.119:0/3729733537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861488e70 0x561861489290 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7294016fd0 tx=0x7f729400c960 comp rx=0 tx=0).stop 2024-04-23T18:31:17.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/3729733537 shutdown_connections 2024-04-23T18:31:17.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 --2- 172.21.15.119:0/3729733537 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f70e4036e60 0x7f70e4039320 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 --2- 172.21.15.119:0/3729733537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861488e70 0x561861489290 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/3729733537 >> 172.21.15.119:0/3729733537 conn(0x56186147d920 msgr2=0x56186147e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/3729733537 shutdown_connections 2024-04-23T18:31:17.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/3729733537 wait complete. 2024-04-23T18:31:17.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561861496870 msgr2=0x561861498c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561861496870 0x561861498c80 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56186149b4f0 msgr2=0x56186149d980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56186149b4f0 0x56186149d980 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.838+0000 7f72a3946800 1 -- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7188036e60 msgr2=0x7f7188039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.839+0000 7f72a3946800 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7188036e60 0x7f7188039320 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f729400efd0 tx=0x7f729400df30 comp rx=0 tx=0).stop 2024-04-23T18:31:17.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.839+0000 7f72a3946800 1 -- 172.21.15.119:0/4012284782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 msgr2=0x561861459cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.839+0000 7f72a3946800 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 0x561861459cc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7294004000 tx=0x7f7294000bc0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.839+0000 7f72a3946800 1 -- 172.21.15.119:0/4012284782 shutdown_connections 2024-04-23T18:31:17.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.839+0000 7f72a3946800 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x56186149b4f0 0x56186149d980 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.839+0000 7f72a3946800 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561861496870 0x561861498c80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.839+0000 7f72a3946800 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7188036e60 0x7f7188039320 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.839+0000 7f72a3946800 1 --2- 172.21.15.119:0/4012284782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561861361140 0x561861459cc0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.839+0000 7f72a3946800 1 -- 172.21.15.119:0/4012284782 >> 172.21.15.119:0/4012284782 conn(0x56186135c800 msgr2=0x56186144c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.839+0000 7f72a3946800 1 -- 172.21.15.119:0/4012284782 shutdown_connections 2024-04-23T18:31:17.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.839+0000 7f72a3946800 1 -- 172.21.15.119:0/4012284782 wait complete. 2024-04-23T18:31:17.843 INFO:teuthology.orchestra.run.smithi119.stdout:{"id":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-23T18:31:17.844 DEBUG:tasks.util.rgw: json result: {'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-23T18:31:17.844 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-23T18:31:17.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-23T18:31:17.844 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-23T18:31:17.929 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:17.929 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:17.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.936+0000 7f533f52f800 1 Processor -- start 2024-04-23T18:31:17.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.936+0000 7f533f52f800 1 -- start start 2024-04-23T18:31:17.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.936+0000 7f533f52f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c9c4322f50 0x55c9c4323370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.936+0000 7f533f52f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c9c41d4560 con 0x55c9c43241b0 2024-04-23T18:31:17.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.936+0000 7f533f52f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55c9c41c5e20 con 0x55c9c4322f50 2024-04-23T18:31:17.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.937+0000 7f533b1d1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c9c4322f50 0x55c9c4323370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.937+0000 7f533b1d1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c9c4322f50 0x55c9c4323370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54734/0 (socket says 172.21.15.119:54734) 2024-04-23T18:31:17.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.937+0000 7f53329d0640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55c9c43241b0 0x55c9c4324630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50522/0 (socket says 172.21.15.119:50522) 2024-04-23T18:31:17.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.937+0000 7f533b1d1640 1 -- 172.21.15.119:0/1586923567 learned_addr learned my addr 172.21.15.119:0/1586923567 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.937+0000 7f533b1d1640 1 -- 172.21.15.119:0/1586923567 >> v1:172.21.15.62:6789/0 conn(0x55c9c43241b0 legacy=0x55c9c4324630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.937+0000 7f533b1d1640 1 -- 172.21.15.119:0/1586923567 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c41d3e60 con 0x55c9c4322f50 2024-04-23T18:31:17.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.939+0000 7f533b1d1640 1 --2- 172.21.15.119:0/1586923567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c4323370 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f532c00a520 tx=0x7f532c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85cca35864f4263 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.939+0000 7f533a9d0640 1 -- 172.21.15.119:0/1586923567 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c057070 con 0x55c9c4322f50 2024-04-23T18:31:17.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.939+0000 7f533a9d0640 1 -- 172.21.15.119:0/1586923567 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c052570 con 0x55c9c4322f50 2024-04-23T18:31:17.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.939+0000 7f533a9d0640 1 -- 172.21.15.119:0/1586923567 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c04ae60 con 0x55c9c4322f50 2024-04-23T18:31:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.939+0000 7f533f52f800 1 -- 172.21.15.119:0/1586923567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 msgr2=0x55c9c4323370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.939+0000 7f533f52f800 1 --2- 172.21.15.119:0/1586923567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c4323370 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f532c00a520 tx=0x7f532c01d010 comp rx=0 tx=0).stop 2024-04-23T18:31:17.933 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.939+0000 7f533f52f800 1 -- 172.21.15.119:0/1586923567 shutdown_connections 2024-04-23T18:31:17.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.939+0000 7f533f52f800 1 --2- 172.21.15.119:0/1586923567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c4323370 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.939+0000 7f533f52f800 1 -- 172.21.15.119:0/1586923567 >> 172.21.15.119:0/1586923567 conn(0x55c9c431e530 msgr2=0x55c9c4320950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.939+0000 7f533f52f800 1 -- 172.21.15.119:0/1586923567 shutdown_connections 2024-04-23T18:31:17.934 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.939+0000 7f533f52f800 1 -- 172.21.15.119:0/1586923567 wait complete. 2024-04-23T18:31:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.951+0000 7f533f52f800 1 Processor -- start 2024-04-23T18:31:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.951+0000 7f533f52f800 1 -- start start 2024-04-23T18:31:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.951+0000 7f533f52f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c4296f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.951+0000 7f533f52f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9c426f5d0 con 0x55c9c4322f50 2024-04-23T18:31:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.952+0000 7f533b1d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c4296f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.952+0000 7f533b1d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c4296f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54742/0 (socket says 172.21.15.119:54742) 2024-04-23T18:31:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.952+0000 7f533b1d1640 1 -- 172.21.15.119:0/3930470298 learned_addr learned my addr 172.21.15.119:0/3930470298 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.952+0000 7f533b1d1640 1 -- 172.21.15.119:0/3930470298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c41e5860 con 0x55c9c4322f50 2024-04-23T18:31:17.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.952+0000 7f533b1d1640 1 --2- 172.21.15.119:0/3930470298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c4296f70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f532c01d050 tx=0x7f532c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f72b115c7c7e175 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.952+0000 7f522960a640 1 -- 172.21.15.119:0/3930470298 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c057040 con 0x55c9c4322f50 2024-04-23T18:31:17.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.952+0000 7f522960a640 1 -- 172.21.15.119:0/3930470298 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c052720 con 0x55c9c4322f50 2024-04-23T18:31:17.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.952+0000 7f522960a640 1 -- 172.21.15.119:0/3930470298 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c052a40 con 0x55c9c4322f50 2024-04-23T18:31:17.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.953+0000 7f533f52f800 1 -- 172.21.15.119:0/3930470298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 msgr2=0x55c9c4296f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.953+0000 7f533f52f800 1 --2- 172.21.15.119:0/3930470298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c4296f70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f532c01d050 tx=0x7f532c04c000 comp rx=0 tx=0).stop 2024-04-23T18:31:17.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.953+0000 7f533f52f800 1 -- 172.21.15.119:0/3930470298 shutdown_connections 2024-04-23T18:31:17.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.953+0000 7f533f52f800 1 --2- 172.21.15.119:0/3930470298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c4296f70 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.953+0000 7f533f52f800 1 -- 172.21.15.119:0/3930470298 >> 172.21.15.119:0/3930470298 conn(0x55c9c431e530 msgr2=0x55c9c440ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.953+0000 7f533f52f800 1 -- 172.21.15.119:0/3930470298 shutdown_connections 2024-04-23T18:31:17.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.953+0000 7f533f52f800 1 -- 172.21.15.119:0/3930470298 wait complete. 2024-04-23T18:31:17.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.953+0000 7f533f52f800 1 Processor -- start 2024-04-23T18:31:17.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.953+0000 7f533f52f800 1 -- start start 2024-04-23T18:31:17.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.953+0000 7f533f52f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c441cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.953+0000 7f533f52f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9c432c620 con 0x55c9c4322f50 2024-04-23T18:31:17.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.954+0000 7f533b1d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c441cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.954+0000 7f533b1d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c441cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54758/0 (socket says 172.21.15.119:54758) 2024-04-23T18:31:17.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.954+0000 7f533b1d1640 1 -- 172.21.15.119:0/3407282859 learned_addr learned my addr 172.21.15.119:0/3407282859 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.954+0000 7f533b1d1640 1 -- 172.21.15.119:0/3407282859 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c41e3eb0 con 0x55c9c4322f50 2024-04-23T18:31:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.954+0000 7f533b1d1640 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c441cf30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f532c01cfe0 tx=0x7f532c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.954+0000 7f5227e07640 1 -- 172.21.15.119:0/3407282859 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c073070 con 0x55c9c4322f50 2024-04-23T18:31:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.954+0000 7f5227e07640 1 -- 172.21.15.119:0/3407282859 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c052da0 con 0x55c9c4322f50 2024-04-23T18:31:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.954+0000 7f533f52f800 1 -- 172.21.15.119:0/3407282859 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9c441d470 con 0x55c9c4322f50 2024-04-23T18:31:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.954+0000 7f5227e07640 1 -- 172.21.15.119:0/3407282859 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c057070 con 0x55c9c4322f50 2024-04-23T18:31:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.954+0000 7f533f52f800 1 -- 172.21.15.119:0/3407282859 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c441d990 con 0x55c9c4322f50 2024-04-23T18:31:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.955+0000 7f533f52f800 1 Processor -- start 2024-04-23T18:31:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.955+0000 7f533f52f800 1 -- start start 2024-04-23T18:31:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.955+0000 7f533f52f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 0x55c9c442aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.955+0000 7f533f52f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9c4215df0 con 0x55c9c442a610 2024-04-23T18:31:17.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.955+0000 7f5227e07640 1 -- 172.21.15.119:0/3407282859 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f532c076070 con 0x55c9c4322f50 2024-04-23T18:31:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.955+0000 7f533b9d2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 0x55c9c442aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.955+0000 7f533b9d2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 0x55c9c442aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54772/0 (socket says 172.21.15.119:54772) 2024-04-23T18:31:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.955+0000 7f533b9d2640 1 -- 172.21.15.119:0/4140897690 learned_addr learned my addr 172.21.15.119:0/4140897690 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.955+0000 7f5227e07640 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5220036e60 0x7f5220039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.955+0000 7f5227e07640 1 -- 172.21.15.119:0/3407282859 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f532c08e180 con 0x55c9c4322f50 2024-04-23T18:31:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f533b1d1640 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5220036e60 0x7f5220039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f533b9d2640 1 -- 172.21.15.119:0/4140897690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c442af70 con 0x55c9c442a610 2024-04-23T18:31:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f533b9d2640 1 --2- 172.21.15.119:0/4140897690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 0x55c9c442aa30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f533400a430 tx=0x7f533400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606591d3d6fd0cc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f533b1d1640 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5220036e60 0x7f5220039320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f532c0529e0 tx=0x7f532c066f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f5225e03640 1 -- 172.21.15.119:0/4140897690 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5334015070 con 0x55c9c442a610 2024-04-23T18:31:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f5225e03640 1 -- 172.21.15.119:0/4140897690 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5334001670 con 0x55c9c442a610 2024-04-23T18:31:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f5225e03640 1 -- 172.21.15.119:0/4140897690 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5334001990 con 0x55c9c442a610 2024-04-23T18:31:17.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f533f52f800 1 -- 172.21.15.119:0/4140897690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 msgr2=0x55c9c442aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f533f52f800 1 --2- 172.21.15.119:0/4140897690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 0x55c9c442aa30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f533400a430 tx=0x7f533400a8f0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f533f52f800 1 -- 172.21.15.119:0/4140897690 shutdown_connections 2024-04-23T18:31:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f533f52f800 1 --2- 172.21.15.119:0/4140897690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 0x55c9c442aa30 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f533f52f800 1 -- 172.21.15.119:0/4140897690 >> 172.21.15.119:0/4140897690 conn(0x55c9c43241b0 msgr2=0x55c9c44270b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f533f52f800 1 -- 172.21.15.119:0/4140897690 shutdown_connections 2024-04-23T18:31:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.956+0000 7f533f52f800 1 -- 172.21.15.119:0/4140897690 wait complete. 2024-04-23T18:31:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.957+0000 7f533f52f800 1 Processor -- start 2024-04-23T18:31:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.957+0000 7f533f52f800 1 -- start start 2024-04-23T18:31:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.957+0000 7f533f52f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 0x55c9c4415d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.957+0000 7f533f52f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9c442b900 con 0x55c9c442a610 2024-04-23T18:31:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.957+0000 7f533b9d2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 0x55c9c4415d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.957+0000 7f533b9d2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 0x55c9c4415d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54774/0 (socket says 172.21.15.119:54774) 2024-04-23T18:31:17.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.957+0000 7f533b9d2640 1 -- 172.21.15.119:0/2591363226 learned_addr learned my addr 172.21.15.119:0/2591363226 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.957+0000 7f533b9d2640 1 -- 172.21.15.119:0/2591363226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c4414450 con 0x55c9c442a610 2024-04-23T18:31:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.957+0000 7f533b9d2640 1 --2- 172.21.15.119:0/2591363226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 0x55c9c4415d60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5334013040 tx=0x7f5334003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.958+0000 7f5217fff640 1 -- 172.21.15.119:0/2591363226 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5334020020 con 0x55c9c442a610 2024-04-23T18:31:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.958+0000 7f5217fff640 1 -- 172.21.15.119:0/2591363226 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53340108e0 con 0x55c9c442a610 2024-04-23T18:31:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.958+0000 7f533f52f800 1 -- 172.21.15.119:0/2591363226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9c44146e0 con 0x55c9c442a610 2024-04-23T18:31:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.958+0000 7f5217fff640 1 -- 172.21.15.119:0/2591363226 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5334015040 con 0x55c9c442a610 2024-04-23T18:31:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.958+0000 7f533f52f800 1 -- 172.21.15.119:0/2591363226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c4414b80 con 0x55c9c442a610 2024-04-23T18:31:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.958+0000 7f5217fff640 1 -- 172.21.15.119:0/2591363226 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f5334023020 con 0x55c9c442a610 2024-04-23T18:31:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.959+0000 7f5217fff640 1 --2- 172.21.15.119:0/2591363226 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f521c036e60 0x7f521c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.959+0000 7f5217fff640 1 -- 172.21.15.119:0/2591363226 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f533404c840 con 0x55c9c442a610 2024-04-23T18:31:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.959+0000 7f53329d0640 1 --2- 172.21.15.119:0/2591363226 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f521c036e60 0x7f521c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.959+0000 7f53329d0640 1 --2- 172.21.15.119:0/2591363226 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f521c036e60 0x7f521c039320 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5324000f60 tx=0x7f53240012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.959+0000 7f533f52f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:17.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.959+0000 7f533f52f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:17.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.959+0000 7f533f52f800 1 Processor -- start 2024-04-23T18:31:17.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.959+0000 7f533f52f800 1 -- start start 2024-04-23T18:31:17.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.960+0000 7f533f52f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c444e340 0x55c9c444e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.960+0000 7f533f52f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9c44184f0 con 0x55c9c444e340 2024-04-23T18:31:17.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.960+0000 7f533b1d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c444e340 0x55c9c444e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.960+0000 7f533b1d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c444e340 0x55c9c444e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54782/0 (socket says 172.21.15.119:54782) 2024-04-23T18:31:17.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.960+0000 7f533b1d1640 1 -- 172.21.15.119:0/4283010454 learned_addr learned my addr 172.21.15.119:0/4283010454 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:17.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.960+0000 7f533b1d1640 1 -- 172.21.15.119:0/4283010454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c444eca0 con 0x55c9c444e340 2024-04-23T18:31:17.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.960+0000 7f533b1d1640 1 --2- 172.21.15.119:0/4283010454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c444e340 0x55c9c444e760 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f532c08c530 tx=0x7f532c006d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.960+0000 7f5200fe1640 1 -- 172.21.15.119:0/4283010454 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c092070 con 0x55c9c444e340 2024-04-23T18:31:17.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.960+0000 7f5200fe1640 1 -- 172.21.15.119:0/4283010454 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c077de0 con 0x55c9c444e340 2024-04-23T18:31:17.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.960+0000 7f533f52f800 1 -- 172.21.15.119:0/4283010454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9c444f710 con 0x55c9c444e340 2024-04-23T18:31:17.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.960+0000 7f5200fe1640 1 -- 172.21.15.119:0/4283010454 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f532c08c280 con 0x55c9c444e340 2024-04-23T18:31:17.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.960+0000 7f533f52f800 1 -- 172.21.15.119:0/4283010454 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c444fc10 con 0x55c9c444e340 2024-04-23T18:31:17.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.961+0000 7f5200fe1640 1 -- 172.21.15.119:0/4283010454 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f532c095070 con 0x55c9c444e340 2024-04-23T18:31:17.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.961+0000 7f5200fe1640 1 --2- 172.21.15.119:0/4283010454 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5174036e60 0x7f5174039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.961+0000 7f5200fe1640 1 -- 172.21.15.119:0/4283010454 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f532c098d60 con 0x55c9c444e340 2024-04-23T18:31:17.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.961+0000 7f53329d0640 1 --2- 172.21.15.119:0/4283010454 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5174036e60 0x7f5174039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.962+0000 7f51fa7fc640 20 reqs_thread_entry: start 2024-04-23T18:31:17.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.962+0000 7f53329d0640 1 --2- 172.21.15.119:0/4283010454 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5174036e60 0x7f5174039320 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5324001ed0 tx=0x7f532400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.962+0000 7f533f52f800 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c9c445be00 0x55c9c445e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.962+0000 7f533f52f800 1 -- 172.21.15.119:0/3407282859 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9c445e920 con 0x55c9c445be00 2024-04-23T18:31:17.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.962+0000 7f533b9d2640 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c9c445be00 0x55c9c445e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.962+0000 7f533b9d2640 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c9c445be00 0x55c9c445e250 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.962+0000 7f533b9d2640 1 -- 172.21.15.119:0/3407282859 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f533400e070 con 0x55c9c445be00 2024-04-23T18:31:17.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.962+0000 7f533f52f800 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c9c44606f0 0x55c9c4462ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:17.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.962+0000 7f533f52f800 1 -- 172.21.15.119:0/3407282859 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:2 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9c44631d0 con 0x55c9c44606f0 2024-04-23T18:31:17.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.962+0000 7f533b1d1640 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c9c44606f0 0x55c9c4462ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:17.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.963+0000 7f533b1d1640 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c9c44606f0 0x55c9c4462ae0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:17.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.963+0000 7f533b1d1640 1 -- 172.21.15.119:0/3407282859 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(2 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f532c09e070 con 0x55c9c44606f0 2024-04-23T18:31:17.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.963+0000 7f533f52f800 1 -- 172.21.15.119:0/3407282859 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9c445fdc0 con 0x55c9c44606f0 2024-04-23T18:31:17.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.964+0000 7f533b1d1640 1 -- 172.21.15.119:0/3407282859 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [stat,call,call,writefull 0~993] v34'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f532c09e070 con 0x55c9c44606f0 2024-04-23T18:31:17.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 -- 172.21.15.119:0/2591363226 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f521c036e60 msgr2=0x7f521c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 --2- 172.21.15.119:0/2591363226 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f521c036e60 0x7f521c039320 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5324000f60 tx=0x7f53240012f0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 -- 172.21.15.119:0/2591363226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 msgr2=0x55c9c4415d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 --2- 172.21.15.119:0/2591363226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 0x55c9c4415d60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5334013040 tx=0x7f5334003370 comp rx=0 tx=0).stop 2024-04-23T18:31:17.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 -- 172.21.15.119:0/2591363226 shutdown_connections 2024-04-23T18:31:17.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 --2- 172.21.15.119:0/2591363226 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f521c036e60 0x7f521c039320 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 --2- 172.21.15.119:0/2591363226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c442a610 0x55c9c4415d60 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 -- 172.21.15.119:0/2591363226 >> 172.21.15.119:0/2591363226 conn(0x55c9c43241b0 msgr2=0x55c9c44246f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 -- 172.21.15.119:0/2591363226 shutdown_connections 2024-04-23T18:31:17.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 -- 172.21.15.119:0/2591363226 wait complete. 2024-04-23T18:31:17.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 -- 172.21.15.119:0/4283010454 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5174036e60 msgr2=0x7f5174039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 --2- 172.21.15.119:0/4283010454 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5174036e60 0x7f5174039320 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5324001ed0 tx=0x7f532400f000 comp rx=0 tx=0).stop 2024-04-23T18:31:17.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 -- 172.21.15.119:0/4283010454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c444e340 msgr2=0x55c9c444e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.966 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 --2- 172.21.15.119:0/4283010454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c444e340 0x55c9c444e760 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f532c08c530 tx=0x7f532c006d50 comp rx=0 tx=0).stop 2024-04-23T18:31:17.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 -- 172.21.15.119:0/4283010454 shutdown_connections 2024-04-23T18:31:17.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 --2- 172.21.15.119:0/4283010454 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5174036e60 0x7f5174039320 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 --2- 172.21.15.119:0/4283010454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c444e340 0x55c9c444e760 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.965+0000 7f533f52f800 1 -- 172.21.15.119:0/4283010454 >> 172.21.15.119:0/4283010454 conn(0x55c9c4442dd0 msgr2=0x55c9c44437f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 -- 172.21.15.119:0/4283010454 shutdown_connections 2024-04-23T18:31:17.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 -- 172.21.15.119:0/4283010454 wait complete. 2024-04-23T18:31:17.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 -- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c9c445be00 msgr2=0x55c9c445e250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c9c445be00 0x55c9c445e250 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 -- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c9c44606f0 msgr2=0x55c9c4462ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c9c44606f0 0x55c9c4462ae0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 -- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5220036e60 msgr2=0x7f5220039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.967 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5220036e60 0x7f5220039320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f532c0529e0 tx=0x7f532c066f90 comp rx=0 tx=0).stop 2024-04-23T18:31:17.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 -- 172.21.15.119:0/3407282859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 msgr2=0x55c9c441cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:17.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c441cf30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f532c01cfe0 tx=0x7f532c003020 comp rx=0 tx=0).stop 2024-04-23T18:31:17.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 -- 172.21.15.119:0/3407282859 shutdown_connections 2024-04-23T18:31:17.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55c9c44606f0 0x55c9c4462ae0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55c9c445be00 0x55c9c445e250 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5220036e60 0x7f5220039320 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 --2- 172.21.15.119:0/3407282859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9c4322f50 0x55c9c441cf30 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:17.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 -- 172.21.15.119:0/3407282859 >> 172.21.15.119:0/3407282859 conn(0x55c9c431e530 msgr2=0x55c9c440e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:17.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 -- 172.21.15.119:0/3407282859 shutdown_connections 2024-04-23T18:31:17.968 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:17.966+0000 7f533f52f800 1 -- 172.21.15.119:0/3407282859 wait complete. 2024-04-23T18:31:17.969 INFO:teuthology.orchestra.run.smithi119.stdout:{"id":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-23T18:31:17.969 DEBUG:tasks.util.rgw: json result: {'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-23T18:31:17.970 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-04-23T18:31:17.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-04-23T18:31:17.970 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-04-23T18:31:18.011 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:18.011 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:18.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.018+0000 7f023313f800 1 Processor -- start 2024-04-23T18:31:18.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.018+0000 7f023313f800 1 -- start start 2024-04-23T18:31:18.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.018+0000 7f023313f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b29c905560 0x55b29c907950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.018+0000 7f023313f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b29c7b1560 con 0x55b29c901a50 2024-04-23T18:31:18.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.018+0000 7f023313f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55b29c7a2e20 con 0x55b29c905560 2024-04-23T18:31:18.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.018+0000 7f022e69a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b29c905560 0x55b29c907950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.018+0000 7f022e69a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b29c905560 0x55b29c907950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54798/0 (socket says 172.21.15.119:54798) 2024-04-23T18:31:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.018+0000 7f022e69a640 1 -- 172.21.15.119:0/2982084221 learned_addr learned my addr 172.21.15.119:0/2982084221 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.018+0000 7f022ee9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55b29c901a50 0x55b29c903e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50534/0 (socket says 172.21.15.119:50534) 2024-04-23T18:31:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.019+0000 7f022e69a640 1 -- 172.21.15.119:0/2982084221 >> v1:172.21.15.62:6789/0 conn(0x55b29c901a50 legacy=0x55b29c903e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.019+0000 7f022e69a640 1 -- 172.21.15.119:0/2982084221 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29c7b0e60 con 0x55b29c905560 2024-04-23T18:31:18.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.020+0000 7f022e69a640 1 --2- 172.21.15.119:0/2982084221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c905560 0x55b29c907950 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f022400a520 tx=0x7f022401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714bb5027d8456ae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.021+0000 7f022de99640 1 -- 172.21.15.119:0/2982084221 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0224057070 con 0x55b29c905560 2024-04-23T18:31:18.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.021+0000 7f022de99640 1 -- 172.21.15.119:0/2982084221 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0224052570 con 0x55b29c905560 2024-04-23T18:31:18.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.021+0000 7f022de99640 1 -- 172.21.15.119:0/2982084221 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f022404ae60 con 0x55b29c905560 2024-04-23T18:31:18.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.021+0000 7f023313f800 1 -- 172.21.15.119:0/2982084221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c905560 msgr2=0x55b29c907950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.021+0000 7f023313f800 1 --2- 172.21.15.119:0/2982084221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c905560 0x55b29c907950 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f022400a520 tx=0x7f022401d010 comp rx=0 tx=0).stop 2024-04-23T18:31:18.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.021+0000 7f023313f800 1 -- 172.21.15.119:0/2982084221 shutdown_connections 2024-04-23T18:31:18.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.021+0000 7f023313f800 1 --2- 172.21.15.119:0/2982084221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c905560 0x55b29c907950 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.021+0000 7f023313f800 1 -- 172.21.15.119:0/2982084221 >> 172.21.15.119:0/2982084221 conn(0x55b29c8fb400 msgr2=0x55b29c8fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.021+0000 7f023313f800 1 -- 172.21.15.119:0/2982084221 shutdown_connections 2024-04-23T18:31:18.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.021+0000 7f023313f800 1 -- 172.21.15.119:0/2982084221 wait complete. 2024-04-23T18:31:18.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.033+0000 7f023313f800 1 Processor -- start 2024-04-23T18:31:18.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.033+0000 7f023313f800 1 -- start start 2024-04-23T18:31:18.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.033+0000 7f023313f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 0x55b29c9f2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.033+0000 7f023313f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b29c84c5a0 con 0x55b29c901a50 2024-04-23T18:31:18.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.033+0000 7f022ee9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 0x55b29c9f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.033+0000 7f022ee9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 0x55b29c9f2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54812/0 (socket says 172.21.15.119:54812) 2024-04-23T18:31:18.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.033+0000 7f022ee9b640 1 -- 172.21.15.119:0/713377791 learned_addr learned my addr 172.21.15.119:0/713377791 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.034+0000 7f022ee9b640 1 -- 172.21.15.119:0/713377791 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29c7c2860 con 0x55b29c901a50 2024-04-23T18:31:18.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.034+0000 7f022ee9b640 1 --2- 172.21.15.119:0/713377791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 0x55b29c9f2160 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0220001e10 tx=0x7f022000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc984459af3302a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.034+0000 7f011ce09640 1 -- 172.21.15.119:0/713377791 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f022000e5c0 con 0x55b29c901a50 2024-04-23T18:31:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.034+0000 7f011ce09640 1 -- 172.21.15.119:0/713377791 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0220006070 con 0x55b29c901a50 2024-04-23T18:31:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.034+0000 7f011ce09640 1 -- 172.21.15.119:0/713377791 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f022000e930 con 0x55b29c901a50 2024-04-23T18:31:18.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f023313f800 1 -- 172.21.15.119:0/713377791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 msgr2=0x55b29c9f2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f023313f800 1 --2- 172.21.15.119:0/713377791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 0x55b29c9f2160 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0220001e10 tx=0x7f022000b6c0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f023313f800 1 -- 172.21.15.119:0/713377791 shutdown_connections 2024-04-23T18:31:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f023313f800 1 --2- 172.21.15.119:0/713377791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 0x55b29c9f2160 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f023313f800 1 -- 172.21.15.119:0/713377791 >> 172.21.15.119:0/713377791 conn(0x55b29c8fb400 msgr2=0x55b29c9eda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f023313f800 1 -- 172.21.15.119:0/713377791 shutdown_connections 2024-04-23T18:31:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f023313f800 1 -- 172.21.15.119:0/713377791 wait complete. 2024-04-23T18:31:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f023313f800 1 Processor -- start 2024-04-23T18:31:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f023313f800 1 -- start start 2024-04-23T18:31:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f023313f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 0x55b29c901340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f023313f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b29c90a1a0 con 0x55b29c901a50 2024-04-23T18:31:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f022ee9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 0x55b29c901340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f022ee9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 0x55b29c901340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54826/0 (socket says 172.21.15.119:54826) 2024-04-23T18:31:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.035+0000 7f022ee9b640 1 -- 172.21.15.119:0/2274792615 learned_addr learned my addr 172.21.15.119:0/2274792615 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.036+0000 7f022ee9b640 1 -- 172.21.15.119:0/2274792615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29c7c0eb0 con 0x55b29c901a50 2024-04-23T18:31:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.036+0000 7f022ee9b640 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 0x55b29c901340 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f022000b700 tx=0x7f0220000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.036+0000 7f011b606640 1 -- 172.21.15.119:0/2274792615 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f022000f8d0 con 0x55b29c901a50 2024-04-23T18:31:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.036+0000 7f011b606640 1 -- 172.21.15.119:0/2274792615 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f022000fa70 con 0x55b29c901a50 2024-04-23T18:31:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.036+0000 7f023313f800 1 -- 172.21.15.119:0/2274792615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b29c901880 con 0x55b29c901a50 2024-04-23T18:31:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.036+0000 7f011b606640 1 -- 172.21.15.119:0/2274792615 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f022000fd50 con 0x55b29c901a50 2024-04-23T18:31:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.036+0000 7f023313f800 1 -- 172.21.15.119:0/2274792615 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b29c8ffdd0 con 0x55b29c901a50 2024-04-23T18:31:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f023313f800 1 Processor -- start 2024-04-23T18:31:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f023313f800 1 -- start start 2024-04-23T18:31:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f011b606640 1 -- 172.21.15.119:0/2274792615 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0220017070 con 0x55b29c901a50 2024-04-23T18:31:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f023313f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 0x55b29ca097b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f023313f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b29c7f2df0 con 0x55b29ca09390 2024-04-23T18:31:18.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f011b606640 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0114036e60 0x7f0114039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f022f69c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 0x55b29ca097b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f022f69c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 0x55b29ca097b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54840/0 (socket says 172.21.15.119:54840) 2024-04-23T18:31:18.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f022f69c640 1 -- 172.21.15.119:0/684434489 learned_addr learned my addr 172.21.15.119:0/684434489 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f011b606640 1 -- 172.21.15.119:0/2274792615 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f0220015020 con 0x55b29c901a50 2024-04-23T18:31:18.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f022ee9b640 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0114036e60 0x7f0114039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f022f69c640 1 -- 172.21.15.119:0/684434489 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29ca09cf0 con 0x55b29ca09390 2024-04-23T18:31:18.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f022f69c640 1 --2- 172.21.15.119:0/684434489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 0x55b29ca097b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f022800a430 tx=0x7f022800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ed7f88caec5be2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.037+0000 7f022ee9b640 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0114036e60 0x7f0114039320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f022000ffd0 tx=0x7f022001c520 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f0119602640 1 -- 172.21.15.119:0/684434489 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0228015070 con 0x55b29ca09390 2024-04-23T18:31:18.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f0119602640 1 -- 172.21.15.119:0/684434489 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0228001670 con 0x55b29ca09390 2024-04-23T18:31:18.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f0119602640 1 -- 172.21.15.119:0/684434489 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0228001990 con 0x55b29ca09390 2024-04-23T18:31:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f023313f800 1 -- 172.21.15.119:0/684434489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 msgr2=0x55b29ca097b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f023313f800 1 --2- 172.21.15.119:0/684434489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 0x55b29ca097b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f022800a430 tx=0x7f022800a8f0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f023313f800 1 -- 172.21.15.119:0/684434489 shutdown_connections 2024-04-23T18:31:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f023313f800 1 --2- 172.21.15.119:0/684434489 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 0x55b29ca097b0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f023313f800 1 -- 172.21.15.119:0/684434489 >> 172.21.15.119:0/684434489 conn(0x55b29c905560 msgr2=0x55b29ca05e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f023313f800 1 -- 172.21.15.119:0/684434489 shutdown_connections 2024-04-23T18:31:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f023313f800 1 -- 172.21.15.119:0/684434489 wait complete. 2024-04-23T18:31:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f023313f800 1 Processor -- start 2024-04-23T18:31:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f023313f800 1 -- start start 2024-04-23T18:31:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f023313f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 0x55b29ca107f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.038+0000 7f023313f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b29ca0a680 con 0x55b29ca09390 2024-04-23T18:31:18.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.039+0000 7f022f69c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 0x55b29ca107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.039+0000 7f022f69c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 0x55b29ca107f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54852/0 (socket says 172.21.15.119:54852) 2024-04-23T18:31:18.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.039+0000 7f022f69c640 1 -- 172.21.15.119:0/2251864227 learned_addr learned my addr 172.21.15.119:0/2251864227 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.039+0000 7f022f69c640 1 -- 172.21.15.119:0/2251864227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29ca10d30 con 0x55b29ca09390 2024-04-23T18:31:18.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.039+0000 7f022f69c640 1 --2- 172.21.15.119:0/2251864227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 0x55b29ca107f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0228013040 tx=0x7f0228003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.039+0000 7f01137fe640 1 -- 172.21.15.119:0/2251864227 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0228020020 con 0x55b29ca09390 2024-04-23T18:31:18.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.039+0000 7f01137fe640 1 -- 172.21.15.119:0/2251864227 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02280108e0 con 0x55b29ca09390 2024-04-23T18:31:18.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.039+0000 7f023313f800 1 -- 172.21.15.119:0/2251864227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b29ca10fc0 con 0x55b29ca09390 2024-04-23T18:31:18.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.039+0000 7f01137fe640 1 -- 172.21.15.119:0/2251864227 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0228015040 con 0x55b29ca09390 2024-04-23T18:31:18.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.039+0000 7f023313f800 1 -- 172.21.15.119:0/2251864227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b29ca13c70 con 0x55b29ca09390 2024-04-23T18:31:18.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.040+0000 7f01137fe640 1 -- 172.21.15.119:0/2251864227 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f0228023020 con 0x55b29ca09390 2024-04-23T18:31:18.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.040+0000 7f01137fe640 1 --2- 172.21.15.119:0/2251864227 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0108036e60 0x7f0108039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.040+0000 7f023313f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:18.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.040+0000 7f023313f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.040+0000 7f01137fe640 1 -- 172.21.15.119:0/2251864227 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f022804c7c0 con 0x55b29ca09390 2024-04-23T18:31:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.041+0000 7f022e69a640 1 --2- 172.21.15.119:0/2251864227 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0108036e60 0x7f0108039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.041+0000 7f023313f800 1 Processor -- start 2024-04-23T18:31:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.041+0000 7f023313f800 1 -- start start 2024-04-23T18:31:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.041+0000 7f022e69a640 1 --2- 172.21.15.119:0/2251864227 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0108036e60 0x7f0108039320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0224054000 tx=0x7f022404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.041+0000 7f023313f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca2aee0 0x55b29ca2b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.041+0000 7f023313f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b29c9f28e0 con 0x55b29ca2aee0 2024-04-23T18:31:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.041+0000 7f022ee9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca2aee0 0x55b29ca2b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.041+0000 7f022ee9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca2aee0 0x55b29ca2b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54868/0 (socket says 172.21.15.119:54868) 2024-04-23T18:31:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.041+0000 7f022ee9b640 1 -- 172.21.15.119:0/1057779988 learned_addr learned my addr 172.21.15.119:0/1057779988 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.041+0000 7f022ee9b640 1 -- 172.21.15.119:0/1057779988 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29ca2b840 con 0x55b29ca2aee0 2024-04-23T18:31:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.042+0000 7f022ee9b640 1 --2- 172.21.15.119:0/1057779988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca2aee0 0x55b29ca2b300 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0220001640 tx=0x7f0220019c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.042+0000 7f00f37e6640 1 -- 172.21.15.119:0/1057779988 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f022001bc50 con 0x55b29ca2aee0 2024-04-23T18:31:18.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.042+0000 7f00f37e6640 1 -- 172.21.15.119:0/1057779988 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0220038050 con 0x55b29ca2aee0 2024-04-23T18:31:18.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.042+0000 7f023313f800 1 -- 172.21.15.119:0/1057779988 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b29ca2c2b0 con 0x55b29ca2aee0 2024-04-23T18:31:18.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.042+0000 7f00f37e6640 1 -- 172.21.15.119:0/1057779988 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0220043150 con 0x55b29ca2aee0 2024-04-23T18:31:18.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.042+0000 7f023313f800 1 -- 172.21.15.119:0/1057779988 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b29ca2c7b0 con 0x55b29ca2aee0 2024-04-23T18:31:18.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.043+0000 7f00f37e6640 1 -- 172.21.15.119:0/1057779988 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f022004b6a0 con 0x55b29ca2aee0 2024-04-23T18:31:18.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.043+0000 7f00f37e6640 1 --2- 172.21.15.119:0/1057779988 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0070036e60 0x7f0070039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.043+0000 7f00f37e6640 1 -- 172.21.15.119:0/1057779988 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f0220028d40 con 0x55b29ca2aee0 2024-04-23T18:31:18.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.043+0000 7f022e69a640 1 --2- 172.21.15.119:0/1057779988 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0070036e60 0x7f0070039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.043+0000 7f00f17e2640 20 reqs_thread_entry: start 2024-04-23T18:31:18.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.043+0000 7f023313f800 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b29ca388e0 0x55b29ca3acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.043+0000 7f023313f800 1 -- 172.21.15.119:0/2274792615 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b29ca3b3a0 con 0x55b29ca388e0 2024-04-23T18:31:18.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.043+0000 7f022e69a640 1 --2- 172.21.15.119:0/1057779988 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0070036e60 0x7f0070039320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0224000c00 tx=0x7f0224005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.043+0000 7f022f69c640 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b29ca388e0 0x55b29ca3acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.043+0000 7f022f69c640 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b29ca388e0 0x55b29ca3acf0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.044+0000 7f022f69c640 1 -- 172.21.15.119:0/2274792615 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f022800e070 con 0x55b29ca388e0 2024-04-23T18:31:18.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.044+0000 7f023313f800 1 -- 172.21.15.119:0/2274792615 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b29ca3b920 con 0x55b29ca388e0 2024-04-23T18:31:18.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.044+0000 7f022f69c640 1 -- 172.21.15.119:0/2274792615 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f022800e070 con 0x55b29ca388e0 2024-04-23T18:31:18.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.044+0000 7f023313f800 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b29ca3d540 0x55b29ca3f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.044+0000 7f023313f800 1 -- 172.21.15.119:0/2274792615 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:3 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b29ca40160 con 0x55b29ca3d540 2024-04-23T18:31:18.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.044+0000 7f022ee9b640 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b29ca3d540 0x55b29ca3f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.045+0000 7f022ee9b640 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b29ca3d540 0x55b29ca3f9d0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.045+0000 7f022ee9b640 1 -- 172.21.15.119:0/2274792615 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(3 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f022002e070 con 0x55b29ca3d540 2024-04-23T18:31:18.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/2251864227 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0108036e60 msgr2=0x7f0108039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/2251864227 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0108036e60 0x7f0108039320 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0224054000 tx=0x7f022404e000 comp rx=0 tx=0).stop 2024-04-23T18:31:18.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/2251864227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 msgr2=0x55b29ca107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/2251864227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 0x55b29ca107f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0228013040 tx=0x7f0228003370 comp rx=0 tx=0).stop 2024-04-23T18:31:18.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/2251864227 shutdown_connections 2024-04-23T18:31:18.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/2251864227 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0108036e60 0x7f0108039320 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/2251864227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca09390 0x55b29ca107f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/2251864227 >> 172.21.15.119:0/2251864227 conn(0x55b29c905560 msgr2=0x55b29ca03470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/2251864227 shutdown_connections 2024-04-23T18:31:18.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/2251864227 wait complete. 2024-04-23T18:31:18.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/1057779988 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0070036e60 msgr2=0x7f0070039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/1057779988 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0070036e60 0x7f0070039320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0224000c00 tx=0x7f0224005ac0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/1057779988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca2aee0 msgr2=0x55b29ca2b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/1057779988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca2aee0 0x55b29ca2b300 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0220001640 tx=0x7f0220019c30 comp rx=0 tx=0).stop 2024-04-23T18:31:18.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/1057779988 shutdown_connections 2024-04-23T18:31:18.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/1057779988 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0070036e60 0x7f0070039320 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/1057779988 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29ca2aee0 0x55b29ca2b300 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/1057779988 >> 172.21.15.119:0/1057779988 conn(0x55b29ca1f980 msgr2=0x55b29ca203f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/1057779988 shutdown_connections 2024-04-23T18:31:18.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/1057779988 wait complete. 2024-04-23T18:31:18.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/2274792615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b29ca3d540 msgr2=0x55b29ca3f9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b29ca3d540 0x55b29ca3f9d0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/2274792615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b29ca388e0 msgr2=0x55b29ca3acf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b29ca388e0 0x55b29ca3acf0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/2274792615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0114036e60 msgr2=0x7f0114039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0114036e60 0x7f0114039320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f022000ffd0 tx=0x7f022001c520 comp rx=0 tx=0).stop 2024-04-23T18:31:18.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/2274792615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 msgr2=0x55b29c901340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 0x55b29c901340 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f022000b700 tx=0x7f0220000bc0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 -- 172.21.15.119:0/2274792615 shutdown_connections 2024-04-23T18:31:18.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b29ca3d540 0x55b29ca3f9d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b29ca388e0 0x55b29ca3acf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f0114036e60 0x7f0114039320 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.046+0000 7f023313f800 1 --2- 172.21.15.119:0/2274792615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b29c901a50 0x55b29c901340 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.047+0000 7f023313f800 1 -- 172.21.15.119:0/2274792615 >> 172.21.15.119:0/2274792615 conn(0x55b29c8fb400 msgr2=0x55b29c9ec2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.047+0000 7f023313f800 1 -- 172.21.15.119:0/2274792615 shutdown_connections 2024-04-23T18:31:18.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.047+0000 7f023313f800 1 -- 172.21.15.119:0/2274792615 wait complete. 2024-04-23T18:31:18.051 INFO:teuthology.orchestra.run.smithi119.stdout:{"id":"4f165054-0d30-4e3c-af82-245e56f34813","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85","zones":[{"id":"b69d402b-cbc2-4a79-bc3a-05ce158bbf85","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-04-23T18:31:18.051 DEBUG:tasks.util.rgw: json result: {'id': '4f165054-0d30-4e3c-af82-245e56f34813', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85', 'zones': [{'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-04-23T18:31:18.054 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-04-23T18:31:18.074 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-23T18:31:18.074 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-23T18:31:18.074 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-04-23T18:31:18.144 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:18.144 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.152+0000 7f56faa16800 1 Processor -- start 2024-04-23T18:31:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.152+0000 7f56faa16800 1 -- start start 2024-04-23T18:31:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.152+0000 7f56faa16800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e4db3ee350 0x55e4db3f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.152+0000 7f56faa16800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4db29e560 con 0x55e4db3ec810 2024-04-23T18:31:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.152+0000 7f56faa16800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55e4db28fe20 con 0x55e4db3ee350 2024-04-23T18:31:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.152+0000 7f56f5883640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e4db3ee350 0x55e4db3f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.152+0000 7f56f5883640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e4db3ee350 0x55e4db3f6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54880/0 (socket says 172.21.15.119:54880) 2024-04-23T18:31:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.152+0000 7f56f5883640 1 -- 172.21.15.119:0/2514805408 learned_addr learned my addr 172.21.15.119:0/2514805408 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.152+0000 7f56f6084640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55e4db3ec810 0x55e4db3ecc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50548/0 (socket says 172.21.15.119:50548) 2024-04-23T18:31:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.152+0000 7f56f5883640 1 -- 172.21.15.119:0/2514805408 >> v1:172.21.15.62:6789/0 conn(0x55e4db3ec810 legacy=0x55e4db3ecc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.146 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.152+0000 7f56f5883640 1 -- 172.21.15.119:0/2514805408 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4db29de60 con 0x55e4db3ee350 2024-04-23T18:31:18.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.154+0000 7f56f5883640 1 --2- 172.21.15.119:0/2514805408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ee350 0x55e4db3f6e50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00a520 tx=0x7f56ec01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411bdde4149c1ff server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.148 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.154+0000 7f56f5082640 1 -- 172.21.15.119:0/2514805408 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec057070 con 0x55e4db3ee350 2024-04-23T18:31:18.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.154+0000 7f56f5082640 1 -- 172.21.15.119:0/2514805408 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ec052570 con 0x55e4db3ee350 2024-04-23T18:31:18.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.155+0000 7f56f5082640 1 -- 172.21.15.119:0/2514805408 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec052870 con 0x55e4db3ee350 2024-04-23T18:31:18.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.155+0000 7f56faa16800 1 -- 172.21.15.119:0/2514805408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ee350 msgr2=0x55e4db3f6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.155+0000 7f56faa16800 1 --2- 172.21.15.119:0/2514805408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ee350 0x55e4db3f6e50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00a520 tx=0x7f56ec01d010 comp rx=0 tx=0).stop 2024-04-23T18:31:18.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.155+0000 7f56faa16800 1 -- 172.21.15.119:0/2514805408 shutdown_connections 2024-04-23T18:31:18.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.155+0000 7f56faa16800 1 --2- 172.21.15.119:0/2514805408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ee350 0x55e4db3f6e50 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.155+0000 7f56faa16800 1 -- 172.21.15.119:0/2514805408 >> 172.21.15.119:0/2514805408 conn(0x55e4db3e83b0 msgr2=0x55e4db3ea7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.155+0000 7f56faa16800 1 -- 172.21.15.119:0/2514805408 shutdown_connections 2024-04-23T18:31:18.149 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.155+0000 7f56faa16800 1 -- 172.21.15.119:0/2514805408 wait complete. 2024-04-23T18:31:18.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.167+0000 7f56faa16800 1 Processor -- start 2024-04-23T18:31:18.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.167+0000 7f56faa16800 1 -- start start 2024-04-23T18:31:18.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.167+0000 7f56faa16800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ec810 0x55e4db4e1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.167+0000 7f56faa16800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e4db339550 con 0x55e4db3ec810 2024-04-23T18:31:18.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.167+0000 7f56f6084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ec810 0x55e4db4e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.167+0000 7f56f6084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ec810 0x55e4db4e1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54888/0 (socket says 172.21.15.119:54888) 2024-04-23T18:31:18.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.167+0000 7f56f6084640 1 -- 172.21.15.119:0/2176686786 learned_addr learned my addr 172.21.15.119:0/2176686786 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.161 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.167+0000 7f56f6084640 1 -- 172.21.15.119:0/2176686786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4db2af860 con 0x55e4db3ec810 2024-04-23T18:31:18.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.168+0000 7f56f6084640 1 --2- 172.21.15.119:0/2176686786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ec810 0x55e4db4e1790 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f56e8001e10 tx=0x7f56e800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2028f1e4bf9e7dd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.168+0000 7f55e4608640 1 -- 172.21.15.119:0/2176686786 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e800e5c0 con 0x55e4db3ec810 2024-04-23T18:31:18.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.168+0000 7f55e4608640 1 -- 172.21.15.119:0/2176686786 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e8006070 con 0x55e4db3ec810 2024-04-23T18:31:18.162 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.168+0000 7f55e4608640 1 -- 172.21.15.119:0/2176686786 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e800e930 con 0x55e4db3ec810 2024-04-23T18:31:18.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.168+0000 7f56faa16800 1 -- 172.21.15.119:0/2176686786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ec810 msgr2=0x55e4db4e1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.168+0000 7f56faa16800 1 --2- 172.21.15.119:0/2176686786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ec810 0x55e4db4e1790 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f56e8001e10 tx=0x7f56e800b6c0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.168+0000 7f56faa16800 1 -- 172.21.15.119:0/2176686786 shutdown_connections 2024-04-23T18:31:18.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.168+0000 7f56faa16800 1 --2- 172.21.15.119:0/2176686786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ec810 0x55e4db4e1790 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.168+0000 7f56faa16800 1 -- 172.21.15.119:0/2176686786 >> 172.21.15.119:0/2176686786 conn(0x55e4db3e83b0 msgr2=0x55e4db4dd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.169+0000 7f56faa16800 1 -- 172.21.15.119:0/2176686786 shutdown_connections 2024-04-23T18:31:18.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.169+0000 7f56faa16800 1 -- 172.21.15.119:0/2176686786 wait complete. 2024-04-23T18:31:18.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.169+0000 7f56faa16800 1 Processor -- start 2024-04-23T18:31:18.166 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.169+0000 7f56faa16800 1 -- start start 2024-04-23T18:31:18.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.169+0000 7f56faa16800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ec810 0x55e4db4e9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.169+0000 7f56faa16800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e4db3f9670 con 0x55e4db3ec810 2024-04-23T18:31:18.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.169+0000 7f56f6084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ec810 0x55e4db4e9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.169+0000 7f56f6084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ec810 0x55e4db4e9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54896/0 (socket says 172.21.15.119:54896) 2024-04-23T18:31:18.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.169+0000 7f56f6084640 1 -- 172.21.15.119:0/1545263550 learned_addr learned my addr 172.21.15.119:0/1545263550 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.169+0000 7f56f6084640 1 -- 172.21.15.119:0/1545263550 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4db2adeb0 con 0x55e4db3ec810 2024-04-23T18:31:18.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.170+0000 7f56f6084640 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ec810 0x55e4db4e9160 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f56e800b700 tx=0x7f56e8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.170+0000 7f55e2e05640 1 -- 172.21.15.119:0/1545263550 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e800f8d0 con 0x55e4db3ec810 2024-04-23T18:31:18.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.170+0000 7f55e2e05640 1 -- 172.21.15.119:0/1545263550 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e800fa70 con 0x55e4db3ec810 2024-04-23T18:31:18.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.170+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4db4e96a0 con 0x55e4db3ec810 2024-04-23T18:31:18.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.170+0000 7f55e2e05640 1 -- 172.21.15.119:0/1545263550 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e800fd50 con 0x55e4db3ec810 2024-04-23T18:31:18.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.170+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4db4e9bc0 con 0x55e4db3ec810 2024-04-23T18:31:18.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.171+0000 7f55e2e05640 1 -- 172.21.15.119:0/1545263550 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f56e8017070 con 0x55e4db3ec810 2024-04-23T18:31:18.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.171+0000 7f55e2e05640 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55dc036e60 0x7f55dc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.171+0000 7f55e2e05640 1 -- 172.21.15.119:0/1545263550 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f56e8015020 con 0x55e4db3ec810 2024-04-23T18:31:18.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.171+0000 7f56f5883640 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55dc036e60 0x7f55dc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.171+0000 7f56faa16800 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e4db3ee350 0x55e4db4f0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.171+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db4f0700 con 0x55e4db3ee350 2024-04-23T18:31:18.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.171+0000 7f56f6885640 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e4db3ee350 0x55e4db4f0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.171+0000 7f56f5883640 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55dc036e60 0x7f55dc039320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f56ec054000 tx=0x7f56ec04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.171+0000 7f56f6885640 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e4db3ee350 0x55e4db4f0180 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.172+0000 7f56f6885640 1 -- 172.21.15.119:0/1545263550 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db3ee350 2024-04-23T18:31:18.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.172+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db4ed750 con 0x55e4db3ee350 2024-04-23T18:31:18.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.172+0000 7f56f6885640 1 -- 172.21.15.119:0/1545263550 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db3ee350 2024-04-23T18:31:18.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.172+0000 7f56faa16800 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e4db4f2a50 0x55e4db4f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.172+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db4f5530 con 0x55e4db4f2a50 2024-04-23T18:31:18.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.172+0000 7f56f6084640 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e4db4f2a50 0x55e4db4f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.172+0000 7f56f6084640 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e4db4f2a50 0x55e4db4f4e40 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.173+0000 7f56f6084640 1 -- 172.21.15.119:0/1545263550 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f56e802e070 con 0x55e4db4f2a50 2024-04-23T18:31:18.169 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.173+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db4f1a00 con 0x55e4db3ee350 2024-04-23T18:31:18.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.173+0000 7f56f6885640 1 -- 172.21.15.119:0/1545263550 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db3ee350 2024-04-23T18:31:18.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.173+0000 7f56faa16800 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e4db4f69e0 0x55e4db4f8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.173+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db4f9590 con 0x55e4db4f69e0 2024-04-23T18:31:18.184 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.173+0000 7f56f5883640 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e4db4f69e0 0x55e4db4f8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.174+0000 7f56f5883640 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e4db4f69e0 0x55e4db4f8e30 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.174+0000 7f56f5883640 1 -- 172.21.15.119:0/1545263550 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f56ec05a040 con 0x55e4db4f69e0 2024-04-23T18:31:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.174+0000 7f56faa16800 1 Processor -- start 2024-04-23T18:31:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.174+0000 7f56faa16800 1 -- start start 2024-04-23T18:31:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.175+0000 7f56faa16800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db5079f0 0x55e4db507e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.175+0000 7f56faa16800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e4db2dfdf0 con 0x55e4db5079f0 2024-04-23T18:31:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.175+0000 7f56f6084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db5079f0 0x55e4db507e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.175+0000 7f56f6084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db5079f0 0x55e4db507e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54902/0 (socket says 172.21.15.119:54902) 2024-04-23T18:31:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.175+0000 7f56f6084640 1 -- 172.21.15.119:0/2662688616 learned_addr learned my addr 172.21.15.119:0/2662688616 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.175+0000 7f56f6084640 1 -- 172.21.15.119:0/2662688616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4db508350 con 0x55e4db5079f0 2024-04-23T18:31:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.175+0000 7f56f6084640 1 --2- 172.21.15.119:0/2662688616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db5079f0 0x55e4db507e10 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f56e801cfd0 tx=0x7f56e801b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.175+0000 7f55dbfff640 1 -- 172.21.15.119:0/2662688616 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e80179a0 con 0x55e4db5079f0 2024-04-23T18:31:18.185 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.175+0000 7f55dbfff640 1 -- 172.21.15.119:0/2662688616 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e8044070 con 0x55e4db5079f0 2024-04-23T18:31:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.175+0000 7f56faa16800 1 -- 172.21.15.119:0/2662688616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4db508dc0 con 0x55e4db5079f0 2024-04-23T18:31:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.175+0000 7f55dbfff640 1 -- 172.21.15.119:0/2662688616 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e8017cd0 con 0x55e4db5079f0 2024-04-23T18:31:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.175+0000 7f56faa16800 1 -- 172.21.15.119:0/2662688616 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4db5092c0 con 0x55e4db5079f0 2024-04-23T18:31:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.176+0000 7f55dbfff640 1 -- 172.21.15.119:0/2662688616 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f56e804dbb0 con 0x55e4db5079f0 2024-04-23T18:31:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.176+0000 7f55dbfff640 1 --2- 172.21.15.119:0/2662688616 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55d0036e60 0x7f55d0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.176+0000 7f55dbfff640 1 -- 172.21.15.119:0/2662688616 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f56e8005200 con 0x55e4db5079f0 2024-04-23T18:31:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.176+0000 7f56f5883640 1 --2- 172.21.15.119:0/2662688616 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55d0036e60 0x7f55d0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.176+0000 7f56faa16800 1 Processor -- start 2024-04-23T18:31:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.177+0000 7f56faa16800 1 -- start start 2024-04-23T18:31:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.177+0000 7f56f5883640 1 --2- 172.21.15.119:0/2662688616 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55d0036e60 0x7f55d0039320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55e4db4f1000 tx=0x7f56ec005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.177+0000 7f56faa16800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 0x55e4db515030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.186 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.177+0000 7f56faa16800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e4db4e1f10 con 0x55e4db514c10 2024-04-23T18:31:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.177+0000 7f56f6084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 0x55e4db515030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.177+0000 7f56f6084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 0x55e4db515030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54914/0 (socket says 172.21.15.119:54914) 2024-04-23T18:31:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.177+0000 7f56f6084640 1 -- 172.21.15.119:0/2761811216 learned_addr learned my addr 172.21.15.119:0/2761811216 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.177+0000 7f56f6084640 1 -- 172.21.15.119:0/2761811216 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4db515600 con 0x55e4db514c10 2024-04-23T18:31:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.177+0000 7f56f6084640 1 --2- 172.21.15.119:0/2761811216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 0x55e4db515030 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f56e8011ff0 tx=0x7f56e8045280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed286eb9be5cb385 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.177+0000 7f55d9ffb640 1 -- 172.21.15.119:0/2761811216 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e8032dd0 con 0x55e4db514c10 2024-04-23T18:31:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.177+0000 7f55d9ffb640 1 -- 172.21.15.119:0/2761811216 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e801a660 con 0x55e4db514c10 2024-04-23T18:31:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.178+0000 7f55d9ffb640 1 -- 172.21.15.119:0/2761811216 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e8045510 con 0x55e4db514c10 2024-04-23T18:31:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.178+0000 7f56faa16800 1 -- 172.21.15.119:0/2761811216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 msgr2=0x55e4db515030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.178+0000 7f56faa16800 1 --2- 172.21.15.119:0/2761811216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 0x55e4db515030 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f56e8011ff0 tx=0x7f56e8045280 comp rx=0 tx=0).stop 2024-04-23T18:31:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.178+0000 7f56faa16800 1 -- 172.21.15.119:0/2761811216 shutdown_connections 2024-04-23T18:31:18.187 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.178+0000 7f56faa16800 1 --2- 172.21.15.119:0/2761811216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 0x55e4db515030 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.178+0000 7f56faa16800 1 -- 172.21.15.119:0/2761811216 >> 172.21.15.119:0/2761811216 conn(0x55e4db510e90 msgr2=0x55e4db50eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.178+0000 7f56faa16800 1 -- 172.21.15.119:0/2761811216 shutdown_connections 2024-04-23T18:31:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.178+0000 7f56faa16800 1 -- 172.21.15.119:0/2761811216 wait complete. 2024-04-23T18:31:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.178+0000 7f56faa16800 1 Processor -- start 2024-04-23T18:31:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.178+0000 7f56faa16800 1 -- start start 2024-04-23T18:31:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.178+0000 7f56faa16800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 0x55e4db51bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.178+0000 7f56faa16800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e4db515c70 con 0x55e4db514c10 2024-04-23T18:31:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.179+0000 7f56f6084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 0x55e4db51bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.179+0000 7f56f6084640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 0x55e4db51bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54928/0 (socket says 172.21.15.119:54928) 2024-04-23T18:31:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.179+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 learned_addr learned my addr 172.21.15.119:0/2997625108 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.179+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4db51c4c0 con 0x55e4db514c10 2024-04-23T18:31:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.179+0000 7f56f6084640 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 0x55e4db51bf80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f56e801bab0 tx=0x7f56e8004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.188 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.179+0000 7f55c7fff640 1 -- 172.21.15.119:0/2997625108 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e8032dd0 con 0x55e4db514c10 2024-04-23T18:31:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.179+0000 7f55c7fff640 1 -- 172.21.15.119:0/2997625108 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e8019a20 con 0x55e4db514c10 2024-04-23T18:31:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.179+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4db51c4c0 con 0x55e4db514c10 2024-04-23T18:31:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.179+0000 7f55c7fff640 1 -- 172.21.15.119:0/2997625108 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56e8019d00 con 0x55e4db514c10 2024-04-23T18:31:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.179+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4db51c4c0 con 0x55e4db514c10 2024-04-23T18:31:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.180+0000 7f55c7fff640 1 -- 172.21.15.119:0/2997625108 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f56e8013130 con 0x55e4db514c10 2024-04-23T18:31:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.180+0000 7f55c7fff640 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55c0036e60 0x7f55c0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.180+0000 7f55c7fff640 1 -- 172.21.15.119:0/2997625108 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f56e8071d00 con 0x55e4db514c10 2024-04-23T18:31:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.180+0000 7f56f5883640 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55c0036e60 0x7f55c0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.181+0000 7f56f5883640 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55c0036e60 0x7f55c0039320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55e4db4f9990 tx=0x7f56ec04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.181+0000 7f56faa16800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.181+0000 7f56faa16800 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e4db5276d0 0x55e4db529b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.181+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52a2e0 con 0x55e4db5276d0 2024-04-23T18:31:18.189 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.181+0000 7f56f6885640 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e4db5276d0 0x55e4db529b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.181+0000 7f56f6885640 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e4db5276d0 0x55e4db529b90 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.181+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db5276d0 2024-04-23T18:31:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.181+0000 7f56faa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.181+0000 7f56faa16800 20 realm 2024-04-23T18:31:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.181+0000 7f56faa16800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.181+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52a6f0 con 0x55e4db5276d0 2024-04-23T18:31:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db5276d0 2024-04-23T18:31:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56faa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56faa16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56faa16800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52afc0 con 0x55e4db5276d0 2024-04-23T18:31:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db5276d0 2024-04-23T18:31:18.190 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56faa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56faa16800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db5276d0 2024-04-23T18:31:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db5276d0 2024-04-23T18:31:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56faa16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56faa16800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56faa16800 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e4db52c0c0 0x55e4db52e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52eac0 con 0x55e4db52c0c0 2024-04-23T18:31:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56f6084640 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e4db52c0c0 0x55e4db52e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.182+0000 7f56f6084640 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e4db52c0c0 0x55e4db52e4b0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.183+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f56e802e070 con 0x55e4db52c0c0 2024-04-23T18:31:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.183+0000 7f56faa16800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.183+0000 7f56faa16800 20 searching for the correct realm 2024-04-23T18:31:18.191 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.183+0000 7f56faa16800 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e4db530a70 0x55e4db532f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.183+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db533600 con 0x55e4db530a70 2024-04-23T18:31:18.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.183+0000 7f56f5883640 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e4db530a70 0x55e4db532f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.183+0000 7f56f5883640 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e4db530a70 0x55e4db532f30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.183+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.183+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db533600 con 0x55e4db52c0c0 2024-04-23T18:31:18.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.184+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e802e070 con 0x55e4db52c0c0 2024-04-23T18:31:18.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.184+0000 7f56f6084640 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f56e807b040 0x7f56e8027870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.184+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db533600 con 0x7f56e807b040 2024-04-23T18:31:18.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.184+0000 7f56f6885640 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f56e807b040 0x7f56e8027870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.184+0000 7f56f6885640 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f56e807b040 0x7f56e8027870 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.185+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f000a4a0 con 0x7f56e807b040 2024-04-23T18:31:18.192 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.185+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db5276d0 2024-04-23T18:31:18.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.185+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db5276d0 2024-04-23T18:31:18.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.185+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db5276d0 2024-04-23T18:31:18.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.185+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db5276d0 2024-04-23T18:31:18.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.185+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x7f56e807b040 2024-04-23T18:31:18.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.185+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f000a4a0 con 0x7f56e807b040 2024-04-23T18:31:18.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.185+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x7f56e807b040 2024-04-23T18:31:18.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.185+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f56f000a4a0 con 0x7f56e807b040 2024-04-23T18:31:18.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.186+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db52c0c0 2024-04-23T18:31:18.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.186+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e802e070 con 0x55e4db52c0c0 2024-04-23T18:31:18.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.186+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db530a70 2024-04-23T18:31:18.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.186+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.186+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db5276d0 2024-04-23T18:31:18.193 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.186+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db5276d0 2024-04-23T18:31:18.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.186+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x7f56e807b040 2024-04-23T18:31:18.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.187+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f000a4a0 con 0x7f56e807b040 2024-04-23T18:31:18.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.187+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db5276d0 2024-04-23T18:31:18.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.187+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db5276d0 2024-04-23T18:31:18.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.187+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db52c0c0 2024-04-23T18:31:18.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.187+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f56e802e070 con 0x55e4db52c0c0 2024-04-23T18:31:18.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.187+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db530a70 2024-04-23T18:31:18.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.187+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.187+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db530a70 2024-04-23T18:31:18.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.187+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.187+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x7f56e807b040 2024-04-23T18:31:18.194 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.188+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f000a4a0 con 0x7f56e807b040 2024-04-23T18:31:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.188+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db530a70 2024-04-23T18:31:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.188+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.188+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db530a70 2024-04-23T18:31:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.188+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.188+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db5276d0 2024-04-23T18:31:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.188+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db5276d0 2024-04-23T18:31:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.189+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db5276d0 2024-04-23T18:31:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.189+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db5276d0 2024-04-23T18:31:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.189+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x7f56e807b040 2024-04-23T18:31:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.189+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f000a4a0 con 0x7f56e807b040 2024-04-23T18:31:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.189+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db530a70 2024-04-23T18:31:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.189+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.189+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db52c0c0 2024-04-23T18:31:18.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.190+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f56e802e070 con 0x55e4db52c0c0 2024-04-23T18:31:18.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.190+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db5276d0 2024-04-23T18:31:18.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.190+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f000a4a0 con 0x55e4db5276d0 2024-04-23T18:31:18.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.190+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db52c0c0 2024-04-23T18:31:18.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.190+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e802e070 con 0x55e4db52c0c0 2024-04-23T18:31:18.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.190+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db530a70 2024-04-23T18:31:18.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.190+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.190+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x7f56e807b040 2024-04-23T18:31:18.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.191+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f000a4a0 con 0x7f56e807b040 2024-04-23T18:31:18.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.191+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db52c0c0 2024-04-23T18:31:18.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.191+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e8088040 con 0x55e4db52c0c0 2024-04-23T18:31:18.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.191+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db530a70 2024-04-23T18:31:18.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.191+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.191+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x7f56e807b040 2024-04-23T18:31:18.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.191+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56f000a4a0 con 0x7f56e807b040 2024-04-23T18:31:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.191+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db5276d0 2024-04-23T18:31:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52b360 con 0x55e4db52c0c0 2024-04-23T18:31:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56e8088040 con 0x55e4db52c0c0 2024-04-23T18:31:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52f380 con 0x55e4db5276d0 2024-04-23T18:31:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52f770 con 0x55e4db5276d0 2024-04-23T18:31:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.192+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db52f770 con 0x7f56e807b040 2024-04-23T18:31:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f56f0040080 con 0x7f56e807b040 2024-04-23T18:31:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 20 zone default found 2024-04-23T18:31:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 4 Realm: () 2024-04-23T18:31:18.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 20 zonegroup default 2024-04-23T18:31:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db533a80 con 0x55e4db52c0c0 2024-04-23T18:31:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f56e8088040 con 0x55e4db52c0c0 2024-04-23T18:31:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db535800 con 0x55e4db530a70 2024-04-23T18:31:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.193+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db535ba0 con 0x55e4db530a70 2024-04-23T18:31:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.194+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.194+0000 7f56faa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.194+0000 7f56faa16800 20 started sync module instance, tier type = 2024-04-23T18:31:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.194+0000 7f56faa16800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.194+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db534ca0 con 0x55e4db52c0c0 2024-04-23T18:31:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.195+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e8088040 con 0x55e4db52c0c0 2024-04-23T18:31:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.195+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94441420572656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db535f40 con 0x55e4db52c0c0 2024-04-23T18:31:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.195+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db536810 con 0x55e4db5276d0 2024-04-23T18:31:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.196+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.196+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94441420579552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db5370b0 con 0x55e4db5276d0 2024-04-23T18:31:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.196+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db537b90 con 0x55e4db530a70 2024-04-23T18:31:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.197+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94441420579552] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.211 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.197+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94441420572656] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e8088040 con 0x55e4db52c0c0 2024-04-23T18:31:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.198+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.198+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94441420574912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db5370b0 con 0x55e4db530a70 2024-04-23T18:31:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.198+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db5384c0 con 0x55e4db52c0c0 2024-04-23T18:31:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.199+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e8088040 con 0x55e4db52c0c0 2024-04-23T18:31:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.199+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94441420589232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db539180 con 0x55e4db52c0c0 2024-04-23T18:31:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.199+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db539bf0 con 0x55e4db5276d0 2024-04-23T18:31:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.199+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94441420574912] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.200+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94441420589232] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e8088040 con 0x55e4db52c0c0 2024-04-23T18:31:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.200+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.200+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94441420592832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db538cd0 con 0x55e4db5276d0 2024-04-23T18:31:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.200+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db53a490 con 0x7f56e807b040 2024-04-23T18:31:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.201+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94441420592832] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.212 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.201+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x7f56e807b040 2024-04-23T18:31:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.201+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94441420581888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db538cd0 con 0x7f56e807b040 2024-04-23T18:31:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.201+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db53aa60 con 0x7f56e807b040 2024-04-23T18:31:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.202+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94441420581888] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x7f56e807b040 2024-04-23T18:31:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.203+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x7f56e807b040 2024-04-23T18:31:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.203+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94441420596560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db53aa20 con 0x7f56e807b040 2024-04-23T18:31:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.203+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db53b460 con 0x7f56e807b040 2024-04-23T18:31:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.204+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(58 notify.7 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x7f56e807b040 2024-04-23T18:31:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.204+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94441420596560] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x7f56e807b040 2024-04-23T18:31:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.204+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94441420599088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db53b8d0 con 0x7f56e807b040 2024-04-23T18:31:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.204+0000 7f56faa16800 20 add_watcher() i=0 2024-04-23T18:31:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.204+0000 7f56faa16800 20 add_watcher() i=1 2024-04-23T18:31:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.204+0000 7f56faa16800 20 add_watcher() i=2 2024-04-23T18:31:18.213 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.204+0000 7f56faa16800 20 add_watcher() i=3 2024-04-23T18:31:18.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.204+0000 7f56faa16800 20 add_watcher() i=4 2024-04-23T18:31:18.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.204+0000 7f56faa16800 20 add_watcher() i=5 2024-04-23T18:31:18.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.204+0000 7f56faa16800 20 add_watcher() i=6 2024-04-23T18:31:18.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.205+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94441420599088] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x7f56e807b040 2024-04-23T18:31:18.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.205+0000 7f56faa16800 20 add_watcher() i=7 2024-04-23T18:31:18.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.205+0000 7f56faa16800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:18.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.205+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db53b8d0 con 0x55e4db5276d0 2024-04-23T18:31:18.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.205+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.205+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94441420600352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db53b840 con 0x55e4db5276d0 2024-04-23T18:31:18.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.206+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94441420600352] v34'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.206+0000 7f55acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:18.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.206+0000 7f56faa16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:18.214 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.206+0000 7f56faa16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.206+0000 7f56faa16800 5 note: GC not initialized 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.206+0000 7f55277fe640 20 reqs_thread_entry: start 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 20 Filter name: none 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f55257fa640 20 reqs_thread_entry: start 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db572100 con 0x7f56e807b040 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x7f56e807b040 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-04-23T18:31:18.215 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db570740 con 0x55e4db5276d0 2024-04-23T18:31:18.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-04-23T18:31:18.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-23T18:31:18.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-23T18:31:18.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-23T18:31:18.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.207+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db571140 con 0x7f56e807b040 2024-04-23T18:31:18.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x7f56e807b040 2024-04-23T18:31:18.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f56faa16800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:18.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f56faa16800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:18.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f56faa16800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-23T18:31:18.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94441420819296 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db575c20 con 0x55e4db5276d0 2024-04-23T18:31:18.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== watch-notify(notify (1) cookie 94441420592832 notify 146028888095 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55e4db5714e0 con 0x55e4db5276d0 2024-04-23T18:31:18.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f55d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 94441420592832 notifier 4826 bl.length()=649 2024-04-23T18:31:18.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.4 [notify cookie 94441420819296 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f55d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:18.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f55d9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:18.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f55d9ffb640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f55bc003ea0 con 0x55e4db5276d0 2024-04-23T18:31:18.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== watch-notify(notify_complete (2) cookie 94441420819296 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e4db571d40 con 0x55e4db5276d0 2024-04-23T18:31:18.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.209+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db570ae0 con 0x55e4db5276d0 2024-04-23T18:31:18.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.210+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v34'22 uv22 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.210+0000 7f56faa16800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-23T18:31:18.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.210+0000 7f56faa16800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-23T18:31:18.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.210+0000 7f56faa16800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-04-23T18:31:18.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.211+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94441420819168 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4db576050 con 0x55e4db530a70 2024-04-23T18:31:18.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.211+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== watch-notify(notify (1) cookie 94441420574912 notify 146028888072 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f56ec088040 con 0x55e4db530a70 2024-04-23T18:31:18.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.211+0000 7f55d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 94441420574912 notifier 4826 bl.length()=177 2024-04-23T18:31:18.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.211+0000 7f55d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-23T18:31:18.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.211+0000 7f55d9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-23T18:31:18.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.211+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(68 notify.2 [notify cookie 94441420819168 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.211+0000 7f55d9ffb640 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f55bc003ea0 con 0x55e4db530a70 2024-04-23T18:31:18.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.211+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== watch-notify(notify_complete (2) cookie 94441420819168 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e4db29de60 con 0x55e4db530a70 2024-04-23T18:31:18.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.211+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.219 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-23T18:31:18.209839Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:31:18.209827Z","tags":[],"group_ids":[]} 2024-04-23T18:31:18.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.212+0000 7f55acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:18.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.212+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94441420600352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db573540 con 0x55e4db5276d0 2024-04-23T18:31:18.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.213+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94441420600352] v34'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.213+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94441420572656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db53b420 con 0x55e4db52c0c0 2024-04-23T18:31:18.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.214+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94441420572656] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e8088040 con 0x55e4db52c0c0 2024-04-23T18:31:18.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.214+0000 7f56faa16800 20 remove_watcher() i=0 2024-04-23T18:31:18.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.214+0000 7f56faa16800 2 removed watcher, disabling cache 2024-04-23T18:31:18.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.214+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94441420579552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db53b420 con 0x55e4db5276d0 2024-04-23T18:31:18.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.215+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94441420579552] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.215+0000 7f56faa16800 20 remove_watcher() i=1 2024-04-23T18:31:18.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.215+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94441420574912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db53b420 con 0x55e4db530a70 2024-04-23T18:31:18.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.216+0000 7f56f5883640 1 -- 172.21.15.119:0/2997625108 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94441420574912] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56ec07f070 con 0x55e4db530a70 2024-04-23T18:31:18.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.216+0000 7f56faa16800 20 remove_watcher() i=2 2024-04-23T18:31:18.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.216+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94441420589232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db5350c0 con 0x55e4db52c0c0 2024-04-23T18:31:18.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.217+0000 7f56f6084640 1 -- 172.21.15.119:0/2997625108 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94441420589232] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56e8088040 con 0x55e4db52c0c0 2024-04-23T18:31:18.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.217+0000 7f56faa16800 20 remove_watcher() i=3 2024-04-23T18:31:18.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.217+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94441420592832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db5350c0 con 0x55e4db5276d0 2024-04-23T18:31:18.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.218+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94441420592832] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x55e4db5276d0 2024-04-23T18:31:18.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.218+0000 7f56faa16800 20 remove_watcher() i=4 2024-04-23T18:31:18.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.218+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94441420581888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db5396c0 con 0x7f56e807b040 2024-04-23T18:31:18.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.219+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94441420581888] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x7f56e807b040 2024-04-23T18:31:18.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.219+0000 7f56faa16800 20 remove_watcher() i=5 2024-04-23T18:31:18.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.219+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94441420596560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db5350c0 con 0x7f56e807b040 2024-04-23T18:31:18.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.221+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94441420596560] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x7f56e807b040 2024-04-23T18:31:18.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.221+0000 7f56faa16800 20 remove_watcher() i=6 2024-04-23T18:31:18.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.221+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94441420599088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4db5396c0 con 0x7f56e807b040 2024-04-23T18:31:18.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94441420599088] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56f0040080 con 0x7f56e807b040 2024-04-23T18:31:18.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 20 remove_watcher() i=7 2024-04-23T18:31:18.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f56e807b040 msgr2=0x7f56e8027870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f56e807b040 0x7f56e8027870 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e4db5276d0 msgr2=0x55e4db529b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e4db5276d0 0x55e4db529b90 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e4db52c0c0 msgr2=0x55e4db52e4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e4db52c0c0 0x55e4db52e4b0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e4db530a70 msgr2=0x55e4db532f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55e4db530a70 0x55e4db532f30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55c0036e60 msgr2=0x7f55c0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55c0036e60 0x7f55c0039320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55e4db4f9990 tx=0x7f56ec04f000 comp rx=0 tx=0).stop 2024-04-23T18:31:18.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 msgr2=0x55e4db51bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56f6885640 1 -- 172.21.15.119:0/2997625108 reap_dead start 2024-04-23T18:31:18.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 0x55e4db51bf80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f56e801bab0 tx=0x7f56e8004f90 comp rx=0 tx=0).stop 2024-04-23T18:31:18.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 shutdown_connections 2024-04-23T18:31:18.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 --2- 172.21.15.119:0/2997625108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db514c10 0x55e4db51bf80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 >> 172.21.15.119:0/2997625108 conn(0x55e4db510e90 msgr2=0x55e4db50e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 shutdown_connections 2024-04-23T18:31:18.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2997625108 wait complete. 2024-04-23T18:31:18.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2662688616 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55d0036e60 msgr2=0x7f55d0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 --2- 172.21.15.119:0/2662688616 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55d0036e60 0x7f55d0039320 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55e4db4f1000 tx=0x7f56ec005ac0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2662688616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db5079f0 msgr2=0x55e4db507e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 --2- 172.21.15.119:0/2662688616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db5079f0 0x55e4db507e10 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f56e801cfd0 tx=0x7f56e801b960 comp rx=0 tx=0).stop 2024-04-23T18:31:18.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2662688616 shutdown_connections 2024-04-23T18:31:18.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 --2- 172.21.15.119:0/2662688616 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55d0036e60 0x7f55d0039320 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 --2- 172.21.15.119:0/2662688616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db5079f0 0x55e4db507e10 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.222+0000 7f56faa16800 1 -- 172.21.15.119:0/2662688616 >> 172.21.15.119:0/2662688616 conn(0x55e4db4fba90 msgr2=0x55e4db4fbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 -- 172.21.15.119:0/2662688616 shutdown_connections 2024-04-23T18:31:18.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 -- 172.21.15.119:0/2662688616 wait complete. 2024-04-23T18:31:18.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e4db4f69e0 msgr2=0x55e4db4f8e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55e4db4f69e0 0x55e4db4f8e30 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e4db3ee350 msgr2=0x55e4db4f0180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55e4db3ee350 0x55e4db4f0180 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e4db4f2a50 msgr2=0x55e4db4f4e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55e4db4f2a50 0x55e4db4f4e40 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55dc036e60 msgr2=0x7f55dc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f55dc036e60 0x7f55dc039320 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f56ec054000 tx=0x7f56ec04e000 comp rx=0 tx=0).stop 2024-04-23T18:31:18.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ec810 msgr2=0x55e4db4e9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 --2- 172.21.15.119:0/1545263550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e4db3ec810 0x55e4db4e9160 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f56e800b700 tx=0x7f56e8000bc0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56f6885640 1 -- 172.21.15.119:0/1545263550 reap_dead start 2024-04-23T18:31:18.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 shutdown_connections 2024-04-23T18:31:18.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 >> 172.21.15.119:0/1545263550 conn(0x55e4db3e83b0 msgr2=0x55e4db4db8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 shutdown_connections 2024-04-23T18:31:18.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.223+0000 7f56faa16800 1 -- 172.21.15.119:0/1545263550 wait complete. 2024-04-23T18:31:18.231 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:18.231 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:18.231 ERROR:root:0 2024-04-23T18:31:18.232 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:18.238 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000f7669df50681d7b9-006627fe76-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:31:18.239 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-04-23T18:31:18.248 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:18.249 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-04-23T18:31:18.263 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-04-23T18:31:18.263 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-04-23T18:31:18.280 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-23T18:31:18.280 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-23T18:31:18.289 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-04-23T18:31:18.289 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:18.293 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:18.293 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-04-23T18:31:18.298 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:18.298 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-23T18:31:18.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-23T18:31:18.298 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-04-23T18:31:18.343 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:18.343 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:18.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.350+0000 7fc38b72d800 1 Processor -- start 2024-04-23T18:31:18.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.350+0000 7fc38b72d800 1 -- start start 2024-04-23T18:31:18.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.350+0000 7fc38b72d800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55985040f3c0 0x5598504117b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.350+0000 7fc38b72d800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598502bb560 con 0x55985040af80 2024-04-23T18:31:18.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.350+0000 7fc38b72d800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5598502ace20 con 0x55985040f3c0 2024-04-23T18:31:18.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.351+0000 7fc37ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55985040f3c0 0x5598504117b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.351+0000 7fc38737f640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55985040af80 0x55985040b3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50560/0 (socket says 172.21.15.119:50560) 2024-04-23T18:31:18.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.351+0000 7fc38737f640 1 -- 172.21.15.119:0/1785556616 learned_addr learned my addr 172.21.15.119:0/1785556616 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:31:18.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.351+0000 7fc37ffff640 1 -- 172.21.15.119:0/1785556616 >> v1:172.21.15.62:6789/0 conn(0x55985040af80 legacy=0x55985040b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.345 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.351+0000 7fc37ffff640 1 -- 172.21.15.119:0/1785556616 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598502bae60 con 0x55985040f3c0 2024-04-23T18:31:18.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.353+0000 7fc37ffff640 1 --2- 172.21.15.119:0/1785556616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040f3c0 0x5598504117b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc37000a470 tx=0x7fc37001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a3dd755bb4f291 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.353+0000 7fc386b7e640 1 -- 172.21.15.119:0/1785556616 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc370057070 con 0x55985040f3c0 2024-04-23T18:31:18.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.353+0000 7fc386b7e640 1 -- 172.21.15.119:0/1785556616 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc370052570 con 0x55985040f3c0 2024-04-23T18:31:18.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.353+0000 7fc386b7e640 1 -- 172.21.15.119:0/1785556616 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc370052870 con 0x55985040f3c0 2024-04-23T18:31:18.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.353+0000 7fc38b72d800 1 -- 172.21.15.119:0/1785556616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040f3c0 msgr2=0x5598504117b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.353+0000 7fc38b72d800 1 --2- 172.21.15.119:0/1785556616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040f3c0 0x5598504117b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc37000a470 tx=0x7fc37001ce90 comp rx=0 tx=0).stop 2024-04-23T18:31:18.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.353+0000 7fc38b72d800 1 -- 172.21.15.119:0/1785556616 shutdown_connections 2024-04-23T18:31:18.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.353+0000 7fc38b72d800 1 --2- 172.21.15.119:0/1785556616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040f3c0 0x5598504117b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.353+0000 7fc38b72d800 1 -- 172.21.15.119:0/1785556616 >> 172.21.15.119:0/1785556616 conn(0x559850406560 msgr2=0x559850408980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.353+0000 7fc38b72d800 1 -- 172.21.15.119:0/1785556616 shutdown_connections 2024-04-23T18:31:18.348 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.353+0000 7fc38b72d800 1 -- 172.21.15.119:0/1785556616 wait complete. 2024-04-23T18:31:18.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.365+0000 7fc38b72d800 1 Processor -- start 2024-04-23T18:31:18.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.365+0000 7fc38b72d800 1 -- start start 2024-04-23T18:31:18.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.365+0000 7fc38b72d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040af80 0x5598504fc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.365+0000 7fc38b72d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5598503565d0 con 0x55985040af80 2024-04-23T18:31:18.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.366+0000 7fc38737f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040af80 0x5598504fc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.366+0000 7fc38737f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040af80 0x5598504fc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54936/0 (socket says 172.21.15.119:54936) 2024-04-23T18:31:18.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.366+0000 7fc38737f640 1 -- 172.21.15.119:0/3476652715 learned_addr learned my addr 172.21.15.119:0/3476652715 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.359 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.366+0000 7fc38737f640 1 -- 172.21.15.119:0/3476652715 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598502cc860 con 0x55985040af80 2024-04-23T18:31:18.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.366+0000 7fc38737f640 1 --2- 172.21.15.119:0/3476652715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040af80 0x5598504fc1b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc378001d80 tx=0x7fc378001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f2ac8d66745cb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.366+0000 7fc27560a640 1 -- 172.21.15.119:0/3476652715 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc378013030 con 0x55985040af80 2024-04-23T18:31:18.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.366+0000 7fc27560a640 1 -- 172.21.15.119:0/3476652715 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37800e470 con 0x55985040af80 2024-04-23T18:31:18.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.366+0000 7fc27560a640 1 -- 172.21.15.119:0/3476652715 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc37800e810 con 0x55985040af80 2024-04-23T18:31:18.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.367+0000 7fc38b72d800 1 -- 172.21.15.119:0/3476652715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040af80 msgr2=0x5598504fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.367+0000 7fc38b72d800 1 --2- 172.21.15.119:0/3476652715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040af80 0x5598504fc1b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc378001d80 tx=0x7fc378001e70 comp rx=0 tx=0).stop 2024-04-23T18:31:18.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.367+0000 7fc38b72d800 1 -- 172.21.15.119:0/3476652715 shutdown_connections 2024-04-23T18:31:18.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.367+0000 7fc38b72d800 1 --2- 172.21.15.119:0/3476652715 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040af80 0x5598504fc1b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.367+0000 7fc38b72d800 1 -- 172.21.15.119:0/3476652715 >> 172.21.15.119:0/3476652715 conn(0x559850406560 msgr2=0x5598504f7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.367+0000 7fc38b72d800 1 -- 172.21.15.119:0/3476652715 shutdown_connections 2024-04-23T18:31:18.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.367+0000 7fc38b72d800 1 -- 172.21.15.119:0/3476652715 wait complete. 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.367+0000 7fc38b72d800 1 Processor -- start 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.367+0000 7fc38b72d800 1 -- start start 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.368+0000 7fc38b72d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040af80 0x559850380830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.368+0000 7fc38b72d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559850412080 con 0x55985040af80 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.368+0000 7fc38737f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040af80 0x559850380830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.368+0000 7fc38737f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040af80 0x559850380830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54942/0 (socket says 172.21.15.119:54942) 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.368+0000 7fc38737f640 1 -- 172.21.15.119:0/739121132 learned_addr learned my addr 172.21.15.119:0/739121132 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.368+0000 7fc38737f640 1 -- 172.21.15.119:0/739121132 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598502caeb0 con 0x55985040af80 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.368+0000 7fc38737f640 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040af80 0x559850380830 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc378004000 tx=0x7fc378000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.368+0000 7fc273e07640 1 -- 172.21.15.119:0/739121132 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc378027070 con 0x55985040af80 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.368+0000 7fc273e07640 1 -- 172.21.15.119:0/739121132 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc378019900 con 0x55985040af80 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.368+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55985037ef20 con 0x55985040af80 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.368+0000 7fc273e07640 1 -- 172.21.15.119:0/739121132 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc378019c60 con 0x55985040af80 2024-04-23T18:31:18.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.368+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55985037f440 con 0x55985040af80 2024-04-23T18:31:18.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.369+0000 7fc273e07640 1 -- 172.21.15.119:0/739121132 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc37802a070 con 0x55985040af80 2024-04-23T18:31:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.369+0000 7fc273e07640 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc26c036e60 0x7fc26c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.369+0000 7fc273e07640 1 -- 172.21.15.119:0/739121132 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fc37801f070 con 0x55985040af80 2024-04-23T18:31:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.369+0000 7fc37ffff640 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc26c036e60 0x7fc26c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.369+0000 7fc38b72d800 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55985040f3c0 0x55985050cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.370+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55985050d470 con 0x55985040f3c0 2024-04-23T18:31:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.370+0000 7fc387b80640 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55985040f3c0 0x55985050cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.370+0000 7fc37ffff640 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc26c036e60 0x7fc26c039320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc370054000 tx=0x7fc37004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.370+0000 7fc387b80640 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55985040f3c0 0x55985050cf30 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.370+0000 7fc387b80640 1 -- 172.21.15.119:0/739121132 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc38000a4a0 con 0x55985040f3c0 2024-04-23T18:31:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.370+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55985050dcc0 con 0x55985040f3c0 2024-04-23T18:31:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.371+0000 7fc387b80640 1 -- 172.21.15.119:0/739121132 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc38000a4a0 con 0x55985040f3c0 2024-04-23T18:31:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.371+0000 7fc38b72d800 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55985050f6f0 0x559850511b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.371+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598505122b0 con 0x55985050f6f0 2024-04-23T18:31:18.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.371+0000 7fc38737f640 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55985050f6f0 0x559850511b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.371+0000 7fc38737f640 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55985050f6f0 0x559850511b20 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.371+0000 7fc38737f640 1 -- 172.21.15.119:0/739121132 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc378029030 con 0x55985050f6f0 2024-04-23T18:31:18.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.371+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55985050e510 con 0x55985040f3c0 2024-04-23T18:31:18.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.372+0000 7fc387b80640 1 -- 172.21.15.119:0/739121132 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc38000a4a0 con 0x55985040f3c0 2024-04-23T18:31:18.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.372+0000 7fc38b72d800 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559850513710 0x559850515b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.372+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598505162e0 con 0x559850513710 2024-04-23T18:31:18.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.372+0000 7fc37ffff640 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559850513710 0x559850515b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.372+0000 7fc37ffff640 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559850513710 0x559850515b80 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.373+0000 7fc37ffff640 1 -- 172.21.15.119:0/739121132 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc370052980 con 0x559850513710 2024-04-23T18:31:18.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.373+0000 7fc38b72d800 1 Processor -- start 2024-04-23T18:31:18.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.373+0000 7fc38b72d800 1 -- start start 2024-04-23T18:31:18.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.373+0000 7fc38b72d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850524740 0x559850524b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.373+0000 7fc38b72d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559850380d70 con 0x559850524740 2024-04-23T18:31:18.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.373+0000 7fc38737f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850524740 0x559850524b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.373+0000 7fc38737f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850524740 0x559850524b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54954/0 (socket says 172.21.15.119:54954) 2024-04-23T18:31:18.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.373+0000 7fc38737f640 1 -- 172.21.15.119:0/661405799 learned_addr learned my addr 172.21.15.119:0/661405799 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.374+0000 7fc38737f640 1 -- 172.21.15.119:0/661405799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598505250a0 con 0x559850524740 2024-04-23T18:31:18.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.374+0000 7fc38737f640 1 --2- 172.21.15.119:0/661405799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850524740 0x559850524b60 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc378016fd0 tx=0x7fc3780177a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.374+0000 7fc271602640 1 -- 172.21.15.119:0/661405799 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3780440c0 con 0x559850524740 2024-04-23T18:31:18.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.374+0000 7fc271602640 1 -- 172.21.15.119:0/661405799 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc378044260 con 0x559850524740 2024-04-23T18:31:18.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.374+0000 7fc38b72d800 1 -- 172.21.15.119:0/661405799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559850525b10 con 0x559850524740 2024-04-23T18:31:18.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.374+0000 7fc271602640 1 -- 172.21.15.119:0/661405799 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc378044540 con 0x559850524740 2024-04-23T18:31:18.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.374+0000 7fc38b72d800 1 -- 172.21.15.119:0/661405799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559850526010 con 0x559850524740 2024-04-23T18:31:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.375+0000 7fc271602640 1 -- 172.21.15.119:0/661405799 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc37803b060 con 0x559850524740 2024-04-23T18:31:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.375+0000 7fc271602640 1 --2- 172.21.15.119:0/661405799 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc260036e60 0x7fc260039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.375+0000 7fc271602640 1 -- 172.21.15.119:0/661405799 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fc378014070 con 0x559850524740 2024-04-23T18:31:18.392 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.375+0000 7fc37ffff640 1 --2- 172.21.15.119:0/661405799 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc260036e60 0x7fc260039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.375+0000 7fc38b72d800 1 Processor -- start 2024-04-23T18:31:18.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.375+0000 7fc38b72d800 1 -- start start 2024-04-23T18:31:18.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.375+0000 7fc37ffff640 1 --2- 172.21.15.119:0/661405799 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc260036e60 0x7fc260039320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55985037f830 tx=0x7fc370005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.375+0000 7fc38b72d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 0x559850531c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.375+0000 7fc38b72d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5598502fcdf0 con 0x559850531810 2024-04-23T18:31:18.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.376+0000 7fc38737f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 0x559850531c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.376+0000 7fc38737f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 0x559850531c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54960/0 (socket says 172.21.15.119:54960) 2024-04-23T18:31:18.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.376+0000 7fc38737f640 1 -- 172.21.15.119:0/1215091638 learned_addr learned my addr 172.21.15.119:0/1215091638 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.376+0000 7fc38737f640 1 -- 172.21.15.119:0/1215091638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559850532200 con 0x559850531810 2024-04-23T18:31:18.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.376+0000 7fc38737f640 1 --2- 172.21.15.119:0/1215091638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 0x559850531c30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc378041fd0 tx=0x7fc37802cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76964d2bb0f1949b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.376+0000 7fc26affd640 1 -- 172.21.15.119:0/1215091638 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc37805d070 con 0x559850531810 2024-04-23T18:31:18.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.376+0000 7fc26affd640 1 -- 172.21.15.119:0/1215091638 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37800ce70 con 0x559850531810 2024-04-23T18:31:18.393 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.376+0000 7fc26affd640 1 -- 172.21.15.119:0/1215091638 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc37802c440 con 0x559850531810 2024-04-23T18:31:18.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38b72d800 1 -- 172.21.15.119:0/1215091638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 msgr2=0x559850531c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38b72d800 1 --2- 172.21.15.119:0/1215091638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 0x559850531c30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc378041fd0 tx=0x7fc37802cd10 comp rx=0 tx=0).stop 2024-04-23T18:31:18.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38b72d800 1 -- 172.21.15.119:0/1215091638 shutdown_connections 2024-04-23T18:31:18.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38b72d800 1 --2- 172.21.15.119:0/1215091638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 0x559850531c30 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38b72d800 1 -- 172.21.15.119:0/1215091638 >> 172.21.15.119:0/1215091638 conn(0x55985052db70 msgr2=0x55985052bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38b72d800 1 -- 172.21.15.119:0/1215091638 shutdown_connections 2024-04-23T18:31:18.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38b72d800 1 -- 172.21.15.119:0/1215091638 wait complete. 2024-04-23T18:31:18.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38b72d800 1 Processor -- start 2024-04-23T18:31:18.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38b72d800 1 -- start start 2024-04-23T18:31:18.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38b72d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 0x559850538ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38b72d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559850532730 con 0x559850531810 2024-04-23T18:31:18.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38737f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 0x559850538ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.394 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38737f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 0x559850538ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54966/0 (socket says 172.21.15.119:54966) 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.377+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 learned_addr learned my addr 172.21.15.119:0/105239948 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.378+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559850539020 con 0x559850531810 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.378+0000 7fc38737f640 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 0x559850538ae0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc37805b040 tx=0x7fc378013730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.378+0000 7fc2697fa640 1 -- 172.21.15.119:0/105239948 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc378067070 con 0x559850531810 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.378+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559850539020 con 0x559850531810 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.378+0000 7fc2697fa640 1 -- 172.21.15.119:0/105239948 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc37804b8f0 con 0x559850531810 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.378+0000 7fc2697fa640 1 -- 172.21.15.119:0/105239948 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc37805d040 con 0x559850531810 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.378+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559850539520 con 0x559850531810 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.379+0000 7fc2697fa640 1 -- 172.21.15.119:0/105239948 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fc37806a070 con 0x559850531810 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.379+0000 7fc2697fa640 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc250036e60 0x7fc250039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.379+0000 7fc2697fa640 1 -- 172.21.15.119:0/105239948 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fc37806dd60 con 0x559850531810 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.379+0000 7fc37ffff640 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc250036e60 0x7fc250039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.379+0000 7fc38b72d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.395 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.379+0000 7fc38b72d800 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559850544290 0x559850546750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.379+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559850546ea0 con 0x559850544290 2024-04-23T18:31:18.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.379+0000 7fc37ffff640 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc250036e60 0x7fc250039320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc37001ced0 tx=0x7fc37004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.380+0000 7fc387b80640 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559850544290 0x559850546750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.380+0000 7fc387b80640 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559850544290 0x559850546750 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.380+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc38000a4a0 con 0x559850544290 2024-04-23T18:31:18.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.380+0000 7fc38b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.380+0000 7fc38b72d800 20 realm 2024-04-23T18:31:18.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.380+0000 7fc38b72d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.380+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598505472b0 con 0x559850544290 2024-04-23T18:31:18.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.380+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc38000a4a0 con 0x559850544290 2024-04-23T18:31:18.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.380+0000 7fc38b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.380+0000 7fc38b72d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:18.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.380+0000 7fc38b72d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.380+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559850547b80 con 0x559850544290 2024-04-23T18:31:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.380+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc38000a4a0 con 0x559850544290 2024-04-23T18:31:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.381+0000 7fc38b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.381+0000 7fc38b72d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.381+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850544290 2024-04-23T18:31:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.381+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc38000a4a0 con 0x559850544290 2024-04-23T18:31:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.381+0000 7fc38b72d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.381+0000 7fc38b72d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.381+0000 7fc38b72d800 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559850548c80 0x55985054b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.381+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55985054b680 con 0x559850548c80 2024-04-23T18:31:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.381+0000 7fc38737f640 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559850548c80 0x55985054b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.381+0000 7fc38737f640 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559850548c80 0x55985054b070 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.381+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc378073070 con 0x559850548c80 2024-04-23T18:31:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.381+0000 7fc38b72d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.381+0000 7fc38b72d800 20 searching for the correct realm 2024-04-23T18:31:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.382+0000 7fc38b72d800 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55985054d630 0x55985054faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.382+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598505501c0 con 0x55985054d630 2024-04-23T18:31:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.382+0000 7fc37ffff640 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55985054d630 0x55985054faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.382+0000 7fc37ffff640 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55985054d630 0x55985054faf0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.382+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.382+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598505501c0 con 0x559850548c80 2024-04-23T18:31:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.382+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc378073070 con 0x559850548c80 2024-04-23T18:31:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.382+0000 7fc38737f640 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc37806c070 0x7fc378011510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.382+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5598505501c0 con 0x7fc37806c070 2024-04-23T18:31:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.383+0000 7fc387b80640 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc37806c070 0x7fc378011510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.383+0000 7fc387b80640 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc37806c070 0x7fc378011510 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.383+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc38000a4a0 con 0x7fc37806c070 2024-04-23T18:31:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.383+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850544290 2024-04-23T18:31:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.384+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc38000a4a0 con 0x559850544290 2024-04-23T18:31:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.384+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850544290 2024-04-23T18:31:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.384+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc38000a4a0 con 0x559850544290 2024-04-23T18:31:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.384+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x7fc37806c070 2024-04-23T18:31:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.384+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc38000a4a0 con 0x7fc37806c070 2024-04-23T18:31:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.384+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x7fc37806c070 2024-04-23T18:31:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.384+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc38000a4a0 con 0x7fc37806c070 2024-04-23T18:31:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.384+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850548c80 2024-04-23T18:31:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.385+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc378073070 con 0x559850548c80 2024-04-23T18:31:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.385+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x55985054d630 2024-04-23T18:31:18.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.385+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.385+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850544290 2024-04-23T18:31:18.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.385+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc38000a4a0 con 0x559850544290 2024-04-23T18:31:18.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.385+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x7fc37806c070 2024-04-23T18:31:18.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.385+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc38000a4a0 con 0x7fc37806c070 2024-04-23T18:31:18.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.385+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850544290 2024-04-23T18:31:18.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.385+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc38000a4a0 con 0x559850544290 2024-04-23T18:31:18.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.385+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850548c80 2024-04-23T18:31:18.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.386+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc378073070 con 0x559850548c80 2024-04-23T18:31:18.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.386+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x55985054d630 2024-04-23T18:31:18.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.386+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.386+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x55985054d630 2024-04-23T18:31:18.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.386+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.400 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.386+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x7fc37806c070 2024-04-23T18:31:18.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.387+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc38000a4a0 con 0x7fc37806c070 2024-04-23T18:31:18.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.387+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x55985054d630 2024-04-23T18:31:18.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.387+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.387+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x55985054d630 2024-04-23T18:31:18.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.387+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.387+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850544290 2024-04-23T18:31:18.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.387+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc38000a4a0 con 0x559850544290 2024-04-23T18:31:18.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.387+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850544290 2024-04-23T18:31:18.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.387+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc38000a4a0 con 0x559850544290 2024-04-23T18:31:18.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.387+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x7fc37806c070 2024-04-23T18:31:18.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.388+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc38000a4a0 con 0x7fc37806c070 2024-04-23T18:31:18.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.388+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x55985054d630 2024-04-23T18:31:18.401 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.388+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.388+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850548c80 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.388+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc378073070 con 0x559850548c80 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.388+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850544290 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.388+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc38000a4a0 con 0x559850544290 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.388+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850548c80 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.389+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc378073070 con 0x559850548c80 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.389+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x55985054d630 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.389+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.389+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x7fc37806c070 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.389+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc38000a4a0 con 0x7fc37806c070 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.389+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850548c80 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.389+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc378088040 con 0x559850548c80 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.389+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x55985054d630 2024-04-23T18:31:18.402 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.390+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.390+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x7fc37806c070 2024-04-23T18:31:18.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.390+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc38000a4a0 con 0x7fc37806c070 2024-04-23T18:31:18.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.390+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850544290 2024-04-23T18:31:18.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.390+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.390+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559850547f20 con 0x559850548c80 2024-04-23T18:31:18.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.390+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc378088040 con 0x559850548c80 2024-04-23T18:31:18.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.390+0000 7fc38b72d800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:18.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.390+0000 7fc38b72d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:18.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.390+0000 7fc38b72d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:18.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.390+0000 7fc38b72d800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:18.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.390+0000 7fc38b72d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:18.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.390+0000 7fc38b72d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:18.403 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55985054bf40 con 0x559850544290 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55985054c330 con 0x559850544290 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55985054c330 con 0x7fc37806c070 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc380040080 con 0x7fc37806c070 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 20 zone default found 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 4 Realm: () 2024-04-23T18:31:18.404 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:18.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:18.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:18.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 20 zonegroup default 2024-04-23T18:31:18.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.391+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55985054bb80 con 0x559850548c80 2024-04-23T18:31:18.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.392+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc378088040 con 0x559850548c80 2024-04-23T18:31:18.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.392+0000 7fc38b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.392+0000 7fc38b72d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.392+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559850552080 con 0x55985054d630 2024-04-23T18:31:18.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.392+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.392+0000 7fc38b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.392+0000 7fc38b72d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.392+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598505524f0 con 0x55985054d630 2024-04-23T18:31:18.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.392+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.392+0000 7fc38b72d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.392+0000 7fc38b72d800 20 started sync module instance, tier type = 2024-04-23T18:31:18.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.392+0000 7fc38b72d800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:18.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.392+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598505514c0 con 0x559850548c80 2024-04-23T18:31:18.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.393+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc378088040 con 0x559850548c80 2024-04-23T18:31:18.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.393+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94112671144112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850551cd0 con 0x559850548c80 2024-04-23T18:31:18.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.393+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850553400 con 0x559850544290 2024-04-23T18:31:18.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.394+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94112671144112] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc378088040 con 0x559850548c80 2024-04-23T18:31:18.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.395+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.395+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94112671149904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850553820 con 0x559850544290 2024-04-23T18:31:18.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.395+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850554220 con 0x55985054d630 2024-04-23T18:31:18.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.396+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94112671149904] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.396+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.396+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94112671150960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850553790 con 0x55985054d630 2024-04-23T18:31:18.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.396+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598505550e0 con 0x559850548c80 2024-04-23T18:31:18.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.397+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc378088040 con 0x559850548c80 2024-04-23T18:31:18.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.397+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94112671157808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850555980 con 0x559850548c80 2024-04-23T18:31:18.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.397+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850556430 con 0x559850544290 2024-04-23T18:31:18.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.397+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94112671150960] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.398+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.398+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94112671155728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850556430 con 0x559850544290 2024-04-23T18:31:18.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.398+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94112671157808] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc378088040 con 0x559850548c80 2024-04-23T18:31:18.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.398+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598505554d0 con 0x7fc37806c070 2024-04-23T18:31:18.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.399+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94112671155728] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.400+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x7fc37806c070 2024-04-23T18:31:18.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.400+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94112671162128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598505554d0 con 0x7fc37806c070 2024-04-23T18:31:18.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.400+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598505572f0 con 0x7fc37806c070 2024-04-23T18:31:18.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.401+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94112671162128] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x7fc37806c070 2024-04-23T18:31:18.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.401+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x7fc37806c070 2024-04-23T18:31:18.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.402+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94112671164816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850557260 con 0x7fc37806c070 2024-04-23T18:31:18.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.402+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850557c60 con 0x7fc37806c070 2024-04-23T18:31:18.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.402+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(58 notify.7 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x7fc37806c070 2024-04-23T18:31:18.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.402+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94112671168368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850558080 con 0x7fc37806c070 2024-04-23T18:31:18.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.402+0000 7fc38b72d800 20 add_watcher() i=0 2024-04-23T18:31:18.412 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.403+0000 7fc38b72d800 20 add_watcher() i=1 2024-04-23T18:31:18.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.403+0000 7fc38b72d800 20 add_watcher() i=2 2024-04-23T18:31:18.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.403+0000 7fc38b72d800 20 add_watcher() i=3 2024-04-23T18:31:18.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.403+0000 7fc38b72d800 20 add_watcher() i=4 2024-04-23T18:31:18.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.403+0000 7fc38b72d800 20 add_watcher() i=5 2024-04-23T18:31:18.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.403+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94112671164816] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x7fc37806c070 2024-04-23T18:31:18.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.403+0000 7fc38b72d800 20 add_watcher() i=6 2024-04-23T18:31:18.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.403+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94112671168368] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x7fc37806c070 2024-04-23T18:31:18.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.403+0000 7fc38b72d800 20 add_watcher() i=7 2024-04-23T18:31:18.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.403+0000 7fc38b72d800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:18.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.404+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559850556db0 con 0x559850544290 2024-04-23T18:31:18.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.404+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.404+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94112671169424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850556db0 con 0x559850544290 2024-04-23T18:31:18.413 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.405+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94112671169424] v34'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.405+0000 7fc23dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.405+0000 7fc38b72d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.405+0000 7fc38b72d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.405+0000 7fc38b72d800 5 note: GC not initialized 2024-04-23T18:31:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.405+0000 7fc23cfe1640 20 reqs_thread_entry: start 2024-04-23T18:31:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.405+0000 7fc38b72d800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.405+0000 7fc38b72d800 20 Filter name: none 2024-04-23T18:31:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.405+0000 7fc1b67fc640 20 reqs_thread_entry: start 2024-04-23T18:31:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.406+0000 7fc38b72d800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-23T18:31:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.406+0000 7fc38b72d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.406+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55985058e7b0 con 0x7fc37806c070 2024-04-23T18:31:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.406+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fc380040080 con 0x7fc37806c070 2024-04-23T18:31:18.414 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.406+0000 7fc38b72d800 20 rados_obj.operate() r=0 bl.length=473 2024-04-23T18:31:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.406+0000 7fc38b72d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-23T18:31:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.406+0000 7fc38b72d800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.406+0000 7fc38b72d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.407+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5598505950d0 con 0x7fc37806c070 2024-04-23T18:31:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.408+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc380040080 con 0x7fc37806c070 2024-04-23T18:31:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.408+0000 7fc38b72d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.408+0000 7fc38b72d800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.408+0000 7fc38b72d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-23T18:31:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.408+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94112671419200 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5598505907c0 con 0x559850544290 2024-04-23T18:31:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.408+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== watch-notify(notify (1) cookie 94112671155728 notify 146028888097 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fc3800455c0 con 0x559850544290 2024-04-23T18:31:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.408+0000 7fc26affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94112671155728 notifier 4833 bl.length()=636 2024-04-23T18:31:18.415 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.408+0000 7fc26affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:18.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.408+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 notify.4 [notify cookie 94112671419200 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.408+0000 7fc26affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:18.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.408+0000 7fc26affd640 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc24c003ea0 con 0x559850544290 2024-04-23T18:31:18.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.408+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.416 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.408+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== watch-notify(notify_complete (2) cookie 94112671419200 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc380045790 con 0x559850544290 2024-04-23T18:31:18.416 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-23T18:31:18.209839Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:31:18.209827Z","tags":[],"group_ids":[]} 2024-04-23T18:31:18.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.409+0000 7fc23dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:18.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.409+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94112671169424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850590bd0 con 0x559850544290 2024-04-23T18:31:18.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.410+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94112671169424] v34'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.410+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94112671144112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850557b90 con 0x559850548c80 2024-04-23T18:31:18.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.411+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94112671144112] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc378088040 con 0x559850548c80 2024-04-23T18:31:18.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.411+0000 7fc38b72d800 20 remove_watcher() i=0 2024-04-23T18:31:18.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.411+0000 7fc38b72d800 2 removed watcher, disabling cache 2024-04-23T18:31:18.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.411+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94112671149904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850557b90 con 0x559850544290 2024-04-23T18:31:18.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.412+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94112671149904] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.413+0000 7fc38b72d800 20 remove_watcher() i=1 2024-04-23T18:31:18.422 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.413+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94112671150960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850552f50 con 0x55985054d630 2024-04-23T18:31:18.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.413+0000 7fc37ffff640 1 -- 172.21.15.119:0/105239948 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94112671150960] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc370081070 con 0x55985054d630 2024-04-23T18:31:18.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.414+0000 7fc38b72d800 20 remove_watcher() i=2 2024-04-23T18:31:18.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.414+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94112671157808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850557b90 con 0x559850548c80 2024-04-23T18:31:18.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.415+0000 7fc38737f640 1 -- 172.21.15.119:0/105239948 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94112671157808] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc378088040 con 0x559850548c80 2024-04-23T18:31:18.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.415+0000 7fc38b72d800 20 remove_watcher() i=3 2024-04-23T18:31:18.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.415+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94112671155728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850554e30 con 0x559850544290 2024-04-23T18:31:18.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.416+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94112671155728] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x559850544290 2024-04-23T18:31:18.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.416+0000 7fc38b72d800 20 remove_watcher() i=4 2024-04-23T18:31:18.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.416+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94112671162128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850557b90 con 0x7fc37806c070 2024-04-23T18:31:18.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.417+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94112671162128] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x7fc37806c070 2024-04-23T18:31:18.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.417+0000 7fc38b72d800 20 remove_watcher() i=5 2024-04-23T18:31:18.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.417+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94112671164816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850554610 con 0x7fc37806c070 2024-04-23T18:31:18.423 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.418+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94112671164816] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x7fc37806c070 2024-04-23T18:31:18.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.418+0000 7fc38b72d800 20 remove_watcher() i=6 2024-04-23T18:31:18.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.418+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94112671168368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559850555f10 con 0x7fc37806c070 2024-04-23T18:31:18.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94112671168368] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc380040080 con 0x7fc37806c070 2024-04-23T18:31:18.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 20 remove_watcher() i=7 2024-04-23T18:31:18.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc37806c070 msgr2=0x7fc378011510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fc37806c070 0x7fc378011510 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559850544290 msgr2=0x559850546750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x559850544290 0x559850546750 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559850548c80 msgr2=0x55985054b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x559850548c80 0x55985054b070 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55985054d630 msgr2=0x55985054faf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55985054d630 0x55985054faf0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.424 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc250036e60 msgr2=0x7fc250039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc250036e60 0x7fc250039320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc37001ced0 tx=0x7fc37004f000 comp rx=0 tx=0).stop 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 msgr2=0x559850538ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc387b80640 1 -- 172.21.15.119:0/105239948 reap_dead start 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 0x559850538ae0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fc37805b040 tx=0x7fc378013730 comp rx=0 tx=0).stop 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 shutdown_connections 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 --2- 172.21.15.119:0/105239948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850531810 0x559850538ae0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 >> 172.21.15.119:0/105239948 conn(0x55985052db70 msgr2=0x55985052b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 shutdown_connections 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/105239948 wait complete. 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/661405799 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc260036e60 msgr2=0x7fc260039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 --2- 172.21.15.119:0/661405799 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc260036e60 0x7fc260039320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55985037f830 tx=0x7fc370005a00 comp rx=0 tx=0).stop 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/661405799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850524740 msgr2=0x559850524b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 --2- 172.21.15.119:0/661405799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850524740 0x559850524b60 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc378016fd0 tx=0x7fc3780177a0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.425 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/661405799 shutdown_connections 2024-04-23T18:31:18.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 --2- 172.21.15.119:0/661405799 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc260036e60 0x7fc260039320 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 --2- 172.21.15.119:0/661405799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559850524740 0x559850524b60 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/661405799 >> 172.21.15.119:0/661405799 conn(0x5598505187e0 msgr2=0x559850518be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/661405799 shutdown_connections 2024-04-23T18:31:18.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.419+0000 7fc38b72d800 1 -- 172.21.15.119:0/661405799 wait complete. 2024-04-23T18:31:18.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559850513710 msgr2=0x559850515b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x559850513710 0x559850515b80 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55985040f3c0 msgr2=0x55985050cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55985040f3c0 0x55985050cf30 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55985050f6f0 msgr2=0x559850511b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55985050f6f0 0x559850511b20 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc26c036e60 msgr2=0x7fc26c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.426 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fc26c036e60 0x7fc26c039320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc370054000 tx=0x7fc37004e000 comp rx=0 tx=0).stop 2024-04-23T18:31:18.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040af80 msgr2=0x559850380830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 --2- 172.21.15.119:0/739121132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55985040af80 0x559850380830 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc378004000 tx=0x7fc378000bc0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc387b80640 1 -- 172.21.15.119:0/739121132 reap_dead start 2024-04-23T18:31:18.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 shutdown_connections 2024-04-23T18:31:18.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 >> 172.21.15.119:0/739121132 conn(0x559850406560 msgr2=0x5598504f6310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 shutdown_connections 2024-04-23T18:31:18.427 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.420+0000 7fc38b72d800 1 -- 172.21.15.119:0/739121132 wait complete. 2024-04-23T18:31:18.427 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:18.427 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:18.427 ERROR:root:0 2024-04-23T18:31:18.428 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-23T18:31:18.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-23T18:31:18.428 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-04-23T18:31:18.480 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:18.480 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:18.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.487+0000 7f55c0b2f800 1 Processor -- start 2024-04-23T18:31:18.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.487+0000 7f55c0b2f800 1 -- start start 2024-04-23T18:31:18.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.487+0000 7f55c0b2f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55fd9fc75a00 0x55fd9fc77df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.487+0000 7f55c0b2f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fd9fb25560 con 0x55fd9fc78330 2024-04-23T18:31:18.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.487+0000 7f55c0b2f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55fd9fb16e20 con 0x55fd9fc75a00 2024-04-23T18:31:18.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.487+0000 7f55bc8c5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55fd9fc75a00 0x55fd9fc77df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.481 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.487+0000 7f55b7fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55fd9fc78330 0x55fd9fc7a720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50564/0 (socket says 172.21.15.119:50564) 2024-04-23T18:31:18.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.487+0000 7f55bc8c5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55fd9fc75a00 0x55fd9fc77df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54968/0 (socket says 172.21.15.119:54968) 2024-04-23T18:31:18.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.488+0000 7f55b7fff640 1 -- 172.21.15.119:0/3131598646 learned_addr learned my addr 172.21.15.119:0/3131598646 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:31:18.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.488+0000 7f55bc8c5640 1 -- 172.21.15.119:0/3131598646 >> v1:172.21.15.62:6789/0 conn(0x55fd9fc78330 legacy=0x55fd9fc7a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.488+0000 7f55bc8c5640 1 -- 172.21.15.119:0/3131598646 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9fb24e60 con 0x55fd9fc75a00 2024-04-23T18:31:18.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.490+0000 7f55bc8c5640 1 --2- 172.21.15.119:0/3131598646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fc77df0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f55b000a470 tx=0x7f55b001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a545e6828b4db7f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.490+0000 7f55b77fe640 1 -- 172.21.15.119:0/3131598646 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0057070 con 0x55fd9fc75a00 2024-04-23T18:31:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.490+0000 7f55b77fe640 1 -- 172.21.15.119:0/3131598646 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b0052570 con 0x55fd9fc75a00 2024-04-23T18:31:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.490+0000 7f55b77fe640 1 -- 172.21.15.119:0/3131598646 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0052870 con 0x55fd9fc75a00 2024-04-23T18:31:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.490+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3131598646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 msgr2=0x55fd9fc77df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.490+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/3131598646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fc77df0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f55b000a470 tx=0x7f55b001ce90 comp rx=0 tx=0).stop 2024-04-23T18:31:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.490+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3131598646 shutdown_connections 2024-04-23T18:31:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.490+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/3131598646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fc77df0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.490+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3131598646 >> 172.21.15.119:0/3131598646 conn(0x55fd9fc6f3b0 msgr2=0x55fd9fc717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.490+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3131598646 shutdown_connections 2024-04-23T18:31:18.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.490+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3131598646 wait complete. 2024-04-23T18:31:18.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.502+0000 7f55c0b2f800 1 Processor -- start 2024-04-23T18:31:18.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.502+0000 7f55c0b2f800 1 -- start start 2024-04-23T18:31:18.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.502+0000 7f55c0b2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fd66180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.502+0000 7f55c0b2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fd9fbc0550 con 0x55fd9fc75a00 2024-04-23T18:31:18.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.503+0000 7f55bc8c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fd66180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.503+0000 7f55bc8c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fd66180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54972/0 (socket says 172.21.15.119:54972) 2024-04-23T18:31:18.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.503+0000 7f55bc8c5640 1 -- 172.21.15.119:0/3499418754 learned_addr learned my addr 172.21.15.119:0/3499418754 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.496 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.503+0000 7f55bc8c5640 1 -- 172.21.15.119:0/3499418754 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9fb36860 con 0x55fd9fc75a00 2024-04-23T18:31:18.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.503+0000 7f55bc8c5640 1 --2- 172.21.15.119:0/3499418754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fd66180 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f55b0055040 tx=0x7f55b004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8192b4ff8743556 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.503+0000 7f54aae05640 1 -- 172.21.15.119:0/3499418754 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0057070 con 0x55fd9fc75a00 2024-04-23T18:31:18.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.503+0000 7f54aae05640 1 -- 172.21.15.119:0/3499418754 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b0063070 con 0x55fd9fc75a00 2024-04-23T18:31:18.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.503+0000 7f54aae05640 1 -- 172.21.15.119:0/3499418754 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0052720 con 0x55fd9fc75a00 2024-04-23T18:31:18.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.504+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3499418754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 msgr2=0x55fd9fd66180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.504+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/3499418754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fd66180 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f55b0055040 tx=0x7f55b004c000 comp rx=0 tx=0).stop 2024-04-23T18:31:18.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.504+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3499418754 shutdown_connections 2024-04-23T18:31:18.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.504+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/3499418754 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fd66180 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.499 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.504+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3499418754 >> 172.21.15.119:0/3499418754 conn(0x55fd9fc6f3b0 msgr2=0x55fd9fd61aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.504+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3499418754 shutdown_connections 2024-04-23T18:31:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.504+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3499418754 wait complete. 2024-04-23T18:31:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.504+0000 7f55c0b2f800 1 Processor -- start 2024-04-23T18:31:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.504+0000 7f55c0b2f800 1 -- start start 2024-04-23T18:31:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.505+0000 7f55c0b2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fd6d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.505+0000 7f55c0b2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fd9fc7e150 con 0x55fd9fc75a00 2024-04-23T18:31:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.505+0000 7f55bc8c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fd6d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.505+0000 7f55bc8c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fd6d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54974/0 (socket says 172.21.15.119:54974) 2024-04-23T18:31:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.505+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1669522272 learned_addr learned my addr 172.21.15.119:0/1669522272 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.505+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1669522272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9fb34eb0 con 0x55fd9fc75a00 2024-04-23T18:31:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.505+0000 7f55bc8c5640 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fd6d940 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f55b0055040 tx=0x7f55b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.505+0000 7f54a9602640 1 -- 172.21.15.119:0/1669522272 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0052df0 con 0x55fd9fc75a00 2024-04-23T18:31:18.500 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.505+0000 7f54a9602640 1 -- 172.21.15.119:0/1669522272 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b006c070 con 0x55fd9fc75a00 2024-04-23T18:31:18.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.505+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd9fd6de80 con 0x55fd9fc75a00 2024-04-23T18:31:18.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.505+0000 7f54a9602640 1 -- 172.21.15.119:0/1669522272 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b005e5d0 con 0x55fd9fc75a00 2024-04-23T18:31:18.501 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.505+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9fd6e3a0 con 0x55fd9fc75a00 2024-04-23T18:31:18.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.506+0000 7f54a9602640 1 -- 172.21.15.119:0/1669522272 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f55b0077060 con 0x55fd9fc75a00 2024-04-23T18:31:18.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.506+0000 7f54a9602640 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f54a4036e60 0x7f54a4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.506+0000 7f54a9602640 1 -- 172.21.15.119:0/1669522272 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f55b008eca0 con 0x55fd9fc75a00 2024-04-23T18:31:18.508 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.506+0000 7f55b7fff640 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f54a4036e60 0x7f54a4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.506+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd9fc78330 0x55fd9fd749b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.506+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fd74f30 con 0x55fd9fc78330 2024-04-23T18:31:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.507+0000 7f55bd0c6640 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd9fc78330 0x55fd9fd749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.507+0000 7f55b7fff640 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f54a4036e60 0x7f54a4039320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f55a8000f60 tx=0x7f55a80012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.507+0000 7f55bd0c6640 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd9fc78330 0x55fd9fd749b0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.507+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1669522272 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fc78330 2024-04-23T18:31:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.507+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fd71f80 con 0x55fd9fc78330 2024-04-23T18:31:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.507+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1669522272 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fc78330 2024-04-23T18:31:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.507+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd9fd77280 0x55fd9fd79670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.507+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fd79d60 con 0x55fd9fd77280 2024-04-23T18:31:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.508+0000 7f55bc8c5640 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd9fd77280 0x55fd9fd79670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.508+0000 7f55bc8c5640 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd9fd77280 0x55fd9fd79670 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.508+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1669522272 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f55b006fce0 con 0x55fd9fd77280 2024-04-23T18:31:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.508+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fd76230 con 0x55fd9fc78330 2024-04-23T18:31:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.508+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1669522272 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fc78330 2024-04-23T18:31:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.508+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55fd9fd7b210 0x55fd9fd7d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.508+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fd7ddc0 con 0x55fd9fd7b210 2024-04-23T18:31:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.509+0000 7f55b7fff640 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55fd9fd7b210 0x55fd9fd7d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.509+0000 7f55b7fff640 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55fd9fd7b210 0x55fd9fd7d660 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.509+0000 7f55b7fff640 1 -- 172.21.15.119:0/1669522272 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fd7b210 2024-04-23T18:31:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.510+0000 7f55c0b2f800 1 Processor -- start 2024-04-23T18:31:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.510+0000 7f55c0b2f800 1 -- start start 2024-04-23T18:31:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.510+0000 7f55c0b2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd8c220 0x55fd9fd8c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.510+0000 7f55c0b2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fd9fb66df0 con 0x55fd9fd8c220 2024-04-23T18:31:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.510+0000 7f55bc8c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd8c220 0x55fd9fd8c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.510+0000 7f55bc8c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd8c220 0x55fd9fd8c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54982/0 (socket says 172.21.15.119:54982) 2024-04-23T18:31:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.510+0000 7f55bc8c5640 1 -- 172.21.15.119:0/3678020957 learned_addr learned my addr 172.21.15.119:0/3678020957 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.510+0000 7f55bc8c5640 1 -- 172.21.15.119:0/3678020957 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9fd8cb80 con 0x55fd9fd8c220 2024-04-23T18:31:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.511+0000 7f55bc8c5640 1 --2- 172.21.15.119:0/3678020957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd8c220 0x55fd9fd8c640 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f55b008d240 tx=0x7f55b006f480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.511+0000 7f54a27fc640 1 -- 172.21.15.119:0/3678020957 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0009d60 con 0x55fd9fd8c220 2024-04-23T18:31:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.511+0000 7f54a27fc640 1 -- 172.21.15.119:0/3678020957 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b0093070 con 0x55fd9fd8c220 2024-04-23T18:31:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.511+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3678020957 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd9fd8d5f0 con 0x55fd9fd8c220 2024-04-23T18:31:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.511+0000 7f54a27fc640 1 -- 172.21.15.119:0/3678020957 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0068ae0 con 0x55fd9fd8c220 2024-04-23T18:31:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.511+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3678020957 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9fd8daf0 con 0x55fd9fd8c220 2024-04-23T18:31:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.511+0000 7f54a27fc640 1 -- 172.21.15.119:0/3678020957 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f55b006e030 con 0x55fd9fd8c220 2024-04-23T18:31:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.512+0000 7f54a27fc640 1 --2- 172.21.15.119:0/3678020957 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5494036e60 0x7f5494039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.512+0000 7f54a27fc640 1 -- 172.21.15.119:0/3678020957 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f55b008b050 con 0x55fd9fd8c220 2024-04-23T18:31:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.512+0000 7f55b7fff640 1 --2- 172.21.15.119:0/3678020957 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5494036e60 0x7f5494039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.512+0000 7f55c0b2f800 1 Processor -- start 2024-04-23T18:31:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.512+0000 7f55c0b2f800 1 -- start start 2024-04-23T18:31:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.512+0000 7f55b7fff640 1 --2- 172.21.15.119:0/3678020957 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5494036e60 0x7f5494039320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f55a800bf50 tx=0x7f55a800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.512+0000 7f55c0b2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd9b220 0x55fd9fd9b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.512+0000 7f55c0b2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fd9fd66840 con 0x55fd9fd9b220 2024-04-23T18:31:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.512+0000 7f55bc8c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd9b220 0x55fd9fd9b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.512+0000 7f55bc8c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd9b220 0x55fd9fd9b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54986/0 (socket says 172.21.15.119:54986) 2024-04-23T18:31:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.512+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1975662666 learned_addr learned my addr 172.21.15.119:0/1975662666 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.513+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1975662666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9fd9bc10 con 0x55fd9fd9b220 2024-04-23T18:31:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.513+0000 7f55bc8c5640 1 --2- 172.21.15.119:0/1975662666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd9b220 0x55fd9fd9b640 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f55b00096d0 tx=0x7f55b006af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77bad7cd38aed20 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.513+0000 7f5493fff640 1 -- 172.21.15.119:0/1975662666 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b008bb10 con 0x55fd9fd9b220 2024-04-23T18:31:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.513+0000 7f5493fff640 1 -- 172.21.15.119:0/1975662666 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b0058040 con 0x55fd9fd9b220 2024-04-23T18:31:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.513+0000 7f5493fff640 1 -- 172.21.15.119:0/1975662666 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b0050bf0 con 0x55fd9fd9b220 2024-04-23T18:31:18.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.513+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1975662666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd9b220 msgr2=0x55fd9fd9b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.513+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1975662666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd9b220 0x55fd9fd9b640 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f55b00096d0 tx=0x7f55b006af50 comp rx=0 tx=0).stop 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.513+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1975662666 shutdown_connections 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.513+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1975662666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd9b220 0x55fd9fd9b640 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.513+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1975662666 >> 172.21.15.119:0/1975662666 conn(0x55fd9fc73a30 msgr2=0x55fd9fc73e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.513+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1975662666 shutdown_connections 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.513+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1975662666 wait complete. 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.514+0000 7f55c0b2f800 1 Processor -- start 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.514+0000 7f55c0b2f800 1 -- start start 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.514+0000 7f55c0b2f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd9b220 0x55fd9fda28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.514+0000 7f55c0b2f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fd9fd9c5c0 con 0x55fd9fd9b220 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.514+0000 7f55bc8c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd9b220 0x55fd9fda28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.514+0000 7f55bc8c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd9b220 0x55fd9fda28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54990/0 (socket says 172.21.15.119:54990) 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.514+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 learned_addr learned my addr 172.21.15.119:0/1627784845 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.514+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9fda2df0 con 0x55fd9fd9b220 2024-04-23T18:31:18.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.514+0000 7f55bc8c5640 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd9b220 0x55fd9fda28b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009990 tx=0x7f55b009bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.515+0000 7f54927fc640 1 -- 172.21.15.119:0/1627784845 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b008b250 con 0x55fd9fd9b220 2024-04-23T18:31:18.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.515+0000 7f54927fc640 1 -- 172.21.15.119:0/1627784845 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b00880c0 con 0x55fd9fd9b220 2024-04-23T18:31:18.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.515+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd9fda2df0 con 0x55fd9fd9b220 2024-04-23T18:31:18.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.515+0000 7f54927fc640 1 -- 172.21.15.119:0/1627784845 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55b008b3f0 con 0x55fd9fd9b220 2024-04-23T18:31:18.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.515+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9fda2df0 con 0x55fd9fd9b220 2024-04-23T18:31:18.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.515+0000 7f54927fc640 1 -- 172.21.15.119:0/1627784845 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f55b0068c80 con 0x55fd9fd9b220 2024-04-23T18:31:18.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.516+0000 7f54927fc640 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5488036e60 0x7f5488039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.516+0000 7f54927fc640 1 -- 172.21.15.119:0/1627784845 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f55b00c1d00 con 0x55fd9fd9b220 2024-04-23T18:31:18.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.516+0000 7f55b7fff640 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5488036e60 0x7f5488039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.516+0000 7f55c0b2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.516+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd9fdae060 0x55fd9fdb0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.516+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb0c70 con 0x55fd9fdae060 2024-04-23T18:31:18.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.516+0000 7f55b7fff640 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5488036e60 0x7f5488039320 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f55a8001b60 tx=0x7f55a8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.528 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.516+0000 7f55bd0c6640 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd9fdae060 0x55fd9fdb0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.516+0000 7f55bd0c6640 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd9fdae060 0x55fd9fdb0520 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fdae060 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 20 realm 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1080 con 0x55fd9fdae060 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fdae060 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1950 con 0x55fd9fdae060 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fdae060 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.529 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdae060 2024-04-23T18:31:18.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fdae060 2024-04-23T18:31:18.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:18.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd9fdb2a50 0x55fd9fdb4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.517+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb5450 con 0x55fd9fdb2a50 2024-04-23T18:31:18.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.518+0000 7f55bc8c5640 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd9fdb2a50 0x55fd9fdb4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.518+0000 7f55bc8c5640 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd9fdb2a50 0x55fd9fdb4e40 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.518+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f55b006fce0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.518+0000 7f55c0b2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:18.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.518+0000 7f55c0b2f800 20 searching for the correct realm 2024-04-23T18:31:18.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.518+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55fd9fdb7400 0x55fd9fdb98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.530 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.518+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb9f90 con 0x55fd9fdb7400 2024-04-23T18:31:18.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.518+0000 7f55b7fff640 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55fd9fdb7400 0x55fd9fdb98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.518+0000 7f55b7fff640 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55fd9fdb7400 0x55fd9fdb98c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.519+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.519+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb9f90 con 0x55fd9fdb2a50 2024-04-23T18:31:18.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.519+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b006fce0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.519+0000 7f55bc8c5640 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f55b0079070 0x7f55b0088950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.519+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb9f90 con 0x7f55b0079070 2024-04-23T18:31:18.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.519+0000 7f55bd0c6640 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f55b0079070 0x7f55b0088950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.520+0000 7f55bd0c6640 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f55b0079070 0x7f55b0088950 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.520+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b800a4a0 con 0x7f55b0079070 2024-04-23T18:31:18.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.520+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdae060 2024-04-23T18:31:18.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.520+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fdae060 2024-04-23T18:31:18.531 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.520+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdae060 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.520+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fdae060 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.520+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x7f55b0079070 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.521+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b800a4a0 con 0x7f55b0079070 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.521+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x7f55b0079070 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.521+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f55b800a4a0 con 0x7f55b0079070 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.521+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.521+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b006fce0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.521+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb7400 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.521+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.521+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdae060 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.522+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fdae060 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.522+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x7f55b0079070 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.522+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b800a4a0 con 0x7f55b0079070 2024-04-23T18:31:18.532 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.522+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdae060 2024-04-23T18:31:18.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.522+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fdae060 2024-04-23T18:31:18.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.522+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.522+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f55b006fce0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.523+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb7400 2024-04-23T18:31:18.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.523+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.523+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb7400 2024-04-23T18:31:18.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.523+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.523+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x7f55b0079070 2024-04-23T18:31:18.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.524+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b800a4a0 con 0x7f55b0079070 2024-04-23T18:31:18.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.524+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb7400 2024-04-23T18:31:18.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.524+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.524+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb7400 2024-04-23T18:31:18.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.524+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.524+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdae060 2024-04-23T18:31:18.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.525+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fdae060 2024-04-23T18:31:18.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.525+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdae060 2024-04-23T18:31:18.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.525+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fdae060 2024-04-23T18:31:18.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.525+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x7f55b0079070 2024-04-23T18:31:18.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.525+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b800a4a0 con 0x7f55b0079070 2024-04-23T18:31:18.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.525+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb7400 2024-04-23T18:31:18.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.525+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.525+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.526+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f55b006fce0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.526+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdae060 2024-04-23T18:31:18.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.526+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b800a4a0 con 0x55fd9fdae060 2024-04-23T18:31:18.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.526+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.526+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b006fce0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.526+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb7400 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.526+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.526+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x7f55b0079070 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.527+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b800a4a0 con 0x7f55b0079070 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.527+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.527+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b00d5040 con 0x55fd9fdb2a50 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.527+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb7400 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.528+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.528+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x7f55b0079070 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.528+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b800a4a0 con 0x7f55b0079070 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.528+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdae060 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.528+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.528+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb1cf0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55b00d5040 con 0x55fd9fdb2a50 2024-04-23T18:31:18.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:18.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:18.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:18.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:18.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:18.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:18.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb5d10 con 0x55fd9fdae060 2024-04-23T18:31:18.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb6100 con 0x55fd9fdae060 2024-04-23T18:31:18.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:18.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdb6100 con 0x7f55b0079070 2024-04-23T18:31:18.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f55b8040080 con 0x7f55b0079070 2024-04-23T18:31:18.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:18.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 zone default found 2024-04-23T18:31:18.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 4 Realm: () 2024-04-23T18:31:18.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:18.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:18.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:18.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 zonegroup default 2024-04-23T18:31:18.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.529+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdba410 con 0x55fd9fdb2a50 2024-04-23T18:31:18.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.530+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f55b00d5040 con 0x55fd9fdb2a50 2024-04-23T18:31:18.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.530+0000 7f55c0b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.530+0000 7f55c0b2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.530+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbc190 con 0x55fd9fdb7400 2024-04-23T18:31:18.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.530+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.530+0000 7f55c0b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.530+0000 7f55c0b2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.530+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbc530 con 0x55fd9fdb7400 2024-04-23T18:31:18.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.530+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.530+0000 7f55c0b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.530+0000 7f55c0b2f800 20 started sync module instance, tier type = 2024-04-23T18:31:18.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.530+0000 7f55c0b2f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:18.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.530+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbb630 con 0x55fd9fdb2a50 2024-04-23T18:31:18.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.531+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b00d5040 con 0x55fd9fdb2a50 2024-04-23T18:31:18.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.531+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94547797064272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbcd80 con 0x55fd9fdb2a50 2024-04-23T18:31:18.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.531+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbd5d0 con 0x55fd9fdae060 2024-04-23T18:31:18.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.532+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94547797064272] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b00d5040 con 0x55fd9fdb2a50 2024-04-23T18:31:18.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.533+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.533+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94547797067984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbd5d0 con 0x55fd9fdae060 2024-04-23T18:31:18.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.533+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbe050 con 0x55fd9fdb7400 2024-04-23T18:31:18.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.534+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94547797067984] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.534+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.534+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94547797072704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbe3f0 con 0x55fd9fdb7400 2024-04-23T18:31:18.539 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.534+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbeeb0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.535+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b00d5040 con 0x55fd9fdb2a50 2024-04-23T18:31:18.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.535+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94547797072704] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.535+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94547797076352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbf2d0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.535+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbfd20 con 0x55fd9fdae060 2024-04-23T18:31:18.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.536+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94547797076352] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b00d5040 con 0x55fd9fdb2a50 2024-04-23T18:31:18.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.536+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.536+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94547797080080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbfce0 con 0x55fd9fdae060 2024-04-23T18:31:18.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.537+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdc0730 con 0x7f55b0079070 2024-04-23T18:31:18.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.537+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x7f55b0079070 2024-04-23T18:31:18.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.538+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94547797082752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdc06a0 con 0x7f55b0079070 2024-04-23T18:31:18.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.538+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdc1620 con 0x7f55b0079070 2024-04-23T18:31:18.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.538+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94547797080080] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.539+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94547797082752] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x7f55b0079070 2024-04-23T18:31:18.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.539+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x7f55b0079070 2024-04-23T18:31:18.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.539+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94547797085008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdc1170 con 0x7f55b0079070 2024-04-23T18:31:18.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.539+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdc1b30 con 0x7f55b0079070 2024-04-23T18:31:18.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.540+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(58 notify.7 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x7f55b0079070 2024-04-23T18:31:18.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.540+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94547797087872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdc1f50 con 0x7f55b0079070 2024-04-23T18:31:18.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.540+0000 7f55c0b2f800 20 add_watcher() i=0 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.540+0000 7f55c0b2f800 20 add_watcher() i=1 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.540+0000 7f55c0b2f800 20 add_watcher() i=2 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.540+0000 7f55c0b2f800 20 add_watcher() i=3 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.540+0000 7f55c0b2f800 20 add_watcher() i=4 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.540+0000 7f55c0b2f800 20 add_watcher() i=5 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.540+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94547797085008] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x7f55b0079070 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.540+0000 7f55c0b2f800 20 add_watcher() i=6 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.541+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94547797087872] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x7f55b0079070 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.541+0000 7f55c0b2f800 20 add_watcher() i=7 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.541+0000 7f55c0b2f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.541+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdc1f50 con 0x55fd9fdae060 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.541+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.541+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94547797088928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdc2910 con 0x55fd9fdae060 2024-04-23T18:31:18.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.542+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94547797088928] v34'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.542+0000 7f5472fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:18.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.542+0000 7f55c0b2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:18.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.542+0000 7f55c0b2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:18.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.543+0000 7f55c0b2f800 5 note: GC not initialized 2024-04-23T18:31:18.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.543+0000 7f5471fe3640 20 reqs_thread_entry: start 2024-04-23T18:31:18.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.543+0000 7f55c0b2f800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:18.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.543+0000 7f55c0b2f800 20 Filter name: none 2024-04-23T18:31:18.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.543+0000 7f53e37fe640 20 reqs_thread_entry: start 2024-04-23T18:31:18.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.543+0000 7f55c0b2f800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-23T18:31:18.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.543+0000 7f55c0b2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.543+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdf8760 con 0x7f55b0079070 2024-04-23T18:31:18.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x7f55b0079070 2024-04-23T18:31:18.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55c0b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55c0b2f800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55c0b2f800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55c0b2f800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55c0b2f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdf6da0 con 0x55fd9fdb7400 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55c0b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55c0b2f800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55c0b2f800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55c0b2f800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55c0b2f800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.544+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdf7890 con 0x7f55b0079070 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.545+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v34'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x7f55b0079070 2024-04-23T18:31:18.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.545+0000 7f55c0b2f800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.545+0000 7f55c0b2f800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.545+0000 7f55c0b2f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.545+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94547797308080 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdfc410 con 0x55fd9fdb2a50 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.546+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== watch-notify(notify (1) cookie 94547797064272 notify 146028888087 ret 0) ==== 575+0+0 (crc 0 0 0) 0x55fd9fd8d5f0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.546+0000 7f5493fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94547797064272 notifier 4840 bl.length()=533 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.546+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(65 notify.0 [notify cookie 94547797308080 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f55b00d5040 con 0x55fd9fdb2a50 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.546+0000 7f5493fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.546+0000 7f5493fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.546+0000 7f5493fff640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5480003ea0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.546+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b00d5040 con 0x55fd9fdb2a50 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.546+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== watch-notify(notify_complete (2) cookie 94547797308080 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fd9fd8cb80 con 0x55fd9fdb2a50 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.546+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdfc3d0 con 0x55fd9fdb7400 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.547+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v34'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.547+0000 7f55c0b2f800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-23T18:31:18.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.547+0000 7f55c0b2f800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-23T18:31:18.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.547+0000 7f55c0b2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-23T18:31:18.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.547+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94547797327648 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdfccd0 con 0x55fd9fdae060 2024-04-23T18:31:18.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.547+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== watch-notify(notify (1) cookie 94547797067984 notify 146028888098 ret 0) ==== 218+0+0 (crc 0 0 0) 0x55fd9fdfbd50 con 0x55fd9fdae060 2024-04-23T18:31:18.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.547+0000 7f5493fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94547797067984 notifier 4840 bl.length()=176 2024-04-23T18:31:18.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.547+0000 7f5493fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-23T18:31:18.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.547+0000 7f5493fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-23T18:31:18.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.547+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(68 notify.1 [notify cookie 94547797327648 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.547+0000 7f5493fff640 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5480003ea0 con 0x55fd9fdae060 2024-04-23T18:31:18.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.548+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.548+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== watch-notify(notify_complete (2) cookie 94547797327648 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fd9fdf8450 con 0x55fd9fdae060 2024-04-23T18:31:18.553 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-04-23T18:31:18.546398Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:31:18.546384Z","tags":[],"group_ids":[]} 2024-04-23T18:31:18.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.548+0000 7f5472fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:18.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.549+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94547797088928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdc4ca0 con 0x55fd9fdae060 2024-04-23T18:31:18.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.549+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94547797088928] v34'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.550+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94547797064272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdc1aa0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.550+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94547797064272] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b00d5040 con 0x55fd9fdb2a50 2024-04-23T18:31:18.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.551+0000 7f55c0b2f800 20 remove_watcher() i=0 2024-04-23T18:31:18.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.551+0000 7f55c0b2f800 2 removed watcher, disabling cache 2024-04-23T18:31:18.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.551+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94547797067984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbba50 con 0x55fd9fdae060 2024-04-23T18:31:18.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.552+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94547797067984] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.552+0000 7f55c0b2f800 20 remove_watcher() i=1 2024-04-23T18:31:18.558 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.552+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94547797072704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbba50 con 0x55fd9fdb7400 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.553+0000 7f55b7fff640 1 -- 172.21.15.119:0/1627784845 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94547797072704] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55a8009050 con 0x55fd9fdb7400 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.553+0000 7f55c0b2f800 20 remove_watcher() i=2 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.553+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94547797076352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbc8d0 con 0x55fd9fdb2a50 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.553+0000 7f55bc8c5640 1 -- 172.21.15.119:0/1627784845 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94547797076352] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b00d5040 con 0x55fd9fdb2a50 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.554+0000 7f55c0b2f800 20 remove_watcher() i=3 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.554+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94547797080080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbc8d0 con 0x55fd9fdae060 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.555+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94547797080080] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x55fd9fdae060 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.555+0000 7f55c0b2f800 20 remove_watcher() i=4 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.555+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94547797082752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdbc8d0 con 0x7f55b0079070 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.556+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94547797082752] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x7f55b0079070 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.556+0000 7f55c0b2f800 20 remove_watcher() i=5 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.556+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94547797085008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdc0280 con 0x7f55b0079070 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.557+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94547797085008] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x7f55b0079070 2024-04-23T18:31:18.559 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.557+0000 7f55c0b2f800 20 remove_watcher() i=6 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.557+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94547797087872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fd9fdc0b50 con 0x7f55b0079070 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94547797087872] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55b8040080 con 0x7f55b0079070 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 20 remove_watcher() i=7 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f55b0079070 msgr2=0x7f55b0088950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f55b0079070 0x7f55b0088950 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd9fdae060 msgr2=0x55fd9fdb0520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd9fdae060 0x55fd9fdb0520 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd9fdb2a50 msgr2=0x55fd9fdb4e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd9fdb2a50 0x55fd9fdb4e40 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55fd9fdb7400 msgr2=0x55fd9fdb98c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55fd9fdb7400 0x55fd9fdb98c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5488036e60 msgr2=0x7f5488039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5488036e60 0x7f5488039320 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f55a8001b60 tx=0x7f55a8010000 comp rx=0 tx=0).stop 2024-04-23T18:31:18.560 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd9b220 msgr2=0x55fd9fda28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1627784845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd9b220 0x55fd9fda28b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009990 tx=0x7f55b009bf30 comp rx=0 tx=0).stop 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 reap_dead start 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1627784845 reap_dead start 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 shutdown_connections 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 >> 172.21.15.119:0/1627784845 conn(0x55fd9fc73a30 msgr2=0x55fd9fd92cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 shutdown_connections 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1627784845 wait complete. 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3678020957 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5494036e60 msgr2=0x7f5494039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/3678020957 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5494036e60 0x7f5494039320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f55a800bf50 tx=0x7f55a800f000 comp rx=0 tx=0).stop 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3678020957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd8c220 msgr2=0x55fd9fd8c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/3678020957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd8c220 0x55fd9fd8c640 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f55b008d240 tx=0x7f55b006f480 comp rx=0 tx=0).stop 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3678020957 shutdown_connections 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/3678020957 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f5494036e60 0x7f5494039320 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/3678020957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fd8c220 0x55fd9fd8c640 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.561 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3678020957 >> 172.21.15.119:0/3678020957 conn(0x55fd9fd802c0 msgr2=0x55fd9fd806c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3678020957 shutdown_connections 2024-04-23T18:31:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.558+0000 7f55c0b2f800 1 -- 172.21.15.119:0/3678020957 wait complete. 2024-04-23T18:31:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55fd9fd7b210 msgr2=0x55fd9fd7d660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55fd9fd7b210 0x55fd9fd7d660 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd9fc78330 msgr2=0x55fd9fd749b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55fd9fc78330 0x55fd9fd749b0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd9fd77280 msgr2=0x55fd9fd79670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55fd9fd77280 0x55fd9fd79670 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f54a4036e60 msgr2=0x7f54a4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f54a4036e60 0x7f54a4039320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f55a8000f60 tx=0x7f55a80012b0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 msgr2=0x55fd9fd6d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 --2- 172.21.15.119:0/1669522272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fd9fc75a00 0x55fd9fd6d940 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f55b0055040 tx=0x7f55b0002fb0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.562 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55bd0c6640 1 -- 172.21.15.119:0/1669522272 reap_dead start 2024-04-23T18:31:18.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 shutdown_connections 2024-04-23T18:31:18.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 >> 172.21.15.119:0/1669522272 conn(0x55fd9fc6f3b0 msgr2=0x55fd9fd64b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 shutdown_connections 2024-04-23T18:31:18.563 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.559+0000 7f55c0b2f800 1 -- 172.21.15.119:0/1669522272 wait complete. 2024-04-23T18:31:18.564 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-23T18:31:18.546398Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.546384Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:18.564 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-23T18:31:18.546398Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.546384Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:18.564 ERROR:root:0 2024-04-23T18:31:18.564 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:18.569 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:18.569 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-04-23T18:31:18.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-04-23T18:31:18.569 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-04-23T18:31:18.611 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:18.612 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:18.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.619+0000 7fb9a0d38800 1 Processor -- start 2024-04-23T18:31:18.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.619+0000 7fb9a0d38800 1 -- start start 2024-04-23T18:31:18.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.619+0000 7fb9a0d38800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x563232c5d050 0x563232cecb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.619+0000 7fb9a0d38800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563232b9a560 con 0x563232ced0a0 2024-04-23T18:31:18.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.619+0000 7fb9a0d38800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x563232b8be20 con 0x563232c5d050 2024-04-23T18:31:18.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.620+0000 7fb99ca3a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x563232c5d050 0x563232cecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.620+0000 7fb99ca3a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x563232c5d050 0x563232cecb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:54992/0 (socket says 172.21.15.119:54992) 2024-04-23T18:31:18.613 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.620+0000 7fb994239640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x563232ced0a0 0x563232cef540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50572/0 (socket says 172.21.15.119:50572) 2024-04-23T18:31:18.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.620+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1973806284 learned_addr learned my addr 172.21.15.119:0/1973806284 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.620+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1973806284 >> v1:172.21.15.62:6789/0 conn(0x563232ced0a0 legacy=0x563232cef540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.614 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.620+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1973806284 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563232b99e60 con 0x563232c5d050 2024-04-23T18:31:18.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.622+0000 7fb99ca3a640 1 --2- 172.21.15.119:0/1973806284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232cecb00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00a520 tx=0x7fb98c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717cc372a615d340 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.622+0000 7fb997fff640 1 -- 172.21.15.119:0/1973806284 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c057070 con 0x563232c5d050 2024-04-23T18:31:18.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.622+0000 7fb997fff640 1 -- 172.21.15.119:0/1973806284 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98c052570 con 0x563232c5d050 2024-04-23T18:31:18.615 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.622+0000 7fb997fff640 1 -- 172.21.15.119:0/1973806284 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c04ae60 con 0x563232c5d050 2024-04-23T18:31:18.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.622+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1973806284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 msgr2=0x563232cecb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.622+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/1973806284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232cecb00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00a520 tx=0x7fb98c01d010 comp rx=0 tx=0).stop 2024-04-23T18:31:18.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.622+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1973806284 shutdown_connections 2024-04-23T18:31:18.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.622+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/1973806284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232cecb00 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.616 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.622+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1973806284 >> 172.21.15.119:0/1973806284 conn(0x563232ce4420 msgr2=0x563232ce6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.622+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1973806284 shutdown_connections 2024-04-23T18:31:18.617 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.622+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1973806284 wait complete. 2024-04-23T18:31:18.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.634+0000 7fb9a0d38800 1 Processor -- start 2024-04-23T18:31:18.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.634+0000 7fb9a0d38800 1 -- start start 2024-04-23T18:31:18.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.634+0000 7fb9a0d38800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232cea430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.634+0000 7fb9a0d38800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563232c355b0 con 0x563232c5d050 2024-04-23T18:31:18.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.634+0000 7fb99ca3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232cea430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.634+0000 7fb99ca3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232cea430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55002/0 (socket says 172.21.15.119:55002) 2024-04-23T18:31:18.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.634+0000 7fb99ca3a640 1 -- 172.21.15.119:0/3834948670 learned_addr learned my addr 172.21.15.119:0/3834948670 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.635+0000 7fb99ca3a640 1 -- 172.21.15.119:0/3834948670 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563232bab860 con 0x563232c5d050 2024-04-23T18:31:18.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.635+0000 7fb99ca3a640 1 --2- 172.21.15.119:0/3834948670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232cea430 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb98c01d050 tx=0x7fb98c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2181b3fb8e985ede server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.635+0000 7fb88ae0d640 1 -- 172.21.15.119:0/3834948670 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c057040 con 0x563232c5d050 2024-04-23T18:31:18.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.635+0000 7fb88ae0d640 1 -- 172.21.15.119:0/3834948670 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98c052720 con 0x563232c5d050 2024-04-23T18:31:18.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.635+0000 7fb88ae0d640 1 -- 172.21.15.119:0/3834948670 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c052a40 con 0x563232c5d050 2024-04-23T18:31:18.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.636+0000 7fb9a0d38800 1 -- 172.21.15.119:0/3834948670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 msgr2=0x563232cea430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.636+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/3834948670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232cea430 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb98c01d050 tx=0x7fb98c04c000 comp rx=0 tx=0).stop 2024-04-23T18:31:18.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.636+0000 7fb9a0d38800 1 -- 172.21.15.119:0/3834948670 shutdown_connections 2024-04-23T18:31:18.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.636+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/3834948670 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232cea430 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.636+0000 7fb9a0d38800 1 -- 172.21.15.119:0/3834948670 >> 172.21.15.119:0/3834948670 conn(0x563232ce4420 msgr2=0x563232dd6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.636+0000 7fb9a0d38800 1 -- 172.21.15.119:0/3834948670 shutdown_connections 2024-04-23T18:31:18.632 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.636+0000 7fb9a0d38800 1 -- 172.21.15.119:0/3834948670 wait complete. 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.636+0000 7fb9a0d38800 1 Processor -- start 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.636+0000 7fb9a0d38800 1 -- start start 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.636+0000 7fb9a0d38800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232de4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.636+0000 7fb9a0d38800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563232cf0fb0 con 0x563232c5d050 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.637+0000 7fb99ca3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232de4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.637+0000 7fb99ca3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232de4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55008/0 (socket says 172.21.15.119:55008) 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.637+0000 7fb99ca3a640 1 -- 172.21.15.119:0/582472082 learned_addr learned my addr 172.21.15.119:0/582472082 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.637+0000 7fb99ca3a640 1 -- 172.21.15.119:0/582472082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563232ba9eb0 con 0x563232c5d050 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.637+0000 7fb99ca3a640 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232de4b20 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb98c01cfe0 tx=0x7fb98c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.637+0000 7fb88960a640 1 -- 172.21.15.119:0/582472082 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c073070 con 0x563232c5d050 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.637+0000 7fb88960a640 1 -- 172.21.15.119:0/582472082 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98c05d440 con 0x563232c5d050 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.637+0000 7fb88960a640 1 -- 172.21.15.119:0/582472082 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c057070 con 0x563232c5d050 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.637+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563232de5060 con 0x563232c5d050 2024-04-23T18:31:18.633 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.637+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563232de5580 con 0x563232c5d050 2024-04-23T18:31:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.638+0000 7fb88960a640 1 -- 172.21.15.119:0/582472082 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb98c076070 con 0x563232c5d050 2024-04-23T18:31:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.638+0000 7fb88960a640 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb884036e60 0x7fb884039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.638+0000 7fb88960a640 1 -- 172.21.15.119:0/582472082 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb98c08e4b0 con 0x563232c5d050 2024-04-23T18:31:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.638+0000 7fb994239640 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb884036e60 0x7fb884039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.638+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563232ced0a0 0x563232debb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.638+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232dec120 con 0x563232ced0a0 2024-04-23T18:31:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.638+0000 7fb99d23b640 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563232ced0a0 0x563232debb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.639+0000 7fb994239640 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb884036e60 0x7fb884039320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb984001e40 tx=0x7fb9840013a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.634 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.639+0000 7fb99d23b640 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563232ced0a0 0x563232debb90 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.644 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.639+0000 7fb99d23b640 1 -- 172.21.15.119:0/582472082 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232ced0a0 2024-04-23T18:31:18.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.639+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232dec9e0 con 0x563232ced0a0 2024-04-23T18:31:18.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.639+0000 7fb99d23b640 1 -- 172.21.15.119:0/582472082 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232ced0a0 2024-04-23T18:31:18.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.639+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563232dee2f0 0x563232df0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.639+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232df0f10 con 0x563232dee2f0 2024-04-23T18:31:18.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.639+0000 7fb99ca3a640 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563232dee2f0 0x563232df0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.640+0000 7fb99ca3a640 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563232dee2f0 0x563232df0780 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.640+0000 7fb99ca3a640 1 -- 172.21.15.119:0/582472082 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb98c075030 con 0x563232dee2f0 2024-04-23T18:31:18.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.640+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232ded230 con 0x563232ced0a0 2024-04-23T18:31:18.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.640+0000 7fb99d23b640 1 -- 172.21.15.119:0/582472082 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232ced0a0 2024-04-23T18:31:18.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.640+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x563232df2370 0x563232df47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.640+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232df4f40 con 0x563232df2370 2024-04-23T18:31:18.645 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.641+0000 7fb994239640 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x563232df2370 0x563232df47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.641+0000 7fb994239640 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x563232df2370 0x563232df47e0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.641+0000 7fb994239640 1 -- 172.21.15.119:0/582472082 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb98400f6d0 con 0x563232df2370 2024-04-23T18:31:18.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.642+0000 7fb9a0d38800 1 Processor -- start 2024-04-23T18:31:18.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.642+0000 7fb9a0d38800 1 -- start start 2024-04-23T18:31:18.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.642+0000 7fb9a0d38800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e033a0 0x563232e037c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.642+0000 7fb9a0d38800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563232bdbdf0 con 0x563232e033a0 2024-04-23T18:31:18.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.642+0000 7fb99ca3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e033a0 0x563232e037c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.642+0000 7fb99ca3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e033a0 0x563232e037c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55014/0 (socket says 172.21.15.119:55014) 2024-04-23T18:31:18.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.642+0000 7fb99ca3a640 1 -- 172.21.15.119:0/3507202846 learned_addr learned my addr 172.21.15.119:0/3507202846 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.642+0000 7fb99ca3a640 1 -- 172.21.15.119:0/3507202846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563232e03d00 con 0x563232e033a0 2024-04-23T18:31:18.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.642+0000 7fb99ca3a640 1 --2- 172.21.15.119:0/3507202846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e033a0 0x563232e037c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb98c005930 tx=0x7fb98c0776a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.643+0000 7fb8827fc640 1 -- 172.21.15.119:0/3507202846 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c077a70 con 0x563232e033a0 2024-04-23T18:31:18.646 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.643+0000 7fb8827fc640 1 -- 172.21.15.119:0/3507202846 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98c088070 con 0x563232e033a0 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.643+0000 7fb9a0d38800 1 -- 172.21.15.119:0/3507202846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563232e04770 con 0x563232e033a0 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.643+0000 7fb8827fc640 1 -- 172.21.15.119:0/3507202846 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c077d60 con 0x563232e033a0 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.643+0000 7fb9a0d38800 1 -- 172.21.15.119:0/3507202846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563232e04c70 con 0x563232e033a0 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.643+0000 7fb8827fc640 1 -- 172.21.15.119:0/3507202846 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb98c08a030 con 0x563232e033a0 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.643+0000 7fb8827fc640 1 --2- 172.21.15.119:0/3507202846 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb874036eb0 0x7fb874039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.643+0000 7fb8827fc640 1 -- 172.21.15.119:0/3507202846 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb98c085040 con 0x563232e033a0 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.644+0000 7fb994239640 1 --2- 172.21.15.119:0/3507202846 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb874036eb0 0x7fb874039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.644+0000 7fb9a0d38800 1 Processor -- start 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.644+0000 7fb9a0d38800 1 -- start start 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.644+0000 7fb994239640 1 --2- 172.21.15.119:0/3507202846 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb874036eb0 0x7fb874039370 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x563232de9080 tx=0x7fb98400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.644+0000 7fb9a0d38800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 0x563232e10890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.644+0000 7fb9a0d38800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563232ce89f0 con 0x563232e10470 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.644+0000 7fb99ca3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 0x563232e10890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.647 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.644+0000 7fb99ca3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 0x563232e10890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55022/0 (socket says 172.21.15.119:55022) 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.644+0000 7fb99ca3a640 1 -- 172.21.15.119:0/519654731 learned_addr learned my addr 172.21.15.119:0/519654731 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.645+0000 7fb99ca3a640 1 -- 172.21.15.119:0/519654731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563232e10e60 con 0x563232e10470 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.645+0000 7fb99ca3a640 1 --2- 172.21.15.119:0/519654731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 0x563232e10890 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb98c08e420 tx=0x7fb98c078b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11646e916bd83c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.645+0000 7fb873fff640 1 -- 172.21.15.119:0/519654731 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c0a8070 con 0x563232e10470 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.645+0000 7fb873fff640 1 -- 172.21.15.119:0/519654731 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98c08eb50 con 0x563232e10470 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.645+0000 7fb873fff640 1 -- 172.21.15.119:0/519654731 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c06f050 con 0x563232e10470 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.645+0000 7fb9a0d38800 1 -- 172.21.15.119:0/519654731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 msgr2=0x563232e10890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.645+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/519654731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 0x563232e10890 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb98c08e420 tx=0x7fb98c078b90 comp rx=0 tx=0).stop 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.645+0000 7fb9a0d38800 1 -- 172.21.15.119:0/519654731 shutdown_connections 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.645+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/519654731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 0x563232e10890 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.645+0000 7fb9a0d38800 1 -- 172.21.15.119:0/519654731 >> 172.21.15.119:0/519654731 conn(0x563232e0c7d0 msgr2=0x563232e0a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.645+0000 7fb9a0d38800 1 -- 172.21.15.119:0/519654731 shutdown_connections 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.645+0000 7fb9a0d38800 1 -- 172.21.15.119:0/519654731 wait complete. 2024-04-23T18:31:18.648 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.646+0000 7fb9a0d38800 1 Processor -- start 2024-04-23T18:31:18.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.646+0000 7fb9a0d38800 1 -- start start 2024-04-23T18:31:18.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.646+0000 7fb9a0d38800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 0x563232e17840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.646+0000 7fb9a0d38800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563232e11510 con 0x563232e10470 2024-04-23T18:31:18.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.646+0000 7fb99ca3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 0x563232e17840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.646+0000 7fb99ca3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 0x563232e17840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55028/0 (socket says 172.21.15.119:55028) 2024-04-23T18:31:18.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.646+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 learned_addr learned my addr 172.21.15.119:0/1954782857 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.646+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563232e17d80 con 0x563232e10470 2024-04-23T18:31:18.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.646+0000 7fb99ca3a640 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 0x563232e17840 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb98c08e420 tx=0x7fb98c066690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.647+0000 7fb8727fc640 1 -- 172.21.15.119:0/1954782857 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c0b3020 con 0x563232e10470 2024-04-23T18:31:18.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.647+0000 7fb8727fc640 1 -- 172.21.15.119:0/1954782857 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98c0a9040 con 0x563232e10470 2024-04-23T18:31:18.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.647+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563232e17d80 con 0x563232e10470 2024-04-23T18:31:18.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.647+0000 7fb8727fc640 1 -- 172.21.15.119:0/1954782857 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb98c0a8070 con 0x563232e10470 2024-04-23T18:31:18.649 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.647+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563232e17d80 con 0x563232e10470 2024-04-23T18:31:18.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.647+0000 7fb8727fc640 1 -- 172.21.15.119:0/1954782857 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb98c0b6020 con 0x563232e10470 2024-04-23T18:31:18.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.647+0000 7fb8727fc640 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb868036e60 0x7fb868039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.647+0000 7fb8727fc640 1 -- 172.21.15.119:0/1954782857 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb98c0b9d10 con 0x563232e10470 2024-04-23T18:31:18.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.648+0000 7fb994239640 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb868036e60 0x7fb868039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.648+0000 7fb994239640 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb868036e60 0x7fb868039320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x563232df5340 tx=0x7fb984010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.648+0000 7fb9a0d38800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.648+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563232e22f70 0x563232e25430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.648+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e25b80 con 0x563232e22f70 2024-04-23T18:31:18.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.648+0000 7fb99d23b640 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563232e22f70 0x563232e25430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.648+0000 7fb99d23b640 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563232e22f70 0x563232e25430 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232e22f70 2024-04-23T18:31:18.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.650 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 20 realm 2024-04-23T18:31:18.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e25f90 con 0x563232e22f70 2024-04-23T18:31:18.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232e22f70 2024-04-23T18:31:18.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:18.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e26860 con 0x563232e22f70 2024-04-23T18:31:18.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232e22f70 2024-04-23T18:31:18.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e22f70 2024-04-23T18:31:18.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232e22f70 2024-04-23T18:31:18.651 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563232e27960 0x563232e29d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e2a360 con 0x563232e27960 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.649+0000 7fb99ca3a640 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563232e27960 0x563232e29d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.650+0000 7fb99ca3a640 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563232e27960 0x563232e29d50 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.650+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb98c075030 con 0x563232e27960 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.650+0000 7fb9a0d38800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.650+0000 7fb9a0d38800 20 searching for the correct realm 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.650+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563232e2c310 0x563232e2e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.650+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e2eea0 con 0x563232e2c310 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.650+0000 7fb994239640 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563232e2c310 0x563232e2e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.650+0000 7fb994239640 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563232e2c310 0x563232e2e7d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.651+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.652 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.651+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e2eea0 con 0x563232e27960 2024-04-23T18:31:18.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.651+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb98c075030 con 0x563232e27960 2024-04-23T18:31:18.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.651+0000 7fb99ca3a640 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb98c0b8020 0x7fb98c04d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.651+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e2eea0 con 0x7fb98c0b8020 2024-04-23T18:31:18.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.651+0000 7fb99d23b640 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb98c0b8020 0x7fb98c04d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.653 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.651+0000 7fb99d23b640 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb98c0b8020 0x7fb98c04d160 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.652+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99800a4a0 con 0x7fb98c0b8020 2024-04-23T18:31:18.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.652+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e22f70 2024-04-23T18:31:18.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.652+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232e22f70 2024-04-23T18:31:18.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.652+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e22f70 2024-04-23T18:31:18.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.652+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232e22f70 2024-04-23T18:31:18.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.652+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x7fb98c0b8020 2024-04-23T18:31:18.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.652+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99800a4a0 con 0x7fb98c0b8020 2024-04-23T18:31:18.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.652+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x7fb98c0b8020 2024-04-23T18:31:18.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.653+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb99800a4a0 con 0x7fb98c0b8020 2024-04-23T18:31:18.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.653+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e27960 2024-04-23T18:31:18.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.653+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb98c075030 con 0x563232e27960 2024-04-23T18:31:18.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.653+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e2c310 2024-04-23T18:31:18.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.653+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.653+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e22f70 2024-04-23T18:31:18.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.653+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232e22f70 2024-04-23T18:31:18.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.653+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x7fb98c0b8020 2024-04-23T18:31:18.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.654+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99800a4a0 con 0x7fb98c0b8020 2024-04-23T18:31:18.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.654+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e22f70 2024-04-23T18:31:18.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.654+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232e22f70 2024-04-23T18:31:18.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.654+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e27960 2024-04-23T18:31:18.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.654+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb98c075030 con 0x563232e27960 2024-04-23T18:31:18.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.654+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e2c310 2024-04-23T18:31:18.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.654+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.654+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e2c310 2024-04-23T18:31:18.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.655+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.655+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x7fb98c0b8020 2024-04-23T18:31:18.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.655+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99800a4a0 con 0x7fb98c0b8020 2024-04-23T18:31:18.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.655+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e2c310 2024-04-23T18:31:18.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.655+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.655+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e2c310 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.655+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.655+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e22f70 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.656+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232e22f70 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.656+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e22f70 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.656+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232e22f70 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.656+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x7fb98c0b8020 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.656+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99800a4a0 con 0x7fb98c0b8020 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.656+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e2c310 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.656+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.656+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e27960 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.657+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb98c075030 con 0x563232e27960 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.657+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e22f70 2024-04-23T18:31:18.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.657+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99800a4a0 con 0x563232e22f70 2024-04-23T18:31:18.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.657+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e27960 2024-04-23T18:31:18.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.657+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb98c075030 con 0x563232e27960 2024-04-23T18:31:18.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.657+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e2c310 2024-04-23T18:31:18.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.657+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.657+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x7fb98c0b8020 2024-04-23T18:31:18.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.658+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99800a4a0 con 0x7fb98c0b8020 2024-04-23T18:31:18.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.658+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e27960 2024-04-23T18:31:18.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.658+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.658+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e2c310 2024-04-23T18:31:18.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.658+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.658+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x7fb98c0b8020 2024-04-23T18:31:18.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb99800a4a0 con 0x7fb98c0b8020 2024-04-23T18:31:18.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e22f70 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563232e26c00 con 0x563232e27960 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb9a0d38800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb9a0d38800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb9a0d38800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb9a0d38800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb9a0d38800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb9a0d38800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb9a0d38800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e2ac20 con 0x563232e22f70 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb9a0d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb9a0d38800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.659+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e2b010 con 0x563232e22f70 2024-04-23T18:31:18.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:18.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e2b010 con 0x7fb98c0b8020 2024-04-23T18:31:18.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:18.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 20 zone default found 2024-04-23T18:31:18.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 4 Realm: () 2024-04-23T18:31:18.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:18.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:18.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 20 zonegroup default 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e2f320 con 0x563232e27960 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.660+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e310a0 con 0x563232e2c310 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.661+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.661+0000 7fb9a0d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.661+0000 7fb9a0d38800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.661+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e31440 con 0x563232e2c310 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.661+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.661+0000 7fb9a0d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.661+0000 7fb9a0d38800 20 started sync module instance, tier type = 2024-04-23T18:31:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.661+0000 7fb9a0d38800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.661+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e30540 con 0x563232e27960 2024-04-23T18:31:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.662+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.662+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94773602093360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e31c90 con 0x563232e27960 2024-04-23T18:31:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.662+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e324e0 con 0x563232e22f70 2024-04-23T18:31:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.663+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94773602093360] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.663+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.663+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94773602097120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e324e0 con 0x563232e22f70 2024-04-23T18:31:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.663+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e32fb0 con 0x563232e2c310 2024-04-23T18:31:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.664+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94773602097120] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.665+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.665+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94773602099248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e32450 con 0x563232e2c310 2024-04-23T18:31:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.665+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e33e70 con 0x563232e27960 2024-04-23T18:31:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.666+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.666+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94773602106272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e34710 con 0x563232e27960 2024-04-23T18:31:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.666+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e351e0 con 0x563232e22f70 2024-04-23T18:31:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.666+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94773602099248] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.667+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94773602106272] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.667+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.667+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94773602110672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e34260 con 0x563232e22f70 2024-04-23T18:31:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.667+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e35a80 con 0x7fb98c0b8020 2024-04-23T18:31:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.668+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.668+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94773602112896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e34260 con 0x7fb98c0b8020 2024-04-23T18:31:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.668+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e36530 con 0x7fb98c0b8020 2024-04-23T18:31:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.668+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94773602110672] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.669+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94773602112896] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.669+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.669+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94773602113952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e36530 con 0x7fb98c0b8020 2024-04-23T18:31:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.669+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e36e00 con 0x7fb98c0b8020 2024-04-23T18:31:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.670+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94773602113952] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.671+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.671+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94773602115648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e36530 con 0x7fb98c0b8020 2024-04-23T18:31:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.671+0000 7fb9a0d38800 20 add_watcher() i=0 2024-04-23T18:31:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.671+0000 7fb9a0d38800 20 add_watcher() i=1 2024-04-23T18:31:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.671+0000 7fb9a0d38800 20 add_watcher() i=2 2024-04-23T18:31:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.671+0000 7fb9a0d38800 20 add_watcher() i=3 2024-04-23T18:31:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.671+0000 7fb9a0d38800 20 add_watcher() i=4 2024-04-23T18:31:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.671+0000 7fb9a0d38800 20 add_watcher() i=5 2024-04-23T18:31:18.674 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.671+0000 7fb9a0d38800 20 add_watcher() i=6 2024-04-23T18:31:18.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.672+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94773602115648] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.672+0000 7fb9a0d38800 20 add_watcher() i=7 2024-04-23T18:31:18.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.672+0000 7fb9a0d38800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:18.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.672+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e39e30 con 0x563232e22f70 2024-04-23T18:31:18.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.672+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.672+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94773602117968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e372f0 con 0x563232e22f70 2024-04-23T18:31:18.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.673+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94773602117968] v34'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.673+0000 7fb852fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:18.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.673+0000 7fb9a0d38800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:18.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.673+0000 7fb9a0d38800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:18.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.673+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e42a40 con 0x563232e22f70 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.675+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.675+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e43090 con 0x7fb98c0b8020 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.676+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.676+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e434f0 con 0x563232e2c310 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.677+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.677+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e43f10 con 0x563232e22f70 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.678+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'247 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.678+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e3e700 con 0x563232e27960 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.679+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.679+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e3e6d0 con 0x563232e2c310 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.680+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.680+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e44a70 con 0x563232e22f70 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.681+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.679 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.681+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e44f20 con 0x7fb98c0b8020 2024-04-23T18:31:18.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.682+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'54 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.682+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e44f20 con 0x563232e27960 2024-04-23T18:31:18.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.683+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.683+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e44f20 con 0x563232e2c310 2024-04-23T18:31:18.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.684+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.680 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.684+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e44f20 con 0x563232e27960 2024-04-23T18:31:18.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.685+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.685+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e44fe0 con 0x7fb98c0b8020 2024-04-23T18:31:18.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.686+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.686+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e44fe0 con 0x563232e27960 2024-04-23T18:31:18.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.687+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.681 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.687+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e44fb0 con 0x7fb98c0b8020 2024-04-23T18:31:18.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.688+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.688+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e44fb0 con 0x563232e22f70 2024-04-23T18:31:18.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.689+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'248 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.682 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.689+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e44fb0 con 0x563232e2c310 2024-04-23T18:31:18.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.690+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'71 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.690+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45720 con 0x563232e27960 2024-04-23T18:31:18.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.691+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.691+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e3e050 con 0x563232e2c310 2024-04-23T18:31:18.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.692+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.692+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45720 con 0x563232e22f70 2024-04-23T18:31:18.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.693+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.693+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45550 con 0x563232e22f70 2024-04-23T18:31:18.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.694+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'249 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.694+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45550 con 0x563232e2c310 2024-04-23T18:31:18.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.695+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'72 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.695+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45550 con 0x563232e27960 2024-04-23T18:31:18.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.696+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.697+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45550 con 0x563232e2c310 2024-04-23T18:31:18.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.697+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.697+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45550 con 0x563232e2c310 2024-04-23T18:31:18.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.698+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.692 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.698+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45550 con 0x563232e2c310 2024-04-23T18:31:18.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.699+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.693 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.700+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45550 con 0x563232e2c310 2024-04-23T18:31:18.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.700+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.694 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.701+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45550 con 0x7fb98c0b8020 2024-04-23T18:31:18.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.702+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.695 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.702+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45b60 con 0x563232e2c310 2024-04-23T18:31:18.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.703+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.696 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.703+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45b60 con 0x7fb98c0b8020 2024-04-23T18:31:18.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.704+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'55 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.697 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.704+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45b60 con 0x563232e2c310 2024-04-23T18:31:18.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.705+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'73 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.698 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.705+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45b60 con 0x7fb98c0b8020 2024-04-23T18:31:18.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.707+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.707+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e45b60 con 0x563232e27960 2024-04-23T18:31:18.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.708+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.708+0000 7fb851fe3640 20 reqs_thread_entry: start 2024-04-23T18:31:18.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.708+0000 7fb9a0d38800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:18.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.708+0000 7fb9a0d38800 20 Filter name: none 2024-04-23T18:31:18.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.708+0000 7fb7c37fe640 20 reqs_thread_entry: start 2024-04-23T18:31:18.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.708+0000 7fb9a0d38800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-23T18:31:18.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.708+0000 7fb9a0d38800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.702 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.708+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e705a0 con 0x7fb98c0b8020 2024-04-23T18:31:18.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.709+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.709+0000 7fb9a0d38800 20 rados_obj.operate() r=0 bl.length=349 2024-04-23T18:31:18.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.709+0000 7fb9a0d38800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-04-23T18:31:18.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.709+0000 7fb9a0d38800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-23T18:31:18.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.709+0000 7fb9a0d38800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:18.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.709+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e72fc0 con 0x7fb98c0b8020 2024-04-23T18:31:18.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.710+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.710+0000 7fb9a0d38800 10 removing key index: system_akey 2024-04-23T18:31:18.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.710+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e70fa0 con 0x563232e2c310 2024-04-23T18:31:18.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.711+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(96 system_akey [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.711+0000 7fb9a0d38800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-23T18:31:18.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.711+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94773602360064 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e733e0 con 0x563232e22f70 2024-04-23T18:31:18.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.711+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== watch-notify(notify (1) cookie 94773602097120 notify 146028888099 ret 0) ==== 203+0+0 (crc 0 0 0) 0x563232e44a70 con 0x563232e22f70 2024-04-23T18:31:18.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.711+0000 7fb873fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94773602097120 notifier 4847 bl.length()=161 2024-04-23T18:31:18.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.711+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(97 notify.1 [notify cookie 94773602360064 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.711+0000 7fb873fff640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb860003d60 con 0x563232e22f70 2024-04-23T18:31:18.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.711+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.711+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== watch-notify(notify_complete (2) cookie 94773602360064 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563232e42590 con 0x563232e22f70 2024-04-23T18:31:18.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.711+0000 7fb9a0d38800 10 removing email index: 2024-04-23T18:31:18.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.711+0000 7fb9a0d38800 10 removing user buckets index 2024-04-23T18:31:18.706 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.712+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e70f50 con 0x7fb98c0b8020 2024-04-23T18:31:18.707 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.713+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(99 system_user.buckets [delete] v34'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.713+0000 7fb9a0d38800 10 removing user index: system_user 2024-04-23T18:31:18.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.713+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e750f0 con 0x7fb98c0b8020 2024-04-23T18:31:18.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.714+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(100 system_user [call,call,delete] v34'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.714+0000 7fb9a0d38800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-04-23T18:31:18.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.714+0000 7fb9a0d38800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-23T18:31:18.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.714+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94773602372672 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563232e750a0 con 0x563232e27960 2024-04-23T18:31:18.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.714+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== watch-notify(notify (1) cookie 94773602093360 notify 146028888088 ret 0) ==== 202+0+0 (crc 0 0 0) 0x563232e3ed50 con 0x563232e27960 2024-04-23T18:31:18.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.714+0000 7fb873fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94773602093360 notifier 4847 bl.length()=160 2024-04-23T18:31:18.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.714+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(101 notify.0 [notify cookie 94773602372672 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.714+0000 7fb873fff640 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb860003d60 con 0x563232e27960 2024-04-23T18:31:18.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.714+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== watch-notify(notify_complete (2) cookie 94773602372672 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563232e03d00 con 0x563232e27960 2024-04-23T18:31:18.708 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.714+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 24 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.715+0000 7fb852fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:18.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.715+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94773602117968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232dd2730 con 0x563232e22f70 2024-04-23T18:31:18.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.716+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94773602117968] v34'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.716+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94773602093360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e36950 con 0x563232e27960 2024-04-23T18:31:18.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.717+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 25 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94773602093360] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.717+0000 7fb9a0d38800 20 remove_watcher() i=0 2024-04-23T18:31:18.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.717+0000 7fb9a0d38800 2 removed watcher, disabling cache 2024-04-23T18:31:18.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.717+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94773602097120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e36950 con 0x563232e22f70 2024-04-23T18:31:18.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.719+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94773602097120] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.719+0000 7fb9a0d38800 20 remove_watcher() i=1 2024-04-23T18:31:18.712 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.719+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94773602099248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e317e0 con 0x563232e2c310 2024-04-23T18:31:18.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.720+0000 7fb994239640 1 -- 172.21.15.119:0/1954782857 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94773602099248] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb984037040 con 0x563232e2c310 2024-04-23T18:31:18.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.720+0000 7fb9a0d38800 20 remove_watcher() i=2 2024-04-23T18:31:18.713 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.720+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94773602106272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e36950 con 0x563232e27960 2024-04-23T18:31:18.714 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.721+0000 7fb99ca3a640 1 -- 172.21.15.119:0/1954782857 <== osd.2 v2:172.21.15.119:6800/2624052101 26 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94773602106272] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb98c0cf040 con 0x563232e27960 2024-04-23T18:31:18.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.721+0000 7fb9a0d38800 20 remove_watcher() i=3 2024-04-23T18:31:18.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.721+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94773602110672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e32030 con 0x563232e22f70 2024-04-23T18:31:18.715 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.722+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94773602110672] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x563232e22f70 2024-04-23T18:31:18.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.722+0000 7fb9a0d38800 20 remove_watcher() i=4 2024-04-23T18:31:18.716 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.722+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94773602112896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e36950 con 0x7fb98c0b8020 2024-04-23T18:31:18.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.723+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94773602112896] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.723+0000 7fb9a0d38800 20 remove_watcher() i=5 2024-04-23T18:31:18.717 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.723+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94773602113952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e34cd0 con 0x7fb98c0b8020 2024-04-23T18:31:18.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.724+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94773602113952] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.724+0000 7fb9a0d38800 20 remove_watcher() i=6 2024-04-23T18:31:18.718 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.724+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94773602115648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563232e32030 con 0x7fb98c0b8020 2024-04-23T18:31:18.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.725+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94773602115648] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb998040080 con 0x7fb98c0b8020 2024-04-23T18:31:18.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.725+0000 7fb9a0d38800 20 remove_watcher() i=7 2024-04-23T18:31:18.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb98c0b8020 msgr2=0x7fb98c04d160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb98c0b8020 0x7fb98c04d160 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563232e22f70 msgr2=0x563232e25430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563232e22f70 0x563232e25430 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563232e27960 msgr2=0x563232e29d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563232e27960 0x563232e29d50 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563232e2c310 msgr2=0x563232e2e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x563232e2c310 0x563232e2e7d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb868036e60 msgr2=0x7fb868039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb868036e60 0x7fb868039320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x563232df5340 tx=0x7fb984010000 comp rx=0 tx=0).stop 2024-04-23T18:31:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 msgr2=0x563232e17840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb99d23b640 1 -- 172.21.15.119:0/1954782857 reap_dead start 2024-04-23T18:31:18.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 0x563232e17840 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb98c08e420 tx=0x7fb98c066690 comp rx=0 tx=0).stop 2024-04-23T18:31:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 shutdown_connections 2024-04-23T18:31:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/1954782857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e10470 0x563232e17840 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 >> 172.21.15.119:0/1954782857 conn(0x563232e0c7d0 msgr2=0x563232e09e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 shutdown_connections 2024-04-23T18:31:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/1954782857 wait complete. 2024-04-23T18:31:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/3507202846 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb874036eb0 msgr2=0x7fb874039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/3507202846 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb874036eb0 0x7fb874039370 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x563232de9080 tx=0x7fb98400f000 comp rx=0 tx=0).stop 2024-04-23T18:31:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/3507202846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e033a0 msgr2=0x563232e037c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/3507202846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e033a0 0x563232e037c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb98c005930 tx=0x7fb98c0776a0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/3507202846 shutdown_connections 2024-04-23T18:31:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/3507202846 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb874036eb0 0x7fb874039370 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/3507202846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232e033a0 0x563232e037c0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/3507202846 >> 172.21.15.119:0/3507202846 conn(0x563232df7440 msgr2=0x563232df7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/3507202846 shutdown_connections 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.726+0000 7fb9a0d38800 1 -- 172.21.15.119:0/3507202846 wait complete. 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x563232df2370 msgr2=0x563232df47e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x563232df2370 0x563232df47e0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563232ced0a0 msgr2=0x563232debb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x563232ced0a0 0x563232debb90 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563232dee2f0 msgr2=0x563232df0780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x563232dee2f0 0x563232df0780 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb884036e60 msgr2=0x7fb884039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb884036e60 0x7fb884039320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb984001e40 tx=0x7fb9840013a0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 msgr2=0x563232de4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 --2- 172.21.15.119:0/582472082 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563232c5d050 0x563232de4b20 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb98c01cfe0 tx=0x7fb98c003020 comp rx=0 tx=0).stop 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb99d23b640 1 -- 172.21.15.119:0/582472082 reap_dead start 2024-04-23T18:31:18.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 shutdown_connections 2024-04-23T18:31:18.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 >> 172.21.15.119:0/582472082 conn(0x563232ce4420 msgr2=0x563232dd6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 shutdown_connections 2024-04-23T18:31:18.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.727+0000 7fb9a0d38800 1 -- 172.21.15.119:0/582472082 wait complete. 2024-04-23T18:31:18.728 ERROR:root:None 2024-04-23T18:31:18.728 ERROR:root:0 2024-04-23T18:31:18.728 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-23T18:31:18.728 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-23T18:31:18.728 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-04-23T18:31:18.820 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:18.820 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:18.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.827+0000 7fe88fc0a800 1 Processor -- start 2024-04-23T18:31:18.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.827+0000 7fe88fc0a800 1 -- start start 2024-04-23T18:31:18.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.828+0000 7fe88fc0a800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561400e7e510 0x561400e80900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.828+0000 7fe88fc0a800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561400d2a560 con 0x561400e7aa00 2024-04-23T18:31:18.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.828+0000 7fe88fc0a800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x561400d1be20 con 0x561400e7e510 2024-04-23T18:31:18.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.828+0000 7fe884f08640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561400e7e510 0x561400e80900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.828+0000 7fe884f08640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561400e7e510 0x561400e80900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55034/0 (socket says 172.21.15.119:55034) 2024-04-23T18:31:18.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.828+0000 7fe884f08640 1 -- 172.21.15.119:0/578912806 learned_addr learned my addr 172.21.15.119:0/578912806 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.828+0000 7fe88d709640 1 --1- 172.21.15.119:0/578912806 >> v1:172.21.15.62:6789/0 conn(0x561400e7aa00 0x561400e7cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50586/0 (socket says 172.21.15.119:50586) 2024-04-23T18:31:18.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.828+0000 7fe884f08640 1 -- 172.21.15.119:0/578912806 >> v1:172.21.15.62:6789/0 conn(0x561400e7aa00 legacy=0x561400e7cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.823 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.828+0000 7fe884f08640 1 -- 172.21.15.119:0/578912806 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561400d29e60 con 0x561400e7e510 2024-04-23T18:31:18.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.830+0000 7fe884f08640 1 --2- 172.21.15.119:0/578912806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7e510 0x561400e80900 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe87800a520 tx=0x7fe87801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2fc26eb64e76a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.830+0000 7fe88cf08640 1 -- 172.21.15.119:0/578912806 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe878057070 con 0x561400e7e510 2024-04-23T18:31:18.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.830+0000 7fe88cf08640 1 -- 172.21.15.119:0/578912806 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe878052570 con 0x561400e7e510 2024-04-23T18:31:18.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.830+0000 7fe88cf08640 1 -- 172.21.15.119:0/578912806 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe87804ae60 con 0x561400e7e510 2024-04-23T18:31:18.824 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.831+0000 7fe88fc0a800 1 -- 172.21.15.119:0/578912806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7e510 msgr2=0x561400e80900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.831+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/578912806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7e510 0x561400e80900 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe87800a520 tx=0x7fe87801d010 comp rx=0 tx=0).stop 2024-04-23T18:31:18.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.831+0000 7fe88fc0a800 1 -- 172.21.15.119:0/578912806 shutdown_connections 2024-04-23T18:31:18.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.831+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/578912806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7e510 0x561400e80900 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.831+0000 7fe88fc0a800 1 -- 172.21.15.119:0/578912806 >> 172.21.15.119:0/578912806 conn(0x561400e743b0 msgr2=0x561400e767d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.831+0000 7fe88fc0a800 1 -- 172.21.15.119:0/578912806 shutdown_connections 2024-04-23T18:31:18.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.831+0000 7fe88fc0a800 1 -- 172.21.15.119:0/578912806 wait complete. 2024-04-23T18:31:18.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.842+0000 7fe88fc0a800 1 Processor -- start 2024-04-23T18:31:18.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.842+0000 7fe88fc0a800 1 -- start start 2024-04-23T18:31:18.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.842+0000 7fe88fc0a800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7aa00 0x561400e7a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.842+0000 7fe88fc0a800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561400dc5550 con 0x561400e7aa00 2024-04-23T18:31:18.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.843+0000 7fe88d709640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7aa00 0x561400e7a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.836 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.843+0000 7fe88d709640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7aa00 0x561400e7a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55044/0 (socket says 172.21.15.119:55044) 2024-04-23T18:31:18.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.843+0000 7fe88d709640 1 -- 172.21.15.119:0/3697937329 learned_addr learned my addr 172.21.15.119:0/3697937329 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.843+0000 7fe88d709640 1 -- 172.21.15.119:0/3697937329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561400d3b860 con 0x561400e7aa00 2024-04-23T18:31:18.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.843+0000 7fe88d709640 1 --2- 172.21.15.119:0/3697937329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7aa00 0x561400e7a340 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe880001e10 tx=0x7fe88000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b03b42d54460d13 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.843+0000 7fe77b606640 1 -- 172.21.15.119:0/3697937329 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe88000e5c0 con 0x561400e7aa00 2024-04-23T18:31:18.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.843+0000 7fe77b606640 1 -- 172.21.15.119:0/3697937329 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe880006070 con 0x561400e7aa00 2024-04-23T18:31:18.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.843+0000 7fe77b606640 1 -- 172.21.15.119:0/3697937329 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe88000e930 con 0x561400e7aa00 2024-04-23T18:31:18.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.844+0000 7fe88fc0a800 1 -- 172.21.15.119:0/3697937329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7aa00 msgr2=0x561400e7a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.844+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/3697937329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7aa00 0x561400e7a340 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe880001e10 tx=0x7fe88000b6c0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.844+0000 7fe88fc0a800 1 -- 172.21.15.119:0/3697937329 shutdown_connections 2024-04-23T18:31:18.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.844+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/3697937329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7aa00 0x561400e7a340 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.844+0000 7fe88fc0a800 1 -- 172.21.15.119:0/3697937329 >> 172.21.15.119:0/3697937329 conn(0x561400e743b0 msgr2=0x561400f66a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.844+0000 7fe88fc0a800 1 -- 172.21.15.119:0/3697937329 shutdown_connections 2024-04-23T18:31:18.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.844+0000 7fe88fc0a800 1 -- 172.21.15.119:0/3697937329 wait complete. 2024-04-23T18:31:18.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.844+0000 7fe88fc0a800 1 Processor -- start 2024-04-23T18:31:18.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.844+0000 7fe88fc0a800 1 -- start start 2024-04-23T18:31:18.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.845+0000 7fe88fc0a800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7aa00 0x561400f74ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.845+0000 7fe88fc0a800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561400e83150 con 0x561400e7aa00 2024-04-23T18:31:18.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.845+0000 7fe88d709640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7aa00 0x561400f74ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.845+0000 7fe88d709640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7aa00 0x561400f74ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55050/0 (socket says 172.21.15.119:55050) 2024-04-23T18:31:18.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.845+0000 7fe88d709640 1 -- 172.21.15.119:0/1913929807 learned_addr learned my addr 172.21.15.119:0/1913929807 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.845+0000 7fe88d709640 1 -- 172.21.15.119:0/1913929807 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561400d39eb0 con 0x561400e7aa00 2024-04-23T18:31:18.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.845+0000 7fe88d709640 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7aa00 0x561400f74ce0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe88000b700 tx=0x7fe880000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.845+0000 7fe779e03640 1 -- 172.21.15.119:0/1913929807 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe88000f8d0 con 0x561400e7aa00 2024-04-23T18:31:18.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.845+0000 7fe779e03640 1 -- 172.21.15.119:0/1913929807 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe88000fa70 con 0x561400e7aa00 2024-04-23T18:31:18.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.845+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561400f75220 con 0x561400e7aa00 2024-04-23T18:31:18.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.845+0000 7fe779e03640 1 -- 172.21.15.119:0/1913929807 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe88000fd50 con 0x561400e7aa00 2024-04-23T18:31:18.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.845+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561400f75740 con 0x561400e7aa00 2024-04-23T18:31:18.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.846+0000 7fe779e03640 1 -- 172.21.15.119:0/1913929807 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe880017070 con 0x561400e7aa00 2024-04-23T18:31:18.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.846+0000 7fe779e03640 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe774036e60 0x7fe774039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.846+0000 7fe779e03640 1 -- 172.21.15.119:0/1913929807 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fe880015020 con 0x561400e7aa00 2024-04-23T18:31:18.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.846+0000 7fe884f08640 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe774036e60 0x7fe774039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.847+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561400e7e510 0x561400f7bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.847+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400f7c2d0 con 0x561400e7e510 2024-04-23T18:31:18.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.847+0000 7fe88df0a640 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561400e7e510 0x561400f7bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.847+0000 7fe884f08640 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe774036e60 0x7fe774039320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe878054000 tx=0x7fe87804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.847+0000 7fe88df0a640 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561400e7e510 0x561400f7bd50 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.847+0000 7fe88df0a640 1 -- 172.21.15.119:0/1913929807 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400e7e510 2024-04-23T18:31:18.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.847+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400f79320 con 0x561400e7e510 2024-04-23T18:31:18.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.848+0000 7fe88df0a640 1 -- 172.21.15.119:0/1913929807 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400e7e510 2024-04-23T18:31:18.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.848+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561400f7e620 0x561400f80a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.848+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400f81100 con 0x561400f7e620 2024-04-23T18:31:18.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.848+0000 7fe88d709640 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561400f7e620 0x561400f80a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.848+0000 7fe88d709640 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561400f7e620 0x561400f80a10 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.848+0000 7fe88d709640 1 -- 172.21.15.119:0/1913929807 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe88002e070 con 0x561400f7e620 2024-04-23T18:31:18.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.848+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400f7d5d0 con 0x561400e7e510 2024-04-23T18:31:18.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.849+0000 7fe88df0a640 1 -- 172.21.15.119:0/1913929807 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400e7e510 2024-04-23T18:31:18.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.849+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561400f825b0 0x561400f84a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.849+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400f85160 con 0x561400f825b0 2024-04-23T18:31:18.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.849+0000 7fe884f08640 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561400f825b0 0x561400f84a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.849+0000 7fe884f08640 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561400f825b0 0x561400f84a00 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.850+0000 7fe884f08640 1 -- 172.21.15.119:0/1913929807 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe87805a040 con 0x561400f825b0 2024-04-23T18:31:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.850+0000 7fe88fc0a800 1 Processor -- start 2024-04-23T18:31:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.850+0000 7fe88fc0a800 1 -- start start 2024-04-23T18:31:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.850+0000 7fe88fc0a800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400f935c0 0x561400f939e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.850+0000 7fe88fc0a800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561400d6bdf0 con 0x561400f935c0 2024-04-23T18:31:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.850+0000 7fe88d709640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400f935c0 0x561400f939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.850+0000 7fe88d709640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400f935c0 0x561400f939e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55052/0 (socket says 172.21.15.119:55052) 2024-04-23T18:31:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.850+0000 7fe88d709640 1 -- 172.21.15.119:0/4076865104 learned_addr learned my addr 172.21.15.119:0/4076865104 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.851+0000 7fe88d709640 1 -- 172.21.15.119:0/4076865104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561400f93f20 con 0x561400f935c0 2024-04-23T18:31:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.851+0000 7fe88d709640 1 --2- 172.21.15.119:0/4076865104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400f935c0 0x561400f939e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fe88004bb70 tx=0x7fe880017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.851+0000 7fe772ffd640 1 -- 172.21.15.119:0/4076865104 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe880045b10 con 0x561400f935c0 2024-04-23T18:31:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.851+0000 7fe772ffd640 1 -- 172.21.15.119:0/4076865104 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe880045cb0 con 0x561400f935c0 2024-04-23T18:31:18.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.851+0000 7fe772ffd640 1 -- 172.21.15.119:0/4076865104 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8800451a0 con 0x561400f935c0 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.851+0000 7fe88fc0a800 1 -- 172.21.15.119:0/4076865104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561400f94990 con 0x561400f935c0 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.851+0000 7fe88fc0a800 1 -- 172.21.15.119:0/4076865104 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561400f94e90 con 0x561400f935c0 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.852+0000 7fe772ffd640 1 -- 172.21.15.119:0/4076865104 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe880045340 con 0x561400f935c0 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.852+0000 7fe772ffd640 1 --2- 172.21.15.119:0/4076865104 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe764036e60 0x7fe764039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.852+0000 7fe772ffd640 1 -- 172.21.15.119:0/4076865104 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fe88003dd00 con 0x561400f935c0 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.852+0000 7fe884f08640 1 --2- 172.21.15.119:0/4076865104 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe764036e60 0x7fe764039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.852+0000 7fe88fc0a800 1 Processor -- start 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.852+0000 7fe88fc0a800 1 -- start start 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.852+0000 7fe884f08640 1 --2- 172.21.15.119:0/4076865104 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe764036e60 0x7fe764039320 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x561400f7cbd0 tx=0x7fe878005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.852+0000 7fe88fc0a800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400fa0650 0x561400fa0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.852+0000 7fe88fc0a800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561400e789c0 con 0x561400fa0650 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.853+0000 7fe88d709640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400fa0650 0x561400fa0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.853+0000 7fe88d709640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400fa0650 0x561400fa0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55062/0 (socket says 172.21.15.119:55062) 2024-04-23T18:31:18.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.853+0000 7fe88d709640 1 -- 172.21.15.119:0/2500466384 learned_addr learned my addr 172.21.15.119:0/2500466384 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.853+0000 7fe88d709640 1 -- 172.21.15.119:0/2500466384 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561400fa1040 con 0x561400fa0650 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.853+0000 7fe88d709640 1 --2- 172.21.15.119:0/2500466384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400fa0650 0x561400fa0a70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c690 tx=0x7fe880020f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3838b2d94413891 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.853+0000 7fe770ff9640 1 -- 172.21.15.119:0/2500466384 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe880045630 con 0x561400fa0650 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.853+0000 7fe770ff9640 1 -- 172.21.15.119:0/2500466384 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe88005e020 con 0x561400fa0650 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.853+0000 7fe770ff9640 1 -- 172.21.15.119:0/2500466384 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe880019860 con 0x561400fa0650 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88fc0a800 1 -- 172.21.15.119:0/2500466384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400fa0650 msgr2=0x561400fa0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/2500466384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400fa0650 0x561400fa0a70 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c690 tx=0x7fe880020f40 comp rx=0 tx=0).stop 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88fc0a800 1 -- 172.21.15.119:0/2500466384 shutdown_connections 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/2500466384 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400fa0650 0x561400fa0a70 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88fc0a800 1 -- 172.21.15.119:0/2500466384 >> 172.21.15.119:0/2500466384 conn(0x561400f9c9b0 msgr2=0x561400f9aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88fc0a800 1 -- 172.21.15.119:0/2500466384 shutdown_connections 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88fc0a800 1 -- 172.21.15.119:0/2500466384 wait complete. 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88fc0a800 1 Processor -- start 2024-04-23T18:31:18.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88fc0a800 1 -- start start 2024-04-23T18:31:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88fc0a800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400fa0650 0x561400fa7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88fc0a800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561400fa16f0 con 0x561400fa0650 2024-04-23T18:31:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88d709640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400fa0650 0x561400fa7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88d709640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400fa0650 0x561400fa7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55068/0 (socket says 172.21.15.119:55068) 2024-04-23T18:31:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.854+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 learned_addr learned my addr 172.21.15.119:0/1879076354 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.855+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561400fa7f60 con 0x561400fa0650 2024-04-23T18:31:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.855+0000 7fe88d709640 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400fa0650 0x561400fa7a20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c690 tx=0x7fe880043f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.855+0000 7fe762ffd640 1 -- 172.21.15.119:0/1879076354 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe880019b90 con 0x561400fa0650 2024-04-23T18:31:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.855+0000 7fe762ffd640 1 -- 172.21.15.119:0/1879076354 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe880027430 con 0x561400fa0650 2024-04-23T18:31:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.855+0000 7fe762ffd640 1 -- 172.21.15.119:0/1879076354 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe880019d30 con 0x561400fa0650 2024-04-23T18:31:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.855+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561400fa7f60 con 0x561400fa0650 2024-04-23T18:31:18.854 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.855+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561400fa7f60 con 0x561400fa0650 2024-04-23T18:31:18.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.856+0000 7fe762ffd640 1 -- 172.21.15.119:0/1879076354 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe88001dc70 con 0x561400fa0650 2024-04-23T18:31:18.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.856+0000 7fe762ffd640 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe758036e10 0x7fe7580392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.856+0000 7fe762ffd640 1 -- 172.21.15.119:0/1879076354 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fe88006c030 con 0x561400fa0650 2024-04-23T18:31:18.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.856+0000 7fe884f08640 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe758036e10 0x7fe7580392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.856+0000 7fe88fc0a800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.856+0000 7fe884f08640 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe758036e10 0x7fe7580392d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe878055040 tx=0x7fe87804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.856+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561400fb3140 0x561400fb5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.856+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400fb5d50 con 0x561400fb3140 2024-04-23T18:31:18.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88df0a640 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561400fb3140 0x561400fb5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88df0a640 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561400fb3140 0x561400fb5600 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400fb3140 2024-04-23T18:31:18.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88fc0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88fc0a800 20 realm 2024-04-23T18:31:18.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88fc0a800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6160 con 0x561400fb3140 2024-04-23T18:31:18.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400fb3140 2024-04-23T18:31:18.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88fc0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88fc0a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:18.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88fc0a800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6a30 con 0x561400fb3140 2024-04-23T18:31:18.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400fb3140 2024-04-23T18:31:18.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88fc0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88fc0a800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.857+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb3140 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.858+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400fb3140 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.858+0000 7fe88fc0a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.858+0000 7fe88fc0a800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.858+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561400fb7b30 0x561400fb9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.858+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400fba530 con 0x561400fb7b30 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.858+0000 7fe88d709640 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561400fb7b30 0x561400fb9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.858+0000 7fe88d709640 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561400fb7b30 0x561400fb9f20 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.858+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe88002e070 con 0x561400fb7b30 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.858+0000 7fe88fc0a800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.858+0000 7fe88fc0a800 20 searching for the correct realm 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.859+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561400fbc4e0 0x561400fbe9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.859+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fbf070 con 0x561400fbc4e0 2024-04-23T18:31:18.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.859+0000 7fe884f08640 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561400fbc4e0 0x561400fbe9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.859+0000 7fe884f08640 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561400fbc4e0 0x561400fbe9a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.859+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.859+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fbf070 con 0x561400fb7b30 2024-04-23T18:31:18.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.860+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88002e070 con 0x561400fb7b30 2024-04-23T18:31:18.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.860+0000 7fe88d709640 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe88000f070 0x7fe88004d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.860+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fbf070 con 0x7fe88000f070 2024-04-23T18:31:18.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.860+0000 7fe88df0a640 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe88000f070 0x7fe88004d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.860+0000 7fe88df0a640 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe88000f070 0x7fe88004d9b0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.861+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88800a4a0 con 0x7fe88000f070 2024-04-23T18:31:18.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.861+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb3140 2024-04-23T18:31:18.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.861+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400fb3140 2024-04-23T18:31:18.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.861+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb3140 2024-04-23T18:31:18.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.861+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400fb3140 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.861+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x7fe88000f070 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.861+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88800a4a0 con 0x7fe88000f070 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.861+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x7fe88000f070 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.861+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe88800a4a0 con 0x7fe88000f070 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.861+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb7b30 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.862+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88002e070 con 0x561400fb7b30 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.862+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fbc4e0 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.862+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.862+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb3140 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.862+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400fb3140 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.862+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x7fe88000f070 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.862+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88800a4a0 con 0x7fe88000f070 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.863+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb3140 2024-04-23T18:31:18.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.863+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400fb3140 2024-04-23T18:31:18.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.863+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb7b30 2024-04-23T18:31:18.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.863+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe88002e070 con 0x561400fb7b30 2024-04-23T18:31:18.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.863+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fbc4e0 2024-04-23T18:31:18.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.863+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.863+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fbc4e0 2024-04-23T18:31:18.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.863+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.863+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x7fe88000f070 2024-04-23T18:31:18.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.864+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88800a4a0 con 0x7fe88000f070 2024-04-23T18:31:18.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.864+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fbc4e0 2024-04-23T18:31:18.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.864+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.864+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fbc4e0 2024-04-23T18:31:18.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.864+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.864+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb3140 2024-04-23T18:31:18.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.865+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400fb3140 2024-04-23T18:31:18.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.865+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb3140 2024-04-23T18:31:18.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.865+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400fb3140 2024-04-23T18:31:18.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.865+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x7fe88000f070 2024-04-23T18:31:18.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.865+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88800a4a0 con 0x7fe88000f070 2024-04-23T18:31:18.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.865+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fbc4e0 2024-04-23T18:31:18.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.865+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.866+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb7b30 2024-04-23T18:31:18.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.866+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe88002e070 con 0x561400fb7b30 2024-04-23T18:31:18.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.866+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb3140 2024-04-23T18:31:18.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.866+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88800a4a0 con 0x561400fb3140 2024-04-23T18:31:18.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.866+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb7b30 2024-04-23T18:31:18.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.866+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88002e070 con 0x561400fb7b30 2024-04-23T18:31:18.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.866+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fbc4e0 2024-04-23T18:31:18.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.866+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.866+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x7fe88000f070 2024-04-23T18:31:18.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.867+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88800a4a0 con 0x7fe88000f070 2024-04-23T18:31:18.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.867+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb7b30 2024-04-23T18:31:18.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.867+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88002e070 con 0x561400fb7b30 2024-04-23T18:31:18.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.867+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fbc4e0 2024-04-23T18:31:18.876 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.867+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.867+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x7fe88000f070 2024-04-23T18:31:18.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88800a4a0 con 0x7fe88000f070 2024-04-23T18:31:18.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb3140 2024-04-23T18:31:18.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe888040080 con 0x561400fb3140 2024-04-23T18:31:18.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561400fb6dd0 con 0x561400fb7b30 2024-04-23T18:31:18.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88002e070 con 0x561400fb7b30 2024-04-23T18:31:18.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88fc0a800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:18.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88fc0a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:18.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88fc0a800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:18.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88fc0a800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:18.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88fc0a800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:18.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88fc0a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88fc0a800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400fbadf0 con 0x561400fb3140 2024-04-23T18:31:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe888040080 con 0x561400fb3140 2024-04-23T18:31:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88fc0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88fc0a800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.868+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400fbb1e0 con 0x561400fb3140 2024-04-23T18:31:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe888040080 con 0x561400fb3140 2024-04-23T18:31:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88fc0a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88fc0a800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400fbb1e0 con 0x7fe88000f070 2024-04-23T18:31:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe888040080 con 0x7fe88000f070 2024-04-23T18:31:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88fc0a800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:18.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88fc0a800 20 zone default found 2024-04-23T18:31:18.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88fc0a800 4 Realm: () 2024-04-23T18:31:18.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88fc0a800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:18.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88fc0a800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:18.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88fc0a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:18.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88fc0a800 20 zonegroup default 2024-04-23T18:31:18.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88fc0a800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400fbaa30 con 0x561400fb7b30 2024-04-23T18:31:18.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.869+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe880092040 con 0x561400fb7b30 2024-04-23T18:31:18.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.870+0000 7fe88fc0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.870+0000 7fe88fc0a800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.870+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400fc0ed0 con 0x561400fbc4e0 2024-04-23T18:31:18.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.870+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.879 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.870+0000 7fe88fc0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.870+0000 7fe88fc0a800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.870+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400fc1360 con 0x561400fbc4e0 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.870+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.870+0000 7fe88fc0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.870+0000 7fe88fc0a800 20 started sync module instance, tier type = 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.870+0000 7fe88fc0a800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.870+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc0370 con 0x561400fb7b30 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.871+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe880092040 con 0x561400fb7b30 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.871+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94643915851616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc1c70 con 0x561400fb7b30 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.871+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc24c0 con 0x561400fb3140 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.872+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94643915851616] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe880092040 con 0x561400fb7b30 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.872+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x561400fb3140 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.872+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94643915855808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc2580 con 0x561400fb3140 2024-04-23T18:31:18.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.873+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc30a0 con 0x561400fbc4e0 2024-04-23T18:31:18.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.874+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94643915855808] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x561400fb3140 2024-04-23T18:31:18.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.874+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.874+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94643915860848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc3490 con 0x561400fbc4e0 2024-04-23T18:31:18.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.874+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc3f00 con 0x561400fb7b30 2024-04-23T18:31:18.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.875+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe880092040 con 0x561400fb7b30 2024-04-23T18:31:18.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.875+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94643915860848] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.875+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94643915866864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc4bc0 con 0x561400fb7b30 2024-04-23T18:31:18.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.875+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc5100 con 0x561400fb3140 2024-04-23T18:31:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.876+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94643915866864] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe880092040 con 0x561400fb7b30 2024-04-23T18:31:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.876+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x561400fb3140 2024-04-23T18:31:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.876+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94643915857936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc4bc0 con 0x561400fb3140 2024-04-23T18:31:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.876+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc5b10 con 0x7fe88000f070 2024-04-23T18:31:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.877+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94643915857936] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x561400fb3140 2024-04-23T18:31:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.877+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x7fe88000f070 2024-04-23T18:31:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.877+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94643915872352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc4bc0 con 0x7fe88000f070 2024-04-23T18:31:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.877+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc6520 con 0x7fe88000f070 2024-04-23T18:31:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.878+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(56 notify.6 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x7fe88000f070 2024-04-23T18:31:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.878+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94643915874416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc6940 con 0x7fe88000f070 2024-04-23T18:31:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.878+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc73e0 con 0x7fe88000f070 2024-04-23T18:31:18.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.878+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94643915872352] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x7fe88000f070 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.879+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94643915874416] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x7fe88000f070 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.879+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x7fe88000f070 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.879+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94643915867920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc6f30 con 0x7fe88000f070 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.879+0000 7fe88fc0a800 20 add_watcher() i=0 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.879+0000 7fe88fc0a800 20 add_watcher() i=1 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.879+0000 7fe88fc0a800 20 add_watcher() i=2 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.879+0000 7fe88fc0a800 20 add_watcher() i=3 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.879+0000 7fe88fc0a800 20 add_watcher() i=4 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.879+0000 7fe88fc0a800 20 add_watcher() i=5 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.879+0000 7fe88fc0a800 20 add_watcher() i=6 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.880+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94643915867920] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x7fe88000f070 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.880+0000 7fe88fc0a800 20 add_watcher() i=7 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.880+0000 7fe88fc0a800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:18.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.880+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400fca410 con 0x561400fb3140 2024-04-23T18:31:18.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.881+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe888040080 con 0x561400fb3140 2024-04-23T18:31:18.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.881+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94643915878192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc7830 con 0x561400fb3140 2024-04-23T18:31:18.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.882+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94643915878192] v34'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe888040080 con 0x561400fb3140 2024-04-23T18:31:18.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.882+0000 7fe7437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:18.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.882+0000 7fe88fc0a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:18.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.882+0000 7fe88fc0a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:18.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.882+0000 7fe88fc0a800 5 note: GC not initialized 2024-04-23T18:31:18.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.882+0000 7fe7427e4640 20 reqs_thread_entry: start 2024-04-23T18:31:18.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.882+0000 7fe88fc0a800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:18.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.882+0000 7fe88fc0a800 20 Filter name: none 2024-04-23T18:31:18.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.882+0000 7fe6b3fff640 20 reqs_thread_entry: start 2024-04-23T18:31:18.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400ffdb90 con 0x561400fbc4e0 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 20 rados->read ofs=0 len=0 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400ffc680 con 0x561400fbc4e0 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-23T18:31:18.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.883+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561401001180 con 0x561400fbc4e0 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.884+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v34'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.884+0000 7fe88fc0a800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.884+0000 7fe88fc0a800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.884+0000 7fe88fc0a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.884+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94643916112240 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561401000aa0 con 0x561400fbc4e0 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.884+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== watch-notify(notify (1) cookie 94643915860848 notify 146028888073 ret 0) ==== 584+0+0 (crc 0 0 0) 0x561401001520 con 0x561400fbc4e0 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.884+0000 7fe770ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94643915860848 notifier 4854 bl.length()=542 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.884+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(65 notify.2 [notify cookie 94643916112240 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.884+0000 7fe770ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.884+0000 7fe770ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.884+0000 7fe770ff9640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe750003ea0 con 0x561400fbc4e0 2024-04-23T18:31:18.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.885+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.885+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== watch-notify(notify_complete (2) cookie 94643916112240 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561400ffc460 con 0x561400fbc4e0 2024-04-23T18:31:18.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.885+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fff160 con 0x561400fbc4e0 2024-04-23T18:31:18.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.886+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v34'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.886+0000 7fe88fc0a800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-23T18:31:18.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.886+0000 7fe88fc0a800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-23T18:31:18.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.886+0000 7fe88fc0a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-23T18:31:18.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.886+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94643916115696 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561400fff160 con 0x7fe88000f070 2024-04-23T18:31:18.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.886+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== watch-notify(notify (1) cookie 94643915872352 notify 146028888110 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7fe888018d30 con 0x7fe88000f070 2024-04-23T18:31:18.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.886+0000 7fe770ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888110 cookie 94643915872352 notifier 4854 bl.length()=175 2024-04-23T18:31:18.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.886+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(68 notify.5 [notify cookie 94643916115696 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe888040080 con 0x7fe88000f070 2024-04-23T18:31:18.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.886+0000 7fe770ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-23T18:31:18.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.886+0000 7fe770ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-23T18:31:18.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.886+0000 7fe770ff9640 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe750003ea0 con 0x7fe88000f070 2024-04-23T18:31:18.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.887+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== watch-notify(notify_complete (2) cookie 94643916115696 notify 146028888110 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe888005040 con 0x7fe88000f070 2024-04-23T18:31:18.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.887+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x7fe88000f070 2024-04-23T18:31:18.894 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-04-23T18:31:18.885520Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:31:18.885505Z","tags":[],"group_ids":[]} 2024-04-23T18:31:18.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.888+0000 7fe7437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:18.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.888+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94643915878192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400ffe880 con 0x561400fb3140 2024-04-23T18:31:18.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.889+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94643915878192] v34'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe888040080 con 0x561400fb3140 2024-04-23T18:31:18.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.889+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94643915851616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc6f30 con 0x561400fb7b30 2024-04-23T18:31:18.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.890+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94643915851616] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe880092040 con 0x561400fb7b30 2024-04-23T18:31:18.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.890+0000 7fe88fc0a800 20 remove_watcher() i=0 2024-04-23T18:31:18.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.890+0000 7fe88fc0a800 2 removed watcher, disabling cache 2024-04-23T18:31:18.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.890+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94643915855808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc6f30 con 0x561400fb3140 2024-04-23T18:31:18.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.891+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94643915855808] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x561400fb3140 2024-04-23T18:31:18.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.891+0000 7fe88fc0a800 20 remove_watcher() i=1 2024-04-23T18:31:18.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.891+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94643915860848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc17c0 con 0x561400fbc4e0 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.892+0000 7fe884f08640 1 -- 172.21.15.119:0/1879076354 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94643915860848] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe87807f070 con 0x561400fbc4e0 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.892+0000 7fe88fc0a800 20 remove_watcher() i=2 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.892+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94643915866864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc6f30 con 0x561400fb7b30 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.893+0000 7fe88d709640 1 -- 172.21.15.119:0/1879076354 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94643915866864] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe880092040 con 0x561400fb7b30 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.893+0000 7fe88fc0a800 20 remove_watcher() i=3 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.893+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94643915857936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc2b70 con 0x561400fb3140 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.895+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94643915857936] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x561400fb3140 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.895+0000 7fe88fc0a800 20 remove_watcher() i=4 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.895+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94643915872352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc42f0 con 0x7fe88000f070 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.897+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94643915872352] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x7fe88000f070 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.897+0000 7fe88fc0a800 20 remove_watcher() i=5 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.897+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94643915874416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc6f30 con 0x7fe88000f070 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.898+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94643915874416] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x7fe88000f070 2024-04-23T18:31:18.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.898+0000 7fe88fc0a800 20 remove_watcher() i=6 2024-04-23T18:31:18.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.898+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94643915867920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561400fc2010 con 0x7fe88000f070 2024-04-23T18:31:18.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94643915867920] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe888040080 con 0x7fe88000f070 2024-04-23T18:31:18.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 20 remove_watcher() i=7 2024-04-23T18:31:18.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe88000f070 msgr2=0x7fe88004d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fe88000f070 0x7fe88004d9b0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561400fb3140 msgr2=0x561400fb5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561400fb3140 0x561400fb5600 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561400fb7b30 msgr2=0x561400fb9f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561400fb7b30 0x561400fb9f20 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561400fbc4e0 msgr2=0x561400fbe9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x561400fbc4e0 0x561400fbe9a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe758036e10 msgr2=0x7fe7580392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe758036e10 0x7fe7580392d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe878055040 tx=0x7fe87804f000 comp rx=0 tx=0).stop 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400fa0650 msgr2=0x561400fa7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1879076354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400fa0650 0x561400fa7a20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c690 tx=0x7fe880043f30 comp rx=0 tx=0).stop 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 reap_dead start 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88df0a640 1 -- 172.21.15.119:0/1879076354 reap_dead start 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 shutdown_connections 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 >> 172.21.15.119:0/1879076354 conn(0x561400f9c9b0 msgr2=0x561400f9a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 shutdown_connections 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1879076354 wait complete. 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/4076865104 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe764036e60 msgr2=0x7fe764039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/4076865104 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe764036e60 0x7fe764039320 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x561400f7cbd0 tx=0x7fe878005ac0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/4076865104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400f935c0 msgr2=0x561400f939e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/4076865104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400f935c0 0x561400f939e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fe88004bb70 tx=0x7fe880017d50 comp rx=0 tx=0).stop 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/4076865104 shutdown_connections 2024-04-23T18:31:18.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/4076865104 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe764036e60 0x7fe764039320 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/4076865104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400f935c0 0x561400f939e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/4076865104 >> 172.21.15.119:0/4076865104 conn(0x561400f87660 msgr2=0x561400f87a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.899+0000 7fe88fc0a800 1 -- 172.21.15.119:0/4076865104 shutdown_connections 2024-04-23T18:31:18.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 -- 172.21.15.119:0/4076865104 wait complete. 2024-04-23T18:31:18.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561400f825b0 msgr2=0x561400f84a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x561400f825b0 0x561400f84a00 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561400e7e510 msgr2=0x561400f7bd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x561400e7e510 0x561400f7bd50 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561400f7e620 msgr2=0x561400f80a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x561400f7e620 0x561400f80a10 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe774036e60 msgr2=0x7fe774039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe774036e60 0x7fe774039320 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe878054000 tx=0x7fe87804e000 comp rx=0 tx=0).stop 2024-04-23T18:31:18.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7aa00 msgr2=0x561400f74ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 --2- 172.21.15.119:0/1913929807 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561400e7aa00 0x561400f74ce0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe88000b700 tx=0x7fe880000bc0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88df0a640 1 -- 172.21.15.119:0/1913929807 reap_dead start 2024-04-23T18:31:18.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 shutdown_connections 2024-04-23T18:31:18.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 >> 172.21.15.119:0/1913929807 conn(0x561400e743b0 msgr2=0x561400f66660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 shutdown_connections 2024-04-23T18:31:18.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.900+0000 7fe88fc0a800 1 -- 172.21.15.119:0/1913929807 wait complete. 2024-04-23T18:31:18.906 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-23T18:31:18.885520Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.885505Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:18.906 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-23T18:31:18.885520Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.885505Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:18.906 ERROR:root:0 2024-04-23T18:31:18.907 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:18.912 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:18.912 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-04-23T18:31:18.912 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-04-23T18:31:18.912 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-04-23T18:31:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:18.955 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.962+0000 7efd18119800 1 Processor -- start 2024-04-23T18:31:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.962+0000 7efd18119800 1 -- start start 2024-04-23T18:31:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.962+0000 7efd18119800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5605538cb5a0 0x5605538cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.962+0000 7efd18119800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560553777560 con 0x5605538c7a90 2024-04-23T18:31:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.962+0000 7efd18119800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x560553768e20 con 0x5605538cb5a0 2024-04-23T18:31:18.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.962+0000 7efd15417640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5605538cb5a0 0x5605538cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.962+0000 7efd15417640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5605538cb5a0 0x5605538cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55082/0 (socket says 172.21.15.119:55082) 2024-04-23T18:31:18.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.962+0000 7efd15c18640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5605538c7a90 0x5605538c9e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50602/0 (socket says 172.21.15.119:50602) 2024-04-23T18:31:18.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.963+0000 7efd15417640 1 -- 172.21.15.119:0/1676160694 learned_addr learned my addr 172.21.15.119:0/1676160694 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.963+0000 7efd15417640 1 -- 172.21.15.119:0/1676160694 >> v1:172.21.15.62:6789/0 conn(0x5605538c7a90 legacy=0x5605538c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.957 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.963+0000 7efd15417640 1 -- 172.21.15.119:0/1676160694 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560553776e60 con 0x5605538cb5a0 2024-04-23T18:31:18.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.965+0000 7efd15417640 1 --2- 172.21.15.119:0/1676160694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538cb5a0 0x5605538cd990 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7efd0800a520 tx=0x7efd0801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6dd652026c3714 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.965+0000 7efd14c16640 1 -- 172.21.15.119:0/1676160694 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd08057070 con 0x5605538cb5a0 2024-04-23T18:31:18.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.965+0000 7efd14c16640 1 -- 172.21.15.119:0/1676160694 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd08052570 con 0x5605538cb5a0 2024-04-23T18:31:18.958 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.965+0000 7efd14c16640 1 -- 172.21.15.119:0/1676160694 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd0804ae60 con 0x5605538cb5a0 2024-04-23T18:31:18.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.965+0000 7efd18119800 1 -- 172.21.15.119:0/1676160694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538cb5a0 msgr2=0x5605538cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.965+0000 7efd18119800 1 --2- 172.21.15.119:0/1676160694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538cb5a0 0x5605538cd990 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7efd0800a520 tx=0x7efd0801d010 comp rx=0 tx=0).stop 2024-04-23T18:31:18.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.965+0000 7efd18119800 1 -- 172.21.15.119:0/1676160694 shutdown_connections 2024-04-23T18:31:18.959 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.965+0000 7efd18119800 1 --2- 172.21.15.119:0/1676160694 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538cb5a0 0x5605538cd990 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.965+0000 7efd18119800 1 -- 172.21.15.119:0/1676160694 >> 172.21.15.119:0/1676160694 conn(0x5605538c1420 msgr2=0x5605538c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.965+0000 7efd18119800 1 -- 172.21.15.119:0/1676160694 shutdown_connections 2024-04-23T18:31:18.960 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.965+0000 7efd18119800 1 -- 172.21.15.119:0/1676160694 wait complete. 2024-04-23T18:31:18.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.977+0000 7efd18119800 1 Processor -- start 2024-04-23T18:31:18.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.977+0000 7efd18119800 1 -- start start 2024-04-23T18:31:18.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.977+0000 7efd18119800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538c7a90 0x5605539b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.977+0000 7efd18119800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5605538125b0 con 0x5605538c7a90 2024-04-23T18:31:18.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.977+0000 7efd15c18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538c7a90 0x5605539b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.978+0000 7efd15c18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538c7a90 0x5605539b8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55084/0 (socket says 172.21.15.119:55084) 2024-04-23T18:31:18.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.978+0000 7efd15c18640 1 -- 172.21.15.119:0/4238498211 learned_addr learned my addr 172.21.15.119:0/4238498211 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.978+0000 7efd15c18640 1 -- 172.21.15.119:0/4238498211 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560553788860 con 0x5605538c7a90 2024-04-23T18:31:18.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.978+0000 7efd15c18640 1 --2- 172.21.15.119:0/4238498211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538c7a90 0x5605539b8190 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7efd00001e10 tx=0x7efd0000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a57013ac2d06f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.978+0000 7efc03e07640 1 -- 172.21.15.119:0/4238498211 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd0000e5c0 con 0x5605538c7a90 2024-04-23T18:31:18.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.978+0000 7efc03e07640 1 -- 172.21.15.119:0/4238498211 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd00006070 con 0x5605538c7a90 2024-04-23T18:31:18.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.978+0000 7efc03e07640 1 -- 172.21.15.119:0/4238498211 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd0000e930 con 0x5605538c7a90 2024-04-23T18:31:18.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd18119800 1 -- 172.21.15.119:0/4238498211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538c7a90 msgr2=0x5605539b8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:18.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd18119800 1 --2- 172.21.15.119:0/4238498211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538c7a90 0x5605539b8190 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7efd00001e10 tx=0x7efd0000b6c0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd18119800 1 -- 172.21.15.119:0/4238498211 shutdown_connections 2024-04-23T18:31:18.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd18119800 1 --2- 172.21.15.119:0/4238498211 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538c7a90 0x5605539b8190 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:18.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd18119800 1 -- 172.21.15.119:0/4238498211 >> 172.21.15.119:0/4238498211 conn(0x5605538c1420 msgr2=0x5605539b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:18.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd18119800 1 -- 172.21.15.119:0/4238498211 shutdown_connections 2024-04-23T18:31:18.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd18119800 1 -- 172.21.15.119:0/4238498211 wait complete. 2024-04-23T18:31:18.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd18119800 1 Processor -- start 2024-04-23T18:31:18.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd18119800 1 -- start start 2024-04-23T18:31:18.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd18119800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538c7a90 0x5605538c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd18119800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5605538d01e0 con 0x5605538c7a90 2024-04-23T18:31:18.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd15c18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538c7a90 0x5605538c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.979 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd15c18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538c7a90 0x5605538c7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55088/0 (socket says 172.21.15.119:55088) 2024-04-23T18:31:18.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.979+0000 7efd15c18640 1 -- 172.21.15.119:0/4126434605 learned_addr learned my addr 172.21.15.119:0/4126434605 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.980+0000 7efd15c18640 1 -- 172.21.15.119:0/4126434605 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560553786eb0 con 0x5605538c7a90 2024-04-23T18:31:18.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.980+0000 7efd15c18640 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538c7a90 0x5605538c7380 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7efd0000b700 tx=0x7efd00000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.980+0000 7efc02604640 1 -- 172.21.15.119:0/4126434605 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd0000f8d0 con 0x5605538c7a90 2024-04-23T18:31:18.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.980+0000 7efc02604640 1 -- 172.21.15.119:0/4126434605 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0000fa70 con 0x5605538c7a90 2024-04-23T18:31:18.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.980+0000 7efc02604640 1 -- 172.21.15.119:0/4126434605 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd0000fd50 con 0x5605538c7a90 2024-04-23T18:31:18.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.980+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605538c78c0 con 0x5605538c7a90 2024-04-23T18:31:18.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.980+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605538c5e10 con 0x5605538c7a90 2024-04-23T18:31:18.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.981+0000 7efc02604640 1 -- 172.21.15.119:0/4126434605 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7efd00017070 con 0x5605538c7a90 2024-04-23T18:31:18.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.981+0000 7efc02604640 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbfc036e60 0x7efbfc039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.981+0000 7efc02604640 1 -- 172.21.15.119:0/4126434605 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7efd00015020 con 0x5605538c7a90 2024-04-23T18:31:18.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.981+0000 7efd15417640 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbfc036e60 0x7efbfc039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.980 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.981+0000 7efd18119800 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5605538cb5a0 0x5605539c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.981+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5605539c9490 con 0x5605538cb5a0 2024-04-23T18:31:18.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.981+0000 7efd16419640 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5605538cb5a0 0x5605539c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.982+0000 7efd15417640 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbfc036e60 0x7efbfc039320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efd08054000 tx=0x7efd0804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.982+0000 7efd16419640 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5605538cb5a0 0x5605539c8f50 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.982+0000 7efd16419640 1 -- 172.21.15.119:0/4126434605 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd1000a4a0 con 0x5605538cb5a0 2024-04-23T18:31:18.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.982+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5605539c9850 con 0x5605538cb5a0 2024-04-23T18:31:18.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.982+0000 7efd16419640 1 -- 172.21.15.119:0/4126434605 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd1000a4a0 con 0x5605538cb5a0 2024-04-23T18:31:18.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.982+0000 7efd18119800 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5605539cb660 0x5605539cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.982+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5605539ce0f0 con 0x5605539cb660 2024-04-23T18:31:18.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.982+0000 7efd15c18640 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5605539cb660 0x5605539cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.982+0000 7efd15c18640 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5605539cb660 0x5605539cda50 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.983+0000 7efd15c18640 1 -- 172.21.15.119:0/4126434605 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efd0002e070 con 0x5605539cb660 2024-04-23T18:31:18.981 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.983+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5605539ca610 con 0x5605538cb5a0 2024-04-23T18:31:18.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.983+0000 7efd16419640 1 -- 172.21.15.119:0/4126434605 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd1000a4a0 con 0x5605538cb5a0 2024-04-23T18:31:18.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.983+0000 7efd18119800 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5605539cf5a0 0x5605539d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.983+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5605539d2150 con 0x5605539cf5a0 2024-04-23T18:31:18.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.983+0000 7efd15417640 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5605539cf5a0 0x5605539d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.984+0000 7efd15417640 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5605539cf5a0 0x5605539d19f0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.984+0000 7efd15417640 1 -- 172.21.15.119:0/4126434605 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efd0805a040 con 0x5605539cf5a0 2024-04-23T18:31:18.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.984+0000 7efd18119800 1 Processor -- start 2024-04-23T18:31:18.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.984+0000 7efd18119800 1 -- start start 2024-04-23T18:31:18.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.984+0000 7efd18119800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539e05b0 0x5605539e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:18.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.984+0000 7efd18119800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5605537b8df0 con 0x5605539e05b0 2024-04-23T18:31:18.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.985+0000 7efd15c18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539e05b0 0x5605539e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:18.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.985+0000 7efd15c18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539e05b0 0x5605539e09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55102/0 (socket says 172.21.15.119:55102) 2024-04-23T18:31:18.982 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.985+0000 7efd15c18640 1 -- 172.21.15.119:0/2588444465 learned_addr learned my addr 172.21.15.119:0/2588444465 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:18.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.985+0000 7efd15c18640 1 -- 172.21.15.119:0/2588444465 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605539e0f10 con 0x5605539e05b0 2024-04-23T18:31:18.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.985+0000 7efd15c18640 1 --2- 172.21.15.119:0/2588444465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539e05b0 0x5605539e09d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7efd0004bb70 tx=0x7efd00017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:18.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.985+0000 7efbfb7fe640 1 -- 172.21.15.119:0/2588444465 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd0001ae10 con 0x5605539e05b0 2024-04-23T18:31:18.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.985+0000 7efbfb7fe640 1 -- 172.21.15.119:0/2588444465 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd00045b10 con 0x5605539e05b0 2024-04-23T18:31:18.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.985+0000 7efd18119800 1 -- 172.21.15.119:0/2588444465 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605539e1980 con 0x5605539e05b0 2024-04-23T18:31:18.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.985+0000 7efbfb7fe640 1 -- 172.21.15.119:0/2588444465 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd00045df0 con 0x5605539e05b0 2024-04-23T18:31:18.983 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.985+0000 7efd18119800 1 -- 172.21.15.119:0/2588444465 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605539e1e80 con 0x5605539e05b0 2024-04-23T18:31:19.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.986+0000 7efbfb7fe640 1 -- 172.21.15.119:0/2588444465 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7efd000451a0 con 0x5605539e05b0 2024-04-23T18:31:19.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.986+0000 7efbfb7fe640 1 --2- 172.21.15.119:0/2588444465 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbf0036e60 0x7efbf0039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.986+0000 7efbfb7fe640 1 -- 172.21.15.119:0/2588444465 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7efd0003dd00 con 0x5605539e05b0 2024-04-23T18:31:19.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.986+0000 7efd15417640 1 --2- 172.21.15.119:0/2588444465 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbf0036e60 0x7efbf0039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.986+0000 7efd18119800 1 Processor -- start 2024-04-23T18:31:19.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.986+0000 7efd18119800 1 -- start start 2024-04-23T18:31:19.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.986+0000 7efd15417640 1 --2- 172.21.15.119:0/2588444465 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbf0036e60 0x7efbf0039320 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x5605538c6a90 tx=0x7efd08005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.001 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.987+0000 7efd18119800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 0x5605539edac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.987+0000 7efd18119800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5605539b8910 con 0x5605539ed6a0 2024-04-23T18:31:19.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.987+0000 7efd15c18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 0x5605539edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.987+0000 7efd15c18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 0x5605539edac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55104/0 (socket says 172.21.15.119:55104) 2024-04-23T18:31:19.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.987+0000 7efd15c18640 1 -- 172.21.15.119:0/255815885 learned_addr learned my addr 172.21.15.119:0/255815885 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.987+0000 7efd15c18640 1 -- 172.21.15.119:0/255815885 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605539ee090 con 0x5605539ed6a0 2024-04-23T18:31:19.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.987+0000 7efd15c18640 1 --2- 172.21.15.119:0/255815885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 0x5605539edac0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7efd000176e0 tx=0x7efd0000c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1ff32b1aaf0fc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.987+0000 7efbf97fa640 1 -- 172.21.15.119:0/255815885 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd00046dd0 con 0x5605539ed6a0 2024-04-23T18:31:19.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.987+0000 7efbf97fa640 1 -- 172.21.15.119:0/255815885 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0005e020 con 0x5605539ed6a0 2024-04-23T18:31:19.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.988+0000 7efbf97fa640 1 -- 172.21.15.119:0/255815885 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd00031cd0 con 0x5605539ed6a0 2024-04-23T18:31:19.002 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.988+0000 7efd18119800 1 -- 172.21.15.119:0/255815885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 msgr2=0x5605539edac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.988+0000 7efd18119800 1 --2- 172.21.15.119:0/255815885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 0x5605539edac0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7efd000176e0 tx=0x7efd0000c5d0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.988+0000 7efd18119800 1 -- 172.21.15.119:0/255815885 shutdown_connections 2024-04-23T18:31:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.988+0000 7efd18119800 1 --2- 172.21.15.119:0/255815885 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 0x5605539edac0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.988+0000 7efd18119800 1 -- 172.21.15.119:0/255815885 >> 172.21.15.119:0/255815885 conn(0x5605539e9a00 msgr2=0x5605539e7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.988+0000 7efd18119800 1 -- 172.21.15.119:0/255815885 shutdown_connections 2024-04-23T18:31:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.988+0000 7efd18119800 1 -- 172.21.15.119:0/255815885 wait complete. 2024-04-23T18:31:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.988+0000 7efd18119800 1 Processor -- start 2024-04-23T18:31:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.988+0000 7efd18119800 1 -- start start 2024-04-23T18:31:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.988+0000 7efd18119800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 0x5605539f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.988+0000 7efd18119800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5605539ee740 con 0x5605539ed6a0 2024-04-23T18:31:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.989+0000 7efd15c18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 0x5605539f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.989+0000 7efd15c18640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 0x5605539f4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55118/0 (socket says 172.21.15.119:55118) 2024-04-23T18:31:19.003 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.989+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 learned_addr learned my addr 172.21.15.119:0/3070914414 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.989+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605539f4fd0 con 0x5605539ed6a0 2024-04-23T18:31:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.989+0000 7efd15c18640 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 0x5605539f4a90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7efd00027fd0 tx=0x7efd00043ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.989+0000 7efbe77fe640 1 -- 172.21.15.119:0/3070914414 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd00019860 con 0x5605539ed6a0 2024-04-23T18:31:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.989+0000 7efbe77fe640 1 -- 172.21.15.119:0/3070914414 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd00027430 con 0x5605539ed6a0 2024-04-23T18:31:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.989+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5605539f4fd0 con 0x5605539ed6a0 2024-04-23T18:31:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.989+0000 7efbe77fe640 1 -- 172.21.15.119:0/3070914414 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd00019a00 con 0x5605539ed6a0 2024-04-23T18:31:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.989+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605539f4fd0 con 0x5605539ed6a0 2024-04-23T18:31:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.990+0000 7efbe77fe640 1 -- 172.21.15.119:0/3070914414 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7efd0001dad0 con 0x5605539ed6a0 2024-04-23T18:31:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.990+0000 7efbe77fe640 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbe0036e10 0x7efbe00392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.990+0000 7efbe77fe640 1 -- 172.21.15.119:0/3070914414 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7efd0006c030 con 0x5605539ed6a0 2024-04-23T18:31:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.990+0000 7efd15417640 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbe0036e10 0x7efbe00392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.991+0000 7efd15417640 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbe0036e10 0x7efbe00392d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efd08055040 tx=0x7efd0804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.004 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.991+0000 7efd18119800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.991+0000 7efd18119800 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560553a001d0 0x560553a02690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.991+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a02de0 con 0x560553a001d0 2024-04-23T18:31:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.991+0000 7efd16419640 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560553a001d0 0x560553a02690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.991+0000 7efd16419640 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560553a001d0 0x560553a02690 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.991+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd1000a4a0 con 0x560553a001d0 2024-04-23T18:31:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.991+0000 7efd18119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.991+0000 7efd18119800 20 realm 2024-04-23T18:31:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.991+0000 7efd18119800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.991+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a031f0 con 0x560553a001d0 2024-04-23T18:31:19.005 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd1000a4a0 con 0x560553a001d0 2024-04-23T18:31:19.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd18119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd18119800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:19.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd18119800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a03ac0 con 0x560553a001d0 2024-04-23T18:31:19.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd1000a4a0 con 0x560553a001d0 2024-04-23T18:31:19.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd18119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd18119800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a001d0 2024-04-23T18:31:19.006 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd1000a4a0 con 0x560553a001d0 2024-04-23T18:31:19.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd18119800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd18119800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd18119800 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560553a04bc0 0x560553a06fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a075c0 con 0x560553a04bc0 2024-04-23T18:31:19.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd15c18640 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560553a04bc0 0x560553a06fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.992+0000 7efd15c18640 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560553a04bc0 0x560553a06fb0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.993+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.993+0000 7efd18119800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:19.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.993+0000 7efd18119800 20 searching for the correct realm 2024-04-23T18:31:19.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.993+0000 7efd18119800 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560553a09570 0x560553a0ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.993+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a0c100 con 0x560553a09570 2024-04-23T18:31:19.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.993+0000 7efd15417640 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560553a09570 0x560553a0ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.007 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.993+0000 7efd15417640 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560553a09570 0x560553a0ba30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.993+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.993+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a0c100 con 0x560553a04bc0 2024-04-23T18:31:19.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.994+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.994+0000 7efd15c18640 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7efd0000f070 0x7efd00026390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.994+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a0c100 con 0x7efd0000f070 2024-04-23T18:31:19.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.994+0000 7efd16419640 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7efd0000f070 0x7efd00026390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.994+0000 7efd16419640 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7efd0000f070 0x7efd00026390 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.995+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1000a4a0 con 0x7efd0000f070 2024-04-23T18:31:19.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.995+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a001d0 2024-04-23T18:31:19.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.995+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1000a4a0 con 0x560553a001d0 2024-04-23T18:31:19.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.995+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a001d0 2024-04-23T18:31:19.008 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.995+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1000a4a0 con 0x560553a001d0 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.995+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x7efd0000f070 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.995+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1000a4a0 con 0x7efd0000f070 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.995+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x7efd0000f070 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.996+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efd1000a4a0 con 0x7efd0000f070 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.996+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a04bc0 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.996+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.996+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a09570 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.996+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.996+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a001d0 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.996+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1000a4a0 con 0x560553a001d0 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.996+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x7efd0000f070 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.997+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1000a4a0 con 0x7efd0000f070 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.997+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a001d0 2024-04-23T18:31:19.009 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.997+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1000a4a0 con 0x560553a001d0 2024-04-23T18:31:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.997+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a04bc0 2024-04-23T18:31:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.997+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.997+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a09570 2024-04-23T18:31:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.997+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.997+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a09570 2024-04-23T18:31:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.998+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.998+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x7efd0000f070 2024-04-23T18:31:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.998+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1000a4a0 con 0x7efd0000f070 2024-04-23T18:31:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.998+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a09570 2024-04-23T18:31:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.998+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.998+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a09570 2024-04-23T18:31:19.010 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.999+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.999+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a001d0 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.999+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1000a4a0 con 0x560553a001d0 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.999+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a001d0 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.999+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efd1000a4a0 con 0x560553a001d0 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.999+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x7efd0000f070 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.999+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1000a4a0 con 0x7efd0000f070 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:18.999+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a09570 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.000+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.000+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a04bc0 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.000+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.000+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a001d0 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.000+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1000a4a0 con 0x560553a001d0 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.000+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a04bc0 2024-04-23T18:31:19.011 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.000+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.000+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a09570 2024-04-23T18:31:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.000+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.001+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x7efd0000f070 2024-04-23T18:31:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.001+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1000a4a0 con 0x7efd0000f070 2024-04-23T18:31:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.001+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a04bc0 2024-04-23T18:31:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.001+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.001+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a09570 2024-04-23T18:31:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.001+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.001+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x7efd0000f070 2024-04-23T18:31:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1000a4a0 con 0x7efd0000f070 2024-04-23T18:31:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a001d0 2024-04-23T18:31:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.012 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560553a03e60 con 0x560553a04bc0 2024-04-23T18:31:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd18119800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd18119800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd18119800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd18119800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd18119800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd18119800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd18119800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a07e80 con 0x560553a001d0 2024-04-23T18:31:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd18119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd18119800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.013 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.002+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a08270 con 0x560553a001d0 2024-04-23T18:31:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a08270 con 0x7efd0000f070 2024-04-23T18:31:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 20 zone default found 2024-04-23T18:31:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 4 Realm: () 2024-04-23T18:31:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:19.014 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:19.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 20 zonegroup default 2024-04-23T18:31:19.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a0c580 con 0x560553a04bc0 2024-04-23T18:31:19.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.003+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a0e300 con 0x560553a09570 2024-04-23T18:31:19.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.004+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.004+0000 7efd18119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.004+0000 7efd18119800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.004+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a0e6a0 con 0x560553a09570 2024-04-23T18:31:19.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.004+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.015 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.004+0000 7efd18119800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.004+0000 7efd18119800 20 started sync module instance, tier type = 2024-04-23T18:31:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.004+0000 7efd18119800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.004+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a0d7a0 con 0x560553a04bc0 2024-04-23T18:31:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.005+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.005+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94580877873904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a0ea40 con 0x560553a04bc0 2024-04-23T18:31:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.005+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a0f400 con 0x560553a001d0 2024-04-23T18:31:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.006+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94580877873904] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.006+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.006+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94580877881168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a0f820 con 0x560553a001d0 2024-04-23T18:31:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.006+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a101e0 con 0x560553a09570 2024-04-23T18:31:19.016 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.007+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94580877881168] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.008+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.008+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94580877882224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a0f790 con 0x560553a09570 2024-04-23T18:31:19.017 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.008+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a11050 con 0x560553a04bc0 2024-04-23T18:31:19.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.009+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94580877882224] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.009+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.009+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94580877886848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a118f0 con 0x560553a04bc0 2024-04-23T18:31:19.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.009+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a122b0 con 0x560553a001d0 2024-04-23T18:31:19.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.010+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94580877886848] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.010+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.010+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94580877891104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a122b0 con 0x560553a001d0 2024-04-23T18:31:19.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.010+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a12c70 con 0x7efd0000f070 2024-04-23T18:31:19.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.011+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94580877891104] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.011+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.011+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94580877893600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a12c70 con 0x7efd0000f070 2024-04-23T18:31:19.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.011+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a13630 con 0x7efd0000f070 2024-04-23T18:31:19.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.012+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(56 notify.6 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.012+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94580877898112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a13a50 con 0x7efd0000f070 2024-04-23T18:31:19.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.012+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a144f0 con 0x7efd0000f070 2024-04-23T18:31:19.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.012+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94580877893600] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.013+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94580877898112] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.013+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.013+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94580877901760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a135a0 con 0x7efd0000f070 2024-04-23T18:31:19.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.013+0000 7efd18119800 20 add_watcher() i=0 2024-04-23T18:31:19.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.013+0000 7efd18119800 20 add_watcher() i=1 2024-04-23T18:31:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.013+0000 7efd18119800 20 add_watcher() i=2 2024-04-23T18:31:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.013+0000 7efd18119800 20 add_watcher() i=3 2024-04-23T18:31:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.013+0000 7efd18119800 20 add_watcher() i=4 2024-04-23T18:31:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.013+0000 7efd18119800 20 add_watcher() i=5 2024-04-23T18:31:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.013+0000 7efd18119800 20 add_watcher() i=6 2024-04-23T18:31:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.014+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94580877901760] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.014+0000 7efd18119800 20 add_watcher() i=7 2024-04-23T18:31:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.014+0000 7efd18119800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.014+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a17700 con 0x560553a001d0 2024-04-23T18:31:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.015+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.015+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94580877895616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a14bb0 con 0x560553a001d0 2024-04-23T18:31:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.016+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94580877895616] v34'253 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.016+0000 7efbc77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.016+0000 7efd18119800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.016+0000 7efd18119800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.016+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a20040 con 0x560553a001d0 2024-04-23T18:31:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.017+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.017+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a20690 con 0x7efd0000f070 2024-04-23T18:31:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.019+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.019+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a20af0 con 0x560553a09570 2024-04-23T18:31:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.019+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.020+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a21510 con 0x560553a001d0 2024-04-23T18:31:19.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.021+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'254 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.021+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a1bce0 con 0x560553a04bc0 2024-04-23T18:31:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.022+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.022+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a1bcb0 con 0x560553a09570 2024-04-23T18:31:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.023+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.023+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22520 con 0x560553a001d0 2024-04-23T18:31:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.024+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.024+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22520 con 0x7efd0000f070 2024-04-23T18:31:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.025+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'56 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.025+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22520 con 0x560553a04bc0 2024-04-23T18:31:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.026+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.027 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.026+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22520 con 0x560553a09570 2024-04-23T18:31:19.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.027+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.027+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22780 con 0x560553a04bc0 2024-04-23T18:31:19.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.028+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.028+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22810 con 0x7efd0000f070 2024-04-23T18:31:19.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.029+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'37 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.028 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.029+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22810 con 0x560553a04bc0 2024-04-23T18:31:19.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.030+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.030+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a229e0 con 0x7efd0000f070 2024-04-23T18:31:19.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.031+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.031+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a229e0 con 0x560553a001d0 2024-04-23T18:31:19.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.032+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'255 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.032+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a09570 2024-04-23T18:31:19.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.033+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'74 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.033+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a04bc0 2024-04-23T18:31:19.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.034+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.034+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a09570 2024-04-23T18:31:19.030 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.035+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.035+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a001d0 2024-04-23T18:31:19.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.036+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.036+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a001d0 2024-04-23T18:31:19.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.037+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'256 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.031 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.038+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a09570 2024-04-23T18:31:19.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.039+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'75 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.032 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.039+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a04bc0 2024-04-23T18:31:19.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.040+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.033 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.040+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a09570 2024-04-23T18:31:19.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.041+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.034 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.041+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a09570 2024-04-23T18:31:19.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.041+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.035 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.042+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a09570 2024-04-23T18:31:19.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.042+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.036 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.042+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a09570 2024-04-23T18:31:19.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.043+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.037 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.043+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x7efd0000f070 2024-04-23T18:31:19.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.045+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.045+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a09570 2024-04-23T18:31:19.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.046+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.046+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x7efd0000f070 2024-04-23T18:31:19.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.047+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'57 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.040 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.047+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a09570 2024-04-23T18:31:19.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.048+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'76 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.041 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.048+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x7efd0000f070 2024-04-23T18:31:19.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.049+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.042 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.049+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a22de0 con 0x560553a04bc0 2024-04-23T18:31:19.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.050+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.051+0000 7efbc67fc640 20 reqs_thread_entry: start 2024-04-23T18:31:19.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.051+0000 7efd18119800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:19.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.051+0000 7efd18119800 20 Filter name: none 2024-04-23T18:31:19.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.051+0000 7efb37fff640 20 reqs_thread_entry: start 2024-04-23T18:31:19.044 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.051+0000 7efd18119800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-23T18:31:19.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.051+0000 7efd18119800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.045 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.051+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a4da90 con 0x560553a09570 2024-04-23T18:31:19.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.051+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.051+0000 7efd18119800 20 rados_obj.operate() r=0 bl.length=363 2024-04-23T18:31:19.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.051+0000 7efd18119800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-04-23T18:31:19.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.051+0000 7efd18119800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-23T18:31:19.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.051+0000 7efd18119800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:19.046 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.051+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a50520 con 0x560553a09570 2024-04-23T18:31:19.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.052+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7efd0807f070 con 0x560553a09570 2024-04-23T18:31:19.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.052+0000 7efd18119800 10 removing key index: true_admin_akey 2024-04-23T18:31:19.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.052+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a4e500 con 0x560553a09570 2024-04-23T18:31:19.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.053+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 28 ==== osd_op_reply(96 true_admin_akey [delete] v34'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7efd08091040 con 0x560553a09570 2024-04-23T18:31:19.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.053+0000 7efd18119800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-23T18:31:19.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.053+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94580878143504 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a50a50 con 0x7efd0000f070 2024-04-23T18:31:19.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.053+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== watch-notify(notify (1) cookie 94580877893600 notify 146028888111 ret 0) ==== 207+0+0 (crc 0 0 0) 0x560553a22950 con 0x7efd0000f070 2024-04-23T18:31:19.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.053+0000 7efbf97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888111 cookie 94580877893600 notifier 4861 bl.length()=165 2024-04-23T18:31:19.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.053+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(97 notify.5 [notify cookie 94580878143504 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.053+0000 7efbf97fa640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7efbd8003d60 con 0x7efd0000f070 2024-04-23T18:31:19.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.054+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.054+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== watch-notify(notify_complete (2) cookie 94580878143504 notify 146028888111 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560553a1fb70 con 0x7efd0000f070 2024-04-23T18:31:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.054+0000 7efd18119800 10 removing email index: 2024-04-23T18:31:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.054+0000 7efd18119800 10 removing user buckets index 2024-04-23T18:31:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.054+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a509d0 con 0x560553a09570 2024-04-23T18:31:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.055+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 29 ==== osd_op_reply(99 a_user.buckets [delete] v34'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7efd08091040 con 0x560553a09570 2024-04-23T18:31:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.055+0000 7efd18119800 10 removing user index: a_user 2024-04-23T18:31:19.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.055+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a509d0 con 0x560553a09570 2024-04-23T18:31:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.056+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 30 ==== osd_op_reply(100 a_user [call,call,delete] v34'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7efd08091040 con 0x560553a09570 2024-04-23T18:31:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.056+0000 7efd18119800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-04-23T18:31:19.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.056+0000 7efd18119800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-23T18:31:19.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.056+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94580878150096 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560553a4f010 con 0x560553a09570 2024-04-23T18:31:19.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.056+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 31 ==== watch-notify(notify (1) cookie 94580877882224 notify 146028888074 ret 0) ==== 197+0+0 (crc 0 0 0) 0x560553a225b0 con 0x560553a09570 2024-04-23T18:31:19.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.056+0000 7efbf97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94580877882224 notifier 4861 bl.length()=155 2024-04-23T18:31:19.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.056+0000 7efbf97fa640 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7efbd8003d60 con 0x560553a09570 2024-04-23T18:31:19.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.056+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 32 ==== osd_op_reply(101 notify.2 [notify cookie 94580878150096 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efd08091040 con 0x560553a09570 2024-04-23T18:31:19.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.056+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 33 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd08091040 con 0x560553a09570 2024-04-23T18:31:19.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.056+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 34 ==== watch-notify(notify_complete (2) cookie 94580878150096 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560553a1c050 con 0x560553a09570 2024-04-23T18:31:19.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.057+0000 7efbc77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.057+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94580877895616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a509d0 con 0x560553a001d0 2024-04-23T18:31:19.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.058+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94580877895616] v34'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.058+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94580877873904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a509b0 con 0x560553a04bc0 2024-04-23T18:31:19.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.059+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94580877873904] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.059+0000 7efd18119800 20 remove_watcher() i=0 2024-04-23T18:31:19.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.059+0000 7efd18119800 2 removed watcher, disabling cache 2024-04-23T18:31:19.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.059+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94580877881168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a0d2f0 con 0x560553a001d0 2024-04-23T18:31:19.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.061+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94580877881168] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.061+0000 7efd18119800 20 remove_watcher() i=1 2024-04-23T18:31:19.054 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.061+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94580877882224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a0ef50 con 0x560553a09570 2024-04-23T18:31:19.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.062+0000 7efd15417640 1 -- 172.21.15.119:0/3070914414 <== osd.3 v2:172.21.15.119:6809/3910610681 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94580877882224] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd08091040 con 0x560553a09570 2024-04-23T18:31:19.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.062+0000 7efd18119800 20 remove_watcher() i=2 2024-04-23T18:31:19.055 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.062+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94580877886848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a509b0 con 0x560553a04bc0 2024-04-23T18:31:19.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.063+0000 7efd15c18640 1 -- 172.21.15.119:0/3070914414 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94580877886848] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0002e070 con 0x560553a04bc0 2024-04-23T18:31:19.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.063+0000 7efd18119800 20 remove_watcher() i=3 2024-04-23T18:31:19.056 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.063+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94580877891104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a10580 con 0x560553a001d0 2024-04-23T18:31:19.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.064+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94580877891104] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x560553a001d0 2024-04-23T18:31:19.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.064+0000 7efd18119800 20 remove_watcher() i=4 2024-04-23T18:31:19.057 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.064+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94580877893600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a11620 con 0x7efd0000f070 2024-04-23T18:31:19.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.065+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94580877893600] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.065+0000 7efd18119800 20 remove_watcher() i=5 2024-04-23T18:31:19.058 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.065+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94580877898112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a11620 con 0x7efd0000f070 2024-04-23T18:31:19.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.066+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94580877898112] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.066+0000 7efd18119800 20 remove_watcher() i=6 2024-04-23T18:31:19.059 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.066+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94580877901760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560553a11620 con 0x7efd0000f070 2024-04-23T18:31:19.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94580877901760] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd10040080 con 0x7efd0000f070 2024-04-23T18:31:19.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 20 remove_watcher() i=7 2024-04-23T18:31:19.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7efd0000f070 msgr2=0x7efd00026390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7efd0000f070 0x7efd00026390 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560553a001d0 msgr2=0x560553a02690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x560553a001d0 0x560553a02690 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560553a04bc0 msgr2=0x560553a06fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x560553a04bc0 0x560553a06fb0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560553a09570 msgr2=0x560553a0ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x560553a09570 0x560553a0ba30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.063 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbe0036e10 msgr2=0x7efbe00392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbe0036e10 0x7efbe00392d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efd08055040 tx=0x7efd0804f000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 msgr2=0x5605539f4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 0x5605539f4a90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7efd00027fd0 tx=0x7efd00043ee0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd16419640 1 -- 172.21.15.119:0/3070914414 reap_dead start 2024-04-23T18:31:19.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 shutdown_connections 2024-04-23T18:31:19.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 --2- 172.21.15.119:0/3070914414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539ed6a0 0x5605539f4a90 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 >> 172.21.15.119:0/3070914414 conn(0x5605539e9a00 msgr2=0x5605539e7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 shutdown_connections 2024-04-23T18:31:19.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 -- 172.21.15.119:0/3070914414 wait complete. 2024-04-23T18:31:19.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 -- 172.21.15.119:0/2588444465 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbf0036e60 msgr2=0x7efbf0039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.064 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 --2- 172.21.15.119:0/2588444465 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbf0036e60 0x7efbf0039320 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x5605538c6a90 tx=0x7efd08005ac0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 -- 172.21.15.119:0/2588444465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539e05b0 msgr2=0x5605539e09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 --2- 172.21.15.119:0/2588444465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539e05b0 0x5605539e09d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7efd0004bb70 tx=0x7efd00017d50 comp rx=0 tx=0).stop 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.067+0000 7efd18119800 1 -- 172.21.15.119:0/2588444465 shutdown_connections 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 --2- 172.21.15.119:0/2588444465 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbf0036e60 0x7efbf0039320 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 --2- 172.21.15.119:0/2588444465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605539e05b0 0x5605539e09d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 -- 172.21.15.119:0/2588444465 >> 172.21.15.119:0/2588444465 conn(0x5605539d4650 msgr2=0x5605539d4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 -- 172.21.15.119:0/2588444465 shutdown_connections 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 -- 172.21.15.119:0/2588444465 wait complete. 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5605539cf5a0 msgr2=0x5605539d19f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5605539cf5a0 0x5605539d19f0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5605538cb5a0 msgr2=0x5605539c8f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5605538cb5a0 0x5605539c8f50 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5605539cb660 msgr2=0x5605539cda50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.065 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5605539cb660 0x5605539cda50 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbfc036e60 msgr2=0x7efbfc039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbfc036e60 0x7efbfc039320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efd08054000 tx=0x7efd0804e000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538c7a90 msgr2=0x5605538c7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 --2- 172.21.15.119:0/4126434605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5605538c7a90 0x5605538c7380 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7efd0000b700 tx=0x7efd00000bc0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd16419640 1 -- 172.21.15.119:0/4126434605 reap_dead start 2024-04-23T18:31:19.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 shutdown_connections 2024-04-23T18:31:19.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 >> 172.21.15.119:0/4126434605 conn(0x5605538c1420 msgr2=0x5605539b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 shutdown_connections 2024-04-23T18:31:19.066 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.068+0000 7efd18119800 1 -- 172.21.15.119:0/4126434605 wait complete. 2024-04-23T18:31:19.069 ERROR:root:None 2024-04-23T18:31:19.069 ERROR:root:0 2024-04-23T18:31:19.069 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-23T18:31:19.069 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-23T18:31:19.070 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-04-23T18:31:19.154 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:19.154 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:19.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.161+0000 7fa25dc13800 1 Processor -- start 2024-04-23T18:31:19.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.161+0000 7fa25dc13800 1 -- start start 2024-04-23T18:31:19.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.161+0000 7fa25dc13800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55dc25b0f5a0 0x55dc25b11990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.161+0000 7fa25dc13800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dc259bb560 con 0x55dc25b0ba90 2024-04-23T18:31:19.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.161+0000 7fa25dc13800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55dc259ace20 con 0x55dc25b0f5a0 2024-04-23T18:31:19.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.162+0000 7fa2589db640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55dc25b0f5a0 0x55dc25b11990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.162+0000 7fa2589db640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55dc25b0f5a0 0x55dc25b11990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55124/0 (socket says 172.21.15.119:55124) 2024-04-23T18:31:19.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.162+0000 7fa2591dc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55dc25b0ba90 0x55dc25b0de80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50616/0 (socket says 172.21.15.119:50616) 2024-04-23T18:31:19.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.162+0000 7fa2589db640 1 -- 172.21.15.119:0/679785649 learned_addr learned my addr 172.21.15.119:0/679785649 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.162+0000 7fa2589db640 1 -- 172.21.15.119:0/679785649 >> v1:172.21.15.62:6789/0 conn(0x55dc25b0ba90 legacy=0x55dc25b0de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.156 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.162+0000 7fa2589db640 1 -- 172.21.15.119:0/679785649 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc259bae60 con 0x55dc25b0f5a0 2024-04-23T18:31:19.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.164+0000 7fa2589db640 1 --2- 172.21.15.119:0/679785649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0f5a0 0x55dc25b11990 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa25000a520 tx=0x7fa25001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc744ac93bfc7cd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.164+0000 7fa24bfff640 1 -- 172.21.15.119:0/679785649 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa250057070 con 0x55dc25b0f5a0 2024-04-23T18:31:19.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.164+0000 7fa24bfff640 1 -- 172.21.15.119:0/679785649 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa250052570 con 0x55dc25b0f5a0 2024-04-23T18:31:19.157 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.164+0000 7fa24bfff640 1 -- 172.21.15.119:0/679785649 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa25004ae60 con 0x55dc25b0f5a0 2024-04-23T18:31:19.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.164+0000 7fa25dc13800 1 -- 172.21.15.119:0/679785649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0f5a0 msgr2=0x55dc25b11990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.164+0000 7fa25dc13800 1 --2- 172.21.15.119:0/679785649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0f5a0 0x55dc25b11990 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa25000a520 tx=0x7fa25001d010 comp rx=0 tx=0).stop 2024-04-23T18:31:19.158 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.164+0000 7fa25dc13800 1 -- 172.21.15.119:0/679785649 shutdown_connections 2024-04-23T18:31:19.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.164+0000 7fa25dc13800 1 --2- 172.21.15.119:0/679785649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0f5a0 0x55dc25b11990 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.164+0000 7fa25dc13800 1 -- 172.21.15.119:0/679785649 >> 172.21.15.119:0/679785649 conn(0x55dc25b05440 msgr2=0x55dc25b07860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.164+0000 7fa25dc13800 1 -- 172.21.15.119:0/679785649 shutdown_connections 2024-04-23T18:31:19.159 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.164+0000 7fa25dc13800 1 -- 172.21.15.119:0/679785649 wait complete. 2024-04-23T18:31:19.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.176+0000 7fa25dc13800 1 Processor -- start 2024-04-23T18:31:19.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.176+0000 7fa25dc13800 1 -- start start 2024-04-23T18:31:19.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.176+0000 7fa25dc13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0ba90 0x55dc25bfc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.176+0000 7fa25dc13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dc25a565d0 con 0x55dc25b0ba90 2024-04-23T18:31:19.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.177+0000 7fa2591dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0ba90 0x55dc25bfc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.177+0000 7fa2591dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0ba90 0x55dc25bfc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55132/0 (socket says 172.21.15.119:55132) 2024-04-23T18:31:19.170 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.177+0000 7fa2591dc640 1 -- 172.21.15.119:0/3346162124 learned_addr learned my addr 172.21.15.119:0/3346162124 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.177+0000 7fa2591dc640 1 -- 172.21.15.119:0/3346162124 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc259cc860 con 0x55dc25b0ba90 2024-04-23T18:31:19.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.177+0000 7fa2591dc640 1 --2- 172.21.15.119:0/3346162124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0ba90 0x55dc25bfc1e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa24c001610 tx=0x7fa24c006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625066d38fdea76 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.177+0000 7fa147606640 1 -- 172.21.15.119:0/3346162124 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24c013420 con 0x55dc25b0ba90 2024-04-23T18:31:19.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.177+0000 7fa147606640 1 -- 172.21.15.119:0/3346162124 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24c0135e0 con 0x55dc25b0ba90 2024-04-23T18:31:19.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.177+0000 7fa147606640 1 -- 172.21.15.119:0/3346162124 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24c013940 con 0x55dc25b0ba90 2024-04-23T18:31:19.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.178+0000 7fa25dc13800 1 -- 172.21.15.119:0/3346162124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0ba90 msgr2=0x55dc25bfc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.178+0000 7fa25dc13800 1 --2- 172.21.15.119:0/3346162124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0ba90 0x55dc25bfc1e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa24c001610 tx=0x7fa24c006f90 comp rx=0 tx=0).stop 2024-04-23T18:31:19.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.178+0000 7fa25dc13800 1 -- 172.21.15.119:0/3346162124 shutdown_connections 2024-04-23T18:31:19.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.178+0000 7fa25dc13800 1 --2- 172.21.15.119:0/3346162124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0ba90 0x55dc25bfc1e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.178+0000 7fa25dc13800 1 -- 172.21.15.119:0/3346162124 >> 172.21.15.119:0/3346162124 conn(0x55dc25b05440 msgr2=0x55dc25bf7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.178+0000 7fa25dc13800 1 -- 172.21.15.119:0/3346162124 shutdown_connections 2024-04-23T18:31:19.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.178+0000 7fa25dc13800 1 -- 172.21.15.119:0/3346162124 wait complete. 2024-04-23T18:31:19.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.178+0000 7fa25dc13800 1 Processor -- start 2024-04-23T18:31:19.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.178+0000 7fa25dc13800 1 -- start start 2024-04-23T18:31:19.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.179+0000 7fa25dc13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0ba90 0x55dc25c03ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.179+0000 7fa25dc13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dc25b141e0 con 0x55dc25b0ba90 2024-04-23T18:31:19.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.179+0000 7fa2591dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0ba90 0x55dc25c03ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.179+0000 7fa2591dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0ba90 0x55dc25c03ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55140/0 (socket says 172.21.15.119:55140) 2024-04-23T18:31:19.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.179+0000 7fa2591dc640 1 -- 172.21.15.119:0/1047449964 learned_addr learned my addr 172.21.15.119:0/1047449964 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.179+0000 7fa2591dc640 1 -- 172.21.15.119:0/1047449964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc259caeb0 con 0x55dc25b0ba90 2024-04-23T18:31:19.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.179+0000 7fa2591dc640 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0ba90 0x55dc25c03ba0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00f000 tx=0x7fa24c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.179+0000 7fa145e03640 1 -- 172.21.15.119:0/1047449964 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24c022020 con 0x55dc25b0ba90 2024-04-23T18:31:19.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.179+0000 7fa145e03640 1 -- 172.21.15.119:0/1047449964 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24c019040 con 0x55dc25b0ba90 2024-04-23T18:31:19.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.179+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc25c040e0 con 0x55dc25b0ba90 2024-04-23T18:31:19.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.179+0000 7fa145e03640 1 -- 172.21.15.119:0/1047449964 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24c004b20 con 0x55dc25b0ba90 2024-04-23T18:31:19.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.179+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc25c04600 con 0x55dc25b0ba90 2024-04-23T18:31:19.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.180+0000 7fa145e03640 1 -- 172.21.15.119:0/1047449964 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa24c025020 con 0x55dc25b0ba90 2024-04-23T18:31:19.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.180+0000 7fa145e03640 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa140036e60 0x7fa140039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.180+0000 7fa145e03640 1 -- 172.21.15.119:0/1047449964 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fa24c04cda0 con 0x55dc25b0ba90 2024-04-23T18:31:19.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.180+0000 7fa2589db640 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa140036e60 0x7fa140039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.181+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55dc25b0f5a0 0x55dc25c0abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.181+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c0b190 con 0x55dc25b0f5a0 2024-04-23T18:31:19.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.181+0000 7fa2599dd640 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55dc25b0f5a0 0x55dc25c0abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.224 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.181+0000 7fa2589db640 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa140036e60 0x7fa140039320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa250054000 tx=0x7fa25004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.181+0000 7fa2599dd640 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55dc25b0f5a0 0x55dc25c0abc0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.181+0000 7fa2599dd640 1 -- 172.21.15.119:0/1047449964 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2540083e0 con 0x55dc25b0f5a0 2024-04-23T18:31:19.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.181+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c08170 con 0x55dc25b0f5a0 2024-04-23T18:31:19.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.181+0000 7fa2599dd640 1 -- 172.21.15.119:0/1047449964 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2540083e0 con 0x55dc25b0f5a0 2024-04-23T18:31:19.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.181+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55dc25c0d4a0 0x55dc25c0f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.181+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c0ff80 con 0x55dc25c0d4a0 2024-04-23T18:31:19.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.182+0000 7fa2591dc640 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55dc25c0d4a0 0x55dc25c0f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.182+0000 7fa2591dc640 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55dc25c0d4a0 0x55dc25c0f890 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.182+0000 7fa2591dc640 1 -- 172.21.15.119:0/1047449964 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa24c00f030 con 0x55dc25c0d4a0 2024-04-23T18:31:19.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.182+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c0c420 con 0x55dc25b0f5a0 2024-04-23T18:31:19.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.182+0000 7fa2599dd640 1 -- 172.21.15.119:0/1047449964 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2540083e0 con 0x55dc25b0f5a0 2024-04-23T18:31:19.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.182+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55dc25c113e0 0x55dc25c13830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.225 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.182+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c13fc0 con 0x55dc25c113e0 2024-04-23T18:31:19.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.183+0000 7fa2589db640 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55dc25c113e0 0x55dc25c13830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.183+0000 7fa2589db640 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55dc25c113e0 0x55dc25c13830 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.183+0000 7fa2589db640 1 -- 172.21.15.119:0/1047449964 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa25005a040 con 0x55dc25c113e0 2024-04-23T18:31:19.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.183+0000 7fa25dc13800 1 Processor -- start 2024-04-23T18:31:19.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.184+0000 7fa25dc13800 1 -- start start 2024-04-23T18:31:19.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.184+0000 7fa25dc13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c22420 0x55dc25c22840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.184+0000 7fa25dc13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dc259fcdf0 con 0x55dc25c22420 2024-04-23T18:31:19.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.184+0000 7fa2591dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c22420 0x55dc25c22840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.184+0000 7fa2591dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c22420 0x55dc25c22840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55154/0 (socket says 172.21.15.119:55154) 2024-04-23T18:31:19.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.184+0000 7fa2591dc640 1 -- 172.21.15.119:0/1550015080 learned_addr learned my addr 172.21.15.119:0/1550015080 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.226 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.184+0000 7fa2591dc640 1 -- 172.21.15.119:0/1550015080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc25c22d80 con 0x55dc25c22420 2024-04-23T18:31:19.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.184+0000 7fa2591dc640 1 --2- 172.21.15.119:0/1550015080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c22420 0x55dc25c22840 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa24c04b110 tx=0x7fa24c01e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.184+0000 7fa13effd640 1 -- 172.21.15.119:0/1550015080 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24c034070 con 0x55dc25c22420 2024-04-23T18:31:19.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.184+0000 7fa13effd640 1 -- 172.21.15.119:0/1550015080 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24c044540 con 0x55dc25c22420 2024-04-23T18:31:19.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.184+0000 7fa13effd640 1 -- 172.21.15.119:0/1550015080 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24c0106c0 con 0x55dc25c22420 2024-04-23T18:31:19.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.184+0000 7fa25dc13800 1 -- 172.21.15.119:0/1550015080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc25c237f0 con 0x55dc25c22420 2024-04-23T18:31:19.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.184+0000 7fa25dc13800 1 -- 172.21.15.119:0/1550015080 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc25c23cf0 con 0x55dc25c22420 2024-04-23T18:31:19.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.185+0000 7fa13effd640 1 -- 172.21.15.119:0/1550015080 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa24c010070 con 0x55dc25c22420 2024-04-23T18:31:19.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.185+0000 7fa13effd640 1 --2- 172.21.15.119:0/1550015080 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa130036e60 0x7fa130039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.185+0000 7fa13effd640 1 -- 172.21.15.119:0/1550015080 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fa24c039d10 con 0x55dc25c22420 2024-04-23T18:31:19.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.185+0000 7fa2589db640 1 --2- 172.21.15.119:0/1550015080 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa130036e60 0x7fa130039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.186+0000 7fa25dc13800 1 Processor -- start 2024-04-23T18:31:19.227 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.186+0000 7fa25dc13800 1 -- start start 2024-04-23T18:31:19.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.186+0000 7fa2589db640 1 --2- 172.21.15.119:0/1550015080 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa130036e60 0x7fa130039320 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55dc25c0b640 tx=0x7fa250005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.186+0000 7fa25dc13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c2f5a0 0x55dc25c2f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.186+0000 7fa25dc13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dc25bfc960 con 0x55dc25c2f5a0 2024-04-23T18:31:19.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.186+0000 7fa2591dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c2f5a0 0x55dc25c2f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.186+0000 7fa2591dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c2f5a0 0x55dc25c2f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55160/0 (socket says 172.21.15.119:55160) 2024-04-23T18:31:19.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.186+0000 7fa2591dc640 1 -- 172.21.15.119:0/1188861035 learned_addr learned my addr 172.21.15.119:0/1188861035 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.186+0000 7fa2591dc640 1 -- 172.21.15.119:0/1188861035 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc25c2ff90 con 0x55dc25c2f5a0 2024-04-23T18:31:19.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.186+0000 7fa2591dc640 1 --2- 172.21.15.119:0/1188861035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c2f5a0 0x55dc25c2f9c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa24c040fd0 tx=0x7fa24c04cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d307da69050c464e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.186+0000 7fa13cff9640 1 -- 172.21.15.119:0/1188861035 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24c010990 con 0x55dc25c2f5a0 2024-04-23T18:31:19.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.186+0000 7fa13cff9640 1 -- 172.21.15.119:0/1188861035 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24c058070 con 0x55dc25c2f5a0 2024-04-23T18:31:19.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.187+0000 7fa13cff9640 1 -- 172.21.15.119:0/1188861035 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24c027530 con 0x55dc25c2f5a0 2024-04-23T18:31:19.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.187+0000 7fa25dc13800 1 -- 172.21.15.119:0/1188861035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c2f5a0 msgr2=0x55dc25c2f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.187+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1188861035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c2f5a0 0x55dc25c2f9c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa24c040fd0 tx=0x7fa24c04cc50 comp rx=0 tx=0).stop 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.187+0000 7fa25dc13800 1 -- 172.21.15.119:0/1188861035 shutdown_connections 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.187+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1188861035 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c2f5a0 0x55dc25c2f9c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.187+0000 7fa25dc13800 1 -- 172.21.15.119:0/1188861035 >> 172.21.15.119:0/1188861035 conn(0x55dc25c2b900 msgr2=0x55dc25c29960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.187+0000 7fa25dc13800 1 -- 172.21.15.119:0/1188861035 shutdown_connections 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.187+0000 7fa25dc13800 1 -- 172.21.15.119:0/1188861035 wait complete. 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.187+0000 7fa25dc13800 1 Processor -- start 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.187+0000 7fa25dc13800 1 -- start start 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.187+0000 7fa25dc13800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c2f5a0 0x55dc25b0b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.187+0000 7fa25dc13800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dc25c30640 con 0x55dc25c2f5a0 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.188+0000 7fa2591dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c2f5a0 0x55dc25b0b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.188+0000 7fa2591dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c2f5a0 0x55dc25b0b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55174/0 (socket says 172.21.15.119:55174) 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.188+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 learned_addr learned my addr 172.21.15.119:0/1279573358 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.188+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc25b09ac0 con 0x55dc25c2f5a0 2024-04-23T18:31:19.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.188+0000 7fa2591dc640 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c2f5a0 0x55dc25b0b3d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa24c027db0 tx=0x7fa24c03fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.188+0000 7fa12effd640 1 -- 172.21.15.119:0/1279573358 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24c06d070 con 0x55dc25c2f5a0 2024-04-23T18:31:19.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.188+0000 7fa12effd640 1 -- 172.21.15.119:0/1279573358 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24c04e070 con 0x55dc25c2f5a0 2024-04-23T18:31:19.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.188+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc25b09ac0 con 0x55dc25c2f5a0 2024-04-23T18:31:19.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.188+0000 7fa12effd640 1 -- 172.21.15.119:0/1279573358 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24c03f730 con 0x55dc25c2f5a0 2024-04-23T18:31:19.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.188+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc25b09ac0 con 0x55dc25c2f5a0 2024-04-23T18:31:19.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.189+0000 7fa12effd640 1 -- 172.21.15.119:0/1279573358 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa24c070070 con 0x55dc25c2f5a0 2024-04-23T18:31:19.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.189+0000 7fa12effd640 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa124036e60 0x7fa124039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.189+0000 7fa12effd640 1 -- 172.21.15.119:0/1279573358 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fa24c069d80 con 0x55dc25c2f5a0 2024-04-23T18:31:19.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.189+0000 7fa2589db640 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa124036e60 0x7fa124039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa2589db640 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa124036e60 0x7fa124039320 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa250055040 tx=0x7fa25004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa25dc13800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55dc25c44320 0x55dc25c467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c46f30 con 0x55dc25c44320 2024-04-23T18:31:19.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa2599dd640 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55dc25c44320 0x55dc25c467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa2599dd640 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55dc25c44320 0x55dc25c467e0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2540083e0 con 0x55dc25c44320 2024-04-23T18:31:19.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa25dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa25dc13800 20 realm 2024-04-23T18:31:19.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa25dc13800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47340 con 0x55dc25c44320 2024-04-23T18:31:19.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2540083e0 con 0x55dc25c44320 2024-04-23T18:31:19.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa25dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa25dc13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:19.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa25dc13800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.190+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c44320 2024-04-23T18:31:19.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.191+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2540083e0 con 0x55dc25c44320 2024-04-23T18:31:19.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.191+0000 7fa25dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.191+0000 7fa25dc13800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.191+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47fb0 con 0x55dc25c44320 2024-04-23T18:31:19.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.191+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2540083e0 con 0x55dc25c44320 2024-04-23T18:31:19.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.191+0000 7fa25dc13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.191+0000 7fa25dc13800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.191+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55dc25c48970 0x55dc25c4ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.191+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c4b3b0 con 0x55dc25c48970 2024-04-23T18:31:19.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.191+0000 7fa2591dc640 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55dc25c48970 0x55dc25c4ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.191+0000 7fa2591dc640 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55dc25c48970 0x55dc25c4ad60 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.192+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.192+0000 7fa25dc13800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:19.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.192+0000 7fa25dc13800 20 searching for the correct realm 2024-04-23T18:31:19.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.192+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55dc25c4d340 0x55dc25c4f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.192+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c4fed0 con 0x55dc25c4d340 2024-04-23T18:31:19.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.192+0000 7fa2589db640 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55dc25c4d340 0x55dc25c4f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.192+0000 7fa2589db640 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55dc25c4d340 0x55dc25c4f800 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.192+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.192+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c4fed0 con 0x55dc25c48970 2024-04-23T18:31:19.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.193+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.193+0000 7fa2591dc640 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa24c072060 0x7fa24c038840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.193+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c4fed0 con 0x7fa24c072060 2024-04-23T18:31:19.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.193+0000 7fa2599dd640 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa24c072060 0x7fa24c038840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.193+0000 7fa2599dd640 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa24c072060 0x7fa24c038840 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.194+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540083e0 con 0x7fa24c072060 2024-04-23T18:31:19.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.194+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c44320 2024-04-23T18:31:19.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.194+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540083e0 con 0x55dc25c44320 2024-04-23T18:31:19.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.194+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c44320 2024-04-23T18:31:19.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.194+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa254026040 con 0x55dc25c44320 2024-04-23T18:31:19.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.194+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x7fa24c072060 2024-04-23T18:31:19.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.194+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa254026040 con 0x7fa24c072060 2024-04-23T18:31:19.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.194+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x7fa24c072060 2024-04-23T18:31:19.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.194+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa254026040 con 0x7fa24c072060 2024-04-23T18:31:19.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.194+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c48970 2024-04-23T18:31:19.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.195+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.195+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c4d340 2024-04-23T18:31:19.234 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.195+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.195+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c44320 2024-04-23T18:31:19.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.195+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa254026040 con 0x55dc25c44320 2024-04-23T18:31:19.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.195+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x7fa24c072060 2024-04-23T18:31:19.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.196+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa254026040 con 0x7fa24c072060 2024-04-23T18:31:19.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.196+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c44320 2024-04-23T18:31:19.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.196+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa254026040 con 0x55dc25c44320 2024-04-23T18:31:19.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.196+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c48970 2024-04-23T18:31:19.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.196+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.196+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c4d340 2024-04-23T18:31:19.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.196+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.196+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c4d340 2024-04-23T18:31:19.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.197+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.235 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.197+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x7fa24c072060 2024-04-23T18:31:19.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.197+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa254026040 con 0x7fa24c072060 2024-04-23T18:31:19.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.197+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c4d340 2024-04-23T18:31:19.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.197+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.197+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c4d340 2024-04-23T18:31:19.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.197+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.197+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c44320 2024-04-23T18:31:19.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.197+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa254026040 con 0x55dc25c44320 2024-04-23T18:31:19.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.197+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c44320 2024-04-23T18:31:19.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.198+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa254026040 con 0x55dc25c44320 2024-04-23T18:31:19.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.198+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x7fa24c072060 2024-04-23T18:31:19.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.198+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa254026040 con 0x7fa24c072060 2024-04-23T18:31:19.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.198+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c4d340 2024-04-23T18:31:19.236 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.198+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.198+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c48970 2024-04-23T18:31:19.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.198+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.198+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c44320 2024-04-23T18:31:19.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.199+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa254026040 con 0x55dc25c44320 2024-04-23T18:31:19.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.199+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c48970 2024-04-23T18:31:19.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.199+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.199+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c4d340 2024-04-23T18:31:19.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.199+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.199+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x7fa24c072060 2024-04-23T18:31:19.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.200+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa254026040 con 0x7fa24c072060 2024-04-23T18:31:19.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.200+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c48970 2024-04-23T18:31:19.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.200+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.237 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.200+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c4d340 2024-04-23T18:31:19.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.200+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.200+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x7fa24c072060 2024-04-23T18:31:19.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.200+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa254026040 con 0x7fa24c072060 2024-04-23T18:31:19.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.200+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c44320 2024-04-23T18:31:19.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa254026040 con 0x55dc25c44320 2024-04-23T18:31:19.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c47c10 con 0x55dc25c48970 2024-04-23T18:31:19.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:19.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:19.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:19.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:19.238 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c4b750 con 0x55dc25c44320 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa254026040 con 0x55dc25c44320 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c4bb40 con 0x55dc25c44320 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa254026040 con 0x55dc25c44320 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.201+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c4bb40 con 0x7fa24c072060 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa254036040 con 0x7fa24c072060 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:19.239 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 20 zone default found 2024-04-23T18:31:19.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 4 Realm: () 2024-04-23T18:31:19.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:19.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:19.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:19.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 20 zonegroup default 2024-04-23T18:31:19.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c4c820 con 0x55dc25c48970 2024-04-23T18:31:19.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c51d60 con 0x55dc25c4d340 2024-04-23T18:31:19.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.240 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.202+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c521f0 con 0x55dc25c4d340 2024-04-23T18:31:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.203+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.203+0000 7fa25dc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.203+0000 7fa25dc13800 20 started sync module instance, tier type = 2024-04-23T18:31:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.203+0000 7fa25dc13800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.203+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c511d0 con 0x55dc25c48970 2024-04-23T18:31:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.204+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.204+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94404014839536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c511d0 con 0x55dc25c48970 2024-04-23T18:31:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.204+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c52ce0 con 0x55dc25c44320 2024-04-23T18:31:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.205+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94404014839536] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.205+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x55dc25c44320 2024-04-23T18:31:19.241 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.205+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94404014843888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c511d0 con 0x55dc25c44320 2024-04-23T18:31:19.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.205+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c537b0 con 0x55dc25c4d340 2024-04-23T18:31:19.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.206+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94404014843888] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x55dc25c44320 2024-04-23T18:31:19.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.207+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.207+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94404014837024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c51140 con 0x55dc25c4d340 2024-04-23T18:31:19.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.207+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c546a0 con 0x55dc25c48970 2024-04-23T18:31:19.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.207+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94404014837024] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.208+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.208+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94404014850544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c54610 con 0x55dc25c48970 2024-04-23T18:31:19.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.208+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c55560 con 0x55dc25c44320 2024-04-23T18:31:19.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.209+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x55dc25c44320 2024-04-23T18:31:19.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.209+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94404014854320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c554d0 con 0x55dc25c44320 2024-04-23T18:31:19.242 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.209+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c56480 con 0x7fa24c072060 2024-04-23T18:31:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.209+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94404014850544] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.210+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x7fa24c072060 2024-04-23T18:31:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.210+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94404014852752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c56450 con 0x7fa24c072060 2024-04-23T18:31:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.210+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c56e90 con 0x7fa24c072060 2024-04-23T18:31:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.210+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94404014854320] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x55dc25c44320 2024-04-23T18:31:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.211+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(56 notify.6 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x7fa24c072060 2024-04-23T18:31:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.211+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94404014856528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c56e90 con 0x7fa24c072060 2024-04-23T18:31:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.211+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c57850 con 0x7fa24c072060 2024-04-23T18:31:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.211+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94404014852752] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x7fa24c072060 2024-04-23T18:31:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.212+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(58 notify.7 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x7fa24c072060 2024-04-23T18:31:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.212+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94404014856528] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x7fa24c072060 2024-04-23T18:31:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.212+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94404014858144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c573a0 con 0x7fa24c072060 2024-04-23T18:31:19.243 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.212+0000 7fa25dc13800 20 add_watcher() i=0 2024-04-23T18:31:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.212+0000 7fa25dc13800 20 add_watcher() i=1 2024-04-23T18:31:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.212+0000 7fa25dc13800 20 add_watcher() i=2 2024-04-23T18:31:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.212+0000 7fa25dc13800 20 add_watcher() i=3 2024-04-23T18:31:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.212+0000 7fa25dc13800 20 add_watcher() i=4 2024-04-23T18:31:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.212+0000 7fa25dc13800 20 add_watcher() i=5 2024-04-23T18:31:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.212+0000 7fa25dc13800 20 add_watcher() i=6 2024-04-23T18:31:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.213+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94404014858144] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x7fa24c072060 2024-04-23T18:31:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.213+0000 7fa25dc13800 20 add_watcher() i=7 2024-04-23T18:31:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.213+0000 7fa25dc13800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.213+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c5a880 con 0x55dc25c44320 2024-04-23T18:31:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.213+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa254036040 con 0x55dc25c44320 2024-04-23T18:31:19.244 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.213+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94404014863264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c57d50 con 0x55dc25c44320 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.214+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94404014863264] v34'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa254036040 con 0x55dc25c44320 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.214+0000 7fa10f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.214+0000 7fa25dc13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.214+0000 7fa25dc13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.214+0000 7fa25dc13800 5 note: GC not initialized 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.214+0000 7fa10e7e4640 20 reqs_thread_entry: start 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.215+0000 7fa25dc13800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.215+0000 7fa25dc13800 20 Filter name: none 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.215+0000 7fa07ffff640 20 reqs_thread_entry: start 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.215+0000 7fa25dc13800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.215+0000 7fa25dc13800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.215+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c8deb0 con 0x7fa24c072060 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.216+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fa254036040 con 0x7fa24c072060 2024-04-23T18:31:19.245 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.216+0000 7fa25dc13800 20 rados_obj.operate() r=0 bl.length=460 2024-04-23T18:31:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.216+0000 7fa25dc13800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-23T18:31:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.216+0000 7fa25dc13800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.216+0000 7fa25dc13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.216+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c944c0 con 0x7fa24c072060 2024-04-23T18:31:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.218+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa254036040 con 0x7fa24c072060 2024-04-23T18:31:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.218+0000 7fa25dc13800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.218+0000 7fa25dc13800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.218+0000 7fa25dc13800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-23T18:31:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.218+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94404015111984 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c8fbd0 con 0x55dc25c44320 2024-04-23T18:31:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.218+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== watch-notify(notify (1) cookie 94404014854320 notify 146028888100 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fa254010040 con 0x55dc25c44320 2024-04-23T18:31:19.246 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.218+0000 7fa13cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888100 cookie 94404014854320 notifier 4868 bl.length()=666 2024-04-23T18:31:19.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.218+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 notify.4 [notify cookie 94404015111984 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa254036040 con 0x55dc25c44320 2024-04-23T18:31:19.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.218+0000 7fa13cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:19.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.218+0000 7fa13cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.218+0000 7fa13cff9640 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa11c003ea0 con 0x55dc25c44320 2024-04-23T18:31:19.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.218+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x55dc25c44320 2024-04-23T18:31:19.247 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.218+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== watch-notify(notify_complete (2) cookie 94404015111984 notify 146028888100 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa25402c780 con 0x55dc25c44320 2024-04-23T18:31:19.247 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-23T18:31:18.209839Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:31:18.209827Z","tags":[],"group_ids":[]} 2024-04-23T18:31:19.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.219+0000 7fa10f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.219+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94404014863264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c8c4b0 con 0x55dc25c44320 2024-04-23T18:31:19.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.220+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94404014863264] v34'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa254036040 con 0x55dc25c44320 2024-04-23T18:31:19.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.220+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94404014839536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c573a0 con 0x55dc25c48970 2024-04-23T18:31:19.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.221+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94404014839536] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.253 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.221+0000 7fa25dc13800 20 remove_watcher() i=0 2024-04-23T18:31:19.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.221+0000 7fa25dc13800 2 removed watcher, disabling cache 2024-04-23T18:31:19.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.221+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94404014843888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c516f0 con 0x55dc25c44320 2024-04-23T18:31:19.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.222+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94404014843888] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x55dc25c44320 2024-04-23T18:31:19.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.222+0000 7fa25dc13800 20 remove_watcher() i=1 2024-04-23T18:31:19.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.222+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94404014837024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c516f0 con 0x55dc25c4d340 2024-04-23T18:31:19.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.223+0000 7fa2589db640 1 -- 172.21.15.119:0/1279573358 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94404014837024] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa25007f070 con 0x55dc25c4d340 2024-04-23T18:31:19.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.223+0000 7fa25dc13800 20 remove_watcher() i=2 2024-04-23T18:31:19.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.223+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94404014850544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c50d20 con 0x55dc25c48970 2024-04-23T18:31:19.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.224+0000 7fa2591dc640 1 -- 172.21.15.119:0/1279573358 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94404014850544] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa24c06f030 con 0x55dc25c48970 2024-04-23T18:31:19.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.224+0000 7fa25dc13800 20 remove_watcher() i=3 2024-04-23T18:31:19.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.224+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94404014854320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c541f0 con 0x55dc25c44320 2024-04-23T18:31:19.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.225+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94404014854320] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x55dc25c44320 2024-04-23T18:31:19.254 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.225+0000 7fa25dc13800 20 remove_watcher() i=4 2024-04-23T18:31:19.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.225+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94404014852752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c50d20 con 0x7fa24c072060 2024-04-23T18:31:19.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.227+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94404014852752] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x7fa24c072060 2024-04-23T18:31:19.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.227+0000 7fa25dc13800 20 remove_watcher() i=5 2024-04-23T18:31:19.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.227+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94404014856528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c550b0 con 0x7fa24c072060 2024-04-23T18:31:19.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.228+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94404014856528] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x7fa24c072060 2024-04-23T18:31:19.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.228+0000 7fa25dc13800 20 remove_watcher() i=6 2024-04-23T18:31:19.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.228+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94404014858144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dc25c541f0 con 0x7fa24c072060 2024-04-23T18:31:19.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94404014858144] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa254036040 con 0x7fa24c072060 2024-04-23T18:31:19.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 20 remove_watcher() i=7 2024-04-23T18:31:19.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa24c072060 msgr2=0x7fa24c038840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa24c072060 0x7fa24c038840 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.255 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55dc25c44320 msgr2=0x55dc25c467e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55dc25c44320 0x55dc25c467e0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55dc25c48970 msgr2=0x55dc25c4ad60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55dc25c48970 0x55dc25c4ad60 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55dc25c4d340 msgr2=0x55dc25c4f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55dc25c4d340 0x55dc25c4f800 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa124036e60 msgr2=0x7fa124039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa124036e60 0x7fa124039320 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa250055040 tx=0x7fa25004f000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c2f5a0 msgr2=0x55dc25b0b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1279573358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c2f5a0 0x55dc25b0b3d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa24c027db0 tx=0x7fa24c03fee0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 reap_dead start 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa2599dd640 1 -- 172.21.15.119:0/1279573358 reap_dead start 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 shutdown_connections 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 >> 172.21.15.119:0/1279573358 conn(0x55dc25c2b900 msgr2=0x55dc25c28f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.256 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 shutdown_connections 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 -- 172.21.15.119:0/1279573358 wait complete. 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 -- 172.21.15.119:0/1550015080 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa130036e60 msgr2=0x7fa130039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1550015080 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa130036e60 0x7fa130039320 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55dc25c0b640 tx=0x7fa250005ac0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 -- 172.21.15.119:0/1550015080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c22420 msgr2=0x55dc25c22840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.229+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1550015080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c22420 0x55dc25c22840 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa24c04b110 tx=0x7fa24c01e7f0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 -- 172.21.15.119:0/1550015080 shutdown_connections 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1550015080 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa130036e60 0x7fa130039320 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1550015080 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25c22420 0x55dc25c22840 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 -- 172.21.15.119:0/1550015080 >> 172.21.15.119:0/1550015080 conn(0x55dc25c164c0 msgr2=0x55dc25c168c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 -- 172.21.15.119:0/1550015080 shutdown_connections 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 -- 172.21.15.119:0/1550015080 wait complete. 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55dc25c113e0 msgr2=0x55dc25c13830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55dc25c113e0 0x55dc25c13830 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55dc25b0f5a0 msgr2=0x55dc25c0abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.257 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55dc25b0f5a0 0x55dc25c0abc0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55dc25c0d4a0 msgr2=0x55dc25c0f890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55dc25c0d4a0 0x55dc25c0f890 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa140036e60 msgr2=0x7fa140039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fa140036e60 0x7fa140039320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa250054000 tx=0x7fa25004e000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0ba90 msgr2=0x55dc25c03ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 --2- 172.21.15.119:0/1047449964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dc25b0ba90 0x55dc25c03ba0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00f000 tx=0x7fa24c000f40 comp rx=0 tx=0).stop 2024-04-23T18:31:19.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa2599dd640 1 -- 172.21.15.119:0/1047449964 reap_dead start 2024-04-23T18:31:19.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 shutdown_connections 2024-04-23T18:31:19.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 >> 172.21.15.119:0/1047449964 conn(0x55dc25b05440 msgr2=0x55dc25bf6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 shutdown_connections 2024-04-23T18:31:19.258 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.230+0000 7fa25dc13800 1 -- 172.21.15.119:0/1047449964 wait complete. 2024-04-23T18:31:19.259 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:19.259 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:19.259 ERROR:root:0 2024-04-23T18:31:19.259 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:19.263 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:19.263 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-23T18:31:19.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-23T18:31:19.264 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-04-23T18:31:19.310 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:19.310 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:19.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.317+0000 7f20a8416800 1 Processor -- start 2024-04-23T18:31:19.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.317+0000 7f20a8416800 1 -- start start 2024-04-23T18:31:19.311 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.318+0000 7f20a8416800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b4cdab28d0 0x55b4cdab2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.318+0000 7f20a8416800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b4cd964560 con 0x55b4cdab3230 2024-04-23T18:31:19.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.318+0000 7f20a8416800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55b4cd955e20 con 0x55b4cdab28d0 2024-04-23T18:31:19.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.318+0000 7f20a3a84640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b4cdab28d0 0x55b4cdab2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.318+0000 7f20a3283640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55b4cdab3230 0x55b4cdab36e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50622/0 (socket says 172.21.15.119:50622) 2024-04-23T18:31:19.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.318+0000 7f20a3283640 1 -- 172.21.15.119:0/3101396784 learned_addr learned my addr 172.21.15.119:0/3101396784 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:31:19.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.318+0000 7f20a3a84640 1 -- 172.21.15.119:0/3101396784 >> v1:172.21.15.62:6789/0 conn(0x55b4cdab3230 legacy=0x55b4cdab36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.312 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.318+0000 7f20a3a84640 1 -- 172.21.15.119:0/3101396784 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4cd963e60 con 0x55b4cdab28d0 2024-04-23T18:31:19.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.320+0000 7f20a3a84640 1 --2- 172.21.15.119:0/3101396784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdab2cf0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f209400a470 tx=0x7f209401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19f0e68fc5e538 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.313 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.320+0000 7f20a2a82640 1 -- 172.21.15.119:0/3101396784 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2094057070 con 0x55b4cdab28d0 2024-04-23T18:31:19.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.320+0000 7f20a2a82640 1 -- 172.21.15.119:0/3101396784 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209404adc0 con 0x55b4cdab28d0 2024-04-23T18:31:19.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.320+0000 7f20a2a82640 1 -- 172.21.15.119:0/3101396784 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2094052590 con 0x55b4cdab28d0 2024-04-23T18:31:19.314 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.321+0000 7f20a8416800 1 -- 172.21.15.119:0/3101396784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 msgr2=0x55b4cdab2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.321+0000 7f20a8416800 1 --2- 172.21.15.119:0/3101396784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdab2cf0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f209400a470 tx=0x7f209401ce90 comp rx=0 tx=0).stop 2024-04-23T18:31:19.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.321+0000 7f20a8416800 1 -- 172.21.15.119:0/3101396784 shutdown_connections 2024-04-23T18:31:19.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.321+0000 7f20a8416800 1 --2- 172.21.15.119:0/3101396784 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdab2cf0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.321+0000 7f20a8416800 1 -- 172.21.15.119:0/3101396784 >> 172.21.15.119:0/3101396784 conn(0x55b4cdaae430 msgr2=0x55b4cdab0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.321+0000 7f20a8416800 1 -- 172.21.15.119:0/3101396784 shutdown_connections 2024-04-23T18:31:19.315 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.321+0000 7f20a8416800 1 -- 172.21.15.119:0/3101396784 wait complete. 2024-04-23T18:31:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.332+0000 7f20a8416800 1 Processor -- start 2024-04-23T18:31:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.332+0000 7f20a8416800 1 -- start start 2024-04-23T18:31:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.332+0000 7f20a8416800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdba7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.332+0000 7f20a8416800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b4cd9ff5d0 con 0x55b4cdab28d0 2024-04-23T18:31:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.333+0000 7f20a3a84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdba7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.333+0000 7f20a3a84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdba7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55192/0 (socket says 172.21.15.119:55192) 2024-04-23T18:31:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.333+0000 7f20a3a84640 1 -- 172.21.15.119:0/4069223904 learned_addr learned my addr 172.21.15.119:0/4069223904 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.333+0000 7f20a3a84640 1 -- 172.21.15.119:0/4069223904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4cd975860 con 0x55b4cdab28d0 2024-04-23T18:31:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.333+0000 7f20a3a84640 1 --2- 172.21.15.119:0/4069223904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdba7540 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2094055040 tx=0x7f209404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb14abea28330a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.327 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.333+0000 7f1f91e0b640 1 -- 172.21.15.119:0/4069223904 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2094057040 con 0x55b4cdab28d0 2024-04-23T18:31:19.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.333+0000 7f1f91e0b640 1 -- 172.21.15.119:0/4069223904 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2094062070 con 0x55b4cdab28d0 2024-04-23T18:31:19.328 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.333+0000 7f1f91e0b640 1 -- 172.21.15.119:0/4069223904 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209405d470 con 0x55b4cdab28d0 2024-04-23T18:31:19.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.334+0000 7f20a8416800 1 -- 172.21.15.119:0/4069223904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 msgr2=0x55b4cdba7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.334+0000 7f20a8416800 1 --2- 172.21.15.119:0/4069223904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdba7540 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2094055040 tx=0x7f209404c000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.334+0000 7f20a8416800 1 -- 172.21.15.119:0/4069223904 shutdown_connections 2024-04-23T18:31:19.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.334+0000 7f20a8416800 1 --2- 172.21.15.119:0/4069223904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdba7540 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.334+0000 7f20a8416800 1 -- 172.21.15.119:0/4069223904 >> 172.21.15.119:0/4069223904 conn(0x55b4cdaae430 msgr2=0x55b4cdba2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.334+0000 7f20a8416800 1 -- 172.21.15.119:0/4069223904 shutdown_connections 2024-04-23T18:31:19.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.334+0000 7f20a8416800 1 -- 172.21.15.119:0/4069223904 wait complete. 2024-04-23T18:31:19.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.334+0000 7f20a8416800 1 Processor -- start 2024-04-23T18:31:19.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.334+0000 7f20a8416800 1 -- start start 2024-04-23T18:31:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.335+0000 7f20a8416800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdbaed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.335+0000 7f20a8416800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b4cdab4030 con 0x55b4cdab28d0 2024-04-23T18:31:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.335+0000 7f20a3a84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdbaed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.335+0000 7f20a3a84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdbaed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55204/0 (socket says 172.21.15.119:55204) 2024-04-23T18:31:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.335+0000 7f20a3a84640 1 -- 172.21.15.119:0/44685659 learned_addr learned my addr 172.21.15.119:0/44685659 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.335+0000 7f20a3a84640 1 -- 172.21.15.119:0/44685659 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4cd973eb0 con 0x55b4cdab28d0 2024-04-23T18:31:19.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.335+0000 7f20a3a84640 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdbaed60 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f209405f040 tx=0x7f2094002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.335+0000 7f1f8bfff640 1 -- 172.21.15.119:0/44685659 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209406b070 con 0x55b4cdab28d0 2024-04-23T18:31:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.335+0000 7f1f8bfff640 1 -- 172.21.15.119:0/44685659 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209405d9a0 con 0x55b4cdab28d0 2024-04-23T18:31:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.335+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4cdbaf2a0 con 0x55b4cdab28d0 2024-04-23T18:31:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.335+0000 7f1f8bfff640 1 -- 172.21.15.119:0/44685659 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2094057070 con 0x55b4cdab28d0 2024-04-23T18:31:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.335+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4cdbaf7c0 con 0x55b4cdab28d0 2024-04-23T18:31:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.336+0000 7f1f8bfff640 1 -- 172.21.15.119:0/44685659 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f209405dca0 con 0x55b4cdab28d0 2024-04-23T18:31:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.336+0000 7f1f8bfff640 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f8c036e60 0x7f1f8c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.336+0000 7f1f8bfff640 1 -- 172.21.15.119:0/44685659 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f209408e9d0 con 0x55b4cdab28d0 2024-04-23T18:31:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.336+0000 7f20a3283640 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f8c036e60 0x7f1f8c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.337+0000 7f20a8416800 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b4cdab3230 0x55b4cdbb5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.337+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbb6310 con 0x55b4cdab3230 2024-04-23T18:31:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.337+0000 7f20a4285640 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b4cdab3230 0x55b4cdbb5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.337+0000 7f20a3283640 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f8c036e60 0x7f1f8c039320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2098001d90 tx=0x7f20980012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.337+0000 7f20a4285640 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b4cdab3230 0x55b4cdbb5dd0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.338 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.337+0000 7f20a4285640 1 -- 172.21.15.119:0/44685659 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdab3230 2024-04-23T18:31:19.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.337+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbb6bd0 con 0x55b4cdab3230 2024-04-23T18:31:19.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.337+0000 7f20a4285640 1 -- 172.21.15.119:0/44685659 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdab3230 2024-04-23T18:31:19.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.337+0000 7f20a8416800 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b4cdbb84e0 0x55b4cdbba970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.337+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbbb100 con 0x55b4cdbb84e0 2024-04-23T18:31:19.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.338+0000 7f20a3a84640 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b4cdbb84e0 0x55b4cdbba970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.339 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.338+0000 7f20a3a84640 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b4cdbb84e0 0x55b4cdbba970 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.338+0000 7f20a3a84640 1 -- 172.21.15.119:0/44685659 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f209405a040 con 0x55b4cdbb84e0 2024-04-23T18:31:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.338+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbb7450 con 0x55b4cdab3230 2024-04-23T18:31:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.338+0000 7f20a4285640 1 -- 172.21.15.119:0/44685659 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdab3230 2024-04-23T18:31:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.338+0000 7f20a8416800 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b4cdbbc5b0 0x55b4cdbbea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.338+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbbf180 con 0x55b4cdbbc5b0 2024-04-23T18:31:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.339+0000 7f20a3283640 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b4cdbbc5b0 0x55b4cdbbea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.339+0000 7f20a3283640 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b4cdbbc5b0 0x55b4cdbbea20 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.340 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.339+0000 7f20a3283640 1 -- 172.21.15.119:0/44685659 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbbc5b0 2024-04-23T18:31:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.340+0000 7f20a8416800 1 Processor -- start 2024-04-23T18:31:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.340+0000 7f20a8416800 1 -- start start 2024-04-23T18:31:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.340+0000 7f20a8416800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbcd570 0x55b4cdbcd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.340+0000 7f20a8416800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b4cd9a5df0 con 0x55b4cdbcd570 2024-04-23T18:31:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.340+0000 7f20a3a84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbcd570 0x55b4cdbcd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.340+0000 7f20a3a84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbcd570 0x55b4cdbcd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55208/0 (socket says 172.21.15.119:55208) 2024-04-23T18:31:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.340+0000 7f20a3a84640 1 -- 172.21.15.119:0/2695052771 learned_addr learned my addr 172.21.15.119:0/2695052771 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.341 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.340+0000 7f20a3a84640 1 -- 172.21.15.119:0/2695052771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4cdbcded0 con 0x55b4cdbcd570 2024-04-23T18:31:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.340+0000 7f20a3a84640 1 --2- 172.21.15.119:0/2695052771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbcd570 0x55b4cdbcd990 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f20940057d0 tx=0x7f20940783a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.340+0000 7f1f897fa640 1 -- 172.21.15.119:0/2695052771 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209406e550 con 0x55b4cdbcd570 2024-04-23T18:31:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.341+0000 7f1f897fa640 1 -- 172.21.15.119:0/2695052771 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2094078730 con 0x55b4cdbcd570 2024-04-23T18:31:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.341+0000 7f20a8416800 1 -- 172.21.15.119:0/2695052771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4cdbce940 con 0x55b4cdbcd570 2024-04-23T18:31:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.341+0000 7f1f897fa640 1 -- 172.21.15.119:0/2695052771 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2094078a10 con 0x55b4cdbcd570 2024-04-23T18:31:19.342 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.341+0000 7f20a8416800 1 -- 172.21.15.119:0/2695052771 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4cdbcee40 con 0x55b4cdbcd570 2024-04-23T18:31:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.341+0000 7f1f897fa640 1 -- 172.21.15.119:0/2695052771 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f2094009ab0 con 0x55b4cdbcd570 2024-04-23T18:31:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.341+0000 7f1f897fa640 1 --2- 172.21.15.119:0/2695052771 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f7c036e60 0x7f1f7c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.341+0000 7f1f897fa640 1 -- 172.21.15.119:0/2695052771 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f2094088030 con 0x55b4cdbcd570 2024-04-23T18:31:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.342+0000 7f20a3283640 1 --2- 172.21.15.119:0/2695052771 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f7c036e60 0x7f1f7c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.342+0000 7f20a8416800 1 Processor -- start 2024-04-23T18:31:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.342+0000 7f20a8416800 1 -- start start 2024-04-23T18:31:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.342+0000 7f20a3283640 1 --2- 172.21.15.119:0/2695052771 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f7c036e60 0x7f1f7c039320 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55b4cdbb32c0 tx=0x7f209800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.342+0000 7f20a8416800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 0x55b4cdbdab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.342+0000 7f20a8416800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b4cdba7c00 con 0x55b4cdbda6e0 2024-04-23T18:31:19.361 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.342+0000 7f20a3a84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 0x55b4cdbdab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.342+0000 7f20a3a84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 0x55b4cdbdab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55224/0 (socket says 172.21.15.119:55224) 2024-04-23T18:31:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.342+0000 7f20a3a84640 1 -- 172.21.15.119:0/3956551793 learned_addr learned my addr 172.21.15.119:0/3956551793 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.342+0000 7f20a3a84640 1 -- 172.21.15.119:0/3956551793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4cdbdb0d0 con 0x55b4cdbda6e0 2024-04-23T18:31:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.343+0000 7f20a3a84640 1 --2- 172.21.15.119:0/3956551793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 0x55b4cdbdab00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f209404b6f0 tx=0x7f2094080740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb371a1c704d82ad server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.343+0000 7f1f82ffd640 1 -- 172.21.15.119:0/3956551793 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20940a6020 con 0x55b4cdbda6e0 2024-04-23T18:31:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.343+0000 7f1f82ffd640 1 -- 172.21.15.119:0/3956551793 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20940529a0 con 0x55b4cdbda6e0 2024-04-23T18:31:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.343+0000 7f1f82ffd640 1 -- 172.21.15.119:0/3956551793 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2094079760 con 0x55b4cdbda6e0 2024-04-23T18:31:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.343+0000 7f20a8416800 1 -- 172.21.15.119:0/3956551793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 msgr2=0x55b4cdbdab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.343+0000 7f20a8416800 1 --2- 172.21.15.119:0/3956551793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 0x55b4cdbdab00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f209404b6f0 tx=0x7f2094080740 comp rx=0 tx=0).stop 2024-04-23T18:31:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.343+0000 7f20a8416800 1 -- 172.21.15.119:0/3956551793 shutdown_connections 2024-04-23T18:31:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.343+0000 7f20a8416800 1 --2- 172.21.15.119:0/3956551793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 0x55b4cdbdab00 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.362 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.343+0000 7f20a8416800 1 -- 172.21.15.119:0/3956551793 >> 172.21.15.119:0/3956551793 conn(0x55b4cdbd6a40 msgr2=0x55b4cdbd4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.343+0000 7f20a8416800 1 -- 172.21.15.119:0/3956551793 shutdown_connections 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.343+0000 7f20a8416800 1 -- 172.21.15.119:0/3956551793 wait complete. 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.343+0000 7f20a8416800 1 Processor -- start 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.343+0000 7f20a8416800 1 -- start start 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.344+0000 7f20a8416800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 0x55b4cdbe1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.344+0000 7f20a8416800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b4cdbdb780 con 0x55b4cdbda6e0 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.344+0000 7f20a3a84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 0x55b4cdbe1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.344+0000 7f20a3a84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 0x55b4cdbe1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55240/0 (socket says 172.21.15.119:55240) 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.344+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 learned_addr learned my addr 172.21.15.119:0/2762219816 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.344+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4cdbe2030 con 0x55b4cdbda6e0 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.344+0000 7f20a3a84640 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 0x55b4cdbe1af0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2094080780 tx=0x7f209406fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.344+0000 7f1f817fa640 1 -- 172.21.15.119:0/2762219816 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20940bb070 con 0x55b4cdbda6e0 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.344+0000 7f1f817fa640 1 -- 172.21.15.119:0/2762219816 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2094079d20 con 0x55b4cdbda6e0 2024-04-23T18:31:19.363 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.344+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4cdbe2030 con 0x55b4cdbda6e0 2024-04-23T18:31:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.344+0000 7f1f817fa640 1 -- 172.21.15.119:0/2762219816 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2094080ae0 con 0x55b4cdbda6e0 2024-04-23T18:31:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.344+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4cdbe2030 con 0x55b4cdbda6e0 2024-04-23T18:31:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.345+0000 7f1f817fa640 1 -- 172.21.15.119:0/2762219816 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f20940be070 con 0x55b4cdbda6e0 2024-04-23T18:31:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.345+0000 7f1f817fa640 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f6c036e60 0x7f1f6c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.345+0000 7f1f817fa640 1 -- 172.21.15.119:0/2762219816 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f20940b1030 con 0x55b4cdbda6e0 2024-04-23T18:31:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.345+0000 7f20a3283640 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f6c036e60 0x7f1f6c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.346+0000 7f20a3283640 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f6c036e60 0x7f1f6c039320 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55b4cdbbf580 tx=0x7f2098010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.346+0000 7f20a8416800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.346+0000 7f20a8416800 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b4cdbed0c0 0x55b4cdbef580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.364 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.346+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbefcd0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.346+0000 7f20a4285640 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b4cdbed0c0 0x55b4cdbef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.346+0000 7f20a4285640 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b4cdbed0c0 0x55b4cdbef580 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.346+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.346+0000 7f20a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.346+0000 7f20a8416800 20 realm 2024-04-23T18:31:19.365 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.346+0000 7f20a8416800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.346+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf00e0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a8416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:19.366 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a8416800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf09b0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a8416800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbed0c0 2024-04-23T18:31:19.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.367 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a8416800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a8416800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a8416800 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b4cdbf1ab0 0x55b4cdbf3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf44b0 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a3a84640 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b4cdbf1ab0 0x55b4cdbf3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.347+0000 7f20a3a84640 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b4cdbf1ab0 0x55b4cdbf3ea0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.368 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.348+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f20940bd030 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.348+0000 7f20a8416800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:19.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.348+0000 7f20a8416800 20 searching for the correct realm 2024-04-23T18:31:19.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.348+0000 7f20a8416800 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b4cdbf6460 0x55b4cdbf8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.348+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf8ff0 con 0x55b4cdbf6460 2024-04-23T18:31:19.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.348+0000 7f20a3283640 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b4cdbf6460 0x55b4cdbf8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.348+0000 7f20a3283640 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b4cdbf6460 0x55b4cdbf8920 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.369 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.348+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.348+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf8ff0 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.349+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20940bd030 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.349+0000 7f20a3a84640 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f20940c0060 0x7f20940923d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.349+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf8ff0 con 0x7f20940c0060 2024-04-23T18:31:19.370 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.349+0000 7f20a4285640 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f20940c0060 0x7f20940923d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.349+0000 7f20a4285640 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f20940c0060 0x7f20940923d0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.350+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c00a4a0 con 0x7f20940c0060 2024-04-23T18:31:19.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.350+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbed0c0 2024-04-23T18:31:19.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.350+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.350+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbed0c0 2024-04-23T18:31:19.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.350+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.371 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.350+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x7f20940c0060 2024-04-23T18:31:19.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.350+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c00a4a0 con 0x7f20940c0060 2024-04-23T18:31:19.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.350+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x7f20940c0060 2024-04-23T18:31:19.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.351+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f209c00a4a0 con 0x7f20940c0060 2024-04-23T18:31:19.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.351+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.351+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20940bd030 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.372 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.351+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf6460 2024-04-23T18:31:19.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.351+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.351+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbed0c0 2024-04-23T18:31:19.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.351+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.351+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x7f20940c0060 2024-04-23T18:31:19.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.352+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c00a4a0 con 0x7f20940c0060 2024-04-23T18:31:19.373 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.352+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbed0c0 2024-04-23T18:31:19.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.352+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.352+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.352+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f20940bd030 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.352+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf6460 2024-04-23T18:31:19.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.352+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.374 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.352+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf6460 2024-04-23T18:31:19.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.352+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.352+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x7f20940c0060 2024-04-23T18:31:19.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.353+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c00a4a0 con 0x7f20940c0060 2024-04-23T18:31:19.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.353+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf6460 2024-04-23T18:31:19.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.353+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.375 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.353+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf6460 2024-04-23T18:31:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.353+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.353+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbed0c0 2024-04-23T18:31:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.354+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.354+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbed0c0 2024-04-23T18:31:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.354+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.376 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.354+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x7f20940c0060 2024-04-23T18:31:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.354+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c00a4a0 con 0x7f20940c0060 2024-04-23T18:31:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.354+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf6460 2024-04-23T18:31:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.355+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.355+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.355+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f20940bd030 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.377 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.355+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbed0c0 2024-04-23T18:31:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.355+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c00a4a0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.355+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.355+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20940bd030 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.355+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf6460 2024-04-23T18:31:19.378 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.355+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.355+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x7f20940c0060 2024-04-23T18:31:19.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.356+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c00a4a0 con 0x7f20940c0060 2024-04-23T18:31:19.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.356+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.356+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20940d4040 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.356+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf6460 2024-04-23T18:31:19.379 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.356+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.356+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x7f20940c0060 2024-04-23T18:31:19.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c00a4a0 con 0x7f20940c0060 2024-04-23T18:31:19.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbed0c0 2024-04-23T18:31:19.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf0d50 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20940d4040 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.380 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a8416800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:19.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a8416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:19.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a8416800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:19.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a8416800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:19.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a8416800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:19.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a8416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:19.381 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a8416800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf4d70 con 0x55b4cdbed0c0 2024-04-23T18:31:19.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a8416800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.382 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.357+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf5160 con 0x55b4cdbed0c0 2024-04-23T18:31:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf5160 con 0x7f20940c0060 2024-04-23T18:31:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f209c040080 con 0x7f20940c0060 2024-04-23T18:31:19.383 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 20 zone default found 2024-04-23T18:31:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 4 Realm: () 2024-04-23T18:31:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 20 zonegroup default 2024-04-23T18:31:19.384 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbf9470 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f20940d4040 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.358+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfb1f0 con 0x55b4cdbf6460 2024-04-23T18:31:19.385 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.359+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.359+0000 7f20a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.359+0000 7f20a8416800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.359+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfb590 con 0x55b4cdbf6460 2024-04-23T18:31:19.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.359+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.359+0000 7f20a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.386 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.359+0000 7f20a8416800 20 started sync module instance, tier type = 2024-04-23T18:31:19.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.359+0000 7f20a8416800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:19.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.359+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfa690 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.360+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20940d4040 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.360+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94235034364592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfbde0 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.360+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfc630 con 0x55b4cdbed0c0 2024-04-23T18:31:19.387 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.361+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94235034364592] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20940d4040 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.361+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.361+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94235034368304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfc670 con 0x55b4cdbed0c0 2024-04-23T18:31:19.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.361+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfd160 con 0x55b4cdbf6460 2024-04-23T18:31:19.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.362+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.362+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94235034373168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfda00 con 0x55b4cdbf6460 2024-04-23T18:31:19.388 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.362+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfe4e0 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.363+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94235034368304] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.363+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94235034373168] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.364+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20940d4040 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.364+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94235034375504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfc180 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.364+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfeef0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.389 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.365+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.365+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94235034380864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbff310 con 0x55b4cdbed0c0 2024-04-23T18:31:19.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.365+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbffd30 con 0x7f20940c0060 2024-04-23T18:31:19.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.365+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94235034375504] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20940d4040 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.365+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94235034380864] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.366+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x7f20940c0060 2024-04-23T18:31:19.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.366+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94235034384416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfee60 con 0x7f20940c0060 2024-04-23T18:31:19.390 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.366+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdc005d0 con 0x7f20940c0060 2024-04-23T18:31:19.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.367+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94235034384416] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x7f20940c0060 2024-04-23T18:31:19.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.367+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x7f20940c0060 2024-04-23T18:31:19.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.367+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94235034378224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfee60 con 0x7f20940c0060 2024-04-23T18:31:19.391 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.367+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdc00bf0 con 0x7f20940c0060 2024-04-23T18:31:19.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.368+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(58 notify.7 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x7f20940c0060 2024-04-23T18:31:19.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.368+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94235034378224] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x7f20940c0060 2024-04-23T18:31:19.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.368+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94235034388288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdc01010 con 0x7f20940c0060 2024-04-23T18:31:19.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.368+0000 7f20a8416800 20 add_watcher() i=0 2024-04-23T18:31:19.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.368+0000 7f20a8416800 20 add_watcher() i=1 2024-04-23T18:31:19.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.368+0000 7f20a8416800 20 add_watcher() i=2 2024-04-23T18:31:19.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.368+0000 7f20a8416800 20 add_watcher() i=3 2024-04-23T18:31:19.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.368+0000 7f20a8416800 20 add_watcher() i=4 2024-04-23T18:31:19.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.368+0000 7f20a8416800 20 add_watcher() i=5 2024-04-23T18:31:19.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.368+0000 7f20a8416800 20 add_watcher() i=6 2024-04-23T18:31:19.396 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.369+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94235034388288] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x7f20940c0060 2024-04-23T18:31:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.369+0000 7f20a8416800 20 add_watcher() i=7 2024-04-23T18:31:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.369+0000 7f20a8416800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.369+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdc01010 con 0x55b4cdbed0c0 2024-04-23T18:31:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.369+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.369+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94235034389344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdc018e0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.370+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94235034389344] v34'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.370+0000 7f1f59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.370+0000 7f20a8416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.370+0000 7f20a8416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.370+0000 7f20a8416800 5 note: GC not initialized 2024-04-23T18:31:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.370+0000 7f1f58fe1640 20 reqs_thread_entry: start 2024-04-23T18:31:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.371+0000 7f20a8416800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:19.397 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.371+0000 7f20a8416800 20 Filter name: none 2024-04-23T18:31:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.371+0000 7f1ed27fc640 20 reqs_thread_entry: start 2024-04-23T18:31:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.371+0000 7f20a8416800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-23T18:31:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.371+0000 7f20a8416800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.371+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdc376f0 con 0x7f20940c0060 2024-04-23T18:31:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.372+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f209c040080 con 0x7f20940c0060 2024-04-23T18:31:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.372+0000 7f20a8416800 20 rados_obj.operate() r=0 bl.length=490 2024-04-23T18:31:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.372+0000 7f20a8416800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-23T18:31:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.372+0000 7f20a8416800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.372+0000 7f20a8416800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.372+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdc3e090 con 0x7f20940c0060 2024-04-23T18:31:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.373+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f209c040080 con 0x7f20940c0060 2024-04-23T18:31:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.373+0000 7f20a8416800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:19.398 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.373+0000 7f20a8416800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.373+0000 7f20a8416800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-23T18:31:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.373+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94235034639104 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdc39720 con 0x55b4cdbed0c0 2024-04-23T18:31:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.374+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== watch-notify(notify (1) cookie 94235034380864 notify 146028888101 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f209c0455c0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.374+0000 7f1f82ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 94235034380864 notifier 4875 bl.length()=666 2024-04-23T18:31:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.374+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 notify.4 [notify cookie 94235034639104 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.374+0000 7f1f82ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.374+0000 7f1f82ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.374+0000 7f1f82ffd640 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1f68003ea0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.374+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify_complete (2) cookie 94235034639104 notify 146028888101 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f209c045790 con 0x55b4cdbed0c0 2024-04-23T18:31:19.399 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.374+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.399 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-23T18:31:18.209839Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:31:18.209827Z","tags":[],"group_ids":[]} 2024-04-23T18:31:19.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.375+0000 7f1f59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.375+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94235034389344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdc35cb0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.376+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94235034389344] v34'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.376+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94235034364592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdc00b60 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.377+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94235034364592] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20940d4040 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.377+0000 7f20a8416800 20 remove_watcher() i=0 2024-04-23T18:31:19.405 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.377+0000 7f20a8416800 2 removed watcher, disabling cache 2024-04-23T18:31:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.377+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94235034368304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdc00b60 con 0x55b4cdbed0c0 2024-04-23T18:31:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.378+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94235034368304] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.378+0000 7f20a8416800 20 remove_watcher() i=1 2024-04-23T18:31:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.378+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94235034373168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdc00b60 con 0x55b4cdbf6460 2024-04-23T18:31:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.379+0000 7f20a3283640 1 -- 172.21.15.119:0/2762219816 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94235034373168] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2098009050 con 0x55b4cdbf6460 2024-04-23T18:31:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.379+0000 7f20a8416800 20 remove_watcher() i=2 2024-04-23T18:31:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.379+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94235034375504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfaab0 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.380+0000 7f20a3a84640 1 -- 172.21.15.119:0/2762219816 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94235034375504] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20940d4040 con 0x55b4cdbf1ab0 2024-04-23T18:31:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.380+0000 7f20a8416800 20 remove_watcher() i=3 2024-04-23T18:31:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.380+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94235034380864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfaab0 con 0x55b4cdbed0c0 2024-04-23T18:31:19.406 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.381+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94235034380864] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x55b4cdbed0c0 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.381+0000 7f20a8416800 20 remove_watcher() i=4 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.381+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94235034384416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfea40 con 0x7f20940c0060 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.383+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94235034384416] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x7f20940c0060 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.383+0000 7f20a8416800 20 remove_watcher() i=5 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.383+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94235034378224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfaab0 con 0x7f20940c0060 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.384+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94235034378224] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x7f20940c0060 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.384+0000 7f20a8416800 20 remove_watcher() i=6 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.384+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94235034388288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4cdbfea40 con 0x7f20940c0060 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94235034388288] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c040080 con 0x7f20940c0060 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 20 remove_watcher() i=7 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f20940c0060 msgr2=0x7f20940923d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f20940c0060 0x7f20940923d0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b4cdbed0c0 msgr2=0x55b4cdbef580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.407 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b4cdbed0c0 0x55b4cdbef580 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b4cdbf1ab0 msgr2=0x55b4cdbf3ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b4cdbf1ab0 0x55b4cdbf3ea0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b4cdbf6460 msgr2=0x55b4cdbf8920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55b4cdbf6460 0x55b4cdbf8920 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f6c036e60 msgr2=0x7f1f6c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f6c036e60 0x7f1f6c039320 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55b4cdbbf580 tx=0x7f2098010000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 msgr2=0x55b4cdbe1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a4285640 1 -- 172.21.15.119:0/2762219816 reap_dead start 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 0x55b4cdbe1af0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f2094080780 tx=0x7f209406fee0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 shutdown_connections 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 --2- 172.21.15.119:0/2762219816 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbda6e0 0x55b4cdbe1af0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 >> 172.21.15.119:0/2762219816 conn(0x55b4cdbd6a40 msgr2=0x55b4cdbd40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 shutdown_connections 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2762219816 wait complete. 2024-04-23T18:31:19.408 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2695052771 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f7c036e60 msgr2=0x7f1f7c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 --2- 172.21.15.119:0/2695052771 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f7c036e60 0x7f1f7c039320 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55b4cdbb32c0 tx=0x7f209800f000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2695052771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbcd570 msgr2=0x55b4cdbcd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 --2- 172.21.15.119:0/2695052771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbcd570 0x55b4cdbcd990 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f20940057d0 tx=0x7f20940783a0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2695052771 shutdown_connections 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 --2- 172.21.15.119:0/2695052771 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f7c036e60 0x7f1f7c039320 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 --2- 172.21.15.119:0/2695052771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdbcd570 0x55b4cdbcd990 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2695052771 >> 172.21.15.119:0/2695052771 conn(0x55b4cdbc1610 msgr2=0x55b4cdbc1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2695052771 shutdown_connections 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.385+0000 7f20a8416800 1 -- 172.21.15.119:0/2695052771 wait complete. 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b4cdbbc5b0 msgr2=0x55b4cdbbea20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55b4cdbbc5b0 0x55b4cdbbea20 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b4cdab3230 msgr2=0x55b4cdbb5dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55b4cdab3230 0x55b4cdbb5dd0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b4cdbb84e0 msgr2=0x55b4cdbba970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.409 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55b4cdbb84e0 0x55b4cdbba970 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f8c036e60 msgr2=0x7f1f8c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1f8c036e60 0x7f1f8c039320 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2098001d90 tx=0x7f20980012f0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 msgr2=0x55b4cdbaed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 --2- 172.21.15.119:0/44685659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4cdab28d0 0x55b4cdbaed60 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f209405f040 tx=0x7f2094002fb0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a4285640 1 -- 172.21.15.119:0/44685659 reap_dead start 2024-04-23T18:31:19.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 shutdown_connections 2024-04-23T18:31:19.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 >> 172.21.15.119:0/44685659 conn(0x55b4cdaae430 msgr2=0x55b4cdba5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 shutdown_connections 2024-04-23T18:31:19.410 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.386+0000 7f20a8416800 1 -- 172.21.15.119:0/44685659 wait complete. 2024-04-23T18:31:19.410 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:19.411 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:19.411 ERROR:root:0 2024-04-23T18:31:19.411 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:19.415 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:19.415 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-23T18:31:19.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-23T18:31:19.416 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-23T18:31:19.460 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:19.461 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:19.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.468+0000 7fa080698800 1 Processor -- start 2024-04-23T18:31:19.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.468+0000 7fa080698800 1 -- start start 2024-04-23T18:31:19.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.468+0000 7fa080698800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d2da4a1590 0x55d2da4a3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.468+0000 7fa080698800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d2da34d560 con 0x55d2da49da80 2024-04-23T18:31:19.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.468+0000 7fa080698800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55d2da33ee20 con 0x55d2da4a1590 2024-04-23T18:31:19.462 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.468+0000 7fa075996640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d2da4a1590 0x55d2da4a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.468+0000 7fa075996640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d2da4a1590 0x55d2da4a3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55252/0 (socket says 172.21.15.119:55252) 2024-04-23T18:31:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.468+0000 7fa07e197640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55d2da49da80 0x55d2da49fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50638/0 (socket says 172.21.15.119:50638) 2024-04-23T18:31:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.468+0000 7fa075996640 1 -- 172.21.15.119:0/2389316392 learned_addr learned my addr 172.21.15.119:0/2389316392 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.469+0000 7fa075996640 1 -- 172.21.15.119:0/2389316392 >> v1:172.21.15.62:6789/0 conn(0x55d2da49da80 legacy=0x55d2da49fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.463 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.469+0000 7fa075996640 1 -- 172.21.15.119:0/2389316392 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2da34ce60 con 0x55d2da4a1590 2024-04-23T18:31:19.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.470+0000 7fa075996640 1 --2- 172.21.15.119:0/2389316392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da4a1590 0x55d2da4a3980 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa06800a520 tx=0x7fa06801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200fbfefd3c5adea server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.470+0000 7fa07d996640 1 -- 172.21.15.119:0/2389316392 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa068057070 con 0x55d2da4a1590 2024-04-23T18:31:19.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.471+0000 7fa07d996640 1 -- 172.21.15.119:0/2389316392 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa068052570 con 0x55d2da4a1590 2024-04-23T18:31:19.464 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.471+0000 7fa07d996640 1 -- 172.21.15.119:0/2389316392 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa06804ae60 con 0x55d2da4a1590 2024-04-23T18:31:19.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.471+0000 7fa080698800 1 -- 172.21.15.119:0/2389316392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da4a1590 msgr2=0x55d2da4a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.471+0000 7fa080698800 1 --2- 172.21.15.119:0/2389316392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da4a1590 0x55d2da4a3980 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa06800a520 tx=0x7fa06801d010 comp rx=0 tx=0).stop 2024-04-23T18:31:19.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.471+0000 7fa080698800 1 -- 172.21.15.119:0/2389316392 shutdown_connections 2024-04-23T18:31:19.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.471+0000 7fa080698800 1 --2- 172.21.15.119:0/2389316392 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da4a1590 0x55d2da4a3980 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.471+0000 7fa080698800 1 -- 172.21.15.119:0/2389316392 >> 172.21.15.119:0/2389316392 conn(0x55d2da497430 msgr2=0x55d2da499850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.471+0000 7fa080698800 1 -- 172.21.15.119:0/2389316392 shutdown_connections 2024-04-23T18:31:19.465 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.471+0000 7fa080698800 1 -- 172.21.15.119:0/2389316392 wait complete. 2024-04-23T18:31:19.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.483+0000 7fa080698800 1 Processor -- start 2024-04-23T18:31:19.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.483+0000 7fa080698800 1 -- start start 2024-04-23T18:31:19.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.483+0000 7fa080698800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da49da80 0x55d2da49d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.483+0000 7fa080698800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d2da3e85d0 con 0x55d2da49da80 2024-04-23T18:31:19.477 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.483+0000 7fa07e197640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da49da80 0x55d2da49d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.483+0000 7fa07e197640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da49da80 0x55d2da49d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55258/0 (socket says 172.21.15.119:55258) 2024-04-23T18:31:19.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.483+0000 7fa07e197640 1 -- 172.21.15.119:0/3736795324 learned_addr learned my addr 172.21.15.119:0/3736795324 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.483+0000 7fa07e197640 1 -- 172.21.15.119:0/3736795324 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2da35e860 con 0x55d2da49da80 2024-04-23T18:31:19.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.484+0000 7fa07e197640 1 --2- 172.21.15.119:0/3736795324 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da49da80 0x55d2da49d3c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa070001e10 tx=0x7fa07000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7625394cb316b8b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.484+0000 7f9f6c608640 1 -- 172.21.15.119:0/3736795324 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa07000e5c0 con 0x55d2da49da80 2024-04-23T18:31:19.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.484+0000 7f9f6c608640 1 -- 172.21.15.119:0/3736795324 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa070006070 con 0x55d2da49da80 2024-04-23T18:31:19.478 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.484+0000 7f9f6c608640 1 -- 172.21.15.119:0/3736795324 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa07000e930 con 0x55d2da49da80 2024-04-23T18:31:19.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.485+0000 7fa080698800 1 -- 172.21.15.119:0/3736795324 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da49da80 msgr2=0x55d2da49d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.485+0000 7fa080698800 1 --2- 172.21.15.119:0/3736795324 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da49da80 0x55d2da49d3c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa070001e10 tx=0x7fa07000b6c0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.485+0000 7fa080698800 1 -- 172.21.15.119:0/3736795324 shutdown_connections 2024-04-23T18:31:19.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.485+0000 7fa080698800 1 --2- 172.21.15.119:0/3736795324 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da49da80 0x55d2da49d3c0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.485+0000 7fa080698800 1 -- 172.21.15.119:0/3736795324 >> 172.21.15.119:0/3736795324 conn(0x55d2da497430 msgr2=0x55d2da589ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.485+0000 7fa080698800 1 -- 172.21.15.119:0/3736795324 shutdown_connections 2024-04-23T18:31:19.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.485+0000 7fa080698800 1 -- 172.21.15.119:0/3736795324 wait complete. 2024-04-23T18:31:19.482 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.485+0000 7fa080698800 1 Processor -- start 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.485+0000 7fa080698800 1 -- start start 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.485+0000 7fa080698800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da49da80 0x55d2da597d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.486+0000 7fa080698800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d2da4a61d0 con 0x55d2da49da80 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.486+0000 7fa07e197640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da49da80 0x55d2da597d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.486+0000 7fa07e197640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da49da80 0x55d2da597d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55270/0 (socket says 172.21.15.119:55270) 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.486+0000 7fa07e197640 1 -- 172.21.15.119:0/2602450308 learned_addr learned my addr 172.21.15.119:0/2602450308 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.486+0000 7fa07e197640 1 -- 172.21.15.119:0/2602450308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2da35ceb0 con 0x55d2da49da80 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.486+0000 7fa07e197640 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da49da80 0x55d2da597d30 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa07000b700 tx=0x7fa070000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.486+0000 7f9f6ae05640 1 -- 172.21.15.119:0/2602450308 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa07000f8d0 con 0x55d2da49da80 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.486+0000 7f9f6ae05640 1 -- 172.21.15.119:0/2602450308 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07000fa70 con 0x55d2da49da80 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.486+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2da598270 con 0x55d2da49da80 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.486+0000 7f9f6ae05640 1 -- 172.21.15.119:0/2602450308 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa07000fd50 con 0x55d2da49da80 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.486+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2da598790 con 0x55d2da49da80 2024-04-23T18:31:19.483 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.487+0000 7f9f6ae05640 1 -- 172.21.15.119:0/2602450308 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa070017070 con 0x55d2da49da80 2024-04-23T18:31:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.487+0000 7f9f6ae05640 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f64036e60 0x7f9f64039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.487+0000 7f9f6ae05640 1 -- 172.21.15.119:0/2602450308 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fa070015020 con 0x55d2da49da80 2024-04-23T18:31:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.487+0000 7fa075996640 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f64036e60 0x7f9f64039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.487+0000 7fa080698800 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d2da4a1590 0x55d2da59eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.487+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da59f370 con 0x55d2da4a1590 2024-04-23T18:31:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.487+0000 7fa07e998640 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d2da4a1590 0x55d2da59eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.488+0000 7fa075996640 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f64036e60 0x7f9f64039320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa068054000 tx=0x7fa06804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.488+0000 7fa07e998640 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d2da4a1590 0x55d2da59eda0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.488+0000 7fa07e998640 1 -- 172.21.15.119:0/2602450308 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da4a1590 2024-04-23T18:31:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.488+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da59c370 con 0x55d2da4a1590 2024-04-23T18:31:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.488+0000 7fa07e998640 1 -- 172.21.15.119:0/2602450308 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da4a1590 2024-04-23T18:31:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.488+0000 7fa080698800 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d2da5a1680 0x55d2da5a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.484 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.488+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5a4110 con 0x55d2da5a1680 2024-04-23T18:31:19.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.489+0000 7fa07e197640 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d2da5a1680 0x55d2da5a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.485 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.489+0000 7fa07e197640 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d2da5a1680 0x55d2da5a3a70 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.489+0000 7fa07e197640 1 -- 172.21.15.119:0/2602450308 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5a1680 2024-04-23T18:31:19.490 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.489+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5a0630 con 0x55d2da4a1590 2024-04-23T18:31:19.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.489+0000 7fa07e998640 1 -- 172.21.15.119:0/2602450308 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da4a1590 2024-04-23T18:31:19.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.490+0000 7fa080698800 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d2da5a55c0 0x55d2da5a7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.490+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5a8170 con 0x55d2da5a55c0 2024-04-23T18:31:19.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.490+0000 7fa075996640 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d2da5a55c0 0x55d2da5a7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.490+0000 7fa075996640 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d2da5a55c0 0x55d2da5a7a10 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.490+0000 7fa075996640 1 -- 172.21.15.119:0/2602450308 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa06805a040 con 0x55d2da5a55c0 2024-04-23T18:31:19.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.491+0000 7fa080698800 1 Processor -- start 2024-04-23T18:31:19.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.491+0000 7fa080698800 1 -- start start 2024-04-23T18:31:19.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.491+0000 7fa080698800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5b65d0 0x55d2da5b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.491+0000 7fa080698800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d2da38edf0 con 0x55d2da5b65d0 2024-04-23T18:31:19.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.491+0000 7fa07e197640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5b65d0 0x55d2da5b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.491+0000 7fa07e197640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5b65d0 0x55d2da5b69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55282/0 (socket says 172.21.15.119:55282) 2024-04-23T18:31:19.491 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.491+0000 7fa07e197640 1 -- 172.21.15.119:0/919253743 learned_addr learned my addr 172.21.15.119:0/919253743 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.491+0000 7fa07e197640 1 -- 172.21.15.119:0/919253743 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2da5b6f30 con 0x55d2da5b65d0 2024-04-23T18:31:19.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.492+0000 7fa07e197640 1 --2- 172.21.15.119:0/919253743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5b65d0 0x55d2da5b69f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fa07004bb70 tx=0x7fa070017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.492+0000 7f9f63fff640 1 -- 172.21.15.119:0/919253743 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa070045b10 con 0x55d2da5b65d0 2024-04-23T18:31:19.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.492+0000 7f9f63fff640 1 -- 172.21.15.119:0/919253743 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa070045cb0 con 0x55d2da5b65d0 2024-04-23T18:31:19.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.492+0000 7fa080698800 1 -- 172.21.15.119:0/919253743 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2da5b79a0 con 0x55d2da5b65d0 2024-04-23T18:31:19.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.492+0000 7f9f63fff640 1 -- 172.21.15.119:0/919253743 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0700451a0 con 0x55d2da5b65d0 2024-04-23T18:31:19.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.492+0000 7fa080698800 1 -- 172.21.15.119:0/919253743 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2da5b7ea0 con 0x55d2da5b65d0 2024-04-23T18:31:19.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.492+0000 7f9f63fff640 1 -- 172.21.15.119:0/919253743 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa070045340 con 0x55d2da5b65d0 2024-04-23T18:31:19.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.493+0000 7f9f63fff640 1 --2- 172.21.15.119:0/919253743 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f58036e60 0x7f9f58039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.493+0000 7f9f63fff640 1 -- 172.21.15.119:0/919253743 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fa07003dd00 con 0x55d2da5b65d0 2024-04-23T18:31:19.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.493+0000 7fa075996640 1 --2- 172.21.15.119:0/919253743 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f58036e60 0x7f9f58039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.493+0000 7fa080698800 1 Processor -- start 2024-04-23T18:31:19.492 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.493+0000 7fa080698800 1 -- start start 2024-04-23T18:31:19.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.493+0000 7fa075996640 1 --2- 172.21.15.119:0/919253743 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f58036e60 0x7f9f58039320 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55d2da59c290 tx=0x7fa068005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.493+0000 7fa080698800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 0x55d2da5c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.493+0000 7fa080698800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d2da49ba40 con 0x55d2da5c36a0 2024-04-23T18:31:19.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.493+0000 7fa07e197640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 0x55d2da5c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.493+0000 7fa07e197640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 0x55d2da5c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55290/0 (socket says 172.21.15.119:55290) 2024-04-23T18:31:19.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.493+0000 7fa07e197640 1 -- 172.21.15.119:0/316312801 learned_addr learned my addr 172.21.15.119:0/316312801 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.494+0000 7fa07e197640 1 -- 172.21.15.119:0/316312801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2da5c4090 con 0x55d2da5c36a0 2024-04-23T18:31:19.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.494+0000 7fa07e197640 1 --2- 172.21.15.119:0/316312801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 0x55d2da5c3ac0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fa07000c690 tx=0x7fa070020f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72aa86aee8383973 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.494+0000 7f9f61ffb640 1 -- 172.21.15.119:0/316312801 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa070045630 con 0x55d2da5c36a0 2024-04-23T18:31:19.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.494+0000 7f9f61ffb640 1 -- 172.21.15.119:0/316312801 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07005e020 con 0x55d2da5c36a0 2024-04-23T18:31:19.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.494+0000 7f9f61ffb640 1 -- 172.21.15.119:0/316312801 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa070019860 con 0x55d2da5c36a0 2024-04-23T18:31:19.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.495+0000 7fa080698800 1 -- 172.21.15.119:0/316312801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 msgr2=0x55d2da5c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.493 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.495+0000 7fa080698800 1 --2- 172.21.15.119:0/316312801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 0x55d2da5c3ac0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fa07000c690 tx=0x7fa070020f40 comp rx=0 tx=0).stop 2024-04-23T18:31:19.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.495+0000 7fa080698800 1 -- 172.21.15.119:0/316312801 shutdown_connections 2024-04-23T18:31:19.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.495+0000 7fa080698800 1 --2- 172.21.15.119:0/316312801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 0x55d2da5c3ac0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.495+0000 7fa080698800 1 -- 172.21.15.119:0/316312801 >> 172.21.15.119:0/316312801 conn(0x55d2da5bf9c0 msgr2=0x55d2da5bda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.495+0000 7fa080698800 1 -- 172.21.15.119:0/316312801 shutdown_connections 2024-04-23T18:31:19.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.495+0000 7fa080698800 1 -- 172.21.15.119:0/316312801 wait complete. 2024-04-23T18:31:19.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.495+0000 7fa080698800 1 Processor -- start 2024-04-23T18:31:19.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.495+0000 7fa080698800 1 -- start start 2024-04-23T18:31:19.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.495+0000 7fa080698800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 0x55d2da5caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.495+0000 7fa080698800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d2da5c47b0 con 0x55d2da5c36a0 2024-04-23T18:31:19.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.496+0000 7fa07e197640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 0x55d2da5caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.496+0000 7fa07e197640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 0x55d2da5caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55306/0 (socket says 172.21.15.119:55306) 2024-04-23T18:31:19.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.496+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 learned_addr learned my addr 172.21.15.119:0/340189564 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.494 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.496+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2da5caf60 con 0x55d2da5c36a0 2024-04-23T18:31:19.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.496+0000 7fa07e197640 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 0x55d2da5caa20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa07000c690 tx=0x7fa070043f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.496+0000 7f9f4ffff640 1 -- 172.21.15.119:0/340189564 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa070019b90 con 0x55d2da5c36a0 2024-04-23T18:31:19.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.496+0000 7f9f4ffff640 1 -- 172.21.15.119:0/340189564 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa070027430 con 0x55d2da5c36a0 2024-04-23T18:31:19.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.496+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d2da5caf60 con 0x55d2da5c36a0 2024-04-23T18:31:19.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.497+0000 7f9f4ffff640 1 -- 172.21.15.119:0/340189564 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa070019d30 con 0x55d2da5c36a0 2024-04-23T18:31:19.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.497+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2da5caf60 con 0x55d2da5c36a0 2024-04-23T18:31:19.495 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.497+0000 7f9f4ffff640 1 -- 172.21.15.119:0/340189564 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fa07001dc70 con 0x55d2da5c36a0 2024-04-23T18:31:19.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.498+0000 7f9f4ffff640 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f48036e60 0x7f9f48039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.509 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.498+0000 7f9f4ffff640 1 -- 172.21.15.119:0/340189564 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fa07006c030 con 0x55d2da5c36a0 2024-04-23T18:31:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.498+0000 7fa075996640 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f48036e60 0x7f9f48039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.499+0000 7fa075996640 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f48036e60 0x7f9f48039320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa068055040 tx=0x7fa06804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.499+0000 7fa080698800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.499+0000 7fa080698800 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d2da5d6110 0x55d2da5d85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.499+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d8d20 con 0x55d2da5d6110 2024-04-23T18:31:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.499+0000 7fa07e998640 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d2da5d6110 0x55d2da5d85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.499+0000 7fa07e998640 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d2da5d6110 0x55d2da5d85d0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.499+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da5d6110 2024-04-23T18:31:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.499+0000 7fa080698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.499+0000 7fa080698800 20 realm 2024-04-23T18:31:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.499+0000 7fa080698800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.510 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.499+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9130 con 0x55d2da5d6110 2024-04-23T18:31:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da5d6110 2024-04-23T18:31:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa080698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa080698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa080698800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9a00 con 0x55d2da5d6110 2024-04-23T18:31:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da5d6110 2024-04-23T18:31:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa080698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa080698800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5d6110 2024-04-23T18:31:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da5d6110 2024-04-23T18:31:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa080698800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa080698800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.511 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa080698800 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d2da5dab00 0x55d2da5dcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5dd500 con 0x55d2da5dab00 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.500+0000 7fa07e197640 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d2da5dab00 0x55d2da5dcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.501+0000 7fa07e197640 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d2da5dab00 0x55d2da5dcef0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.501+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.501+0000 7fa080698800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.501+0000 7fa080698800 20 searching for the correct realm 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.501+0000 7fa080698800 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d2da5df4b0 0x55d2da5e1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.501+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e2040 con 0x55d2da5df4b0 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.501+0000 7fa075996640 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d2da5df4b0 0x55d2da5e1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.502+0000 7fa075996640 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d2da5df4b0 0x55d2da5e1970 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.502+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.502+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e2040 con 0x55d2da5dab00 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.502+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.512 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.502+0000 7fa07e197640 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa07000f070 0x7fa070006220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.502+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e2040 con 0x7fa07000f070 2024-04-23T18:31:19.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.503+0000 7fa07e998640 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa07000f070 0x7fa070006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.503+0000 7fa07e998640 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa07000f070 0x7fa070006220 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.503+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07800a4a0 con 0x7fa07000f070 2024-04-23T18:31:19.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.503+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5d6110 2024-04-23T18:31:19.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.504+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da5d6110 2024-04-23T18:31:19.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.504+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5d6110 2024-04-23T18:31:19.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.504+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da5d6110 2024-04-23T18:31:19.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.504+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x7fa07000f070 2024-04-23T18:31:19.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.504+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07800a4a0 con 0x7fa07000f070 2024-04-23T18:31:19.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.504+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x7fa07000f070 2024-04-23T18:31:19.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.504+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa07800a4a0 con 0x7fa07000f070 2024-04-23T18:31:19.513 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.504+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5dab00 2024-04-23T18:31:19.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.504+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.504+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5df4b0 2024-04-23T18:31:19.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.505+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.505+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5d6110 2024-04-23T18:31:19.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.505+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da5d6110 2024-04-23T18:31:19.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.505+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x7fa07000f070 2024-04-23T18:31:19.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.506+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07800a4a0 con 0x7fa07000f070 2024-04-23T18:31:19.514 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.506+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5d6110 2024-04-23T18:31:19.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.506+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da5d6110 2024-04-23T18:31:19.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.506+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5dab00 2024-04-23T18:31:19.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.506+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.506+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5df4b0 2024-04-23T18:31:19.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.506+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.507+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5df4b0 2024-04-23T18:31:19.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.507+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.507+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x7fa07000f070 2024-04-23T18:31:19.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.507+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07800a4a0 con 0x7fa07000f070 2024-04-23T18:31:19.515 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.507+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5df4b0 2024-04-23T18:31:19.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.507+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.507+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5df4b0 2024-04-23T18:31:19.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.508+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.508+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5d6110 2024-04-23T18:31:19.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.508+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da5d6110 2024-04-23T18:31:19.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.508+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5d6110 2024-04-23T18:31:19.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.508+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da5d6110 2024-04-23T18:31:19.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.508+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x7fa07000f070 2024-04-23T18:31:19.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.508+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07800a4a0 con 0x7fa07000f070 2024-04-23T18:31:19.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.508+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5df4b0 2024-04-23T18:31:19.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.509+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.509+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5dab00 2024-04-23T18:31:19.516 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.509+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.509+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5d6110 2024-04-23T18:31:19.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.509+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07800a4a0 con 0x55d2da5d6110 2024-04-23T18:31:19.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.509+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5dab00 2024-04-23T18:31:19.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.509+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.509+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5df4b0 2024-04-23T18:31:19.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.510+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.510+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x7fa07000f070 2024-04-23T18:31:19.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.510+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07800a4a0 con 0x7fa07000f070 2024-04-23T18:31:19.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.510+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5dab00 2024-04-23T18:31:19.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.510+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.510+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5df4b0 2024-04-23T18:31:19.517 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.510+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.510+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x7fa07000f070 2024-04-23T18:31:19.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07800a4a0 con 0x7fa07000f070 2024-04-23T18:31:19.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5d6110 2024-04-23T18:31:19.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5d9da0 con 0x55d2da5dab00 2024-04-23T18:31:19.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.518 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa080698800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa080698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa080698800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa080698800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa080698800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa080698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa080698800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.519 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5dddc0 con 0x55d2da5d6110 2024-04-23T18:31:19.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa080698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa080698800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.511+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5de1b0 con 0x55d2da5d6110 2024-04-23T18:31:19.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.520 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5de1b0 con 0x7fa07000f070 2024-04-23T18:31:19.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa078040080 con 0x7fa07000f070 2024-04-23T18:31:19.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:19.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 20 zone default found 2024-04-23T18:31:19.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 4 Realm: () 2024-04-23T18:31:19.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:19.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:19.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:19.521 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 20 zonegroup default 2024-04-23T18:31:19.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5dda00 con 0x55d2da5dab00 2024-04-23T18:31:19.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.512+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e3f00 con 0x55d2da5df4b0 2024-04-23T18:31:19.522 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.513+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.513+0000 7fa080698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.513+0000 7fa080698800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.513+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e43b0 con 0x55d2da5df4b0 2024-04-23T18:31:19.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.513+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.513+0000 7fa080698800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.513+0000 7fa080698800 20 started sync module instance, tier type = 2024-04-23T18:31:19.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.513+0000 7fa080698800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:19.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.513+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e3340 con 0x55d2da5dab00 2024-04-23T18:31:19.523 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.514+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.514+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94364095100720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e4cc0 con 0x55d2da5dab00 2024-04-23T18:31:19.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.514+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e5510 con 0x55d2da5d6110 2024-04-23T18:31:19.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.515+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94364095100720] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.515+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.515+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94364095105040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e55b0 con 0x55d2da5d6110 2024-04-23T18:31:19.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.515+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e60d0 con 0x55d2da5df4b0 2024-04-23T18:31:19.524 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.516+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94364095105040] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.516+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.517+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94364095110048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e64c0 con 0x55d2da5df4b0 2024-04-23T18:31:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.517+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e6f00 con 0x55d2da5dab00 2024-04-23T18:31:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.518+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.518+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94364095116016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e7bc0 con 0x55d2da5dab00 2024-04-23T18:31:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.518+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e8610 con 0x55d2da5d6110 2024-04-23T18:31:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.519+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94364095116016] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.519+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94364095110048] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.519+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.519+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94364095119616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e7710 con 0x55d2da5d6110 2024-04-23T18:31:19.533 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.519+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e8a30 con 0x7fa07000f070 2024-04-23T18:31:19.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.520+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94364095119616] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.521+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x7fa07000f070 2024-04-23T18:31:19.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.521+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94364095107168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e89b0 con 0x7fa07000f070 2024-04-23T18:31:19.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.521+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e9480 con 0x7fa07000f070 2024-04-23T18:31:19.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.523+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(56 notify.6 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x7fa07000f070 2024-04-23T18:31:19.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.523+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94364095123312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e98f0 con 0x7fa07000f070 2024-04-23T18:31:19.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.523+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5ea410 con 0x7fa07000f070 2024-04-23T18:31:19.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.523+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94364095107168] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x7fa07000f070 2024-04-23T18:31:19.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.524+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94364095123312] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x7fa07000f070 2024-04-23T18:31:19.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.524+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x7fa07000f070 2024-04-23T18:31:19.534 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.524+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94364095127264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e9480 con 0x7fa07000f070 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.524+0000 7fa080698800 20 add_watcher() i=0 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.524+0000 7fa080698800 20 add_watcher() i=1 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.524+0000 7fa080698800 20 add_watcher() i=2 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.524+0000 7fa080698800 20 add_watcher() i=3 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.524+0000 7fa080698800 20 add_watcher() i=4 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.524+0000 7fa080698800 20 add_watcher() i=5 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.524+0000 7fa080698800 20 add_watcher() i=6 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.525+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94364095127264] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x7fa07000f070 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.525+0000 7fa080698800 20 add_watcher() i=7 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.525+0000 7fa080698800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.525+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5ed510 con 0x55d2da5d6110 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.526+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.526+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94364095117072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5ea990 con 0x55d2da5d6110 2024-04-23T18:31:19.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.527+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94364095117072] v34'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.527+0000 7f9f34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.527+0000 7fa080698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:19.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.527+0000 7fa080698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:19.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.527+0000 7fa080698800 5 note: GC not initialized 2024-04-23T18:31:19.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.527+0000 7f9eaf7fe640 20 reqs_thread_entry: start 2024-04-23T18:31:19.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.527+0000 7fa080698800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:19.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.527+0000 7fa080698800 20 Filter name: none 2024-04-23T18:31:19.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.527+0000 7f9ead7fa640 20 reqs_thread_entry: start 2024-04-23T18:31:19.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.527+0000 7fa080698800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-23T18:31:19.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.528+0000 7fa080698800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.536 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.528+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da620ae0 con 0x7fa07000f070 2024-04-23T18:31:19.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.528+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fa078040080 con 0x7fa07000f070 2024-04-23T18:31:19.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.528+0000 7fa080698800 20 rados_obj.operate() r=0 bl.length=490 2024-04-23T18:31:19.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.528+0000 7fa080698800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-23T18:31:19.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.528+0000 7fa080698800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.528+0000 7fa080698800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:19.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.528+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da627430 con 0x7fa07000f070 2024-04-23T18:31:19.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.529+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa078040080 con 0x7fa07000f070 2024-04-23T18:31:19.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.529+0000 7fa080698800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:19.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.529+0000 7fa080698800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.529+0000 7fa080698800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-23T18:31:19.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.529+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94364095377056 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d2da622ac0 con 0x55d2da5d6110 2024-04-23T18:31:19.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.530+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== watch-notify(notify (1) cookie 94364095119616 notify 146028888102 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7fa078018c10 con 0x55d2da5d6110 2024-04-23T18:31:19.537 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.530+0000 7f9f61ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888102 cookie 94364095119616 notifier 4882 bl.length()=679 2024-04-23T18:31:19.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.530+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 notify.4 [notify cookie 94364095377056 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.530+0000 7f9f61ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:19.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.530+0000 7f9f61ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.530+0000 7f9f61ffb640 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9f44003ea0 con 0x55d2da5d6110 2024-04-23T18:31:19.538 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.530+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== watch-notify(notify_complete (2) cookie 94364095377056 notify 146028888102 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa078018de0 con 0x55d2da5d6110 2024-04-23T18:31:19.538 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-23T18:31:18.209839Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:31:18.209827Z","tags":[],"group_ids":[]} 2024-04-23T18:31:19.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.530+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.531+0000 7f9f34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.531+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94364095117072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da61f080 con 0x55d2da5d6110 2024-04-23T18:31:19.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.532+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94364095117072] v34'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.532+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94364095100720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e7710 con 0x55d2da5dab00 2024-04-23T18:31:19.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.533+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94364095100720] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.545 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.533+0000 7fa080698800 20 remove_watcher() i=0 2024-04-23T18:31:19.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.533+0000 7fa080698800 2 removed watcher, disabling cache 2024-04-23T18:31:19.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.533+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94364095105040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e3730 con 0x55d2da5d6110 2024-04-23T18:31:19.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.534+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94364095105040] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.534+0000 7fa080698800 20 remove_watcher() i=1 2024-04-23T18:31:19.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.534+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94364095110048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e3730 con 0x55d2da5df4b0 2024-04-23T18:31:19.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.535+0000 7fa075996640 1 -- 172.21.15.119:0/340189564 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94364095110048] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa06807f070 con 0x55d2da5df4b0 2024-04-23T18:31:19.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.535+0000 7fa080698800 20 remove_watcher() i=2 2024-04-23T18:31:19.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.535+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94364095116016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e5ba0 con 0x55d2da5dab00 2024-04-23T18:31:19.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.536+0000 7fa07e197640 1 -- 172.21.15.119:0/340189564 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94364095116016] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa07002e070 con 0x55d2da5dab00 2024-04-23T18:31:19.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.536+0000 7fa080698800 20 remove_watcher() i=3 2024-04-23T18:31:19.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.536+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94364095119616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e5ba0 con 0x55d2da5d6110 2024-04-23T18:31:19.546 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.537+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94364095119616] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x55d2da5d6110 2024-04-23T18:31:19.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.537+0000 7fa080698800 20 remove_watcher() i=4 2024-04-23T18:31:19.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.537+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94364095107168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e5ba0 con 0x7fa07000f070 2024-04-23T18:31:19.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.538+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94364095107168] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x7fa07000f070 2024-04-23T18:31:19.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.538+0000 7fa080698800 20 remove_watcher() i=5 2024-04-23T18:31:19.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.538+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94364095123312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e5060 con 0x7fa07000f070 2024-04-23T18:31:19.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.539+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94364095123312] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x7fa07000f070 2024-04-23T18:31:19.547 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.539+0000 7fa080698800 20 remove_watcher() i=6 2024-04-23T18:31:19.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.539+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94364095127264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d2da5e5060 con 0x7fa07000f070 2024-04-23T18:31:19.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94364095127264] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa078040080 con 0x7fa07000f070 2024-04-23T18:31:19.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa080698800 20 remove_watcher() i=7 2024-04-23T18:31:19.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa07000f070 msgr2=0x7fa070006220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa080698800 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fa07000f070 0x7fa070006220 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d2da5d6110 msgr2=0x55d2da5d85d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.548 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa080698800 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d2da5d6110 0x55d2da5d85d0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d2da5dab00 msgr2=0x55d2da5dcef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa080698800 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d2da5dab00 0x55d2da5dcef0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d2da5df4b0 msgr2=0x55d2da5e1970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa080698800 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55d2da5df4b0 0x55d2da5e1970 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f48036e60 msgr2=0x7f9f48039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa080698800 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f48036e60 0x7f9f48039320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa068055040 tx=0x7fa06804f000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 msgr2=0x55d2da5caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa07e998640 1 -- 172.21.15.119:0/340189564 reap_dead start 2024-04-23T18:31:19.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.540+0000 7fa080698800 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 0x55d2da5caa20 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fa07000c690 tx=0x7fa070043f30 comp rx=0 tx=0).stop 2024-04-23T18:31:19.549 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 shutdown_connections 2024-04-23T18:31:19.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 --2- 172.21.15.119:0/340189564 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5c36a0 0x55d2da5caa20 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 >> 172.21.15.119:0/340189564 conn(0x55d2da5bf9c0 msgr2=0x55d2da5bd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 shutdown_connections 2024-04-23T18:31:19.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/340189564 wait complete. 2024-04-23T18:31:19.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/919253743 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f58036e60 msgr2=0x7f9f58039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 --2- 172.21.15.119:0/919253743 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f58036e60 0x7f9f58039320 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55d2da59c290 tx=0x7fa068005ac0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/919253743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5b65d0 msgr2=0x55d2da5b69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 --2- 172.21.15.119:0/919253743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5b65d0 0x55d2da5b69f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fa07004bb70 tx=0x7fa070017d50 comp rx=0 tx=0).stop 2024-04-23T18:31:19.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/919253743 shutdown_connections 2024-04-23T18:31:19.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 --2- 172.21.15.119:0/919253743 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f58036e60 0x7f9f58039320 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 --2- 172.21.15.119:0/919253743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da5b65d0 0x55d2da5b69f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/919253743 >> 172.21.15.119:0/919253743 conn(0x55d2da5aa670 msgr2=0x55d2da5aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.550 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/919253743 shutdown_connections 2024-04-23T18:31:19.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/919253743 wait complete. 2024-04-23T18:31:19.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d2da5a55c0 msgr2=0x55d2da5a7a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55d2da5a55c0 0x55d2da5a7a10 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d2da4a1590 msgr2=0x55d2da59eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55d2da4a1590 0x55d2da59eda0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d2da5a1680 msgr2=0x55d2da5a3a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55d2da5a1680 0x55d2da5a3a70 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f64036e60 msgr2=0x7f9f64039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9f64036e60 0x7f9f64039320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa068054000 tx=0x7fa06804e000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da49da80 msgr2=0x55d2da597d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 --2- 172.21.15.119:0/2602450308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d2da49da80 0x55d2da597d30 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa07000b700 tx=0x7fa070000bc0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.551 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa07e998640 1 -- 172.21.15.119:0/2602450308 reap_dead start 2024-04-23T18:31:19.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 shutdown_connections 2024-04-23T18:31:19.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 >> 172.21.15.119:0/2602450308 conn(0x55d2da497430 msgr2=0x55d2da5896b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 shutdown_connections 2024-04-23T18:31:19.552 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.541+0000 7fa080698800 1 -- 172.21.15.119:0/2602450308 wait complete. 2024-04-23T18:31:19.552 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:19.552 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:19.552 ERROR:root:0 2024-04-23T18:31:19.552 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:19.557 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:19.557 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-23T18:31:19.557 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-23T18:31:19.557 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-04-23T18:31:19.602 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:19.602 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:19.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.610+0000 7fb15131f800 1 Processor -- start 2024-04-23T18:31:19.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.610+0000 7fb15131f800 1 -- start start 2024-04-23T18:31:19.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.610+0000 7fb15131f800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bff19c9590 0x55bff19cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.610+0000 7fb15131f800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bff1875560 con 0x55bff19c5a80 2024-04-23T18:31:19.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.610+0000 7fb15131f800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55bff1866e20 con 0x55bff19c9590 2024-04-23T18:31:19.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.610+0000 7fb147fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bff19c9590 0x55bff19cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.610+0000 7fb147fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bff19c9590 0x55bff19cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55322/0 (socket says 172.21.15.119:55322) 2024-04-23T18:31:19.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.610+0000 7fb14cfe7640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55bff19c5a80 0x55bff19c7e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50650/0 (socket says 172.21.15.119:50650) 2024-04-23T18:31:19.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.610+0000 7fb147fff640 1 -- 172.21.15.119:0/2343583415 learned_addr learned my addr 172.21.15.119:0/2343583415 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.610+0000 7fb147fff640 1 -- 172.21.15.119:0/2343583415 >> v1:172.21.15.62:6789/0 conn(0x55bff19c5a80 legacy=0x55bff19c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.604 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.610+0000 7fb147fff640 1 -- 172.21.15.119:0/2343583415 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bff1874e60 con 0x55bff19c9590 2024-04-23T18:31:19.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.612+0000 7fb147fff640 1 --2- 172.21.15.119:0/2343583415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c9590 0x55bff19cb980 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb13800a520 tx=0x7fb13801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd734ece04b45d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.612+0000 7fb1477fe640 1 -- 172.21.15.119:0/2343583415 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb138057070 con 0x55bff19c9590 2024-04-23T18:31:19.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.612+0000 7fb1477fe640 1 -- 172.21.15.119:0/2343583415 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb138052570 con 0x55bff19c9590 2024-04-23T18:31:19.606 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.612+0000 7fb1477fe640 1 -- 172.21.15.119:0/2343583415 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb13804ae60 con 0x55bff19c9590 2024-04-23T18:31:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.613+0000 7fb15131f800 1 -- 172.21.15.119:0/2343583415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c9590 msgr2=0x55bff19cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.613+0000 7fb15131f800 1 --2- 172.21.15.119:0/2343583415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c9590 0x55bff19cb980 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb13800a520 tx=0x7fb13801d010 comp rx=0 tx=0).stop 2024-04-23T18:31:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.613+0000 7fb15131f800 1 -- 172.21.15.119:0/2343583415 shutdown_connections 2024-04-23T18:31:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.613+0000 7fb15131f800 1 --2- 172.21.15.119:0/2343583415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c9590 0x55bff19cb980 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.613+0000 7fb15131f800 1 -- 172.21.15.119:0/2343583415 >> 172.21.15.119:0/2343583415 conn(0x55bff19bf430 msgr2=0x55bff19c1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.613+0000 7fb15131f800 1 -- 172.21.15.119:0/2343583415 shutdown_connections 2024-04-23T18:31:19.607 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.613+0000 7fb15131f800 1 -- 172.21.15.119:0/2343583415 wait complete. 2024-04-23T18:31:19.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.625+0000 7fb15131f800 1 Processor -- start 2024-04-23T18:31:19.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.625+0000 7fb15131f800 1 -- start start 2024-04-23T18:31:19.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.625+0000 7fb15131f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c5a80 0x55bff1ab6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.625+0000 7fb15131f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bff19105d0 con 0x55bff19c5a80 2024-04-23T18:31:19.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.625+0000 7fb14cfe7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c5a80 0x55bff1ab6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.619 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.625+0000 7fb14cfe7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c5a80 0x55bff1ab6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55326/0 (socket says 172.21.15.119:55326) 2024-04-23T18:31:19.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.625+0000 7fb14cfe7640 1 -- 172.21.15.119:0/2250415624 learned_addr learned my addr 172.21.15.119:0/2250415624 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.625+0000 7fb14cfe7640 1 -- 172.21.15.119:0/2250415624 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bff1886860 con 0x55bff19c5a80 2024-04-23T18:31:19.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.625+0000 7fb14cfe7640 1 --2- 172.21.15.119:0/2250415624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c5a80 0x55bff1ab6270 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb140001e90 tx=0x7fb14000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512201a05aaaf3b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.626+0000 7fb03ae05640 1 -- 172.21.15.119:0/2250415624 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14000e5c0 con 0x55bff19c5a80 2024-04-23T18:31:19.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.626+0000 7fb03ae05640 1 -- 172.21.15.119:0/2250415624 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb140006070 con 0x55bff19c5a80 2024-04-23T18:31:19.620 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.626+0000 7fb03ae05640 1 -- 172.21.15.119:0/2250415624 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14000e890 con 0x55bff19c5a80 2024-04-23T18:31:19.626 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.626+0000 7fb15131f800 1 -- 172.21.15.119:0/2250415624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c5a80 msgr2=0x55bff1ab6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.626+0000 7fb15131f800 1 --2- 172.21.15.119:0/2250415624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c5a80 0x55bff1ab6270 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb140001e90 tx=0x7fb14000b6c0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.626+0000 7fb15131f800 1 -- 172.21.15.119:0/2250415624 shutdown_connections 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.626+0000 7fb15131f800 1 --2- 172.21.15.119:0/2250415624 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c5a80 0x55bff1ab6270 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.626+0000 7fb15131f800 1 -- 172.21.15.119:0/2250415624 >> 172.21.15.119:0/2250415624 conn(0x55bff19bf430 msgr2=0x55bff1ab1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.626+0000 7fb15131f800 1 -- 172.21.15.119:0/2250415624 shutdown_connections 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.626+0000 7fb15131f800 1 -- 172.21.15.119:0/2250415624 wait complete. 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.627+0000 7fb15131f800 1 Processor -- start 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.627+0000 7fb15131f800 1 -- start start 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.627+0000 7fb15131f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c5a80 0x55bff1abdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.627+0000 7fb15131f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bff19ce1d0 con 0x55bff19c5a80 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.627+0000 7fb14cfe7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c5a80 0x55bff1abdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.627+0000 7fb14cfe7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c5a80 0x55bff1abdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55342/0 (socket says 172.21.15.119:55342) 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.627+0000 7fb14cfe7640 1 -- 172.21.15.119:0/2912029705 learned_addr learned my addr 172.21.15.119:0/2912029705 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.627+0000 7fb14cfe7640 1 -- 172.21.15.119:0/2912029705 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bff1884eb0 con 0x55bff19c5a80 2024-04-23T18:31:19.627 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.627+0000 7fb14cfe7640 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c5a80 0x55bff1abdc40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb140001ed0 tx=0x7fb140000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.628+0000 7fb039602640 1 -- 172.21.15.119:0/2912029705 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14001a880 con 0x55bff19c5a80 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.628+0000 7fb039602640 1 -- 172.21.15.119:0/2912029705 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14001aa20 con 0x55bff19c5a80 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.628+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bff1abe180 con 0x55bff19c5a80 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.628+0000 7fb039602640 1 -- 172.21.15.119:0/2912029705 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14001ad40 con 0x55bff19c5a80 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.628+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bff1abe6a0 con 0x55bff19c5a80 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.628+0000 7fb039602640 1 -- 172.21.15.119:0/2912029705 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb140017070 con 0x55bff19c5a80 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.629+0000 7fb039602640 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb034036e60 0x7fb034039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.629+0000 7fb039602640 1 -- 172.21.15.119:0/2912029705 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb140015020 con 0x55bff19c5a80 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.629+0000 7fb147fff640 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb034036e60 0x7fb034039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.629+0000 7fb15131f800 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bff19c9590 0x55bff1ac4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.629+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1ac51e0 con 0x55bff19c9590 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.629+0000 7fb14d7e8640 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bff19c9590 0x55bff1ac4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.629+0000 7fb147fff640 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb034036e60 0x7fb034039320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb138054000 tx=0x7fb13804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.629+0000 7fb14d7e8640 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bff19c9590 0x55bff1ac4c60 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.628 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.629+0000 7fb14d7e8640 1 -- 172.21.15.119:0/2912029705 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff19c9590 2024-04-23T18:31:19.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.629+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1ac2230 con 0x55bff19c9590 2024-04-23T18:31:19.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.630+0000 7fb14d7e8640 1 -- 172.21.15.119:0/2912029705 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff19c9590 2024-04-23T18:31:19.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.630+0000 7fb15131f800 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bff1ac7530 0x55bff1ac9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.630+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1aca010 con 0x55bff1ac7530 2024-04-23T18:31:19.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.630+0000 7fb14cfe7640 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bff1ac7530 0x55bff1ac9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.630+0000 7fb14cfe7640 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bff1ac7530 0x55bff1ac9920 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.630+0000 7fb14cfe7640 1 -- 172.21.15.119:0/2912029705 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb14002e070 con 0x55bff1ac7530 2024-04-23T18:31:19.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.630+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1ac64e0 con 0x55bff19c9590 2024-04-23T18:31:19.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.631+0000 7fb14d7e8640 1 -- 172.21.15.119:0/2912029705 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff19c9590 2024-04-23T18:31:19.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.631+0000 7fb15131f800 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bff1acb4c0 0x55bff1acd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.629 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.631+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1ace070 con 0x55bff1acb4c0 2024-04-23T18:31:19.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.631+0000 7fb147fff640 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bff1acb4c0 0x55bff1acd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.631+0000 7fb147fff640 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bff1acb4c0 0x55bff1acd910 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.632+0000 7fb147fff640 1 -- 172.21.15.119:0/2912029705 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb13805a040 con 0x55bff1acb4c0 2024-04-23T18:31:19.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.632+0000 7fb15131f800 1 Processor -- start 2024-04-23T18:31:19.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.632+0000 7fb15131f800 1 -- start start 2024-04-23T18:31:19.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.632+0000 7fb15131f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1adc4d0 0x55bff1adc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.632+0000 7fb15131f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bff18b6df0 con 0x55bff1adc4d0 2024-04-23T18:31:19.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.632+0000 7fb14cfe7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1adc4d0 0x55bff1adc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.632+0000 7fb14cfe7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1adc4d0 0x55bff1adc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55358/0 (socket says 172.21.15.119:55358) 2024-04-23T18:31:19.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.632+0000 7fb14cfe7640 1 -- 172.21.15.119:0/855444547 learned_addr learned my addr 172.21.15.119:0/855444547 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.633+0000 7fb14cfe7640 1 -- 172.21.15.119:0/855444547 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bff1adce30 con 0x55bff1adc4d0 2024-04-23T18:31:19.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.633+0000 7fb14cfe7640 1 --2- 172.21.15.119:0/855444547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1adc4d0 0x55bff1adc8f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb14001afd0 tx=0x7fb14001ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.630 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.633+0000 7fb0327fc640 1 -- 172.21.15.119:0/855444547 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb140045cc0 con 0x55bff1adc4d0 2024-04-23T18:31:19.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.633+0000 7fb0327fc640 1 -- 172.21.15.119:0/855444547 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb140044040 con 0x55bff1adc4d0 2024-04-23T18:31:19.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.633+0000 7fb15131f800 1 -- 172.21.15.119:0/855444547 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bff1add8a0 con 0x55bff1adc4d0 2024-04-23T18:31:19.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.633+0000 7fb0327fc640 1 -- 172.21.15.119:0/855444547 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb14001d450 con 0x55bff1adc4d0 2024-04-23T18:31:19.631 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.633+0000 7fb15131f800 1 -- 172.21.15.119:0/855444547 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bff1addda0 con 0x55bff1adc4d0 2024-04-23T18:31:19.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.634+0000 7fb0327fc640 1 -- 172.21.15.119:0/855444547 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb14003a070 con 0x55bff1adc4d0 2024-04-23T18:31:19.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.634+0000 7fb0327fc640 1 --2- 172.21.15.119:0/855444547 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb024036eb0 0x7fb024039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.634+0000 7fb0327fc640 1 -- 172.21.15.119:0/855444547 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb140038070 con 0x55bff1adc4d0 2024-04-23T18:31:19.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.634+0000 7fb147fff640 1 --2- 172.21.15.119:0/855444547 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb024036eb0 0x7fb024039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.634+0000 7fb15131f800 1 Processor -- start 2024-04-23T18:31:19.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.634+0000 7fb15131f800 1 -- start start 2024-04-23T18:31:19.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.634+0000 7fb147fff640 1 --2- 172.21.15.119:0/855444547 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb024036eb0 0x7fb024039370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55bff1ac5ae0 tx=0x7fb138005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.634+0000 7fb15131f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 0x55bff1ae9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.634+0000 7fb15131f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bff1ab69f0 con 0x55bff1ae96d0 2024-04-23T18:31:19.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.635+0000 7fb14cfe7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 0x55bff1ae9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.656 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.635+0000 7fb14cfe7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 0x55bff1ae9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55372/0 (socket says 172.21.15.119:55372) 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.635+0000 7fb14cfe7640 1 -- 172.21.15.119:0/2720178869 learned_addr learned my addr 172.21.15.119:0/2720178869 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.635+0000 7fb14cfe7640 1 -- 172.21.15.119:0/2720178869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bff1aea0c0 con 0x55bff1ae96d0 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.635+0000 7fb14cfe7640 1 --2- 172.21.15.119:0/2720178869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 0x55bff1ae9af0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb140019fd0 tx=0x7fb140031480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c7850b5ac5250b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.635+0000 7fb023fff640 1 -- 172.21.15.119:0/2720178869 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb140062070 con 0x55bff1ae96d0 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.635+0000 7fb023fff640 1 -- 172.21.15.119:0/2720178869 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1400456d0 con 0x55bff1ae96d0 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.635+0000 7fb023fff640 1 -- 172.21.15.119:0/2720178869 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb140055070 con 0x55bff1ae96d0 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb15131f800 1 -- 172.21.15.119:0/2720178869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 msgr2=0x55bff1ae9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb15131f800 1 --2- 172.21.15.119:0/2720178869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 0x55bff1ae9af0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb140019fd0 tx=0x7fb140031480 comp rx=0 tx=0).stop 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb15131f800 1 -- 172.21.15.119:0/2720178869 shutdown_connections 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb15131f800 1 --2- 172.21.15.119:0/2720178869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 0x55bff1ae9af0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb15131f800 1 -- 172.21.15.119:0/2720178869 >> 172.21.15.119:0/2720178869 conn(0x55bff1ae5950 msgr2=0x55bff1ae39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb15131f800 1 -- 172.21.15.119:0/2720178869 shutdown_connections 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb15131f800 1 -- 172.21.15.119:0/2720178869 wait complete. 2024-04-23T18:31:19.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb15131f800 1 Processor -- start 2024-04-23T18:31:19.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb15131f800 1 -- start start 2024-04-23T18:31:19.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb15131f800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 0x55bff1af0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb15131f800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bff1aea730 con 0x55bff1ae96d0 2024-04-23T18:31:19.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb14cfe7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 0x55bff1af0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb14cfe7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 0x55bff1af0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55378/0 (socket says 172.21.15.119:55378) 2024-04-23T18:31:19.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.636+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 learned_addr learned my addr 172.21.15.119:0/3064904855 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.637+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bff1af1050 con 0x55bff1ae96d0 2024-04-23T18:31:19.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.637+0000 7fb14cfe7640 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 0x55bff1af0b10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb14001bab0 tx=0x7fb140023f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.637+0000 7fb0227fc640 1 -- 172.21.15.119:0/3064904855 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb140062040 con 0x55bff1ae96d0 2024-04-23T18:31:19.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.637+0000 7fb0227fc640 1 -- 172.21.15.119:0/3064904855 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14006d020 con 0x55bff1ae96d0 2024-04-23T18:31:19.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.637+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bff1af1050 con 0x55bff1ae96d0 2024-04-23T18:31:19.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.637+0000 7fb0227fc640 1 -- 172.21.15.119:0/3064904855 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb140058040 con 0x55bff1ae96d0 2024-04-23T18:31:19.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.637+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bff1af1050 con 0x55bff1ae96d0 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.638+0000 7fb0227fc640 1 -- 172.21.15.119:0/3064904855 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb14004d240 con 0x55bff1ae96d0 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.638+0000 7fb0227fc640 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb018036eb0 0x7fb018039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.638+0000 7fb0227fc640 1 -- 172.21.15.119:0/3064904855 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb14006e030 con 0x55bff1ae96d0 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.638+0000 7fb147fff640 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb018036eb0 0x7fb018039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.639+0000 7fb15131f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.639+0000 7fb15131f800 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bff1afc210 0x55bff1afe6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.639+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1afee20 con 0x55bff1afc210 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.639+0000 7fb147fff640 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb018036eb0 0x7fb018039370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55bff1ace470 tx=0x7fb13804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.639+0000 7fb14d7e8640 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bff1afc210 0x55bff1afe6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.639+0000 7fb14d7e8640 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bff1afc210 0x55bff1afe6d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.639+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff1afc210 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.639+0000 7fb15131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.639+0000 7fb15131f800 20 realm 2024-04-23T18:31:19.659 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.639+0000 7fb15131f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.639+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1aff230 con 0x55bff1afc210 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff1afc210 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb15131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb15131f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb15131f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affb00 con 0x55bff1afc210 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff1afc210 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb15131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb15131f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1afc210 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff1afc210 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb15131f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb15131f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.660 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb15131f800 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bff1b00c00 0x55bff1b02ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b03600 con 0x55bff1b00c00 2024-04-23T18:31:19.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb14cfe7640 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bff1b00c00 0x55bff1b02ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.640+0000 7fb14cfe7640 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bff1b00c00 0x55bff1b02ff0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.641+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.641+0000 7fb15131f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:19.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.641+0000 7fb15131f800 20 searching for the correct realm 2024-04-23T18:31:19.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.641+0000 7fb15131f800 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bff1b055b0 0x55bff1b07a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.641+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b08140 con 0x55bff1b055b0 2024-04-23T18:31:19.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.641+0000 7fb147fff640 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bff1b055b0 0x55bff1b07a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.641+0000 7fb147fff640 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bff1b055b0 0x55bff1b07a70 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.641+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.661 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.641+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b08140 con 0x55bff1b00c00 2024-04-23T18:31:19.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.642+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.642+0000 7fb14cfe7640 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb14007d040 0x7fb14003c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.642+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b08140 con 0x7fb14007d040 2024-04-23T18:31:19.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.642+0000 7fb14d7e8640 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb14007d040 0x7fb14003c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.642+0000 7fb14d7e8640 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb14007d040 0x7fb14003c960 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.643+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14800a4a0 con 0x7fb14007d040 2024-04-23T18:31:19.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.643+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1afc210 2024-04-23T18:31:19.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.643+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff1afc210 2024-04-23T18:31:19.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.643+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1afc210 2024-04-23T18:31:19.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.643+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff1afc210 2024-04-23T18:31:19.662 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.643+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x7fb14007d040 2024-04-23T18:31:19.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.643+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14800a4a0 con 0x7fb14007d040 2024-04-23T18:31:19.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.643+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x7fb14007d040 2024-04-23T18:31:19.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.644+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb14800a4a0 con 0x7fb14007d040 2024-04-23T18:31:19.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.644+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b00c00 2024-04-23T18:31:19.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.644+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.644+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b055b0 2024-04-23T18:31:19.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.644+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.644+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1afc210 2024-04-23T18:31:19.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.644+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff1afc210 2024-04-23T18:31:19.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.644+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x7fb14007d040 2024-04-23T18:31:19.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.645+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14800a4a0 con 0x7fb14007d040 2024-04-23T18:31:19.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.645+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1afc210 2024-04-23T18:31:19.663 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.645+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff1afc210 2024-04-23T18:31:19.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.645+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b00c00 2024-04-23T18:31:19.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.645+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.645+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b055b0 2024-04-23T18:31:19.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.645+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.645+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b055b0 2024-04-23T18:31:19.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.646+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.646+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x7fb14007d040 2024-04-23T18:31:19.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.646+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14800a4a0 con 0x7fb14007d040 2024-04-23T18:31:19.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.646+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b055b0 2024-04-23T18:31:19.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.646+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.646+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b055b0 2024-04-23T18:31:19.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.646+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.664 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.646+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1afc210 2024-04-23T18:31:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.647+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff1afc210 2024-04-23T18:31:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.647+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1afc210 2024-04-23T18:31:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.647+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff1afc210 2024-04-23T18:31:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.647+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x7fb14007d040 2024-04-23T18:31:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.647+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14800a4a0 con 0x7fb14007d040 2024-04-23T18:31:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.647+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b055b0 2024-04-23T18:31:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.647+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.647+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b00c00 2024-04-23T18:31:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.648+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.648+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1afc210 2024-04-23T18:31:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.648+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14800a4a0 con 0x55bff1afc210 2024-04-23T18:31:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.648+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b00c00 2024-04-23T18:31:19.665 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.648+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.648+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b055b0 2024-04-23T18:31:19.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.648+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.648+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x7fb14007d040 2024-04-23T18:31:19.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.649+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14800a4a0 con 0x7fb14007d040 2024-04-23T18:31:19.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.649+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b00c00 2024-04-23T18:31:19.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.649+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.649+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b055b0 2024-04-23T18:31:19.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.649+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.649+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x7fb14007d040 2024-04-23T18:31:19.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.649+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb14800a4a0 con 0x7fb14007d040 2024-04-23T18:31:19.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.649+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1afc210 2024-04-23T18:31:19.666 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bff1affea0 con 0x55bff1b00c00 2024-04-23T18:31:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b03ec0 con 0x55bff1afc210 2024-04-23T18:31:19.667 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b042b0 con 0x55bff1afc210 2024-04-23T18:31:19.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.650+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b042b0 con 0x7fb14007d040 2024-04-23T18:31:19.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb148040080 con 0x7fb14007d040 2024-04-23T18:31:19.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:19.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 20 zone default found 2024-04-23T18:31:19.668 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 4 Realm: () 2024-04-23T18:31:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 20 zonegroup default 2024-04-23T18:31:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b085c0 con 0x55bff1b00c00 2024-04-23T18:31:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0a340 con 0x55bff1b055b0 2024-04-23T18:31:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.669 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0a6e0 con 0x55bff1b055b0 2024-04-23T18:31:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.651+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.652+0000 7fb15131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.652+0000 7fb15131f800 20 started sync module instance, tier type = 2024-04-23T18:31:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.652+0000 7fb15131f800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.652+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b097e0 con 0x55bff1b00c00 2024-04-23T18:31:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.653+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.653+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94282881995568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0aa80 con 0x55bff1b00c00 2024-04-23T18:31:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.653+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0b440 con 0x55bff1afc210 2024-04-23T18:31:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.654+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94282881995568] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.654+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.670 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.654+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94282882002832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0b860 con 0x55bff1afc210 2024-04-23T18:31:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.654+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0c220 con 0x55bff1b055b0 2024-04-23T18:31:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.655+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.655+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94282882006384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0ca70 con 0x55bff1b055b0 2024-04-23T18:31:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.655+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0d530 con 0x55bff1b00c00 2024-04-23T18:31:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.655+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94282882002832] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.656+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.656+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94282882003888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0de00 con 0x55bff1b00c00 2024-04-23T18:31:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.656+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94282882006384] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.656+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0c5c0 con 0x55bff1afc210 2024-04-23T18:31:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.657+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.657+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94282882016016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0c5c0 con 0x55bff1afc210 2024-04-23T18:31:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.657+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0f0f0 con 0x7fb14007d040 2024-04-23T18:31:19.671 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.657+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94282882003888] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.658+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94282882016016] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.658+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x7fb14007d040 2024-04-23T18:31:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.658+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94282882013520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0f0b0 con 0x7fb14007d040 2024-04-23T18:31:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.658+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0f570 con 0x7fb14007d040 2024-04-23T18:31:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.660+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94282882013520] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x7fb14007d040 2024-04-23T18:31:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.660+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x7fb14007d040 2024-04-23T18:31:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.660+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94282882017072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0f530 con 0x7fb14007d040 2024-04-23T18:31:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.660+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0ff50 con 0x7fb14007d040 2024-04-23T18:31:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.661+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94282882017072] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x7fb14007d040 2024-04-23T18:31:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.661+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x7fb14007d040 2024-04-23T18:31:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.661+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94282882021952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0ff10 con 0x7fb14007d040 2024-04-23T18:31:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.661+0000 7fb15131f800 20 add_watcher() i=0 2024-04-23T18:31:19.672 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.661+0000 7fb15131f800 20 add_watcher() i=1 2024-04-23T18:31:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.661+0000 7fb15131f800 20 add_watcher() i=2 2024-04-23T18:31:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.661+0000 7fb15131f800 20 add_watcher() i=3 2024-04-23T18:31:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.661+0000 7fb15131f800 20 add_watcher() i=4 2024-04-23T18:31:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.661+0000 7fb15131f800 20 add_watcher() i=5 2024-04-23T18:31:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.661+0000 7fb15131f800 20 add_watcher() i=6 2024-04-23T18:31:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.662+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94282882021952] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x7fb14007d040 2024-04-23T18:31:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.662+0000 7fb15131f800 20 add_watcher() i=7 2024-04-23T18:31:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.662+0000 7fb15131f800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.662+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b133a0 con 0x55bff1afc210 2024-04-23T18:31:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.662+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.673 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.662+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94282882018128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b10890 con 0x55bff1afc210 2024-04-23T18:31:19.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.663+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94282882018128] v34'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.663+0000 7fb002fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.663+0000 7fb15131f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:19.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.663+0000 7fb15131f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:19.676 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.663+0000 7fb15131f800 5 note: GC not initialized 2024-04-23T18:31:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.664+0000 7fb001fe3640 20 reqs_thread_entry: start 2024-04-23T18:31:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.664+0000 7fb15131f800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.664+0000 7fb15131f800 20 Filter name: none 2024-04-23T18:31:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.664+0000 7faf737fe640 20 reqs_thread_entry: start 2024-04-23T18:31:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.664+0000 7fb15131f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-23T18:31:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.664+0000 7fb15131f800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.664+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b46ad0 con 0x7fb14007d040 2024-04-23T18:31:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.665+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7fb148040080 con 0x7fb14007d040 2024-04-23T18:31:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.665+0000 7fb15131f800 20 rados_obj.operate() r=0 bl.length=503 2024-04-23T18:31:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.665+0000 7fb15131f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-23T18:31:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.665+0000 7fb15131f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.665+0000 7fb15131f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:19.677 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.665+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b4d4e0 con 0x7fb14007d040 2024-04-23T18:31:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.666+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb148040080 con 0x7fb14007d040 2024-04-23T18:31:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.666+0000 7fb15131f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.666+0000 7fb15131f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.666+0000 7fb15131f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-23T18:31:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.666+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94282882273104 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b48bb0 con 0x55bff1afc210 2024-04-23T18:31:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.666+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== watch-notify(notify (1) cookie 94282882016016 notify 146028888103 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fb1480455c0 con 0x55bff1afc210 2024-04-23T18:31:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.666+0000 7fb023fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94282882016016 notifier 4889 bl.length()=636 2024-04-23T18:31:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.666+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 notify.4 [notify cookie 94282882273104 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.666+0000 7fb023fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.666+0000 7fb023fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.666+0000 7fb023fff640 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb010003ea0 con 0x55bff1afc210 2024-04-23T18:31:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.667+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.678 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.667+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== watch-notify(notify_complete (2) cookie 94282882273104 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb148045790 con 0x55bff1afc210 2024-04-23T18:31:19.679 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-23T18:31:18.209839Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:31:18.209827Z","tags":[],"group_ids":[]} 2024-04-23T18:31:19.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.667+0000 7fb002fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.667+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94282882018128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b48fc0 con 0x55bff1afc210 2024-04-23T18:31:19.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.668+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94282882018128] v34'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.668+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94282881995568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0eb50 con 0x55bff1b00c00 2024-04-23T18:31:19.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.669+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94282881995568] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.669+0000 7fb15131f800 20 remove_watcher() i=0 2024-04-23T18:31:19.685 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.669+0000 7fb15131f800 2 removed watcher, disabling cache 2024-04-23T18:31:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.670+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94282882002832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0eb50 con 0x55bff1afc210 2024-04-23T18:31:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.671+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94282882002832] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.671+0000 7fb15131f800 20 remove_watcher() i=1 2024-04-23T18:31:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.671+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94282882006384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0eb50 con 0x55bff1b055b0 2024-04-23T18:31:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.672+0000 7fb147fff640 1 -- 172.21.15.119:0/3064904855 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94282882006384] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb13807f070 con 0x55bff1b055b0 2024-04-23T18:31:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.672+0000 7fb15131f800 20 remove_watcher() i=2 2024-04-23T18:31:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.672+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94282882003888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0af90 con 0x55bff1b00c00 2024-04-23T18:31:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.673+0000 7fb14cfe7640 1 -- 172.21.15.119:0/3064904855 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94282882003888] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb140065040 con 0x55bff1b00c00 2024-04-23T18:31:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.673+0000 7fb15131f800 20 remove_watcher() i=3 2024-04-23T18:31:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.673+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94282882016016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0bd70 con 0x55bff1afc210 2024-04-23T18:31:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.673+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94282882016016] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x55bff1afc210 2024-04-23T18:31:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.673+0000 7fb15131f800 20 remove_watcher() i=4 2024-04-23T18:31:19.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.674+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94282882013520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0b440 con 0x7fb14007d040 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.675+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94282882013520] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x7fb14007d040 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.675+0000 7fb15131f800 20 remove_watcher() i=5 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.675+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94282882017072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0b440 con 0x7fb14007d040 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.675+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94282882017072] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x7fb14007d040 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.676+0000 7fb15131f800 20 remove_watcher() i=6 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.676+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94282882021952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bff1b0bd70 con 0x7fb14007d040 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.676+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94282882021952] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb148040080 con 0x7fb14007d040 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.676+0000 7fb15131f800 20 remove_watcher() i=7 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb14007d040 msgr2=0x7fb14003c960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7fb14007d040 0x7fb14003c960 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bff1afc210 msgr2=0x55bff1afe6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bff1afc210 0x55bff1afe6d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bff1b00c00 msgr2=0x55bff1b02ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bff1b00c00 0x55bff1b02ff0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bff1b055b0 msgr2=0x55bff1b07a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55bff1b055b0 0x55bff1b07a70 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb018036eb0 msgr2=0x7fb018039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb018036eb0 0x7fb018039370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55bff1ace470 tx=0x7fb13804f000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 msgr2=0x55bff1af0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 0x55bff1af0b10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb14001bab0 tx=0x7fb140023f50 comp rx=0 tx=0).stop 2024-04-23T18:31:19.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb14d7e8640 1 -- 172.21.15.119:0/3064904855 reap_dead start 2024-04-23T18:31:19.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 shutdown_connections 2024-04-23T18:31:19.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 --2- 172.21.15.119:0/3064904855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1ae96d0 0x55bff1af0b10 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 >> 172.21.15.119:0/3064904855 conn(0x55bff1ae5950 msgr2=0x55bff1ae2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 shutdown_connections 2024-04-23T18:31:19.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/3064904855 wait complete. 2024-04-23T18:31:19.688 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/855444547 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb024036eb0 msgr2=0x7fb024039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 --2- 172.21.15.119:0/855444547 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb024036eb0 0x7fb024039370 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55bff1ac5ae0 tx=0x7fb138005ac0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/855444547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1adc4d0 msgr2=0x55bff1adc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 --2- 172.21.15.119:0/855444547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1adc4d0 0x55bff1adc8f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb14001afd0 tx=0x7fb14001ba20 comp rx=0 tx=0).stop 2024-04-23T18:31:19.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/855444547 shutdown_connections 2024-04-23T18:31:19.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 --2- 172.21.15.119:0/855444547 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb024036eb0 0x7fb024039370 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 --2- 172.21.15.119:0/855444547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff1adc4d0 0x55bff1adc8f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/855444547 >> 172.21.15.119:0/855444547 conn(0x55bff1ad0570 msgr2=0x55bff1ad0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/855444547 shutdown_connections 2024-04-23T18:31:19.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.677+0000 7fb15131f800 1 -- 172.21.15.119:0/855444547 wait complete. 2024-04-23T18:31:19.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bff1acb4c0 msgr2=0x55bff1acd910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55bff1acb4c0 0x55bff1acd910 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bff19c9590 msgr2=0x55bff1ac4c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.689 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55bff19c9590 0x55bff1ac4c60 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bff1ac7530 msgr2=0x55bff1ac9920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55bff1ac7530 0x55bff1ac9920 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb034036e60 msgr2=0x7fb034039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb034036e60 0x7fb034039320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb138054000 tx=0x7fb13804e000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c5a80 msgr2=0x55bff1abdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 --2- 172.21.15.119:0/2912029705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bff19c5a80 0x55bff1abdc40 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb140001ed0 tx=0x7fb140000ed0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb14d7e8640 1 -- 172.21.15.119:0/2912029705 reap_dead start 2024-04-23T18:31:19.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 shutdown_connections 2024-04-23T18:31:19.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 >> 172.21.15.119:0/2912029705 conn(0x55bff19bf430 msgr2=0x55bff1ab03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.690 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 shutdown_connections 2024-04-23T18:31:19.691 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.678+0000 7fb15131f800 1 -- 172.21.15.119:0/2912029705 wait complete. 2024-04-23T18:31:19.691 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:19.691 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:19.692 ERROR:root:0 2024-04-23T18:31:19.692 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-23T18:31:19.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-23T18:31:19.692 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-04-23T18:31:19.737 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:19.737 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:19.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.745+0000 7f40ba03c800 1 Processor -- start 2024-04-23T18:31:19.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.745+0000 7f40ba03c800 1 -- start start 2024-04-23T18:31:19.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.745+0000 7f40ba03c800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558a197755b0 0x558a197779a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.745+0000 7f40ba03c800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558a19621560 con 0x558a19771aa0 2024-04-23T18:31:19.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.745+0000 7f40ba03c800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x558a19612e20 con 0x558a197755b0 2024-04-23T18:31:19.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.745+0000 7f40b44d4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558a197755b0 0x558a197779a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.745+0000 7f40b4cd5640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x558a19771aa0 0x558a19773e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50656/0 (socket says 172.21.15.119:50656) 2024-04-23T18:31:19.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.745+0000 7f40b4cd5640 1 -- 172.21.15.119:0/3010302325 learned_addr learned my addr 172.21.15.119:0/3010302325 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:31:19.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.745+0000 7f40b44d4640 1 -- 172.21.15.119:0/3010302325 >> v1:172.21.15.62:6789/0 conn(0x558a19771aa0 legacy=0x558a19773e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.745+0000 7f40b44d4640 1 -- 172.21.15.119:0/3010302325 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a19620e60 con 0x558a197755b0 2024-04-23T18:31:19.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.747+0000 7f40b44d4640 1 --2- 172.21.15.119:0/3010302325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a197755b0 0x558a197779a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f40a800a470 tx=0x7f40a801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9693e052328b7559 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.747+0000 7f40b3cd3640 1 -- 172.21.15.119:0/3010302325 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a8057070 con 0x558a197755b0 2024-04-23T18:31:19.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.747+0000 7f40b3cd3640 1 -- 172.21.15.119:0/3010302325 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a8052570 con 0x558a197755b0 2024-04-23T18:31:19.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.747+0000 7f40b3cd3640 1 -- 172.21.15.119:0/3010302325 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a8052870 con 0x558a197755b0 2024-04-23T18:31:19.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.748+0000 7f40ba03c800 1 -- 172.21.15.119:0/3010302325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a197755b0 msgr2=0x558a197779a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.748+0000 7f40ba03c800 1 --2- 172.21.15.119:0/3010302325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a197755b0 0x558a197779a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f40a800a470 tx=0x7f40a801ce90 comp rx=0 tx=0).stop 2024-04-23T18:31:19.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.748+0000 7f40ba03c800 1 -- 172.21.15.119:0/3010302325 shutdown_connections 2024-04-23T18:31:19.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.748+0000 7f40ba03c800 1 --2- 172.21.15.119:0/3010302325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a197755b0 0x558a197779a0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.748+0000 7f40ba03c800 1 -- 172.21.15.119:0/3010302325 >> 172.21.15.119:0/3010302325 conn(0x558a1976b430 msgr2=0x558a1976d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.748+0000 7f40ba03c800 1 -- 172.21.15.119:0/3010302325 shutdown_connections 2024-04-23T18:31:19.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.748+0000 7f40ba03c800 1 -- 172.21.15.119:0/3010302325 wait complete. 2024-04-23T18:31:19.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.760+0000 7f40ba03c800 1 Processor -- start 2024-04-23T18:31:19.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.760+0000 7f40ba03c800 1 -- start start 2024-04-23T18:31:19.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.760+0000 7f40ba03c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a19771aa0 0x558a197713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.760+0000 7f40ba03c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558a196bc5d0 con 0x558a19771aa0 2024-04-23T18:31:19.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.760+0000 7f40b4cd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a19771aa0 0x558a197713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.760+0000 7f40b4cd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a19771aa0 0x558a197713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55392/0 (socket says 172.21.15.119:55392) 2024-04-23T18:31:19.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.760+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1304828505 learned_addr learned my addr 172.21.15.119:0/1304828505 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.761+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1304828505 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a19632860 con 0x558a19771aa0 2024-04-23T18:31:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.761+0000 7f40b4cd5640 1 --2- 172.21.15.119:0/1304828505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a19771aa0 0x558a197713e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f40a4001de0 tx=0x7f40a400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6005193add63e525 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.761+0000 7f3fa2e0d640 1 -- 172.21.15.119:0/1304828505 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a4012020 con 0x558a19771aa0 2024-04-23T18:31:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.761+0000 7f3fa2e0d640 1 -- 172.21.15.119:0/1304828505 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a400e5a0 con 0x558a19771aa0 2024-04-23T18:31:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.761+0000 7f3fa2e0d640 1 -- 172.21.15.119:0/1304828505 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a400e8c0 con 0x558a19771aa0 2024-04-23T18:31:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40ba03c800 1 -- 172.21.15.119:0/1304828505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a19771aa0 msgr2=0x558a197713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1304828505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a19771aa0 0x558a197713e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f40a4001de0 tx=0x7f40a400b6c0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40ba03c800 1 -- 172.21.15.119:0/1304828505 shutdown_connections 2024-04-23T18:31:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1304828505 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a19771aa0 0x558a197713e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40ba03c800 1 -- 172.21.15.119:0/1304828505 >> 172.21.15.119:0/1304828505 conn(0x558a1976b430 msgr2=0x558a1985db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40ba03c800 1 -- 172.21.15.119:0/1304828505 shutdown_connections 2024-04-23T18:31:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40ba03c800 1 -- 172.21.15.119:0/1304828505 wait complete. 2024-04-23T18:31:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40ba03c800 1 Processor -- start 2024-04-23T18:31:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40ba03c800 1 -- start start 2024-04-23T18:31:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40ba03c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a19771aa0 0x558a1986be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40ba03c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558a1977a1f0 con 0x558a19771aa0 2024-04-23T18:31:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40b4cd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a19771aa0 0x558a1986be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40b4cd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a19771aa0 0x558a1986be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55406/0 (socket says 172.21.15.119:55406) 2024-04-23T18:31:19.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.762+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1327424030 learned_addr learned my addr 172.21.15.119:0/1327424030 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.763+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1327424030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a19630eb0 con 0x558a19771aa0 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.763+0000 7f40b4cd5640 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a19771aa0 0x558a1986be10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f40a400c010 tx=0x7f40a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.763+0000 7f3fa160a640 1 -- 172.21.15.119:0/1327424030 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a4012070 con 0x558a19771aa0 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.763+0000 7f3fa160a640 1 -- 172.21.15.119:0/1327424030 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a401a7a0 con 0x558a19771aa0 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.763+0000 7f3fa160a640 1 -- 172.21.15.119:0/1327424030 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a401aa80 con 0x558a19771aa0 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.763+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a1986c350 con 0x558a19771aa0 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.763+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a1986c870 con 0x558a19771aa0 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.764+0000 7f3fa160a640 1 -- 172.21.15.119:0/1327424030 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f40a4015020 con 0x558a19771aa0 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.764+0000 7f3fa160a640 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f9c036eb0 0x7f3f9c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.764+0000 7f3fa160a640 1 -- 172.21.15.119:0/1327424030 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f40a4020070 con 0x558a19771aa0 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.764+0000 7f40b44d4640 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f9c036eb0 0x7f3f9c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.764+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558a197755b0 0x558a19872e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.764+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198733c0 con 0x558a197755b0 2024-04-23T18:31:19.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.764+0000 7f40b54d6640 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558a197755b0 0x558a19872e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.764+0000 7f40b44d4640 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f9c036eb0 0x7f3f9c039370 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f40a8054000 tx=0x7f40a804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.764+0000 7f40b54d6640 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558a197755b0 0x558a19872e80 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.765+0000 7f40b54d6640 1 -- 172.21.15.119:0/1327424030 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a197755b0 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.765+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a19870450 con 0x558a197755b0 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.765+0000 7f40b54d6640 1 -- 172.21.15.119:0/1327424030 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a197755b0 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.765+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558a198756f0 0x558a19877ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.765+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198781d0 con 0x558a198756f0 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.765+0000 7f40b4cd5640 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558a198756f0 0x558a19877ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.765+0000 7f40b4cd5640 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558a198756f0 0x558a19877ae0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.766+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1327424030 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40a402b070 con 0x558a198756f0 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.766+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198746a0 con 0x558a197755b0 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.766+0000 7f40b54d6640 1 -- 172.21.15.119:0/1327424030 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a197755b0 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.766+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558a19879630 0x558a1987bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.766+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a1987c220 con 0x558a19879630 2024-04-23T18:31:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.766+0000 7f40b44d4640 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558a19879630 0x558a1987bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.766+0000 7f40b44d4640 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558a19879630 0x558a1987bac0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.767+0000 7f40b44d4640 1 -- 172.21.15.119:0/1327424030 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40a8052a40 con 0x558a19879630 2024-04-23T18:31:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.767+0000 7f40ba03c800 1 Processor -- start 2024-04-23T18:31:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.767+0000 7f40ba03c800 1 -- start start 2024-04-23T18:31:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.767+0000 7f40ba03c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a1988a5c0 0x558a1988a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.767+0000 7f40ba03c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558a19662df0 con 0x558a1988a5c0 2024-04-23T18:31:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.767+0000 7f40b4cd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a1988a5c0 0x558a1988a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.767+0000 7f40b4cd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a1988a5c0 0x558a1988a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55420/0 (socket says 172.21.15.119:55420) 2024-04-23T18:31:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.767+0000 7f40b4cd5640 1 -- 172.21.15.119:0/738621686 learned_addr learned my addr 172.21.15.119:0/738621686 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.768+0000 7f40b4cd5640 1 -- 172.21.15.119:0/738621686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a1988af20 con 0x558a1988a5c0 2024-04-23T18:31:19.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.768+0000 7f40b4cd5640 1 --2- 172.21.15.119:0/738621686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a1988a5c0 0x558a1988a9e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f40a4022530 tx=0x7f40a4018a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.768+0000 7f3f9a7fc640 1 -- 172.21.15.119:0/738621686 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a4033030 con 0x558a1988a5c0 2024-04-23T18:31:19.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.768+0000 7f3f9a7fc640 1 -- 172.21.15.119:0/738621686 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a40440c0 con 0x558a1988a5c0 2024-04-23T18:31:19.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.768+0000 7f40ba03c800 1 -- 172.21.15.119:0/738621686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a1988b990 con 0x558a1988a5c0 2024-04-23T18:31:19.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.768+0000 7f3f9a7fc640 1 -- 172.21.15.119:0/738621686 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a4043030 con 0x558a1988a5c0 2024-04-23T18:31:19.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.768+0000 7f40ba03c800 1 -- 172.21.15.119:0/738621686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a1988be90 con 0x558a1988a5c0 2024-04-23T18:31:19.790 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.769+0000 7f3f9a7fc640 1 -- 172.21.15.119:0/738621686 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f40a4036070 con 0x558a1988a5c0 2024-04-23T18:31:19.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.769+0000 7f3f9a7fc640 1 --2- 172.21.15.119:0/738621686 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f8c036eb0 0x7f3f8c039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.769+0000 7f3f9a7fc640 1 -- 172.21.15.119:0/738621686 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f40a4034070 con 0x558a1988a5c0 2024-04-23T18:31:19.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.769+0000 7f40b44d4640 1 --2- 172.21.15.119:0/738621686 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f8c036eb0 0x7f3f8c039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.769+0000 7f40ba03c800 1 Processor -- start 2024-04-23T18:31:19.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.769+0000 7f40ba03c800 1 -- start start 2024-04-23T18:31:19.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.769+0000 7f40b44d4640 1 --2- 172.21.15.119:0/738621686 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f8c036eb0 0x7f3f8c039370 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x558a19874670 tx=0x7f40a8005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.770+0000 7f40ba03c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 0x558a19897be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.770+0000 7f40ba03c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558a1976fa60 con 0x558a198977c0 2024-04-23T18:31:19.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.770+0000 7f40b4cd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 0x558a19897be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.770+0000 7f40b4cd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 0x558a19897be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55422/0 (socket says 172.21.15.119:55422) 2024-04-23T18:31:19.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.770+0000 7f40b4cd5640 1 -- 172.21.15.119:0/445386989 learned_addr learned my addr 172.21.15.119:0/445386989 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.770+0000 7f40b4cd5640 1 -- 172.21.15.119:0/445386989 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a198981b0 con 0x558a198977c0 2024-04-23T18:31:19.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.770+0000 7f40b4cd5640 1 --2- 172.21.15.119:0/445386989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 0x558a19897be0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f40a402a000 tx=0x7f40a404c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39078075d2e841e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.770+0000 7f3f8bfff640 1 -- 172.21.15.119:0/445386989 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a4057040 con 0x558a198977c0 2024-04-23T18:31:19.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.770+0000 7f3f8bfff640 1 -- 172.21.15.119:0/445386989 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a4025dd0 con 0x558a198977c0 2024-04-23T18:31:19.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.770+0000 7f3f8bfff640 1 -- 172.21.15.119:0/445386989 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a4041d40 con 0x558a198977c0 2024-04-23T18:31:19.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40ba03c800 1 -- 172.21.15.119:0/445386989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 msgr2=0x558a19897be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40ba03c800 1 --2- 172.21.15.119:0/445386989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 0x558a19897be0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f40a402a000 tx=0x7f40a404c760 comp rx=0 tx=0).stop 2024-04-23T18:31:19.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40ba03c800 1 -- 172.21.15.119:0/445386989 shutdown_connections 2024-04-23T18:31:19.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40ba03c800 1 --2- 172.21.15.119:0/445386989 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 0x558a19897be0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40ba03c800 1 -- 172.21.15.119:0/445386989 >> 172.21.15.119:0/445386989 conn(0x558a19893a90 msgr2=0x558a19891af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40ba03c800 1 -- 172.21.15.119:0/445386989 shutdown_connections 2024-04-23T18:31:19.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40ba03c800 1 -- 172.21.15.119:0/445386989 wait complete. 2024-04-23T18:31:19.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40ba03c800 1 Processor -- start 2024-04-23T18:31:19.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40ba03c800 1 -- start start 2024-04-23T18:31:19.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40ba03c800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 0x558a1989eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40ba03c800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558a19898880 con 0x558a198977c0 2024-04-23T18:31:19.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40b4cd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 0x558a1989eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40b4cd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 0x558a1989eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55426/0 (socket says 172.21.15.119:55426) 2024-04-23T18:31:19.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.771+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 learned_addr learned my addr 172.21.15.119:0/1126082065 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.772+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a1989f030 con 0x558a198977c0 2024-04-23T18:31:19.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.772+0000 7f40b4cd5640 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 0x558a1989eaf0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f40a4025d50 tx=0x7f40a403d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.772+0000 7f3f8a7fc640 1 -- 172.21.15.119:0/1126082065 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a4031bc0 con 0x558a198977c0 2024-04-23T18:31:19.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.772+0000 7f3f8a7fc640 1 -- 172.21.15.119:0/1126082065 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a4031d60 con 0x558a198977c0 2024-04-23T18:31:19.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.772+0000 7f3f8a7fc640 1 -- 172.21.15.119:0/1126082065 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40a403d180 con 0x558a198977c0 2024-04-23T18:31:19.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.772+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a1989f030 con 0x558a198977c0 2024-04-23T18:31:19.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.772+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a1989f030 con 0x558a198977c0 2024-04-23T18:31:19.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.773+0000 7f3f8a7fc640 1 -- 172.21.15.119:0/1126082065 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f40a403d320 con 0x558a198977c0 2024-04-23T18:31:19.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.773+0000 7f3f8a7fc640 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f80036eb0 0x7f3f80039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.773+0000 7f3f8a7fc640 1 -- 172.21.15.119:0/1126082065 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f40a4071d30 con 0x558a198977c0 2024-04-23T18:31:19.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.773+0000 7f40b44d4640 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f80036eb0 0x7f3f80039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.773+0000 7f40b44d4640 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f80036eb0 0x7f3f80039370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f40a8052fd0 tx=0x7f40a804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.773+0000 7f40ba03c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558a198aa290 0x558a198ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198acea0 con 0x558a198aa290 2024-04-23T18:31:19.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40b54d6640 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558a198aa290 0x558a198ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40b54d6640 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558a198aa290 0x558a198ac750 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a198aa290 2024-04-23T18:31:19.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40ba03c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40ba03c800 20 realm 2024-04-23T18:31:19.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40ba03c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.794 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198ad2b0 con 0x558a198aa290 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a198aa290 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40ba03c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40ba03c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40ba03c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.774+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198adb80 con 0x558a198aa290 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a198aa290 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40ba03c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40ba03c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aa290 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a198aa290 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40ba03c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40ba03c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558a198aec80 0x558a198b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198b1630 con 0x558a198aec80 2024-04-23T18:31:19.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40b4cd5640 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558a198aec80 0x558a198b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40b4cd5640 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558a198aec80 0x558a198b1070 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40ba03c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:19.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40ba03c800 20 searching for the correct realm 2024-04-23T18:31:19.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558a198b35e0 0x558a198b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.775+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198b6170 con 0x558a198b35e0 2024-04-23T18:31:19.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.776+0000 7f40b44d4640 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558a198b35e0 0x558a198b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.776+0000 7f40b44d4640 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558a198b35e0 0x558a198b5aa0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.776+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.776+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198b6170 con 0x558a198aec80 2024-04-23T18:31:19.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.776+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.776+0000 7f40b4cd5640 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f40a4066050 0x7f40a4028170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.776+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198b6170 con 0x7f40a4066050 2024-04-23T18:31:19.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.777+0000 7f40b54d6640 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f40a4066050 0x7f40a4028170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.777+0000 7f40b54d6640 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f40a4066050 0x7f40a4028170 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.777+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ac00a4a0 con 0x7f40a4066050 2024-04-23T18:31:19.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.777+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aa290 2024-04-23T18:31:19.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.777+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a198aa290 2024-04-23T18:31:19.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.777+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aa290 2024-04-23T18:31:19.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.778+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a198aa290 2024-04-23T18:31:19.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.778+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x7f40a4066050 2024-04-23T18:31:19.797 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.778+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ac00a4a0 con 0x7f40a4066050 2024-04-23T18:31:19.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.778+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x7f40a4066050 2024-04-23T18:31:19.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.778+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f40ac00a4a0 con 0x7f40a4066050 2024-04-23T18:31:19.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.778+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aec80 2024-04-23T18:31:19.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.778+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.778+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198b35e0 2024-04-23T18:31:19.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.779+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.779+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aa290 2024-04-23T18:31:19.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.779+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a198aa290 2024-04-23T18:31:19.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.779+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x7f40a4066050 2024-04-23T18:31:19.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.779+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ac00a4a0 con 0x7f40a4066050 2024-04-23T18:31:19.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.779+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aa290 2024-04-23T18:31:19.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.779+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a198aa290 2024-04-23T18:31:19.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.779+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aec80 2024-04-23T18:31:19.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.780+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.780+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198b35e0 2024-04-23T18:31:19.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.780+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.780+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198b35e0 2024-04-23T18:31:19.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.780+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.780+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x7f40a4066050 2024-04-23T18:31:19.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.781+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ac00a4a0 con 0x7f40a4066050 2024-04-23T18:31:19.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.781+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198b35e0 2024-04-23T18:31:19.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.781+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.781+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198b35e0 2024-04-23T18:31:19.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.781+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.781+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aa290 2024-04-23T18:31:19.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.781+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a198aa290 2024-04-23T18:31:19.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.781+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aa290 2024-04-23T18:31:19.800 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.781+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a198aa290 2024-04-23T18:31:19.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.781+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x7f40a4066050 2024-04-23T18:31:19.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.782+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ac00a4a0 con 0x7f40a4066050 2024-04-23T18:31:19.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.782+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198b35e0 2024-04-23T18:31:19.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.782+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.782+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aec80 2024-04-23T18:31:19.801 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.782+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.782+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aa290 2024-04-23T18:31:19.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.782+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ac00a4a0 con 0x558a198aa290 2024-04-23T18:31:19.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.782+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aec80 2024-04-23T18:31:19.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.783+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.783+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198b35e0 2024-04-23T18:31:19.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.783+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.783+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x7f40a4066050 2024-04-23T18:31:19.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.783+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ac00a4a0 con 0x7f40a4066050 2024-04-23T18:31:19.806 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.783+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aec80 2024-04-23T18:31:19.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.783+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.783+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198b35e0 2024-04-23T18:31:19.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.784+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.784+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x7f40a4066050 2024-04-23T18:31:19.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.784+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40ac00a4a0 con 0x7f40a4066050 2024-04-23T18:31:19.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.784+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aa290 2024-04-23T18:31:19.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a198adf20 con 0x558a198aec80 2024-04-23T18:31:19.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:19.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:19.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:19.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:19.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:19.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:19.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198b1ef0 con 0x558a198aa290 2024-04-23T18:31:19.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198b22e0 con 0x558a198aa290 2024-04-23T18:31:19.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.810 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.785+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198b22e0 con 0x7f40a4066050 2024-04-23T18:31:19.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f40ac040080 con 0x7f40a4066050 2024-04-23T18:31:19.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:19.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 20 zone default found 2024-04-23T18:31:19.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 4 Realm: () 2024-04-23T18:31:19.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:19.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:19.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:19.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 20 zonegroup default 2024-04-23T18:31:19.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198b65f0 con 0x558a198aec80 2024-04-23T18:31:19.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198b8370 con 0x558a198b35e0 2024-04-23T18:31:19.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198b8710 con 0x558a198b35e0 2024-04-23T18:31:19.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.786+0000 7f40ba03c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.787+0000 7f40ba03c800 20 started sync module instance, tier type = 2024-04-23T18:31:19.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.787+0000 7f40ba03c800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:19.814 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.787+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198b7810 con 0x558a198aec80 2024-04-23T18:31:19.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.787+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.788+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94051622417248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198b8ab0 con 0x558a198aec80 2024-04-23T18:31:19.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.788+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198b9470 con 0x558a198aa290 2024-04-23T18:31:19.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.789+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94051622417248] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.789+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.789+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94051622424512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198b9890 con 0x558a198aa290 2024-04-23T18:31:19.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.789+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198ba250 con 0x558a198b35e0 2024-04-23T18:31:19.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.790+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.790+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94051622428064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198baaf0 con 0x558a198b35e0 2024-04-23T18:31:19.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.790+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198bb570 con 0x558a198aec80 2024-04-23T18:31:19.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.790+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94051622424512] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.791+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94051622428064] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.791+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.791+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94051622430272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198b93e0 con 0x558a198aec80 2024-04-23T18:31:19.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.791+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198bbe40 con 0x558a198aa290 2024-04-23T18:31:19.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.792+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94051622430272] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.792+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.792+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94051622432864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198bbe40 con 0x558a198aa290 2024-04-23T18:31:19.817 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.792+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198bc840 con 0x7f40a4066050 2024-04-23T18:31:19.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.793+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x7f40a4066050 2024-04-23T18:31:19.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.793+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94051622437712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198bc770 con 0x7f40a4066050 2024-04-23T18:31:19.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.793+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198bd760 con 0x7f40a4066050 2024-04-23T18:31:19.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.793+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94051622432864] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.794+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94051622437712] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x7f40a4066050 2024-04-23T18:31:19.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.794+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x7f40a4066050 2024-04-23T18:31:19.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.794+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94051622441552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198bcbe0 con 0x7f40a4066050 2024-04-23T18:31:19.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.794+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198bdd40 con 0x7f40a4066050 2024-04-23T18:31:19.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.795+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94051622441552] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x7f40a4066050 2024-04-23T18:31:19.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.796+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x7f40a4066050 2024-04-23T18:31:19.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.796+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94051622435216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198bdd40 con 0x7f40a4066050 2024-04-23T18:31:19.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.796+0000 7f40ba03c800 20 add_watcher() i=0 2024-04-23T18:31:19.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.796+0000 7f40ba03c800 20 add_watcher() i=1 2024-04-23T18:31:19.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.796+0000 7f40ba03c800 20 add_watcher() i=2 2024-04-23T18:31:19.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.796+0000 7f40ba03c800 20 add_watcher() i=3 2024-04-23T18:31:19.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.796+0000 7f40ba03c800 20 add_watcher() i=4 2024-04-23T18:31:19.820 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.796+0000 7f40ba03c800 20 add_watcher() i=5 2024-04-23T18:31:19.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.796+0000 7f40ba03c800 20 add_watcher() i=6 2024-04-23T18:31:19.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.797+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94051622435216] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x7f40a4066050 2024-04-23T18:31:19.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.797+0000 7f40ba03c800 20 add_watcher() i=7 2024-04-23T18:31:19.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.797+0000 7f40ba03c800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:19.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.797+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198c0fd0 con 0x558a198aa290 2024-04-23T18:31:19.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.797+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.797+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94051622443520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198be2d0 con 0x558a198aa290 2024-04-23T18:31:19.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.798+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94051622443520] v34'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.827 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.798+0000 7f3f6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.798+0000 7f40ba03c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:19.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.798+0000 7f40ba03c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:19.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.798+0000 7f40ba03c800 5 note: GC not initialized 2024-04-23T18:31:19.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.798+0000 7f3f69fe3640 20 reqs_thread_entry: start 2024-04-23T18:31:19.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.798+0000 7f40ba03c800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:19.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.799+0000 7f40ba03c800 20 Filter name: none 2024-04-23T18:31:19.828 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.799+0000 7f3edb7fe640 20 reqs_thread_entry: start 2024-04-23T18:31:19.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.799+0000 7f40ba03c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-23T18:31:19.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.799+0000 7f40ba03c800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.799+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198f4860 con 0x7f40a4066050 2024-04-23T18:31:19.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.799+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f40ac040080 con 0x7f40a4066050 2024-04-23T18:31:19.829 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.799+0000 7f40ba03c800 20 rados_obj.operate() r=0 bl.length=460 2024-04-23T18:31:19.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.799+0000 7f40ba03c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-23T18:31:19.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.799+0000 7f40ba03c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.799+0000 7f40ba03c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:19.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.800+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198fae40 con 0x7f40a4066050 2024-04-23T18:31:19.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.801+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x7f40a4066050 2024-04-23T18:31:19.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.801+0000 7f40ba03c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:19.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.801+0000 7f40ba03c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.801+0000 7f40ba03c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-23T18:31:19.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.801+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94051622693040 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a198f6530 con 0x558a198aa290 2024-04-23T18:31:19.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.801+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== watch-notify(notify (1) cookie 94051622432864 notify 146028888104 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f40ac0455c0 con 0x558a198aa290 2024-04-23T18:31:19.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.801+0000 7f3f8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 94051622432864 notifier 4896 bl.length()=666 2024-04-23T18:31:19.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.801+0000 7f3f8bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:19.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.801+0000 7f3f8bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.801+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 notify.4 [notify cookie 94051622693040 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.801+0000 7f3f8bfff640 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3f78003ea0 con 0x558a198aa290 2024-04-23T18:31:19.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.801+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.801+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== watch-notify(notify_complete (2) cookie 94051622693040 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f40ac045790 con 0x558a198aa290 2024-04-23T18:31:19.833 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-23T18:31:18.209839Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:31:18.209827Z","tags":[],"group_ids":[]} 2024-04-23T18:31:19.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.802+0000 7f3f6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.802+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94051622443520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198c0220 con 0x558a198aa290 2024-04-23T18:31:19.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.803+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94051622443520] v34'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.803+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94051622417248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198bda00 con 0x558a198aec80 2024-04-23T18:31:19.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.804+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94051622417248] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.804+0000 7f40ba03c800 20 remove_watcher() i=0 2024-04-23T18:31:19.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.804+0000 7f40ba03c800 2 removed watcher, disabling cache 2024-04-23T18:31:19.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.804+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94051622424512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198f3ae0 con 0x558a198aa290 2024-04-23T18:31:19.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.805+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94051622424512] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.805+0000 7f40ba03c800 20 remove_watcher() i=1 2024-04-23T18:31:19.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.805+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94051622428064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198f3ae0 con 0x558a198b35e0 2024-04-23T18:31:19.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.806+0000 7f40b44d4640 1 -- 172.21.15.119:0/1126082065 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94051622428064] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40a8081070 con 0x558a198b35e0 2024-04-23T18:31:19.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.806+0000 7f40ba03c800 20 remove_watcher() i=2 2024-04-23T18:31:19.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.806+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94051622430272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198b8fc0 con 0x558a198aec80 2024-04-23T18:31:19.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.807+0000 7f40b4cd5640 1 -- 172.21.15.119:0/1126082065 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94051622430272] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40a4077070 con 0x558a198aec80 2024-04-23T18:31:19.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.807+0000 7f40ba03c800 20 remove_watcher() i=3 2024-04-23T18:31:19.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.807+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94051622432864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198ba640 con 0x558a198aa290 2024-04-23T18:31:19.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.808+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94051622432864] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x558a198aa290 2024-04-23T18:31:19.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.808+0000 7f40ba03c800 20 remove_watcher() i=4 2024-04-23T18:31:19.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.808+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94051622437712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198b8fc0 con 0x7f40a4066050 2024-04-23T18:31:19.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.809+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94051622437712] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x7f40a4066050 2024-04-23T18:31:19.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.809+0000 7f40ba03c800 20 remove_watcher() i=5 2024-04-23T18:31:19.842 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.809+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94051622441552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198bb060 con 0x7f40a4066050 2024-04-23T18:31:19.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.811+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94051622441552] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x7f40a4066050 2024-04-23T18:31:19.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.811+0000 7f40ba03c800 20 remove_watcher() i=6 2024-04-23T18:31:19.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.811+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94051622435216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a198b8fc0 con 0x7f40a4066050 2024-04-23T18:31:19.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94051622435216] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40ac040080 con 0x7f40a4066050 2024-04-23T18:31:19.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 20 remove_watcher() i=7 2024-04-23T18:31:19.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f40a4066050 msgr2=0x7f40a4028170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f40a4066050 0x7f40a4028170 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558a198aa290 msgr2=0x558a198ac750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558a198aa290 0x558a198ac750 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558a198aec80 msgr2=0x558a198b1070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558a198aec80 0x558a198b1070 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558a198b35e0 msgr2=0x558a198b5aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.843 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x558a198b35e0 0x558a198b5aa0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f80036eb0 msgr2=0x7f3f80039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f80036eb0 0x7f3f80039370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f40a8052fd0 tx=0x7f40a804f000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 msgr2=0x558a1989eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40b54d6640 1 -- 172.21.15.119:0/1126082065 reap_dead start 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 0x558a1989eaf0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f40a4025d50 tx=0x7f40a403d6b0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 shutdown_connections 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1126082065 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a198977c0 0x558a1989eaf0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 >> 172.21.15.119:0/1126082065 conn(0x558a19893a90 msgr2=0x558a198910f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 shutdown_connections 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 -- 172.21.15.119:0/1126082065 wait complete. 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.812+0000 7f40ba03c800 1 -- 172.21.15.119:0/738621686 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f8c036eb0 msgr2=0x7f3f8c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 --2- 172.21.15.119:0/738621686 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f8c036eb0 0x7f3f8c039370 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x558a19874670 tx=0x7f40a8005a00 comp rx=0 tx=0).stop 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/738621686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a1988a5c0 msgr2=0x558a1988a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.844 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 --2- 172.21.15.119:0/738621686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a1988a5c0 0x558a1988a9e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f40a4022530 tx=0x7f40a4018a90 comp rx=0 tx=0).stop 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/738621686 shutdown_connections 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 --2- 172.21.15.119:0/738621686 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f8c036eb0 0x7f3f8c039370 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 --2- 172.21.15.119:0/738621686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a1988a5c0 0x558a1988a9e0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/738621686 >> 172.21.15.119:0/738621686 conn(0x558a1987e660 msgr2=0x558a1987ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/738621686 shutdown_connections 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/738621686 wait complete. 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558a19879630 msgr2=0x558a1987bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x558a19879630 0x558a1987bac0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558a197755b0 msgr2=0x558a19872e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x558a197755b0 0x558a19872e80 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558a198756f0 msgr2=0x558a19877ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x558a198756f0 0x558a19877ae0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f9c036eb0 msgr2=0x7f3f9c039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3f9c036eb0 0x7f3f9c039370 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f40a8054000 tx=0x7f40a804e000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a19771aa0 msgr2=0x558a1986be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 --2- 172.21.15.119:0/1327424030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a19771aa0 0x558a1986be10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f40a400c010 tx=0x7f40a4000ed0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40b54d6640 1 -- 172.21.15.119:0/1327424030 reap_dead start 2024-04-23T18:31:19.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 shutdown_connections 2024-04-23T18:31:19.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 >> 172.21.15.119:0/1327424030 conn(0x558a1976b430 msgr2=0x558a1985d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 shutdown_connections 2024-04-23T18:31:19.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.813+0000 7f40ba03c800 1 -- 172.21.15.119:0/1327424030 wait complete. 2024-04-23T18:31:19.846 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:19.846 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:19.846 ERROR:root:0 2024-04-23T18:31:19.847 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:19.851 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx000003eea38620a8f77ce-006627fe77-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:31:19.851 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-23T18:31:19.852 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-23T18:31:19.852 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-04-23T18:31:19.897 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:19.897 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:19.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.904+0000 7efd3112d800 1 Processor -- start 2024-04-23T18:31:19.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.904+0000 7efd3112d800 1 -- start start 2024-04-23T18:31:19.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.904+0000 7efd3112d800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5579c5c14e80 0x5579c5c152a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.904+0000 7efd3112d800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5579c5ac6560 con 0x5579c5c160e0 2024-04-23T18:31:19.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.904+0000 7efd3112d800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5579c5ab7e20 con 0x5579c5c14e80 2024-04-23T18:31:19.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.905+0000 7efd2cdae640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5579c5c14e80 0x5579c5c152a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.905+0000 7efd2cdae640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5579c5c14e80 0x5579c5c152a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55430/0 (socket says 172.21.15.119:55430) 2024-04-23T18:31:19.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.905+0000 7efd2c5ad640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5579c5c160e0 0x5579c5c16560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50670/0 (socket says 172.21.15.119:50670) 2024-04-23T18:31:19.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.905+0000 7efd2cdae640 1 -- 172.21.15.119:0/4256744523 learned_addr learned my addr 172.21.15.119:0/4256744523 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.905+0000 7efd2cdae640 1 -- 172.21.15.119:0/4256744523 >> v1:172.21.15.62:6789/0 conn(0x5579c5c160e0 legacy=0x5579c5c16560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.899 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.905+0000 7efd2cdae640 1 -- 172.21.15.119:0/4256744523 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c5ac5e60 con 0x5579c5c14e80 2024-04-23T18:31:19.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.907+0000 7efd2cdae640 1 --2- 172.21.15.119:0/4256744523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5c152a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00c710 tx=0x7efd1c01f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef13f9ecd4ae4ce1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.907+0000 7efd2bdac640 1 -- 172.21.15.119:0/4256744523 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c04d820 con 0x5579c5c14e80 2024-04-23T18:31:19.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.907+0000 7efd2bdac640 1 -- 172.21.15.119:0/4256744523 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c051070 con 0x5579c5c14e80 2024-04-23T18:31:19.900 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.907+0000 7efd2bdac640 1 -- 172.21.15.119:0/4256744523 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c04db50 con 0x5579c5c14e80 2024-04-23T18:31:19.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.907+0000 7efd3112d800 1 -- 172.21.15.119:0/4256744523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 msgr2=0x5579c5c152a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.907+0000 7efd3112d800 1 --2- 172.21.15.119:0/4256744523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5c152a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00c710 tx=0x7efd1c01f450 comp rx=0 tx=0).stop 2024-04-23T18:31:19.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.907+0000 7efd3112d800 1 -- 172.21.15.119:0/4256744523 shutdown_connections 2024-04-23T18:31:19.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.907+0000 7efd3112d800 1 --2- 172.21.15.119:0/4256744523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5c152a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.907+0000 7efd3112d800 1 -- 172.21.15.119:0/4256744523 >> 172.21.15.119:0/4256744523 conn(0x5579c5c10440 msgr2=0x5579c5c12860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.907+0000 7efd3112d800 1 -- 172.21.15.119:0/4256744523 shutdown_connections 2024-04-23T18:31:19.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.907+0000 7efd3112d800 1 -- 172.21.15.119:0/4256744523 wait complete. 2024-04-23T18:31:19.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.919+0000 7efd3112d800 1 Processor -- start 2024-04-23T18:31:19.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.919+0000 7efd3112d800 1 -- start start 2024-04-23T18:31:19.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.919+0000 7efd3112d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5d05570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.919+0000 7efd3112d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5579c5b615d0 con 0x5579c5c14e80 2024-04-23T18:31:19.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.920+0000 7efd2cdae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5d05570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.920+0000 7efd2cdae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5d05570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55442/0 (socket says 172.21.15.119:55442) 2024-04-23T18:31:19.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.920+0000 7efd2cdae640 1 -- 172.21.15.119:0/1055916606 learned_addr learned my addr 172.21.15.119:0/1055916606 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.913 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.920+0000 7efd2cdae640 1 -- 172.21.15.119:0/1055916606 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c5ad7860 con 0x5579c5c14e80 2024-04-23T18:31:19.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.920+0000 7efd2cdae640 1 --2- 172.21.15.119:0/1055916606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5d05570 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7efd1c01f490 tx=0x7efd1c04f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07bf2add106a70d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.920+0000 7efc1ae0d640 1 -- 172.21.15.119:0/1055916606 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c066070 con 0x5579c5c14e80 2024-04-23T18:31:19.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.920+0000 7efc1ae0d640 1 -- 172.21.15.119:0/1055916606 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c04da70 con 0x5579c5c14e80 2024-04-23T18:31:19.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.920+0000 7efc1ae0d640 1 -- 172.21.15.119:0/1055916606 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c061470 con 0x5579c5c14e80 2024-04-23T18:31:19.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.921+0000 7efd3112d800 1 -- 172.21.15.119:0/1055916606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 msgr2=0x5579c5d05570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.916 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.921+0000 7efd3112d800 1 --2- 172.21.15.119:0/1055916606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5d05570 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7efd1c01f490 tx=0x7efd1c04f000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.921+0000 7efd3112d800 1 -- 172.21.15.119:0/1055916606 shutdown_connections 2024-04-23T18:31:19.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.921+0000 7efd3112d800 1 --2- 172.21.15.119:0/1055916606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5d05570 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.921+0000 7efd3112d800 1 -- 172.21.15.119:0/1055916606 >> 172.21.15.119:0/1055916606 conn(0x5579c5c10440 msgr2=0x5579c5d00e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.921+0000 7efd3112d800 1 -- 172.21.15.119:0/1055916606 shutdown_connections 2024-04-23T18:31:19.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.921+0000 7efd3112d800 1 -- 172.21.15.119:0/1055916606 wait complete. 2024-04-23T18:31:19.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.921+0000 7efd3112d800 1 Processor -- start 2024-04-23T18:31:19.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.921+0000 7efd3112d800 1 -- start start 2024-04-23T18:31:19.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.922+0000 7efd3112d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5d0ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.922+0000 7efd3112d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5579c5b88580 con 0x5579c5c14e80 2024-04-23T18:31:19.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.922+0000 7efd2cdae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5d0ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.922+0000 7efd2cdae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5d0ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55450/0 (socket says 172.21.15.119:55450) 2024-04-23T18:31:19.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.922+0000 7efd2cdae640 1 -- 172.21.15.119:0/3766866761 learned_addr learned my addr 172.21.15.119:0/3766866761 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.917 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.922+0000 7efd2cdae640 1 -- 172.21.15.119:0/3766866761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c5ad5eb0 con 0x5579c5c14e80 2024-04-23T18:31:19.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.922+0000 7efd2cdae640 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5d0ceb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7efd1c000f80 tx=0x7efd1c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.922+0000 7efc1960a640 1 -- 172.21.15.119:0/3766866761 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c066070 con 0x5579c5c14e80 2024-04-23T18:31:19.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.922+0000 7efc1960a640 1 -- 172.21.15.119:0/3766866761 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c070070 con 0x5579c5c14e80 2024-04-23T18:31:19.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.922+0000 7efc1960a640 1 -- 172.21.15.119:0/3766866761 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c06b440 con 0x5579c5c14e80 2024-04-23T18:31:19.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.922+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579c5d0d3f0 con 0x5579c5c14e80 2024-04-23T18:31:19.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.922+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579c5d0d8b0 con 0x5579c5c14e80 2024-04-23T18:31:19.918 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.923+0000 7efc1960a640 1 -- 172.21.15.119:0/3766866761 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7efd1c053030 con 0x5579c5c14e80 2024-04-23T18:31:19.925 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.923+0000 7efc1960a640 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc14036eb0 0x7efc14039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.923+0000 7efc1960a640 1 -- 172.21.15.119:0/3766866761 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7efd1c091200 con 0x5579c5c14e80 2024-04-23T18:31:19.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.923+0000 7efd2c5ad640 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc14036eb0 0x7efc14039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.924+0000 7efd3112d800 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5579c5c160e0 0x5579c5d13e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.924+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d14440 con 0x5579c5c160e0 2024-04-23T18:31:19.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.924+0000 7efd2d5af640 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5579c5c160e0 0x5579c5d13e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.924+0000 7efd2c5ad640 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc14036eb0 0x7efc14039370 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efd20000f60 tx=0x7efd20001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.924+0000 7efd2d5af640 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5579c5c160e0 0x5579c5d13e50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.924+0000 7efd2d5af640 1 -- 172.21.15.119:0/3766866761 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd240083e0 con 0x5579c5c160e0 2024-04-23T18:31:19.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.924+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d114d0 con 0x5579c5c160e0 2024-04-23T18:31:19.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.924+0000 7efd2d5af640 1 -- 172.21.15.119:0/3766866761 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd240083e0 con 0x5579c5c160e0 2024-04-23T18:31:19.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.924+0000 7efd3112d800 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5579c5d16770 0x5579c5d18b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.926 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.924+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d19250 con 0x5579c5d16770 2024-04-23T18:31:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.925+0000 7efd2cdae640 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5579c5d16770 0x5579c5d18b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.925+0000 7efd2cdae640 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5579c5d16770 0x5579c5d18b60 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.925+0000 7efd2cdae640 1 -- 172.21.15.119:0/3766866761 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efd1c069070 con 0x5579c5d16770 2024-04-23T18:31:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.925+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d15720 con 0x5579c5c160e0 2024-04-23T18:31:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.925+0000 7efd2d5af640 1 -- 172.21.15.119:0/3766866761 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd240083e0 con 0x5579c5c160e0 2024-04-23T18:31:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.925+0000 7efd3112d800 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5579c5d1a700 0x5579c5d1cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.925+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d1d2c0 con 0x5579c5d1a700 2024-04-23T18:31:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.926+0000 7efd2c5ad640 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5579c5d1a700 0x5579c5d1cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.926+0000 7efd2c5ad640 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5579c5d1a700 0x5579c5d1cb30 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.926+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3766866761 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efd2000f690 con 0x5579c5d1a700 2024-04-23T18:31:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.927+0000 7efd3112d800 1 Processor -- start 2024-04-23T18:31:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.927+0000 7efd3112d800 1 -- start start 2024-04-23T18:31:19.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.927+0000 7efd3112d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d2fb30 0x5579c5d2ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.927+0000 7efd3112d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5579c5b07df0 con 0x5579c5d2fb30 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.927+0000 7efd2cdae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d2fb30 0x5579c5d2ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.927+0000 7efd2cdae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d2fb30 0x5579c5d2ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55458/0 (socket says 172.21.15.119:55458) 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.927+0000 7efd2cdae640 1 -- 172.21.15.119:0/1216170773 learned_addr learned my addr 172.21.15.119:0/1216170773 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.927+0000 7efd2cdae640 1 -- 172.21.15.119:0/1216170773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c5d30490 con 0x5579c5d2fb30 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.927+0000 7efd2cdae640 1 --2- 172.21.15.119:0/1216170773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d2fb30 0x5579c5d2ff50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7efd1c08f4e0 tx=0x7efd1c075730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.928+0000 7efc127fc640 1 -- 172.21.15.119:0/1216170773 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c06bc70 con 0x5579c5d2fb30 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.928+0000 7efc127fc640 1 -- 172.21.15.119:0/1216170773 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c067040 con 0x5579c5d2fb30 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.928+0000 7efd3112d800 1 -- 172.21.15.119:0/1216170773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579c5d30f00 con 0x5579c5d2fb30 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.928+0000 7efc127fc640 1 -- 172.21.15.119:0/1216170773 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c05ecb0 con 0x5579c5d2fb30 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.928+0000 7efd3112d800 1 -- 172.21.15.119:0/1216170773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579c5d31400 con 0x5579c5d2fb30 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.928+0000 7efc127fc640 1 -- 172.21.15.119:0/1216170773 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7efd1c0543c0 con 0x5579c5d2fb30 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.928+0000 7efc127fc640 1 --2- 172.21.15.119:0/1216170773 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc04036eb0 0x7efc04039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.928+0000 7efc127fc640 1 -- 172.21.15.119:0/1216170773 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7efd1c087070 con 0x5579c5d2fb30 2024-04-23T18:31:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.929+0000 7efd2c5ad640 1 --2- 172.21.15.119:0/1216170773 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc04036eb0 0x7efc04039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.929+0000 7efd3112d800 1 Processor -- start 2024-04-23T18:31:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.929+0000 7efd3112d800 1 -- start start 2024-04-23T18:31:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.929+0000 7efd2c5ad640 1 --2- 172.21.15.119:0/1216170773 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc04036eb0 0x7efc04039370 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x5579c5d14910 tx=0x7efd2000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.929+0000 7efd3112d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d3cc80 0x5579c5d3d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.929+0000 7efd3112d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5579c5d05c90 con 0x5579c5d3cc80 2024-04-23T18:31:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.929+0000 7efd2cdae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d3cc80 0x5579c5d3d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.929+0000 7efd2cdae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d3cc80 0x5579c5d3d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55466/0 (socket says 172.21.15.119:55466) 2024-04-23T18:31:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.929+0000 7efd2cdae640 1 -- 172.21.15.119:0/522301706 learned_addr learned my addr 172.21.15.119:0/522301706 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.929+0000 7efd2cdae640 1 -- 172.21.15.119:0/522301706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c5d3d670 con 0x5579c5d3cc80 2024-04-23T18:31:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.929+0000 7efd2cdae640 1 --2- 172.21.15.119:0/522301706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d3cc80 0x5579c5d3d0a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7efd1c054fd0 tx=0x7efd1c06ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f575472ff770d1b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.930+0000 7efc03fff640 1 -- 172.21.15.119:0/522301706 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c09f070 con 0x5579c5d3cc80 2024-04-23T18:31:19.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.930+0000 7efc03fff640 1 -- 172.21.15.119:0/522301706 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c060030 con 0x5579c5d3cc80 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.930+0000 7efc03fff640 1 -- 172.21.15.119:0/522301706 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c081950 con 0x5579c5d3cc80 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.930+0000 7efd3112d800 1 -- 172.21.15.119:0/522301706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d3cc80 msgr2=0x5579c5d3d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.930+0000 7efd3112d800 1 --2- 172.21.15.119:0/522301706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d3cc80 0x5579c5d3d0a0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7efd1c054fd0 tx=0x7efd1c06ade0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.930+0000 7efd3112d800 1 -- 172.21.15.119:0/522301706 shutdown_connections 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.930+0000 7efd3112d800 1 --2- 172.21.15.119:0/522301706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d3cc80 0x5579c5d3d0a0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.930+0000 7efd3112d800 1 -- 172.21.15.119:0/522301706 >> 172.21.15.119:0/522301706 conn(0x5579c5d38f50 msgr2=0x5579c5d36fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.930+0000 7efd3112d800 1 -- 172.21.15.119:0/522301706 shutdown_connections 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.930+0000 7efd3112d800 1 -- 172.21.15.119:0/522301706 wait complete. 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.930+0000 7efd3112d800 1 Processor -- start 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.930+0000 7efd3112d800 1 -- start start 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.931+0000 7efd3112d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d3cc80 0x5579c5d43f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.931+0000 7efd3112d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5579c5d3dcd0 con 0x5579c5d3cc80 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.931+0000 7efd2cdae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d3cc80 0x5579c5d43f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.931+0000 7efd2cdae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d3cc80 0x5579c5d43f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55472/0 (socket says 172.21.15.119:55472) 2024-04-23T18:31:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.931+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 learned_addr learned my addr 172.21.15.119:0/3012879399 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.931+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579c5d444c0 con 0x5579c5d3cc80 2024-04-23T18:31:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.931+0000 7efd2cdae640 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d3cc80 0x5579c5d43f80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7efd1c04d7c0 tx=0x7efd1c081f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.931+0000 7efc027fc640 1 -- 172.21.15.119:0/3012879399 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c081950 con 0x5579c5d3cc80 2024-04-23T18:31:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.931+0000 7efc027fc640 1 -- 172.21.15.119:0/3012879399 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c06a3a0 con 0x5579c5d3cc80 2024-04-23T18:31:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.931+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579c5d444c0 con 0x5579c5d3cc80 2024-04-23T18:31:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.931+0000 7efc027fc640 1 -- 172.21.15.119:0/3012879399 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c05f930 con 0x5579c5d3cc80 2024-04-23T18:31:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.932+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579c5d444c0 con 0x5579c5d3cc80 2024-04-23T18:31:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.932+0000 7efc027fc640 1 -- 172.21.15.119:0/3012879399 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7efd1c0b1020 con 0x5579c5d3cc80 2024-04-23T18:31:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.932+0000 7efc027fc640 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbf8036eb0 0x7efbf8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.932+0000 7efc027fc640 1 -- 172.21.15.119:0/3012879399 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7efd1c0b4d20 con 0x5579c5d3cc80 2024-04-23T18:31:19.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.932+0000 7efd2c5ad640 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbf8036eb0 0x7efbf8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.933+0000 7efd2c5ad640 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbf8036eb0 0x7efbf8039370 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5579c5d1d6c0 tx=0x7efd20010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.933+0000 7efd3112d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.933+0000 7efd3112d800 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5579c5d4f740 0x5579c5d51c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.933+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d52350 con 0x5579c5d4f740 2024-04-23T18:31:19.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.933+0000 7efd2d5af640 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5579c5d4f740 0x5579c5d51c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.933+0000 7efd2d5af640 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5579c5d4f740 0x5579c5d51c00 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.933+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd240083e0 con 0x5579c5d4f740 2024-04-23T18:31:19.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 20 realm 2024-04-23T18:31:19.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d52760 con 0x5579c5d4f740 2024-04-23T18:31:19.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd240083e0 con 0x5579c5d4f740 2024-04-23T18:31:19.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:19.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d4f740 2024-04-23T18:31:19.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd240083e0 con 0x5579c5d4f740 2024-04-23T18:31:19.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d533d0 con 0x5579c5d4f740 2024-04-23T18:31:19.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd240083e0 con 0x5579c5d4f740 2024-04-23T18:31:19.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5579c5d53d90 0x5579c5d56180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d567d0 con 0x5579c5d53d90 2024-04-23T18:31:19.946 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.934+0000 7efd2cdae640 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5579c5d53d90 0x5579c5d56180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.935+0000 7efd2cdae640 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5579c5d53d90 0x5579c5d56180 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.935+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efd1c0a1030 con 0x5579c5d53d90 2024-04-23T18:31:19.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.935+0000 7efd3112d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:19.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.935+0000 7efd3112d800 20 searching for the correct realm 2024-04-23T18:31:19.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.935+0000 7efd3112d800 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5579c5d58760 0x5579c5d5ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.935+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5b2f0 con 0x5579c5d58760 2024-04-23T18:31:19.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.935+0000 7efd2c5ad640 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5579c5d58760 0x5579c5d5ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.935+0000 7efd2c5ad640 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5579c5d58760 0x5579c5d5ac20 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.936+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.936+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5b2f0 con 0x5579c5d53d90 2024-04-23T18:31:19.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.936+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1c0a1030 con 0x5579c5d53d90 2024-04-23T18:31:19.947 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.936+0000 7efd2cdae640 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7efd1c0547e0 0x7efd1c08a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.936+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5b2f0 con 0x7efd1c0547e0 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.936+0000 7efd2d5af640 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7efd1c0547e0 0x7efd1c08a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.937+0000 7efd2d5af640 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7efd1c0547e0 0x7efd1c08a860 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.937+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd240083e0 con 0x7efd1c0547e0 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.937+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d4f740 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.937+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd240083e0 con 0x5579c5d4f740 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.937+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d4f740 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.937+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd24026040 con 0x5579c5d4f740 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.937+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x7efd1c0547e0 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.938+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd24026040 con 0x7efd1c0547e0 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.938+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x7efd1c0547e0 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.938+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efd24026040 con 0x7efd1c0547e0 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.938+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d53d90 2024-04-23T18:31:19.948 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.938+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1c0a1030 con 0x5579c5d53d90 2024-04-23T18:31:19.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.938+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d58760 2024-04-23T18:31:19.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.938+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.938+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d4f740 2024-04-23T18:31:19.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.938+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd24026040 con 0x5579c5d4f740 2024-04-23T18:31:19.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.938+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x7efd1c0547e0 2024-04-23T18:31:19.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.939+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd24026040 con 0x7efd1c0547e0 2024-04-23T18:31:19.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.939+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d4f740 2024-04-23T18:31:19.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.939+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd24026040 con 0x5579c5d4f740 2024-04-23T18:31:19.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.939+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d53d90 2024-04-23T18:31:19.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.939+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efd1c0a1030 con 0x5579c5d53d90 2024-04-23T18:31:19.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.939+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d58760 2024-04-23T18:31:19.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.939+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.949 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.939+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d58760 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.940+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.940+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x7efd1c0547e0 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.940+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd24026040 con 0x7efd1c0547e0 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.940+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d58760 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.940+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.940+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d58760 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.941+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.941+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d4f740 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.941+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd24026040 con 0x5579c5d4f740 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.941+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d4f740 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.941+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efd24026040 con 0x5579c5d4f740 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.941+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x7efd1c0547e0 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.941+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd24026040 con 0x7efd1c0547e0 2024-04-23T18:31:19.950 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.941+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d58760 2024-04-23T18:31:19.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.941+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.941+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d53d90 2024-04-23T18:31:19.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.942+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efd1c0a1030 con 0x5579c5d53d90 2024-04-23T18:31:19.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.942+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d4f740 2024-04-23T18:31:19.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.942+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd24026040 con 0x5579c5d4f740 2024-04-23T18:31:19.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.942+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d53d90 2024-04-23T18:31:19.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.942+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1c0a1030 con 0x5579c5d53d90 2024-04-23T18:31:19.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.942+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d58760 2024-04-23T18:31:19.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.942+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.942+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x7efd1c0547e0 2024-04-23T18:31:19.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.943+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd24026040 con 0x7efd1c0547e0 2024-04-23T18:31:19.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.943+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d53d90 2024-04-23T18:31:19.951 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.943+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1c0cf040 con 0x5579c5d53d90 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.943+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d58760 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.943+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.943+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x7efd1c0547e0 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.944+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd24026040 con 0x7efd1c0547e0 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.944+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d4f740 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.944+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efd24026040 con 0x5579c5d4f740 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.944+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d53030 con 0x5579c5d53d90 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.944+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1c0cf040 con 0x5579c5d53d90 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.944+0000 7efd3112d800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.944+0000 7efd3112d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.944+0000 7efd3112d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.944+0000 7efd3112d800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.944+0000 7efd3112d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:19.952 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.944+0000 7efd3112d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.944+0000 7efd3112d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d56b70 con 0x5579c5d4f740 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd24026040 con 0x5579c5d4f740 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d56f60 con 0x5579c5d4f740 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd24026040 con 0x5579c5d4f740 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d56f60 con 0x7efd1c0547e0 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efd24036040 con 0x7efd1c0547e0 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 20 zone default found 2024-04-23T18:31:19.953 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 4 Realm: () 2024-04-23T18:31:19.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:19.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:19.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:19.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 20 zonegroup default 2024-04-23T18:31:19.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.945+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5b770 con 0x5579c5d53d90 2024-04-23T18:31:19.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.946+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efd1c0cf040 con 0x5579c5d53d90 2024-04-23T18:31:19.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.946+0000 7efd3112d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.946+0000 7efd3112d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.946+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5d4f0 con 0x5579c5d58760 2024-04-23T18:31:19.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.946+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.946+0000 7efd3112d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.954 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.946+0000 7efd3112d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.946+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5d890 con 0x5579c5d58760 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.946+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.946+0000 7efd3112d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.946+0000 7efd3112d800 20 started sync module instance, tier type = 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.946+0000 7efd3112d800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.946+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5c990 con 0x5579c5d53d90 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.947+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd1c0cf040 con 0x5579c5d53d90 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.947+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93981498527104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5c5f0 con 0x5579c5d53d90 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.947+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5e5f0 con 0x5579c5d4f740 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.948+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93981498527104] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd1c0cf040 con 0x5579c5d53d90 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.948+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x5579c5d4f740 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.949+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93981498530864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5e9e0 con 0x5579c5d4f740 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.949+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5f450 con 0x5579c5d58760 2024-04-23T18:31:19.955 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.949+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93981498530864] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x5579c5d4f740 2024-04-23T18:31:19.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.950+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.950+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93981498535712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5f840 con 0x5579c5d58760 2024-04-23T18:31:19.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.950+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d60280 con 0x5579c5d53d90 2024-04-23T18:31:19.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.951+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93981498535712] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.951+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd1c0cf040 con 0x5579c5d53d90 2024-04-23T18:31:19.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.951+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93981498539344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d60670 con 0x5579c5d53d90 2024-04-23T18:31:19.956 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.951+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d61090 con 0x5579c5d4f740 2024-04-23T18:31:19.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.952+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x5579c5d4f740 2024-04-23T18:31:19.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.952+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93981498542976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d61500 con 0x5579c5d4f740 2024-04-23T18:31:19.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.952+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d62020 con 0x7efd1c0547e0 2024-04-23T18:31:19.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.952+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93981498539344] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd1c0cf040 con 0x5579c5d53d90 2024-04-23T18:31:19.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.953+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93981498542976] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x5579c5d4f740 2024-04-23T18:31:19.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.953+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x7efd1c0547e0 2024-04-23T18:31:19.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.953+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93981498546928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d61050 con 0x7efd1c0547e0 2024-04-23T18:31:19.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.953+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d628c0 con 0x7efd1c0547e0 2024-04-23T18:31:19.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.954+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93981498546928] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x7efd1c0547e0 2024-04-23T18:31:19.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.954+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x7efd1c0547e0 2024-04-23T18:31:19.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.954+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93981498531920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d61050 con 0x7efd1c0547e0 2024-04-23T18:31:19.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.954+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d62e90 con 0x7efd1c0547e0 2024-04-23T18:31:19.961 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.955+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93981498531920] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x7efd1c0547e0 2024-04-23T18:31:19.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.955+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x7efd1c0547e0 2024-04-23T18:31:19.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.955+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93981498549120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d62e50 con 0x7efd1c0547e0 2024-04-23T18:31:19.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.955+0000 7efd3112d800 20 add_watcher() i=0 2024-04-23T18:31:19.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.955+0000 7efd3112d800 20 add_watcher() i=1 2024-04-23T18:31:19.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.955+0000 7efd3112d800 20 add_watcher() i=2 2024-04-23T18:31:19.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.955+0000 7efd3112d800 20 add_watcher() i=3 2024-04-23T18:31:19.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.955+0000 7efd3112d800 20 add_watcher() i=4 2024-04-23T18:31:19.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.955+0000 7efd3112d800 20 add_watcher() i=5 2024-04-23T18:31:19.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.955+0000 7efd3112d800 20 add_watcher() i=6 2024-04-23T18:31:19.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.956+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93981498549120] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x7efd1c0547e0 2024-04-23T18:31:19.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.956+0000 7efd3112d800 20 add_watcher() i=7 2024-04-23T18:31:19.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.956+0000 7efd3112d800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:19.962 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.956+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d66280 con 0x5579c5d4f740 2024-04-23T18:31:19.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.957+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efd24036040 con 0x5579c5d4f740 2024-04-23T18:31:19.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.957+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93981498551152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d637a0 con 0x5579c5d4f740 2024-04-23T18:31:19.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.958+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93981498551152] v34'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd24036040 con 0x5579c5d4f740 2024-04-23T18:31:19.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.958+0000 7efbe2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.958+0000 7efd3112d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:19.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.958+0000 7efd3112d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:19.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.958+0000 7efd3112d800 5 note: GC not initialized 2024-04-23T18:31:19.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.958+0000 7efbe1fe3640 20 reqs_thread_entry: start 2024-04-23T18:31:19.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.958+0000 7efd3112d800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:19.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.958+0000 7efd3112d800 20 Filter name: none 2024-04-23T18:31:19.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.958+0000 7efb537fe640 20 reqs_thread_entry: start 2024-04-23T18:31:19.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.958+0000 7efd3112d800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-23T18:31:19.963 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.958+0000 7efd3112d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.958+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d99b30 con 0x7efd1c0547e0 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.959+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7efd24036040 con 0x7efd1c0547e0 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.959+0000 7efd3112d800 20 rados_obj.operate() r=0 bl.length=490 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.959+0000 7efd3112d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.959+0000 7efd3112d800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.959+0000 7efd3112d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.959+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5da0430 con 0x7efd1c0547e0 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.960+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7efd24036040 con 0x7efd1c0547e0 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.960+0000 7efd3112d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.960+0000 7efd3112d800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.960+0000 7efd3112d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.960+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93981498801824 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d9bb20 con 0x5579c5d4f740 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.961+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== watch-notify(notify (1) cookie 93981498542976 notify 146028888105 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7efd24010040 con 0x5579c5d4f740 2024-04-23T18:31:19.964 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.961+0000 7efc03fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 93981498542976 notifier 4903 bl.length()=636 2024-04-23T18:31:19.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.961+0000 7efc03fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:19.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.961+0000 7efc03fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:19.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.961+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 notify.4 [notify cookie 93981498801824 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efd24036040 con 0x5579c5d4f740 2024-04-23T18:31:19.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.961+0000 7efc03fff640 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7efbf0003ea0 con 0x5579c5d4f740 2024-04-23T18:31:19.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.961+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x5579c5d4f740 2024-04-23T18:31:19.965 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.961+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== watch-notify(notify_complete (2) cookie 93981498801824 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efd2402c760 con 0x5579c5d4f740 2024-04-23T18:31:19.965 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-23T18:31:18.209839Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:31:18.209827Z","tags":[],"group_ids":[]} 2024-04-23T18:31:19.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.962+0000 7efbe2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:19.970 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.962+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93981498551152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d9bf30 con 0x5579c5d4f740 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.963+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93981498551152] v34'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd24036040 con 0x5579c5d4f740 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.963+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93981498527104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d9ba80 con 0x5579c5d53d90 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.964+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93981498527104] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd1c0cf040 con 0x5579c5d53d90 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.964+0000 7efd3112d800 20 remove_watcher() i=0 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.964+0000 7efd3112d800 2 removed watcher, disabling cache 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.964+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93981498530864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5cd80 con 0x5579c5d4f740 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.965+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93981498530864] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x5579c5d4f740 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.965+0000 7efd3112d800 20 remove_watcher() i=1 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.965+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93981498535712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5dc30 con 0x5579c5d58760 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.966+0000 7efd2c5ad640 1 -- 172.21.15.119:0/3012879399 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93981498535712] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd20037040 con 0x5579c5d58760 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.966+0000 7efd3112d800 20 remove_watcher() i=2 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.966+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93981498539344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5ef20 con 0x5579c5d53d90 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.967+0000 7efd2cdae640 1 -- 172.21.15.119:0/3012879399 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93981498539344] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd1c0cf040 con 0x5579c5d53d90 2024-04-23T18:31:19.971 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.967+0000 7efd3112d800 20 remove_watcher() i=3 2024-04-23T18:31:19.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.967+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93981498542976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5fd50 con 0x5579c5d4f740 2024-04-23T18:31:19.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.968+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93981498542976] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x5579c5d4f740 2024-04-23T18:31:19.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.968+0000 7efd3112d800 20 remove_watcher() i=4 2024-04-23T18:31:19.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.968+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93981498546928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5fd50 con 0x7efd1c0547e0 2024-04-23T18:31:19.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.969+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93981498546928] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x7efd1c0547e0 2024-04-23T18:31:19.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.969+0000 7efd3112d800 20 remove_watcher() i=5 2024-04-23T18:31:19.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.969+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93981498531920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d61af0 con 0x7efd1c0547e0 2024-04-23T18:31:19.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.970+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93981498531920] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x7efd1c0547e0 2024-04-23T18:31:19.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.970+0000 7efd3112d800 20 remove_watcher() i=6 2024-04-23T18:31:19.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.970+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93981498549120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5579c5d5ef20 con 0x7efd1c0547e0 2024-04-23T18:31:19.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93981498549120] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd24036040 con 0x7efd1c0547e0 2024-04-23T18:31:19.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd3112d800 20 remove_watcher() i=7 2024-04-23T18:31:19.972 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7efd1c0547e0 msgr2=0x7efd1c08a860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd3112d800 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7efd1c0547e0 0x7efd1c08a860 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5579c5d4f740 msgr2=0x5579c5d51c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd3112d800 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5579c5d4f740 0x5579c5d51c00 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5579c5d53d90 msgr2=0x5579c5d56180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd3112d800 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5579c5d53d90 0x5579c5d56180 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5579c5d58760 msgr2=0x5579c5d5ac20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd3112d800 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5579c5d58760 0x5579c5d5ac20 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbf8036eb0 msgr2=0x7efbf8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd3112d800 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efbf8036eb0 0x7efbf8039370 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5579c5d1d6c0 tx=0x7efd20010000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d3cc80 msgr2=0x5579c5d43f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd3112d800 1 --2- 172.21.15.119:0/3012879399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d3cc80 0x5579c5d43f80 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7efd1c04d7c0 tx=0x7efd1c081f90 comp rx=0 tx=0).stop 2024-04-23T18:31:19.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 reap_dead start 2024-04-23T18:31:19.973 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.971+0000 7efd2d5af640 1 -- 172.21.15.119:0/3012879399 reap_dead start 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 shutdown_connections 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 >> 172.21.15.119:0/3012879399 conn(0x5579c5d38f50 msgr2=0x5579c5d365b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 shutdown_connections 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/3012879399 wait complete. 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/1216170773 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc04036eb0 msgr2=0x7efc04039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 --2- 172.21.15.119:0/1216170773 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc04036eb0 0x7efc04039370 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x5579c5d14910 tx=0x7efd2000f000 comp rx=0 tx=0).stop 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/1216170773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d2fb30 msgr2=0x5579c5d2ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 --2- 172.21.15.119:0/1216170773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d2fb30 0x5579c5d2ff50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7efd1c08f4e0 tx=0x7efd1c075730 comp rx=0 tx=0).stop 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/1216170773 shutdown_connections 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 --2- 172.21.15.119:0/1216170773 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc04036eb0 0x7efc04039370 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 --2- 172.21.15.119:0/1216170773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5d2fb30 0x5579c5d2ff50 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/1216170773 >> 172.21.15.119:0/1216170773 conn(0x5579c5d1f7c0 msgr2=0x5579c5d1fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/1216170773 shutdown_connections 2024-04-23T18:31:19.974 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/1216170773 wait complete. 2024-04-23T18:31:19.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5579c5d1a700 msgr2=0x5579c5d1cb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5579c5d1a700 0x5579c5d1cb30 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5579c5c160e0 msgr2=0x5579c5d13e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5579c5c160e0 0x5579c5d13e50 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5579c5d16770 msgr2=0x5579c5d18b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5579c5d16770 0x5579c5d18b60 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:19.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc14036eb0 msgr2=0x7efc14039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7efc14036eb0 0x7efc14039370 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efd20000f60 tx=0x7efd20001370 comp rx=0 tx=0).stop 2024-04-23T18:31:19.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 msgr2=0x5579c5d0ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:19.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 --2- 172.21.15.119:0/3766866761 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5579c5c14e80 0x5579c5d0ceb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7efd1c000f80 tx=0x7efd1c003330 comp rx=0 tx=0).stop 2024-04-23T18:31:19.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd2d5af640 1 -- 172.21.15.119:0/3766866761 reap_dead start 2024-04-23T18:31:19.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 shutdown_connections 2024-04-23T18:31:19.975 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 >> 172.21.15.119:0/3766866761 conn(0x5579c5c10440 msgr2=0x5579c5d03f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:19.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 shutdown_connections 2024-04-23T18:31:19.976 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:19.972+0000 7efd3112d800 1 -- 172.21.15.119:0/3766866761 wait complete. 2024-04-23T18:31:19.976 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:19.977 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:19.977 ERROR:root:0 2024-04-23T18:31:19.977 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-23T18:31:19.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-23T18:31:19.977 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-23T18:31:20.021 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:20.022 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:20.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.029+0000 7f4a7983b800 1 Processor -- start 2024-04-23T18:31:20.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.029+0000 7f4a7983b800 1 -- start start 2024-04-23T18:31:20.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.029+0000 7f4a7983b800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556667462890 0x556667462cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.029+0000 7f4a7983b800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556667314560 con 0x5566674631f0 2024-04-23T18:31:20.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.029+0000 7f4a7983b800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x556667305e20 con 0x556667462890 2024-04-23T18:31:20.023 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.029+0000 7f4a7733a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556667462890 0x556667462cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.029+0000 7f4a76b39640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5566674631f0 0x5566674636a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50680/0 (socket says 172.21.15.119:50680) 2024-04-23T18:31:20.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.029+0000 7f4a76b39640 1 -- 172.21.15.119:0/183890582 learned_addr learned my addr 172.21.15.119:0/183890582 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:31:20.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.030+0000 7f4a7733a640 1 -- 172.21.15.119:0/183890582 >> v1:172.21.15.62:6789/0 conn(0x5566674631f0 legacy=0x5566674636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.030+0000 7f4a7733a640 1 -- 172.21.15.119:0/183890582 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556667313e60 con 0x556667462890 2024-04-23T18:31:20.024 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.030+0000 7f4a76338640 1 -- 172.21.15.119:0/183890582 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 21137440 0 0) 0x556667314560 con 0x5566674631f0 2024-04-23T18:31:20.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.031+0000 7f4a7733a640 1 --2- 172.21.15.119:0/183890582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x556667462cb0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000a470 tx=0x7f4a7001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb91340d059e8058 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.032+0000 7f4a76338640 1 -- 172.21.15.119:0/183890582 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a70057070 con 0x556667462890 2024-04-23T18:31:20.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.032+0000 7f4a76338640 1 -- 172.21.15.119:0/183890582 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7004adc0 con 0x556667462890 2024-04-23T18:31:20.025 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.032+0000 7f4a76338640 1 -- 172.21.15.119:0/183890582 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a70052590 con 0x556667462890 2024-04-23T18:31:20.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.032+0000 7f4a7983b800 1 -- 172.21.15.119:0/183890582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 msgr2=0x556667462cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.032+0000 7f4a7983b800 1 --2- 172.21.15.119:0/183890582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x556667462cb0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000a470 tx=0x7f4a7001ce90 comp rx=0 tx=0).stop 2024-04-23T18:31:20.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.032+0000 7f4a7983b800 1 -- 172.21.15.119:0/183890582 shutdown_connections 2024-04-23T18:31:20.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.032+0000 7f4a7983b800 1 --2- 172.21.15.119:0/183890582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x556667462cb0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.032+0000 7f4a7983b800 1 -- 172.21.15.119:0/183890582 >> 172.21.15.119:0/183890582 conn(0x55666745e430 msgr2=0x556667460850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:20.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.032+0000 7f4a7983b800 1 -- 172.21.15.119:0/183890582 shutdown_connections 2024-04-23T18:31:20.026 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.032+0000 7f4a7983b800 1 -- 172.21.15.119:0/183890582 wait complete. 2024-04-23T18:31:20.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.044+0000 7f4a7983b800 1 Processor -- start 2024-04-23T18:31:20.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.044+0000 7f4a7983b800 1 -- start start 2024-04-23T18:31:20.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.044+0000 7f4a7983b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x5566675572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.038 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.044+0000 7f4a7983b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5566673af5d0 con 0x556667462890 2024-04-23T18:31:20.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.044+0000 7f4a7733a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x5566675572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.044+0000 7f4a7733a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x5566675572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55482/0 (socket says 172.21.15.119:55482) 2024-04-23T18:31:20.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.044+0000 7f4a7733a640 1 -- 172.21.15.119:0/2213161430 learned_addr learned my addr 172.21.15.119:0/2213161430 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:20.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.044+0000 7f4a7733a640 1 -- 172.21.15.119:0/2213161430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556667325860 con 0x556667462890 2024-04-23T18:31:20.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.045+0000 7f4a7733a640 1 --2- 172.21.15.119:0/2213161430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x5566675572c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4a70055040 tx=0x7f4a7004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3ef60b4c1ec751 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.045+0000 7f496560a640 1 -- 172.21.15.119:0/2213161430 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a70063070 con 0x556667462890 2024-04-23T18:31:20.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.045+0000 7f496560a640 1 -- 172.21.15.119:0/2213161430 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7000a230 con 0x556667462890 2024-04-23T18:31:20.039 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.045+0000 7f496560a640 1 -- 172.21.15.119:0/2213161430 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a70057040 con 0x556667462890 2024-04-23T18:31:20.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.045+0000 7f4a7983b800 1 -- 172.21.15.119:0/2213161430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 msgr2=0x5566675572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.047 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.045+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2213161430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x5566675572c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4a70055040 tx=0x7f4a7004c000 comp rx=0 tx=0).stop 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.045+0000 7f4a7983b800 1 -- 172.21.15.119:0/2213161430 shutdown_connections 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.045+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2213161430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x5566675572c0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.045+0000 7f4a7983b800 1 -- 172.21.15.119:0/2213161430 >> 172.21.15.119:0/2213161430 conn(0x55666745e430 msgr2=0x556667552be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.046+0000 7f4a7983b800 1 -- 172.21.15.119:0/2213161430 shutdown_connections 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.046+0000 7f4a7983b800 1 -- 172.21.15.119:0/2213161430 wait complete. 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.046+0000 7f4a7983b800 1 Processor -- start 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.046+0000 7f4a7983b800 1 -- start start 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.046+0000 7f4a7983b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x55666755ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.046+0000 7f4a7983b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5566674640b0 con 0x556667462890 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.046+0000 7f4a7733a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x55666755ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.046+0000 7f4a7733a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x55666755ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55494/0 (socket says 172.21.15.119:55494) 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.046+0000 7f4a7733a640 1 -- 172.21.15.119:0/2352639686 learned_addr learned my addr 172.21.15.119:0/2352639686 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.046+0000 7f4a7733a640 1 -- 172.21.15.119:0/2352639686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556667323eb0 con 0x556667462890 2024-04-23T18:31:20.048 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.047+0000 7f4a7733a640 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x55666755ec20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4a70061040 tx=0x7f4a70002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.047+0000 7f4963e07640 1 -- 172.21.15.119:0/2352639686 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7006c070 con 0x556667462890 2024-04-23T18:31:20.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.047+0000 7f4963e07640 1 -- 172.21.15.119:0/2352639686 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7005d7f0 con 0x556667462890 2024-04-23T18:31:20.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.047+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55666755f160 con 0x556667462890 2024-04-23T18:31:20.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.047+0000 7f4963e07640 1 -- 172.21.15.119:0/2352639686 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a70063040 con 0x556667462890 2024-04-23T18:31:20.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.047+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55666755f680 con 0x556667462890 2024-04-23T18:31:20.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.047+0000 7f4963e07640 1 -- 172.21.15.119:0/2352639686 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4a70066070 con 0x556667462890 2024-04-23T18:31:20.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.048+0000 7f4963e07640 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f495c036e60 0x7f495c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.048+0000 7f4963e07640 1 -- 172.21.15.119:0/2352639686 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f4a7008dd80 con 0x556667462890 2024-04-23T18:31:20.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.048+0000 7f4a76b39640 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f495c036e60 0x7f495c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.048+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5566674631f0 0x556667565c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.048+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556667566210 con 0x5566674631f0 2024-04-23T18:31:20.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.048+0000 7f4a77b3b640 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5566674631f0 0x556667565c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.049 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.048+0000 7f4a76b39640 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f495c036e60 0x7f495c039320 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a60000c00 tx=0x7f4a600013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.048+0000 7f4a77b3b640 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5566674631f0 0x556667565c90 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.048+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2352639686 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a6800a4a0 con 0x5566674631f0 2024-04-23T18:31:20.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.049+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556667563240 con 0x5566674631f0 2024-04-23T18:31:20.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.049+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2352639686 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a6800a4a0 con 0x5566674631f0 2024-04-23T18:31:20.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.049+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5566675684e0 0x55666756a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.049+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55666756af70 con 0x5566675684e0 2024-04-23T18:31:20.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.049+0000 7f4a7733a640 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5566675684e0 0x55666756a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.049+0000 7f4a7733a640 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5566675684e0 0x55666756a8d0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.049+0000 7f4a7733a640 1 -- 172.21.15.119:0/2352639686 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4a7006e070 con 0x5566675684e0 2024-04-23T18:31:20.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.049+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556667567490 con 0x5566674631f0 2024-04-23T18:31:20.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.050+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2352639686 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a6800a4a0 con 0x5566674631f0 2024-04-23T18:31:20.050 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.050+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55666756c420 0x55666756e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.050+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55666756efd0 con 0x55666756c420 2024-04-23T18:31:20.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.050+0000 7f4a76b39640 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55666756c420 0x55666756e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.050+0000 7f4a76b39640 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55666756c420 0x55666756e870 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.051+0000 7f4a76b39640 1 -- 172.21.15.119:0/2352639686 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4a6000f670 con 0x55666756c420 2024-04-23T18:31:20.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.051+0000 7f4a7983b800 1 Processor -- start 2024-04-23T18:31:20.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.051+0000 7f4a7983b800 1 -- start start 2024-04-23T18:31:20.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.051+0000 7f4a7983b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666757d3c0 0x55666757d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.051+0000 7f4a7983b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556667355df0 con 0x55666757d3c0 2024-04-23T18:31:20.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.051+0000 7f4a7733a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666757d3c0 0x55666757d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.051+0000 7f4a7733a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666757d3c0 0x55666757d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55500/0 (socket says 172.21.15.119:55500) 2024-04-23T18:31:20.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.051+0000 7f4a7733a640 1 -- 172.21.15.119:0/2991012185 learned_addr learned my addr 172.21.15.119:0/2991012185 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:20.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.052+0000 7f4a7733a640 1 -- 172.21.15.119:0/2991012185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55666757dd20 con 0x55666757d3c0 2024-04-23T18:31:20.051 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.052+0000 7f4a7733a640 1 --2- 172.21.15.119:0/2991012185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666757d3c0 0x55666757d7e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000a450 tx=0x7f4a70009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.052+0000 7f4961602640 1 -- 172.21.15.119:0/2991012185 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7005daf0 con 0x55666757d3c0 2024-04-23T18:31:20.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.052+0000 7f4961602640 1 -- 172.21.15.119:0/2991012185 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7005dc90 con 0x55666757d3c0 2024-04-23T18:31:20.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.052+0000 7f4a7983b800 1 -- 172.21.15.119:0/2991012185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55666757e790 con 0x55666757d3c0 2024-04-23T18:31:20.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.052+0000 7f4961602640 1 -- 172.21.15.119:0/2991012185 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a700705b0 con 0x55666757d3c0 2024-04-23T18:31:20.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.052+0000 7f4a7983b800 1 -- 172.21.15.119:0/2991012185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55666757e790 con 0x55666757d3c0 2024-04-23T18:31:20.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.053+0000 7f4961602640 1 -- 172.21.15.119:0/2991012185 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4a70070750 con 0x55666757d3c0 2024-04-23T18:31:20.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.053+0000 7f4961602640 1 --2- 172.21.15.119:0/2991012185 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4950036eb0 0x7f4950039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.053+0000 7f4961602640 1 -- 172.21.15.119:0/2991012185 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f4a70084070 con 0x55666757d3c0 2024-04-23T18:31:20.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.053+0000 7f4a76b39640 1 --2- 172.21.15.119:0/2991012185 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4950036eb0 0x7f4950039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.053+0000 7f4a7983b800 1 Processor -- start 2024-04-23T18:31:20.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.053+0000 7f4a7983b800 1 -- start start 2024-04-23T18:31:20.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.053+0000 7f4a76b39640 1 --2- 172.21.15.119:0/2991012185 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4950036eb0 0x7f4950039370 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x556667563180 tx=0x7f4a60006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.052 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.053+0000 7f4a7983b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 0x55666758a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.053+0000 7f4a7983b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556667557980 con 0x55666758a320 2024-04-23T18:31:20.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.054+0000 7f4a7733a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 0x55666758a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.054+0000 7f4a7733a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 0x55666758a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55502/0 (socket says 172.21.15.119:55502) 2024-04-23T18:31:20.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.054+0000 7f4a7733a640 1 -- 172.21.15.119:0/386852234 learned_addr learned my addr 172.21.15.119:0/386852234 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:20.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.054+0000 7f4a7733a640 1 -- 172.21.15.119:0/386852234 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55666758ad10 con 0x55666758a320 2024-04-23T18:31:20.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.054+0000 7f4a7733a640 1 --2- 172.21.15.119:0/386852234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 0x55666758a740 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4a7005d4d0 tx=0x7f4a7005e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9c37caf3b76088 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.054+0000 7f495affd640 1 -- 172.21.15.119:0/386852234 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a7009d040 con 0x55666758a320 2024-04-23T18:31:20.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.054+0000 7f495affd640 1 -- 172.21.15.119:0/386852234 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a700a6070 con 0x55666758a320 2024-04-23T18:31:20.053 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.054+0000 7f495affd640 1 -- 172.21.15.119:0/386852234 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a70088d20 con 0x55666758a320 2024-04-23T18:31:20.070 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7983b800 1 -- 172.21.15.119:0/386852234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 msgr2=0x55666758a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7983b800 1 --2- 172.21.15.119:0/386852234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 0x55666758a740 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4a7005d4d0 tx=0x7f4a7005e9d0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7983b800 1 -- 172.21.15.119:0/386852234 shutdown_connections 2024-04-23T18:31:20.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7983b800 1 --2- 172.21.15.119:0/386852234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 0x55666758a740 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7983b800 1 -- 172.21.15.119:0/386852234 >> 172.21.15.119:0/386852234 conn(0x556667586630 msgr2=0x556667584690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:20.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7983b800 1 -- 172.21.15.119:0/386852234 shutdown_connections 2024-04-23T18:31:20.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7983b800 1 -- 172.21.15.119:0/386852234 wait complete. 2024-04-23T18:31:20.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7983b800 1 Processor -- start 2024-04-23T18:31:20.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7983b800 1 -- start start 2024-04-23T18:31:20.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7983b800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 0x5566675916d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7983b800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55666758b3a0 con 0x55666758a320 2024-04-23T18:31:20.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7733a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 0x5566675916d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.071 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7733a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 0x5566675916d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55506/0 (socket says 172.21.15.119:55506) 2024-04-23T18:31:20.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.055+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 learned_addr learned my addr 172.21.15.119:0/2438278229 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:20.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.056+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556667591c10 con 0x55666758a320 2024-04-23T18:31:20.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.056+0000 7f4a7733a640 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 0x5566675916d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4a7005eeb0 tx=0x7f4a70063e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.056+0000 7f49597fa640 1 -- 172.21.15.119:0/2438278229 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a70070a40 con 0x55666758a320 2024-04-23T18:31:20.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.056+0000 7f49597fa640 1 -- 172.21.15.119:0/2438278229 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a700b1070 con 0x55666758a320 2024-04-23T18:31:20.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.056+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556667591c10 con 0x55666758a320 2024-04-23T18:31:20.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.056+0000 7f49597fa640 1 -- 172.21.15.119:0/2438278229 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a70088590 con 0x55666758a320 2024-04-23T18:31:20.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.056+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556667591c10 con 0x55666758a320 2024-04-23T18:31:20.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.057+0000 7f49597fa640 1 -- 172.21.15.119:0/2438278229 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4a70088730 con 0x55666758a320 2024-04-23T18:31:20.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.057+0000 7f49597fa640 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4940036eb0 0x7f4940039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.057+0000 7f49597fa640 1 -- 172.21.15.119:0/2438278229 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f4a700b7da0 con 0x55666758a320 2024-04-23T18:31:20.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.057+0000 7f4a76b39640 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4940036eb0 0x7f4940039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.072 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.057+0000 7f4a76b39640 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4940036eb0 0x7f4940039370 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000ffd0 tx=0x7f4a60023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a7983b800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55666759ce10 0x55666759f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55666759fa20 con 0x55666759ce10 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a77b3b640 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55666759ce10 0x55666759f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a77b3b640 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55666759ce10 0x55666759f2d0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a6800a4a0 con 0x55666759ce10 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a7983b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a7983b800 20 realm 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a7983b800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55666759fe30 con 0x55666759ce10 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a6800a4a0 con 0x55666759ce10 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a7983b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a7983b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:20.073 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a7983b800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0700 con 0x55666759ce10 2024-04-23T18:31:20.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.058+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a6800a4a0 con 0x55666759ce10 2024-04-23T18:31:20.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7983b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7983b800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x55666759ce10 2024-04-23T18:31:20.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a6800a4a0 con 0x55666759ce10 2024-04-23T18:31:20.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7983b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:20.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7983b800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5566675a1800 0x5566675a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566675a4200 con 0x5566675a1800 2024-04-23T18:31:20.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7733a640 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5566675a1800 0x5566675a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.074 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7733a640 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5566675a1800 0x5566675a3bf0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4a7006e070 con 0x5566675a1800 2024-04-23T18:31:20.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7983b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:20.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7983b800 20 searching for the correct realm 2024-04-23T18:31:20.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5566675a6190 0x5566675a8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.059+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a8d20 con 0x5566675a6190 2024-04-23T18:31:20.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.060+0000 7f4a76b39640 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5566675a6190 0x5566675a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.060+0000 7f4a76b39640 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5566675a6190 0x5566675a8650 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.060+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.060+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a8d20 con 0x5566675a1800 2024-04-23T18:31:20.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.060+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7006e070 con 0x5566675a1800 2024-04-23T18:31:20.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.060+0000 7f4a7733a640 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4a700ad040 0x7f4a7005f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.060+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a8d20 con 0x7f4a700ad040 2024-04-23T18:31:20.075 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.061+0000 7f4a77b3b640 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4a700ad040 0x7f4a7005f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.061+0000 7f4a77b3b640 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4a700ad040 0x7f4a7005f8d0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.061+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6800a4a0 con 0x7f4a700ad040 2024-04-23T18:31:20.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.061+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x55666759ce10 2024-04-23T18:31:20.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.062+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6800a4a0 con 0x55666759ce10 2024-04-23T18:31:20.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.062+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x55666759ce10 2024-04-23T18:31:20.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.062+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6800a4a0 con 0x55666759ce10 2024-04-23T18:31:20.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.062+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x7f4a700ad040 2024-04-23T18:31:20.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.062+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6800a4a0 con 0x7f4a700ad040 2024-04-23T18:31:20.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.062+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x7f4a700ad040 2024-04-23T18:31:20.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.062+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4a6800a4a0 con 0x7f4a700ad040 2024-04-23T18:31:20.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.062+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a1800 2024-04-23T18:31:20.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.062+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7006e070 con 0x5566675a1800 2024-04-23T18:31:20.076 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.063+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a6190 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.063+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.063+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x55666759ce10 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.063+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6800a4a0 con 0x55666759ce10 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.063+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x7f4a700ad040 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.063+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6800a4a0 con 0x7f4a700ad040 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.063+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x55666759ce10 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.063+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6800a4a0 con 0x55666759ce10 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.063+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a1800 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.064+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4a7006e070 con 0x5566675a1800 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.064+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a6190 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.064+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.064+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a6190 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.064+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.077 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.064+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x7f4a700ad040 2024-04-23T18:31:20.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.065+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6800a4a0 con 0x7f4a700ad040 2024-04-23T18:31:20.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.065+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a6190 2024-04-23T18:31:20.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.065+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.065+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a6190 2024-04-23T18:31:20.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.065+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.065+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x55666759ce10 2024-04-23T18:31:20.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.065+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6800a4a0 con 0x55666759ce10 2024-04-23T18:31:20.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.066+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x55666759ce10 2024-04-23T18:31:20.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.066+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4a6800a4a0 con 0x55666759ce10 2024-04-23T18:31:20.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.066+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x7f4a700ad040 2024-04-23T18:31:20.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.066+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6800a4a0 con 0x7f4a700ad040 2024-04-23T18:31:20.078 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.066+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a6190 2024-04-23T18:31:20.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.066+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.066+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a1800 2024-04-23T18:31:20.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.066+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4a7006e070 con 0x5566675a1800 2024-04-23T18:31:20.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.067+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x55666759ce10 2024-04-23T18:31:20.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.067+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6800a4a0 con 0x55666759ce10 2024-04-23T18:31:20.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.067+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a1800 2024-04-23T18:31:20.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.067+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a7006e070 con 0x5566675a1800 2024-04-23T18:31:20.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.067+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a6190 2024-04-23T18:31:20.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.067+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.067+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x7f4a700ad040 2024-04-23T18:31:20.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.068+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6800a4a0 con 0x7f4a700ad040 2024-04-23T18:31:20.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.068+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a1800 2024-04-23T18:31:20.079 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.068+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a700d2040 con 0x5566675a1800 2024-04-23T18:31:20.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.068+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a6190 2024-04-23T18:31:20.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.068+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.068+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x7f4a700ad040 2024-04-23T18:31:20.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6800a4a0 con 0x7f4a700ad040 2024-04-23T18:31:20.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x55666759ce10 2024-04-23T18:31:20.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5566675a0aa0 con 0x5566675a1800 2024-04-23T18:31:20.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a700d2040 con 0x5566675a1800 2024-04-23T18:31:20.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a7983b800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:20.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a7983b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:20.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a7983b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:20.080 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a7983b800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:20.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a7983b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:20.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a7983b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:20.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a7983b800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566675a4ac0 con 0x55666759ce10 2024-04-23T18:31:20.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a7983b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a7983b800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566675a4eb0 con 0x55666759ce10 2024-04-23T18:31:20.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.069+0000 7f4a7983b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:20.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566675a4eb0 con 0x7f4a700ad040 2024-04-23T18:31:20.081 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4a68040080 con 0x7f4a700ad040 2024-04-23T18:31:20.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:20.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 20 zone default found 2024-04-23T18:31:20.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 4 Realm: () 2024-04-23T18:31:20.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:20.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:20.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:20.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 20 zonegroup default 2024-04-23T18:31:20.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566675a91a0 con 0x5566675a1800 2024-04-23T18:31:20.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4a700d2040 con 0x5566675a1800 2024-04-23T18:31:20.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.082 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.070+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566675aaf20 con 0x5566675a6190 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.071+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.071+0000 7f4a7983b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.071+0000 7f4a7983b800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.071+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566675ab2c0 con 0x5566675a6190 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.071+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.071+0000 7f4a7983b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.071+0000 7f4a7983b800 20 started sync module instance, tier type = 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.071+0000 7f4a7983b800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.071+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675aa3c0 con 0x5566675a1800 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.072+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a700d2040 con 0x5566675a1800 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.072+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93898309019888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675aa3c0 con 0x5566675a1800 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.072+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675abd00 con 0x55666759ce10 2024-04-23T18:31:20.083 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.073+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 93898309019888] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a700d2040 con 0x5566675a1800 2024-04-23T18:31:20.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.073+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.073+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93898309023696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675aa3c0 con 0x55666759ce10 2024-04-23T18:31:20.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.073+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675ac7a0 con 0x5566675a6190 2024-04-23T18:31:20.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.075+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.075+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93898309026448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675ad070 con 0x5566675a6190 2024-04-23T18:31:20.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.075+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675adb40 con 0x5566675a1800 2024-04-23T18:31:20.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.075+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93898309023696] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.076+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93898309026448] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.076+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a700d2040 con 0x5566675a1800 2024-04-23T18:31:20.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.076+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93898309028800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675a9f10 con 0x5566675a1800 2024-04-23T18:31:20.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.076+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675ae550 con 0x55666759ce10 2024-04-23T18:31:20.084 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.077+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.077+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93898309034144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675ae970 con 0x55666759ce10 2024-04-23T18:31:20.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.077+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675af3b0 con 0x7f4a700ad040 2024-04-23T18:31:20.085 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.077+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 93898309028800] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a700d2040 con 0x5566675a1800 2024-04-23T18:31:20.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.078+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x7f4a700ad040 2024-04-23T18:31:20.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.078+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93898309037696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675af370 con 0x7f4a700ad040 2024-04-23T18:31:20.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.078+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675afdc0 con 0x7f4a700ad040 2024-04-23T18:31:20.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.078+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93898309034144] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.089 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.079+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(56 notify.6 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x7f4a700ad040 2024-04-23T18:31:20.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.079+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93898309035200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675afdc0 con 0x7f4a700ad040 2024-04-23T18:31:20.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.079+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675b0780 con 0x7f4a700ad040 2024-04-23T18:31:20.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.079+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93898309037696] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x7f4a700ad040 2024-04-23T18:31:20.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.080+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93898309035200] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x7f4a700ad040 2024-04-23T18:31:20.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.080+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x7f4a700ad040 2024-04-23T18:31:20.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.080+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93898309040400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675afd30 con 0x7f4a700ad040 2024-04-23T18:31:20.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.080+0000 7f4a7983b800 20 add_watcher() i=0 2024-04-23T18:31:20.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.080+0000 7f4a7983b800 20 add_watcher() i=1 2024-04-23T18:31:20.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.080+0000 7f4a7983b800 20 add_watcher() i=2 2024-04-23T18:31:20.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.080+0000 7f4a7983b800 20 add_watcher() i=3 2024-04-23T18:31:20.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.080+0000 7f4a7983b800 20 add_watcher() i=4 2024-04-23T18:31:20.090 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.080+0000 7f4a7983b800 20 add_watcher() i=5 2024-04-23T18:31:20.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.080+0000 7f4a7983b800 20 add_watcher() i=6 2024-04-23T18:31:20.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.081+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93898309040400] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x7f4a700ad040 2024-04-23T18:31:20.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.081+0000 7f4a7983b800 20 add_watcher() i=7 2024-04-23T18:31:20.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.081+0000 7f4a7983b800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:20.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.081+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566675b37b0 con 0x55666759ce10 2024-04-23T18:31:20.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.082+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.082+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93898309042896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675b0c70 con 0x55666759ce10 2024-04-23T18:31:20.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.083+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93898309042896] v34'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.083+0000 7f492dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:20.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.083+0000 7f4a7983b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:20.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.083+0000 7f4a7983b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:20.091 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.083+0000 7f4a7983b800 5 note: GC not initialized 2024-04-23T18:31:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.083+0000 7f492cfe1640 20 reqs_thread_entry: start 2024-04-23T18:31:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.083+0000 7f4a7983b800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.083+0000 7f4a7983b800 20 Filter name: none 2024-04-23T18:31:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.083+0000 7f48a67fc640 20 reqs_thread_entry: start 2024-04-23T18:31:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.083+0000 7f4a7983b800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-23T18:31:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.083+0000 7f4a7983b800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.083+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566675e6e10 con 0x7f4a700ad040 2024-04-23T18:31:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.084+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f4a68040080 con 0x7f4a700ad040 2024-04-23T18:31:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.084+0000 7f4a7983b800 20 rados_obj.operate() r=0 bl.length=460 2024-04-23T18:31:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.084+0000 7f4a7983b800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-23T18:31:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.084+0000 7f4a7983b800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:20.092 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.084+0000 7f4a7983b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.084+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675ed410 con 0x7f4a700ad040 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.085+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x7f4a700ad040 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.085+0000 7f4a7983b800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.085+0000 7f4a7983b800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.085+0000 7f4a7983b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.085+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93898309291648 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5566675e8b00 con 0x55666759ce10 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.086+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== watch-notify(notify (1) cookie 93898309034144 notify 146028888106 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f4a68018c30 con 0x55666759ce10 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.086+0000 7f495affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 93898309034144 notifier 4910 bl.length()=649 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.086+0000 7f495affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.086+0000 7f495affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.086+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 notify.4 [notify cookie 93898309291648 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.086+0000 7f495affd640 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f493c003ea0 con 0x55666759ce10 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.086+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.093 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.086+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== watch-notify(notify_complete (2) cookie 93898309291648 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4a68018e00 con 0x55666759ce10 2024-04-23T18:31:20.094 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-23T18:31:18.209839Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:31:18.209827Z","tags":[],"group_ids":[]} 2024-04-23T18:31:20.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.087+0000 7f492dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.087+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93898309042896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675e92c0 con 0x55666759ce10 2024-04-23T18:31:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.088+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93898309042896] v34'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.088+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93898309019888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675e92c0 con 0x5566675a1800 2024-04-23T18:31:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.089+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93898309019888] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a700d2040 con 0x5566675a1800 2024-04-23T18:31:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.089+0000 7f4a7983b800 20 remove_watcher() i=0 2024-04-23T18:31:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.089+0000 7f4a7983b800 2 removed watcher, disabling cache 2024-04-23T18:31:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.089+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93898309023696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675e92c0 con 0x55666759ce10 2024-04-23T18:31:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.090+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93898309023696] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.090+0000 7f4a7983b800 20 remove_watcher() i=1 2024-04-23T18:31:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.090+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93898309026448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675e92c0 con 0x5566675a6190 2024-04-23T18:31:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.091+0000 7f4a76b39640 1 -- 172.21.15.119:0/2438278229 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93898309026448] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a60037040 con 0x5566675a6190 2024-04-23T18:31:20.100 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.091+0000 7f4a7983b800 20 remove_watcher() i=2 2024-04-23T18:31:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.091+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93898309028800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675aa8f0 con 0x5566675a1800 2024-04-23T18:31:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.092+0000 7f4a7733a640 1 -- 172.21.15.119:0/2438278229 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93898309028800] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a700d2040 con 0x5566675a1800 2024-04-23T18:31:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.092+0000 7f4a7983b800 20 remove_watcher() i=3 2024-04-23T18:31:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.092+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93898309034144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675ab7d0 con 0x55666759ce10 2024-04-23T18:31:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.094+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93898309034144] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x55666759ce10 2024-04-23T18:31:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.094+0000 7f4a7983b800 20 remove_watcher() i=4 2024-04-23T18:31:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.094+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93898309037696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675acbc0 con 0x7f4a700ad040 2024-04-23T18:31:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.095+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93898309037696] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x7f4a700ad040 2024-04-23T18:31:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.095+0000 7f4a7983b800 20 remove_watcher() i=5 2024-04-23T18:31:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.095+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93898309035200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675aa8f0 con 0x7f4a700ad040 2024-04-23T18:31:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.096+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93898309035200] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x7f4a700ad040 2024-04-23T18:31:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.096+0000 7f4a7983b800 20 remove_watcher() i=6 2024-04-23T18:31:20.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.096+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93898309040400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5566675ab7d0 con 0x7f4a700ad040 2024-04-23T18:31:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93898309040400] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a68040080 con 0x7f4a700ad040 2024-04-23T18:31:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 20 remove_watcher() i=7 2024-04-23T18:31:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4a700ad040 msgr2=0x7f4a7005f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f4a700ad040 0x7f4a7005f8d0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55666759ce10 msgr2=0x55666759f2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55666759ce10 0x55666759f2d0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5566675a1800 msgr2=0x5566675a3bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5566675a1800 0x5566675a3bf0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5566675a6190 msgr2=0x5566675a8650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x5566675a6190 0x5566675a8650 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4940036eb0 msgr2=0x7f4940039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4940036eb0 0x7f4940039370 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4a6000ffd0 tx=0x7f4a60023040 comp rx=0 tx=0).stop 2024-04-23T18:31:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 msgr2=0x5566675916d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2438278229 reap_dead start 2024-04-23T18:31:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 0x5566675916d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4a7005eeb0 tx=0x7f4a70063e90 comp rx=0 tx=0).stop 2024-04-23T18:31:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 shutdown_connections 2024-04-23T18:31:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2438278229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666758a320 0x5566675916d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 >> 172.21.15.119:0/2438278229 conn(0x556667586630 msgr2=0x556667583c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 shutdown_connections 2024-04-23T18:31:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.097+0000 7f4a7983b800 1 -- 172.21.15.119:0/2438278229 wait complete. 2024-04-23T18:31:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2991012185 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4950036eb0 msgr2=0x7f4950039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2991012185 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4950036eb0 0x7f4950039370 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x556667563180 tx=0x7f4a60006000 comp rx=0 tx=0).stop 2024-04-23T18:31:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2991012185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666757d3c0 msgr2=0x55666757d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2991012185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666757d3c0 0x55666757d7e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000a450 tx=0x7f4a70009640 comp rx=0 tx=0).stop 2024-04-23T18:31:20.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2991012185 shutdown_connections 2024-04-23T18:31:20.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2991012185 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f4950036eb0 0x7f4950039370 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2991012185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55666757d3c0 0x55666757d7e0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2991012185 >> 172.21.15.119:0/2991012185 conn(0x556667571460 msgr2=0x556667571860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:20.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2991012185 shutdown_connections 2024-04-23T18:31:20.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2991012185 wait complete. 2024-04-23T18:31:20.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55666756c420 msgr2=0x55666756e870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55666756c420 0x55666756e870 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5566674631f0 msgr2=0x556667565c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5566674631f0 0x556667565c90 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5566675684e0 msgr2=0x55666756a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5566675684e0 0x55666756a8d0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f495c036e60 msgr2=0x7f495c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.104 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f495c036e60 0x7f495c039320 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a60000c00 tx=0x7f4a600013b0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 msgr2=0x55666755ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 --2- 172.21.15.119:0/2352639686 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556667462890 0x55666755ec20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4a70061040 tx=0x7f4a70002fb0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a77b3b640 1 -- 172.21.15.119:0/2352639686 reap_dead start 2024-04-23T18:31:20.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 shutdown_connections 2024-04-23T18:31:20.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 >> 172.21.15.119:0/2352639686 conn(0x55666745e430 msgr2=0x556667551460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:20.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 shutdown_connections 2024-04-23T18:31:20.105 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.098+0000 7f4a7983b800 1 -- 172.21.15.119:0/2352639686 wait complete. 2024-04-23T18:31:20.105 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:20.105 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:20.105 ERROR:root:0 2024-04-23T18:31:20.106 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-23T18:31:20.106 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-23T18:31:20.106 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-23T18:31:20.150 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:31:20.150 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:31:20.151 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.158+0000 7f7de401d800 1 Processor -- start 2024-04-23T18:31:20.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.158+0000 7f7de401d800 1 -- start start 2024-04-23T18:31:20.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.158+0000 7f7de401d800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55a76bf83a80 0x55a76bf85e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.158+0000 7f7de401d800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a76be33560 con 0x55a76bf863b0 2024-04-23T18:31:20.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.158+0000 7f7de401d800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55a76be24e20 con 0x55a76bf83a80 2024-04-23T18:31:20.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.158+0000 7f7de1b1c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55a76bf83a80 0x55a76bf85e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.158+0000 7f7dd931b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55a76bf863b0 0x55a76bf887a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:50696/0 (socket says 172.21.15.119:50696) 2024-04-23T18:31:20.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.158+0000 7f7dd931b640 1 -- 172.21.15.119:0/2727540542 learned_addr learned my addr 172.21.15.119:0/2727540542 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:31:20.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.158+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2727540542 >> v1:172.21.15.62:6789/0 conn(0x55a76bf863b0 legacy=0x55a76bf887a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.152 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.158+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2727540542 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76be32e60 con 0x55a76bf83a80 2024-04-23T18:31:20.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.160+0000 7f7de1b1c640 1 --2- 172.21.15.119:0/2727540542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76bf85e70 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400a470 tx=0x7f7dd401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c54eb5d84fe366c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.160+0000 7f7de131b640 1 -- 172.21.15.119:0/2727540542 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd4057070 con 0x55a76bf83a80 2024-04-23T18:31:20.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.160+0000 7f7de131b640 1 -- 172.21.15.119:0/2727540542 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd4052570 con 0x55a76bf83a80 2024-04-23T18:31:20.154 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.160+0000 7f7de131b640 1 -- 172.21.15.119:0/2727540542 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd4052870 con 0x55a76bf83a80 2024-04-23T18:31:20.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.161+0000 7f7de401d800 1 -- 172.21.15.119:0/2727540542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 msgr2=0x55a76bf85e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.161+0000 7f7de401d800 1 --2- 172.21.15.119:0/2727540542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76bf85e70 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400a470 tx=0x7f7dd401ce90 comp rx=0 tx=0).stop 2024-04-23T18:31:20.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.161+0000 7f7de401d800 1 -- 172.21.15.119:0/2727540542 shutdown_connections 2024-04-23T18:31:20.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.161+0000 7f7de401d800 1 --2- 172.21.15.119:0/2727540542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76bf85e70 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.161+0000 7f7de401d800 1 -- 172.21.15.119:0/2727540542 >> 172.21.15.119:0/2727540542 conn(0x55a76bf7d430 msgr2=0x55a76bf7f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:20.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.161+0000 7f7de401d800 1 -- 172.21.15.119:0/2727540542 shutdown_connections 2024-04-23T18:31:20.155 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.161+0000 7f7de401d800 1 -- 172.21.15.119:0/2727540542 wait complete. 2024-04-23T18:31:20.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.172+0000 7f7de401d800 1 Processor -- start 2024-04-23T18:31:20.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.173+0000 7f7de401d800 1 -- start start 2024-04-23T18:31:20.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.173+0000 7f7de401d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76bf833c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.173+0000 7f7de401d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a76bece5d0 con 0x55a76bf83a80 2024-04-23T18:31:20.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.173+0000 7f7de1b1c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76bf833c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.173+0000 7f7de1b1c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76bf833c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55526/0 (socket says 172.21.15.119:55526) 2024-04-23T18:31:20.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.173+0000 7f7de1b1c640 1 -- 172.21.15.119:0/3604613939 learned_addr learned my addr 172.21.15.119:0/3604613939 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:20.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.173+0000 7f7de1b1c640 1 -- 172.21.15.119:0/3604613939 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76be44860 con 0x55a76bf83a80 2024-04-23T18:31:20.167 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.173+0000 7f7de1b1c640 1 --2- 172.21.15.119:0/3604613939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76bf833c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4055040 tx=0x7f7dd404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39badf8a50693c0d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.174+0000 7f7ccfe07640 1 -- 172.21.15.119:0/3604613939 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd4057070 con 0x55a76bf83a80 2024-04-23T18:31:20.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.174+0000 7f7ccfe07640 1 -- 172.21.15.119:0/3604613939 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd4063070 con 0x55a76bf83a80 2024-04-23T18:31:20.168 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.174+0000 7f7ccfe07640 1 -- 172.21.15.119:0/3604613939 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd4052720 con 0x55a76bf83a80 2024-04-23T18:31:20.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.174+0000 7f7de401d800 1 -- 172.21.15.119:0/3604613939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 msgr2=0x55a76bf833c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.174+0000 7f7de401d800 1 --2- 172.21.15.119:0/3604613939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76bf833c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4055040 tx=0x7f7dd404c000 comp rx=0 tx=0).stop 2024-04-23T18:31:20.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.174+0000 7f7de401d800 1 -- 172.21.15.119:0/3604613939 shutdown_connections 2024-04-23T18:31:20.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.174+0000 7f7de401d800 1 --2- 172.21.15.119:0/3604613939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76bf833c0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.174+0000 7f7de401d800 1 -- 172.21.15.119:0/3604613939 >> 172.21.15.119:0/3604613939 conn(0x55a76bf7d430 msgr2=0x55a76c06fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:20.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.174+0000 7f7de401d800 1 -- 172.21.15.119:0/3604613939 shutdown_connections 2024-04-23T18:31:20.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.175+0000 7f7de401d800 1 -- 172.21.15.119:0/3604613939 wait complete. 2024-04-23T18:31:20.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.175+0000 7f7de401d800 1 Processor -- start 2024-04-23T18:31:20.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.175+0000 7f7de401d800 1 -- start start 2024-04-23T18:31:20.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.175+0000 7f7de401d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76c07dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.175+0000 7f7de401d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a76bf8c1d0 con 0x55a76bf83a80 2024-04-23T18:31:20.173 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.175+0000 7f7de1b1c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76c07dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.175+0000 7f7de1b1c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76c07dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55534/0 (socket says 172.21.15.119:55534) 2024-04-23T18:31:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.175+0000 7f7de1b1c640 1 -- 172.21.15.119:0/3124898602 learned_addr learned my addr 172.21.15.119:0/3124898602 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.175+0000 7f7de1b1c640 1 -- 172.21.15.119:0/3124898602 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76be42eb0 con 0x55a76bf83a80 2024-04-23T18:31:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.176+0000 7f7de1b1c640 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76c07dc90 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4060040 tx=0x7f7dd4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.176+0000 7f7cce604640 1 -- 172.21.15.119:0/3124898602 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd4052e30 con 0x55a76bf83a80 2024-04-23T18:31:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.176+0000 7f7cce604640 1 -- 172.21.15.119:0/3124898602 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd406c070 con 0x55a76bf83a80 2024-04-23T18:31:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.176+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a76c07e1d0 con 0x55a76bf83a80 2024-04-23T18:31:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.176+0000 7f7cce604640 1 -- 172.21.15.119:0/3124898602 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd405e5d0 con 0x55a76bf83a80 2024-04-23T18:31:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.176+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a76c07e750 con 0x55a76bf83a80 2024-04-23T18:31:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.177+0000 7f7cce604640 1 -- 172.21.15.119:0/3124898602 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7dd405e770 con 0x55a76bf83a80 2024-04-23T18:31:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.177+0000 7f7cce604640 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cc8036eb0 0x7f7cc8039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.174 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.177+0000 7f7cce604640 1 -- 172.21.15.119:0/3124898602 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f7dd408ef60 con 0x55a76bf83a80 2024-04-23T18:31:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.177+0000 7f7dd931b640 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cc8036eb0 0x7f7cc8039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.177+0000 7f7de401d800 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55a76bf863b0 0x55a76c084d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.177+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c085280 con 0x55a76bf863b0 2024-04-23T18:31:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.177+0000 7f7de231d640 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55a76bf863b0 0x55a76c084d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.177+0000 7f7dd931b640 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cc8036eb0 0x7f7cc8039370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc001d90 tx=0x7f7dcc0012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.177+0000 7f7de231d640 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55a76bf863b0 0x55a76c084d00 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.178+0000 7f7de231d640 1 -- 172.21.15.119:0/3124898602 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76bf863b0 2024-04-23T18:31:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.178+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0822b0 con 0x55a76bf863b0 2024-04-23T18:31:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.178+0000 7f7de231d640 1 -- 172.21.15.119:0/3124898602 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76bf863b0 2024-04-23T18:31:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.178+0000 7f7de401d800 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55a76c087590 0x55a76c089980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.178+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c08a020 con 0x55a76c087590 2024-04-23T18:31:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.178+0000 7f7de1b1c640 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55a76c087590 0x55a76c089980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.175 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.178+0000 7f7de1b1c640 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55a76c087590 0x55a76c089980 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.179+0000 7f7de1b1c640 1 -- 172.21.15.119:0/3124898602 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7dd4009d10 con 0x55a76c087590 2024-04-23T18:31:20.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.179+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c086540 con 0x55a76bf863b0 2024-04-23T18:31:20.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.179+0000 7f7de231d640 1 -- 172.21.15.119:0/3124898602 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76bf863b0 2024-04-23T18:31:20.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.179+0000 7f7de401d800 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55a76c08b4d0 0x55a76c08d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.179+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c08e080 con 0x55a76c08b4d0 2024-04-23T18:31:20.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.179+0000 7f7dd931b640 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55a76c08b4d0 0x55a76c08d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.176 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.180+0000 7f7dd931b640 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55a76c08b4d0 0x55a76c08d920 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.180+0000 7f7dd931b640 1 -- 172.21.15.119:0/3124898602 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c08b4d0 2024-04-23T18:31:20.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.180+0000 7f7de401d800 1 Processor -- start 2024-04-23T18:31:20.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.180+0000 7f7de401d800 1 -- start start 2024-04-23T18:31:20.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.180+0000 7f7de401d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c09c4e0 0x55a76c09c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.180+0000 7f7de401d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a76be74df0 con 0x55a76c09c4e0 2024-04-23T18:31:20.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.180+0000 7f7de1b1c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c09c4e0 0x55a76c09c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.181+0000 7f7de1b1c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c09c4e0 0x55a76c09c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55550/0 (socket says 172.21.15.119:55550) 2024-04-23T18:31:20.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.181+0000 7f7de1b1c640 1 -- 172.21.15.119:0/3654548270 learned_addr learned my addr 172.21.15.119:0/3654548270 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:20.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.181+0000 7f7de1b1c640 1 -- 172.21.15.119:0/3654548270 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76c09ce40 con 0x55a76c09c4e0 2024-04-23T18:31:20.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.181+0000 7f7de1b1c640 1 --2- 172.21.15.119:0/3654548270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c09c4e0 0x55a76c09c900 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4055040 tx=0x7f7dd4068bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.195 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.181+0000 7f7cc77fe640 1 -- 172.21.15.119:0/3654548270 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd405ea60 con 0x55a76c09c4e0 2024-04-23T18:31:20.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.181+0000 7f7cc77fe640 1 -- 172.21.15.119:0/3654548270 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd4058040 con 0x55a76c09c4e0 2024-04-23T18:31:20.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.181+0000 7f7de401d800 1 -- 172.21.15.119:0/3654548270 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a76c09d8b0 con 0x55a76c09c4e0 2024-04-23T18:31:20.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.181+0000 7f7cc77fe640 1 -- 172.21.15.119:0/3654548270 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd405ed50 con 0x55a76c09c4e0 2024-04-23T18:31:20.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.181+0000 7f7de401d800 1 -- 172.21.15.119:0/3654548270 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a76c09ddb0 con 0x55a76c09c4e0 2024-04-23T18:31:20.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.182+0000 7f7cc77fe640 1 -- 172.21.15.119:0/3654548270 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7dd4090020 con 0x55a76c09c4e0 2024-04-23T18:31:20.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.182+0000 7f7cc77fe640 1 --2- 172.21.15.119:0/3654548270 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cbc036eb0 0x7f7cbc039370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.182+0000 7f7cc77fe640 1 -- 172.21.15.119:0/3654548270 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f7dd40600d0 con 0x55a76c09c4e0 2024-04-23T18:31:20.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.182+0000 7f7dd931b640 1 --2- 172.21.15.119:0/3654548270 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cbc036eb0 0x7f7cbc039370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.182+0000 7f7de401d800 1 Processor -- start 2024-04-23T18:31:20.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.182+0000 7f7de401d800 1 -- start start 2024-04-23T18:31:20.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.183+0000 7f7dd931b640 1 --2- 172.21.15.119:0/3654548270 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cbc036eb0 0x7f7cbc039370 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55a76c0821f0 tx=0x7f7dcc00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.196 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.183+0000 7f7de401d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c0a9640 0x55a76c0a9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.183+0000 7f7de401d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a76bf81980 con 0x55a76c0a9640 2024-04-23T18:31:20.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.183+0000 7f7de1b1c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c0a9640 0x55a76c0a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.183+0000 7f7de1b1c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c0a9640 0x55a76c0a9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55558/0 (socket says 172.21.15.119:55558) 2024-04-23T18:31:20.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.183+0000 7f7de1b1c640 1 -- 172.21.15.119:0/1544025152 learned_addr learned my addr 172.21.15.119:0/1544025152 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:20.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.183+0000 7f7de1b1c640 1 -- 172.21.15.119:0/1544025152 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76c0aa030 con 0x55a76c0a9640 2024-04-23T18:31:20.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.183+0000 7f7de1b1c640 1 --2- 172.21.15.119:0/1544025152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c0a9640 0x55a76c0a9a60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4073040 tx=0x7f7dd404cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930e9f76fdd65fc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.183+0000 7f7cc57fa640 1 -- 172.21.15.119:0/1544025152 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd4071d90 con 0x55a76c0a9640 2024-04-23T18:31:20.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.183+0000 7f7cc57fa640 1 -- 172.21.15.119:0/1544025152 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd4071ad0 con 0x55a76c0a9640 2024-04-23T18:31:20.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.183+0000 7f7cc57fa640 1 -- 172.21.15.119:0/1544025152 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd405fd60 con 0x55a76c0a9640 2024-04-23T18:31:20.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de401d800 1 -- 172.21.15.119:0/1544025152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c0a9640 msgr2=0x55a76c0a9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.197 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de401d800 1 --2- 172.21.15.119:0/1544025152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c0a9640 0x55a76c0a9a60 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4073040 tx=0x7f7dd404cfd0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de401d800 1 -- 172.21.15.119:0/1544025152 shutdown_connections 2024-04-23T18:31:20.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de401d800 1 --2- 172.21.15.119:0/1544025152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c0a9640 0x55a76c0a9a60 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de401d800 1 -- 172.21.15.119:0/1544025152 >> 172.21.15.119:0/1544025152 conn(0x55a76c0a5910 msgr2=0x55a76c0a3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:20.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de401d800 1 -- 172.21.15.119:0/1544025152 shutdown_connections 2024-04-23T18:31:20.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de401d800 1 -- 172.21.15.119:0/1544025152 wait complete. 2024-04-23T18:31:20.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de401d800 1 Processor -- start 2024-04-23T18:31:20.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de401d800 1 -- start start 2024-04-23T18:31:20.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de401d800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c0a9640 0x55a76c0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de401d800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a76c0aa690 con 0x55a76c0a9640 2024-04-23T18:31:20.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de1b1c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c0a9640 0x55a76c0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.198 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de1b1c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c0a9640 0x55a76c0b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:55562/0 (socket says 172.21.15.119:55562) 2024-04-23T18:31:20.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.184+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 learned_addr learned my addr 172.21.15.119:0/2421594821 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:31:20.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.185+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76c0b0e80 con 0x55a76c0a9640 2024-04-23T18:31:20.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.185+0000 7f7de1b1c640 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c0a9640 0x55a76c0b0940 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4073040 tx=0x7f7dd4064f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.185+0000 7f7cb37fe640 1 -- 172.21.15.119:0/2421594821 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd40b7020 con 0x55a76c0a9640 2024-04-23T18:31:20.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.185+0000 7f7cb37fe640 1 -- 172.21.15.119:0/2421594821 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd408d600 con 0x55a76c0a9640 2024-04-23T18:31:20.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.185+0000 7f7cb37fe640 1 -- 172.21.15.119:0/2421594821 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dd408d920 con 0x55a76c0a9640 2024-04-23T18:31:20.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.185+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a76c0b0e80 con 0x55a76c0a9640 2024-04-23T18:31:20.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.185+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a76c0b0e80 con 0x55a76c0a9640 2024-04-23T18:31:20.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.186+0000 7f7cb37fe640 1 -- 172.21.15.119:0/2421594821 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f7dd40ba020 con 0x55a76c0a9640 2024-04-23T18:31:20.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.186+0000 7f7cb37fe640 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cac037050 0x7f7cac039510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.186+0000 7f7cb37fe640 1 -- 172.21.15.119:0/2421594821 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f7dd40bdd10 con 0x55a76c0a9640 2024-04-23T18:31:20.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.186+0000 7f7dd931b640 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cac037050 0x7f7cac039510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.199 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.186+0000 7f7dd931b640 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cac037050 0x7f7cac039510 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55a76c08e480 tx=0x7f7dcc010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.187+0000 7f7de401d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.187+0000 7f7de401d800 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55a76c0bc060 0x55a76c0be520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.187+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bec70 con 0x55a76c0bc060 2024-04-23T18:31:20.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.187+0000 7f7de231d640 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55a76c0bc060 0x55a76c0be520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.187+0000 7f7de231d640 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55a76c0bc060 0x55a76c0be520 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.187+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76c0bc060 2024-04-23T18:31:20.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.187+0000 7f7de401d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.187+0000 7f7de401d800 20 realm 2024-04-23T18:31:20.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.187+0000 7f7de401d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.187+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bf080 con 0x55a76c0bc060 2024-04-23T18:31:20.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76c0bc060 2024-04-23T18:31:20.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de401d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.200 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de401d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:31:20.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de401d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bf950 con 0x55a76c0bc060 2024-04-23T18:31:20.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76c0bc060 2024-04-23T18:31:20.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de401d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de401d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0bc060 2024-04-23T18:31:20.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76c0bc060 2024-04-23T18:31:20.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de401d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:20.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de401d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de401d800 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55a76c0c0a50 0x55a76c0c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c3450 con 0x55a76c0c0a50 2024-04-23T18:31:20.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de1b1c640 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55a76c0c0a50 0x55a76c0c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.201 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.188+0000 7f7de1b1c640 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55a76c0c0a50 0x55a76c0c2e40 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.189+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7dd4009d10 con 0x55a76c0c0a50 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.189+0000 7f7de401d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.189+0000 7f7de401d800 20 searching for the correct realm 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.189+0000 7f7de401d800 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55a76c0c5400 0x55a76c0c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.189+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c7f90 con 0x55a76c0c5400 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.189+0000 7f7dd931b640 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55a76c0c5400 0x55a76c0c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.189+0000 7f7dd931b640 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55a76c0c5400 0x55a76c0c78c0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.189+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.189+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c7f90 con 0x55a76c0c0a50 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.190+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd4009d10 con 0x55a76c0c0a50 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.190+0000 7f7de1b1c640 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f7dd40bc020 0x7f7dd40b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.190+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c7f90 con 0x7f7dd40bc020 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.190+0000 7f7de231d640 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f7dd40bc020 0x7f7dd40b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:31:20.202 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.190+0000 7f7de231d640 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f7dd40bc020 0x7f7dd40b38d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:31:20.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.191+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x7f7dd40bc020 2024-04-23T18:31:20.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.191+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0bc060 2024-04-23T18:31:20.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.191+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76c0bc060 2024-04-23T18:31:20.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.191+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0bc060 2024-04-23T18:31:20.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.191+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76c0bc060 2024-04-23T18:31:20.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.191+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x7f7dd40bc020 2024-04-23T18:31:20.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.191+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x7f7dd40bc020 2024-04-23T18:31:20.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.191+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x7f7dd40bc020 2024-04-23T18:31:20.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.191+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x7f7dd40bc020 2024-04-23T18:31:20.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.191+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c0a50 2024-04-23T18:31:20.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.192+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd4009d10 con 0x55a76c0c0a50 2024-04-23T18:31:20.203 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.192+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c5400 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.192+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.192+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0bc060 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.192+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76c0bc060 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.192+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x7f7dd40bc020 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.193+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x7f7dd40bc020 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.193+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0bc060 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.193+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76c0bc060 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.193+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c0a50 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.193+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7dd4009d10 con 0x55a76c0c0a50 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.193+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c5400 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.193+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.193+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c5400 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.194+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.204 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.194+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x7f7dd40bc020 2024-04-23T18:31:20.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.194+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x7f7dd40bc020 2024-04-23T18:31:20.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.194+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c5400 2024-04-23T18:31:20.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.194+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.194+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c5400 2024-04-23T18:31:20.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.194+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.194+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0bc060 2024-04-23T18:31:20.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.195+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76c0bc060 2024-04-23T18:31:20.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.195+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0bc060 2024-04-23T18:31:20.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.195+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76c0bc060 2024-04-23T18:31:20.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.195+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x7f7dd40bc020 2024-04-23T18:31:20.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.195+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x7f7dd40bc020 2024-04-23T18:31:20.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.195+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c5400 2024-04-23T18:31:20.205 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.195+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.195+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c0a50 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.196+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7dd4009d10 con 0x55a76c0c0a50 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.196+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0bc060 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.196+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x55a76c0bc060 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.196+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c0a50 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.196+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd4009d10 con 0x55a76c0c0a50 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.196+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c5400 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.196+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.196+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x7f7dd40bc020 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.197+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x7f7dd40bc020 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.197+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c0a50 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.197+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd40d8040 con 0x55a76c0c0a50 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.197+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c5400 2024-04-23T18:31:20.206 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.197+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.197+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x7f7dd40bc020 2024-04-23T18:31:20.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ddc00a4a0 con 0x7f7dd40bc020 2024-04-23T18:31:20.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0bc060 2024-04-23T18:31:20.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0bfcf0 con 0x55a76c0c0a50 2024-04-23T18:31:20.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7dd40d8040 con 0x55a76c0c0a50 2024-04-23T18:31:20.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de401d800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:31:20.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de401d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:31:20.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de401d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:31:20.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de401d800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:31:20.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de401d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:31:20.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de401d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:31:20.207 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de401d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c3d10 con 0x55a76c0bc060 2024-04-23T18:31:20.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.198+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c4100 con 0x55a76c0bc060 2024-04-23T18:31:20.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:31:20.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c4100 con 0x7f7dd40bc020 2024-04-23T18:31:20.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7ddc040080 con 0x7f7dd40bc020 2024-04-23T18:31:20.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:31:20.208 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 20 zone default found 2024-04-23T18:31:20.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 4 Realm: () 2024-04-23T18:31:20.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:31:20.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:31:20.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:31:20.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 20 zonegroup default 2024-04-23T18:31:20.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c8410 con 0x55a76c0c0a50 2024-04-23T18:31:20.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7dd40d8040 con 0x55a76c0c0a50 2024-04-23T18:31:20.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.199+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0ca190 con 0x55a76c0c5400 2024-04-23T18:31:20.209 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.200+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.200+0000 7f7de401d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.200+0000 7f7de401d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.200+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0ca530 con 0x55a76c0c5400 2024-04-23T18:31:20.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.200+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.200+0000 7f7de401d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:31:20.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.200+0000 7f7de401d800 20 started sync module instance, tier type = 2024-04-23T18:31:20.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.200+0000 7f7de401d800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:31:20.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.200+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c9630 con 0x55a76c0c0a50 2024-04-23T18:31:20.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.201+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dd40d8040 con 0x55a76c0c0a50 2024-04-23T18:31:20.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.201+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94177560664608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c9290 con 0x55a76c0c0a50 2024-04-23T18:31:20.210 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.201+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0cb230 con 0x55a76c0bc060 2024-04-23T18:31:20.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.202+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94177560664608] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dd40d8040 con 0x55a76c0c0a50 2024-04-23T18:31:20.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.202+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.202+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94177560668368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0cb1a0 con 0x55a76c0bc060 2024-04-23T18:31:20.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.202+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0cbd50 con 0x55a76c0c5400 2024-04-23T18:31:20.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.203+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94177560668368] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.216 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.204+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.204+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94177560669424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0cb110 con 0x55a76c0c5400 2024-04-23T18:31:20.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.204+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0ccc10 con 0x55a76c0c0a50 2024-04-23T18:31:20.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.205+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94177560669424] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.205+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dd40d8040 con 0x55a76c0c0a50 2024-04-23T18:31:20.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.205+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94177560676192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0cd030 con 0x55a76c0c0a50 2024-04-23T18:31:20.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.205+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0cd9f0 con 0x55a76c0bc060 2024-04-23T18:31:20.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.206+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.206+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94177560679744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0cde10 con 0x55a76c0bc060 2024-04-23T18:31:20.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.206+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94177560676192] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dd40d8040 con 0x55a76c0c0a50 2024-04-23T18:31:20.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.206+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0ce8d0 con 0x7f7dd40bc020 2024-04-23T18:31:20.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.207+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94177560679744] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.207+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x7f7dd40bc020 2024-04-23T18:31:20.217 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.207+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94177560683424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0cd960 con 0x7f7dd40bc020 2024-04-23T18:31:20.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.207+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0cf170 con 0x7f7dd40bc020 2024-04-23T18:31:20.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.208+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94177560683424] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x7f7dd40bc020 2024-04-23T18:31:20.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.208+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x7f7dd40bc020 2024-04-23T18:31:20.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.208+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94177560677248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0cd960 con 0x7f7dd40bc020 2024-04-23T18:31:20.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.208+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0cf750 con 0x7f7dd40bc020 2024-04-23T18:31:20.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.209+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94177560677248] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x7f7dd40bc020 2024-04-23T18:31:20.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.209+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x7f7dd40bc020 2024-04-23T18:31:20.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.209+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94177560687168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0cf710 con 0x7f7dd40bc020 2024-04-23T18:31:20.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.209+0000 7f7de401d800 20 add_watcher() i=0 2024-04-23T18:31:20.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.209+0000 7f7de401d800 20 add_watcher() i=1 2024-04-23T18:31:20.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.209+0000 7f7de401d800 20 add_watcher() i=2 2024-04-23T18:31:20.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.209+0000 7f7de401d800 20 add_watcher() i=3 2024-04-23T18:31:20.218 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.209+0000 7f7de401d800 20 add_watcher() i=4 2024-04-23T18:31:20.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.209+0000 7f7de401d800 20 add_watcher() i=5 2024-04-23T18:31:20.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.209+0000 7f7de401d800 20 add_watcher() i=6 2024-04-23T18:31:20.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.210+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94177560687168] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x7f7dd40bc020 2024-04-23T18:31:20.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.210+0000 7f7de401d800 20 add_watcher() i=7 2024-04-23T18:31:20.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.210+0000 7f7de401d800 2 all 8 watchers are set, enabling cache 2024-04-23T18:31:20.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.210+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0d2b70 con 0x55a76c0bc060 2024-04-23T18:31:20.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.210+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.210+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94177560685552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0d0090 con 0x55a76c0bc060 2024-04-23T18:31:20.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.211+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94177560685552] v34'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.212+0000 7f7c937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:20.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.212+0000 7f7de401d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:31:20.219 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.212+0000 7f7de401d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.212+0000 7f7de401d800 5 note: GC not initialized 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.212+0000 7f7c927fc640 20 reqs_thread_entry: start 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.212+0000 7f7de401d800 20 init_complete bucket index max shards: 11 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.212+0000 7f7de401d800 20 Filter name: none 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.212+0000 7f7c03fff640 20 reqs_thread_entry: start 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.212+0000 7f7de401d800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.212+0000 7f7de401d800 20 rados->read ofs=0 len=0 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.212+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c106370 con 0x7f7dd40bc020 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.213+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f7ddc040080 con 0x7f7dd40bc020 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.213+0000 7f7de401d800 20 rados_obj.operate() r=0 bl.length=473 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.213+0000 7f7de401d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.213+0000 7f7de401d800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.213+0000 7f7de401d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-23T18:31:20.220 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.213+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c10cc90 con 0x7f7dd40bc020 2024-04-23T18:31:20.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.214+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x7f7dd40bc020 2024-04-23T18:31:20.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.214+0000 7f7de401d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:20.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.214+0000 7f7de401d800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:20.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.214+0000 7f7de401d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-23T18:31:20.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.214+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94177560938240 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a76c108380 con 0x55a76c0bc060 2024-04-23T18:31:20.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.214+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== watch-notify(notify (1) cookie 94177560679744 notify 146028888107 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f7ddc018c30 con 0x55a76c0bc060 2024-04-23T18:31:20.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.214+0000 7f7cc57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94177560679744 notifier 4917 bl.length()=649 2024-04-23T18:31:20.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.214+0000 7f7cc57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-23T18:31:20.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.214+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(64 notify.4 [notify cookie 94177560938240 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.214+0000 7f7cc57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-23T18:31:20.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.214+0000 7f7cc57fa640 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7ca4003ea0 con 0x55a76c0bc060 2024-04-23T18:31:20.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.215+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.221 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.215+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== watch-notify(notify_complete (2) cookie 94177560938240 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7ddc018e00 con 0x55a76c0bc060 2024-04-23T18:31:20.222 INFO:teuthology.orchestra.run.smithi119.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-23T18:31:18.209839Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-23T18:31:18.209827Z","tags":[],"group_ids":[]} 2024-04-23T18:31:20.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.216+0000 7f7c937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:31:20.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.216+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94177560685552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c108b40 con 0x55a76c0bc060 2024-04-23T18:31:20.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.216+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94177560685552] v34'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.217+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94177560664608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c108b40 con 0x55a76c0c0a50 2024-04-23T18:31:20.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.218+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94177560664608] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dd40d8040 con 0x55a76c0c0a50 2024-04-23T18:31:20.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.218+0000 7f7de401d800 20 remove_watcher() i=0 2024-04-23T18:31:20.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.218+0000 7f7de401d800 2 removed watcher, disabling cache 2024-04-23T18:31:20.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.218+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94177560668368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c108b40 con 0x55a76c0bc060 2024-04-23T18:31:20.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.219+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94177560668368] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.219+0000 7f7de401d800 20 remove_watcher() i=1 2024-04-23T18:31:20.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.219+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94177560669424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c108b40 con 0x55a76c0c5400 2024-04-23T18:31:20.228 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.220+0000 7f7dd931b640 1 -- 172.21.15.119:0/2421594821 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94177560669424] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dcc009050 con 0x55a76c0c5400 2024-04-23T18:31:20.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.220+0000 7f7de401d800 20 remove_watcher() i=2 2024-04-23T18:31:20.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.220+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94177560676192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c9a20 con 0x55a76c0c0a50 2024-04-23T18:31:20.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.221+0000 7f7de1b1c640 1 -- 172.21.15.119:0/2421594821 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94177560676192] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7dd40d8040 con 0x55a76c0c0a50 2024-04-23T18:31:20.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.221+0000 7f7de401d800 20 remove_watcher() i=3 2024-04-23T18:31:20.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.221+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94177560679744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c9a20 con 0x55a76c0bc060 2024-04-23T18:31:20.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.222+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94177560679744] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x55a76c0bc060 2024-04-23T18:31:20.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.222+0000 7f7de401d800 20 remove_watcher() i=4 2024-04-23T18:31:20.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.222+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94177560683424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0cd540 con 0x7f7dd40bc020 2024-04-23T18:31:20.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.223+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94177560683424] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x7f7dd40bc020 2024-04-23T18:31:20.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.223+0000 7f7de401d800 20 remove_watcher() i=5 2024-04-23T18:31:20.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.223+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94177560677248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c9a20 con 0x7f7dd40bc020 2024-04-23T18:31:20.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.224+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94177560677248] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x7f7dd40bc020 2024-04-23T18:31:20.229 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.224+0000 7f7de401d800 20 remove_watcher() i=6 2024-04-23T18:31:20.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.224+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94177560687168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a76c0c9a20 con 0x7f7dd40bc020 2024-04-23T18:31:20.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94177560687168] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ddc040080 con 0x7f7dd40bc020 2024-04-23T18:31:20.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 20 remove_watcher() i=7 2024-04-23T18:31:20.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f7dd40bc020 msgr2=0x7f7dd40b38d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f7dd40bc020 0x7f7dd40b38d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55a76c0bc060 msgr2=0x55a76c0be520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55a76c0bc060 0x55a76c0be520 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55a76c0c0a50 msgr2=0x55a76c0c2e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55a76c0c0a50 0x55a76c0c2e40 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55a76c0c5400 msgr2=0x55a76c0c78c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x55a76c0c5400 0x55a76c0c78c0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cac037050 msgr2=0x7f7cac039510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.230 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cac037050 0x7f7cac039510 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55a76c08e480 tx=0x7f7dcc010000 comp rx=0 tx=0).stop 2024-04-23T18:31:20.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c0a9640 msgr2=0x55a76c0b0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 --2- 172.21.15.119:0/2421594821 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c0a9640 0x55a76c0b0940 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4073040 tx=0x7f7dd4064f30 comp rx=0 tx=0).stop 2024-04-23T18:31:20.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 reap_dead start 2024-04-23T18:31:20.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de231d640 1 -- 172.21.15.119:0/2421594821 reap_dead start 2024-04-23T18:31:20.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 shutdown_connections 2024-04-23T18:31:20.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 >> 172.21.15.119:0/2421594821 conn(0x55a76c0a5910 msgr2=0x55a76c0a2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:20.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 shutdown_connections 2024-04-23T18:31:20.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/2421594821 wait complete. 2024-04-23T18:31:20.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/3654548270 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cbc036eb0 msgr2=0x7f7cbc039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 --2- 172.21.15.119:0/3654548270 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cbc036eb0 0x7f7cbc039370 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55a76c0821f0 tx=0x7f7dcc00f000 comp rx=0 tx=0).stop 2024-04-23T18:31:20.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/3654548270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c09c4e0 msgr2=0x55a76c09c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 --2- 172.21.15.119:0/3654548270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c09c4e0 0x55a76c09c900 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4055040 tx=0x7f7dd4068bc0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.231 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/3654548270 shutdown_connections 2024-04-23T18:31:20.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 --2- 172.21.15.119:0/3654548270 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cbc036eb0 0x7f7cbc039370 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 --2- 172.21.15.119:0/3654548270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76c09c4e0 0x55a76c09c900 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/3654548270 >> 172.21.15.119:0/3654548270 conn(0x55a76c090580 msgr2=0x55a76c090980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:20.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/3654548270 shutdown_connections 2024-04-23T18:31:20.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.225+0000 7f7de401d800 1 -- 172.21.15.119:0/3654548270 wait complete. 2024-04-23T18:31:20.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55a76c08b4d0 msgr2=0x55a76c08d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x55a76c08b4d0 0x55a76c08d920 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55a76bf863b0 msgr2=0x55a76c084d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x55a76bf863b0 0x55a76c084d00 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55a76c087590 msgr2=0x55a76c089980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.232 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x55a76c087590 0x55a76c089980 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cc8036eb0 msgr2=0x7f7cc8039370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f7cc8036eb0 0x7f7cc8039370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc001d90 tx=0x7f7dcc0012f0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 msgr2=0x55a76c07dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:31:20.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 --2- 172.21.15.119:0/3124898602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a76bf83a80 0x55a76c07dc90 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4060040 tx=0x7f7dd4002fb0 comp rx=0 tx=0).stop 2024-04-23T18:31:20.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de231d640 1 -- 172.21.15.119:0/3124898602 reap_dead start 2024-04-23T18:31:20.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 shutdown_connections 2024-04-23T18:31:20.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 >> 172.21.15.119:0/3124898602 conn(0x55a76bf7d430 msgr2=0x55a76bf81e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:31:20.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 shutdown_connections 2024-04-23T18:31:20.233 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:31:20.226+0000 7f7de401d800 1 -- 172.21.15.119:0/3124898602 wait complete. 2024-04-23T18:31:20.234 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:20.234 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-23T18:31:18.209839Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-23T18:31:18.209827Z', 'tags': [], 'group_ids': []} 2024-04-23T18:31:20.234 ERROR:root:0 2024-04-23T18:31:20.234 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-23T18:31:20.241 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:20.241 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:20.245 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:20.245 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-23T18:31:20.251 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:20.251 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:20.255 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:20.255 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-04-23T18:31:20.262 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-04-23T18:31:20.262 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:20.266 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:20.266 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-04-23T18:31:20.273 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:31:20.273 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:20.276 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:20.277 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-04-23T18:31:20.284 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-04-23T18:31:20.284 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:20.288 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:20.288 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-04-23T18:31:20.296 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-04-23T18:31:20.296 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:20.300 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:20.300 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-04-23T18:31:20.306 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:31:20.307 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:20.310 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:20.310 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-04-23T18:31:20.315 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:31:20.316 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:20.319 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:20.320 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-04-23T18:31:20.326 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:31:20.327 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:31:20.330 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:20.331 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-23T18:31:20.335 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-23T18:31:20.335 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-23T18:31:20.339 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-23T18:31:20.354 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-23T18:31:20.358 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-04-23T18:31:20.358 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-23T18:31:20.362 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4f165054-0d30-4e3c-af82-245e56f34813', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11', 'marker': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-23T18:31:20.356753Z', 'creation_time': '2024-04-23T18:31:20.352502Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-23T18:31:20.363 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-23T18:31:20.367 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4f165054-0d30-4e3c-af82-245e56f34813', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11', 'marker': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-23T18:31:20.356753Z', 'creation_time': '2024-04-23T18:31:20.352502Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-23T18:31:20.372 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-23T18:31:20.377 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4f165054-0d30-4e3c-af82-245e56f34813', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11', 'marker': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-23T18:31:20.356753Z', 'creation_time': '2024-04-23T18:31:20.352502Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-23T18:31:20.377 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-04-23T18:31:20.381 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx0000008068bbfab67adbc-006627fe78-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:31:20.385 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-04-23T18:31:20.392 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:31:20.392 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-04-23T18:31:20.400 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:31:20.447 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11'} 2024-04-23T18:31:20.457 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:31:20.459 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11'} 2024-04-23T18:31:20.469 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:31:20.469 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-04-23T18:31:20.478 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:31:20.486 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-04-23T18:31:20.492 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:31:20.492 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-23T18:31:20.496 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '4f165054-0d30-4e3c-af82-245e56f34813', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11', 'marker': 'b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-23T18:31:20.473610Z', 'creation_time': '2024-04-23T18:31:20.352502Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-23T18:32:20.544 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-04-23T18:32:20.561 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:32:20.562 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-04-23T18:32:20.576 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:32:20.577 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-23T18:32:20.581 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:32:20.581 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-04-23T18:32:20.586 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:32:20.586 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-04-23T18:32:20.590 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:32:20.590 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-04-23T18:32:20.594 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:32:20.595 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-04-23T18:32:20.599 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-04-23T18:00:00.000000Z', 'epoch': 1713895200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-04-23T18:32:20.599 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-04-23T18:32:20.606 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:32:20.606 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-23T18:32:20.610 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-04-23T18:32:20.610 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-23T18:32:20.619 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:32:20.622 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-23T18:32:20.630 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:32:20.861 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-23T18:32:20.866 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000004c89f6bfb926a6f5-006627feb4-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:32:20.970 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-23T18:32:20.975 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-23T18:32:20.979 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-23T18:32:20.983 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-23T18:32:21.098 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-04-23T18:32:21.140 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:32:21.140 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-23T18:32:21.146 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-04-23T18:32:21.147 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-23T18:32:21.152 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-23T18:32:21.166 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-23T18:32:21.170 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000688f707f20093534-006627feb5-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:32:21.193 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-04-23T18:32:21.225 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:32:21.225 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-23T18:32:21.229 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000171087f1a058399d-006627feb5-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:32:21.230 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-04-23T18:32:21.233 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '7bde1cd1-e3f4-4fcb-8bbb-8f7edde199b6'}]}} 2024-04-23T18:32:21.233 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-04-23T18:32:21.243 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-23T18:32:21.244 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-23T18:32:21.247 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-23T18:32:21.247 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-04-23T18:32:21.251 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000004180b2a7caa0a4b3-006627feb5-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:32:21.252 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-04-23T18:32:21.255 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000020828961b2093f53-006627feb5-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:32:21.269 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-23T18:32:21.273 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-23T18:32:21.273 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-04-23T18:32:21.277 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000074bbee48e943fc15-006627feb5-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:32:21.277 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-04-23T18:32:21.281 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000052b56d80bf7c05b9-006627feb5-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:32:21.281 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-04-23T18:32:21.284 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-23T18:32:21.285 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-04-23T18:32:21.288 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000da85b46215f7fc9c-006627feb5-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:32:21.288 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-04-23T18:32:21.292 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000008c54c344706edac9-006627feb5-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:32:21.292 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-04-23T18:32:21.295 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000009d5c9679ddc65a38-006627feb5-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:32:21.295 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-04-23T18:32:21.299 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000006c87e7f26afbdb2a-006627feb5-4224-default', 'HostId': '4224-default-default'} 2024-04-23T18:32:21.299 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-04-23T18:32:21.308 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:32:21.308 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-23T18:32:21.312 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-04-23T18:32:21.312 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-04-23T18:32:21.317 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:32:21.318 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-23T18:32:21.321 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-04-23T18:32:21.322 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-04-23T18:32:21.327 INFO:tasks.radosgw_admin_rest: empty result 2024-04-23T18:32:21.331 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-23T18:32:21.341 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-23T18:32:21.341 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:32:21.342 INFO:tasks.rgw.client.0.smithi119.stdout:2024-04-23T18:32:21.350+0000 7fbacf3c7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 34603) UID: 0 2024-04-23T18:32:21.342 INFO:tasks.rgw.client.0.smithi119.stdout:2024-04-23T18:32:21.350+0000 7fbad4d21880 -1 shutting down 2024-04-23T18:32:23.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-23T18:32:27.444 INFO:tasks.rgw.client.0:Stopped 2024-04-23T18:32:27.444 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-23T18:32:27.462 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/vault-root-token 2024-04-23T18:32:27.531 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-23T18:32:27.597 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-23T18:32:27.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-23T18:32:27.597 DEBUG:teuthology.orchestra.run.smithi119:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-23T18:32:27.682 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setuser ceph since I am not root 2024-04-23T18:32:27.682 INFO:teuthology.orchestra.run.smithi119.stderr:ignoring --setgroup ceph since I am not root 2024-04-23T18:32:27.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.691+0000 7f18be746800 1 Processor -- start 2024-04-23T18:32:27.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.691+0000 7f18be746800 1 -- start start 2024-04-23T18:32:27.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.691+0000 7f18be746800 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5651430c3890 0x5651430c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.691+0000 7f18be746800 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565142f75560 con 0x5651430c41f0 2024-04-23T18:32:27.683 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.691+0000 7f18be746800 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x565142f66e20 con 0x5651430c3890 2024-04-23T18:32:27.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.691+0000 7f18bc245640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5651430c3890 0x5651430c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.691+0000 7f18bba44640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5651430c41f0 0x5651430c46a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.119:60078/0 (socket says 172.21.15.119:60078) 2024-04-23T18:32:27.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.691+0000 7f18bba44640 1 -- 172.21.15.119:0/2331425469 learned_addr learned my addr 172.21.15.119:0/2331425469 (peer_addr_for_me v1:172.21.15.119:0/0) 2024-04-23T18:32:27.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.691+0000 7f18bc245640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5651430c3890 0x5651430c3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:51368/0 (socket says 172.21.15.119:51368) 2024-04-23T18:32:27.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.692+0000 7f18bc245640 1 -- 172.21.15.119:0/2331425469 >> v1:172.21.15.62:6789/0 conn(0x5651430c41f0 legacy=0x5651430c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.684 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.692+0000 7f18bc245640 1 -- 172.21.15.119:0/2331425469 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565142f74e60 con 0x5651430c3890 2024-04-23T18:32:27.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.693+0000 7f18bc245640 1 --2- 172.21.15.119:0/2331425469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651430c3cb0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f18ac005fd0 tx=0x7f18ac01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbb0fb0c51e886 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.694+0000 7f18bb243640 1 -- 172.21.15.119:0/2331425469 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ac052560 con 0x5651430c3890 2024-04-23T18:32:27.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.694+0000 7f18bb243640 1 -- 172.21.15.119:0/2331425469 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac052700 con 0x5651430c3890 2024-04-23T18:32:27.686 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.694+0000 7f18bb243640 1 -- 172.21.15.119:0/2331425469 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ac052a60 con 0x5651430c3890 2024-04-23T18:32:27.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.694+0000 7f18be746800 1 -- 172.21.15.119:0/2331425469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 msgr2=0x5651430c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.694+0000 7f18be746800 1 --2- 172.21.15.119:0/2331425469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651430c3cb0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f18ac005fd0 tx=0x7f18ac01ccc0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.694+0000 7f18be746800 1 -- 172.21.15.119:0/2331425469 shutdown_connections 2024-04-23T18:32:27.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.694+0000 7f18be746800 1 --2- 172.21.15.119:0/2331425469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651430c3cb0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.694+0000 7f18be746800 1 -- 172.21.15.119:0/2331425469 >> 172.21.15.119:0/2331425469 conn(0x5651430bf410 msgr2=0x5651430c1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:27.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.694+0000 7f18be746800 1 -- 172.21.15.119:0/2331425469 shutdown_connections 2024-04-23T18:32:27.687 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.694+0000 7f18be746800 1 -- 172.21.15.119:0/2331425469 wait complete. 2024-04-23T18:32:27.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.707+0000 7f18be746800 1 Processor -- start 2024-04-23T18:32:27.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.707+0000 7f18be746800 1 -- start start 2024-04-23T18:32:27.700 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.708+0000 7f18be746800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651431b8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.708+0000 7f18be746800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5651430105b0 con 0x5651430c3890 2024-04-23T18:32:27.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.708+0000 7f18bc245640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651431b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.708+0000 7f18bc245640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651431b8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:51372/0 (socket says 172.21.15.119:51372) 2024-04-23T18:32:27.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.708+0000 7f18bc245640 1 -- 172.21.15.119:0/2884868585 learned_addr learned my addr 172.21.15.119:0/2884868585 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:32:27.701 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.708+0000 7f18bc245640 1 -- 172.21.15.119:0/2884868585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565142f86860 con 0x5651430c3890 2024-04-23T18:32:27.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.709+0000 7f18bc245640 1 --2- 172.21.15.119:0/2884868585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651431b8460 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f18ac054040 tx=0x7f18ac04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bc473978e26abf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.709+0000 7f17aa60c640 1 -- 172.21.15.119:0/2884868585 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ac0529e0 con 0x5651430c3890 2024-04-23T18:32:27.703 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.709+0000 7f17aa60c640 1 -- 172.21.15.119:0/2884868585 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac052b80 con 0x5651430c3890 2024-04-23T18:32:27.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.709+0000 7f17aa60c640 1 -- 172.21.15.119:0/2884868585 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ac05c430 con 0x5651430c3890 2024-04-23T18:32:27.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.710+0000 7f18be746800 1 -- 172.21.15.119:0/2884868585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 msgr2=0x5651431b8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.710+0000 7f18be746800 1 --2- 172.21.15.119:0/2884868585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651431b8460 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f18ac054040 tx=0x7f18ac04c000 comp rx=0 tx=0).stop 2024-04-23T18:32:27.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.710+0000 7f18be746800 1 -- 172.21.15.119:0/2884868585 shutdown_connections 2024-04-23T18:32:27.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.710+0000 7f18be746800 1 --2- 172.21.15.119:0/2884868585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651431b8460 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.710+0000 7f18be746800 1 -- 172.21.15.119:0/2884868585 >> 172.21.15.119:0/2884868585 conn(0x5651430bf410 msgr2=0x5651431b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:27.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.710+0000 7f18be746800 1 -- 172.21.15.119:0/2884868585 shutdown_connections 2024-04-23T18:32:27.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.710+0000 7f18be746800 1 -- 172.21.15.119:0/2884868585 wait complete. 2024-04-23T18:32:27.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.710+0000 7f18be746800 1 Processor -- start 2024-04-23T18:32:27.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.710+0000 7f18be746800 1 -- start start 2024-04-23T18:32:27.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.710+0000 7f18be746800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651431bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.710+0000 7f18be746800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5651430c5050 con 0x5651430c3890 2024-04-23T18:32:27.704 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.710+0000 7f18bc245640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651431bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.710+0000 7f18bc245640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651431bfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:51382/0 (socket says 172.21.15.119:51382) 2024-04-23T18:32:27.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.711+0000 7f18bc245640 1 -- 172.21.15.119:0/578572473 learned_addr learned my addr 172.21.15.119:0/578572473 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:32:27.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.711+0000 7f18bc245640 1 -- 172.21.15.119:0/578572473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565142f84eb0 con 0x5651430c3890 2024-04-23T18:32:27.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.711+0000 7f18bc245640 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651431bfc70 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f18ac044810 tx=0x7f18ac003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.711+0000 7f17a8e09640 1 -- 172.21.15.119:0/578572473 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ac066540 con 0x5651430c3890 2024-04-23T18:32:27.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.711+0000 7f17a8e09640 1 -- 172.21.15.119:0/578572473 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac0666e0 con 0x5651430c3890 2024-04-23T18:32:27.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.711+0000 7f17a8e09640 1 -- 172.21.15.119:0/578572473 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ac066a00 con 0x5651430c3890 2024-04-23T18:32:27.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.711+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651431c01b0 con 0x5651430c3890 2024-04-23T18:32:27.705 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.711+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651431c06d0 con 0x5651430c3890 2024-04-23T18:32:27.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.712+0000 7f17a8e09640 1 -- 172.21.15.119:0/578572473 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f18ac078020 con 0x5651430c3890 2024-04-23T18:32:27.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.712+0000 7f17a8e09640 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f17a4036e60 0x7f17a4039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.712+0000 7f17a8e09640 1 -- 172.21.15.119:0/578572473 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f18ac08f180 con 0x5651430c3890 2024-04-23T18:32:27.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.712+0000 7f18bba44640 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f17a4036e60 0x7f17a4039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.713+0000 7f18be746800 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5651430c41f0 0x5651431c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.713+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651431c7300 con 0x5651430c41f0 2024-04-23T18:32:27.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.713+0000 7f18bca46640 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5651430c41f0 0x5651431c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.713+0000 7f18bba44640 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f17a4036e60 0x7f17a4039320 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f18b0000f60 tx=0x7f18b00012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.713+0000 7f18bca46640 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5651430c41f0 0x5651431c6ce0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.709 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.713+0000 7f18bca46640 1 -- 172.21.15.119:0/578572473 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18b40083e0 con 0x5651430c41f0 2024-04-23T18:32:27.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.713+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651431c4290 con 0x5651430c41f0 2024-04-23T18:32:27.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.714+0000 7f18bca46640 1 -- 172.21.15.119:0/578572473 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f18b40083e0 con 0x5651430c41f0 2024-04-23T18:32:27.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.714+0000 7f18be746800 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5651431c9610 0x5651431cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.714+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:3 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651431cc0f0 con 0x5651431c9610 2024-04-23T18:32:27.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.714+0000 7f18bc245640 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5651431c9610 0x5651431cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.714+0000 7f18bc245640 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5651431c9610 0x5651431cba00 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.714+0000 7f18bc245640 1 -- 172.21.15.119:0/578572473 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(3 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f18ac0713f0 con 0x5651431c9610 2024-04-23T18:32:27.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.714+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651431c85c0 con 0x5651430c41f0 2024-04-23T18:32:27.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.715+0000 7f18bca46640 1 -- 172.21.15.119:0/578572473 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f18b40083e0 con 0x5651430c41f0 2024-04-23T18:32:27.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.715+0000 7f18be746800 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5651431cd550 0x5651431cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.710 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.715+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:5 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651431d0120 con 0x5651431cd550 2024-04-23T18:32:27.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.715+0000 7f18bba44640 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5651431cd550 0x5651431cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.715+0000 7f18bba44640 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5651431cd550 0x5651431cf9c0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.716+0000 7f18bba44640 1 -- 172.21.15.119:0/578572473 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(5 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f18b0009050 con 0x5651431cd550 2024-04-23T18:32:27.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.716+0000 7f18be746800 1 Processor -- start 2024-04-23T18:32:27.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.716+0000 7f18be746800 1 -- start start 2024-04-23T18:32:27.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.716+0000 7f18be746800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431de5d0 0x5651431de9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.716+0000 7f18be746800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x565142fb6df0 con 0x5651431de5d0 2024-04-23T18:32:27.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.717+0000 7f18bc245640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431de5d0 0x5651431de9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.717+0000 7f18bc245640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431de5d0 0x5651431de9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:51386/0 (socket says 172.21.15.119:51386) 2024-04-23T18:32:27.711 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.717+0000 7f18bc245640 1 -- 172.21.15.119:0/683520306 learned_addr learned my addr 172.21.15.119:0/683520306 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:32:27.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.717+0000 7f18bc245640 1 -- 172.21.15.119:0/683520306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651431def30 con 0x5651431de5d0 2024-04-23T18:32:27.719 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.717+0000 7f18bc245640 1 --2- 172.21.15.119:0/683520306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431de5d0 0x5651431de9f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f18ac08d580 tx=0x7f18ac070a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.717+0000 7f17a1ffb640 1 -- 172.21.15.119:0/683520306 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ac094070 con 0x5651431de5d0 2024-04-23T18:32:27.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.717+0000 7f17a1ffb640 1 -- 172.21.15.119:0/683520306 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac068de0 con 0x5651431de5d0 2024-04-23T18:32:27.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.717+0000 7f18be746800 1 -- 172.21.15.119:0/683520306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651431df9a0 con 0x5651431de5d0 2024-04-23T18:32:27.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.717+0000 7f17a1ffb640 1 -- 172.21.15.119:0/683520306 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ac079700 con 0x5651431de5d0 2024-04-23T18:32:27.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.718+0000 7f18be746800 1 -- 172.21.15.119:0/683520306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651431dfea0 con 0x5651431de5d0 2024-04-23T18:32:27.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.718+0000 7f17a1ffb640 1 -- 172.21.15.119:0/683520306 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f18ac097070 con 0x5651431de5d0 2024-04-23T18:32:27.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.718+0000 7f17a1ffb640 1 --2- 172.21.15.119:0/683520306 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1794036e60 0x7f1794039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.718+0000 7f17a1ffb640 1 -- 172.21.15.119:0/683520306 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f18ac089070 con 0x5651431de5d0 2024-04-23T18:32:27.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.719+0000 7f18bba44640 1 --2- 172.21.15.119:0/683520306 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1794036e60 0x7f1794039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.719+0000 7f18be746800 1 Processor -- start 2024-04-23T18:32:27.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.719+0000 7f18be746800 1 -- start start 2024-04-23T18:32:27.720 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.719+0000 7f18bba44640 1 --2- 172.21.15.119:0/683520306 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1794036e60 0x7f1794039320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f18b000bf50 tx=0x7f18b000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.719+0000 7f18be746800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 0x5651431ebaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.719+0000 7f18be746800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5651431b8b20 con 0x5651431eb6f0 2024-04-23T18:32:27.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.719+0000 7f18bc245640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 0x5651431ebaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.719+0000 7f18bc245640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 0x5651431ebaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:51398/0 (socket says 172.21.15.119:51398) 2024-04-23T18:32:27.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.719+0000 7f18bc245640 1 -- 172.21.15.119:0/3671941222 learned_addr learned my addr 172.21.15.119:0/3671941222 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:32:27.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.719+0000 7f18bc245640 1 -- 172.21.15.119:0/3671941222 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651431ec0c0 con 0x5651431eb6f0 2024-04-23T18:32:27.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.720+0000 7f18bc245640 1 --2- 172.21.15.119:0/3671941222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 0x5651431ebaf0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f18ac051fd0 tx=0x7f18ac07b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62b7f36eaafb98b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.720+0000 7f179b7fe640 1 -- 172.21.15.119:0/3671941222 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ac09ae70 con 0x5651431eb6f0 2024-04-23T18:32:27.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.720+0000 7f179b7fe640 1 -- 172.21.15.119:0/3671941222 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac06ae30 con 0x5651431eb6f0 2024-04-23T18:32:27.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.720+0000 7f179b7fe640 1 -- 172.21.15.119:0/3671941222 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ac07bb90 con 0x5651431eb6f0 2024-04-23T18:32:27.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.720+0000 7f18be746800 1 -- 172.21.15.119:0/3671941222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 msgr2=0x5651431ebaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.720+0000 7f18be746800 1 --2- 172.21.15.119:0/3671941222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 0x5651431ebaf0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f18ac051fd0 tx=0x7f18ac07b8d0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.721 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.720+0000 7f18be746800 1 -- 172.21.15.119:0/3671941222 shutdown_connections 2024-04-23T18:32:27.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.720+0000 7f18be746800 1 --2- 172.21.15.119:0/3671941222 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 0x5651431ebaf0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.720+0000 7f18be746800 1 -- 172.21.15.119:0/3671941222 >> 172.21.15.119:0/3671941222 conn(0x5651431e79c0 msgr2=0x5651431e5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:27.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.720+0000 7f18be746800 1 -- 172.21.15.119:0/3671941222 shutdown_connections 2024-04-23T18:32:27.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.720+0000 7f18be746800 1 -- 172.21.15.119:0/3671941222 wait complete. 2024-04-23T18:32:27.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.721+0000 7f18be746800 1 Processor -- start 2024-04-23T18:32:27.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.721+0000 7f18be746800 1 -- start start 2024-04-23T18:32:27.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.721+0000 7f18be746800 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 0x5651431f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.721+0000 7f18be746800 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5651431ec7b0 con 0x5651431eb6f0 2024-04-23T18:32:27.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.721+0000 7f18bc245640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 0x5651431f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.721+0000 7f18bc245640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 0x5651431f2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.119:51402/0 (socket says 172.21.15.119:51402) 2024-04-23T18:32:27.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.721+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 learned_addr learned my addr 172.21.15.119:0/400512262 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-04-23T18:32:27.722 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.721+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651431f3060 con 0x5651431eb6f0 2024-04-23T18:32:27.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.721+0000 7f18bc245640 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 0x5651431f2b20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f18ac051fd0 tx=0x7f18ac08c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.722+0000 7f1799ffb640 1 -- 172.21.15.119:0/400512262 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ac0b6070 con 0x5651431eb6f0 2024-04-23T18:32:27.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.722+0000 7f1799ffb640 1 -- 172.21.15.119:0/400512262 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac07b980 con 0x5651431eb6f0 2024-04-23T18:32:27.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.722+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651431f3060 con 0x5651431eb6f0 2024-04-23T18:32:27.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.722+0000 7f1799ffb640 1 -- 172.21.15.119:0/400512262 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18ac08f8a0 con 0x5651431eb6f0 2024-04-23T18:32:27.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.722+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651431f3060 con 0x5651431eb6f0 2024-04-23T18:32:27.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.722+0000 7f1799ffb640 1 -- 172.21.15.119:0/400512262 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f18ac0c1060 con 0x5651431eb6f0 2024-04-23T18:32:27.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.723+0000 7f1799ffb640 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f178c036e60 0x7f178c039320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.723+0000 7f1799ffb640 1 -- 172.21.15.119:0/400512262 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f18ac080040 con 0x5651431eb6f0 2024-04-23T18:32:27.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.723+0000 7f18bba44640 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f178c036e60 0x7f178c039320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.723+0000 7f18bba44640 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f178c036e60 0x7f178c039320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f18b0001b60 tx=0x7f18b0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.723+0000 7f18be746800 20 rados->read ofs=0 len=0 2024-04-23T18:32:27.723 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.723+0000 7f18be746800 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5651431fe200 0x5651432006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.723+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565143200e10 con 0x5651431fe200 2024-04-23T18:32:27.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.723+0000 7f18bca46640 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5651431fe200 0x5651432006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18bca46640 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5651431fe200 0x5651432006c0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18b40083e0 con 0x5651431fe200 2024-04-23T18:32:27.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18be746800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:32:27.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18be746800 20 realm 2024-04-23T18:32:27.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18be746800 20 rados->read ofs=0 len=0 2024-04-23T18:32:27.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565143201240 con 0x5651431fe200 2024-04-23T18:32:27.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18b40083e0 con 0x5651431fe200 2024-04-23T18:32:27.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18be746800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:32:27.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18be746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-23T18:32:27.724 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18be746800 20 rados->read ofs=0 len=0 2024-04-23T18:32:27.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x5651431fe200 2024-04-23T18:32:27.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18b40083e0 con 0x5651431fe200 2024-04-23T18:32:27.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18be746800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:32:27.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18be746800 20 rados->read ofs=0 len=0 2024-04-23T18:32:27.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.724+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565143201eb0 con 0x5651431fe200 2024-04-23T18:32:27.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.725+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f18b40083e0 con 0x5651431fe200 2024-04-23T18:32:27.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.725+0000 7f18be746800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:32:27.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.725+0000 7f18be746800 20 rados->read ofs=0 len=0 2024-04-23T18:32:27.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.725+0000 7f18be746800 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x565143202870 0x565143204c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.725+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:5 5.d 5:b26b0da4:::zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565143205270 con 0x565143202870 2024-04-23T18:32:27.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.725+0000 7f18bc245640 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x565143202870 0x565143204c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.725 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.725+0000 7f18bc245640 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x565143202870 0x565143204c60 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.725+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== osd_op_reply(5 zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f18ac0a5070 con 0x565143202870 2024-04-23T18:32:27.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.725+0000 7f18be746800 20 rados_obj.operate() r=0 bl.length=993 2024-04-23T18:32:27.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.725+0000 7f18be746800 20 searching for the correct realm 2024-04-23T18:32:27.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.725+0000 7f18be746800 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x565143207200 0x5651432096c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.725+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143209d90 con 0x565143207200 2024-04-23T18:32:27.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.725+0000 7f18bba44640 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x565143207200 0x5651432096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.726+0000 7f18bba44640 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x565143207200 0x5651432096c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.726+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.726+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143209d90 con 0x565143202870 2024-04-23T18:32:27.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.726+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18ac0a5070 con 0x565143202870 2024-04-23T18:32:27.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.726+0000 7f18bc245640 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f18ac0c3070 0x7f18ac07f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:27.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.726+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143209d90 con 0x7f18ac0c3070 2024-04-23T18:32:27.726 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.727+0000 7f18bca46640 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f18ac0c3070 0x7f18ac07f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:27.727 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.727+0000 7f18bca46640 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f18ac0c3070 0x7f18ac07f930 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:27.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.728+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b40083e0 con 0x7f18ac0c3070 2024-04-23T18:32:27.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.728+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x5651431fe200 2024-04-23T18:32:27.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.728+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b40083e0 con 0x5651431fe200 2024-04-23T18:32:27.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.728+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x5651431fe200 2024-04-23T18:32:27.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.728+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b4026040 con 0x5651431fe200 2024-04-23T18:32:27.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.728+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x7f18ac0c3070 2024-04-23T18:32:27.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.728+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b4026040 con 0x7f18ac0c3070 2024-04-23T18:32:27.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.728+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x7f18ac0c3070 2024-04-23T18:32:27.736 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.729+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f18b4026040 con 0x7f18ac0c3070 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.729+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143202870 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.729+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18ac0a5070 con 0x565143202870 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.729+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143207200 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.729+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.729+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x5651431fe200 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.729+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b4026040 con 0x5651431fe200 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.729+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x7f18ac0c3070 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.730+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b4026040 con 0x7f18ac0c3070 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.730+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x5651431fe200 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.730+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b4026040 con 0x5651431fe200 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.730+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143202870 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.730+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f18ac0a5070 con 0x565143202870 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.730+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143207200 2024-04-23T18:32:27.737 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.730+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.731+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143207200 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.731+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.731+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x7f18ac0c3070 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.731+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b4026040 con 0x7f18ac0c3070 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.731+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143207200 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.731+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.731+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143207200 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.732+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.732+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x5651431fe200 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.732+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b4026040 con 0x5651431fe200 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.732+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x5651431fe200 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.732+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f18b4026040 con 0x5651431fe200 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.732+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x7f18ac0c3070 2024-04-23T18:32:27.738 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.732+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b4026040 con 0x7f18ac0c3070 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.732+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143207200 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.733+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.733+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143202870 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.733+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f18ac0a5070 con 0x565143202870 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.733+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x5651431fe200 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.733+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b4026040 con 0x5651431fe200 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.733+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143202870 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.733+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=82b] v34'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f18ac0a5070 con 0x565143202870 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.733+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143207200 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.734+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.734+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x7f18ac0c3070 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.734+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b4026040 con 0x7f18ac0c3070 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.734+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143202870 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.734+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 7 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18ac0a5070 con 0x565143202870 2024-04-23T18:32:27.739 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.734+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143207200 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.735+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.735+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x7f18ac0c3070 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.735+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18b4026040 con 0x7f18ac0c3070 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.735+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x5651431fe200 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.735+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f18b4026040 con 0x5651431fe200 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.735+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x565143201b10 con 0x565143202870 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.735+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 8 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 20 RGWRados::pool_iterate: got zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 20 RGWRados::pool_iterate: got default.zone. 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 20 RGWRados::pool_iterate: got zone_info.b69d402b-cbc2-4a79-bc3a-05ce158bbf85 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 20 RGWRados::pool_iterate: got period_config.default 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-23T18:32:27.740 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 20 rados->read ofs=0 len=0 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565143205610 con 0x5651431fe200 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f18b4026040 con 0x5651431fe200 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 20 rados->read ofs=0 len=0 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565143205a00 con 0x5651431fe200 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f18b4026040 con 0x5651431fe200 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 20 rados_obj.operate() r=0 bl.length=46 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 20 rados->read ofs=0 len=0 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:40 5.c 5:342bdcef:::zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565143205a00 con 0x7f18ac0c3070 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 9 ==== osd_op_reply(40 zonegroup_info.4f165054-0d30-4e3c-af82-245e56f34813 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.736+0000 7f18be746800 20 rados_obj.operate() r=0 bl.length=436 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 20 zone default found 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 4 Realm: () 2024-04-23T18:32:27.741 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 4 ZoneGroup: default (4f165054-0d30-4e3c-af82-245e56f34813) 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 4 Zone: default (b69d402b-cbc2-4a79-bc3a-05ce158bbf85) 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 20 zonegroup default 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 20 rados->read ofs=0 len=0 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514320a210 con 0x565143202870 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 20 rados_obj.operate() r=0 bl.length=187 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 20 rados->read ofs=0 len=0 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514320bf90 con 0x565143207200 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 20 rados->read ofs=0 len=0 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.737+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514320c330 con 0x565143207200 2024-04-23T18:32:27.742 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.738+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.738+0000 7f18be746800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.738+0000 7f18be746800 20 started sync module instance, tier type = 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.738+0000 7f18be746800 20 started zone id=b69d402b-cbc2-4a79-bc3a-05ce158bbf85 (name=default) with tier type = 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.738+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320b430 con 0x565143202870 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.739+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 10 ==== osd_op_reply(44 notify.0 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.739+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94907018557472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320cc10 con 0x565143202870 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.739+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320d460 con 0x5651431fe200 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.740+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 11 ==== osd_op_reply(45 notify.0 [watch watch cookie 94907018557472] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.741+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 15 ==== osd_op_reply(46 notify.1 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.741+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94907018561376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320d460 con 0x5651431fe200 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.741+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320df00 con 0x565143207200 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.742+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94907018561376] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.742+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 12 ==== osd_op_reply(48 notify.2 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.743 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.742+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94907018566128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320e2a0 con 0x565143207200 2024-04-23T18:32:27.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.742+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320ed20 con 0x565143202870 2024-04-23T18:32:27.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.743+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94907018566128] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.743+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 12 ==== osd_op_reply(50 notify.3 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.743+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94907018563504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320f5c0 con 0x565143202870 2024-04-23T18:32:27.744 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.743+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320ff80 con 0x5651431fe200 2024-04-23T18:32:27.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.744+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 13 ==== osd_op_reply(51 notify.3 [watch watch cookie 94907018563504] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.746 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.745+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 17 ==== osd_op_reply(52 notify.4 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.745+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94907018572528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320ff80 con 0x5651431fe200 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.745+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143210940 con 0x7f18ac0c3070 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.746+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94907018572528] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.748+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 10 ==== osd_op_reply(54 notify.5 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.749+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94907018575024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143210940 con 0x7f18ac0c3070 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.749+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143211300 con 0x7f18ac0c3070 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.750+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94907018575024] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.750+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 12 ==== osd_op_reply(56 notify.6 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.750+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94907018577040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651432114e0 con 0x7f18ac0c3070 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.750+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143211d30 con 0x7f18ac0c3070 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.751+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94907018577040] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.751+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 14 ==== osd_op_reply(58 notify.7 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.751+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94907018580496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143211be0 con 0x7f18ac0c3070 2024-04-23T18:32:27.747 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.751+0000 7f18be746800 20 add_watcher() i=0 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.751+0000 7f18be746800 20 add_watcher() i=1 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.751+0000 7f18be746800 20 add_watcher() i=2 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.751+0000 7f18be746800 20 add_watcher() i=3 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.751+0000 7f18be746800 20 add_watcher() i=4 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.751+0000 7f18be746800 20 add_watcher() i=5 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.751+0000 7f18be746800 20 add_watcher() i=6 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.752+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94907018580496] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.752+0000 7f18be746800 20 add_watcher() i=7 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.752+0000 7f18be746800 2 all 8 watchers are set, enabling cache 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.752+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x565143215150 con 0x5651431fe200 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.753+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.753+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94907018581616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651432125d0 con 0x5651431fe200 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.754+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94907018581616] v34'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.748 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.754+0000 7f17727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:32:27.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.754+0000 7f18be746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-23T18:32:27.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.754+0000 7f18be746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-23T18:32:27.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.754+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321dc80 con 0x5651431fe200 2024-04-23T18:32:27.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.755+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.756+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321e2d0 con 0x7f18ac0c3070 2024-04-23T18:32:27.749 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.757+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.757+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321e730 con 0x565143207200 2024-04-23T18:32:27.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.758+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.750 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.758+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321d770 con 0x5651431fe200 2024-04-23T18:32:27.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.759+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'276 uv165 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.751 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.759+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321f380 con 0x565143202870 2024-04-23T18:32:27.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.760+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 14 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.752 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.760+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321f410 con 0x565143207200 2024-04-23T18:32:27.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.761+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.753 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.761+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321fe30 con 0x5651431fe200 2024-04-23T18:32:27.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.762+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.754 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.762+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321fe30 con 0x7f18ac0c3070 2024-04-23T18:32:27.755 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.763+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'58 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.756 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.763+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321fe30 con 0x565143202870 2024-04-23T18:32:27.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.764+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 15 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.764+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321fec0 con 0x565143207200 2024-04-23T18:32:27.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.765+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.757 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.765+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143220430 con 0x565143202870 2024-04-23T18:32:27.758 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.766+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 16 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.759 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.766+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143220430 con 0x7f18ac0c3070 2024-04-23T18:32:27.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.768+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'42 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.760 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.768+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143220430 con 0x565143202870 2024-04-23T18:32:27.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.768+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 17 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.761 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.768+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651432204c0 con 0x7f18ac0c3070 2024-04-23T18:32:27.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.770+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.762 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.770+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651432204c0 con 0x5651431fe200 2024-04-23T18:32:27.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.771+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'277 uv167 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.763 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.771+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651432204c0 con 0x565143207200 2024-04-23T18:32:27.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.772+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'77 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.764 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.772+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143220550 con 0x565143202870 2024-04-23T18:32:27.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.773+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 18 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.765 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.773+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143220550 con 0x565143207200 2024-04-23T18:32:27.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.774+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.766 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.774+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651432205e0 con 0x5651431fe200 2024-04-23T18:32:27.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.776+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.768 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.776+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651432205e0 con 0x5651431fe200 2024-04-23T18:32:27.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.777+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'278 uv163 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.769 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.777+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651432205e0 con 0x565143207200 2024-04-23T18:32:27.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.778+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'78 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.770 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.778+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143220670 con 0x565143202870 2024-04-23T18:32:27.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.779+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 19 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.771 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.779+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143220670 con 0x565143207200 2024-04-23T18:32:27.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.779+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.780+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143220670 con 0x565143207200 2024-04-23T18:32:27.772 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.780+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.780+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321f980 con 0x565143207200 2024-04-23T18:32:27.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.781+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.773 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.781+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321f980 con 0x565143207200 2024-04-23T18:32:27.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.782+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.774 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.782+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321f980 con 0x7f18ac0c3070 2024-04-23T18:32:27.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.783+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.783+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321f980 con 0x565143207200 2024-04-23T18:32:27.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.784+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'34 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.776 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.784+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321f980 con 0x7f18ac0c3070 2024-04-23T18:32:27.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.786+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'59 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.778 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.786+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321f980 con 0x565143207200 2024-04-23T18:32:27.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.787+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'79 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.779 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.787+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321f980 con 0x7f18ac0c3070 2024-04-23T18:32:27.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.788+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'63 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.780 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.788+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514321f980 con 0x565143202870 2024-04-23T18:32:27.781 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.789+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 20 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.789+0000 7f17717e2640 20 reqs_thread_entry: start 2024-04-23T18:32:27.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.789+0000 7f18be746800 20 init_complete bucket index max shards: 11 2024-04-23T18:32:27.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.789+0000 7f18be746800 20 Filter name: none 2024-04-23T18:32:27.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.790+0000 7f16e2ffd640 20 reqs_thread_entry: start 2024-04-23T18:32:27.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.790+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-23T18:32:27.782 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.790+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:94 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.791+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 23 ==== osd_op_reply(94 gc.30 [call] v34'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.791+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:95 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.791+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 24 ==== osd_op_reply(95 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.791+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.784 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.791+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:96 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x7f18ac0c3070 2024-04-23T18:32:27.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.791+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 25 ==== osd_op_reply(96 gc.30 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.791+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:97 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.792+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 26 ==== osd_op_reply(97 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.792+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.792+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:98 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.792+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 27 ==== osd_op_reply(98 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.792+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.785 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.792+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:99 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.793+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 28 ==== osd_op_reply(99 gc.30 [call] v34'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.793+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-23T18:32:27.786 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.793+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:100 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.787 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.794+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 21 ==== osd_op_reply(100 gc.31 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.794+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:101 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.794+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 22 ==== osd_op_reply(101 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.794+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.794+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:102 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143202870 2024-04-23T18:32:27.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.795+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 23 ==== osd_op_reply(102 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.795+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:103 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.795+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 24 ==== osd_op_reply(103 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.795+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.795+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:104 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.795+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 25 ==== osd_op_reply(104 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.788 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.795+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.795+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:105 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.797+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 26 ==== osd_op_reply(105 gc.31 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.797+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-23T18:32:27.789 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.797+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:106 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.798+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 27 ==== osd_op_reply(106 gc.0 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.798+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:107 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.799+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 28 ==== osd_op_reply(107 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.791 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.799+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.799+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:108 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x5651431fe200 2024-04-23T18:32:27.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.799+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 29 ==== osd_op_reply(108 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.799+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:109 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.799+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 30 ==== osd_op_reply(109 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.799+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.792 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.799+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:110 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.800+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 31 ==== osd_op_reply(110 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.800+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.800+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:111 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.801+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 32 ==== osd_op_reply(111 gc.0 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.801+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-23T18:32:27.793 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.801+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:112 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.802+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 29 ==== osd_op_reply(112 gc.1 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.802+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:113 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.802+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 30 ==== osd_op_reply(113 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.802+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.802+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:114 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x7f18ac0c3070 2024-04-23T18:32:27.795 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.802+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 31 ==== osd_op_reply(114 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.802+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:115 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.803+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 32 ==== osd_op_reply(115 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.803+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.803+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:116 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.803+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 33 ==== osd_op_reply(116 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.803+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.796 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.803+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:117 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.804+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 34 ==== osd_op_reply(117 gc.1 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.804+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-23T18:32:27.798 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.804+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:118 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.805+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 26 ==== osd_op_reply(118 gc.2 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.805+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:119 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.805+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 27 ==== osd_op_reply(119 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.805+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.805+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:120 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143207200 2024-04-23T18:32:27.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.805+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 28 ==== osd_op_reply(120 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.805+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:121 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.806+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 29 ==== osd_op_reply(121 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.806+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.806+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:122 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.806+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 30 ==== osd_op_reply(122 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.806+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.799 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.806+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:123 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.807+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 31 ==== osd_op_reply(123 gc.2 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.807+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-23T18:32:27.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.807+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:124 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.808+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 33 ==== osd_op_reply(124 gc.3 [call] v34'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.808+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:125 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.808+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 34 ==== osd_op_reply(125 gc.3 [call out=15b] v0'0 uv279 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.802 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.808+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.808+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:126 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x5651431fe200 2024-04-23T18:32:27.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.808+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 35 ==== osd_op_reply(126 gc.3 [call out=24b] v0'0 uv279 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.808+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:127 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.809+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 36 ==== osd_op_reply(127 gc.3 [call out=15b] v0'0 uv279 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.809+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.809+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:128 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.809+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 37 ==== osd_op_reply(128 gc.3 [call out=15b] v0'0 uv279 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.809+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.809+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:129 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.810+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 38 ==== osd_op_reply(129 gc.3 [call] v34'280 uv280 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.810+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-23T18:32:27.803 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.810+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:130 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.811+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 27 ==== osd_op_reply(130 gc.4 [call] v34'86 uv86 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.811+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:131 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.811+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 28 ==== osd_op_reply(131 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.811+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.811+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:132 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143202870 2024-04-23T18:32:27.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.811+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 29 ==== osd_op_reply(132 gc.4 [call out=24b] v0'0 uv86 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.811+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:133 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.811+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 30 ==== osd_op_reply(133 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.811+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.807 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.811+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:134 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.812+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 31 ==== osd_op_reply(134 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.812+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.812+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:135 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.812+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 32 ==== osd_op_reply(135 gc.4 [call] v34'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.813+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-23T18:32:27.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.813+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:136 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.813+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 32 ==== osd_op_reply(136 gc.5 [call] v34'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.813+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:137 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.814+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 33 ==== osd_op_reply(137 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.814+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.814+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:138 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143207200 2024-04-23T18:32:27.808 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.814+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 34 ==== osd_op_reply(138 gc.5 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.814+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:139 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.814+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 35 ==== osd_op_reply(139 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.814+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.814+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:140 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.814+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 36 ==== osd_op_reply(140 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.814+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.809 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.814+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:141 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.811 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.815+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 37 ==== osd_op_reply(141 gc.5 [call] v34'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.815+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-23T18:32:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.815+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:142 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.817+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 39 ==== osd_op_reply(142 gc.6 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.817+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:143 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.817+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 40 ==== osd_op_reply(143 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.817+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.817+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:144 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x5651431fe200 2024-04-23T18:32:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.817+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 41 ==== osd_op_reply(144 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.817+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:145 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.812 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.818+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 42 ==== osd_op_reply(145 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.818+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.818+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:146 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.818+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 43 ==== osd_op_reply(146 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.818+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.818+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:147 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.819+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 44 ==== osd_op_reply(147 gc.6 [call] v34'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.819+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-23T18:32:27.813 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.819+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:148 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.820+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 35 ==== osd_op_reply(148 gc.7 [call] v34'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.820+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:149 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.820+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 36 ==== osd_op_reply(149 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.820+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.815 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.820+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:150 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x7f18ac0c3070 2024-04-23T18:32:27.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.821+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 37 ==== osd_op_reply(150 gc.7 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.821+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:151 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.821+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 38 ==== osd_op_reply(151 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.821+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.821+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:152 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.821+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 39 ==== osd_op_reply(152 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.821+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.821+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:153 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.822+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 40 ==== osd_op_reply(153 gc.7 [call] v34'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.822+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-23T18:32:27.816 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.822+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:154 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.823+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 33 ==== osd_op_reply(154 gc.8 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.824+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:155 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.824+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 34 ==== osd_op_reply(155 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.824+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.824+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:156 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143202870 2024-04-23T18:32:27.818 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.824+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 35 ==== osd_op_reply(156 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.824+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:157 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.824+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 36 ==== osd_op_reply(157 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.824+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.824+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:158 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.824+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 37 ==== osd_op_reply(158 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.825+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.825+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:159 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.826+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 38 ==== osd_op_reply(159 gc.8 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.826+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-23T18:32:27.819 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.826+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:160 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.827+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 38 ==== osd_op_reply(160 gc.9 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.827+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:161 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.827+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 39 ==== osd_op_reply(161 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.827+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.827+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:162 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143207200 2024-04-23T18:32:27.821 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.827+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 40 ==== osd_op_reply(162 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.827+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:163 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.827+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 41 ==== osd_op_reply(163 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.827+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.827+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:164 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.828+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 42 ==== osd_op_reply(164 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.828+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.828+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:165 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.829+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 43 ==== osd_op_reply(165 gc.9 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.829+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-23T18:32:27.822 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.829+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:166 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.830+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 39 ==== osd_op_reply(166 gc.10 [call] v34'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.830+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:167 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.830+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 40 ==== osd_op_reply(167 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.830+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.830+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:168 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143202870 2024-04-23T18:32:27.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.830+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 41 ==== osd_op_reply(168 gc.10 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.830+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:169 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.830+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 42 ==== osd_op_reply(169 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.830+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.830+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:170 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.825 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.830+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 43 ==== osd_op_reply(170 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.830+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.830+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:171 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.831+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 44 ==== osd_op_reply(171 gc.10 [call] v34'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.831+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-23T18:32:27.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.831+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:172 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.832+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 41 ==== osd_op_reply(172 gc.11 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.826 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.832+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:173 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.833+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 42 ==== osd_op_reply(173 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.833+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.833+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:174 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x7f18ac0c3070 2024-04-23T18:32:27.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.833+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 43 ==== osd_op_reply(174 gc.11 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.833+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:175 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.833+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 44 ==== osd_op_reply(175 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.834+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.834+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:176 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.830 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.834+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 45 ==== osd_op_reply(176 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.834+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.834+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:177 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.835+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 46 ==== osd_op_reply(177 gc.11 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.835+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-23T18:32:27.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.835+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:178 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.836+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 45 ==== osd_op_reply(178 gc.12 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.836+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:179 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.836+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 46 ==== osd_op_reply(179 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.836+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.836+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:180 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143202870 2024-04-23T18:32:27.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.836+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 47 ==== osd_op_reply(180 gc.12 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.836+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:181 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.831 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.837+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 48 ==== osd_op_reply(181 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.837+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.837+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:182 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.837+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 49 ==== osd_op_reply(182 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.837+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.837+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:183 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.838+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 50 ==== osd_op_reply(183 gc.12 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.838+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-23T18:32:27.832 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.838+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:184 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.839+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 47 ==== osd_op_reply(184 gc.13 [call] v34'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.839+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:185 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.839+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 48 ==== osd_op_reply(185 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.839+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.839+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:186 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x7f18ac0c3070 2024-04-23T18:32:27.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.840+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 49 ==== osd_op_reply(186 gc.13 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.840+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:187 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.840+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 50 ==== osd_op_reply(187 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.834 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.840+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.840+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:188 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.840+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 51 ==== osd_op_reply(188 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.840+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.840+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:189 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x7f18ac0c3070 2024-04-23T18:32:27.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.841+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 52 ==== osd_op_reply(189 gc.13 [call] v34'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.841+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-23T18:32:27.835 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.841+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:190 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.842+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 45 ==== osd_op_reply(190 gc.14 [call] v34'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.842+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:191 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.842+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 46 ==== osd_op_reply(191 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.842+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.842+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:192 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x5651431fe200 2024-04-23T18:32:27.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.843+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 47 ==== osd_op_reply(192 gc.14 [call out=24b] v0'0 uv281 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.843+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:193 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.843+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 48 ==== osd_op_reply(193 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.843+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.843+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:194 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.843+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 49 ==== osd_op_reply(194 gc.14 [call out=15b] v0'0 uv281 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.837 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.843+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.843+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:195 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.844+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 50 ==== osd_op_reply(195 gc.14 [call] v34'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.844+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-23T18:32:27.838 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.844+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:196 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.845+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 44 ==== osd_op_reply(196 gc.15 [call] v34'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.845+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:197 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.846+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 45 ==== osd_op_reply(197 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.846+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.846+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:198 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143207200 2024-04-23T18:32:27.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.846+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 46 ==== osd_op_reply(198 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.846+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:199 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.840 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.846+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 47 ==== osd_op_reply(199 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.846+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.846+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:200 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.846+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 48 ==== osd_op_reply(200 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.846+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.846+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:201 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.847+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 49 ==== osd_op_reply(201 gc.15 [call] v34'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.847+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-23T18:32:27.841 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.847+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:202 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.848+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 51 ==== osd_op_reply(202 gc.16 [call] v34'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.848+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:203 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.848+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 52 ==== osd_op_reply(203 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.848+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.848+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:204 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143202870 2024-04-23T18:32:27.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.849+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 53 ==== osd_op_reply(204 gc.16 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.849+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:205 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.849+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 54 ==== osd_op_reply(205 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.849+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.849+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:206 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.849+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 55 ==== osd_op_reply(206 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.845 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.849+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.849+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:207 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.850+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 56 ==== osd_op_reply(207 gc.16 [call] v34'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.850+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-23T18:32:27.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.850+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:208 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.851+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 50 ==== osd_op_reply(208 gc.17 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.851+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:209 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.851+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 51 ==== osd_op_reply(209 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.851+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.851+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:210 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143207200 2024-04-23T18:32:27.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.851+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 52 ==== osd_op_reply(210 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.846 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.851+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:211 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.851+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 53 ==== osd_op_reply(211 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.852+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.852+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:212 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.852+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 54 ==== osd_op_reply(212 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.852+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.852+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:213 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.853+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 55 ==== osd_op_reply(213 gc.17 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.853+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-23T18:32:27.847 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.853+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:214 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.854+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 51 ==== osd_op_reply(214 gc.18 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.854+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:215 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.854+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 52 ==== osd_op_reply(215 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.854+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.850 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.854+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:216 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x5651431fe200 2024-04-23T18:32:27.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.854+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 53 ==== osd_op_reply(216 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.854+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:217 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.855+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 54 ==== osd_op_reply(217 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.855+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.855+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:218 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.855+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 55 ==== osd_op_reply(218 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.855+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.855+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:219 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.856+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 56 ==== osd_op_reply(219 gc.18 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.856+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-23T18:32:27.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.856+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:220 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.857+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 57 ==== osd_op_reply(220 gc.19 [call] v34'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.851 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.857+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:221 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.857+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 58 ==== osd_op_reply(221 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.857+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.857+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:222 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x5651431fe200 2024-04-23T18:32:27.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.857+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 59 ==== osd_op_reply(222 gc.19 [call out=24b] v0'0 uv283 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.857+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:223 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.858+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 60 ==== osd_op_reply(223 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.858+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.858+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:224 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.858+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 61 ==== osd_op_reply(224 gc.19 [call out=15b] v0'0 uv283 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.852 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.858+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.853 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.858+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:225 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x5651431fe200 2024-04-23T18:32:27.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.859+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 62 ==== osd_op_reply(225 gc.19 [call] v34'284 uv284 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.859+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-23T18:32:27.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.859+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:226 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.860+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 56 ==== osd_op_reply(226 gc.20 [call] v34'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.860+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:227 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.860+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 57 ==== osd_op_reply(227 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.860+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.855 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.860+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:228 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143207200 2024-04-23T18:32:27.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.861+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 58 ==== osd_op_reply(228 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.861+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:229 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.861+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 59 ==== osd_op_reply(229 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.861+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.861+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:230 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.861+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 60 ==== osd_op_reply(230 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.861+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.861+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:231 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.862+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 61 ==== osd_op_reply(231 gc.20 [call] v34'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.862+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-23T18:32:27.856 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.862+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:232 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.863+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 57 ==== osd_op_reply(232 gc.21 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.863+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:233 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.863+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 58 ==== osd_op_reply(233 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.863+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.859 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.863+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:234 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143202870 2024-04-23T18:32:27.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.864+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 59 ==== osd_op_reply(234 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.864+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:235 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.864+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 60 ==== osd_op_reply(235 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.864+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.864+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:236 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.864+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 61 ==== osd_op_reply(236 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.864+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.864+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:237 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143202870 2024-04-23T18:32:27.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.865+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 62 ==== osd_op_reply(237 gc.21 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.865+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-23T18:32:27.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.865+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:238 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.860 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.866+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 62 ==== osd_op_reply(238 gc.22 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.866+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:239 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.866+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 63 ==== osd_op_reply(239 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.866+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.866+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:240 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143207200 2024-04-23T18:32:27.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.867+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 64 ==== osd_op_reply(240 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.867+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:241 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.867+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 65 ==== osd_op_reply(241 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.867+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.867+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:242 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.867+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 66 ==== osd_op_reply(242 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.867+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.861 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.867+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:243 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.868+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 67 ==== osd_op_reply(243 gc.22 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.868+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-23T18:32:27.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.868+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:244 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.869+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 68 ==== osd_op_reply(244 gc.23 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.869+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:245 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.869+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 69 ==== osd_op_reply(245 gc.23 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.869+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.866 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.869+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:246 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143207200 2024-04-23T18:32:27.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.869+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 70 ==== osd_op_reply(246 gc.23 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.869+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:247 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.870+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 71 ==== osd_op_reply(247 gc.23 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.870+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.870+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:248 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.870+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 72 ==== osd_op_reply(248 gc.23 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.870+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.870+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:249 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.871+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 73 ==== osd_op_reply(249 gc.23 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.871+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-23T18:32:27.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.871+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:250 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.867 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.872+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 74 ==== osd_op_reply(250 gc.24 [call] v34'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.872+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:251 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.872+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 75 ==== osd_op_reply(251 gc.24 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.872+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.872+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:252 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324bc10 con 0x565143207200 2024-04-23T18:32:27.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.872+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 76 ==== osd_op_reply(252 gc.24 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.872+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:253 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.872+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 77 ==== osd_op_reply(253 gc.24 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.872+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.872+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:254 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324cc20 con 0x565143207200 2024-04-23T18:32:27.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 78 ==== osd_op_reply(254 gc.24 [call out=1716b] v0'0 uv30 ondisk = 0) ==== 149+0+1716 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-23T18:32:27.868 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 20 garbage collection: RGWGC::process iterating over entry tag='b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11183006717228485459', time=2024-04-23T18:32:35.866559+0000, chain.objs.size()=7 2024-04-23T18:32:27.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_1 2024-04-23T18:32:27.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:255 3.2cs0 3:352caab6:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324aed0 con 0x565143207200 2024-04-23T18:32:27.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_2 2024-04-23T18:32:27.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:256 3.2es0 3:74b12703:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324fe30 con 0x565143202870 2024-04-23T18:32:27.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_3 2024-04-23T18:32:27.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:257 3.16s0 3:69551e77:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651432526a0 con 0x565143202870 2024-04-23T18:32:27.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_4 2024-04-23T18:32:27.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:258 3.22s0 3:47f789d8:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143254f10 con 0x565143207200 2024-04-23T18:32:27.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_5 2024-04-23T18:32:27.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:259 3.13s0 3:c9e8e981:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143257780 con 0x565143207200 2024-04-23T18:32:27.869 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_6 2024-04-23T18:32:27.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:260 3.7s0 3:e39160af:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143259ff0 con 0x565143207200 2024-04-23T18:32:27.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_7 2024-04-23T18:32:27.870 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.873+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:261 3.1fs0 3:f8f28f3a:::b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143257780 con 0x5651431fe200 2024-04-23T18:32:27.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.875+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 79 ==== osd_op_reply(255 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_1 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.875+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 63 ==== osd_op_reply(257 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_3 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.875+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 63 ==== osd_op_reply(261 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_7 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.876+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 64 ==== osd_op_reply(256 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_2 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.877+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 80 ==== osd_op_reply(258 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_4 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.877+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 81 ==== osd_op_reply(259 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_5 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.871 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.878+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 82 ==== osd_op_reply(260 b69d402b-cbc2-4a79-bc3a-05ce158bbf85.4224.11__shadow_.ZzNhUZrXwJyxgOM6vaO6-k8W_sSbyQ-_6 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.878+0000 7f18be746800 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-23T18:32:27.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.878+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:262 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651432521b0 con 0x565143207200 2024-04-23T18:32:27.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.879+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 83 ==== osd_op_reply(262 gc.24 [call] v34'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.879+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:263 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651432521b0 con 0x565143207200 2024-04-23T18:32:27.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.880+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 84 ==== osd_op_reply(263 gc.24 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.872 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.880+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-23T18:32:27.873 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.880+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:264 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5651432521b0 con 0x565143207200 2024-04-23T18:32:27.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.881+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 85 ==== osd_op_reply(264 gc.25 [call] v34'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.874 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.881+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:265 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651432521b0 con 0x565143207200 2024-04-23T18:32:27.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.881+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 86 ==== osd_op_reply(265 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.881+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.881+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:266 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651432511a0 con 0x565143207200 2024-04-23T18:32:27.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.881+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 87 ==== osd_op_reply(266 gc.25 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.881+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:267 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.882+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 88 ==== osd_op_reply(267 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.882+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.882+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:268 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.882+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 89 ==== osd_op_reply(268 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.882+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.875 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.882+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:269 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.883+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 90 ==== osd_op_reply(269 gc.25 [call] v34'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.883+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-23T18:32:27.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.883+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:270 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x7f18ac0c3070 2024-04-23T18:32:27.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.884+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 53 ==== osd_op_reply(270 gc.26 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.877 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.884+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:271 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x7f18ac0c3070 2024-04-23T18:32:27.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.884+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 54 ==== osd_op_reply(271 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.884+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.884+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:272 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x7f18ac0c3070 2024-04-23T18:32:27.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.884+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 55 ==== osd_op_reply(272 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.884+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:273 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x7f18ac0c3070 2024-04-23T18:32:27.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.885+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 56 ==== osd_op_reply(273 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.885+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.885+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:274 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x7f18ac0c3070 2024-04-23T18:32:27.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.885+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 57 ==== osd_op_reply(274 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.885+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.878 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.885+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:275 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x7f18ac0c3070 2024-04-23T18:32:27.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.886+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 58 ==== osd_op_reply(275 gc.26 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.880 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.886+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-23T18:32:27.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.886+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:276 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.887+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 91 ==== osd_op_reply(276 gc.27 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.887+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:277 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.887+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 92 ==== osd_op_reply(277 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.887+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.887+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:278 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.888+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 93 ==== osd_op_reply(278 gc.27 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.888+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:279 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.888+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 94 ==== osd_op_reply(279 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.888+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.888+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:280 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.881 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.888+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 95 ==== osd_op_reply(280 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.888+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.882 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.888+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:281 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.889+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 96 ==== osd_op_reply(281 gc.27 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.889+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-23T18:32:27.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.889+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:282 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x7f18ac0c3070 2024-04-23T18:32:27.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.890+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 59 ==== osd_op_reply(282 gc.28 [call] v34'62 uv62 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.890+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:283 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x7f18ac0c3070 2024-04-23T18:32:27.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.891+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 60 ==== osd_op_reply(283 gc.28 [call out=15b] v0'0 uv62 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.891+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.891+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:284 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x7f18ac0c3070 2024-04-23T18:32:27.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.891+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 61 ==== osd_op_reply(284 gc.28 [call out=24b] v0'0 uv62 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.891+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:285 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x7f18ac0c3070 2024-04-23T18:32:27.884 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.891+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 62 ==== osd_op_reply(285 gc.28 [call out=15b] v0'0 uv62 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.891+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.891+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:286 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x7f18ac0c3070 2024-04-23T18:32:27.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.892+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 63 ==== osd_op_reply(286 gc.28 [call out=15b] v0'0 uv62 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.892+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.892+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:287 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x7f18ac0c3070 2024-04-23T18:32:27.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.893+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 64 ==== osd_op_reply(287 gc.28 [call] v34'63 uv63 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.885 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.893+0000 7f18be746800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-23T18:32:27.886 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.893+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:288 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.894+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 97 ==== osd_op_reply(288 gc.29 [call] v34'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.894+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:289 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.894+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 98 ==== osd_op_reply(289 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.894+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.894+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:290 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5651432511a0 con 0x565143207200 2024-04-23T18:32:27.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.894+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 99 ==== osd_op_reply(290 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.887 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.894+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:291 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.895+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 100 ==== osd_op_reply(291 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.895+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-23T18:32:27.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.895+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:292 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.895+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 101 ==== osd_op_reply(292 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.895+0000 7f18be746800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-23T18:32:27.888 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.895+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:293 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324a8c0 con 0x565143207200 2024-04-23T18:32:27.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.896+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 102 ==== osd_op_reply(293 gc.29 [call] v34'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.896+0000 7f17727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-23T18:32:27.889 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.896+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94907018581616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514324a140 con 0x5651431fe200 2024-04-23T18:32:27.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.897+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94907018581616] v34'285 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.890 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.898+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94907018557472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x565143211630 con 0x565143202870 2024-04-23T18:32:27.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.898+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 65 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94907018557472] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.898+0000 7f18be746800 20 remove_watcher() i=0 2024-04-23T18:32:27.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.898+0000 7f18be746800 2 removed watcher, disabling cache 2024-04-23T18:32:27.891 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.899+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94907018561376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320b820 con 0x5651431fe200 2024-04-23T18:32:27.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.900+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94907018561376] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.900+0000 7f18be746800 20 remove_watcher() i=1 2024-04-23T18:32:27.892 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.900+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94907018566128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320b820 con 0x565143207200 2024-04-23T18:32:27.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.901+0000 7f18bba44640 1 -- 172.21.15.119:0/400512262 <== osd.3 v2:172.21.15.119:6809/3910610681 103 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94907018566128] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b0009050 con 0x565143207200 2024-04-23T18:32:27.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.901+0000 7f18be746800 20 remove_watcher() i=2 2024-04-23T18:32:27.893 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.901+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94907018563504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320b820 con 0x565143202870 2024-04-23T18:32:27.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.902+0000 7f18bc245640 1 -- 172.21.15.119:0/400512262 <== osd.2 v2:172.21.15.119:6800/2624052101 66 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94907018563504] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18ac0d5040 con 0x565143202870 2024-04-23T18:32:27.894 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.902+0000 7f18be746800 20 remove_watcher() i=3 2024-04-23T18:32:27.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.902+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94907018572528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320b820 con 0x5651431fe200 2024-04-23T18:32:27.895 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.903+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.1 v2:172.21.15.119:6808/2736386629 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94907018572528] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x5651431fe200 2024-04-23T18:32:27.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.903+0000 7f18be746800 20 remove_watcher() i=4 2024-04-23T18:32:27.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.903+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94907018575024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320f2f0 con 0x7f18ac0c3070 2024-04-23T18:32:27.896 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.904+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 65 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94907018575024] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.904+0000 7f18be746800 20 remove_watcher() i=5 2024-04-23T18:32:27.897 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.904+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94907018577040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320b820 con 0x7f18ac0c3070 2024-04-23T18:32:27.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.905+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 66 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94907018577040] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.905+0000 7f18be746800 20 remove_watcher() i=6 2024-04-23T18:32:27.898 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.905+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94907018580496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56514320f2f0 con 0x7f18ac0c3070 2024-04-23T18:32:27.901 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 <== osd.0 v2:172.21.15.62:6800/2641588406 67 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94907018580496] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f18b4036040 con 0x7f18ac0c3070 2024-04-23T18:32:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 20 remove_watcher() i=7 2024-04-23T18:32:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f18ac0c3070 msgr2=0x7f18ac07f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f18ac0c3070 0x7f18ac07f930 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5651431fe200 msgr2=0x5651432006c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5651431fe200 0x5651432006c0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x565143202870 msgr2=0x565143204c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x565143202870 0x565143204c60 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x565143207200 msgr2=0x5651432096c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x565143207200 0x5651432096c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.902 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f178c036e60 msgr2=0x7f178c039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f178c036e60 0x7f178c039320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f18b0001b60 tx=0x7f18b0010000 comp rx=0 tx=0).stop 2024-04-23T18:32:27.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18bca46640 1 -- 172.21.15.119:0/400512262 reap_dead start 2024-04-23T18:32:27.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 msgr2=0x5651431f2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 0x5651431f2b20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f18ac051fd0 tx=0x7f18ac08c140 comp rx=0 tx=0).stop 2024-04-23T18:32:27.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 shutdown_connections 2024-04-23T18:32:27.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 --2- 172.21.15.119:0/400512262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431eb6f0 0x5651431f2b20 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 >> 172.21.15.119:0/400512262 conn(0x5651431e79c0 msgr2=0x5651431e5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:27.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 shutdown_connections 2024-04-23T18:32:27.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 -- 172.21.15.119:0/400512262 wait complete. 2024-04-23T18:32:27.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 -- 172.21.15.119:0/683520306 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1794036e60 msgr2=0x7f1794039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 --2- 172.21.15.119:0/683520306 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1794036e60 0x7f1794039320 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f18b000bf50 tx=0x7f18b000f000 comp rx=0 tx=0).stop 2024-04-23T18:32:27.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 -- 172.21.15.119:0/683520306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431de5d0 msgr2=0x5651431de9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.903 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.907+0000 7f18be746800 1 --2- 172.21.15.119:0/683520306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431de5d0 0x5651431de9f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f18ac08d580 tx=0x7f18ac070a10 comp rx=0 tx=0).stop 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 -- 172.21.15.119:0/683520306 shutdown_connections 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 --2- 172.21.15.119:0/683520306 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1794036e60 0x7f1794039320 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 --2- 172.21.15.119:0/683520306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651431de5d0 0x5651431de9f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 -- 172.21.15.119:0/683520306 >> 172.21.15.119:0/683520306 conn(0x5651431d2670 msgr2=0x5651431d2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 -- 172.21.15.119:0/683520306 shutdown_connections 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 -- 172.21.15.119:0/683520306 wait complete. 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5651431cd550 msgr2=0x5651431cf9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x5651431cd550 0x5651431cf9c0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5651430c41f0 msgr2=0x5651431c6ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x5651430c41f0 0x5651431c6ce0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5651431c9610 msgr2=0x5651431cba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x5651431c9610 0x5651431cba00 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f17a4036e60 msgr2=0x7f17a4039320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.904 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f17a4036e60 0x7f17a4039320 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f18b0000f60 tx=0x7f18b00012b0 comp rx=0 tx=0).stop 2024-04-23T18:32:27.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 msgr2=0x5651431bfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:27.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 --2- 172.21.15.119:0/578572473 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5651430c3890 0x5651431bfc70 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f18ac044810 tx=0x7f18ac003330 comp rx=0 tx=0).stop 2024-04-23T18:32:27.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18bca46640 1 -- 172.21.15.119:0/578572473 reap_dead start 2024-04-23T18:32:27.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 shutdown_connections 2024-04-23T18:32:27.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 >> 172.21.15.119:0/578572473 conn(0x5651430bf410 msgr2=0x5651431b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:27.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 shutdown_connections 2024-04-23T18:32:27.905 INFO:teuthology.orchestra.run.smithi119.stderr:2024-04-23T18:32:27.908+0000 7f18be746800 1 -- 172.21.15.119:0/578572473 wait complete. 2024-04-23T18:32:27.909 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-23T18:32:27.919 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T18:32:27.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:32:28.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.031+0000 7f219aa1b640 1 Processor -- start 2024-04-23T18:32:28.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.031+0000 7f219aa1b640 1 -- start start 2024-04-23T18:32:28.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.032+0000 7f219aa1b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2194128db0 0x7f2194130920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:28.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.032+0000 7f219aa1b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2194096460 con 0x7f21941282c0 2024-04-23T18:32:28.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.032+0000 7f219aa1b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2194096f80 con 0x7f2194128db0 2024-04-23T18:32:28.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.032+0000 7f21937fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2194128db0 0x7f2194130920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:28.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.032+0000 7f2193fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f21941282c0 0x7f21941286a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:54338/0 (socket says 172.21.15.62:54338) 2024-04-23T18:32:28.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.032+0000 7f2193fff640 1 -- 172.21.15.62:0/3814023142 learned_addr learned my addr 172.21.15.62:0/3814023142 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:28.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.032+0000 7f21937fe640 1 -- 172.21.15.62:0/3814023142 >> v1:172.21.15.62:6789/0 conn(0x7f21941282c0 legacy=0x7f21941286a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:28.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.032+0000 7f21937fe640 1 -- 172.21.15.62:0/3814023142 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2194096910 con 0x7f2194128db0 2024-04-23T18:32:28.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.033+0000 7f21937fe640 1 --2- 172.21.15.62:0/3814023142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2194128db0 0x7f2194130920 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f217c009750 tx=0x7f217c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e5b687e2cf64e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.033+0000 7f2192ffd640 1 -- 172.21.15.62:0/3814023142 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f217c035020 con 0x7f2194128db0 2024-04-23T18:32:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.033+0000 7f2192ffd640 1 -- 172.21.15.62:0/3814023142 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f217c031760 con 0x7f2194128db0 2024-04-23T18:32:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.033+0000 7f2192ffd640 1 -- 172.21.15.62:0/3814023142 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f217c031a60 con 0x7f2194128db0 2024-04-23T18:32:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.034+0000 7f219aa1b640 1 -- 172.21.15.62:0/3814023142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2194128db0 msgr2=0x7f2194130920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.034+0000 7f219aa1b640 1 --2- 172.21.15.62:0/3814023142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2194128db0 0x7f2194130920 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f217c009750 tx=0x7f217c02b8d0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.034+0000 7f219aa1b640 1 -- 172.21.15.62:0/3814023142 shutdown_connections 2024-04-23T18:32:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.034+0000 7f219aa1b640 1 --2- 172.21.15.62:0/3814023142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2194128db0 0x7f2194130920 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.034+0000 7f219aa1b640 1 -- 172.21.15.62:0/3814023142 >> 172.21.15.62:0/3814023142 conn(0x7f2194099d70 msgr2=0x7f2194097640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.034+0000 7f219aa1b640 1 -- 172.21.15.62:0/3814023142 shutdown_connections 2024-04-23T18:32:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.034+0000 7f219aa1b640 1 -- 172.21.15.62:0/3814023142 wait complete. 2024-04-23T18:32:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.034+0000 7f219aa1b640 1 Processor -- start 2024-04-23T18:32:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.035+0000 7f219aa1b640 1 -- start start 2024-04-23T18:32:28.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.035+0000 7f219aa1b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21941282c0 0x7f219406e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.035+0000 7f219aa1b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2194094140 con 0x7f21941282c0 2024-04-23T18:32:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.035+0000 7f2193fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21941282c0 0x7f219406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.035+0000 7f2193fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21941282c0 0x7f219406e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34100/0 (socket says 172.21.15.62:34100) 2024-04-23T18:32:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.035+0000 7f2193fff640 1 -- 172.21.15.62:0/3073194589 learned_addr learned my addr 172.21.15.62:0/3073194589 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.035+0000 7f2193fff640 1 -- 172.21.15.62:0/3073194589 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219406f8e0 con 0x7f21941282c0 2024-04-23T18:32:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.036+0000 7f2193fff640 1 --2- 172.21.15.62:0/3073194589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21941282c0 0x7f219406e150 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f218400e6b0 tx=0x7f218400eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.036+0000 7f2190ff9640 1 -- 172.21.15.62:0/3073194589 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2184019070 con 0x7f21941282c0 2024-04-23T18:32:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.036+0000 7f2190ff9640 1 -- 172.21.15.62:0/3073194589 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2184007bf0 con 0x7f21941282c0 2024-04-23T18:32:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.036+0000 7f219aa1b640 1 -- 172.21.15.62:0/3073194589 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2194125830 con 0x7f21941282c0 2024-04-23T18:32:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.036+0000 7f2190ff9640 1 -- 172.21.15.62:0/3073194589 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f218400c660 con 0x7f21941282c0 2024-04-23T18:32:28.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.036+0000 7f219aa1b640 1 -- 172.21.15.62:0/3073194589 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2194070570 con 0x7f21941282c0 2024-04-23T18:32:28.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.037+0000 7f2190ff9640 1 -- 172.21.15.62:0/3073194589 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f218401c070 con 0x7f21941282c0 2024-04-23T18:32:28.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.037+0000 7f219aa1b640 1 -- 172.21.15.62:0/3073194589 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2194070860 con 0x7f21941282c0 2024-04-23T18:32:28.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.037+0000 7f2190ff9640 1 --2- 172.21.15.62:0/3073194589 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21740385c0 0x7f217403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:28.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.037+0000 7f2190ff9640 1 -- 172.21.15.62:0/3073194589 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f218404d550 con 0x7f21941282c0 2024-04-23T18:32:28.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.037+0000 7f21937fe640 1 --2- 172.21.15.62:0/3073194589 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21740385c0 0x7f217403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:28.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.038+0000 7f21937fe640 1 --2- 172.21.15.62:0/3073194589 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21740385c0 0x7f217403aa80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f217c009750 tx=0x7f217c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:28.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.042+0000 7f2190ff9640 1 -- 172.21.15.62:0/3073194589 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2194070860 con 0x7f21941282c0 2024-04-23T18:32:28.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.222+0000 7f219aa1b640 1 -- 172.21.15.62:0/3073194589 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2194127500 con 0x7f21740385c0 2024-04-23T18:32:28.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.238+0000 7f2190ff9640 1 -- 172.21.15.62:0/3073194589 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665730 (secure 0 0 0) 0x7f2194127500 con 0x7f21740385c0 2024-04-23T18:32:28.238 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:32:28.244 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-04-23T18:32:28.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.243+0000 7f219aa1b640 1 -- 172.21.15.62:0/3073194589 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21740385c0 msgr2=0x7f217403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:28.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.243+0000 7f219aa1b640 1 --2- 172.21.15.62:0/3073194589 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21740385c0 0x7f217403aa80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f217c009750 tx=0x7f217c008030 comp rx=0 tx=0).stop 2024-04-23T18:32:28.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.243+0000 7f219aa1b640 1 -- 172.21.15.62:0/3073194589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21941282c0 msgr2=0x7f219406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:28.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.243+0000 7f219aa1b640 1 --2- 172.21.15.62:0/3073194589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21941282c0 0x7f219406e150 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f218400e6b0 tx=0x7f218400eb70 comp rx=0 tx=0).stop 2024-04-23T18:32:28.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.243+0000 7f219aa1b640 1 -- 172.21.15.62:0/3073194589 shutdown_connections 2024-04-23T18:32:28.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.243+0000 7f219aa1b640 1 --2- 172.21.15.62:0/3073194589 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f21740385c0 0x7f217403aa80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.243+0000 7f219aa1b640 1 --2- 172.21.15.62:0/3073194589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f21941282c0 0x7f219406e150 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.243+0000 7f219aa1b640 1 -- 172.21.15.62:0/3073194589 >> 172.21.15.62:0/3073194589 conn(0x7f2194099d70 msgr2=0x7f2194093700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:28.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.243+0000 7f219aa1b640 1 -- 172.21.15.62:0/3073194589 shutdown_connections 2024-04-23T18:32:28.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.243+0000 7f219aa1b640 1 -- 172.21.15.62:0/3073194589 wait complete. 2024-04-23T18:32:28.249 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-23T18:32:26.742220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412790,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4876,"num_read_kb":4453,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186224,"kb_used_data":40720,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377301136,"statfs":{"total":386547056640,"available":386356363264,"internally_reserved":0,"allocated":41697280,"data_stored":40499426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003805"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.392235+0000","last_change":"2024-04-23T18:29:11.496715+0000","last_active":"2024-04-23T18:31:20.392235+0000","last_peered":"2024-04-23T18:31:20.392235+0000","last_clean":"2024-04-23T18:31:20.392235+0000","last_became_active":"2024-04-23T18:29:11.495610+0000","last_became_peered":"2024-04-23T18:29:11.495610+0000","last_unstale":"2024-04-23T18:31:20.392235+0000","last_undegraded":"2024-04-23T18:31:20.392235+0000","last_fullsized":"2024-04-23T18:31:20.392235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:39:13.562652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216466+0000","last_change":"2024-04-23T18:29:13.493644+0000","last_active":"2024-04-23T18:32:21.216466+0000","last_peered":"2024-04-23T18:32:21.216466+0000","last_clean":"2024-04-23T18:32:21.216466+0000","last_became_active":"2024-04-23T18:29:13.492771+0000","last_became_peered":"2024-04-23T18:29:13.492771+0000","last_unstale":"2024-04-23T18:32:21.216466+0000","last_undegraded":"2024-04-23T18:32:21.216466+0000","last_fullsized":"2024-04-23T18:32:21.216466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:18.652802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549100+0000","last_change":"2024-04-23T18:29:11.495726+0000","last_active":"2024-04-23T18:29:52.549100+0000","last_peered":"2024-04-23T18:29:52.549100+0000","last_clean":"2024-04-23T18:29:52.549100+0000","last_became_active":"2024-04-23T18:29:11.495272+0000","last_became_peered":"2024-04-23T18:29:11.495272+0000","last_unstale":"2024-04-23T18:29:52.549100+0000","last_undegraded":"2024-04-23T18:29:52.549100+0000","last_fullsized":"2024-04-23T18:29:52.549100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:11:21.963212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.145581+0000","last_change":"2024-04-23T18:29:13.495212+0000","last_active":"2024-04-23T18:32:21.145581+0000","last_peered":"2024-04-23T18:32:21.145581+0000","last_clean":"2024-04-23T18:32:21.145581+0000","last_became_active":"2024-04-23T18:29:13.494969+0000","last_became_peered":"2024-04-23T18:29:13.494969+0000","last_unstale":"2024-04-23T18:32:21.145581+0000","last_undegraded":"2024-04-23T18:32:21.145581+0000","last_fullsized":"2024-04-23T18:32:21.145581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:31.120065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.883853+0000","last_change":"2024-04-23T18:29:11.505594+0000","last_active":"2024-04-23T18:32:20.883853+0000","last_peered":"2024-04-23T18:32:20.883853+0000","last_clean":"2024-04-23T18:32:20.883853+0000","last_became_active":"2024-04-23T18:29:11.505283+0000","last_became_peered":"2024-04-23T18:29:11.505283+0000","last_unstale":"2024-04-23T18:32:20.883853+0000","last_undegraded":"2024-04-23T18:32:20.883853+0000","last_fullsized":"2024-04-23T18:32:20.883853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:22.032624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549437+0000","last_change":"2024-04-23T18:29:13.495612+0000","last_active":"2024-04-23T18:29:52.549437+0000","last_peered":"2024-04-23T18:29:52.549437+0000","last_clean":"2024-04-23T18:29:52.549437+0000","last_became_active":"2024-04-23T18:29:13.495367+0000","last_became_peered":"2024-04-23T18:29:13.495367+0000","last_unstale":"2024-04-23T18:29:52.549437+0000","last_undegraded":"2024-04-23T18:29:52.549437+0000","last_fullsized":"2024-04-23T18:29:52.549437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:46.592957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542142+0000","last_change":"2024-04-23T18:29:11.496818+0000","last_active":"2024-04-23T18:29:52.542142+0000","last_peered":"2024-04-23T18:29:52.542142+0000","last_clean":"2024-04-23T18:29:52.542142+0000","last_became_active":"2024-04-23T18:29:11.495677+0000","last_became_peered":"2024-04-23T18:29:11.495677+0000","last_unstale":"2024-04-23T18:29:52.542142+0000","last_undegraded":"2024-04-23T18:29:52.542142+0000","last_fullsized":"2024-04-23T18:29:52.542142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:36.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223517+0000","last_change":"2024-04-23T18:29:52.558192+0000","last_active":"2024-04-23T18:32:21.223517+0000","last_peered":"2024-04-23T18:32:21.223517+0000","last_clean":"2024-04-23T18:32:21.223517+0000","last_became_active":"2024-04-23T18:29:52.548291+0000","last_became_peered":"2024-04-23T18:29:52.548291+0000","last_unstale":"2024-04-23T18:32:21.223517+0000","last_undegraded":"2024-04-23T18:32:21.223517+0000","last_fullsized":"2024-04-23T18:32:21.223517+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:21.650682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548661+0000","last_change":"2024-04-23T18:29:11.504896+0000","last_active":"2024-04-23T18:29:52.548661+0000","last_peered":"2024-04-23T18:29:52.548661+0000","last_clean":"2024-04-23T18:29:52.548661+0000","last_became_active":"2024-04-23T18:29:11.504554+0000","last_became_peered":"2024-04-23T18:29:11.504554+0000","last_unstale":"2024-04-23T18:29:52.548661+0000","last_undegraded":"2024-04-23T18:29:52.548661+0000","last_fullsized":"2024-04-23T18:29:52.548661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:17.981912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'5","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223019+0000","last_change":"2024-04-23T18:29:13.498634+0000","last_active":"2024-04-23T18:32:21.223019+0000","last_peered":"2024-04-23T18:32:21.223019+0000","last_clean":"2024-04-23T18:32:21.223019+0000","last_became_active":"2024-04-23T18:29:13.498378+0000","last_became_peered":"2024-04-23T18:29:13.498378+0000","last_unstale":"2024-04-23T18:32:21.223019+0000","last_undegraded":"2024-04-23T18:32:21.223019+0000","last_fullsized":"2024-04-23T18:32:21.223019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:53:35.946871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541220+0000","last_change":"2024-04-23T18:29:11.497271+0000","last_active":"2024-04-23T18:29:52.541220+0000","last_peered":"2024-04-23T18:29:52.541220+0000","last_clean":"2024-04-23T18:29:52.541220+0000","last_became_active":"2024-04-23T18:29:11.496923+0000","last_became_peered":"2024-04-23T18:29:11.496923+0000","last_unstale":"2024-04-23T18:29:52.541220+0000","last_undegraded":"2024-04-23T18:29:52.541220+0000","last_fullsized":"2024-04-23T18:29:52.541220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:28.851647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.758897+0000","last_change":"2024-04-23T18:29:13.503166+0000","last_active":"2024-04-23T18:29:53.758897+0000","last_peered":"2024-04-23T18:29:53.758897+0000","last_clean":"2024-04-23T18:29:53.758897+0000","last_became_active":"2024-04-23T18:29:13.502401+0000","last_became_peered":"2024-04-23T18:29:13.502401+0000","last_unstale":"2024-04-23T18:29:53.758897+0000","last_undegraded":"2024-04-23T18:29:53.758897+0000","last_fullsized":"2024-04-23T18:29:53.758897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:29:37.305411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.126025+0000","last_change":"2024-04-23T18:29:11.500102+0000","last_active":"2024-04-23T18:32:21.126025+0000","last_peered":"2024-04-23T18:32:21.126025+0000","last_clean":"2024-04-23T18:32:21.126025+0000","last_became_active":"2024-04-23T18:29:11.499772+0000","last_became_peered":"2024-04-23T18:29:11.499772+0000","last_unstale":"2024-04-23T18:32:21.126025+0000","last_undegraded":"2024-04-23T18:32:21.126025+0000","last_fullsized":"2024-04-23T18:32:21.126025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:33:31.780314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998531+0000","last_change":"2024-04-23T18:29:13.499669+0000","last_active":"2024-04-23T18:32:20.998531+0000","last_peered":"2024-04-23T18:32:20.998531+0000","last_clean":"2024-04-23T18:32:20.998531+0000","last_became_active":"2024-04-23T18:29:13.498965+0000","last_became_peered":"2024-04-23T18:29:13.498965+0000","last_unstale":"2024-04-23T18:32:20.998531+0000","last_undegraded":"2024-04-23T18:32:20.998531+0000","last_fullsized":"2024-04-23T18:32:20.998531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:55.148135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.524275+0000","last_change":"2024-04-23T18:29:11.493089+0000","last_active":"2024-04-23T18:31:20.524275+0000","last_peered":"2024-04-23T18:31:20.524275+0000","last_clean":"2024-04-23T18:31:20.524275+0000","last_became_active":"2024-04-23T18:29:11.491840+0000","last_became_peered":"2024-04-23T18:29:11.491840+0000","last_unstale":"2024-04-23T18:31:20.524275+0000","last_undegraded":"2024-04-23T18:31:20.524275+0000","last_fullsized":"2024-04-23T18:31:20.524275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:35.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136278+0000","last_change":"2024-04-23T18:29:13.505657+0000","last_active":"2024-04-23T18:32:21.136278+0000","last_peered":"2024-04-23T18:32:21.136278+0000","last_clean":"2024-04-23T18:32:21.136278+0000","last_became_active":"2024-04-23T18:29:13.505348+0000","last_became_peered":"2024-04-23T18:29:13.505348+0000","last_unstale":"2024-04-23T18:32:21.136278+0000","last_undegraded":"2024-04-23T18:32:21.136278+0000","last_fullsized":"2024-04-23T18:32:21.136278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:01.869007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.809404+0000","last_change":"2024-04-23T18:29:13.495619+0000","last_active":"2024-04-23T18:29:54.809404+0000","last_peered":"2024-04-23T18:29:54.809404+0000","last_clean":"2024-04-23T18:29:54.809404+0000","last_became_active":"2024-04-23T18:29:13.495337+0000","last_became_peered":"2024-04-23T18:29:13.495337+0000","last_unstale":"2024-04-23T18:29:54.809404+0000","last_undegraded":"2024-04-23T18:29:54.809404+0000","last_fullsized":"2024-04-23T18:29:54.809404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:01.568090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.207467+0000","last_change":"2024-04-23T18:29:11.502496+0000","last_active":"2024-04-23T18:29:53.207467+0000","last_peered":"2024-04-23T18:29:53.207467+0000","last_clean":"2024-04-23T18:29:53.207467+0000","last_became_active":"2024-04-23T18:29:11.501773+0000","last_became_peered":"2024-04-23T18:29:11.501773+0000","last_unstale":"2024-04-23T18:29:53.207467+0000","last_undegraded":"2024-04-23T18:29:53.207467+0000","last_fullsized":"2024-04-23T18:29:53.207467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:34.195698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.094606+0000","last_change":"2024-04-23T18:29:13.493129+0000","last_active":"2024-04-23T18:29:54.094606+0000","last_peered":"2024-04-23T18:29:54.094606+0000","last_clean":"2024-04-23T18:29:54.094606+0000","last_became_active":"2024-04-23T18:29:13.492366+0000","last_became_peered":"2024-04-23T18:29:13.492366+0000","last_unstale":"2024-04-23T18:29:54.094606+0000","last_undegraded":"2024-04-23T18:29:54.094606+0000","last_fullsized":"2024-04-23T18:29:54.094606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:55.148135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.500819+0000","last_change":"2024-04-23T18:29:11.486168+0000","last_active":"2024-04-23T18:31:20.500819+0000","last_peered":"2024-04-23T18:31:20.500819+0000","last_clean":"2024-04-23T18:31:20.500819+0000","last_became_active":"2024-04-23T18:29:11.484620+0000","last_became_peered":"2024-04-23T18:29:11.484620+0000","last_unstale":"2024-04-23T18:31:20.500819+0000","last_undegraded":"2024-04-23T18:31:20.500819+0000","last_fullsized":"2024-04-23T18:31:20.500819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:49.661961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'16","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216433+0000","last_change":"2024-04-23T18:29:13.496876+0000","last_active":"2024-04-23T18:32:21.216433+0000","last_peered":"2024-04-23T18:32:21.216433+0000","last_clean":"2024-04-23T18:32:21.216433+0000","last_became_active":"2024-04-23T18:29:13.495743+0000","last_became_peered":"2024-04-23T18:29:13.495743+0000","last_unstale":"2024-04-23T18:32:21.216433+0000","last_undegraded":"2024-04-23T18:32:21.216433+0000","last_fullsized":"2024-04-23T18:32:21.216433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:43.595018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547080+0000","last_change":"2024-04-23T18:29:11.494610+0000","last_active":"2024-04-23T18:29:52.547080+0000","last_peered":"2024-04-23T18:29:52.547080+0000","last_clean":"2024-04-23T18:29:52.547080+0000","last_became_active":"2024-04-23T18:29:11.493363+0000","last_became_peered":"2024-04-23T18:29:11.493363+0000","last_unstale":"2024-04-23T18:29:52.547080+0000","last_undegraded":"2024-04-23T18:29:52.547080+0000","last_fullsized":"2024-04-23T18:29:52.547080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:08:38.534696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759623+0000","last_change":"2024-04-23T18:29:13.502315+0000","last_active":"2024-04-23T18:31:39.759623+0000","last_peered":"2024-04-23T18:31:39.759623+0000","last_clean":"2024-04-23T18:31:39.759623+0000","last_became_active":"2024-04-23T18:29:13.501988+0000","last_became_peered":"2024-04-23T18:29:13.501988+0000","last_unstale":"2024-04-23T18:31:39.759623+0000","last_undegraded":"2024-04-23T18:31:39.759623+0000","last_fullsized":"2024-04-23T18:31:39.759623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:13:37.517178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546632+0000","last_change":"2024-04-23T18:29:11.503048+0000","last_active":"2024-04-23T18:29:52.546632+0000","last_peered":"2024-04-23T18:29:52.546632+0000","last_clean":"2024-04-23T18:29:52.546632+0000","last_became_active":"2024-04-23T18:29:11.502714+0000","last_became_peered":"2024-04-23T18:29:11.502714+0000","last_unstale":"2024-04-23T18:29:52.546632+0000","last_undegraded":"2024-04-23T18:29:52.546632+0000","last_fullsized":"2024-04-23T18:29:52.546632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:03.508942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216074+0000","last_change":"2024-04-23T18:29:13.499010+0000","last_active":"2024-04-23T18:32:21.216074+0000","last_peered":"2024-04-23T18:32:21.216074+0000","last_clean":"2024-04-23T18:32:21.216074+0000","last_became_active":"2024-04-23T18:29:13.498488+0000","last_became_peered":"2024-04-23T18:29:13.498488+0000","last_unstale":"2024-04-23T18:32:21.216074+0000","last_undegraded":"2024-04-23T18:32:21.216074+0000","last_fullsized":"2024-04-23T18:32:21.216074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:43.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548048+0000","last_change":"2024-04-23T18:29:11.495476+0000","last_active":"2024-04-23T18:29:52.548048+0000","last_peered":"2024-04-23T18:29:52.548048+0000","last_clean":"2024-04-23T18:29:52.548048+0000","last_became_active":"2024-04-23T18:29:11.495025+0000","last_became_peered":"2024-04-23T18:29:11.495025+0000","last_unstale":"2024-04-23T18:29:52.548048+0000","last_undegraded":"2024-04-23T18:29:52.548048+0000","last_fullsized":"2024-04-23T18:29:52.548048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:20.311305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.546632+0000","last_change":"2024-04-23T18:29:13.494330+0000","last_active":"2024-04-23T18:31:20.546632+0000","last_peered":"2024-04-23T18:31:20.546632+0000","last_clean":"2024-04-23T18:31:20.546632+0000","last_became_active":"2024-04-23T18:29:13.494080+0000","last_became_peered":"2024-04-23T18:29:13.494080+0000","last_unstale":"2024-04-23T18:31:20.546632+0000","last_undegraded":"2024-04-23T18:31:20.546632+0000","last_fullsized":"2024-04-23T18:31:20.546632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:19.116233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548882+0000","last_change":"2024-04-23T18:29:11.507699+0000","last_active":"2024-04-23T18:29:52.548882+0000","last_peered":"2024-04-23T18:29:52.548882+0000","last_clean":"2024-04-23T18:29:52.548882+0000","last_became_active":"2024-04-23T18:29:11.507336+0000","last_became_peered":"2024-04-23T18:29:11.507336+0000","last_unstale":"2024-04-23T18:29:52.548882+0000","last_undegraded":"2024-04-23T18:29:52.548882+0000","last_fullsized":"2024-04-23T18:29:52.548882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:33.718239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.160581+0000","last_change":"2024-04-23T18:29:21.530202+0000","last_active":"2024-04-23T18:32:21.160581+0000","last_peered":"2024-04-23T18:32:21.160581+0000","last_clean":"2024-04-23T18:32:21.160581+0000","last_became_active":"2024-04-23T18:29:21.529771+0000","last_became_peered":"2024-04-23T18:29:21.529771+0000","last_unstale":"2024-04-23T18:32:21.160581+0000","last_undegraded":"2024-04-23T18:32:21.160581+0000","last_fullsized":"2024-04-23T18:32:21.160581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:45.343308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'22","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216053+0000","last_change":"2024-04-23T18:29:52.561113+0000","last_active":"2024-04-23T18:32:21.216053+0000","last_peered":"2024-04-23T18:32:21.216053+0000","last_clean":"2024-04-23T18:32:21.216053+0000","last_became_active":"2024-04-23T18:29:52.549641+0000","last_became_peered":"2024-04-23T18:29:52.549641+0000","last_unstale":"2024-04-23T18:32:21.216053+0000","last_undegraded":"2024-04-23T18:32:21.216053+0000","last_fullsized":"2024-04-23T18:32:21.216053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:47:49.212714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":69,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761819+0000","last_change":"2024-04-23T18:29:11.512384+0000","last_active":"2024-04-23T18:31:31.761819+0000","last_peered":"2024-04-23T18:31:31.761819+0000","last_clean":"2024-04-23T18:31:31.761819+0000","last_became_active":"2024-04-23T18:29:11.512062+0000","last_became_peered":"2024-04-23T18:29:11.512062+0000","last_unstale":"2024-04-23T18:31:31.761819+0000","last_undegraded":"2024-04-23T18:31:31.761819+0000","last_fullsized":"2024-04-23T18:31:31.761819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:39.110614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552423+0000","last_change":"2024-04-23T18:29:15.508358+0000","last_active":"2024-04-23T18:29:52.552423+0000","last_peered":"2024-04-23T18:29:52.552423+0000","last_clean":"2024-04-23T18:29:52.552423+0000","last_became_active":"2024-04-23T18:29:15.508100+0000","last_became_peered":"2024-04-23T18:29:15.508100+0000","last_unstale":"2024-04-23T18:29:52.552423+0000","last_undegraded":"2024-04-23T18:29:52.552423+0000","last_fullsized":"2024-04-23T18:29:52.552423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:20.697054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.037486+0000","last_change":"2024-04-23T18:29:17.513687+0000","last_active":"2024-04-23T18:31:19.037486+0000","last_peered":"2024-04-23T18:31:19.037486+0000","last_clean":"2024-04-23T18:31:19.037486+0000","last_became_active":"2024-04-23T18:29:17.513368+0000","last_became_peered":"2024-04-23T18:29:17.513368+0000","last_unstale":"2024-04-23T18:31:19.037486+0000","last_undegraded":"2024-04-23T18:31:19.037486+0000","last_fullsized":"2024-04-23T18:31:19.037486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:24.244501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548046+0000","last_change":"2024-04-23T18:29:19.520367+0000","last_active":"2024-04-23T18:29:52.548046+0000","last_peered":"2024-04-23T18:29:52.548046+0000","last_clean":"2024-04-23T18:29:52.548046+0000","last_became_active":"2024-04-23T18:29:19.520066+0000","last_became_peered":"2024-04-23T18:29:19.520066+0000","last_unstale":"2024-04-23T18:29:52.548046+0000","last_undegraded":"2024-04-23T18:29:52.548046+0000","last_fullsized":"2024-04-23T18:29:52.548046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:25.717857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.543713+0000","last_change":"2024-04-23T18:29:21.530037+0000","last_active":"2024-04-23T18:31:20.543713+0000","last_peered":"2024-04-23T18:31:20.543713+0000","last_clean":"2024-04-23T18:31:20.543713+0000","last_became_active":"2024-04-23T18:29:21.529743+0000","last_became_peered":"2024-04-23T18:29:21.529743+0000","last_unstale":"2024-04-23T18:31:20.543713+0000","last_undegraded":"2024-04-23T18:31:20.543713+0000","last_fullsized":"2024-04-23T18:31:20.543713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:07.650347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'9","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.005291+0000","last_change":"2024-04-23T18:29:13.496552+0000","last_active":"2024-04-23T18:32:21.005291+0000","last_peered":"2024-04-23T18:32:21.005291+0000","last_clean":"2024-04-23T18:32:21.005291+0000","last_became_active":"2024-04-23T18:29:13.496299+0000","last_became_peered":"2024-04-23T18:29:13.496299+0000","last_unstale":"2024-04-23T18:32:21.005291+0000","last_undegraded":"2024-04-23T18:32:21.005291+0000","last_fullsized":"2024-04-23T18:32:21.005291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:46.067635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.207501+0000","last_change":"2024-04-23T18:29:11.497209+0000","last_active":"2024-04-23T18:29:53.207501+0000","last_peered":"2024-04-23T18:29:53.207501+0000","last_clean":"2024-04-23T18:29:53.207501+0000","last_became_active":"2024-04-23T18:29:11.496878+0000","last_became_peered":"2024-04-23T18:29:11.496878+0000","last_unstale":"2024-04-23T18:29:53.207501+0000","last_undegraded":"2024-04-23T18:29:53.207501+0000","last_fullsized":"2024-04-23T18:29:53.207501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:03.508942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547455+0000","last_change":"2024-04-23T18:29:15.504985+0000","last_active":"2024-04-23T18:29:52.547455+0000","last_peered":"2024-04-23T18:29:52.547455+0000","last_clean":"2024-04-23T18:29:52.547455+0000","last_became_active":"2024-04-23T18:29:15.504744+0000","last_became_peered":"2024-04-23T18:29:15.504744+0000","last_unstale":"2024-04-23T18:29:52.547455+0000","last_undegraded":"2024-04-23T18:29:52.547455+0000","last_fullsized":"2024-04-23T18:29:52.547455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:03.110961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548072+0000","last_change":"2024-04-23T18:29:17.510462+0000","last_active":"2024-04-23T18:29:52.548072+0000","last_peered":"2024-04-23T18:29:52.548072+0000","last_clean":"2024-04-23T18:29:52.548072+0000","last_became_active":"2024-04-23T18:29:17.510201+0000","last_became_peered":"2024-04-23T18:29:17.510201+0000","last_unstale":"2024-04-23T18:29:52.548072+0000","last_undegraded":"2024-04-23T18:29:52.548072+0000","last_fullsized":"2024-04-23T18:29:52.548072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:45:44.947602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546953+0000","last_change":"2024-04-23T18:29:19.528113+0000","last_active":"2024-04-23T18:29:52.546953+0000","last_peered":"2024-04-23T18:29:52.546953+0000","last_clean":"2024-04-23T18:29:52.546953+0000","last_became_active":"2024-04-23T18:29:19.527770+0000","last_became_peered":"2024-04-23T18:29:19.527770+0000","last_unstale":"2024-04-23T18:29:52.546953+0000","last_undegraded":"2024-04-23T18:29:52.546953+0000","last_fullsized":"2024-04-23T18:29:52.546953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:24.718294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546581+0000","last_change":"2024-04-23T18:29:21.526235+0000","last_active":"2024-04-23T18:29:52.546581+0000","last_peered":"2024-04-23T18:29:52.546581+0000","last_clean":"2024-04-23T18:29:52.546581+0000","last_became_active":"2024-04-23T18:29:21.525940+0000","last_became_peered":"2024-04-23T18:29:21.525940+0000","last_unstale":"2024-04-23T18:29:52.546581+0000","last_undegraded":"2024-04-23T18:29:52.546581+0000","last_fullsized":"2024-04-23T18:29:52.546581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:38.457462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216175+0000","last_change":"2024-04-23T18:29:13.496417+0000","last_active":"2024-04-23T18:32:21.216175+0000","last_peered":"2024-04-23T18:32:21.216175+0000","last_clean":"2024-04-23T18:32:21.216175+0000","last_became_active":"2024-04-23T18:29:13.496142+0000","last_became_peered":"2024-04-23T18:29:13.496142+0000","last_unstale":"2024-04-23T18:32:21.216175+0000","last_undegraded":"2024-04-23T18:32:21.216175+0000","last_fullsized":"2024-04-23T18:32:21.216175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:36:50.428324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549926+0000","last_change":"2024-04-23T18:29:11.504850+0000","last_active":"2024-04-23T18:29:52.549926+0000","last_peered":"2024-04-23T18:29:52.549926+0000","last_clean":"2024-04-23T18:29:52.549926+0000","last_became_active":"2024-04-23T18:29:11.504534+0000","last_became_peered":"2024-04-23T18:29:11.504534+0000","last_unstale":"2024-04-23T18:29:52.549926+0000","last_undegraded":"2024-04-23T18:29:52.549926+0000","last_fullsized":"2024-04-23T18:29:52.549926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:52.910514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549373+0000","last_change":"2024-04-23T18:29:15.510428+0000","last_active":"2024-04-23T18:29:52.549373+0000","last_peered":"2024-04-23T18:29:52.549373+0000","last_clean":"2024-04-23T18:29:52.549373+0000","last_became_active":"2024-04-23T18:29:15.510018+0000","last_became_peered":"2024-04-23T18:29:15.510018+0000","last_unstale":"2024-04-23T18:29:52.549373+0000","last_undegraded":"2024-04-23T18:29:52.549373+0000","last_fullsized":"2024-04-23T18:29:52.549373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:31.579537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.323469+0000","last_change":"2024-04-23T18:29:17.518086+0000","last_active":"2024-04-23T18:29:54.323469+0000","last_peered":"2024-04-23T18:29:54.323469+0000","last_clean":"2024-04-23T18:29:54.323469+0000","last_became_active":"2024-04-23T18:29:17.517679+0000","last_became_peered":"2024-04-23T18:29:17.517679+0000","last_unstale":"2024-04-23T18:29:54.323469+0000","last_undegraded":"2024-04-23T18:29:54.323469+0000","last_fullsized":"2024-04-23T18:29:54.323469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:02:29.059730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585443+0000","last_change":"2024-04-23T18:29:19.522798+0000","last_active":"2024-04-23T18:32:20.585443+0000","last_peered":"2024-04-23T18:32:20.585443+0000","last_clean":"2024-04-23T18:32:20.585443+0000","last_became_active":"2024-04-23T18:29:19.522434+0000","last_became_peered":"2024-04-23T18:29:19.522434+0000","last_unstale":"2024-04-23T18:32:20.585443+0000","last_undegraded":"2024-04-23T18:32:20.585443+0000","last_fullsized":"2024-04-23T18:32:20.585443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:32.658811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541070+0000","last_change":"2024-04-23T18:29:21.529767+0000","last_active":"2024-04-23T18:29:52.541070+0000","last_peered":"2024-04-23T18:29:52.541070+0000","last_clean":"2024-04-23T18:29:52.541070+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:29:52.541070+0000","last_undegraded":"2024-04-23T18:29:52.541070+0000","last_fullsized":"2024-04-23T18:29:52.541070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:48.933035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278231+0000","last_change":"2024-04-23T18:29:13.499630+0000","last_active":"2024-04-23T18:31:17.278231+0000","last_peered":"2024-04-23T18:31:17.278231+0000","last_clean":"2024-04-23T18:31:17.278231+0000","last_became_active":"2024-04-23T18:29:13.499248+0000","last_became_peered":"2024-04-23T18:29:13.499248+0000","last_unstale":"2024-04-23T18:31:17.278231+0000","last_undegraded":"2024-04-23T18:31:17.278231+0000","last_fullsized":"2024-04-23T18:31:17.278231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:55:09.572902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542903+0000","last_change":"2024-04-23T18:29:11.488862+0000","last_active":"2024-04-23T18:29:52.542903+0000","last_peered":"2024-04-23T18:29:52.542903+0000","last_clean":"2024-04-23T18:29:52.542903+0000","last_became_active":"2024-04-23T18:29:11.488531+0000","last_became_peered":"2024-04-23T18:29:11.488531+0000","last_unstale":"2024-04-23T18:29:52.542903+0000","last_undegraded":"2024-04-23T18:29:52.542903+0000","last_fullsized":"2024-04-23T18:29:52.542903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:28.851647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552314+0000","last_change":"2024-04-23T18:29:15.511603+0000","last_active":"2024-04-23T18:29:52.552314+0000","last_peered":"2024-04-23T18:29:52.552314+0000","last_clean":"2024-04-23T18:29:52.552314+0000","last_became_active":"2024-04-23T18:29:15.511249+0000","last_became_peered":"2024-04-23T18:29:15.511249+0000","last_unstale":"2024-04-23T18:29:52.552314+0000","last_undegraded":"2024-04-23T18:29:52.552314+0000","last_fullsized":"2024-04-23T18:29:52.552314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:43:24.269505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.032342+0000","last_change":"2024-04-23T18:29:17.518244+0000","last_active":"2024-04-23T18:31:19.032342+0000","last_peered":"2024-04-23T18:31:19.032342+0000","last_clean":"2024-04-23T18:31:19.032342+0000","last_became_active":"2024-04-23T18:29:17.517964+0000","last_became_peered":"2024-04-23T18:29:17.517964+0000","last_unstale":"2024-04-23T18:31:19.032342+0000","last_undegraded":"2024-04-23T18:31:19.032342+0000","last_fullsized":"2024-04-23T18:31:19.032342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:49.766603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":441,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.219733+0000","last_change":"2024-04-23T18:29:19.525252+0000","last_active":"2024-04-23T18:32:21.219733+0000","last_peered":"2024-04-23T18:32:21.219733+0000","last_clean":"2024-04-23T18:32:21.219733+0000","last_became_active":"2024-04-23T18:29:19.524881+0000","last_became_peered":"2024-04-23T18:29:19.524881+0000","last_unstale":"2024-04-23T18:32:21.219733+0000","last_undegraded":"2024-04-23T18:32:21.219733+0000","last_fullsized":"2024-04-23T18:32:21.219733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:32.759949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185271+0000","last_change":"2024-04-23T18:29:13.502374+0000","last_active":"2024-04-23T18:32:21.185271+0000","last_peered":"2024-04-23T18:32:21.185271+0000","last_clean":"2024-04-23T18:32:21.185271+0000","last_became_active":"2024-04-23T18:29:13.501472+0000","last_became_peered":"2024-04-23T18:29:13.501472+0000","last_unstale":"2024-04-23T18:32:21.185271+0000","last_undegraded":"2024-04-23T18:32:21.185271+0000","last_fullsized":"2024-04-23T18:32:21.185271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:48.669984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'5","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.605427+0000","last_change":"2024-04-23T18:29:11.483640+0000","last_active":"2024-04-23T18:30:36.605427+0000","last_peered":"2024-04-23T18:30:36.605427+0000","last_clean":"2024-04-23T18:30:36.605427+0000","last_became_active":"2024-04-23T18:29:11.481977+0000","last_became_peered":"2024-04-23T18:29:11.481977+0000","last_unstale":"2024-04-23T18:30:36.605427+0000","last_undegraded":"2024-04-23T18:30:36.605427+0000","last_fullsized":"2024-04-23T18:30:36.605427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:55.553919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543298+0000","last_change":"2024-04-23T18:29:15.510021+0000","last_active":"2024-04-23T18:29:52.543298+0000","last_peered":"2024-04-23T18:29:52.543298+0000","last_clean":"2024-04-23T18:29:52.543298+0000","last_became_active":"2024-04-23T18:29:15.509711+0000","last_became_peered":"2024-04-23T18:29:15.509711+0000","last_unstale":"2024-04-23T18:29:52.543298+0000","last_undegraded":"2024-04-23T18:29:52.543298+0000","last_fullsized":"2024-04-23T18:29:52.543298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:31.895433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'40","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.041931+0000","last_change":"2024-04-23T18:29:17.511358+0000","last_active":"2024-04-23T18:31:19.041931+0000","last_peered":"2024-04-23T18:31:19.041931+0000","last_clean":"2024-04-23T18:31:19.041931+0000","last_became_active":"2024-04-23T18:29:17.511085+0000","last_became_peered":"2024-04-23T18:29:17.511085+0000","last_unstale":"2024-04-23T18:31:19.041931+0000","last_undegraded":"2024-04-23T18:31:19.041931+0000","last_fullsized":"2024-04-23T18:31:19.041931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:33.909507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547808+0000","last_change":"2024-04-23T18:29:19.527807+0000","last_active":"2024-04-23T18:29:52.547808+0000","last_peered":"2024-04-23T18:29:52.547808+0000","last_clean":"2024-04-23T18:29:52.547808+0000","last_became_active":"2024-04-23T18:29:19.527505+0000","last_became_peered":"2024-04-23T18:29:19.527505+0000","last_unstale":"2024-04-23T18:29:52.547808+0000","last_undegraded":"2024-04-23T18:29:52.547808+0000","last_fullsized":"2024-04-23T18:29:52.547808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:22:25.429131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'13","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.636252+0000","last_change":"2024-04-23T18:29:21.532533+0000","last_active":"2024-04-23T18:32:20.636252+0000","last_peered":"2024-04-23T18:32:20.636252+0000","last_clean":"2024-04-23T18:32:20.636252+0000","last_became_active":"2024-04-23T18:29:21.532163+0000","last_became_peered":"2024-04-23T18:29:21.532163+0000","last_unstale":"2024-04-23T18:32:20.636252+0000","last_undegraded":"2024-04-23T18:32:20.636252+0000","last_fullsized":"2024-04-23T18:32:20.636252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:35.252958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.795754+0000","last_change":"2024-04-23T18:29:13.494415+0000","last_active":"2024-04-23T18:30:36.795754+0000","last_peered":"2024-04-23T18:30:36.795754+0000","last_clean":"2024-04-23T18:30:36.795754+0000","last_became_active":"2024-04-23T18:29:13.494108+0000","last_became_peered":"2024-04-23T18:29:13.494108+0000","last_unstale":"2024-04-23T18:30:36.795754+0000","last_undegraded":"2024-04-23T18:30:36.795754+0000","last_fullsized":"2024-04-23T18:30:36.795754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:48.393428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543652+0000","last_change":"2024-04-23T18:29:11.481951+0000","last_active":"2024-04-23T18:29:52.543652+0000","last_peered":"2024-04-23T18:29:52.543652+0000","last_clean":"2024-04-23T18:29:52.543652+0000","last_became_active":"2024-04-23T18:29:11.481419+0000","last_became_peered":"2024-04-23T18:29:11.481419+0000","last_unstale":"2024-04-23T18:29:52.543652+0000","last_undegraded":"2024-04-23T18:29:52.543652+0000","last_fullsized":"2024-04-23T18:29:52.543652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:30.568409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546778+0000","last_change":"2024-04-23T18:29:15.510512+0000","last_active":"2024-04-23T18:29:52.546778+0000","last_peered":"2024-04-23T18:29:52.546778+0000","last_clean":"2024-04-23T18:29:52.546778+0000","last_became_active":"2024-04-23T18:29:15.510135+0000","last_became_peered":"2024-04-23T18:29:15.510135+0000","last_unstale":"2024-04-23T18:29:52.546778+0000","last_undegraded":"2024-04-23T18:29:52.546778+0000","last_fullsized":"2024-04-23T18:29:52.546778+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:34:51.553982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.021828+0000","last_change":"2024-04-23T18:29:17.513711+0000","last_active":"2024-04-23T18:31:19.021828+0000","last_peered":"2024-04-23T18:31:19.021828+0000","last_clean":"2024-04-23T18:31:19.021828+0000","last_became_active":"2024-04-23T18:29:17.513447+0000","last_became_peered":"2024-04-23T18:29:17.513447+0000","last_unstale":"2024-04-23T18:31:19.021828+0000","last_undegraded":"2024-04-23T18:31:19.021828+0000","last_fullsized":"2024-04-23T18:31:19.021828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:53.226081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546745+0000","last_change":"2024-04-23T18:29:19.518994+0000","last_active":"2024-04-23T18:29:52.546745+0000","last_peered":"2024-04-23T18:29:52.546745+0000","last_clean":"2024-04-23T18:29:52.546745+0000","last_became_active":"2024-04-23T18:29:19.518695+0000","last_became_peered":"2024-04-23T18:29:19.518695+0000","last_unstale":"2024-04-23T18:29:52.546745+0000","last_undegraded":"2024-04-23T18:29:52.546745+0000","last_fullsized":"2024-04-23T18:29:52.546745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:31:26.171589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.187825+0000","last_change":"2024-04-23T18:29:21.533423+0000","last_active":"2024-04-23T18:32:21.187825+0000","last_peered":"2024-04-23T18:32:21.187825+0000","last_clean":"2024-04-23T18:32:21.187825+0000","last_became_active":"2024-04-23T18:29:21.533103+0000","last_became_peered":"2024-04-23T18:29:21.533103+0000","last_unstale":"2024-04-23T18:32:21.187825+0000","last_undegraded":"2024-04-23T18:32:21.187825+0000","last_fullsized":"2024-04-23T18:32:21.187825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:55:25.843294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'12","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216152+0000","last_change":"2024-04-23T18:29:13.500105+0000","last_active":"2024-04-23T18:32:21.216152+0000","last_peered":"2024-04-23T18:32:21.216152+0000","last_clean":"2024-04-23T18:32:21.216152+0000","last_became_active":"2024-04-23T18:29:13.499795+0000","last_became_peered":"2024-04-23T18:29:13.499795+0000","last_unstale":"2024-04-23T18:32:21.216152+0000","last_undegraded":"2024-04-23T18:32:21.216152+0000","last_fullsized":"2024-04-23T18:32:21.216152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:53:51.760582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552836+0000","last_change":"2024-04-23T18:29:11.503536+0000","last_active":"2024-04-23T18:29:52.552836+0000","last_peered":"2024-04-23T18:29:52.552836+0000","last_clean":"2024-04-23T18:29:52.552836+0000","last_became_active":"2024-04-23T18:29:11.503228+0000","last_became_peered":"2024-04-23T18:29:11.503228+0000","last_unstale":"2024-04-23T18:29:52.552836+0000","last_undegraded":"2024-04-23T18:29:52.552836+0000","last_fullsized":"2024-04-23T18:29:52.552836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:41.470810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548689+0000","last_change":"2024-04-23T18:29:15.510453+0000","last_active":"2024-04-23T18:29:52.548689+0000","last_peered":"2024-04-23T18:29:52.548689+0000","last_clean":"2024-04-23T18:29:52.548689+0000","last_became_active":"2024-04-23T18:29:15.509856+0000","last_became_peered":"2024-04-23T18:29:15.509856+0000","last_unstale":"2024-04-23T18:29:52.548689+0000","last_undegraded":"2024-04-23T18:29:52.548689+0000","last_fullsized":"2024-04-23T18:29:52.548689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:23.285461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'39","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.760976+0000","last_change":"2024-04-23T18:29:17.517429+0000","last_active":"2024-04-23T18:31:26.760976+0000","last_peered":"2024-04-23T18:31:26.760976+0000","last_clean":"2024-04-23T18:31:26.760976+0000","last_became_active":"2024-04-23T18:29:17.517116+0000","last_became_peered":"2024-04-23T18:29:17.517116+0000","last_unstale":"2024-04-23T18:31:26.760976+0000","last_undegraded":"2024-04-23T18:31:26.760976+0000","last_fullsized":"2024-04-23T18:31:26.760976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:11.788105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":348,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.336039+0000","last_change":"2024-04-23T18:29:19.518873+0000","last_active":"2024-04-23T18:32:21.336039+0000","last_peered":"2024-04-23T18:32:21.336039+0000","last_clean":"2024-04-23T18:32:21.336039+0000","last_became_active":"2024-04-23T18:29:19.518519+0000","last_became_peered":"2024-04-23T18:29:19.518519+0000","last_unstale":"2024-04-23T18:32:21.336039+0000","last_undegraded":"2024-04-23T18:32:21.336039+0000","last_fullsized":"2024-04-23T18:32:21.336039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:06:53.742445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548413+0000","last_change":"2024-04-23T18:29:21.529229+0000","last_active":"2024-04-23T18:29:52.548413+0000","last_peered":"2024-04-23T18:29:52.548413+0000","last_clean":"2024-04-23T18:29:52.548413+0000","last_became_active":"2024-04-23T18:29:21.528917+0000","last_became_peered":"2024-04-23T18:29:21.528917+0000","last_unstale":"2024-04-23T18:29:52.548413+0000","last_undegraded":"2024-04-23T18:29:52.548413+0000","last_fullsized":"2024-04-23T18:29:52.548413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:23.465133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.320304+0000","last_change":"2024-04-23T18:29:13.499442+0000","last_active":"2024-04-23T18:29:54.320304+0000","last_peered":"2024-04-23T18:29:54.320304+0000","last_clean":"2024-04-23T18:29:54.320304+0000","last_became_active":"2024-04-23T18:29:13.499216+0000","last_became_peered":"2024-04-23T18:29:13.499216+0000","last_unstale":"2024-04-23T18:29:54.320304+0000","last_undegraded":"2024-04-23T18:29:54.320304+0000","last_fullsized":"2024-04-23T18:29:54.320304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:58.980385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.550696+0000","last_change":"2024-04-23T18:29:11.511581+0000","last_active":"2024-04-23T18:29:52.550696+0000","last_peered":"2024-04-23T18:29:52.550696+0000","last_clean":"2024-04-23T18:29:52.550696+0000","last_became_active":"2024-04-23T18:29:11.511211+0000","last_became_peered":"2024-04-23T18:29:11.511211+0000","last_unstale":"2024-04-23T18:29:52.550696+0000","last_undegraded":"2024-04-23T18:29:52.550696+0000","last_fullsized":"2024-04-23T18:29:52.550696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:53.141133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547414+0000","last_change":"2024-04-23T18:29:15.510812+0000","last_active":"2024-04-23T18:29:52.547414+0000","last_peered":"2024-04-23T18:29:52.547414+0000","last_clean":"2024-04-23T18:29:52.547414+0000","last_became_active":"2024-04-23T18:29:15.510350+0000","last_became_peered":"2024-04-23T18:29:15.510350+0000","last_unstale":"2024-04-23T18:29:52.547414+0000","last_undegraded":"2024-04-23T18:29:52.547414+0000","last_fullsized":"2024-04-23T18:29:52.547414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:37.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'54","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.045638+0000","last_change":"2024-04-23T18:29:17.514012+0000","last_active":"2024-04-23T18:31:19.045638+0000","last_peered":"2024-04-23T18:31:19.045638+0000","last_clean":"2024-04-23T18:31:19.045638+0000","last_became_active":"2024-04-23T18:29:17.513298+0000","last_became_peered":"2024-04-23T18:29:17.513298+0000","last_unstale":"2024-04-23T18:31:19.045638+0000","last_undegraded":"2024-04-23T18:31:19.045638+0000","last_fullsized":"2024-04-23T18:31:19.045638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:28:12.293067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546424+0000","last_change":"2024-04-23T18:29:19.518358+0000","last_active":"2024-04-23T18:29:52.546424+0000","last_peered":"2024-04-23T18:29:52.546424+0000","last_clean":"2024-04-23T18:29:52.546424+0000","last_became_active":"2024-04-23T18:29:19.518015+0000","last_became_peered":"2024-04-23T18:29:19.518015+0000","last_unstale":"2024-04-23T18:29:52.546424+0000","last_undegraded":"2024-04-23T18:29:52.546424+0000","last_fullsized":"2024-04-23T18:29:52.546424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:30.663315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.316527+0000","last_change":"2024-04-23T18:29:21.529718+0000","last_active":"2024-04-23T18:32:21.316527+0000","last_peered":"2024-04-23T18:32:21.316527+0000","last_clean":"2024-04-23T18:32:21.316527+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:32:21.316527+0000","last_undegraded":"2024-04-23T18:32:21.316527+0000","last_fullsized":"2024-04-23T18:32:21.316527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:45.962860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.997048+0000","last_change":"2024-04-23T18:29:52.558115+0000","last_active":"2024-04-23T18:32:20.997048+0000","last_peered":"2024-04-23T18:32:20.997048+0000","last_clean":"2024-04-23T18:32:20.997048+0000","last_became_active":"2024-04-23T18:29:52.550778+0000","last_became_peered":"2024-04-23T18:29:52.550778+0000","last_unstale":"2024-04-23T18:32:20.997048+0000","last_undegraded":"2024-04-23T18:32:20.997048+0000","last_fullsized":"2024-04-23T18:32:20.997048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:43.467982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547787+0000","last_change":"2024-04-23T18:29:11.486362+0000","last_active":"2024-04-23T18:29:52.547787+0000","last_peered":"2024-04-23T18:29:52.547787+0000","last_clean":"2024-04-23T18:29:52.547787+0000","last_became_active":"2024-04-23T18:29:11.485899+0000","last_became_peered":"2024-04-23T18:29:11.485899+0000","last_unstale":"2024-04-23T18:29:52.547787+0000","last_undegraded":"2024-04-23T18:29:52.547787+0000","last_fullsized":"2024-04-23T18:29:52.547787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:10.908021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.190971+0000","last_change":"2024-04-23T18:29:15.507275+0000","last_active":"2024-04-23T18:31:20.190971+0000","last_peered":"2024-04-23T18:31:20.190971+0000","last_clean":"2024-04-23T18:31:20.190971+0000","last_became_active":"2024-04-23T18:29:15.506940+0000","last_became_peered":"2024-04-23T18:29:15.506940+0000","last_unstale":"2024-04-23T18:31:20.190971+0000","last_undegraded":"2024-04-23T18:31:20.190971+0000","last_fullsized":"2024-04-23T18:31:20.190971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:52.970455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.026166+0000","last_change":"2024-04-23T18:29:17.510208+0000","last_active":"2024-04-23T18:31:19.026166+0000","last_peered":"2024-04-23T18:31:19.026166+0000","last_clean":"2024-04-23T18:31:19.026166+0000","last_became_active":"2024-04-23T18:29:17.509586+0000","last_became_peered":"2024-04-23T18:29:17.509586+0000","last_unstale":"2024-04-23T18:31:19.026166+0000","last_undegraded":"2024-04-23T18:31:19.026166+0000","last_fullsized":"2024-04-23T18:31:19.026166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:06.298521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551606+0000","last_change":"2024-04-23T18:29:19.522554+0000","last_active":"2024-04-23T18:29:52.551606+0000","last_peered":"2024-04-23T18:29:52.551606+0000","last_clean":"2024-04-23T18:29:52.551606+0000","last_became_active":"2024-04-23T18:29:19.521939+0000","last_became_peered":"2024-04-23T18:29:19.521939+0000","last_unstale":"2024-04-23T18:29:52.551606+0000","last_undegraded":"2024-04-23T18:29:52.551606+0000","last_fullsized":"2024-04-23T18:29:52.551606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:46.071667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760279+0000","last_change":"2024-04-23T18:29:21.531398+0000","last_active":"2024-04-23T18:31:21.760279+0000","last_peered":"2024-04-23T18:31:21.760279+0000","last_clean":"2024-04-23T18:31:21.760279+0000","last_became_active":"2024-04-23T18:29:21.530270+0000","last_became_peered":"2024-04-23T18:29:21.530270+0000","last_unstale":"2024-04-23T18:31:21.760279+0000","last_undegraded":"2024-04-23T18:31:21.760279+0000","last_fullsized":"2024-04-23T18:31:21.760279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:10:11.666403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136387+0000","last_change":"2024-04-23T18:29:13.504743+0000","last_active":"2024-04-23T18:32:21.136387+0000","last_peered":"2024-04-23T18:32:21.136387+0000","last_clean":"2024-04-23T18:32:21.136387+0000","last_became_active":"2024-04-23T18:29:13.501430+0000","last_became_peered":"2024-04-23T18:29:13.501430+0000","last_unstale":"2024-04-23T18:32:21.136387+0000","last_undegraded":"2024-04-23T18:32:21.136387+0000","last_fullsized":"2024-04-23T18:32:21.136387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:05:51.964842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.456289+0000","last_change":"2024-04-23T18:29:11.507985+0000","last_active":"2024-04-23T18:31:20.456289+0000","last_peered":"2024-04-23T18:31:20.456289+0000","last_clean":"2024-04-23T18:31:20.456289+0000","last_became_active":"2024-04-23T18:29:11.507633+0000","last_became_peered":"2024-04-23T18:29:11.507633+0000","last_unstale":"2024-04-23T18:31:20.456289+0000","last_undegraded":"2024-04-23T18:31:20.456289+0000","last_fullsized":"2024-04-23T18:31:20.456289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:03:30.412489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"25'1","reported_seq":218,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.201543+0000","last_change":"2024-04-23T18:29:15.510939+0000","last_active":"2024-04-23T18:31:20.201543+0000","last_peered":"2024-04-23T18:31:20.201543+0000","last_clean":"2024-04-23T18:31:20.201543+0000","last_became_active":"2024-04-23T18:29:15.510579+0000","last_became_peered":"2024-04-23T18:29:15.510579+0000","last_unstale":"2024-04-23T18:31:20.201543+0000","last_undegraded":"2024-04-23T18:31:20.201543+0000","last_fullsized":"2024-04-23T18:31:20.201543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:29.858474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.052643+0000","last_change":"2024-04-23T18:29:17.513300+0000","last_active":"2024-04-23T18:31:19.052643+0000","last_peered":"2024-04-23T18:31:19.052643+0000","last_clean":"2024-04-23T18:31:19.052643+0000","last_became_active":"2024-04-23T18:29:17.512935+0000","last_became_peered":"2024-04-23T18:29:17.512935+0000","last_unstale":"2024-04-23T18:31:19.052643+0000","last_undegraded":"2024-04-23T18:31:19.052643+0000","last_fullsized":"2024-04-23T18:31:19.052643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:03.290679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":431,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.316969+0000","last_change":"2024-04-23T18:29:19.526537+0000","last_active":"2024-04-23T18:32:21.316969+0000","last_peered":"2024-04-23T18:32:21.316969+0000","last_clean":"2024-04-23T18:32:21.316969+0000","last_became_active":"2024-04-23T18:29:19.526260+0000","last_became_peered":"2024-04-23T18:29:19.526260+0000","last_unstale":"2024-04-23T18:32:21.316969+0000","last_undegraded":"2024-04-23T18:32:21.316969+0000","last_fullsized":"2024-04-23T18:32:21.316969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:52.097068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:29.758096+0000","last_change":"2024-04-23T18:29:21.527340+0000","last_active":"2024-04-23T18:31:29.758096+0000","last_peered":"2024-04-23T18:31:29.758096+0000","last_clean":"2024-04-23T18:31:29.758096+0000","last_became_active":"2024-04-23T18:29:21.527108+0000","last_became_peered":"2024-04-23T18:29:21.527108+0000","last_unstale":"2024-04-23T18:31:29.758096+0000","last_undegraded":"2024-04-23T18:31:29.758096+0000","last_fullsized":"2024-04-23T18:31:29.758096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:47.675158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760391+0000","last_change":"2024-04-23T18:29:13.504838+0000","last_active":"2024-04-23T18:31:31.760391+0000","last_peered":"2024-04-23T18:31:31.760391+0000","last_clean":"2024-04-23T18:31:31.760391+0000","last_became_active":"2024-04-23T18:29:13.504570+0000","last_became_peered":"2024-04-23T18:29:13.504570+0000","last_unstale":"2024-04-23T18:31:31.760391+0000","last_undegraded":"2024-04-23T18:31:31.760391+0000","last_fullsized":"2024-04-23T18:31:31.760391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:10:09.191900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.204695+0000","last_change":"2024-04-23T18:29:11.505849+0000","last_active":"2024-04-23T18:29:53.204695+0000","last_peered":"2024-04-23T18:29:53.204695+0000","last_clean":"2024-04-23T18:29:53.204695+0000","last_became_active":"2024-04-23T18:29:11.505531+0000","last_became_peered":"2024-04-23T18:29:11.505531+0000","last_unstale":"2024-04-23T18:29:53.204695+0000","last_undegraded":"2024-04-23T18:29:53.204695+0000","last_fullsized":"2024-04-23T18:29:53.204695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:10:07.184898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.201161+0000","last_change":"2024-04-23T18:29:15.506623+0000","last_active":"2024-04-23T18:31:20.201161+0000","last_peered":"2024-04-23T18:31:20.201161+0000","last_clean":"2024-04-23T18:31:20.201161+0000","last_became_active":"2024-04-23T18:29:15.505983+0000","last_became_peered":"2024-04-23T18:29:15.505983+0000","last_unstale":"2024-04-23T18:31:20.201161+0000","last_undegraded":"2024-04-23T18:31:20.201161+0000","last_fullsized":"2024-04-23T18:31:20.201161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:17.947594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551087+0000","last_change":"2024-04-23T18:29:17.513606+0000","last_active":"2024-04-23T18:29:52.551087+0000","last_peered":"2024-04-23T18:29:52.551087+0000","last_clean":"2024-04-23T18:29:52.551087+0000","last_became_active":"2024-04-23T18:29:17.513213+0000","last_became_peered":"2024-04-23T18:29:17.513213+0000","last_unstale":"2024-04-23T18:29:52.551087+0000","last_undegraded":"2024-04-23T18:29:52.551087+0000","last_fullsized":"2024-04-23T18:29:52.551087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:09:31.064767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":468,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.277024+0000","last_change":"2024-04-23T18:29:19.520435+0000","last_active":"2024-04-23T18:32:21.277024+0000","last_peered":"2024-04-23T18:32:21.277024+0000","last_clean":"2024-04-23T18:32:21.277024+0000","last_became_active":"2024-04-23T18:29:19.518528+0000","last_became_peered":"2024-04-23T18:29:19.518528+0000","last_unstale":"2024-04-23T18:32:21.277024+0000","last_undegraded":"2024-04-23T18:32:21.277024+0000","last_fullsized":"2024-04-23T18:32:21.277024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:42.794724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.335123+0000","last_change":"2024-04-23T18:29:21.531220+0000","last_active":"2024-04-23T18:31:20.335123+0000","last_peered":"2024-04-23T18:31:20.335123+0000","last_clean":"2024-04-23T18:31:20.335123+0000","last_became_active":"2024-04-23T18:29:21.530946+0000","last_became_peered":"2024-04-23T18:29:21.530946+0000","last_unstale":"2024-04-23T18:31:20.335123+0000","last_undegraded":"2024-04-23T18:31:20.335123+0000","last_fullsized":"2024-04-23T18:31:20.335123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:52:56.737823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.145303+0000","last_change":"2024-04-23T18:29:13.508059+0000","last_active":"2024-04-23T18:32:21.145303+0000","last_peered":"2024-04-23T18:32:21.145303+0000","last_clean":"2024-04-23T18:32:21.145303+0000","last_became_active":"2024-04-23T18:29:13.507813+0000","last_became_peered":"2024-04-23T18:29:13.507813+0000","last_unstale":"2024-04-23T18:32:21.145303+0000","last_undegraded":"2024-04-23T18:32:21.145303+0000","last_fullsized":"2024-04-23T18:32:21.145303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:51.116517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549983+0000","last_change":"2024-04-23T18:29:11.501752+0000","last_active":"2024-04-23T18:29:52.549983+0000","last_peered":"2024-04-23T18:29:52.549983+0000","last_clean":"2024-04-23T18:29:52.549983+0000","last_became_active":"2024-04-23T18:29:11.501432+0000","last_became_peered":"2024-04-23T18:29:11.501432+0000","last_unstale":"2024-04-23T18:29:52.549983+0000","last_undegraded":"2024-04-23T18:29:52.549983+0000","last_fullsized":"2024-04-23T18:29:52.549983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:25:19.599288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552068+0000","last_change":"2024-04-23T18:29:15.510003+0000","last_active":"2024-04-23T18:29:52.552068+0000","last_peered":"2024-04-23T18:29:52.552068+0000","last_clean":"2024-04-23T18:29:52.552068+0000","last_became_active":"2024-04-23T18:29:15.509701+0000","last_became_peered":"2024-04-23T18:29:15.509701+0000","last_unstale":"2024-04-23T18:29:52.552068+0000","last_undegraded":"2024-04-23T18:29:52.552068+0000","last_fullsized":"2024-04-23T18:29:52.552068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:40.349247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.038568+0000","last_change":"2024-04-23T18:29:17.509954+0000","last_active":"2024-04-23T18:31:19.038568+0000","last_peered":"2024-04-23T18:31:19.038568+0000","last_clean":"2024-04-23T18:31:19.038568+0000","last_became_active":"2024-04-23T18:29:17.509672+0000","last_became_peered":"2024-04-23T18:29:17.509672+0000","last_unstale":"2024-04-23T18:31:19.038568+0000","last_undegraded":"2024-04-23T18:31:19.038568+0000","last_fullsized":"2024-04-23T18:31:19.038568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:05:55.987108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543479+0000","last_change":"2024-04-23T18:29:19.527128+0000","last_active":"2024-04-23T18:29:52.543479+0000","last_peered":"2024-04-23T18:29:52.543479+0000","last_clean":"2024-04-23T18:29:52.543479+0000","last_became_active":"2024-04-23T18:29:19.526861+0000","last_became_peered":"2024-04-23T18:29:19.526861+0000","last_unstale":"2024-04-23T18:29:52.543479+0000","last_undegraded":"2024-04-23T18:29:52.543479+0000","last_fullsized":"2024-04-23T18:29:52.543479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:48:19.499447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.250373+0000","last_change":"2024-04-23T18:29:21.530887+0000","last_active":"2024-04-23T18:32:21.250373+0000","last_peered":"2024-04-23T18:32:21.250373+0000","last_clean":"2024-04-23T18:32:21.250373+0000","last_became_active":"2024-04-23T18:29:21.530612+0000","last_became_peered":"2024-04-23T18:29:21.530612+0000","last_unstale":"2024-04-23T18:32:21.250373+0000","last_undegraded":"2024-04-23T18:32:21.250373+0000","last_fullsized":"2024-04-23T18:32:21.250373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:46.345887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278266+0000","last_change":"2024-04-23T18:29:13.502952+0000","last_active":"2024-04-23T18:31:17.278266+0000","last_peered":"2024-04-23T18:31:17.278266+0000","last_clean":"2024-04-23T18:31:17.278266+0000","last_became_active":"2024-04-23T18:29:13.501636+0000","last_became_peered":"2024-04-23T18:29:13.501636+0000","last_unstale":"2024-04-23T18:31:17.278266+0000","last_undegraded":"2024-04-23T18:31:17.278266+0000","last_fullsized":"2024-04-23T18:31:17.278266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:48:13.470014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542806+0000","last_change":"2024-04-23T18:28:58.798997+0000","last_active":"2024-04-23T18:29:52.542806+0000","last_peered":"2024-04-23T18:29:52.542806+0000","last_clean":"2024-04-23T18:29:52.542806+0000","last_became_active":"2024-04-23T18:28:58.798001+0000","last_became_peered":"2024-04-23T18:28:58.798001+0000","last_unstale":"2024-04-23T18:29:52.542806+0000","last_undegraded":"2024-04-23T18:29:52.542806+0000","last_fullsized":"2024-04-23T18:29:52.542806+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_clean_scrub_stamp":"2024-04-23T18:28:57.410644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:20.472050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548752+0000","last_change":"2024-04-23T18:29:03.446652+0000","last_active":"2024-04-23T18:29:52.548752+0000","last_peered":"2024-04-23T18:29:52.548752+0000","last_clean":"2024-04-23T18:29:52.548752+0000","last_became_active":"2024-04-23T18:29:03.446324+0000","last_became_peered":"2024-04-23T18:29:03.446324+0000","last_unstale":"2024-04-23T18:29:52.548752+0000","last_undegraded":"2024-04-23T18:29:52.548752+0000","last_fullsized":"2024-04-23T18:29:52.548752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:19.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.210752+0000","last_change":"2024-04-23T18:29:11.512994+0000","last_active":"2024-04-23T18:32:21.210752+0000","last_peered":"2024-04-23T18:32:21.210752+0000","last_clean":"2024-04-23T18:32:21.210752+0000","last_became_active":"2024-04-23T18:29:11.512684+0000","last_became_peered":"2024-04-23T18:29:11.512684+0000","last_unstale":"2024-04-23T18:32:21.210752+0000","last_undegraded":"2024-04-23T18:32:21.210752+0000","last_fullsized":"2024-04-23T18:32:21.210752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:16.645799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546263+0000","last_change":"2024-04-23T18:29:15.509604+0000","last_active":"2024-04-23T18:29:52.546263+0000","last_peered":"2024-04-23T18:29:52.546263+0000","last_clean":"2024-04-23T18:29:52.546263+0000","last_became_active":"2024-04-23T18:29:15.509209+0000","last_became_peered":"2024-04-23T18:29:15.509209+0000","last_unstale":"2024-04-23T18:29:52.546263+0000","last_undegraded":"2024-04-23T18:29:52.546263+0000","last_fullsized":"2024-04-23T18:29:52.546263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:36.226721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.050188+0000","last_change":"2024-04-23T18:29:17.513782+0000","last_active":"2024-04-23T18:31:19.050188+0000","last_peered":"2024-04-23T18:31:19.050188+0000","last_clean":"2024-04-23T18:31:19.050188+0000","last_became_active":"2024-04-23T18:29:17.513504+0000","last_became_peered":"2024-04-23T18:29:17.513504+0000","last_unstale":"2024-04-23T18:31:19.050188+0000","last_undegraded":"2024-04-23T18:31:19.050188+0000","last_fullsized":"2024-04-23T18:31:19.050188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:21.911021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548534+0000","last_change":"2024-04-23T18:29:19.519375+0000","last_active":"2024-04-23T18:29:52.548534+0000","last_peered":"2024-04-23T18:29:52.548534+0000","last_clean":"2024-04-23T18:29:52.548534+0000","last_became_active":"2024-04-23T18:29:19.518974+0000","last_became_peered":"2024-04-23T18:29:19.518974+0000","last_unstale":"2024-04-23T18:29:52.548534+0000","last_undegraded":"2024-04-23T18:29:52.548534+0000","last_fullsized":"2024-04-23T18:29:52.548534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:36:01.680036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":162,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.226604+0000","last_change":"2024-04-23T18:29:21.532023+0000","last_active":"2024-04-23T18:32:21.226604+0000","last_peered":"2024-04-23T18:32:21.226604+0000","last_clean":"2024-04-23T18:32:21.226604+0000","last_became_active":"2024-04-23T18:29:21.531725+0000","last_became_peered":"2024-04-23T18:29:21.531725+0000","last_unstale":"2024-04-23T18:32:21.226604+0000","last_undegraded":"2024-04-23T18:32:21.226604+0000","last_fullsized":"2024-04-23T18:32:21.226604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:44:23.460941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'5","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.909403+0000","last_change":"2024-04-23T18:29:13.497272+0000","last_active":"2024-04-23T18:32:20.909403+0000","last_peered":"2024-04-23T18:32:20.909403+0000","last_clean":"2024-04-23T18:32:20.909403+0000","last_became_active":"2024-04-23T18:29:13.497008+0000","last_became_peered":"2024-04-23T18:29:13.497008+0000","last_unstale":"2024-04-23T18:32:20.909403+0000","last_undegraded":"2024-04-23T18:32:20.909403+0000","last_fullsized":"2024-04-23T18:32:20.909403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:19.658217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547412+0000","last_change":"2024-04-23T18:29:03.447767+0000","last_active":"2024-04-23T18:29:52.547412+0000","last_peered":"2024-04-23T18:29:52.547412+0000","last_clean":"2024-04-23T18:29:52.547412+0000","last_became_active":"2024-04-23T18:29:03.447404+0000","last_became_peered":"2024-04-23T18:29:03.447404+0000","last_unstale":"2024-04-23T18:29:52.547412+0000","last_undegraded":"2024-04-23T18:29:52.547412+0000","last_fullsized":"2024-04-23T18:29:52.547412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:01:15.340699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546565+0000","last_change":"2024-04-23T18:29:11.487391+0000","last_active":"2024-04-23T18:29:52.546565+0000","last_peered":"2024-04-23T18:29:52.546565+0000","last_clean":"2024-04-23T18:29:52.546565+0000","last_became_active":"2024-04-23T18:29:11.486538+0000","last_became_peered":"2024-04-23T18:29:11.486538+0000","last_unstale":"2024-04-23T18:29:52.546565+0000","last_undegraded":"2024-04-23T18:29:52.546565+0000","last_fullsized":"2024-04-23T18:29:52.546565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:31:33.533609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552721+0000","last_change":"2024-04-23T18:29:15.508321+0000","last_active":"2024-04-23T18:29:52.552721+0000","last_peered":"2024-04-23T18:29:52.552721+0000","last_clean":"2024-04-23T18:29:52.552721+0000","last_became_active":"2024-04-23T18:29:15.508020+0000","last_became_peered":"2024-04-23T18:29:15.508020+0000","last_unstale":"2024-04-23T18:29:52.552721+0000","last_undegraded":"2024-04-23T18:29:52.552721+0000","last_fullsized":"2024-04-23T18:29:52.552721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:05.187203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'274","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585466+0000","last_change":"2024-04-23T18:29:17.515301+0000","last_active":"2024-04-23T18:32:20.585466+0000","last_peered":"2024-04-23T18:32:20.585466+0000","last_clean":"2024-04-23T18:32:20.585466+0000","last_became_active":"2024-04-23T18:29:17.515023+0000","last_became_peered":"2024-04-23T18:29:17.515023+0000","last_unstale":"2024-04-23T18:32:20.585466+0000","last_undegraded":"2024-04-23T18:32:20.585466+0000","last_fullsized":"2024-04-23T18:32:20.585466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:57.739742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551884+0000","last_change":"2024-04-23T18:29:19.522666+0000","last_active":"2024-04-23T18:29:52.551884+0000","last_peered":"2024-04-23T18:29:52.551884+0000","last_clean":"2024-04-23T18:29:52.551884+0000","last_became_active":"2024-04-23T18:29:19.522105+0000","last_became_peered":"2024-04-23T18:29:19.522105+0000","last_unstale":"2024-04-23T18:29:52.551884+0000","last_undegraded":"2024-04-23T18:29:52.551884+0000","last_fullsized":"2024-04-23T18:29:52.551884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:35.556440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.621034+0000","last_change":"2024-04-23T18:29:21.533582+0000","last_active":"2024-04-23T18:30:36.621034+0000","last_peered":"2024-04-23T18:30:36.621034+0000","last_clean":"2024-04-23T18:30:36.621034+0000","last_became_active":"2024-04-23T18:29:21.532867+0000","last_became_peered":"2024-04-23T18:29:21.532867+0000","last_unstale":"2024-04-23T18:30:36.621034+0000","last_undegraded":"2024-04-23T18:30:36.621034+0000","last_fullsized":"2024-04-23T18:30:36.621034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:30:13.562825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549403+0000","last_change":"2024-04-23T18:29:13.499606+0000","last_active":"2024-04-23T18:29:52.549403+0000","last_peered":"2024-04-23T18:29:52.549403+0000","last_clean":"2024-04-23T18:29:52.549403+0000","last_became_active":"2024-04-23T18:29:13.499253+0000","last_became_peered":"2024-04-23T18:29:13.499253+0000","last_unstale":"2024-04-23T18:29:52.549403+0000","last_undegraded":"2024-04-23T18:29:52.549403+0000","last_fullsized":"2024-04-23T18:29:52.549403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:12:00.717757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.540896+0000","last_change":"2024-04-23T18:29:03.447054+0000","last_active":"2024-04-23T18:29:52.540896+0000","last_peered":"2024-04-23T18:29:52.540896+0000","last_clean":"2024-04-23T18:29:52.540896+0000","last_became_active":"2024-04-23T18:29:03.446647+0000","last_became_peered":"2024-04-23T18:29:03.446647+0000","last_unstale":"2024-04-23T18:29:52.540896+0000","last_undegraded":"2024-04-23T18:29:52.540896+0000","last_fullsized":"2024-04-23T18:29:52.540896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:57.409435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546219+0000","last_change":"2024-04-23T18:29:11.492974+0000","last_active":"2024-04-23T18:29:52.546219+0000","last_peered":"2024-04-23T18:29:52.546219+0000","last_clean":"2024-04-23T18:29:52.546219+0000","last_became_active":"2024-04-23T18:29:11.491953+0000","last_became_peered":"2024-04-23T18:29:11.491953+0000","last_unstale":"2024-04-23T18:29:52.546219+0000","last_undegraded":"2024-04-23T18:29:52.546219+0000","last_fullsized":"2024-04-23T18:29:52.546219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:45:27.531143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.563923+0000","last_change":"2024-04-23T18:29:52.563435+0000","last_active":"2024-04-23T18:29:52.563923+0000","last_peered":"2024-04-23T18:29:52.563923+0000","last_clean":"2024-04-23T18:29:52.563923+0000","last_became_active":"2024-04-23T18:29:52.551265+0000","last_became_peered":"2024-04-23T18:29:52.551265+0000","last_unstale":"2024-04-23T18:29:52.563923+0000","last_undegraded":"2024-04-23T18:29:52.563923+0000","last_fullsized":"2024-04-23T18:29:52.563923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:39.312725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585625+0000","last_change":"2024-04-23T18:29:17.514185+0000","last_active":"2024-04-23T18:32:20.585625+0000","last_peered":"2024-04-23T18:32:20.585625+0000","last_clean":"2024-04-23T18:32:20.585625+0000","last_became_active":"2024-04-23T18:29:17.513875+0000","last_became_peered":"2024-04-23T18:29:17.513875+0000","last_unstale":"2024-04-23T18:32:20.585625+0000","last_undegraded":"2024-04-23T18:32:20.585625+0000","last_fullsized":"2024-04-23T18:32:20.585625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:59:32.280321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548106+0000","last_change":"2024-04-23T18:29:19.519133+0000","last_active":"2024-04-23T18:29:52.548106+0000","last_peered":"2024-04-23T18:29:52.548106+0000","last_clean":"2024-04-23T18:29:52.548106+0000","last_became_active":"2024-04-23T18:29:19.518744+0000","last_became_peered":"2024-04-23T18:29:19.518744+0000","last_unstale":"2024-04-23T18:29:52.548106+0000","last_undegraded":"2024-04-23T18:29:52.548106+0000","last_fullsized":"2024-04-23T18:29:52.548106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:05:47.618962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.756328+0000","last_change":"2024-04-23T18:29:21.533685+0000","last_active":"2024-04-23T18:29:53.756328+0000","last_peered":"2024-04-23T18:29:53.756328+0000","last_clean":"2024-04-23T18:29:53.756328+0000","last_became_active":"2024-04-23T18:29:21.533358+0000","last_became_peered":"2024-04-23T18:29:21.533358+0000","last_unstale":"2024-04-23T18:29:53.756328+0000","last_undegraded":"2024-04-23T18:29:53.756328+0000","last_fullsized":"2024-04-23T18:29:53.756328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:52.473352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136286+0000","last_change":"2024-04-23T18:29:13.493749+0000","last_active":"2024-04-23T18:32:21.136286+0000","last_peered":"2024-04-23T18:32:21.136286+0000","last_clean":"2024-04-23T18:32:21.136286+0000","last_became_active":"2024-04-23T18:29:13.493321+0000","last_became_peered":"2024-04-23T18:29:13.493321+0000","last_unstale":"2024-04-23T18:32:21.136286+0000","last_undegraded":"2024-04-23T18:32:21.136286+0000","last_fullsized":"2024-04-23T18:32:21.136286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:42:30.926554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548411+0000","last_change":"2024-04-23T18:29:03.446774+0000","last_active":"2024-04-23T18:29:52.548411+0000","last_peered":"2024-04-23T18:29:52.548411+0000","last_clean":"2024-04-23T18:29:52.548411+0000","last_became_active":"2024-04-23T18:29:03.446457+0000","last_became_peered":"2024-04-23T18:29:03.446457+0000","last_unstale":"2024-04-23T18:29:52.548411+0000","last_undegraded":"2024-04-23T18:29:52.548411+0000","last_fullsized":"2024-04-23T18:29:52.548411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:14.074221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.863350+0000","last_change":"2024-04-23T18:29:11.483348+0000","last_active":"2024-04-23T18:32:20.863350+0000","last_peered":"2024-04-23T18:32:20.863350+0000","last_clean":"2024-04-23T18:32:20.863350+0000","last_became_active":"2024-04-23T18:29:11.482896+0000","last_became_peered":"2024-04-23T18:29:11.482896+0000","last_unstale":"2024-04-23T18:32:20.863350+0000","last_undegraded":"2024-04-23T18:32:20.863350+0000","last_fullsized":"2024-04-23T18:32:20.863350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:53.629794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548218+0000","last_change":"2024-04-23T18:29:15.507664+0000","last_active":"2024-04-23T18:29:52.548218+0000","last_peered":"2024-04-23T18:29:52.548218+0000","last_clean":"2024-04-23T18:29:52.548218+0000","last_became_active":"2024-04-23T18:29:15.507357+0000","last_became_peered":"2024-04-23T18:29:15.507357+0000","last_unstale":"2024-04-23T18:29:52.548218+0000","last_undegraded":"2024-04-23T18:29:52.548218+0000","last_fullsized":"2024-04-23T18:29:52.548218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:47.440112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.560727+0000","last_change":"2024-04-23T18:29:17.514159+0000","last_active":"2024-04-23T18:32:20.560727+0000","last_peered":"2024-04-23T18:32:20.560727+0000","last_clean":"2024-04-23T18:32:20.560727+0000","last_became_active":"2024-04-23T18:29:17.513393+0000","last_became_peered":"2024-04-23T18:29:17.513393+0000","last_unstale":"2024-04-23T18:32:20.560727+0000","last_undegraded":"2024-04-23T18:32:20.560727+0000","last_fullsized":"2024-04-23T18:32:20.560727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:46:31.465490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551911+0000","last_change":"2024-04-23T18:29:19.523513+0000","last_active":"2024-04-23T18:29:52.551911+0000","last_peered":"2024-04-23T18:29:52.551911+0000","last_clean":"2024-04-23T18:29:52.551911+0000","last_became_active":"2024-04-23T18:29:19.523070+0000","last_became_peered":"2024-04-23T18:29:19.523070+0000","last_unstale":"2024-04-23T18:29:52.551911+0000","last_undegraded":"2024-04-23T18:29:52.551911+0000","last_fullsized":"2024-04-23T18:29:52.551911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:53.579124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.926481+0000","last_change":"2024-04-23T18:29:21.529180+0000","last_active":"2024-04-23T18:32:20.926481+0000","last_peered":"2024-04-23T18:32:20.926481+0000","last_clean":"2024-04-23T18:32:20.926481+0000","last_became_active":"2024-04-23T18:29:21.528764+0000","last_became_peered":"2024-04-23T18:29:21.528764+0000","last_unstale":"2024-04-23T18:32:20.926481+0000","last_undegraded":"2024-04-23T18:32:20.926481+0000","last_fullsized":"2024-04-23T18:32:20.926481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:15:30.851670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546769+0000","last_change":"2024-04-23T18:29:13.507864+0000","last_active":"2024-04-23T18:29:52.546769+0000","last_peered":"2024-04-23T18:29:52.546769+0000","last_clean":"2024-04-23T18:29:52.546769+0000","last_became_active":"2024-04-23T18:29:13.507496+0000","last_became_peered":"2024-04-23T18:29:13.507496+0000","last_unstale":"2024-04-23T18:29:52.546769+0000","last_undegraded":"2024-04-23T18:29:52.546769+0000","last_fullsized":"2024-04-23T18:29:52.546769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:36.947062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541796+0000","last_change":"2024-04-23T18:29:11.483379+0000","last_active":"2024-04-23T18:29:52.541796+0000","last_peered":"2024-04-23T18:29:52.541796+0000","last_clean":"2024-04-23T18:29:52.541796+0000","last_became_active":"2024-04-23T18:29:11.482348+0000","last_became_peered":"2024-04-23T18:29:11.482348+0000","last_unstale":"2024-04-23T18:29:52.541796+0000","last_undegraded":"2024-04-23T18:29:52.541796+0000","last_fullsized":"2024-04-23T18:29:52.541796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:47:48.291376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547947+0000","last_change":"2024-04-23T18:29:03.446643+0000","last_active":"2024-04-23T18:29:52.547947+0000","last_peered":"2024-04-23T18:29:52.547947+0000","last_clean":"2024-04-23T18:29:52.547947+0000","last_became_active":"2024-04-23T18:29:03.446286+0000","last_became_peered":"2024-04-23T18:29:03.446286+0000","last_unstale":"2024-04-23T18:29:52.547947+0000","last_undegraded":"2024-04-23T18:29:52.547947+0000","last_fullsized":"2024-04-23T18:29:52.547947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:42.594846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:56.764032+0000","last_change":"2024-04-23T18:29:52.554181+0000","last_active":"2024-04-23T18:31:56.764032+0000","last_peered":"2024-04-23T18:31:56.764032+0000","last_clean":"2024-04-23T18:31:56.764032+0000","last_became_active":"2024-04-23T18:29:52.553851+0000","last_became_peered":"2024-04-23T18:29:52.553851+0000","last_unstale":"2024-04-23T18:31:56.764032+0000","last_undegraded":"2024-04-23T18:31:56.764032+0000","last_fullsized":"2024-04-23T18:31:56.764032+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:05.187203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'61","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756499+0000","last_change":"2024-04-23T18:29:17.513936+0000","last_active":"2024-04-23T18:31:19.756499+0000","last_peered":"2024-04-23T18:31:19.756499+0000","last_clean":"2024-04-23T18:31:19.756499+0000","last_became_active":"2024-04-23T18:29:17.513599+0000","last_became_peered":"2024-04-23T18:29:17.513599+0000","last_unstale":"2024-04-23T18:31:19.756499+0000","last_undegraded":"2024-04-23T18:31:19.756499+0000","last_fullsized":"2024-04-23T18:31:19.756499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:56:07.867139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541648+0000","last_change":"2024-04-23T18:29:19.526480+0000","last_active":"2024-04-23T18:29:52.541648+0000","last_peered":"2024-04-23T18:29:52.541648+0000","last_clean":"2024-04-23T18:29:52.541648+0000","last_became_active":"2024-04-23T18:29:19.526192+0000","last_became_peered":"2024-04-23T18:29:19.526192+0000","last_unstale":"2024-04-23T18:29:52.541648+0000","last_undegraded":"2024-04-23T18:29:52.541648+0000","last_fullsized":"2024-04-23T18:29:52.541648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:36:56.457757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.486845+0000","last_change":"2024-04-23T18:29:21.533405+0000","last_active":"2024-04-23T18:31:20.486845+0000","last_peered":"2024-04-23T18:31:20.486845+0000","last_clean":"2024-04-23T18:31:20.486845+0000","last_became_active":"2024-04-23T18:29:21.533202+0000","last_became_peered":"2024-04-23T18:29:21.533202+0000","last_unstale":"2024-04-23T18:31:20.486845+0000","last_undegraded":"2024-04-23T18:31:20.486845+0000","last_fullsized":"2024-04-23T18:31:20.486845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:54:11.716719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":32,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'1","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.759332+0000","last_change":"2024-04-23T18:29:13.507056+0000","last_active":"2024-04-23T18:31:21.759332+0000","last_peered":"2024-04-23T18:31:21.759332+0000","last_clean":"2024-04-23T18:31:21.759332+0000","last_became_active":"2024-04-23T18:29:13.506795+0000","last_became_peered":"2024-04-23T18:29:13.506795+0000","last_unstale":"2024-04-23T18:31:21.759332+0000","last_undegraded":"2024-04-23T18:31:21.759332+0000","last_fullsized":"2024-04-23T18:31:21.759332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:39.344472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548249+0000","last_change":"2024-04-23T18:29:11.492325+0000","last_active":"2024-04-23T18:29:52.548249+0000","last_peered":"2024-04-23T18:29:52.548249+0000","last_clean":"2024-04-23T18:29:52.548249+0000","last_became_active":"2024-04-23T18:29:11.491882+0000","last_became_peered":"2024-04-23T18:29:11.491882+0000","last_unstale":"2024-04-23T18:29:52.548249+0000","last_undegraded":"2024-04-23T18:29:52.548249+0000","last_fullsized":"2024-04-23T18:29:52.548249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:32:57.364121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552526+0000","last_change":"2024-04-23T18:29:03.447598+0000","last_active":"2024-04-23T18:29:52.552526+0000","last_peered":"2024-04-23T18:29:52.552526+0000","last_clean":"2024-04-23T18:29:52.552526+0000","last_became_active":"2024-04-23T18:29:03.447265+0000","last_became_peered":"2024-04-23T18:29:03.447265+0000","last_unstale":"2024-04-23T18:29:52.552526+0000","last_undegraded":"2024-04-23T18:29:52.552526+0000","last_fullsized":"2024-04-23T18:29:52.552526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:56.204409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548211+0000","last_change":"2024-04-23T18:29:15.506698+0000","last_active":"2024-04-23T18:29:52.548211+0000","last_peered":"2024-04-23T18:29:52.548211+0000","last_clean":"2024-04-23T18:29:52.548211+0000","last_became_active":"2024-04-23T18:29:15.506394+0000","last_became_peered":"2024-04-23T18:29:15.506394+0000","last_unstale":"2024-04-23T18:29:52.548211+0000","last_undegraded":"2024-04-23T18:29:52.548211+0000","last_fullsized":"2024-04-23T18:29:52.548211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:21.696617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543554+0000","last_change":"2024-04-23T18:29:17.515730+0000","last_active":"2024-04-23T18:29:52.543554+0000","last_peered":"2024-04-23T18:29:52.543554+0000","last_clean":"2024-04-23T18:29:52.543554+0000","last_became_active":"2024-04-23T18:29:17.515048+0000","last_became_peered":"2024-04-23T18:29:17.515048+0000","last_unstale":"2024-04-23T18:29:52.543554+0000","last_undegraded":"2024-04-23T18:29:52.543554+0000","last_fullsized":"2024-04-23T18:29:52.543554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:23.680483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":369,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585547+0000","last_change":"2024-04-23T18:29:19.518964+0000","last_active":"2024-04-23T18:32:20.585547+0000","last_peered":"2024-04-23T18:32:20.585547+0000","last_clean":"2024-04-23T18:32:20.585547+0000","last_became_active":"2024-04-23T18:29:19.518668+0000","last_became_peered":"2024-04-23T18:29:19.518668+0000","last_unstale":"2024-04-23T18:32:20.585547+0000","last_undegraded":"2024-04-23T18:32:20.585547+0000","last_fullsized":"2024-04-23T18:32:20.585547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:07.298508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.170755+0000","last_change":"2024-04-23T18:29:21.531478+0000","last_active":"2024-04-23T18:32:21.170755+0000","last_peered":"2024-04-23T18:32:21.170755+0000","last_clean":"2024-04-23T18:32:21.170755+0000","last_became_active":"2024-04-23T18:29:21.531185+0000","last_became_peered":"2024-04-23T18:29:21.531185+0000","last_unstale":"2024-04-23T18:32:21.170755+0000","last_undegraded":"2024-04-23T18:32:21.170755+0000","last_fullsized":"2024-04-23T18:32:21.170755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:10.167276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.538256+0000","last_change":"2024-04-23T18:29:13.504754+0000","last_active":"2024-04-23T18:31:20.538256+0000","last_peered":"2024-04-23T18:31:20.538256+0000","last_clean":"2024-04-23T18:31:20.538256+0000","last_became_active":"2024-04-23T18:29:13.503543+0000","last_became_peered":"2024-04-23T18:29:13.503543+0000","last_unstale":"2024-04-23T18:31:20.538256+0000","last_undegraded":"2024-04-23T18:31:20.538256+0000","last_fullsized":"2024-04-23T18:31:20.538256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:55:58.292535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760523+0000","last_change":"2024-04-23T18:29:11.505973+0000","last_active":"2024-04-23T18:31:21.760523+0000","last_peered":"2024-04-23T18:31:21.760523+0000","last_clean":"2024-04-23T18:31:21.760523+0000","last_became_active":"2024-04-23T18:29:11.505604+0000","last_became_peered":"2024-04-23T18:29:11.505604+0000","last_unstale":"2024-04-23T18:31:21.760523+0000","last_undegraded":"2024-04-23T18:31:21.760523+0000","last_fullsized":"2024-04-23T18:31:21.760523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:26.018597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548860+0000","last_change":"2024-04-23T18:29:03.446013+0000","last_active":"2024-04-23T18:29:52.548860+0000","last_peered":"2024-04-23T18:29:52.548860+0000","last_clean":"2024-04-23T18:29:52.548860+0000","last_became_active":"2024-04-23T18:29:03.445715+0000","last_became_peered":"2024-04-23T18:29:03.445715+0000","last_unstale":"2024-04-23T18:29:52.548860+0000","last_undegraded":"2024-04-23T18:29:52.548860+0000","last_fullsized":"2024-04-23T18:29:52.548860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:39.084066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.550999+0000","last_change":"2024-04-23T18:29:15.511864+0000","last_active":"2024-04-23T18:29:52.550999+0000","last_peered":"2024-04-23T18:29:52.550999+0000","last_clean":"2024-04-23T18:29:52.550999+0000","last_became_active":"2024-04-23T18:29:15.511553+0000","last_became_peered":"2024-04-23T18:29:15.511553+0000","last_unstale":"2024-04-23T18:29:52.550999+0000","last_undegraded":"2024-04-23T18:29:52.550999+0000","last_fullsized":"2024-04-23T18:29:52.550999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:20.797539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760395+0000","last_change":"2024-04-23T18:29:17.516388+0000","last_active":"2024-04-23T18:31:21.760395+0000","last_peered":"2024-04-23T18:31:21.760395+0000","last_clean":"2024-04-23T18:31:21.760395+0000","last_became_active":"2024-04-23T18:29:17.515741+0000","last_became_peered":"2024-04-23T18:29:17.515741+0000","last_unstale":"2024-04-23T18:31:21.760395+0000","last_undegraded":"2024-04-23T18:31:21.760395+0000","last_fullsized":"2024-04-23T18:31:21.760395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:57.339089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":399,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.326707+0000","last_change":"2024-04-23T18:29:19.526580+0000","last_active":"2024-04-23T18:32:21.326707+0000","last_peered":"2024-04-23T18:32:21.326707+0000","last_clean":"2024-04-23T18:32:21.326707+0000","last_became_active":"2024-04-23T18:29:19.526375+0000","last_became_peered":"2024-04-23T18:29:19.526375+0000","last_unstale":"2024-04-23T18:32:21.326707+0000","last_undegraded":"2024-04-23T18:32:21.326707+0000","last_fullsized":"2024-04-23T18:32:21.326707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:22.422967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.097904+0000","last_change":"2024-04-23T18:29:21.531204+0000","last_active":"2024-04-23T18:29:54.097904+0000","last_peered":"2024-04-23T18:29:54.097904+0000","last_clean":"2024-04-23T18:29:54.097904+0000","last_became_active":"2024-04-23T18:29:21.530911+0000","last_became_peered":"2024-04-23T18:29:21.530911+0000","last_unstale":"2024-04-23T18:29:54.097904+0000","last_undegraded":"2024-04-23T18:29:54.097904+0000","last_fullsized":"2024-04-23T18:29:54.097904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:38:26.331563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'16","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998529+0000","last_change":"2024-04-23T18:29:13.499873+0000","last_active":"2024-04-23T18:32:20.998529+0000","last_peered":"2024-04-23T18:32:20.998529+0000","last_clean":"2024-04-23T18:32:20.998529+0000","last_became_active":"2024-04-23T18:29:13.499603+0000","last_became_peered":"2024-04-23T18:29:13.499603+0000","last_unstale":"2024-04-23T18:32:20.998529+0000","last_undegraded":"2024-04-23T18:32:20.998529+0000","last_fullsized":"2024-04-23T18:32:20.998529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:17.317212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547877+0000","last_change":"2024-04-23T18:29:11.488874+0000","last_active":"2024-04-23T18:29:52.547877+0000","last_peered":"2024-04-23T18:29:52.547877+0000","last_clean":"2024-04-23T18:29:52.547877+0000","last_became_active":"2024-04-23T18:29:11.488500+0000","last_became_peered":"2024-04-23T18:29:11.488500+0000","last_unstale":"2024-04-23T18:29:52.547877+0000","last_undegraded":"2024-04-23T18:29:52.547877+0000","last_fullsized":"2024-04-23T18:29:52.547877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:52.597685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552056+0000","last_change":"2024-04-23T18:29:03.594008+0000","last_active":"2024-04-23T18:29:52.552056+0000","last_peered":"2024-04-23T18:29:52.552056+0000","last_clean":"2024-04-23T18:29:52.552056+0000","last_became_active":"2024-04-23T18:29:03.593691+0000","last_became_peered":"2024-04-23T18:29:03.593691+0000","last_unstale":"2024-04-23T18:29:52.552056+0000","last_undegraded":"2024-04-23T18:29:52.552056+0000","last_fullsized":"2024-04-23T18:29:52.552056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:18:59.128475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549901+0000","last_change":"2024-04-23T18:29:15.513067+0000","last_active":"2024-04-23T18:29:52.549901+0000","last_peered":"2024-04-23T18:29:52.549901+0000","last_clean":"2024-04-23T18:29:52.549901+0000","last_became_active":"2024-04-23T18:29:15.511207+0000","last_became_peered":"2024-04-23T18:29:15.511207+0000","last_unstale":"2024-04-23T18:29:52.549901+0000","last_undegraded":"2024-04-23T18:29:52.549901+0000","last_fullsized":"2024-04-23T18:29:52.549901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:23.658875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.036554+0000","last_change":"2024-04-23T18:29:17.515549+0000","last_active":"2024-04-23T18:31:19.036554+0000","last_peered":"2024-04-23T18:31:19.036554+0000","last_clean":"2024-04-23T18:31:19.036554+0000","last_became_active":"2024-04-23T18:29:17.515004+0000","last_became_peered":"2024-04-23T18:29:17.515004+0000","last_unstale":"2024-04-23T18:31:19.036554+0000","last_undegraded":"2024-04-23T18:31:19.036554+0000","last_fullsized":"2024-04-23T18:31:19.036554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:36.940155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547648+0000","last_change":"2024-04-23T18:29:19.518175+0000","last_active":"2024-04-23T18:29:52.547648+0000","last_peered":"2024-04-23T18:29:52.547648+0000","last_clean":"2024-04-23T18:29:52.547648+0000","last_became_active":"2024-04-23T18:29:19.517903+0000","last_became_peered":"2024-04-23T18:29:19.517903+0000","last_unstale":"2024-04-23T18:29:52.547648+0000","last_undegraded":"2024-04-23T18:29:52.547648+0000","last_fullsized":"2024-04-23T18:29:52.547648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:49:59.234459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.612385+0000","last_change":"2024-04-23T18:29:21.531285+0000","last_active":"2024-04-23T18:30:36.612385+0000","last_peered":"2024-04-23T18:30:36.612385+0000","last_clean":"2024-04-23T18:30:36.612385+0000","last_became_active":"2024-04-23T18:29:21.530980+0000","last_became_peered":"2024-04-23T18:29:21.530980+0000","last_unstale":"2024-04-23T18:30:36.612385+0000","last_undegraded":"2024-04-23T18:30:36.612385+0000","last_fullsized":"2024-04-23T18:30:36.612385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:04.723674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542703+0000","last_change":"2024-04-23T18:29:21.534750+0000","last_active":"2024-04-23T18:29:52.542703+0000","last_peered":"2024-04-23T18:29:52.542703+0000","last_clean":"2024-04-23T18:29:52.542703+0000","last_became_active":"2024-04-23T18:29:21.534461+0000","last_became_peered":"2024-04-23T18:29:21.534461+0000","last_unstale":"2024-04-23T18:29:52.542703+0000","last_undegraded":"2024-04-23T18:29:52.542703+0000","last_fullsized":"2024-04-23T18:29:52.542703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:35:55.703412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.910166+0000","last_change":"2024-04-23T18:29:13.504381+0000","last_active":"2024-04-23T18:32:20.910166+0000","last_peered":"2024-04-23T18:32:20.910166+0000","last_clean":"2024-04-23T18:32:20.910166+0000","last_became_active":"2024-04-23T18:29:13.504092+0000","last_became_peered":"2024-04-23T18:29:13.504092+0000","last_unstale":"2024-04-23T18:32:20.910166+0000","last_undegraded":"2024-04-23T18:32:20.910166+0000","last_fullsized":"2024-04-23T18:32:20.910166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:28.289132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.550679+0000","last_change":"2024-04-23T18:29:11.511197+0000","last_active":"2024-04-23T18:29:52.550679+0000","last_peered":"2024-04-23T18:29:52.550679+0000","last_clean":"2024-04-23T18:29:52.550679+0000","last_became_active":"2024-04-23T18:29:11.510456+0000","last_became_peered":"2024-04-23T18:29:11.510456+0000","last_unstale":"2024-04-23T18:29:52.550679+0000","last_undegraded":"2024-04-23T18:29:52.550679+0000","last_fullsized":"2024-04-23T18:29:52.550679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:15.310210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.545740+0000","last_change":"2024-04-23T18:29:15.507536+0000","last_active":"2024-04-23T18:29:52.545740+0000","last_peered":"2024-04-23T18:29:52.545740+0000","last_clean":"2024-04-23T18:29:52.545740+0000","last_became_active":"2024-04-23T18:29:15.506939+0000","last_became_peered":"2024-04-23T18:29:15.506939+0000","last_unstale":"2024-04-23T18:29:52.545740+0000","last_undegraded":"2024-04-23T18:29:52.545740+0000","last_fullsized":"2024-04-23T18:29:52.545740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:33.128258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.042869+0000","last_change":"2024-04-23T18:29:17.511932+0000","last_active":"2024-04-23T18:31:19.042869+0000","last_peered":"2024-04-23T18:31:19.042869+0000","last_clean":"2024-04-23T18:31:19.042869+0000","last_became_active":"2024-04-23T18:29:17.511559+0000","last_became_peered":"2024-04-23T18:29:17.511559+0000","last_unstale":"2024-04-23T18:31:19.042869+0000","last_undegraded":"2024-04-23T18:31:19.042869+0000","last_fullsized":"2024-04-23T18:31:19.042869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:32:09.008618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549463+0000","last_change":"2024-04-23T18:29:19.525590+0000","last_active":"2024-04-23T18:29:52.549463+0000","last_peered":"2024-04-23T18:29:52.549463+0000","last_clean":"2024-04-23T18:29:52.549463+0000","last_became_active":"2024-04-23T18:29:19.525302+0000","last_became_peered":"2024-04-23T18:29:19.525302+0000","last_unstale":"2024-04-23T18:29:52.549463+0000","last_undegraded":"2024-04-23T18:29:52.549463+0000","last_fullsized":"2024-04-23T18:29:52.549463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:57.944932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:18.716199+0000","last_change":"2024-04-23T18:29:21.530275+0000","last_active":"2024-04-23T18:31:18.716199+0000","last_peered":"2024-04-23T18:31:18.716199+0000","last_clean":"2024-04-23T18:31:18.716199+0000","last_became_active":"2024-04-23T18:29:21.530013+0000","last_became_peered":"2024-04-23T18:29:21.530013+0000","last_unstale":"2024-04-23T18:31:18.716199+0000","last_undegraded":"2024-04-23T18:31:18.716199+0000","last_fullsized":"2024-04-23T18:31:18.716199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:53.670984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544156+0000","last_change":"2024-04-23T18:29:13.506992+0000","last_active":"2024-04-23T18:29:52.544156+0000","last_peered":"2024-04-23T18:29:52.544156+0000","last_clean":"2024-04-23T18:29:52.544156+0000","last_became_active":"2024-04-23T18:29:13.506770+0000","last_became_peered":"2024-04-23T18:29:13.506770+0000","last_unstale":"2024-04-23T18:29:52.544156+0000","last_undegraded":"2024-04-23T18:29:52.544156+0000","last_fullsized":"2024-04-23T18:29:52.544156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:31:14.220069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.130507+0000","last_change":"2024-04-23T18:29:11.482617+0000","last_active":"2024-04-23T18:32:21.130507+0000","last_peered":"2024-04-23T18:32:21.130507+0000","last_clean":"2024-04-23T18:32:21.130507+0000","last_became_active":"2024-04-23T18:29:11.481884+0000","last_became_peered":"2024-04-23T18:29:11.481884+0000","last_unstale":"2024-04-23T18:32:21.130507+0000","last_undegraded":"2024-04-23T18:32:21.130507+0000","last_fullsized":"2024-04-23T18:32:21.130507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:08:38.534696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549279+0000","last_change":"2024-04-23T18:29:15.508345+0000","last_active":"2024-04-23T18:29:52.549279+0000","last_peered":"2024-04-23T18:29:52.549279+0000","last_clean":"2024-04-23T18:29:52.549279+0000","last_became_active":"2024-04-23T18:29:15.508018+0000","last_became_peered":"2024-04-23T18:29:15.508018+0000","last_unstale":"2024-04-23T18:29:52.549279+0000","last_undegraded":"2024-04-23T18:29:52.549279+0000","last_fullsized":"2024-04-23T18:29:52.549279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:44:46.349637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.565238+0000","last_change":"2024-04-23T18:29:17.515180+0000","last_active":"2024-04-23T18:32:20.565238+0000","last_peered":"2024-04-23T18:32:20.565238+0000","last_clean":"2024-04-23T18:32:20.565238+0000","last_became_active":"2024-04-23T18:29:17.514836+0000","last_became_peered":"2024-04-23T18:29:17.514836+0000","last_unstale":"2024-04-23T18:32:20.565238+0000","last_undegraded":"2024-04-23T18:32:20.565238+0000","last_fullsized":"2024-04-23T18:32:20.565238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:18.629550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541082+0000","last_change":"2024-04-23T18:29:19.527752+0000","last_active":"2024-04-23T18:29:52.541082+0000","last_peered":"2024-04-23T18:29:52.541082+0000","last_clean":"2024-04-23T18:29:52.541082+0000","last_became_active":"2024-04-23T18:29:19.527461+0000","last_became_peered":"2024-04-23T18:29:19.527461+0000","last_unstale":"2024-04-23T18:29:52.541082+0000","last_undegraded":"2024-04-23T18:29:52.541082+0000","last_fullsized":"2024-04-23T18:29:52.541082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:55.806105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547711+0000","last_change":"2024-04-23T18:29:21.529099+0000","last_active":"2024-04-23T18:29:52.547711+0000","last_peered":"2024-04-23T18:29:52.547711+0000","last_clean":"2024-04-23T18:29:52.547711+0000","last_became_active":"2024-04-23T18:29:21.528772+0000","last_became_peered":"2024-04-23T18:29:21.528772+0000","last_unstale":"2024-04-23T18:29:52.547711+0000","last_undegraded":"2024-04-23T18:29:52.547711+0000","last_fullsized":"2024-04-23T18:29:52.547711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:58.849572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.758624+0000","last_change":"2024-04-23T18:29:13.503536+0000","last_active":"2024-04-23T18:29:53.758624+0000","last_peered":"2024-04-23T18:29:53.758624+0000","last_clean":"2024-04-23T18:29:53.758624+0000","last_became_active":"2024-04-23T18:29:13.502849+0000","last_became_peered":"2024-04-23T18:29:13.502849+0000","last_unstale":"2024-04-23T18:29:53.758624+0000","last_undegraded":"2024-04-23T18:29:53.758624+0000","last_fullsized":"2024-04-23T18:29:53.758624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:27.393642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761184+0000","last_change":"2024-04-23T18:29:11.485392+0000","last_active":"2024-04-23T18:31:36.761184+0000","last_peered":"2024-04-23T18:31:36.761184+0000","last_clean":"2024-04-23T18:31:36.761184+0000","last_became_active":"2024-04-23T18:29:11.483628+0000","last_became_peered":"2024-04-23T18:29:11.483628+0000","last_unstale":"2024-04-23T18:31:36.761184+0000","last_undegraded":"2024-04-23T18:31:36.761184+0000","last_fullsized":"2024-04-23T18:31:36.761184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:50.092624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541320+0000","last_change":"2024-04-23T18:29:15.510472+0000","last_active":"2024-04-23T18:29:52.541320+0000","last_peered":"2024-04-23T18:29:52.541320+0000","last_clean":"2024-04-23T18:29:52.541320+0000","last_became_active":"2024-04-23T18:29:15.510130+0000","last_became_peered":"2024-04-23T18:29:15.510130+0000","last_unstale":"2024-04-23T18:29:52.541320+0000","last_undegraded":"2024-04-23T18:29:52.541320+0000","last_fullsized":"2024-04-23T18:29:52.541320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:21.124426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'41","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.618994+0000","last_change":"2024-04-23T18:29:17.510778+0000","last_active":"2024-04-23T18:32:20.618994+0000","last_peered":"2024-04-23T18:32:20.618994+0000","last_clean":"2024-04-23T18:32:20.618994+0000","last_became_active":"2024-04-23T18:29:17.510429+0000","last_became_peered":"2024-04-23T18:29:17.510429+0000","last_unstale":"2024-04-23T18:32:20.618994+0000","last_undegraded":"2024-04-23T18:32:20.618994+0000","last_fullsized":"2024-04-23T18:32:20.618994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:55.966235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543935+0000","last_change":"2024-04-23T18:29:19.519077+0000","last_active":"2024-04-23T18:29:52.543935+0000","last_peered":"2024-04-23T18:29:52.543935+0000","last_clean":"2024-04-23T18:29:52.543935+0000","last_became_active":"2024-04-23T18:29:19.518543+0000","last_became_peered":"2024-04-23T18:29:19.518543+0000","last_unstale":"2024-04-23T18:29:52.543935+0000","last_undegraded":"2024-04-23T18:29:52.543935+0000","last_fullsized":"2024-04-23T18:29:52.543935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:35:53.694069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551260+0000","last_change":"2024-04-23T18:29:21.534350+0000","last_active":"2024-04-23T18:29:52.551260+0000","last_peered":"2024-04-23T18:29:52.551260+0000","last_clean":"2024-04-23T18:29:52.551260+0000","last_became_active":"2024-04-23T18:29:21.534023+0000","last_became_peered":"2024-04-23T18:29:21.534023+0000","last_unstale":"2024-04-23T18:29:52.551260+0000","last_undegraded":"2024-04-23T18:29:52.551260+0000","last_fullsized":"2024-04-23T18:29:52.551260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:14:43.043132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'19","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762471+0000","last_change":"2024-04-23T18:29:13.501148+0000","last_active":"2024-04-23T18:31:36.762471+0000","last_peered":"2024-04-23T18:31:36.762471+0000","last_clean":"2024-04-23T18:31:36.762471+0000","last_became_active":"2024-04-23T18:29:13.500877+0000","last_became_peered":"2024-04-23T18:29:13.500877+0000","last_unstale":"2024-04-23T18:31:36.762471+0000","last_undegraded":"2024-04-23T18:31:36.762471+0000","last_fullsized":"2024-04-23T18:31:36.762471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:29:12.567941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":53,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.302552+0000","last_change":"2024-04-23T18:29:11.498275+0000","last_active":"2024-04-23T18:29:54.302552+0000","last_peered":"2024-04-23T18:29:54.302552+0000","last_clean":"2024-04-23T18:29:54.302552+0000","last_became_active":"2024-04-23T18:29:11.497953+0000","last_became_peered":"2024-04-23T18:29:11.497953+0000","last_unstale":"2024-04-23T18:29:54.302552+0000","last_undegraded":"2024-04-23T18:29:54.302552+0000","last_fullsized":"2024-04-23T18:29:54.302552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:39:13.562652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549826+0000","last_change":"2024-04-23T18:29:15.507545+0000","last_active":"2024-04-23T18:29:52.549826+0000","last_peered":"2024-04-23T18:29:52.549826+0000","last_clean":"2024-04-23T18:29:52.549826+0000","last_became_active":"2024-04-23T18:29:15.507253+0000","last_became_peered":"2024-04-23T18:29:15.507253+0000","last_unstale":"2024-04-23T18:29:52.549826+0000","last_undegraded":"2024-04-23T18:29:52.549826+0000","last_fullsized":"2024-04-23T18:29:52.549826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:24.598564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.028065+0000","last_change":"2024-04-23T18:29:17.514117+0000","last_active":"2024-04-23T18:31:19.028065+0000","last_peered":"2024-04-23T18:31:19.028065+0000","last_clean":"2024-04-23T18:31:19.028065+0000","last_became_active":"2024-04-23T18:29:17.512820+0000","last_became_peered":"2024-04-23T18:29:17.512820+0000","last_unstale":"2024-04-23T18:31:19.028065+0000","last_undegraded":"2024-04-23T18:31:19.028065+0000","last_fullsized":"2024-04-23T18:31:19.028065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:05.590357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541424+0000","last_change":"2024-04-23T18:29:19.525834+0000","last_active":"2024-04-23T18:29:52.541424+0000","last_peered":"2024-04-23T18:29:52.541424+0000","last_clean":"2024-04-23T18:29:52.541424+0000","last_became_active":"2024-04-23T18:29:19.525424+0000","last_became_peered":"2024-04-23T18:29:19.525424+0000","last_unstale":"2024-04-23T18:29:52.541424+0000","last_undegraded":"2024-04-23T18:29:52.541424+0000","last_fullsized":"2024-04-23T18:29:52.541424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:52.622390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.183703+0000","last_change":"2024-04-23T18:29:13.496471+0000","last_active":"2024-04-23T18:32:21.183703+0000","last_peered":"2024-04-23T18:32:21.183703+0000","last_clean":"2024-04-23T18:32:21.183703+0000","last_became_active":"2024-04-23T18:29:13.496179+0000","last_became_peered":"2024-04-23T18:29:13.496179+0000","last_unstale":"2024-04-23T18:32:21.183703+0000","last_undegraded":"2024-04-23T18:32:21.183703+0000","last_fullsized":"2024-04-23T18:32:21.183703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:31.148672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547581+0000","last_change":"2024-04-23T18:29:11.500546+0000","last_active":"2024-04-23T18:29:52.547581+0000","last_peered":"2024-04-23T18:29:52.547581+0000","last_clean":"2024-04-23T18:29:52.547581+0000","last_became_active":"2024-04-23T18:29:11.500118+0000","last_became_peered":"2024-04-23T18:29:11.500118+0000","last_unstale":"2024-04-23T18:29:52.547581+0000","last_undegraded":"2024-04-23T18:29:52.547581+0000","last_fullsized":"2024-04-23T18:29:52.547581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:46.386426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549417+0000","last_change":"2024-04-23T18:29:15.506605+0000","last_active":"2024-04-23T18:29:52.549417+0000","last_peered":"2024-04-23T18:29:52.549417+0000","last_clean":"2024-04-23T18:29:52.549417+0000","last_became_active":"2024-04-23T18:29:15.506197+0000","last_became_peered":"2024-04-23T18:29:15.506197+0000","last_unstale":"2024-04-23T18:29:52.549417+0000","last_undegraded":"2024-04-23T18:29:52.549417+0000","last_fullsized":"2024-04-23T18:29:52.549417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:23:51.396518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'57","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.049212+0000","last_change":"2024-04-23T18:29:17.515116+0000","last_active":"2024-04-23T18:31:19.049212+0000","last_peered":"2024-04-23T18:31:19.049212+0000","last_clean":"2024-04-23T18:31:19.049212+0000","last_became_active":"2024-04-23T18:29:17.514800+0000","last_became_peered":"2024-04-23T18:29:17.514800+0000","last_unstale":"2024-04-23T18:31:19.049212+0000","last_undegraded":"2024-04-23T18:31:19.049212+0000","last_fullsized":"2024-04-23T18:31:19.049212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:42.936606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542001+0000","last_change":"2024-04-23T18:29:19.524639+0000","last_active":"2024-04-23T18:29:52.542001+0000","last_peered":"2024-04-23T18:29:52.542001+0000","last_clean":"2024-04-23T18:29:52.542001+0000","last_became_active":"2024-04-23T18:29:19.524351+0000","last_became_peered":"2024-04-23T18:29:19.524351+0000","last_unstale":"2024-04-23T18:29:52.542001+0000","last_undegraded":"2024-04-23T18:29:52.542001+0000","last_fullsized":"2024-04-23T18:29:52.542001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:45.448270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.483433+0000","last_change":"2024-04-23T18:29:21.529140+0000","last_active":"2024-04-23T18:31:20.483433+0000","last_peered":"2024-04-23T18:31:20.483433+0000","last_clean":"2024-04-23T18:31:20.483433+0000","last_became_active":"2024-04-23T18:29:21.528819+0000","last_became_peered":"2024-04-23T18:29:21.528819+0000","last_unstale":"2024-04-23T18:31:20.483433+0000","last_undegraded":"2024-04-23T18:31:20.483433+0000","last_fullsized":"2024-04-23T18:31:20.483433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:12.967213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.809775+0000","last_change":"2024-04-23T18:29:13.499526+0000","last_active":"2024-04-23T18:29:54.809775+0000","last_peered":"2024-04-23T18:29:54.809775+0000","last_clean":"2024-04-23T18:29:54.809775+0000","last_became_active":"2024-04-23T18:29:13.499137+0000","last_became_peered":"2024-04-23T18:29:13.499137+0000","last_unstale":"2024-04-23T18:29:54.809775+0000","last_undegraded":"2024-04-23T18:29:54.809775+0000","last_fullsized":"2024-04-23T18:29:54.809775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:09:37.644601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543171+0000","last_change":"2024-04-23T18:29:11.500980+0000","last_active":"2024-04-23T18:29:52.543171+0000","last_peered":"2024-04-23T18:29:52.543171+0000","last_clean":"2024-04-23T18:29:52.543171+0000","last_became_active":"2024-04-23T18:29:11.500584+0000","last_became_peered":"2024-04-23T18:29:11.500584+0000","last_unstale":"2024-04-23T18:29:52.543171+0000","last_undegraded":"2024-04-23T18:29:52.543171+0000","last_fullsized":"2024-04-23T18:29:52.543171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:31.151193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544749+0000","last_change":"2024-04-23T18:29:15.503669+0000","last_active":"2024-04-23T18:29:52.544749+0000","last_peered":"2024-04-23T18:29:52.544749+0000","last_clean":"2024-04-23T18:29:52.544749+0000","last_became_active":"2024-04-23T18:29:15.503315+0000","last_became_peered":"2024-04-23T18:29:15.503315+0000","last_unstale":"2024-04-23T18:29:52.544749+0000","last_undegraded":"2024-04-23T18:29:52.544749+0000","last_fullsized":"2024-04-23T18:29:52.544749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:45.603211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.029019+0000","last_change":"2024-04-23T18:29:17.517217+0000","last_active":"2024-04-23T18:31:19.029019+0000","last_peered":"2024-04-23T18:31:19.029019+0000","last_clean":"2024-04-23T18:31:19.029019+0000","last_became_active":"2024-04-23T18:29:17.516934+0000","last_became_peered":"2024-04-23T18:29:17.516934+0000","last_unstale":"2024-04-23T18:31:19.029019+0000","last_undegraded":"2024-04-23T18:31:19.029019+0000","last_fullsized":"2024-04-23T18:31:19.029019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:47.490248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544700+0000","last_change":"2024-04-23T18:29:19.520167+0000","last_active":"2024-04-23T18:29:52.544700+0000","last_peered":"2024-04-23T18:29:52.544700+0000","last_clean":"2024-04-23T18:29:52.544700+0000","last_became_active":"2024-04-23T18:29:19.519854+0000","last_became_peered":"2024-04-23T18:29:19.519854+0000","last_unstale":"2024-04-23T18:29:52.544700+0000","last_undegraded":"2024-04-23T18:29:52.544700+0000","last_fullsized":"2024-04-23T18:29:52.544700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:49.515308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548061+0000","last_change":"2024-04-23T18:29:21.534768+0000","last_active":"2024-04-23T18:29:52.548061+0000","last_peered":"2024-04-23T18:29:52.548061+0000","last_clean":"2024-04-23T18:29:52.548061+0000","last_became_active":"2024-04-23T18:29:21.534487+0000","last_became_peered":"2024-04-23T18:29:21.534487+0000","last_unstale":"2024-04-23T18:29:52.548061+0000","last_undegraded":"2024-04-23T18:29:52.548061+0000","last_fullsized":"2024-04-23T18:29:52.548061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:32:46.393371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.901371+0000","last_change":"2024-04-23T18:29:13.503374+0000","last_active":"2024-04-23T18:32:20.901371+0000","last_peered":"2024-04-23T18:32:20.901371+0000","last_clean":"2024-04-23T18:32:20.901371+0000","last_became_active":"2024-04-23T18:29:13.502710+0000","last_became_peered":"2024-04-23T18:29:13.502710+0000","last_unstale":"2024-04-23T18:32:20.901371+0000","last_undegraded":"2024-04-23T18:32:20.901371+0000","last_fullsized":"2024-04-23T18:32:20.901371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:02.276254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544043+0000","last_change":"2024-04-23T18:29:11.498320+0000","last_active":"2024-04-23T18:29:52.544043+0000","last_peered":"2024-04-23T18:29:52.544043+0000","last_clean":"2024-04-23T18:29:52.544043+0000","last_became_active":"2024-04-23T18:29:11.497191+0000","last_became_peered":"2024-04-23T18:29:11.497191+0000","last_unstale":"2024-04-23T18:29:52.544043+0000","last_undegraded":"2024-04-23T18:29:52.544043+0000","last_fullsized":"2024-04-23T18:29:52.544043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:55.553919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543117+0000","last_change":"2024-04-23T18:29:15.502215+0000","last_active":"2024-04-23T18:29:52.543117+0000","last_peered":"2024-04-23T18:29:52.543117+0000","last_clean":"2024-04-23T18:29:52.543117+0000","last_became_active":"2024-04-23T18:29:15.501957+0000","last_became_peered":"2024-04-23T18:29:15.501957+0000","last_unstale":"2024-04-23T18:29:52.543117+0000","last_undegraded":"2024-04-23T18:29:52.543117+0000","last_fullsized":"2024-04-23T18:29:52.543117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:16:23.586603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.047239+0000","last_change":"2024-04-23T18:29:17.503422+0000","last_active":"2024-04-23T18:31:19.047239+0000","last_peered":"2024-04-23T18:31:19.047239+0000","last_clean":"2024-04-23T18:31:19.047239+0000","last_became_active":"2024-04-23T18:29:17.503196+0000","last_became_peered":"2024-04-23T18:29:17.503196+0000","last_unstale":"2024-04-23T18:31:19.047239+0000","last_undegraded":"2024-04-23T18:31:19.047239+0000","last_fullsized":"2024-04-23T18:31:19.047239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:30:37.507116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548417+0000","last_change":"2024-04-23T18:29:19.527985+0000","last_active":"2024-04-23T18:29:52.548417+0000","last_peered":"2024-04-23T18:29:52.548417+0000","last_clean":"2024-04-23T18:29:52.548417+0000","last_became_active":"2024-04-23T18:29:19.527687+0000","last_became_peered":"2024-04-23T18:29:19.527687+0000","last_unstale":"2024-04-23T18:29:52.548417+0000","last_undegraded":"2024-04-23T18:29:52.548417+0000","last_fullsized":"2024-04-23T18:29:52.548417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:54.022979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.542239+0000","last_change":"2024-04-23T18:29:21.534054+0000","last_active":"2024-04-23T18:31:20.542239+0000","last_peered":"2024-04-23T18:31:20.542239+0000","last_clean":"2024-04-23T18:31:20.542239+0000","last_became_active":"2024-04-23T18:29:21.533754+0000","last_became_peered":"2024-04-23T18:29:21.533754+0000","last_unstale":"2024-04-23T18:31:20.542239+0000","last_undegraded":"2024-04-23T18:31:20.542239+0000","last_fullsized":"2024-04-23T18:31:20.542239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:23.688720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.902182+0000","last_change":"2024-04-23T18:29:13.497462+0000","last_active":"2024-04-23T18:32:20.902182+0000","last_peered":"2024-04-23T18:32:20.902182+0000","last_clean":"2024-04-23T18:32:20.902182+0000","last_became_active":"2024-04-23T18:29:13.497121+0000","last_became_peered":"2024-04-23T18:29:13.497121+0000","last_unstale":"2024-04-23T18:32:20.902182+0000","last_undegraded":"2024-04-23T18:32:20.902182+0000","last_fullsized":"2024-04-23T18:32:20.902182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:19.423755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.207298+0000","last_change":"2024-04-23T18:29:11.504900+0000","last_active":"2024-04-23T18:29:53.207298+0000","last_peered":"2024-04-23T18:29:53.207298+0000","last_clean":"2024-04-23T18:29:53.207298+0000","last_became_active":"2024-04-23T18:29:11.504564+0000","last_became_peered":"2024-04-23T18:29:11.504564+0000","last_unstale":"2024-04-23T18:29:53.207298+0000","last_undegraded":"2024-04-23T18:29:53.207298+0000","last_fullsized":"2024-04-23T18:29:53.207298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:26.282130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547964+0000","last_change":"2024-04-23T18:29:15.506519+0000","last_active":"2024-04-23T18:29:52.547964+0000","last_peered":"2024-04-23T18:29:52.547964+0000","last_clean":"2024-04-23T18:29:52.547964+0000","last_became_active":"2024-04-23T18:29:15.506171+0000","last_became_peered":"2024-04-23T18:29:15.506171+0000","last_unstale":"2024-04-23T18:29:52.547964+0000","last_undegraded":"2024-04-23T18:29:52.547964+0000","last_fullsized":"2024-04-23T18:29:52.547964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:29:39.313604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552039+0000","last_change":"2024-04-23T18:29:17.517401+0000","last_active":"2024-04-23T18:29:52.552039+0000","last_peered":"2024-04-23T18:29:52.552039+0000","last_clean":"2024-04-23T18:29:52.552039+0000","last_became_active":"2024-04-23T18:29:17.517051+0000","last_became_peered":"2024-04-23T18:29:17.517051+0000","last_unstale":"2024-04-23T18:29:52.552039+0000","last_undegraded":"2024-04-23T18:29:52.552039+0000","last_fullsized":"2024-04-23T18:29:52.552039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:43.608104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":366,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585498+0000","last_change":"2024-04-23T18:29:19.527952+0000","last_active":"2024-04-23T18:32:20.585498+0000","last_peered":"2024-04-23T18:32:20.585498+0000","last_clean":"2024-04-23T18:32:20.585498+0000","last_became_active":"2024-04-23T18:29:19.527614+0000","last_became_peered":"2024-04-23T18:29:19.527614+0000","last_unstale":"2024-04-23T18:32:20.585498+0000","last_undegraded":"2024-04-23T18:32:20.585498+0000","last_fullsized":"2024-04-23T18:32:20.585498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:37.178104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.792678+0000","last_change":"2024-04-23T18:29:21.531583+0000","last_active":"2024-04-23T18:30:36.792678+0000","last_peered":"2024-04-23T18:30:36.792678+0000","last_clean":"2024-04-23T18:30:36.792678+0000","last_became_active":"2024-04-23T18:29:21.530619+0000","last_became_peered":"2024-04-23T18:29:21.530619+0000","last_unstale":"2024-04-23T18:30:36.792678+0000","last_undegraded":"2024-04-23T18:30:36.792678+0000","last_fullsized":"2024-04-23T18:30:36.792678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:02:25.354970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136433+0000","last_change":"2024-04-23T18:29:13.502162+0000","last_active":"2024-04-23T18:32:21.136433+0000","last_peered":"2024-04-23T18:32:21.136433+0000","last_clean":"2024-04-23T18:32:21.136433+0000","last_became_active":"2024-04-23T18:29:13.501741+0000","last_became_peered":"2024-04-23T18:29:13.501741+0000","last_unstale":"2024-04-23T18:32:21.136433+0000","last_undegraded":"2024-04-23T18:32:21.136433+0000","last_fullsized":"2024-04-23T18:32:21.136433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:24.039627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546726+0000","last_change":"2024-04-23T18:29:11.501098+0000","last_active":"2024-04-23T18:29:52.546726+0000","last_peered":"2024-04-23T18:29:52.546726+0000","last_clean":"2024-04-23T18:29:52.546726+0000","last_became_active":"2024-04-23T18:29:11.500781+0000","last_became_peered":"2024-04-23T18:29:11.500781+0000","last_unstale":"2024-04-23T18:29:52.546726+0000","last_undegraded":"2024-04-23T18:29:52.546726+0000","last_fullsized":"2024-04-23T18:29:52.546726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:49.661961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.553840+0000","last_change":"2024-04-23T18:29:52.550289+0000","last_active":"2024-04-23T18:29:52.553840+0000","last_peered":"2024-04-23T18:29:52.553840+0000","last_clean":"2024-04-23T18:29:52.553840+0000","last_became_active":"2024-04-23T18:29:52.549944+0000","last_became_peered":"2024-04-23T18:29:52.549944+0000","last_unstale":"2024-04-23T18:29:52.553840+0000","last_undegraded":"2024-04-23T18:29:52.553840+0000","last_fullsized":"2024-04-23T18:29:52.553840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.212007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.019745+0000","last_change":"2024-04-23T18:29:17.509362+0000","last_active":"2024-04-23T18:31:19.019745+0000","last_peered":"2024-04-23T18:31:19.019745+0000","last_clean":"2024-04-23T18:31:19.019745+0000","last_became_active":"2024-04-23T18:29:17.509076+0000","last_became_peered":"2024-04-23T18:29:17.509076+0000","last_unstale":"2024-04-23T18:31:19.019745+0000","last_undegraded":"2024-04-23T18:31:19.019745+0000","last_fullsized":"2024-04-23T18:31:19.019745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:59.200856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546279+0000","last_change":"2024-04-23T18:29:19.519211+0000","last_active":"2024-04-23T18:29:52.546279+0000","last_peered":"2024-04-23T18:29:52.546279+0000","last_clean":"2024-04-23T18:29:52.546279+0000","last_became_active":"2024-04-23T18:29:19.518673+0000","last_became_peered":"2024-04-23T18:29:19.518673+0000","last_unstale":"2024-04-23T18:29:52.546279+0000","last_undegraded":"2024-04-23T18:29:52.546279+0000","last_fullsized":"2024-04-23T18:29:52.546279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:16:13.613155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548269+0000","last_change":"2024-04-23T18:29:21.533731+0000","last_active":"2024-04-23T18:29:52.548269+0000","last_peered":"2024-04-23T18:29:52.548269+0000","last_clean":"2024-04-23T18:29:52.548269+0000","last_became_active":"2024-04-23T18:29:21.533187+0000","last_became_peered":"2024-04-23T18:29:21.533187+0000","last_unstale":"2024-04-23T18:29:52.548269+0000","last_undegraded":"2024-04-23T18:29:52.548269+0000","last_fullsized":"2024-04-23T18:29:52.548269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:16.140403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216088+0000","last_change":"2024-04-23T18:29:13.502229+0000","last_active":"2024-04-23T18:32:21.216088+0000","last_peered":"2024-04-23T18:32:21.216088+0000","last_clean":"2024-04-23T18:32:21.216088+0000","last_became_active":"2024-04-23T18:29:13.501974+0000","last_became_peered":"2024-04-23T18:29:13.501974+0000","last_unstale":"2024-04-23T18:32:21.216088+0000","last_undegraded":"2024-04-23T18:32:21.216088+0000","last_fullsized":"2024-04-23T18:32:21.216088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:41.117616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552635+0000","last_change":"2024-04-23T18:29:11.511621+0000","last_active":"2024-04-23T18:29:52.552635+0000","last_peered":"2024-04-23T18:29:52.552635+0000","last_clean":"2024-04-23T18:29:52.552635+0000","last_became_active":"2024-04-23T18:29:11.511297+0000","last_became_peered":"2024-04-23T18:29:11.511297+0000","last_unstale":"2024-04-23T18:29:52.552635+0000","last_undegraded":"2024-04-23T18:29:52.552635+0000","last_fullsized":"2024-04-23T18:29:52.552635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:59.862004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543723+0000","last_change":"2024-04-23T18:29:15.504950+0000","last_active":"2024-04-23T18:29:52.543723+0000","last_peered":"2024-04-23T18:29:52.543723+0000","last_clean":"2024-04-23T18:29:52.543723+0000","last_became_active":"2024-04-23T18:29:15.504528+0000","last_became_peered":"2024-04-23T18:29:15.504528+0000","last_unstale":"2024-04-23T18:29:52.543723+0000","last_undegraded":"2024-04-23T18:29:52.543723+0000","last_fullsized":"2024-04-23T18:29:52.543723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:41.352665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.020878+0000","last_change":"2024-04-23T18:29:17.513717+0000","last_active":"2024-04-23T18:31:19.020878+0000","last_peered":"2024-04-23T18:31:19.020878+0000","last_clean":"2024-04-23T18:31:19.020878+0000","last_became_active":"2024-04-23T18:29:17.513482+0000","last_became_peered":"2024-04-23T18:29:17.513482+0000","last_unstale":"2024-04-23T18:31:19.020878+0000","last_undegraded":"2024-04-23T18:31:19.020878+0000","last_fullsized":"2024-04-23T18:31:19.020878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:10:12.070821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549506+0000","last_change":"2024-04-23T18:29:19.526244+0000","last_active":"2024-04-23T18:29:52.549506+0000","last_peered":"2024-04-23T18:29:52.549506+0000","last_clean":"2024-04-23T18:29:52.549506+0000","last_became_active":"2024-04-23T18:29:19.525985+0000","last_became_peered":"2024-04-23T18:29:19.525985+0000","last_unstale":"2024-04-23T18:29:52.549506+0000","last_undegraded":"2024-04-23T18:29:52.549506+0000","last_fullsized":"2024-04-23T18:29:52.549506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:40.734604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551426+0000","last_change":"2024-04-23T18:29:21.528945+0000","last_active":"2024-04-23T18:29:52.551426+0000","last_peered":"2024-04-23T18:29:52.551426+0000","last_clean":"2024-04-23T18:29:52.551426+0000","last_became_active":"2024-04-23T18:29:21.528665+0000","last_became_peered":"2024-04-23T18:29:21.528665+0000","last_unstale":"2024-04-23T18:29:52.551426+0000","last_undegraded":"2024-04-23T18:29:52.551426+0000","last_fullsized":"2024-04-23T18:29:52.551426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:24.076754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.320824+0000","last_change":"2024-04-23T18:29:13.495164+0000","last_active":"2024-04-23T18:29:54.320824+0000","last_peered":"2024-04-23T18:29:54.320824+0000","last_clean":"2024-04-23T18:29:54.320824+0000","last_became_active":"2024-04-23T18:29:13.494647+0000","last_became_peered":"2024-04-23T18:29:13.494647+0000","last_unstale":"2024-04-23T18:29:54.320824+0000","last_undegraded":"2024-04-23T18:29:54.320824+0000","last_fullsized":"2024-04-23T18:29:54.320824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:29.887241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.266338+0000","last_change":"2024-04-23T18:29:11.496011+0000","last_active":"2024-04-23T18:31:17.266338+0000","last_peered":"2024-04-23T18:31:17.266338+0000","last_clean":"2024-04-23T18:31:17.266338+0000","last_became_active":"2024-04-23T18:29:11.495723+0000","last_became_peered":"2024-04-23T18:29:11.495723+0000","last_unstale":"2024-04-23T18:31:17.266338+0000","last_undegraded":"2024-04-23T18:31:17.266338+0000","last_fullsized":"2024-04-23T18:31:17.266338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:36:52.346753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543714+0000","last_change":"2024-04-23T18:29:15.510875+0000","last_active":"2024-04-23T18:29:52.543714+0000","last_peered":"2024-04-23T18:29:52.543714+0000","last_clean":"2024-04-23T18:29:52.543714+0000","last_became_active":"2024-04-23T18:29:15.510185+0000","last_became_peered":"2024-04-23T18:29:15.510185+0000","last_unstale":"2024-04-23T18:29:52.543714+0000","last_undegraded":"2024-04-23T18:29:52.543714+0000","last_fullsized":"2024-04-23T18:29:52.543714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:50.678177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'28","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.764076+0000","last_change":"2024-04-23T18:29:17.517329+0000","last_active":"2024-04-23T18:31:46.764076+0000","last_peered":"2024-04-23T18:31:46.764076+0000","last_clean":"2024-04-23T18:31:46.764076+0000","last_became_active":"2024-04-23T18:29:17.516989+0000","last_became_peered":"2024-04-23T18:29:17.516989+0000","last_unstale":"2024-04-23T18:31:46.764076+0000","last_undegraded":"2024-04-23T18:31:46.764076+0000","last_fullsized":"2024-04-23T18:31:46.764076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:12:42.263147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548315+0000","last_change":"2024-04-23T18:29:19.522484+0000","last_active":"2024-04-23T18:29:52.548315+0000","last_peered":"2024-04-23T18:29:52.548315+0000","last_clean":"2024-04-23T18:29:52.548315+0000","last_became_active":"2024-04-23T18:29:19.522217+0000","last_became_peered":"2024-04-23T18:29:19.522217+0000","last_unstale":"2024-04-23T18:29:52.548315+0000","last_undegraded":"2024-04-23T18:29:52.548315+0000","last_fullsized":"2024-04-23T18:29:52.548315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:36:35.803795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.054923+0000","last_change":"2024-04-23T18:29:21.533465+0000","last_active":"2024-04-23T18:31:19.054923+0000","last_peered":"2024-04-23T18:31:19.054923+0000","last_clean":"2024-04-23T18:31:19.054923+0000","last_became_active":"2024-04-23T18:29:21.533152+0000","last_became_peered":"2024-04-23T18:29:21.533152+0000","last_unstale":"2024-04-23T18:31:19.054923+0000","last_undegraded":"2024-04-23T18:31:19.054923+0000","last_fullsized":"2024-04-23T18:31:19.054923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:29.385592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.183234+0000","last_change":"2024-04-23T18:29:13.502434+0000","last_active":"2024-04-23T18:32:21.183234+0000","last_peered":"2024-04-23T18:32:21.183234+0000","last_clean":"2024-04-23T18:32:21.183234+0000","last_became_active":"2024-04-23T18:29:13.501782+0000","last_became_peered":"2024-04-23T18:29:13.501782+0000","last_unstale":"2024-04-23T18:32:21.183234+0000","last_undegraded":"2024-04-23T18:32:21.183234+0000","last_fullsized":"2024-04-23T18:32:21.183234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:12.786478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:16.758702+0000","last_change":"2024-04-23T18:29:11.501970+0000","last_active":"2024-04-23T18:31:16.758702+0000","last_peered":"2024-04-23T18:31:16.758702+0000","last_clean":"2024-04-23T18:31:16.758702+0000","last_became_active":"2024-04-23T18:29:11.501648+0000","last_became_peered":"2024-04-23T18:29:11.501648+0000","last_unstale":"2024-04-23T18:31:16.758702+0000","last_undegraded":"2024-04-23T18:31:16.758702+0000","last_fullsized":"2024-04-23T18:31:16.758702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:50.092624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.716953+0000","last_change":"2024-04-23T18:29:15.510030+0000","last_active":"2024-04-23T18:31:17.716953+0000","last_peered":"2024-04-23T18:31:17.716953+0000","last_clean":"2024-04-23T18:31:17.716953+0000","last_became_active":"2024-04-23T18:29:15.509725+0000","last_became_peered":"2024-04-23T18:29:15.509725+0000","last_unstale":"2024-04-23T18:31:17.716953+0000","last_undegraded":"2024-04-23T18:31:17.716953+0000","last_fullsized":"2024-04-23T18:31:17.716953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:56:00.300728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.580905+0000","last_change":"2024-04-23T18:29:17.515107+0000","last_active":"2024-04-23T18:32:20.580905+0000","last_peered":"2024-04-23T18:32:20.580905+0000","last_clean":"2024-04-23T18:32:20.580905+0000","last_became_active":"2024-04-23T18:29:17.514823+0000","last_became_peered":"2024-04-23T18:29:17.514823+0000","last_unstale":"2024-04-23T18:32:20.580905+0000","last_undegraded":"2024-04-23T18:32:20.580905+0000","last_fullsized":"2024-04-23T18:32:20.580905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:43:37.286173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547277+0000","last_change":"2024-04-23T18:29:19.519462+0000","last_active":"2024-04-23T18:29:52.547277+0000","last_peered":"2024-04-23T18:29:52.547277+0000","last_clean":"2024-04-23T18:29:52.547277+0000","last_became_active":"2024-04-23T18:29:19.519153+0000","last_became_peered":"2024-04-23T18:29:19.519153+0000","last_unstale":"2024-04-23T18:29:52.547277+0000","last_undegraded":"2024-04-23T18:29:52.547277+0000","last_fullsized":"2024-04-23T18:29:52.547277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:04:43.275499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.001111+0000","last_change":"2024-04-23T18:29:21.529659+0000","last_active":"2024-04-23T18:32:21.001111+0000","last_peered":"2024-04-23T18:32:21.001111+0000","last_clean":"2024-04-23T18:32:21.001111+0000","last_became_active":"2024-04-23T18:29:21.529331+0000","last_became_peered":"2024-04-23T18:29:21.529331+0000","last_unstale":"2024-04-23T18:32:21.001111+0000","last_undegraded":"2024-04-23T18:32:21.001111+0000","last_fullsized":"2024-04-23T18:32:21.001111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:10:52.515811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216418+0000","last_change":"2024-04-23T18:29:52.563032+0000","last_active":"2024-04-23T18:32:21.216418+0000","last_peered":"2024-04-23T18:32:21.216418+0000","last_clean":"2024-04-23T18:32:21.216418+0000","last_became_active":"2024-04-23T18:29:52.551523+0000","last_became_peered":"2024-04-23T18:29:52.551523+0000","last_unstale":"2024-04-23T18:32:21.216418+0000","last_undegraded":"2024-04-23T18:32:21.216418+0000","last_fullsized":"2024-04-23T18:32:21.216418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:09:27.042501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.540500+0000","last_change":"2024-04-23T18:29:11.489634+0000","last_active":"2024-04-23T18:29:52.540500+0000","last_peered":"2024-04-23T18:29:52.540500+0000","last_clean":"2024-04-23T18:29:52.540500+0000","last_became_active":"2024-04-23T18:29:11.489284+0000","last_became_peered":"2024-04-23T18:29:11.489284+0000","last_unstale":"2024-04-23T18:29:52.540500+0000","last_undegraded":"2024-04-23T18:29:52.540500+0000","last_fullsized":"2024-04-23T18:29:52.540500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:52.597685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549214+0000","last_change":"2024-04-23T18:29:13.497247+0000","last_active":"2024-04-23T18:29:52.549214+0000","last_peered":"2024-04-23T18:29:52.549214+0000","last_clean":"2024-04-23T18:29:52.549214+0000","last_became_active":"2024-04-23T18:29:13.496958+0000","last_became_peered":"2024-04-23T18:29:13.496958+0000","last_unstale":"2024-04-23T18:29:52.549214+0000","last_undegraded":"2024-04-23T18:29:52.549214+0000","last_fullsized":"2024-04-23T18:29:52.549214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:19.818744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546441+0000","last_change":"2024-04-23T18:29:11.487639+0000","last_active":"2024-04-23T18:29:52.546441+0000","last_peered":"2024-04-23T18:29:52.546441+0000","last_clean":"2024-04-23T18:29:52.546441+0000","last_became_active":"2024-04-23T18:29:11.486563+0000","last_became_peered":"2024-04-23T18:29:11.486563+0000","last_unstale":"2024-04-23T18:29:52.546441+0000","last_undegraded":"2024-04-23T18:29:52.546441+0000","last_fullsized":"2024-04-23T18:29:52.546441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:59.834673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.182969+0000","last_change":"2024-04-23T18:29:13.494907+0000","last_active":"2024-04-23T18:32:21.182969+0000","last_peered":"2024-04-23T18:32:21.182969+0000","last_clean":"2024-04-23T18:32:21.182969+0000","last_became_active":"2024-04-23T18:29:13.494683+0000","last_became_peered":"2024-04-23T18:29:13.494683+0000","last_unstale":"2024-04-23T18:32:21.182969+0000","last_undegraded":"2024-04-23T18:32:21.182969+0000","last_fullsized":"2024-04-23T18:32:21.182969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:39.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:16.759681+0000","last_change":"2024-04-23T18:29:11.511297+0000","last_active":"2024-04-23T18:31:16.759681+0000","last_peered":"2024-04-23T18:31:16.759681+0000","last_clean":"2024-04-23T18:31:16.759681+0000","last_became_active":"2024-04-23T18:29:11.510971+0000","last_became_peered":"2024-04-23T18:29:11.510971+0000","last_unstale":"2024-04-23T18:31:16.759681+0000","last_undegraded":"2024-04-23T18:31:16.759681+0000","last_fullsized":"2024-04-23T18:31:16.759681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:10.779475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278308+0000","last_change":"2024-04-23T18:29:13.497387+0000","last_active":"2024-04-23T18:31:17.278308+0000","last_peered":"2024-04-23T18:31:17.278308+0000","last_clean":"2024-04-23T18:31:17.278308+0000","last_became_active":"2024-04-23T18:29:13.497094+0000","last_became_peered":"2024-04-23T18:29:13.497094+0000","last_unstale":"2024-04-23T18:31:17.278308+0000","last_undegraded":"2024-04-23T18:31:17.278308+0000","last_fullsized":"2024-04-23T18:31:17.278308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:46:30.444504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547921+0000","last_change":"2024-04-23T18:29:11.492610+0000","last_active":"2024-04-23T18:29:52.547921+0000","last_peered":"2024-04-23T18:29:52.547921+0000","last_clean":"2024-04-23T18:29:52.547921+0000","last_became_active":"2024-04-23T18:29:11.492064+0000","last_became_peered":"2024-04-23T18:29:11.492064+0000","last_unstale":"2024-04-23T18:29:52.547921+0000","last_undegraded":"2024-04-23T18:29:52.547921+0000","last_fullsized":"2024-04-23T18:29:52.547921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:53.075916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998383+0000","last_change":"2024-04-23T18:29:13.502885+0000","last_active":"2024-04-23T18:32:20.998383+0000","last_peered":"2024-04-23T18:32:20.998383+0000","last_clean":"2024-04-23T18:32:20.998383+0000","last_became_active":"2024-04-23T18:29:13.502243+0000","last_became_peered":"2024-04-23T18:29:13.502243+0000","last_unstale":"2024-04-23T18:32:20.998383+0000","last_undegraded":"2024-04-23T18:32:20.998383+0000","last_fullsized":"2024-04-23T18:32:20.998383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:03:43.333220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548416+0000","last_change":"2024-04-23T18:29:11.486754+0000","last_active":"2024-04-23T18:29:52.548416+0000","last_peered":"2024-04-23T18:29:52.548416+0000","last_clean":"2024-04-23T18:29:52.548416+0000","last_became_active":"2024-04-23T18:29:11.486452+0000","last_became_peered":"2024-04-23T18:29:11.486452+0000","last_unstale":"2024-04-23T18:29:52.548416+0000","last_undegraded":"2024-04-23T18:29:52.548416+0000","last_fullsized":"2024-04-23T18:29:52.548416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:15.136106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185774+0000","last_change":"2024-04-23T18:29:13.507893+0000","last_active":"2024-04-23T18:32:21.185774+0000","last_peered":"2024-04-23T18:32:21.185774+0000","last_clean":"2024-04-23T18:32:21.185774+0000","last_became_active":"2024-04-23T18:29:13.507582+0000","last_became_peered":"2024-04-23T18:29:13.507582+0000","last_unstale":"2024-04-23T18:32:21.185774+0000","last_undegraded":"2024-04-23T18:32:21.185774+0000","last_fullsized":"2024-04-23T18:32:21.185774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:50.962263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544908+0000","last_change":"2024-04-23T18:29:11.495366+0000","last_active":"2024-04-23T18:29:52.544908+0000","last_peered":"2024-04-23T18:29:52.544908+0000","last_clean":"2024-04-23T18:29:52.544908+0000","last_became_active":"2024-04-23T18:29:11.493318+0000","last_became_peered":"2024-04-23T18:29:11.493318+0000","last_unstale":"2024-04-23T18:29:52.544908+0000","last_undegraded":"2024-04-23T18:29:52.544908+0000","last_fullsized":"2024-04-23T18:29:52.544908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:47:48.291376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'22","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136764+0000","last_change":"2024-04-23T18:29:13.499537+0000","last_active":"2024-04-23T18:32:21.136764+0000","last_peered":"2024-04-23T18:32:21.136764+0000","last_clean":"2024-04-23T18:32:21.136764+0000","last_became_active":"2024-04-23T18:29:13.499155+0000","last_became_peered":"2024-04-23T18:29:13.499155+0000","last_unstale":"2024-04-23T18:32:21.136764+0000","last_undegraded":"2024-04-23T18:32:21.136764+0000","last_fullsized":"2024-04-23T18:32:21.136764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:10:40.469094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544921+0000","last_change":"2024-04-23T18:29:11.486471+0000","last_active":"2024-04-23T18:29:52.544921+0000","last_peered":"2024-04-23T18:29:52.544921+0000","last_clean":"2024-04-23T18:29:52.544921+0000","last_became_active":"2024-04-23T18:29:11.485201+0000","last_became_peered":"2024-04-23T18:29:11.485201+0000","last_unstale":"2024-04-23T18:29:52.544921+0000","last_undegraded":"2024-04-23T18:29:52.544921+0000","last_fullsized":"2024-04-23T18:29:52.544921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:34.195698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.902933+0000","last_change":"2024-04-23T18:29:13.497344+0000","last_active":"2024-04-23T18:32:20.902933+0000","last_peered":"2024-04-23T18:32:20.902933+0000","last_clean":"2024-04-23T18:32:20.902933+0000","last_became_active":"2024-04-23T18:29:13.495654+0000","last_became_peered":"2024-04-23T18:29:13.495654+0000","last_unstale":"2024-04-23T18:32:20.902933+0000","last_undegraded":"2024-04-23T18:32:20.902933+0000","last_fullsized":"2024-04-23T18:32:20.902933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:15.838895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549092+0000","last_change":"2024-04-23T18:29:11.495685+0000","last_active":"2024-04-23T18:29:52.549092+0000","last_peered":"2024-04-23T18:29:52.549092+0000","last_clean":"2024-04-23T18:29:52.549092+0000","last_became_active":"2024-04-23T18:29:11.495224+0000","last_became_peered":"2024-04-23T18:29:11.495224+0000","last_unstale":"2024-04-23T18:29:52.549092+0000","last_undegraded":"2024-04-23T18:29:52.549092+0000","last_fullsized":"2024-04-23T18:29:52.549092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:44.033653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185125+0000","last_change":"2024-04-23T18:29:13.498009+0000","last_active":"2024-04-23T18:32:21.185125+0000","last_peered":"2024-04-23T18:32:21.185125+0000","last_clean":"2024-04-23T18:32:21.185125+0000","last_became_active":"2024-04-23T18:29:13.497588+0000","last_became_peered":"2024-04-23T18:29:13.497588+0000","last_unstale":"2024-04-23T18:32:21.185125+0000","last_undegraded":"2024-04-23T18:32:21.185125+0000","last_fullsized":"2024-04-23T18:32:21.185125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:34.172125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.299467+0000","last_change":"2024-04-23T18:29:11.496267+0000","last_active":"2024-04-23T18:29:54.299467+0000","last_peered":"2024-04-23T18:29:54.299467+0000","last_clean":"2024-04-23T18:29:54.299467+0000","last_became_active":"2024-04-23T18:29:11.495948+0000","last_became_peered":"2024-04-23T18:29:11.495948+0000","last_unstale":"2024-04-23T18:29:54.299467+0000","last_undegraded":"2024-04-23T18:29:54.299467+0000","last_fullsized":"2024-04-23T18:29:54.299467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:25:25.829104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278306+0000","last_change":"2024-04-23T18:29:13.501113+0000","last_active":"2024-04-23T18:31:17.278306+0000","last_peered":"2024-04-23T18:31:17.278306+0000","last_clean":"2024-04-23T18:31:17.278306+0000","last_became_active":"2024-04-23T18:29:13.500819+0000","last_became_peered":"2024-04-23T18:29:13.500819+0000","last_unstale":"2024-04-23T18:31:17.278306+0000","last_undegraded":"2024-04-23T18:31:17.278306+0000","last_fullsized":"2024-04-23T18:31:17.278306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:49.776673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546657+0000","last_change":"2024-04-23T18:29:11.493307+0000","last_active":"2024-04-23T18:29:52.546657+0000","last_peered":"2024-04-23T18:29:52.546657+0000","last_clean":"2024-04-23T18:29:52.546657+0000","last_became_active":"2024-04-23T18:29:11.492727+0000","last_became_peered":"2024-04-23T18:29:11.492727+0000","last_unstale":"2024-04-23T18:29:52.546657+0000","last_undegraded":"2024-04-23T18:29:52.546657+0000","last_fullsized":"2024-04-23T18:29:52.546657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:00.435842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216435+0000","last_change":"2024-04-23T18:29:13.503226+0000","last_active":"2024-04-23T18:32:21.216435+0000","last_peered":"2024-04-23T18:32:21.216435+0000","last_clean":"2024-04-23T18:32:21.216435+0000","last_became_active":"2024-04-23T18:29:13.502835+0000","last_became_peered":"2024-04-23T18:29:13.502835+0000","last_unstale":"2024-04-23T18:32:21.216435+0000","last_undegraded":"2024-04-23T18:32:21.216435+0000","last_fullsized":"2024-04-23T18:32:21.216435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:52.502192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.116559+0000","last_change":"2024-04-23T18:29:11.500172+0000","last_active":"2024-04-23T18:32:21.116559+0000","last_peered":"2024-04-23T18:32:21.116559+0000","last_clean":"2024-04-23T18:32:21.116559+0000","last_became_active":"2024-04-23T18:29:11.498708+0000","last_became_peered":"2024-04-23T18:29:11.498708+0000","last_unstale":"2024-04-23T18:32:21.116559+0000","last_undegraded":"2024-04-23T18:32:21.116559+0000","last_fullsized":"2024-04-23T18:32:21.116559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:30.568409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998106+0000","last_change":"2024-04-23T18:29:13.494415+0000","last_active":"2024-04-23T18:32:20.998106+0000","last_peered":"2024-04-23T18:32:20.998106+0000","last_clean":"2024-04-23T18:32:20.998106+0000","last_became_active":"2024-04-23T18:29:13.494121+0000","last_became_peered":"2024-04-23T18:29:13.494121+0000","last_unstale":"2024-04-23T18:32:20.998106+0000","last_undegraded":"2024-04-23T18:32:20.998106+0000","last_fullsized":"2024-04-23T18:32:20.998106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:53.187803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.785091+0000","last_change":"2024-04-23T18:29:11.490442+0000","last_active":"2024-04-23T18:30:36.785091+0000","last_peered":"2024-04-23T18:30:36.785091+0000","last_clean":"2024-04-23T18:30:36.785091+0000","last_became_active":"2024-04-23T18:29:11.489671+0000","last_became_peered":"2024-04-23T18:29:11.489671+0000","last_unstale":"2024-04-23T18:30:36.785091+0000","last_undegraded":"2024-04-23T18:30:36.785091+0000","last_fullsized":"2024-04-23T18:30:36.785091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:36.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185209+0000","last_change":"2024-04-23T18:29:13.507705+0000","last_active":"2024-04-23T18:32:21.185209+0000","last_peered":"2024-04-23T18:32:21.185209+0000","last_clean":"2024-04-23T18:32:21.185209+0000","last_became_active":"2024-04-23T18:29:13.507438+0000","last_became_peered":"2024-04-23T18:29:13.507438+0000","last_unstale":"2024-04-23T18:32:21.185209+0000","last_undegraded":"2024-04-23T18:32:21.185209+0000","last_fullsized":"2024-04-23T18:32:21.185209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:21.755001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.761106+0000","last_change":"2024-04-23T18:29:11.511457+0000","last_active":"2024-04-23T18:31:26.761106+0000","last_peered":"2024-04-23T18:31:26.761106+0000","last_clean":"2024-04-23T18:31:26.761106+0000","last_became_active":"2024-04-23T18:29:11.510882+0000","last_became_peered":"2024-04-23T18:29:11.510882+0000","last_unstale":"2024-04-23T18:31:26.761106+0000","last_undegraded":"2024-04-23T18:31:26.761106+0000","last_fullsized":"2024-04-23T18:31:26.761106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:53:49.753580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.183468+0000","last_change":"2024-04-23T18:29:13.497528+0000","last_active":"2024-04-23T18:32:21.183468+0000","last_peered":"2024-04-23T18:32:21.183468+0000","last_clean":"2024-04-23T18:32:21.183468+0000","last_became_active":"2024-04-23T18:29:13.497271+0000","last_became_peered":"2024-04-23T18:29:13.497271+0000","last_unstale":"2024-04-23T18:32:21.183468+0000","last_undegraded":"2024-04-23T18:32:21.183468+0000","last_fullsized":"2024-04-23T18:32:21.183468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:16:21.578410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552824+0000","last_change":"2024-04-23T18:29:11.507084+0000","last_active":"2024-04-23T18:29:52.552824+0000","last_peered":"2024-04-23T18:29:52.552824+0000","last_clean":"2024-04-23T18:29:52.552824+0000","last_became_active":"2024-04-23T18:29:11.506749+0000","last_became_peered":"2024-04-23T18:29:11.506749+0000","last_unstale":"2024-04-23T18:29:52.552824+0000","last_undegraded":"2024-04-23T18:29:52.552824+0000","last_fullsized":"2024-04-23T18:29:52.552824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:56.973382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278854+0000","last_change":"2024-04-23T18:29:13.501439+0000","last_active":"2024-04-23T18:31:17.278854+0000","last_peered":"2024-04-23T18:31:17.278854+0000","last_clean":"2024-04-23T18:31:17.278854+0000","last_became_active":"2024-04-23T18:29:13.501177+0000","last_became_peered":"2024-04-23T18:29:13.501177+0000","last_unstale":"2024-04-23T18:31:17.278854+0000","last_undegraded":"2024-04-23T18:31:17.278854+0000","last_fullsized":"2024-04-23T18:31:17.278854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:34.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760399+0000","last_change":"2024-04-23T18:29:11.485837+0000","last_active":"2024-04-23T18:31:31.760399+0000","last_peered":"2024-04-23T18:31:31.760399+0000","last_clean":"2024-04-23T18:31:31.760399+0000","last_became_active":"2024-04-23T18:29:11.484137+0000","last_became_peered":"2024-04-23T18:29:11.484137+0000","last_unstale":"2024-04-23T18:31:31.760399+0000","last_undegraded":"2024-04-23T18:31:31.760399+0000","last_fullsized":"2024-04-23T18:31:31.760399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:31.151193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.615235+0000","last_change":"2024-04-23T18:29:13.498423+0000","last_active":"2024-04-23T18:30:36.615235+0000","last_peered":"2024-04-23T18:30:36.615235+0000","last_clean":"2024-04-23T18:30:36.615235+0000","last_became_active":"2024-04-23T18:29:13.494034+0000","last_became_peered":"2024-04-23T18:29:13.494034+0000","last_unstale":"2024-04-23T18:30:36.615235+0000","last_undegraded":"2024-04-23T18:30:36.615235+0000","last_fullsized":"2024-04-23T18:30:36.615235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:54.917516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552128+0000","last_change":"2024-04-23T18:29:11.507132+0000","last_active":"2024-04-23T18:29:52.552128+0000","last_peered":"2024-04-23T18:29:52.552128+0000","last_clean":"2024-04-23T18:29:52.552128+0000","last_became_active":"2024-04-23T18:29:11.506801+0000","last_became_peered":"2024-04-23T18:29:11.506801+0000","last_unstale":"2024-04-23T18:29:52.552128+0000","last_undegraded":"2024-04-23T18:29:52.552128+0000","last_fullsized":"2024-04-23T18:29:52.552128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.831893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549216+0000","last_change":"2024-04-23T18:29:11.495271+0000","last_active":"2024-04-23T18:29:52.549216+0000","last_peered":"2024-04-23T18:29:52.549216+0000","last_clean":"2024-04-23T18:29:52.549216+0000","last_became_active":"2024-04-23T18:29:11.494891+0000","last_became_peered":"2024-04-23T18:29:11.494891+0000","last_unstale":"2024-04-23T18:29:52.549216+0000","last_undegraded":"2024-04-23T18:29:52.549216+0000","last_fullsized":"2024-04-23T18:29:52.549216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:22:00.867668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759697+0000","last_change":"2024-04-23T18:29:13.495173+0000","last_active":"2024-04-23T18:31:39.759697+0000","last_peered":"2024-04-23T18:31:39.759697+0000","last_clean":"2024-04-23T18:31:39.759697+0000","last_became_active":"2024-04-23T18:29:13.494850+0000","last_became_peered":"2024-04-23T18:29:13.494850+0000","last_unstale":"2024-04-23T18:31:39.759697+0000","last_undegraded":"2024-04-23T18:31:39.759697+0000","last_fullsized":"2024-04-23T18:31:39.759697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:34:01.705044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.122702+0000","last_change":"2024-04-23T18:29:11.495720+0000","last_active":"2024-04-23T18:32:21.122702+0000","last_peered":"2024-04-23T18:32:21.122702+0000","last_clean":"2024-04-23T18:32:21.122702+0000","last_became_active":"2024-04-23T18:29:11.495173+0000","last_became_peered":"2024-04-23T18:29:11.495173+0000","last_unstale":"2024-04-23T18:32:21.122702+0000","last_undegraded":"2024-04-23T18:32:21.122702+0000","last_fullsized":"2024-04-23T18:32:21.122702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:25:10.587855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.762456+0000","last_change":"2024-04-23T18:29:13.506361+0000","last_active":"2024-04-23T18:31:41.762456+0000","last_peered":"2024-04-23T18:31:41.762456+0000","last_clean":"2024-04-23T18:31:41.762456+0000","last_became_active":"2024-04-23T18:29:13.506122+0000","last_became_peered":"2024-04-23T18:29:13.506122+0000","last_unstale":"2024-04-23T18:31:41.762456+0000","last_undegraded":"2024-04-23T18:31:41.762456+0000","last_fullsized":"2024-04-23T18:31:41.762456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:28.025600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1604,"num_read_kb":1494,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640301,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48412,"kb_used_data":13076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323428,"statfs":{"total":96636764160,"available":96587190272,"internally_reserved":0,"allocated":13389824,"data_stored":13058752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640301,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44520,"kb_used_data":9184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327320,"statfs":{"total":96636764160,"available":96591175680,"internally_reserved":0,"allocated":9404416,"data_stored":9128922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42808,"kb_used_data":7472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329032,"statfs":{"total":96636764160,"available":96592928768,"internally_reserved":0,"allocated":7651328,"data_stored":7353470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50484,"kb_used_data":10988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321356,"statfs":{"total":96636764160,"available":96585068544,"internally_reserved":0,"allocated":11251712,"data_stored":10958282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:32:28.260 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:32:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.393+0000 7fe59d5ca640 1 Processor -- start 2024-04-23T18:32:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.393+0000 7fe59d5ca640 1 -- start start 2024-04-23T18:32:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.394+0000 7fe59d5ca640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe59812ea70 0x7fe59812f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.394+0000 7fe59d5ca640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe59806e5a0 con 0x7fe59812b4f0 2024-04-23T18:32:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.394+0000 7fe59d5ca640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe598098cc0 con 0x7fe59812ea70 2024-04-23T18:32:28.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.394+0000 7fe596ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe59812ea70 0x7fe59812f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:28.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.394+0000 7fe5967fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe59812b4f0 0x7fe59812b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:54350/0 (socket says 172.21.15.62:54350) 2024-04-23T18:32:28.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.394+0000 7fe5967fc640 1 -- 172.21.15.62:0/2445384550 learned_addr learned my addr 172.21.15.62:0/2445384550 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:28.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.394+0000 7fe595ffb640 1 -- 172.21.15.62:0/2445384550 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 480509266 0 0) 0x7fe59806e5a0 con 0x7fe59812b4f0 2024-04-23T18:32:28.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.394+0000 7fe595ffb640 1 -- 172.21.15.62:0/2445384550 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe580003520 con 0x7fe59812b4f0 2024-04-23T18:32:28.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.394+0000 7fe596ffd640 1 -- 172.21.15.62:0/2445384550 >> v1:172.21.15.62:6789/0 conn(0x7fe59812b4f0 legacy=0x7fe59812b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:28.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.394+0000 7fe596ffd640 1 -- 172.21.15.62:0/2445384550 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5980989d0 con 0x7fe59812ea70 2024-04-23T18:32:28.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.395+0000 7fe596ffd640 1 --2- 172.21.15.62:0/2445384550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59812ea70 0x7fe59812f270 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe590009d90 tx=0x7fe59002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f582f38d7a7f9d5f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.395+0000 7fe595ffb640 1 -- 172.21.15.62:0/2445384550 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe590039070 con 0x7fe59812ea70 2024-04-23T18:32:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.395+0000 7fe595ffb640 1 -- 172.21.15.62:0/2445384550 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59002cbb0 con 0x7fe59812ea70 2024-04-23T18:32:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.395+0000 7fe595ffb640 1 -- 172.21.15.62:0/2445384550 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe590034440 con 0x7fe59812ea70 2024-04-23T18:32:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.396+0000 7fe59d5ca640 1 -- 172.21.15.62:0/2445384550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59812ea70 msgr2=0x7fe59812f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.396+0000 7fe59d5ca640 1 --2- 172.21.15.62:0/2445384550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59812ea70 0x7fe59812f270 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe590009d90 tx=0x7fe59002bf50 comp rx=0 tx=0).stop 2024-04-23T18:32:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.396+0000 7fe59d5ca640 1 -- 172.21.15.62:0/2445384550 shutdown_connections 2024-04-23T18:32:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.396+0000 7fe59d5ca640 1 --2- 172.21.15.62:0/2445384550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59812ea70 0x7fe59812f270 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.396+0000 7fe59d5ca640 1 -- 172.21.15.62:0/2445384550 >> 172.21.15.62:0/2445384550 conn(0x7fe5980a1000 msgr2=0x7fe5980a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.396+0000 7fe59d5ca640 1 -- 172.21.15.62:0/2445384550 shutdown_connections 2024-04-23T18:32:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.396+0000 7fe59d5ca640 1 -- 172.21.15.62:0/2445384550 wait complete. 2024-04-23T18:32:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.397+0000 7fe59d5ca640 1 Processor -- start 2024-04-23T18:32:28.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.397+0000 7fe59d5ca640 1 -- start start 2024-04-23T18:32:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.397+0000 7fe59d5ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59812b4f0 0x7fe5981263b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.397+0000 7fe59d5ca640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe59812f930 con 0x7fe59812b4f0 2024-04-23T18:32:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.397+0000 7fe596ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59812b4f0 0x7fe5981263b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.397+0000 7fe596ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59812b4f0 0x7fe5981263b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34114/0 (socket says 172.21.15.62:34114) 2024-04-23T18:32:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.397+0000 7fe596ffd640 1 -- 172.21.15.62:0/558076049 learned_addr learned my addr 172.21.15.62:0/558076049 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.397+0000 7fe596ffd640 1 -- 172.21.15.62:0/558076049 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe598127cb0 con 0x7fe59812b4f0 2024-04-23T18:32:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.398+0000 7fe596ffd640 1 --2- 172.21.15.62:0/558076049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59812b4f0 0x7fe5981263b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe590037040 tx=0x7fe590004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.398+0000 7fe57f7fe640 1 -- 172.21.15.62:0/558076049 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe590044030 con 0x7fe59812b4f0 2024-04-23T18:32:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.398+0000 7fe57f7fe640 1 -- 172.21.15.62:0/558076049 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe590004410 con 0x7fe59812b4f0 2024-04-23T18:32:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.398+0000 7fe59d5ca640 1 -- 172.21.15.62:0/558076049 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe59808b740 con 0x7fe59812b4f0 2024-04-23T18:32:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.398+0000 7fe57f7fe640 1 -- 172.21.15.62:0/558076049 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe590039040 con 0x7fe59812b4f0 2024-04-23T18:32:28.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.398+0000 7fe59d5ca640 1 -- 172.21.15.62:0/558076049 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe59808b290 con 0x7fe59812b4f0 2024-04-23T18:32:28.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.399+0000 7fe57f7fe640 1 -- 172.21.15.62:0/558076049 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fe590047070 con 0x7fe59812b4f0 2024-04-23T18:32:28.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.399+0000 7fe59d5ca640 1 -- 172.21.15.62:0/558076049 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5980505b0 con 0x7fe59812b4f0 2024-04-23T18:32:28.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.399+0000 7fe57f7fe640 1 --2- 172.21.15.62:0/558076049 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe5840385c0 0x7fe58403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:28.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.399+0000 7fe57f7fe640 1 -- 172.21.15.62:0/558076049 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fe590045070 con 0x7fe59812b4f0 2024-04-23T18:32:28.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.399+0000 7fe5967fc640 1 --2- 172.21.15.62:0/558076049 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe5840385c0 0x7fe58403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:28.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.400+0000 7fe5967fc640 1 --2- 172.21.15.62:0/558076049 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe5840385c0 0x7fe58403aa80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe58c007fd0 tx=0x7fe58c0010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:28.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.404+0000 7fe57f7fe640 1 -- 172.21.15.62:0/558076049 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe59004e070 con 0x7fe59812b4f0 2024-04-23T18:32:28.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.587+0000 7fe59d5ca640 1 -- 172.21.15.62:0/558076049 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe598127a80 con 0x7fe5840385c0 2024-04-23T18:32:28.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.602+0000 7fe57f7fe640 1 -- 172.21.15.62:0/558076049 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665730 (secure 0 0 0) 0x7fe598127a80 con 0x7fe5840385c0 2024-04-23T18:32:28.600 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:32:28.605 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-04-23T18:32:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.606+0000 7fe59d5ca640 1 -- 172.21.15.62:0/558076049 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe5840385c0 msgr2=0x7fe58403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.606+0000 7fe59d5ca640 1 --2- 172.21.15.62:0/558076049 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe5840385c0 0x7fe58403aa80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe58c007fd0 tx=0x7fe58c0010a0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.606+0000 7fe59d5ca640 1 -- 172.21.15.62:0/558076049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59812b4f0 msgr2=0x7fe5981263b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.606+0000 7fe59d5ca640 1 --2- 172.21.15.62:0/558076049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59812b4f0 0x7fe5981263b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe590037040 tx=0x7fe590004a40 comp rx=0 tx=0).stop 2024-04-23T18:32:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.606+0000 7fe59d5ca640 1 -- 172.21.15.62:0/558076049 shutdown_connections 2024-04-23T18:32:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.606+0000 7fe59d5ca640 1 --2- 172.21.15.62:0/558076049 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fe5840385c0 0x7fe58403aa80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.606+0000 7fe59d5ca640 1 --2- 172.21.15.62:0/558076049 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe59812b4f0 0x7fe5981263b0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.606+0000 7fe59d5ca640 1 -- 172.21.15.62:0/558076049 >> 172.21.15.62:0/558076049 conn(0x7fe5980a1000 msgr2=0x7fe5981b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.606+0000 7fe59d5ca640 1 -- 172.21.15.62:0/558076049 shutdown_connections 2024-04-23T18:32:28.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.606+0000 7fe59d5ca640 1 -- 172.21.15.62:0/558076049 wait complete. 2024-04-23T18:32:28.609 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-23T18:32:26.742220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412790,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4876,"num_read_kb":4453,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186224,"kb_used_data":40720,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377301136,"statfs":{"total":386547056640,"available":386356363264,"internally_reserved":0,"allocated":41697280,"data_stored":40499426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003805"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.392235+0000","last_change":"2024-04-23T18:29:11.496715+0000","last_active":"2024-04-23T18:31:20.392235+0000","last_peered":"2024-04-23T18:31:20.392235+0000","last_clean":"2024-04-23T18:31:20.392235+0000","last_became_active":"2024-04-23T18:29:11.495610+0000","last_became_peered":"2024-04-23T18:29:11.495610+0000","last_unstale":"2024-04-23T18:31:20.392235+0000","last_undegraded":"2024-04-23T18:31:20.392235+0000","last_fullsized":"2024-04-23T18:31:20.392235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:39:13.562652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216466+0000","last_change":"2024-04-23T18:29:13.493644+0000","last_active":"2024-04-23T18:32:21.216466+0000","last_peered":"2024-04-23T18:32:21.216466+0000","last_clean":"2024-04-23T18:32:21.216466+0000","last_became_active":"2024-04-23T18:29:13.492771+0000","last_became_peered":"2024-04-23T18:29:13.492771+0000","last_unstale":"2024-04-23T18:32:21.216466+0000","last_undegraded":"2024-04-23T18:32:21.216466+0000","last_fullsized":"2024-04-23T18:32:21.216466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:18.652802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549100+0000","last_change":"2024-04-23T18:29:11.495726+0000","last_active":"2024-04-23T18:29:52.549100+0000","last_peered":"2024-04-23T18:29:52.549100+0000","last_clean":"2024-04-23T18:29:52.549100+0000","last_became_active":"2024-04-23T18:29:11.495272+0000","last_became_peered":"2024-04-23T18:29:11.495272+0000","last_unstale":"2024-04-23T18:29:52.549100+0000","last_undegraded":"2024-04-23T18:29:52.549100+0000","last_fullsized":"2024-04-23T18:29:52.549100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:11:21.963212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.145581+0000","last_change":"2024-04-23T18:29:13.495212+0000","last_active":"2024-04-23T18:32:21.145581+0000","last_peered":"2024-04-23T18:32:21.145581+0000","last_clean":"2024-04-23T18:32:21.145581+0000","last_became_active":"2024-04-23T18:29:13.494969+0000","last_became_peered":"2024-04-23T18:29:13.494969+0000","last_unstale":"2024-04-23T18:32:21.145581+0000","last_undegraded":"2024-04-23T18:32:21.145581+0000","last_fullsized":"2024-04-23T18:32:21.145581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:31.120065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.883853+0000","last_change":"2024-04-23T18:29:11.505594+0000","last_active":"2024-04-23T18:32:20.883853+0000","last_peered":"2024-04-23T18:32:20.883853+0000","last_clean":"2024-04-23T18:32:20.883853+0000","last_became_active":"2024-04-23T18:29:11.505283+0000","last_became_peered":"2024-04-23T18:29:11.505283+0000","last_unstale":"2024-04-23T18:32:20.883853+0000","last_undegraded":"2024-04-23T18:32:20.883853+0000","last_fullsized":"2024-04-23T18:32:20.883853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:22.032624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549437+0000","last_change":"2024-04-23T18:29:13.495612+0000","last_active":"2024-04-23T18:29:52.549437+0000","last_peered":"2024-04-23T18:29:52.549437+0000","last_clean":"2024-04-23T18:29:52.549437+0000","last_became_active":"2024-04-23T18:29:13.495367+0000","last_became_peered":"2024-04-23T18:29:13.495367+0000","last_unstale":"2024-04-23T18:29:52.549437+0000","last_undegraded":"2024-04-23T18:29:52.549437+0000","last_fullsized":"2024-04-23T18:29:52.549437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:46.592957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542142+0000","last_change":"2024-04-23T18:29:11.496818+0000","last_active":"2024-04-23T18:29:52.542142+0000","last_peered":"2024-04-23T18:29:52.542142+0000","last_clean":"2024-04-23T18:29:52.542142+0000","last_became_active":"2024-04-23T18:29:11.495677+0000","last_became_peered":"2024-04-23T18:29:11.495677+0000","last_unstale":"2024-04-23T18:29:52.542142+0000","last_undegraded":"2024-04-23T18:29:52.542142+0000","last_fullsized":"2024-04-23T18:29:52.542142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:36.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223517+0000","last_change":"2024-04-23T18:29:52.558192+0000","last_active":"2024-04-23T18:32:21.223517+0000","last_peered":"2024-04-23T18:32:21.223517+0000","last_clean":"2024-04-23T18:32:21.223517+0000","last_became_active":"2024-04-23T18:29:52.548291+0000","last_became_peered":"2024-04-23T18:29:52.548291+0000","last_unstale":"2024-04-23T18:32:21.223517+0000","last_undegraded":"2024-04-23T18:32:21.223517+0000","last_fullsized":"2024-04-23T18:32:21.223517+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:21.650682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548661+0000","last_change":"2024-04-23T18:29:11.504896+0000","last_active":"2024-04-23T18:29:52.548661+0000","last_peered":"2024-04-23T18:29:52.548661+0000","last_clean":"2024-04-23T18:29:52.548661+0000","last_became_active":"2024-04-23T18:29:11.504554+0000","last_became_peered":"2024-04-23T18:29:11.504554+0000","last_unstale":"2024-04-23T18:29:52.548661+0000","last_undegraded":"2024-04-23T18:29:52.548661+0000","last_fullsized":"2024-04-23T18:29:52.548661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:17.981912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'5","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223019+0000","last_change":"2024-04-23T18:29:13.498634+0000","last_active":"2024-04-23T18:32:21.223019+0000","last_peered":"2024-04-23T18:32:21.223019+0000","last_clean":"2024-04-23T18:32:21.223019+0000","last_became_active":"2024-04-23T18:29:13.498378+0000","last_became_peered":"2024-04-23T18:29:13.498378+0000","last_unstale":"2024-04-23T18:32:21.223019+0000","last_undegraded":"2024-04-23T18:32:21.223019+0000","last_fullsized":"2024-04-23T18:32:21.223019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:53:35.946871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541220+0000","last_change":"2024-04-23T18:29:11.497271+0000","last_active":"2024-04-23T18:29:52.541220+0000","last_peered":"2024-04-23T18:29:52.541220+0000","last_clean":"2024-04-23T18:29:52.541220+0000","last_became_active":"2024-04-23T18:29:11.496923+0000","last_became_peered":"2024-04-23T18:29:11.496923+0000","last_unstale":"2024-04-23T18:29:52.541220+0000","last_undegraded":"2024-04-23T18:29:52.541220+0000","last_fullsized":"2024-04-23T18:29:52.541220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:28.851647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.758897+0000","last_change":"2024-04-23T18:29:13.503166+0000","last_active":"2024-04-23T18:29:53.758897+0000","last_peered":"2024-04-23T18:29:53.758897+0000","last_clean":"2024-04-23T18:29:53.758897+0000","last_became_active":"2024-04-23T18:29:13.502401+0000","last_became_peered":"2024-04-23T18:29:13.502401+0000","last_unstale":"2024-04-23T18:29:53.758897+0000","last_undegraded":"2024-04-23T18:29:53.758897+0000","last_fullsized":"2024-04-23T18:29:53.758897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:29:37.305411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.126025+0000","last_change":"2024-04-23T18:29:11.500102+0000","last_active":"2024-04-23T18:32:21.126025+0000","last_peered":"2024-04-23T18:32:21.126025+0000","last_clean":"2024-04-23T18:32:21.126025+0000","last_became_active":"2024-04-23T18:29:11.499772+0000","last_became_peered":"2024-04-23T18:29:11.499772+0000","last_unstale":"2024-04-23T18:32:21.126025+0000","last_undegraded":"2024-04-23T18:32:21.126025+0000","last_fullsized":"2024-04-23T18:32:21.126025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:33:31.780314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998531+0000","last_change":"2024-04-23T18:29:13.499669+0000","last_active":"2024-04-23T18:32:20.998531+0000","last_peered":"2024-04-23T18:32:20.998531+0000","last_clean":"2024-04-23T18:32:20.998531+0000","last_became_active":"2024-04-23T18:29:13.498965+0000","last_became_peered":"2024-04-23T18:29:13.498965+0000","last_unstale":"2024-04-23T18:32:20.998531+0000","last_undegraded":"2024-04-23T18:32:20.998531+0000","last_fullsized":"2024-04-23T18:32:20.998531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:55.148135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.524275+0000","last_change":"2024-04-23T18:29:11.493089+0000","last_active":"2024-04-23T18:31:20.524275+0000","last_peered":"2024-04-23T18:31:20.524275+0000","last_clean":"2024-04-23T18:31:20.524275+0000","last_became_active":"2024-04-23T18:29:11.491840+0000","last_became_peered":"2024-04-23T18:29:11.491840+0000","last_unstale":"2024-04-23T18:31:20.524275+0000","last_undegraded":"2024-04-23T18:31:20.524275+0000","last_fullsized":"2024-04-23T18:31:20.524275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:35.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136278+0000","last_change":"2024-04-23T18:29:13.505657+0000","last_active":"2024-04-23T18:32:21.136278+0000","last_peered":"2024-04-23T18:32:21.136278+0000","last_clean":"2024-04-23T18:32:21.136278+0000","last_became_active":"2024-04-23T18:29:13.505348+0000","last_became_peered":"2024-04-23T18:29:13.505348+0000","last_unstale":"2024-04-23T18:32:21.136278+0000","last_undegraded":"2024-04-23T18:32:21.136278+0000","last_fullsized":"2024-04-23T18:32:21.136278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:01.869007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.809404+0000","last_change":"2024-04-23T18:29:13.495619+0000","last_active":"2024-04-23T18:29:54.809404+0000","last_peered":"2024-04-23T18:29:54.809404+0000","last_clean":"2024-04-23T18:29:54.809404+0000","last_became_active":"2024-04-23T18:29:13.495337+0000","last_became_peered":"2024-04-23T18:29:13.495337+0000","last_unstale":"2024-04-23T18:29:54.809404+0000","last_undegraded":"2024-04-23T18:29:54.809404+0000","last_fullsized":"2024-04-23T18:29:54.809404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:01.568090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.207467+0000","last_change":"2024-04-23T18:29:11.502496+0000","last_active":"2024-04-23T18:29:53.207467+0000","last_peered":"2024-04-23T18:29:53.207467+0000","last_clean":"2024-04-23T18:29:53.207467+0000","last_became_active":"2024-04-23T18:29:11.501773+0000","last_became_peered":"2024-04-23T18:29:11.501773+0000","last_unstale":"2024-04-23T18:29:53.207467+0000","last_undegraded":"2024-04-23T18:29:53.207467+0000","last_fullsized":"2024-04-23T18:29:53.207467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:34.195698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.094606+0000","last_change":"2024-04-23T18:29:13.493129+0000","last_active":"2024-04-23T18:29:54.094606+0000","last_peered":"2024-04-23T18:29:54.094606+0000","last_clean":"2024-04-23T18:29:54.094606+0000","last_became_active":"2024-04-23T18:29:13.492366+0000","last_became_peered":"2024-04-23T18:29:13.492366+0000","last_unstale":"2024-04-23T18:29:54.094606+0000","last_undegraded":"2024-04-23T18:29:54.094606+0000","last_fullsized":"2024-04-23T18:29:54.094606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:55.148135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.500819+0000","last_change":"2024-04-23T18:29:11.486168+0000","last_active":"2024-04-23T18:31:20.500819+0000","last_peered":"2024-04-23T18:31:20.500819+0000","last_clean":"2024-04-23T18:31:20.500819+0000","last_became_active":"2024-04-23T18:29:11.484620+0000","last_became_peered":"2024-04-23T18:29:11.484620+0000","last_unstale":"2024-04-23T18:31:20.500819+0000","last_undegraded":"2024-04-23T18:31:20.500819+0000","last_fullsized":"2024-04-23T18:31:20.500819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:49.661961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'16","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216433+0000","last_change":"2024-04-23T18:29:13.496876+0000","last_active":"2024-04-23T18:32:21.216433+0000","last_peered":"2024-04-23T18:32:21.216433+0000","last_clean":"2024-04-23T18:32:21.216433+0000","last_became_active":"2024-04-23T18:29:13.495743+0000","last_became_peered":"2024-04-23T18:29:13.495743+0000","last_unstale":"2024-04-23T18:32:21.216433+0000","last_undegraded":"2024-04-23T18:32:21.216433+0000","last_fullsized":"2024-04-23T18:32:21.216433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:43.595018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547080+0000","last_change":"2024-04-23T18:29:11.494610+0000","last_active":"2024-04-23T18:29:52.547080+0000","last_peered":"2024-04-23T18:29:52.547080+0000","last_clean":"2024-04-23T18:29:52.547080+0000","last_became_active":"2024-04-23T18:29:11.493363+0000","last_became_peered":"2024-04-23T18:29:11.493363+0000","last_unstale":"2024-04-23T18:29:52.547080+0000","last_undegraded":"2024-04-23T18:29:52.547080+0000","last_fullsized":"2024-04-23T18:29:52.547080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:08:38.534696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759623+0000","last_change":"2024-04-23T18:29:13.502315+0000","last_active":"2024-04-23T18:31:39.759623+0000","last_peered":"2024-04-23T18:31:39.759623+0000","last_clean":"2024-04-23T18:31:39.759623+0000","last_became_active":"2024-04-23T18:29:13.501988+0000","last_became_peered":"2024-04-23T18:29:13.501988+0000","last_unstale":"2024-04-23T18:31:39.759623+0000","last_undegraded":"2024-04-23T18:31:39.759623+0000","last_fullsized":"2024-04-23T18:31:39.759623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:13:37.517178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546632+0000","last_change":"2024-04-23T18:29:11.503048+0000","last_active":"2024-04-23T18:29:52.546632+0000","last_peered":"2024-04-23T18:29:52.546632+0000","last_clean":"2024-04-23T18:29:52.546632+0000","last_became_active":"2024-04-23T18:29:11.502714+0000","last_became_peered":"2024-04-23T18:29:11.502714+0000","last_unstale":"2024-04-23T18:29:52.546632+0000","last_undegraded":"2024-04-23T18:29:52.546632+0000","last_fullsized":"2024-04-23T18:29:52.546632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:03.508942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216074+0000","last_change":"2024-04-23T18:29:13.499010+0000","last_active":"2024-04-23T18:32:21.216074+0000","last_peered":"2024-04-23T18:32:21.216074+0000","last_clean":"2024-04-23T18:32:21.216074+0000","last_became_active":"2024-04-23T18:29:13.498488+0000","last_became_peered":"2024-04-23T18:29:13.498488+0000","last_unstale":"2024-04-23T18:32:21.216074+0000","last_undegraded":"2024-04-23T18:32:21.216074+0000","last_fullsized":"2024-04-23T18:32:21.216074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:43.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548048+0000","last_change":"2024-04-23T18:29:11.495476+0000","last_active":"2024-04-23T18:29:52.548048+0000","last_peered":"2024-04-23T18:29:52.548048+0000","last_clean":"2024-04-23T18:29:52.548048+0000","last_became_active":"2024-04-23T18:29:11.495025+0000","last_became_peered":"2024-04-23T18:29:11.495025+0000","last_unstale":"2024-04-23T18:29:52.548048+0000","last_undegraded":"2024-04-23T18:29:52.548048+0000","last_fullsized":"2024-04-23T18:29:52.548048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:20.311305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.546632+0000","last_change":"2024-04-23T18:29:13.494330+0000","last_active":"2024-04-23T18:31:20.546632+0000","last_peered":"2024-04-23T18:31:20.546632+0000","last_clean":"2024-04-23T18:31:20.546632+0000","last_became_active":"2024-04-23T18:29:13.494080+0000","last_became_peered":"2024-04-23T18:29:13.494080+0000","last_unstale":"2024-04-23T18:31:20.546632+0000","last_undegraded":"2024-04-23T18:31:20.546632+0000","last_fullsized":"2024-04-23T18:31:20.546632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:19.116233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548882+0000","last_change":"2024-04-23T18:29:11.507699+0000","last_active":"2024-04-23T18:29:52.548882+0000","last_peered":"2024-04-23T18:29:52.548882+0000","last_clean":"2024-04-23T18:29:52.548882+0000","last_became_active":"2024-04-23T18:29:11.507336+0000","last_became_peered":"2024-04-23T18:29:11.507336+0000","last_unstale":"2024-04-23T18:29:52.548882+0000","last_undegraded":"2024-04-23T18:29:52.548882+0000","last_fullsized":"2024-04-23T18:29:52.548882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:33.718239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.160581+0000","last_change":"2024-04-23T18:29:21.530202+0000","last_active":"2024-04-23T18:32:21.160581+0000","last_peered":"2024-04-23T18:32:21.160581+0000","last_clean":"2024-04-23T18:32:21.160581+0000","last_became_active":"2024-04-23T18:29:21.529771+0000","last_became_peered":"2024-04-23T18:29:21.529771+0000","last_unstale":"2024-04-23T18:32:21.160581+0000","last_undegraded":"2024-04-23T18:32:21.160581+0000","last_fullsized":"2024-04-23T18:32:21.160581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:45.343308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'22","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216053+0000","last_change":"2024-04-23T18:29:52.561113+0000","last_active":"2024-04-23T18:32:21.216053+0000","last_peered":"2024-04-23T18:32:21.216053+0000","last_clean":"2024-04-23T18:32:21.216053+0000","last_became_active":"2024-04-23T18:29:52.549641+0000","last_became_peered":"2024-04-23T18:29:52.549641+0000","last_unstale":"2024-04-23T18:32:21.216053+0000","last_undegraded":"2024-04-23T18:32:21.216053+0000","last_fullsized":"2024-04-23T18:32:21.216053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:47:49.212714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":69,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761819+0000","last_change":"2024-04-23T18:29:11.512384+0000","last_active":"2024-04-23T18:31:31.761819+0000","last_peered":"2024-04-23T18:31:31.761819+0000","last_clean":"2024-04-23T18:31:31.761819+0000","last_became_active":"2024-04-23T18:29:11.512062+0000","last_became_peered":"2024-04-23T18:29:11.512062+0000","last_unstale":"2024-04-23T18:31:31.761819+0000","last_undegraded":"2024-04-23T18:31:31.761819+0000","last_fullsized":"2024-04-23T18:31:31.761819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:39.110614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552423+0000","last_change":"2024-04-23T18:29:15.508358+0000","last_active":"2024-04-23T18:29:52.552423+0000","last_peered":"2024-04-23T18:29:52.552423+0000","last_clean":"2024-04-23T18:29:52.552423+0000","last_became_active":"2024-04-23T18:29:15.508100+0000","last_became_peered":"2024-04-23T18:29:15.508100+0000","last_unstale":"2024-04-23T18:29:52.552423+0000","last_undegraded":"2024-04-23T18:29:52.552423+0000","last_fullsized":"2024-04-23T18:29:52.552423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:20.697054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.037486+0000","last_change":"2024-04-23T18:29:17.513687+0000","last_active":"2024-04-23T18:31:19.037486+0000","last_peered":"2024-04-23T18:31:19.037486+0000","last_clean":"2024-04-23T18:31:19.037486+0000","last_became_active":"2024-04-23T18:29:17.513368+0000","last_became_peered":"2024-04-23T18:29:17.513368+0000","last_unstale":"2024-04-23T18:31:19.037486+0000","last_undegraded":"2024-04-23T18:31:19.037486+0000","last_fullsized":"2024-04-23T18:31:19.037486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:24.244501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548046+0000","last_change":"2024-04-23T18:29:19.520367+0000","last_active":"2024-04-23T18:29:52.548046+0000","last_peered":"2024-04-23T18:29:52.548046+0000","last_clean":"2024-04-23T18:29:52.548046+0000","last_became_active":"2024-04-23T18:29:19.520066+0000","last_became_peered":"2024-04-23T18:29:19.520066+0000","last_unstale":"2024-04-23T18:29:52.548046+0000","last_undegraded":"2024-04-23T18:29:52.548046+0000","last_fullsized":"2024-04-23T18:29:52.548046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:25.717857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.543713+0000","last_change":"2024-04-23T18:29:21.530037+0000","last_active":"2024-04-23T18:31:20.543713+0000","last_peered":"2024-04-23T18:31:20.543713+0000","last_clean":"2024-04-23T18:31:20.543713+0000","last_became_active":"2024-04-23T18:29:21.529743+0000","last_became_peered":"2024-04-23T18:29:21.529743+0000","last_unstale":"2024-04-23T18:31:20.543713+0000","last_undegraded":"2024-04-23T18:31:20.543713+0000","last_fullsized":"2024-04-23T18:31:20.543713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:07.650347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'9","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.005291+0000","last_change":"2024-04-23T18:29:13.496552+0000","last_active":"2024-04-23T18:32:21.005291+0000","last_peered":"2024-04-23T18:32:21.005291+0000","last_clean":"2024-04-23T18:32:21.005291+0000","last_became_active":"2024-04-23T18:29:13.496299+0000","last_became_peered":"2024-04-23T18:29:13.496299+0000","last_unstale":"2024-04-23T18:32:21.005291+0000","last_undegraded":"2024-04-23T18:32:21.005291+0000","last_fullsized":"2024-04-23T18:32:21.005291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:46.067635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.207501+0000","last_change":"2024-04-23T18:29:11.497209+0000","last_active":"2024-04-23T18:29:53.207501+0000","last_peered":"2024-04-23T18:29:53.207501+0000","last_clean":"2024-04-23T18:29:53.207501+0000","last_became_active":"2024-04-23T18:29:11.496878+0000","last_became_peered":"2024-04-23T18:29:11.496878+0000","last_unstale":"2024-04-23T18:29:53.207501+0000","last_undegraded":"2024-04-23T18:29:53.207501+0000","last_fullsized":"2024-04-23T18:29:53.207501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:03.508942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547455+0000","last_change":"2024-04-23T18:29:15.504985+0000","last_active":"2024-04-23T18:29:52.547455+0000","last_peered":"2024-04-23T18:29:52.547455+0000","last_clean":"2024-04-23T18:29:52.547455+0000","last_became_active":"2024-04-23T18:29:15.504744+0000","last_became_peered":"2024-04-23T18:29:15.504744+0000","last_unstale":"2024-04-23T18:29:52.547455+0000","last_undegraded":"2024-04-23T18:29:52.547455+0000","last_fullsized":"2024-04-23T18:29:52.547455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:03.110961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548072+0000","last_change":"2024-04-23T18:29:17.510462+0000","last_active":"2024-04-23T18:29:52.548072+0000","last_peered":"2024-04-23T18:29:52.548072+0000","last_clean":"2024-04-23T18:29:52.548072+0000","last_became_active":"2024-04-23T18:29:17.510201+0000","last_became_peered":"2024-04-23T18:29:17.510201+0000","last_unstale":"2024-04-23T18:29:52.548072+0000","last_undegraded":"2024-04-23T18:29:52.548072+0000","last_fullsized":"2024-04-23T18:29:52.548072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:45:44.947602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546953+0000","last_change":"2024-04-23T18:29:19.528113+0000","last_active":"2024-04-23T18:29:52.546953+0000","last_peered":"2024-04-23T18:29:52.546953+0000","last_clean":"2024-04-23T18:29:52.546953+0000","last_became_active":"2024-04-23T18:29:19.527770+0000","last_became_peered":"2024-04-23T18:29:19.527770+0000","last_unstale":"2024-04-23T18:29:52.546953+0000","last_undegraded":"2024-04-23T18:29:52.546953+0000","last_fullsized":"2024-04-23T18:29:52.546953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:24.718294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546581+0000","last_change":"2024-04-23T18:29:21.526235+0000","last_active":"2024-04-23T18:29:52.546581+0000","last_peered":"2024-04-23T18:29:52.546581+0000","last_clean":"2024-04-23T18:29:52.546581+0000","last_became_active":"2024-04-23T18:29:21.525940+0000","last_became_peered":"2024-04-23T18:29:21.525940+0000","last_unstale":"2024-04-23T18:29:52.546581+0000","last_undegraded":"2024-04-23T18:29:52.546581+0000","last_fullsized":"2024-04-23T18:29:52.546581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:38.457462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216175+0000","last_change":"2024-04-23T18:29:13.496417+0000","last_active":"2024-04-23T18:32:21.216175+0000","last_peered":"2024-04-23T18:32:21.216175+0000","last_clean":"2024-04-23T18:32:21.216175+0000","last_became_active":"2024-04-23T18:29:13.496142+0000","last_became_peered":"2024-04-23T18:29:13.496142+0000","last_unstale":"2024-04-23T18:32:21.216175+0000","last_undegraded":"2024-04-23T18:32:21.216175+0000","last_fullsized":"2024-04-23T18:32:21.216175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:36:50.428324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549926+0000","last_change":"2024-04-23T18:29:11.504850+0000","last_active":"2024-04-23T18:29:52.549926+0000","last_peered":"2024-04-23T18:29:52.549926+0000","last_clean":"2024-04-23T18:29:52.549926+0000","last_became_active":"2024-04-23T18:29:11.504534+0000","last_became_peered":"2024-04-23T18:29:11.504534+0000","last_unstale":"2024-04-23T18:29:52.549926+0000","last_undegraded":"2024-04-23T18:29:52.549926+0000","last_fullsized":"2024-04-23T18:29:52.549926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:52.910514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549373+0000","last_change":"2024-04-23T18:29:15.510428+0000","last_active":"2024-04-23T18:29:52.549373+0000","last_peered":"2024-04-23T18:29:52.549373+0000","last_clean":"2024-04-23T18:29:52.549373+0000","last_became_active":"2024-04-23T18:29:15.510018+0000","last_became_peered":"2024-04-23T18:29:15.510018+0000","last_unstale":"2024-04-23T18:29:52.549373+0000","last_undegraded":"2024-04-23T18:29:52.549373+0000","last_fullsized":"2024-04-23T18:29:52.549373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:31.579537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.323469+0000","last_change":"2024-04-23T18:29:17.518086+0000","last_active":"2024-04-23T18:29:54.323469+0000","last_peered":"2024-04-23T18:29:54.323469+0000","last_clean":"2024-04-23T18:29:54.323469+0000","last_became_active":"2024-04-23T18:29:17.517679+0000","last_became_peered":"2024-04-23T18:29:17.517679+0000","last_unstale":"2024-04-23T18:29:54.323469+0000","last_undegraded":"2024-04-23T18:29:54.323469+0000","last_fullsized":"2024-04-23T18:29:54.323469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:02:29.059730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585443+0000","last_change":"2024-04-23T18:29:19.522798+0000","last_active":"2024-04-23T18:32:20.585443+0000","last_peered":"2024-04-23T18:32:20.585443+0000","last_clean":"2024-04-23T18:32:20.585443+0000","last_became_active":"2024-04-23T18:29:19.522434+0000","last_became_peered":"2024-04-23T18:29:19.522434+0000","last_unstale":"2024-04-23T18:32:20.585443+0000","last_undegraded":"2024-04-23T18:32:20.585443+0000","last_fullsized":"2024-04-23T18:32:20.585443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:32.658811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541070+0000","last_change":"2024-04-23T18:29:21.529767+0000","last_active":"2024-04-23T18:29:52.541070+0000","last_peered":"2024-04-23T18:29:52.541070+0000","last_clean":"2024-04-23T18:29:52.541070+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:29:52.541070+0000","last_undegraded":"2024-04-23T18:29:52.541070+0000","last_fullsized":"2024-04-23T18:29:52.541070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:48.933035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278231+0000","last_change":"2024-04-23T18:29:13.499630+0000","last_active":"2024-04-23T18:31:17.278231+0000","last_peered":"2024-04-23T18:31:17.278231+0000","last_clean":"2024-04-23T18:31:17.278231+0000","last_became_active":"2024-04-23T18:29:13.499248+0000","last_became_peered":"2024-04-23T18:29:13.499248+0000","last_unstale":"2024-04-23T18:31:17.278231+0000","last_undegraded":"2024-04-23T18:31:17.278231+0000","last_fullsized":"2024-04-23T18:31:17.278231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:55:09.572902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542903+0000","last_change":"2024-04-23T18:29:11.488862+0000","last_active":"2024-04-23T18:29:52.542903+0000","last_peered":"2024-04-23T18:29:52.542903+0000","last_clean":"2024-04-23T18:29:52.542903+0000","last_became_active":"2024-04-23T18:29:11.488531+0000","last_became_peered":"2024-04-23T18:29:11.488531+0000","last_unstale":"2024-04-23T18:29:52.542903+0000","last_undegraded":"2024-04-23T18:29:52.542903+0000","last_fullsized":"2024-04-23T18:29:52.542903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:28.851647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552314+0000","last_change":"2024-04-23T18:29:15.511603+0000","last_active":"2024-04-23T18:29:52.552314+0000","last_peered":"2024-04-23T18:29:52.552314+0000","last_clean":"2024-04-23T18:29:52.552314+0000","last_became_active":"2024-04-23T18:29:15.511249+0000","last_became_peered":"2024-04-23T18:29:15.511249+0000","last_unstale":"2024-04-23T18:29:52.552314+0000","last_undegraded":"2024-04-23T18:29:52.552314+0000","last_fullsized":"2024-04-23T18:29:52.552314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:43:24.269505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.032342+0000","last_change":"2024-04-23T18:29:17.518244+0000","last_active":"2024-04-23T18:31:19.032342+0000","last_peered":"2024-04-23T18:31:19.032342+0000","last_clean":"2024-04-23T18:31:19.032342+0000","last_became_active":"2024-04-23T18:29:17.517964+0000","last_became_peered":"2024-04-23T18:29:17.517964+0000","last_unstale":"2024-04-23T18:31:19.032342+0000","last_undegraded":"2024-04-23T18:31:19.032342+0000","last_fullsized":"2024-04-23T18:31:19.032342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:49.766603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":441,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.219733+0000","last_change":"2024-04-23T18:29:19.525252+0000","last_active":"2024-04-23T18:32:21.219733+0000","last_peered":"2024-04-23T18:32:21.219733+0000","last_clean":"2024-04-23T18:32:21.219733+0000","last_became_active":"2024-04-23T18:29:19.524881+0000","last_became_peered":"2024-04-23T18:29:19.524881+0000","last_unstale":"2024-04-23T18:32:21.219733+0000","last_undegraded":"2024-04-23T18:32:21.219733+0000","last_fullsized":"2024-04-23T18:32:21.219733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:32.759949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185271+0000","last_change":"2024-04-23T18:29:13.502374+0000","last_active":"2024-04-23T18:32:21.185271+0000","last_peered":"2024-04-23T18:32:21.185271+0000","last_clean":"2024-04-23T18:32:21.185271+0000","last_became_active":"2024-04-23T18:29:13.501472+0000","last_became_peered":"2024-04-23T18:29:13.501472+0000","last_unstale":"2024-04-23T18:32:21.185271+0000","last_undegraded":"2024-04-23T18:32:21.185271+0000","last_fullsized":"2024-04-23T18:32:21.185271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:48.669984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'5","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.605427+0000","last_change":"2024-04-23T18:29:11.483640+0000","last_active":"2024-04-23T18:30:36.605427+0000","last_peered":"2024-04-23T18:30:36.605427+0000","last_clean":"2024-04-23T18:30:36.605427+0000","last_became_active":"2024-04-23T18:29:11.481977+0000","last_became_peered":"2024-04-23T18:29:11.481977+0000","last_unstale":"2024-04-23T18:30:36.605427+0000","last_undegraded":"2024-04-23T18:30:36.605427+0000","last_fullsized":"2024-04-23T18:30:36.605427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:55.553919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543298+0000","last_change":"2024-04-23T18:29:15.510021+0000","last_active":"2024-04-23T18:29:52.543298+0000","last_peered":"2024-04-23T18:29:52.543298+0000","last_clean":"2024-04-23T18:29:52.543298+0000","last_became_active":"2024-04-23T18:29:15.509711+0000","last_became_peered":"2024-04-23T18:29:15.509711+0000","last_unstale":"2024-04-23T18:29:52.543298+0000","last_undegraded":"2024-04-23T18:29:52.543298+0000","last_fullsized":"2024-04-23T18:29:52.543298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:31.895433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'40","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.041931+0000","last_change":"2024-04-23T18:29:17.511358+0000","last_active":"2024-04-23T18:31:19.041931+0000","last_peered":"2024-04-23T18:31:19.041931+0000","last_clean":"2024-04-23T18:31:19.041931+0000","last_became_active":"2024-04-23T18:29:17.511085+0000","last_became_peered":"2024-04-23T18:29:17.511085+0000","last_unstale":"2024-04-23T18:31:19.041931+0000","last_undegraded":"2024-04-23T18:31:19.041931+0000","last_fullsized":"2024-04-23T18:31:19.041931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:33.909507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547808+0000","last_change":"2024-04-23T18:29:19.527807+0000","last_active":"2024-04-23T18:29:52.547808+0000","last_peered":"2024-04-23T18:29:52.547808+0000","last_clean":"2024-04-23T18:29:52.547808+0000","last_became_active":"2024-04-23T18:29:19.527505+0000","last_became_peered":"2024-04-23T18:29:19.527505+0000","last_unstale":"2024-04-23T18:29:52.547808+0000","last_undegraded":"2024-04-23T18:29:52.547808+0000","last_fullsized":"2024-04-23T18:29:52.547808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:22:25.429131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'13","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.636252+0000","last_change":"2024-04-23T18:29:21.532533+0000","last_active":"2024-04-23T18:32:20.636252+0000","last_peered":"2024-04-23T18:32:20.636252+0000","last_clean":"2024-04-23T18:32:20.636252+0000","last_became_active":"2024-04-23T18:29:21.532163+0000","last_became_peered":"2024-04-23T18:29:21.532163+0000","last_unstale":"2024-04-23T18:32:20.636252+0000","last_undegraded":"2024-04-23T18:32:20.636252+0000","last_fullsized":"2024-04-23T18:32:20.636252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:35.252958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.795754+0000","last_change":"2024-04-23T18:29:13.494415+0000","last_active":"2024-04-23T18:30:36.795754+0000","last_peered":"2024-04-23T18:30:36.795754+0000","last_clean":"2024-04-23T18:30:36.795754+0000","last_became_active":"2024-04-23T18:29:13.494108+0000","last_became_peered":"2024-04-23T18:29:13.494108+0000","last_unstale":"2024-04-23T18:30:36.795754+0000","last_undegraded":"2024-04-23T18:30:36.795754+0000","last_fullsized":"2024-04-23T18:30:36.795754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:48.393428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543652+0000","last_change":"2024-04-23T18:29:11.481951+0000","last_active":"2024-04-23T18:29:52.543652+0000","last_peered":"2024-04-23T18:29:52.543652+0000","last_clean":"2024-04-23T18:29:52.543652+0000","last_became_active":"2024-04-23T18:29:11.481419+0000","last_became_peered":"2024-04-23T18:29:11.481419+0000","last_unstale":"2024-04-23T18:29:52.543652+0000","last_undegraded":"2024-04-23T18:29:52.543652+0000","last_fullsized":"2024-04-23T18:29:52.543652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:30.568409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546778+0000","last_change":"2024-04-23T18:29:15.510512+0000","last_active":"2024-04-23T18:29:52.546778+0000","last_peered":"2024-04-23T18:29:52.546778+0000","last_clean":"2024-04-23T18:29:52.546778+0000","last_became_active":"2024-04-23T18:29:15.510135+0000","last_became_peered":"2024-04-23T18:29:15.510135+0000","last_unstale":"2024-04-23T18:29:52.546778+0000","last_undegraded":"2024-04-23T18:29:52.546778+0000","last_fullsized":"2024-04-23T18:29:52.546778+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:34:51.553982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.021828+0000","last_change":"2024-04-23T18:29:17.513711+0000","last_active":"2024-04-23T18:31:19.021828+0000","last_peered":"2024-04-23T18:31:19.021828+0000","last_clean":"2024-04-23T18:31:19.021828+0000","last_became_active":"2024-04-23T18:29:17.513447+0000","last_became_peered":"2024-04-23T18:29:17.513447+0000","last_unstale":"2024-04-23T18:31:19.021828+0000","last_undegraded":"2024-04-23T18:31:19.021828+0000","last_fullsized":"2024-04-23T18:31:19.021828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:53.226081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546745+0000","last_change":"2024-04-23T18:29:19.518994+0000","last_active":"2024-04-23T18:29:52.546745+0000","last_peered":"2024-04-23T18:29:52.546745+0000","last_clean":"2024-04-23T18:29:52.546745+0000","last_became_active":"2024-04-23T18:29:19.518695+0000","last_became_peered":"2024-04-23T18:29:19.518695+0000","last_unstale":"2024-04-23T18:29:52.546745+0000","last_undegraded":"2024-04-23T18:29:52.546745+0000","last_fullsized":"2024-04-23T18:29:52.546745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:31:26.171589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.187825+0000","last_change":"2024-04-23T18:29:21.533423+0000","last_active":"2024-04-23T18:32:21.187825+0000","last_peered":"2024-04-23T18:32:21.187825+0000","last_clean":"2024-04-23T18:32:21.187825+0000","last_became_active":"2024-04-23T18:29:21.533103+0000","last_became_peered":"2024-04-23T18:29:21.533103+0000","last_unstale":"2024-04-23T18:32:21.187825+0000","last_undegraded":"2024-04-23T18:32:21.187825+0000","last_fullsized":"2024-04-23T18:32:21.187825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:55:25.843294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'12","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216152+0000","last_change":"2024-04-23T18:29:13.500105+0000","last_active":"2024-04-23T18:32:21.216152+0000","last_peered":"2024-04-23T18:32:21.216152+0000","last_clean":"2024-04-23T18:32:21.216152+0000","last_became_active":"2024-04-23T18:29:13.499795+0000","last_became_peered":"2024-04-23T18:29:13.499795+0000","last_unstale":"2024-04-23T18:32:21.216152+0000","last_undegraded":"2024-04-23T18:32:21.216152+0000","last_fullsized":"2024-04-23T18:32:21.216152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:53:51.760582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552836+0000","last_change":"2024-04-23T18:29:11.503536+0000","last_active":"2024-04-23T18:29:52.552836+0000","last_peered":"2024-04-23T18:29:52.552836+0000","last_clean":"2024-04-23T18:29:52.552836+0000","last_became_active":"2024-04-23T18:29:11.503228+0000","last_became_peered":"2024-04-23T18:29:11.503228+0000","last_unstale":"2024-04-23T18:29:52.552836+0000","last_undegraded":"2024-04-23T18:29:52.552836+0000","last_fullsized":"2024-04-23T18:29:52.552836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:41.470810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548689+0000","last_change":"2024-04-23T18:29:15.510453+0000","last_active":"2024-04-23T18:29:52.548689+0000","last_peered":"2024-04-23T18:29:52.548689+0000","last_clean":"2024-04-23T18:29:52.548689+0000","last_became_active":"2024-04-23T18:29:15.509856+0000","last_became_peered":"2024-04-23T18:29:15.509856+0000","last_unstale":"2024-04-23T18:29:52.548689+0000","last_undegraded":"2024-04-23T18:29:52.548689+0000","last_fullsized":"2024-04-23T18:29:52.548689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:23.285461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'39","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.760976+0000","last_change":"2024-04-23T18:29:17.517429+0000","last_active":"2024-04-23T18:31:26.760976+0000","last_peered":"2024-04-23T18:31:26.760976+0000","last_clean":"2024-04-23T18:31:26.760976+0000","last_became_active":"2024-04-23T18:29:17.517116+0000","last_became_peered":"2024-04-23T18:29:17.517116+0000","last_unstale":"2024-04-23T18:31:26.760976+0000","last_undegraded":"2024-04-23T18:31:26.760976+0000","last_fullsized":"2024-04-23T18:31:26.760976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:11.788105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":348,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.336039+0000","last_change":"2024-04-23T18:29:19.518873+0000","last_active":"2024-04-23T18:32:21.336039+0000","last_peered":"2024-04-23T18:32:21.336039+0000","last_clean":"2024-04-23T18:32:21.336039+0000","last_became_active":"2024-04-23T18:29:19.518519+0000","last_became_peered":"2024-04-23T18:29:19.518519+0000","last_unstale":"2024-04-23T18:32:21.336039+0000","last_undegraded":"2024-04-23T18:32:21.336039+0000","last_fullsized":"2024-04-23T18:32:21.336039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:06:53.742445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548413+0000","last_change":"2024-04-23T18:29:21.529229+0000","last_active":"2024-04-23T18:29:52.548413+0000","last_peered":"2024-04-23T18:29:52.548413+0000","last_clean":"2024-04-23T18:29:52.548413+0000","last_became_active":"2024-04-23T18:29:21.528917+0000","last_became_peered":"2024-04-23T18:29:21.528917+0000","last_unstale":"2024-04-23T18:29:52.548413+0000","last_undegraded":"2024-04-23T18:29:52.548413+0000","last_fullsized":"2024-04-23T18:29:52.548413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:23.465133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.320304+0000","last_change":"2024-04-23T18:29:13.499442+0000","last_active":"2024-04-23T18:29:54.320304+0000","last_peered":"2024-04-23T18:29:54.320304+0000","last_clean":"2024-04-23T18:29:54.320304+0000","last_became_active":"2024-04-23T18:29:13.499216+0000","last_became_peered":"2024-04-23T18:29:13.499216+0000","last_unstale":"2024-04-23T18:29:54.320304+0000","last_undegraded":"2024-04-23T18:29:54.320304+0000","last_fullsized":"2024-04-23T18:29:54.320304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:58.980385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.550696+0000","last_change":"2024-04-23T18:29:11.511581+0000","last_active":"2024-04-23T18:29:52.550696+0000","last_peered":"2024-04-23T18:29:52.550696+0000","last_clean":"2024-04-23T18:29:52.550696+0000","last_became_active":"2024-04-23T18:29:11.511211+0000","last_became_peered":"2024-04-23T18:29:11.511211+0000","last_unstale":"2024-04-23T18:29:52.550696+0000","last_undegraded":"2024-04-23T18:29:52.550696+0000","last_fullsized":"2024-04-23T18:29:52.550696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:53.141133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547414+0000","last_change":"2024-04-23T18:29:15.510812+0000","last_active":"2024-04-23T18:29:52.547414+0000","last_peered":"2024-04-23T18:29:52.547414+0000","last_clean":"2024-04-23T18:29:52.547414+0000","last_became_active":"2024-04-23T18:29:15.510350+0000","last_became_peered":"2024-04-23T18:29:15.510350+0000","last_unstale":"2024-04-23T18:29:52.547414+0000","last_undegraded":"2024-04-23T18:29:52.547414+0000","last_fullsized":"2024-04-23T18:29:52.547414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:37.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'54","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.045638+0000","last_change":"2024-04-23T18:29:17.514012+0000","last_active":"2024-04-23T18:31:19.045638+0000","last_peered":"2024-04-23T18:31:19.045638+0000","last_clean":"2024-04-23T18:31:19.045638+0000","last_became_active":"2024-04-23T18:29:17.513298+0000","last_became_peered":"2024-04-23T18:29:17.513298+0000","last_unstale":"2024-04-23T18:31:19.045638+0000","last_undegraded":"2024-04-23T18:31:19.045638+0000","last_fullsized":"2024-04-23T18:31:19.045638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:28:12.293067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546424+0000","last_change":"2024-04-23T18:29:19.518358+0000","last_active":"2024-04-23T18:29:52.546424+0000","last_peered":"2024-04-23T18:29:52.546424+0000","last_clean":"2024-04-23T18:29:52.546424+0000","last_became_active":"2024-04-23T18:29:19.518015+0000","last_became_peered":"2024-04-23T18:29:19.518015+0000","last_unstale":"2024-04-23T18:29:52.546424+0000","last_undegraded":"2024-04-23T18:29:52.546424+0000","last_fullsized":"2024-04-23T18:29:52.546424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:30.663315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.316527+0000","last_change":"2024-04-23T18:29:21.529718+0000","last_active":"2024-04-23T18:32:21.316527+0000","last_peered":"2024-04-23T18:32:21.316527+0000","last_clean":"2024-04-23T18:32:21.316527+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:32:21.316527+0000","last_undegraded":"2024-04-23T18:32:21.316527+0000","last_fullsized":"2024-04-23T18:32:21.316527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:45.962860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.997048+0000","last_change":"2024-04-23T18:29:52.558115+0000","last_active":"2024-04-23T18:32:20.997048+0000","last_peered":"2024-04-23T18:32:20.997048+0000","last_clean":"2024-04-23T18:32:20.997048+0000","last_became_active":"2024-04-23T18:29:52.550778+0000","last_became_peered":"2024-04-23T18:29:52.550778+0000","last_unstale":"2024-04-23T18:32:20.997048+0000","last_undegraded":"2024-04-23T18:32:20.997048+0000","last_fullsized":"2024-04-23T18:32:20.997048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:43.467982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547787+0000","last_change":"2024-04-23T18:29:11.486362+0000","last_active":"2024-04-23T18:29:52.547787+0000","last_peered":"2024-04-23T18:29:52.547787+0000","last_clean":"2024-04-23T18:29:52.547787+0000","last_became_active":"2024-04-23T18:29:11.485899+0000","last_became_peered":"2024-04-23T18:29:11.485899+0000","last_unstale":"2024-04-23T18:29:52.547787+0000","last_undegraded":"2024-04-23T18:29:52.547787+0000","last_fullsized":"2024-04-23T18:29:52.547787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:10.908021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.190971+0000","last_change":"2024-04-23T18:29:15.507275+0000","last_active":"2024-04-23T18:31:20.190971+0000","last_peered":"2024-04-23T18:31:20.190971+0000","last_clean":"2024-04-23T18:31:20.190971+0000","last_became_active":"2024-04-23T18:29:15.506940+0000","last_became_peered":"2024-04-23T18:29:15.506940+0000","last_unstale":"2024-04-23T18:31:20.190971+0000","last_undegraded":"2024-04-23T18:31:20.190971+0000","last_fullsized":"2024-04-23T18:31:20.190971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:52.970455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.026166+0000","last_change":"2024-04-23T18:29:17.510208+0000","last_active":"2024-04-23T18:31:19.026166+0000","last_peered":"2024-04-23T18:31:19.026166+0000","last_clean":"2024-04-23T18:31:19.026166+0000","last_became_active":"2024-04-23T18:29:17.509586+0000","last_became_peered":"2024-04-23T18:29:17.509586+0000","last_unstale":"2024-04-23T18:31:19.026166+0000","last_undegraded":"2024-04-23T18:31:19.026166+0000","last_fullsized":"2024-04-23T18:31:19.026166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:06.298521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551606+0000","last_change":"2024-04-23T18:29:19.522554+0000","last_active":"2024-04-23T18:29:52.551606+0000","last_peered":"2024-04-23T18:29:52.551606+0000","last_clean":"2024-04-23T18:29:52.551606+0000","last_became_active":"2024-04-23T18:29:19.521939+0000","last_became_peered":"2024-04-23T18:29:19.521939+0000","last_unstale":"2024-04-23T18:29:52.551606+0000","last_undegraded":"2024-04-23T18:29:52.551606+0000","last_fullsized":"2024-04-23T18:29:52.551606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:46.071667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760279+0000","last_change":"2024-04-23T18:29:21.531398+0000","last_active":"2024-04-23T18:31:21.760279+0000","last_peered":"2024-04-23T18:31:21.760279+0000","last_clean":"2024-04-23T18:31:21.760279+0000","last_became_active":"2024-04-23T18:29:21.530270+0000","last_became_peered":"2024-04-23T18:29:21.530270+0000","last_unstale":"2024-04-23T18:31:21.760279+0000","last_undegraded":"2024-04-23T18:31:21.760279+0000","last_fullsized":"2024-04-23T18:31:21.760279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:10:11.666403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136387+0000","last_change":"2024-04-23T18:29:13.504743+0000","last_active":"2024-04-23T18:32:21.136387+0000","last_peered":"2024-04-23T18:32:21.136387+0000","last_clean":"2024-04-23T18:32:21.136387+0000","last_became_active":"2024-04-23T18:29:13.501430+0000","last_became_peered":"2024-04-23T18:29:13.501430+0000","last_unstale":"2024-04-23T18:32:21.136387+0000","last_undegraded":"2024-04-23T18:32:21.136387+0000","last_fullsized":"2024-04-23T18:32:21.136387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:05:51.964842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.456289+0000","last_change":"2024-04-23T18:29:11.507985+0000","last_active":"2024-04-23T18:31:20.456289+0000","last_peered":"2024-04-23T18:31:20.456289+0000","last_clean":"2024-04-23T18:31:20.456289+0000","last_became_active":"2024-04-23T18:29:11.507633+0000","last_became_peered":"2024-04-23T18:29:11.507633+0000","last_unstale":"2024-04-23T18:31:20.456289+0000","last_undegraded":"2024-04-23T18:31:20.456289+0000","last_fullsized":"2024-04-23T18:31:20.456289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:03:30.412489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"25'1","reported_seq":218,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.201543+0000","last_change":"2024-04-23T18:29:15.510939+0000","last_active":"2024-04-23T18:31:20.201543+0000","last_peered":"2024-04-23T18:31:20.201543+0000","last_clean":"2024-04-23T18:31:20.201543+0000","last_became_active":"2024-04-23T18:29:15.510579+0000","last_became_peered":"2024-04-23T18:29:15.510579+0000","last_unstale":"2024-04-23T18:31:20.201543+0000","last_undegraded":"2024-04-23T18:31:20.201543+0000","last_fullsized":"2024-04-23T18:31:20.201543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:29.858474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.052643+0000","last_change":"2024-04-23T18:29:17.513300+0000","last_active":"2024-04-23T18:31:19.052643+0000","last_peered":"2024-04-23T18:31:19.052643+0000","last_clean":"2024-04-23T18:31:19.052643+0000","last_became_active":"2024-04-23T18:29:17.512935+0000","last_became_peered":"2024-04-23T18:29:17.512935+0000","last_unstale":"2024-04-23T18:31:19.052643+0000","last_undegraded":"2024-04-23T18:31:19.052643+0000","last_fullsized":"2024-04-23T18:31:19.052643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:03.290679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":431,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.316969+0000","last_change":"2024-04-23T18:29:19.526537+0000","last_active":"2024-04-23T18:32:21.316969+0000","last_peered":"2024-04-23T18:32:21.316969+0000","last_clean":"2024-04-23T18:32:21.316969+0000","last_became_active":"2024-04-23T18:29:19.526260+0000","last_became_peered":"2024-04-23T18:29:19.526260+0000","last_unstale":"2024-04-23T18:32:21.316969+0000","last_undegraded":"2024-04-23T18:32:21.316969+0000","last_fullsized":"2024-04-23T18:32:21.316969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:52.097068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:29.758096+0000","last_change":"2024-04-23T18:29:21.527340+0000","last_active":"2024-04-23T18:31:29.758096+0000","last_peered":"2024-04-23T18:31:29.758096+0000","last_clean":"2024-04-23T18:31:29.758096+0000","last_became_active":"2024-04-23T18:29:21.527108+0000","last_became_peered":"2024-04-23T18:29:21.527108+0000","last_unstale":"2024-04-23T18:31:29.758096+0000","last_undegraded":"2024-04-23T18:31:29.758096+0000","last_fullsized":"2024-04-23T18:31:29.758096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:47.675158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760391+0000","last_change":"2024-04-23T18:29:13.504838+0000","last_active":"2024-04-23T18:31:31.760391+0000","last_peered":"2024-04-23T18:31:31.760391+0000","last_clean":"2024-04-23T18:31:31.760391+0000","last_became_active":"2024-04-23T18:29:13.504570+0000","last_became_peered":"2024-04-23T18:29:13.504570+0000","last_unstale":"2024-04-23T18:31:31.760391+0000","last_undegraded":"2024-04-23T18:31:31.760391+0000","last_fullsized":"2024-04-23T18:31:31.760391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:10:09.191900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.204695+0000","last_change":"2024-04-23T18:29:11.505849+0000","last_active":"2024-04-23T18:29:53.204695+0000","last_peered":"2024-04-23T18:29:53.204695+0000","last_clean":"2024-04-23T18:29:53.204695+0000","last_became_active":"2024-04-23T18:29:11.505531+0000","last_became_peered":"2024-04-23T18:29:11.505531+0000","last_unstale":"2024-04-23T18:29:53.204695+0000","last_undegraded":"2024-04-23T18:29:53.204695+0000","last_fullsized":"2024-04-23T18:29:53.204695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:10:07.184898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.201161+0000","last_change":"2024-04-23T18:29:15.506623+0000","last_active":"2024-04-23T18:31:20.201161+0000","last_peered":"2024-04-23T18:31:20.201161+0000","last_clean":"2024-04-23T18:31:20.201161+0000","last_became_active":"2024-04-23T18:29:15.505983+0000","last_became_peered":"2024-04-23T18:29:15.505983+0000","last_unstale":"2024-04-23T18:31:20.201161+0000","last_undegraded":"2024-04-23T18:31:20.201161+0000","last_fullsized":"2024-04-23T18:31:20.201161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:17.947594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551087+0000","last_change":"2024-04-23T18:29:17.513606+0000","last_active":"2024-04-23T18:29:52.551087+0000","last_peered":"2024-04-23T18:29:52.551087+0000","last_clean":"2024-04-23T18:29:52.551087+0000","last_became_active":"2024-04-23T18:29:17.513213+0000","last_became_peered":"2024-04-23T18:29:17.513213+0000","last_unstale":"2024-04-23T18:29:52.551087+0000","last_undegraded":"2024-04-23T18:29:52.551087+0000","last_fullsized":"2024-04-23T18:29:52.551087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:09:31.064767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":468,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.277024+0000","last_change":"2024-04-23T18:29:19.520435+0000","last_active":"2024-04-23T18:32:21.277024+0000","last_peered":"2024-04-23T18:32:21.277024+0000","last_clean":"2024-04-23T18:32:21.277024+0000","last_became_active":"2024-04-23T18:29:19.518528+0000","last_became_peered":"2024-04-23T18:29:19.518528+0000","last_unstale":"2024-04-23T18:32:21.277024+0000","last_undegraded":"2024-04-23T18:32:21.277024+0000","last_fullsized":"2024-04-23T18:32:21.277024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:42.794724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.335123+0000","last_change":"2024-04-23T18:29:21.531220+0000","last_active":"2024-04-23T18:31:20.335123+0000","last_peered":"2024-04-23T18:31:20.335123+0000","last_clean":"2024-04-23T18:31:20.335123+0000","last_became_active":"2024-04-23T18:29:21.530946+0000","last_became_peered":"2024-04-23T18:29:21.530946+0000","last_unstale":"2024-04-23T18:31:20.335123+0000","last_undegraded":"2024-04-23T18:31:20.335123+0000","last_fullsized":"2024-04-23T18:31:20.335123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:52:56.737823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.145303+0000","last_change":"2024-04-23T18:29:13.508059+0000","last_active":"2024-04-23T18:32:21.145303+0000","last_peered":"2024-04-23T18:32:21.145303+0000","last_clean":"2024-04-23T18:32:21.145303+0000","last_became_active":"2024-04-23T18:29:13.507813+0000","last_became_peered":"2024-04-23T18:29:13.507813+0000","last_unstale":"2024-04-23T18:32:21.145303+0000","last_undegraded":"2024-04-23T18:32:21.145303+0000","last_fullsized":"2024-04-23T18:32:21.145303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:51.116517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549983+0000","last_change":"2024-04-23T18:29:11.501752+0000","last_active":"2024-04-23T18:29:52.549983+0000","last_peered":"2024-04-23T18:29:52.549983+0000","last_clean":"2024-04-23T18:29:52.549983+0000","last_became_active":"2024-04-23T18:29:11.501432+0000","last_became_peered":"2024-04-23T18:29:11.501432+0000","last_unstale":"2024-04-23T18:29:52.549983+0000","last_undegraded":"2024-04-23T18:29:52.549983+0000","last_fullsized":"2024-04-23T18:29:52.549983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:25:19.599288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552068+0000","last_change":"2024-04-23T18:29:15.510003+0000","last_active":"2024-04-23T18:29:52.552068+0000","last_peered":"2024-04-23T18:29:52.552068+0000","last_clean":"2024-04-23T18:29:52.552068+0000","last_became_active":"2024-04-23T18:29:15.509701+0000","last_became_peered":"2024-04-23T18:29:15.509701+0000","last_unstale":"2024-04-23T18:29:52.552068+0000","last_undegraded":"2024-04-23T18:29:52.552068+0000","last_fullsized":"2024-04-23T18:29:52.552068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:40.349247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.038568+0000","last_change":"2024-04-23T18:29:17.509954+0000","last_active":"2024-04-23T18:31:19.038568+0000","last_peered":"2024-04-23T18:31:19.038568+0000","last_clean":"2024-04-23T18:31:19.038568+0000","last_became_active":"2024-04-23T18:29:17.509672+0000","last_became_peered":"2024-04-23T18:29:17.509672+0000","last_unstale":"2024-04-23T18:31:19.038568+0000","last_undegraded":"2024-04-23T18:31:19.038568+0000","last_fullsized":"2024-04-23T18:31:19.038568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:05:55.987108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543479+0000","last_change":"2024-04-23T18:29:19.527128+0000","last_active":"2024-04-23T18:29:52.543479+0000","last_peered":"2024-04-23T18:29:52.543479+0000","last_clean":"2024-04-23T18:29:52.543479+0000","last_became_active":"2024-04-23T18:29:19.526861+0000","last_became_peered":"2024-04-23T18:29:19.526861+0000","last_unstale":"2024-04-23T18:29:52.543479+0000","last_undegraded":"2024-04-23T18:29:52.543479+0000","last_fullsized":"2024-04-23T18:29:52.543479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:48:19.499447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.250373+0000","last_change":"2024-04-23T18:29:21.530887+0000","last_active":"2024-04-23T18:32:21.250373+0000","last_peered":"2024-04-23T18:32:21.250373+0000","last_clean":"2024-04-23T18:32:21.250373+0000","last_became_active":"2024-04-23T18:29:21.530612+0000","last_became_peered":"2024-04-23T18:29:21.530612+0000","last_unstale":"2024-04-23T18:32:21.250373+0000","last_undegraded":"2024-04-23T18:32:21.250373+0000","last_fullsized":"2024-04-23T18:32:21.250373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:46.345887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278266+0000","last_change":"2024-04-23T18:29:13.502952+0000","last_active":"2024-04-23T18:31:17.278266+0000","last_peered":"2024-04-23T18:31:17.278266+0000","last_clean":"2024-04-23T18:31:17.278266+0000","last_became_active":"2024-04-23T18:29:13.501636+0000","last_became_peered":"2024-04-23T18:29:13.501636+0000","last_unstale":"2024-04-23T18:31:17.278266+0000","last_undegraded":"2024-04-23T18:31:17.278266+0000","last_fullsized":"2024-04-23T18:31:17.278266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:48:13.470014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542806+0000","last_change":"2024-04-23T18:28:58.798997+0000","last_active":"2024-04-23T18:29:52.542806+0000","last_peered":"2024-04-23T18:29:52.542806+0000","last_clean":"2024-04-23T18:29:52.542806+0000","last_became_active":"2024-04-23T18:28:58.798001+0000","last_became_peered":"2024-04-23T18:28:58.798001+0000","last_unstale":"2024-04-23T18:29:52.542806+0000","last_undegraded":"2024-04-23T18:29:52.542806+0000","last_fullsized":"2024-04-23T18:29:52.542806+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_clean_scrub_stamp":"2024-04-23T18:28:57.410644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:20.472050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548752+0000","last_change":"2024-04-23T18:29:03.446652+0000","last_active":"2024-04-23T18:29:52.548752+0000","last_peered":"2024-04-23T18:29:52.548752+0000","last_clean":"2024-04-23T18:29:52.548752+0000","last_became_active":"2024-04-23T18:29:03.446324+0000","last_became_peered":"2024-04-23T18:29:03.446324+0000","last_unstale":"2024-04-23T18:29:52.548752+0000","last_undegraded":"2024-04-23T18:29:52.548752+0000","last_fullsized":"2024-04-23T18:29:52.548752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:19.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.210752+0000","last_change":"2024-04-23T18:29:11.512994+0000","last_active":"2024-04-23T18:32:21.210752+0000","last_peered":"2024-04-23T18:32:21.210752+0000","last_clean":"2024-04-23T18:32:21.210752+0000","last_became_active":"2024-04-23T18:29:11.512684+0000","last_became_peered":"2024-04-23T18:29:11.512684+0000","last_unstale":"2024-04-23T18:32:21.210752+0000","last_undegraded":"2024-04-23T18:32:21.210752+0000","last_fullsized":"2024-04-23T18:32:21.210752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:16.645799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546263+0000","last_change":"2024-04-23T18:29:15.509604+0000","last_active":"2024-04-23T18:29:52.546263+0000","last_peered":"2024-04-23T18:29:52.546263+0000","last_clean":"2024-04-23T18:29:52.546263+0000","last_became_active":"2024-04-23T18:29:15.509209+0000","last_became_peered":"2024-04-23T18:29:15.509209+0000","last_unstale":"2024-04-23T18:29:52.546263+0000","last_undegraded":"2024-04-23T18:29:52.546263+0000","last_fullsized":"2024-04-23T18:29:52.546263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:36.226721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.050188+0000","last_change":"2024-04-23T18:29:17.513782+0000","last_active":"2024-04-23T18:31:19.050188+0000","last_peered":"2024-04-23T18:31:19.050188+0000","last_clean":"2024-04-23T18:31:19.050188+0000","last_became_active":"2024-04-23T18:29:17.513504+0000","last_became_peered":"2024-04-23T18:29:17.513504+0000","last_unstale":"2024-04-23T18:31:19.050188+0000","last_undegraded":"2024-04-23T18:31:19.050188+0000","last_fullsized":"2024-04-23T18:31:19.050188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:21.911021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548534+0000","last_change":"2024-04-23T18:29:19.519375+0000","last_active":"2024-04-23T18:29:52.548534+0000","last_peered":"2024-04-23T18:29:52.548534+0000","last_clean":"2024-04-23T18:29:52.548534+0000","last_became_active":"2024-04-23T18:29:19.518974+0000","last_became_peered":"2024-04-23T18:29:19.518974+0000","last_unstale":"2024-04-23T18:29:52.548534+0000","last_undegraded":"2024-04-23T18:29:52.548534+0000","last_fullsized":"2024-04-23T18:29:52.548534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:36:01.680036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":162,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.226604+0000","last_change":"2024-04-23T18:29:21.532023+0000","last_active":"2024-04-23T18:32:21.226604+0000","last_peered":"2024-04-23T18:32:21.226604+0000","last_clean":"2024-04-23T18:32:21.226604+0000","last_became_active":"2024-04-23T18:29:21.531725+0000","last_became_peered":"2024-04-23T18:29:21.531725+0000","last_unstale":"2024-04-23T18:32:21.226604+0000","last_undegraded":"2024-04-23T18:32:21.226604+0000","last_fullsized":"2024-04-23T18:32:21.226604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:44:23.460941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'5","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.909403+0000","last_change":"2024-04-23T18:29:13.497272+0000","last_active":"2024-04-23T18:32:20.909403+0000","last_peered":"2024-04-23T18:32:20.909403+0000","last_clean":"2024-04-23T18:32:20.909403+0000","last_became_active":"2024-04-23T18:29:13.497008+0000","last_became_peered":"2024-04-23T18:29:13.497008+0000","last_unstale":"2024-04-23T18:32:20.909403+0000","last_undegraded":"2024-04-23T18:32:20.909403+0000","last_fullsized":"2024-04-23T18:32:20.909403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:19.658217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547412+0000","last_change":"2024-04-23T18:29:03.447767+0000","last_active":"2024-04-23T18:29:52.547412+0000","last_peered":"2024-04-23T18:29:52.547412+0000","last_clean":"2024-04-23T18:29:52.547412+0000","last_became_active":"2024-04-23T18:29:03.447404+0000","last_became_peered":"2024-04-23T18:29:03.447404+0000","last_unstale":"2024-04-23T18:29:52.547412+0000","last_undegraded":"2024-04-23T18:29:52.547412+0000","last_fullsized":"2024-04-23T18:29:52.547412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:01:15.340699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546565+0000","last_change":"2024-04-23T18:29:11.487391+0000","last_active":"2024-04-23T18:29:52.546565+0000","last_peered":"2024-04-23T18:29:52.546565+0000","last_clean":"2024-04-23T18:29:52.546565+0000","last_became_active":"2024-04-23T18:29:11.486538+0000","last_became_peered":"2024-04-23T18:29:11.486538+0000","last_unstale":"2024-04-23T18:29:52.546565+0000","last_undegraded":"2024-04-23T18:29:52.546565+0000","last_fullsized":"2024-04-23T18:29:52.546565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:31:33.533609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552721+0000","last_change":"2024-04-23T18:29:15.508321+0000","last_active":"2024-04-23T18:29:52.552721+0000","last_peered":"2024-04-23T18:29:52.552721+0000","last_clean":"2024-04-23T18:29:52.552721+0000","last_became_active":"2024-04-23T18:29:15.508020+0000","last_became_peered":"2024-04-23T18:29:15.508020+0000","last_unstale":"2024-04-23T18:29:52.552721+0000","last_undegraded":"2024-04-23T18:29:52.552721+0000","last_fullsized":"2024-04-23T18:29:52.552721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:05.187203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'274","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585466+0000","last_change":"2024-04-23T18:29:17.515301+0000","last_active":"2024-04-23T18:32:20.585466+0000","last_peered":"2024-04-23T18:32:20.585466+0000","last_clean":"2024-04-23T18:32:20.585466+0000","last_became_active":"2024-04-23T18:29:17.515023+0000","last_became_peered":"2024-04-23T18:29:17.515023+0000","last_unstale":"2024-04-23T18:32:20.585466+0000","last_undegraded":"2024-04-23T18:32:20.585466+0000","last_fullsized":"2024-04-23T18:32:20.585466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:57.739742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551884+0000","last_change":"2024-04-23T18:29:19.522666+0000","last_active":"2024-04-23T18:29:52.551884+0000","last_peered":"2024-04-23T18:29:52.551884+0000","last_clean":"2024-04-23T18:29:52.551884+0000","last_became_active":"2024-04-23T18:29:19.522105+0000","last_became_peered":"2024-04-23T18:29:19.522105+0000","last_unstale":"2024-04-23T18:29:52.551884+0000","last_undegraded":"2024-04-23T18:29:52.551884+0000","last_fullsized":"2024-04-23T18:29:52.551884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:35.556440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.621034+0000","last_change":"2024-04-23T18:29:21.533582+0000","last_active":"2024-04-23T18:30:36.621034+0000","last_peered":"2024-04-23T18:30:36.621034+0000","last_clean":"2024-04-23T18:30:36.621034+0000","last_became_active":"2024-04-23T18:29:21.532867+0000","last_became_peered":"2024-04-23T18:29:21.532867+0000","last_unstale":"2024-04-23T18:30:36.621034+0000","last_undegraded":"2024-04-23T18:30:36.621034+0000","last_fullsized":"2024-04-23T18:30:36.621034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:30:13.562825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549403+0000","last_change":"2024-04-23T18:29:13.499606+0000","last_active":"2024-04-23T18:29:52.549403+0000","last_peered":"2024-04-23T18:29:52.549403+0000","last_clean":"2024-04-23T18:29:52.549403+0000","last_became_active":"2024-04-23T18:29:13.499253+0000","last_became_peered":"2024-04-23T18:29:13.499253+0000","last_unstale":"2024-04-23T18:29:52.549403+0000","last_undegraded":"2024-04-23T18:29:52.549403+0000","last_fullsized":"2024-04-23T18:29:52.549403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:12:00.717757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.540896+0000","last_change":"2024-04-23T18:29:03.447054+0000","last_active":"2024-04-23T18:29:52.540896+0000","last_peered":"2024-04-23T18:29:52.540896+0000","last_clean":"2024-04-23T18:29:52.540896+0000","last_became_active":"2024-04-23T18:29:03.446647+0000","last_became_peered":"2024-04-23T18:29:03.446647+0000","last_unstale":"2024-04-23T18:29:52.540896+0000","last_undegraded":"2024-04-23T18:29:52.540896+0000","last_fullsized":"2024-04-23T18:29:52.540896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:57.409435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546219+0000","last_change":"2024-04-23T18:29:11.492974+0000","last_active":"2024-04-23T18:29:52.546219+0000","last_peered":"2024-04-23T18:29:52.546219+0000","last_clean":"2024-04-23T18:29:52.546219+0000","last_became_active":"2024-04-23T18:29:11.491953+0000","last_became_peered":"2024-04-23T18:29:11.491953+0000","last_unstale":"2024-04-23T18:29:52.546219+0000","last_undegraded":"2024-04-23T18:29:52.546219+0000","last_fullsized":"2024-04-23T18:29:52.546219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:45:27.531143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.563923+0000","last_change":"2024-04-23T18:29:52.563435+0000","last_active":"2024-04-23T18:29:52.563923+0000","last_peered":"2024-04-23T18:29:52.563923+0000","last_clean":"2024-04-23T18:29:52.563923+0000","last_became_active":"2024-04-23T18:29:52.551265+0000","last_became_peered":"2024-04-23T18:29:52.551265+0000","last_unstale":"2024-04-23T18:29:52.563923+0000","last_undegraded":"2024-04-23T18:29:52.563923+0000","last_fullsized":"2024-04-23T18:29:52.563923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:39.312725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585625+0000","last_change":"2024-04-23T18:29:17.514185+0000","last_active":"2024-04-23T18:32:20.585625+0000","last_peered":"2024-04-23T18:32:20.585625+0000","last_clean":"2024-04-23T18:32:20.585625+0000","last_became_active":"2024-04-23T18:29:17.513875+0000","last_became_peered":"2024-04-23T18:29:17.513875+0000","last_unstale":"2024-04-23T18:32:20.585625+0000","last_undegraded":"2024-04-23T18:32:20.585625+0000","last_fullsized":"2024-04-23T18:32:20.585625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:59:32.280321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548106+0000","last_change":"2024-04-23T18:29:19.519133+0000","last_active":"2024-04-23T18:29:52.548106+0000","last_peered":"2024-04-23T18:29:52.548106+0000","last_clean":"2024-04-23T18:29:52.548106+0000","last_became_active":"2024-04-23T18:29:19.518744+0000","last_became_peered":"2024-04-23T18:29:19.518744+0000","last_unstale":"2024-04-23T18:29:52.548106+0000","last_undegraded":"2024-04-23T18:29:52.548106+0000","last_fullsized":"2024-04-23T18:29:52.548106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:05:47.618962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.756328+0000","last_change":"2024-04-23T18:29:21.533685+0000","last_active":"2024-04-23T18:29:53.756328+0000","last_peered":"2024-04-23T18:29:53.756328+0000","last_clean":"2024-04-23T18:29:53.756328+0000","last_became_active":"2024-04-23T18:29:21.533358+0000","last_became_peered":"2024-04-23T18:29:21.533358+0000","last_unstale":"2024-04-23T18:29:53.756328+0000","last_undegraded":"2024-04-23T18:29:53.756328+0000","last_fullsized":"2024-04-23T18:29:53.756328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:52.473352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136286+0000","last_change":"2024-04-23T18:29:13.493749+0000","last_active":"2024-04-23T18:32:21.136286+0000","last_peered":"2024-04-23T18:32:21.136286+0000","last_clean":"2024-04-23T18:32:21.136286+0000","last_became_active":"2024-04-23T18:29:13.493321+0000","last_became_peered":"2024-04-23T18:29:13.493321+0000","last_unstale":"2024-04-23T18:32:21.136286+0000","last_undegraded":"2024-04-23T18:32:21.136286+0000","last_fullsized":"2024-04-23T18:32:21.136286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:42:30.926554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548411+0000","last_change":"2024-04-23T18:29:03.446774+0000","last_active":"2024-04-23T18:29:52.548411+0000","last_peered":"2024-04-23T18:29:52.548411+0000","last_clean":"2024-04-23T18:29:52.548411+0000","last_became_active":"2024-04-23T18:29:03.446457+0000","last_became_peered":"2024-04-23T18:29:03.446457+0000","last_unstale":"2024-04-23T18:29:52.548411+0000","last_undegraded":"2024-04-23T18:29:52.548411+0000","last_fullsized":"2024-04-23T18:29:52.548411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:14.074221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.863350+0000","last_change":"2024-04-23T18:29:11.483348+0000","last_active":"2024-04-23T18:32:20.863350+0000","last_peered":"2024-04-23T18:32:20.863350+0000","last_clean":"2024-04-23T18:32:20.863350+0000","last_became_active":"2024-04-23T18:29:11.482896+0000","last_became_peered":"2024-04-23T18:29:11.482896+0000","last_unstale":"2024-04-23T18:32:20.863350+0000","last_undegraded":"2024-04-23T18:32:20.863350+0000","last_fullsized":"2024-04-23T18:32:20.863350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:53.629794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548218+0000","last_change":"2024-04-23T18:29:15.507664+0000","last_active":"2024-04-23T18:29:52.548218+0000","last_peered":"2024-04-23T18:29:52.548218+0000","last_clean":"2024-04-23T18:29:52.548218+0000","last_became_active":"2024-04-23T18:29:15.507357+0000","last_became_peered":"2024-04-23T18:29:15.507357+0000","last_unstale":"2024-04-23T18:29:52.548218+0000","last_undegraded":"2024-04-23T18:29:52.548218+0000","last_fullsized":"2024-04-23T18:29:52.548218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:47.440112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.560727+0000","last_change":"2024-04-23T18:29:17.514159+0000","last_active":"2024-04-23T18:32:20.560727+0000","last_peered":"2024-04-23T18:32:20.560727+0000","last_clean":"2024-04-23T18:32:20.560727+0000","last_became_active":"2024-04-23T18:29:17.513393+0000","last_became_peered":"2024-04-23T18:29:17.513393+0000","last_unstale":"2024-04-23T18:32:20.560727+0000","last_undegraded":"2024-04-23T18:32:20.560727+0000","last_fullsized":"2024-04-23T18:32:20.560727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:46:31.465490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551911+0000","last_change":"2024-04-23T18:29:19.523513+0000","last_active":"2024-04-23T18:29:52.551911+0000","last_peered":"2024-04-23T18:29:52.551911+0000","last_clean":"2024-04-23T18:29:52.551911+0000","last_became_active":"2024-04-23T18:29:19.523070+0000","last_became_peered":"2024-04-23T18:29:19.523070+0000","last_unstale":"2024-04-23T18:29:52.551911+0000","last_undegraded":"2024-04-23T18:29:52.551911+0000","last_fullsized":"2024-04-23T18:29:52.551911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:53.579124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.926481+0000","last_change":"2024-04-23T18:29:21.529180+0000","last_active":"2024-04-23T18:32:20.926481+0000","last_peered":"2024-04-23T18:32:20.926481+0000","last_clean":"2024-04-23T18:32:20.926481+0000","last_became_active":"2024-04-23T18:29:21.528764+0000","last_became_peered":"2024-04-23T18:29:21.528764+0000","last_unstale":"2024-04-23T18:32:20.926481+0000","last_undegraded":"2024-04-23T18:32:20.926481+0000","last_fullsized":"2024-04-23T18:32:20.926481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:15:30.851670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546769+0000","last_change":"2024-04-23T18:29:13.507864+0000","last_active":"2024-04-23T18:29:52.546769+0000","last_peered":"2024-04-23T18:29:52.546769+0000","last_clean":"2024-04-23T18:29:52.546769+0000","last_became_active":"2024-04-23T18:29:13.507496+0000","last_became_peered":"2024-04-23T18:29:13.507496+0000","last_unstale":"2024-04-23T18:29:52.546769+0000","last_undegraded":"2024-04-23T18:29:52.546769+0000","last_fullsized":"2024-04-23T18:29:52.546769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:36.947062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541796+0000","last_change":"2024-04-23T18:29:11.483379+0000","last_active":"2024-04-23T18:29:52.541796+0000","last_peered":"2024-04-23T18:29:52.541796+0000","last_clean":"2024-04-23T18:29:52.541796+0000","last_became_active":"2024-04-23T18:29:11.482348+0000","last_became_peered":"2024-04-23T18:29:11.482348+0000","last_unstale":"2024-04-23T18:29:52.541796+0000","last_undegraded":"2024-04-23T18:29:52.541796+0000","last_fullsized":"2024-04-23T18:29:52.541796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:47:48.291376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547947+0000","last_change":"2024-04-23T18:29:03.446643+0000","last_active":"2024-04-23T18:29:52.547947+0000","last_peered":"2024-04-23T18:29:52.547947+0000","last_clean":"2024-04-23T18:29:52.547947+0000","last_became_active":"2024-04-23T18:29:03.446286+0000","last_became_peered":"2024-04-23T18:29:03.446286+0000","last_unstale":"2024-04-23T18:29:52.547947+0000","last_undegraded":"2024-04-23T18:29:52.547947+0000","last_fullsized":"2024-04-23T18:29:52.547947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:42.594846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:56.764032+0000","last_change":"2024-04-23T18:29:52.554181+0000","last_active":"2024-04-23T18:31:56.764032+0000","last_peered":"2024-04-23T18:31:56.764032+0000","last_clean":"2024-04-23T18:31:56.764032+0000","last_became_active":"2024-04-23T18:29:52.553851+0000","last_became_peered":"2024-04-23T18:29:52.553851+0000","last_unstale":"2024-04-23T18:31:56.764032+0000","last_undegraded":"2024-04-23T18:31:56.764032+0000","last_fullsized":"2024-04-23T18:31:56.764032+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:05.187203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'61","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756499+0000","last_change":"2024-04-23T18:29:17.513936+0000","last_active":"2024-04-23T18:31:19.756499+0000","last_peered":"2024-04-23T18:31:19.756499+0000","last_clean":"2024-04-23T18:31:19.756499+0000","last_became_active":"2024-04-23T18:29:17.513599+0000","last_became_peered":"2024-04-23T18:29:17.513599+0000","last_unstale":"2024-04-23T18:31:19.756499+0000","last_undegraded":"2024-04-23T18:31:19.756499+0000","last_fullsized":"2024-04-23T18:31:19.756499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:56:07.867139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541648+0000","last_change":"2024-04-23T18:29:19.526480+0000","last_active":"2024-04-23T18:29:52.541648+0000","last_peered":"2024-04-23T18:29:52.541648+0000","last_clean":"2024-04-23T18:29:52.541648+0000","last_became_active":"2024-04-23T18:29:19.526192+0000","last_became_peered":"2024-04-23T18:29:19.526192+0000","last_unstale":"2024-04-23T18:29:52.541648+0000","last_undegraded":"2024-04-23T18:29:52.541648+0000","last_fullsized":"2024-04-23T18:29:52.541648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:36:56.457757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.486845+0000","last_change":"2024-04-23T18:29:21.533405+0000","last_active":"2024-04-23T18:31:20.486845+0000","last_peered":"2024-04-23T18:31:20.486845+0000","last_clean":"2024-04-23T18:31:20.486845+0000","last_became_active":"2024-04-23T18:29:21.533202+0000","last_became_peered":"2024-04-23T18:29:21.533202+0000","last_unstale":"2024-04-23T18:31:20.486845+0000","last_undegraded":"2024-04-23T18:31:20.486845+0000","last_fullsized":"2024-04-23T18:31:20.486845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:54:11.716719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":32,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'1","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.759332+0000","last_change":"2024-04-23T18:29:13.507056+0000","last_active":"2024-04-23T18:31:21.759332+0000","last_peered":"2024-04-23T18:31:21.759332+0000","last_clean":"2024-04-23T18:31:21.759332+0000","last_became_active":"2024-04-23T18:29:13.506795+0000","last_became_peered":"2024-04-23T18:29:13.506795+0000","last_unstale":"2024-04-23T18:31:21.759332+0000","last_undegraded":"2024-04-23T18:31:21.759332+0000","last_fullsized":"2024-04-23T18:31:21.759332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:39.344472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548249+0000","last_change":"2024-04-23T18:29:11.492325+0000","last_active":"2024-04-23T18:29:52.548249+0000","last_peered":"2024-04-23T18:29:52.548249+0000","last_clean":"2024-04-23T18:29:52.548249+0000","last_became_active":"2024-04-23T18:29:11.491882+0000","last_became_peered":"2024-04-23T18:29:11.491882+0000","last_unstale":"2024-04-23T18:29:52.548249+0000","last_undegraded":"2024-04-23T18:29:52.548249+0000","last_fullsized":"2024-04-23T18:29:52.548249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:32:57.364121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552526+0000","last_change":"2024-04-23T18:29:03.447598+0000","last_active":"2024-04-23T18:29:52.552526+0000","last_peered":"2024-04-23T18:29:52.552526+0000","last_clean":"2024-04-23T18:29:52.552526+0000","last_became_active":"2024-04-23T18:29:03.447265+0000","last_became_peered":"2024-04-23T18:29:03.447265+0000","last_unstale":"2024-04-23T18:29:52.552526+0000","last_undegraded":"2024-04-23T18:29:52.552526+0000","last_fullsized":"2024-04-23T18:29:52.552526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:56.204409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548211+0000","last_change":"2024-04-23T18:29:15.506698+0000","last_active":"2024-04-23T18:29:52.548211+0000","last_peered":"2024-04-23T18:29:52.548211+0000","last_clean":"2024-04-23T18:29:52.548211+0000","last_became_active":"2024-04-23T18:29:15.506394+0000","last_became_peered":"2024-04-23T18:29:15.506394+0000","last_unstale":"2024-04-23T18:29:52.548211+0000","last_undegraded":"2024-04-23T18:29:52.548211+0000","last_fullsized":"2024-04-23T18:29:52.548211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:21.696617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543554+0000","last_change":"2024-04-23T18:29:17.515730+0000","last_active":"2024-04-23T18:29:52.543554+0000","last_peered":"2024-04-23T18:29:52.543554+0000","last_clean":"2024-04-23T18:29:52.543554+0000","last_became_active":"2024-04-23T18:29:17.515048+0000","last_became_peered":"2024-04-23T18:29:17.515048+0000","last_unstale":"2024-04-23T18:29:52.543554+0000","last_undegraded":"2024-04-23T18:29:52.543554+0000","last_fullsized":"2024-04-23T18:29:52.543554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:23.680483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":369,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585547+0000","last_change":"2024-04-23T18:29:19.518964+0000","last_active":"2024-04-23T18:32:20.585547+0000","last_peered":"2024-04-23T18:32:20.585547+0000","last_clean":"2024-04-23T18:32:20.585547+0000","last_became_active":"2024-04-23T18:29:19.518668+0000","last_became_peered":"2024-04-23T18:29:19.518668+0000","last_unstale":"2024-04-23T18:32:20.585547+0000","last_undegraded":"2024-04-23T18:32:20.585547+0000","last_fullsized":"2024-04-23T18:32:20.585547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:07.298508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.170755+0000","last_change":"2024-04-23T18:29:21.531478+0000","last_active":"2024-04-23T18:32:21.170755+0000","last_peered":"2024-04-23T18:32:21.170755+0000","last_clean":"2024-04-23T18:32:21.170755+0000","last_became_active":"2024-04-23T18:29:21.531185+0000","last_became_peered":"2024-04-23T18:29:21.531185+0000","last_unstale":"2024-04-23T18:32:21.170755+0000","last_undegraded":"2024-04-23T18:32:21.170755+0000","last_fullsized":"2024-04-23T18:32:21.170755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:10.167276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.538256+0000","last_change":"2024-04-23T18:29:13.504754+0000","last_active":"2024-04-23T18:31:20.538256+0000","last_peered":"2024-04-23T18:31:20.538256+0000","last_clean":"2024-04-23T18:31:20.538256+0000","last_became_active":"2024-04-23T18:29:13.503543+0000","last_became_peered":"2024-04-23T18:29:13.503543+0000","last_unstale":"2024-04-23T18:31:20.538256+0000","last_undegraded":"2024-04-23T18:31:20.538256+0000","last_fullsized":"2024-04-23T18:31:20.538256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:55:58.292535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760523+0000","last_change":"2024-04-23T18:29:11.505973+0000","last_active":"2024-04-23T18:31:21.760523+0000","last_peered":"2024-04-23T18:31:21.760523+0000","last_clean":"2024-04-23T18:31:21.760523+0000","last_became_active":"2024-04-23T18:29:11.505604+0000","last_became_peered":"2024-04-23T18:29:11.505604+0000","last_unstale":"2024-04-23T18:31:21.760523+0000","last_undegraded":"2024-04-23T18:31:21.760523+0000","last_fullsized":"2024-04-23T18:31:21.760523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:26.018597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548860+0000","last_change":"2024-04-23T18:29:03.446013+0000","last_active":"2024-04-23T18:29:52.548860+0000","last_peered":"2024-04-23T18:29:52.548860+0000","last_clean":"2024-04-23T18:29:52.548860+0000","last_became_active":"2024-04-23T18:29:03.445715+0000","last_became_peered":"2024-04-23T18:29:03.445715+0000","last_unstale":"2024-04-23T18:29:52.548860+0000","last_undegraded":"2024-04-23T18:29:52.548860+0000","last_fullsized":"2024-04-23T18:29:52.548860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:39.084066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.550999+0000","last_change":"2024-04-23T18:29:15.511864+0000","last_active":"2024-04-23T18:29:52.550999+0000","last_peered":"2024-04-23T18:29:52.550999+0000","last_clean":"2024-04-23T18:29:52.550999+0000","last_became_active":"2024-04-23T18:29:15.511553+0000","last_became_peered":"2024-04-23T18:29:15.511553+0000","last_unstale":"2024-04-23T18:29:52.550999+0000","last_undegraded":"2024-04-23T18:29:52.550999+0000","last_fullsized":"2024-04-23T18:29:52.550999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:20.797539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760395+0000","last_change":"2024-04-23T18:29:17.516388+0000","last_active":"2024-04-23T18:31:21.760395+0000","last_peered":"2024-04-23T18:31:21.760395+0000","last_clean":"2024-04-23T18:31:21.760395+0000","last_became_active":"2024-04-23T18:29:17.515741+0000","last_became_peered":"2024-04-23T18:29:17.515741+0000","last_unstale":"2024-04-23T18:31:21.760395+0000","last_undegraded":"2024-04-23T18:31:21.760395+0000","last_fullsized":"2024-04-23T18:31:21.760395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:57.339089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":399,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.326707+0000","last_change":"2024-04-23T18:29:19.526580+0000","last_active":"2024-04-23T18:32:21.326707+0000","last_peered":"2024-04-23T18:32:21.326707+0000","last_clean":"2024-04-23T18:32:21.326707+0000","last_became_active":"2024-04-23T18:29:19.526375+0000","last_became_peered":"2024-04-23T18:29:19.526375+0000","last_unstale":"2024-04-23T18:32:21.326707+0000","last_undegraded":"2024-04-23T18:32:21.326707+0000","last_fullsized":"2024-04-23T18:32:21.326707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:22.422967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.097904+0000","last_change":"2024-04-23T18:29:21.531204+0000","last_active":"2024-04-23T18:29:54.097904+0000","last_peered":"2024-04-23T18:29:54.097904+0000","last_clean":"2024-04-23T18:29:54.097904+0000","last_became_active":"2024-04-23T18:29:21.530911+0000","last_became_peered":"2024-04-23T18:29:21.530911+0000","last_unstale":"2024-04-23T18:29:54.097904+0000","last_undegraded":"2024-04-23T18:29:54.097904+0000","last_fullsized":"2024-04-23T18:29:54.097904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:38:26.331563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'16","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998529+0000","last_change":"2024-04-23T18:29:13.499873+0000","last_active":"2024-04-23T18:32:20.998529+0000","last_peered":"2024-04-23T18:32:20.998529+0000","last_clean":"2024-04-23T18:32:20.998529+0000","last_became_active":"2024-04-23T18:29:13.499603+0000","last_became_peered":"2024-04-23T18:29:13.499603+0000","last_unstale":"2024-04-23T18:32:20.998529+0000","last_undegraded":"2024-04-23T18:32:20.998529+0000","last_fullsized":"2024-04-23T18:32:20.998529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:17.317212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547877+0000","last_change":"2024-04-23T18:29:11.488874+0000","last_active":"2024-04-23T18:29:52.547877+0000","last_peered":"2024-04-23T18:29:52.547877+0000","last_clean":"2024-04-23T18:29:52.547877+0000","last_became_active":"2024-04-23T18:29:11.488500+0000","last_became_peered":"2024-04-23T18:29:11.488500+0000","last_unstale":"2024-04-23T18:29:52.547877+0000","last_undegraded":"2024-04-23T18:29:52.547877+0000","last_fullsized":"2024-04-23T18:29:52.547877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:52.597685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552056+0000","last_change":"2024-04-23T18:29:03.594008+0000","last_active":"2024-04-23T18:29:52.552056+0000","last_peered":"2024-04-23T18:29:52.552056+0000","last_clean":"2024-04-23T18:29:52.552056+0000","last_became_active":"2024-04-23T18:29:03.593691+0000","last_became_peered":"2024-04-23T18:29:03.593691+0000","last_unstale":"2024-04-23T18:29:52.552056+0000","last_undegraded":"2024-04-23T18:29:52.552056+0000","last_fullsized":"2024-04-23T18:29:52.552056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:18:59.128475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549901+0000","last_change":"2024-04-23T18:29:15.513067+0000","last_active":"2024-04-23T18:29:52.549901+0000","last_peered":"2024-04-23T18:29:52.549901+0000","last_clean":"2024-04-23T18:29:52.549901+0000","last_became_active":"2024-04-23T18:29:15.511207+0000","last_became_peered":"2024-04-23T18:29:15.511207+0000","last_unstale":"2024-04-23T18:29:52.549901+0000","last_undegraded":"2024-04-23T18:29:52.549901+0000","last_fullsized":"2024-04-23T18:29:52.549901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:23.658875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.036554+0000","last_change":"2024-04-23T18:29:17.515549+0000","last_active":"2024-04-23T18:31:19.036554+0000","last_peered":"2024-04-23T18:31:19.036554+0000","last_clean":"2024-04-23T18:31:19.036554+0000","last_became_active":"2024-04-23T18:29:17.515004+0000","last_became_peered":"2024-04-23T18:29:17.515004+0000","last_unstale":"2024-04-23T18:31:19.036554+0000","last_undegraded":"2024-04-23T18:31:19.036554+0000","last_fullsized":"2024-04-23T18:31:19.036554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:36.940155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547648+0000","last_change":"2024-04-23T18:29:19.518175+0000","last_active":"2024-04-23T18:29:52.547648+0000","last_peered":"2024-04-23T18:29:52.547648+0000","last_clean":"2024-04-23T18:29:52.547648+0000","last_became_active":"2024-04-23T18:29:19.517903+0000","last_became_peered":"2024-04-23T18:29:19.517903+0000","last_unstale":"2024-04-23T18:29:52.547648+0000","last_undegraded":"2024-04-23T18:29:52.547648+0000","last_fullsized":"2024-04-23T18:29:52.547648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:49:59.234459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.612385+0000","last_change":"2024-04-23T18:29:21.531285+0000","last_active":"2024-04-23T18:30:36.612385+0000","last_peered":"2024-04-23T18:30:36.612385+0000","last_clean":"2024-04-23T18:30:36.612385+0000","last_became_active":"2024-04-23T18:29:21.530980+0000","last_became_peered":"2024-04-23T18:29:21.530980+0000","last_unstale":"2024-04-23T18:30:36.612385+0000","last_undegraded":"2024-04-23T18:30:36.612385+0000","last_fullsized":"2024-04-23T18:30:36.612385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:04.723674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542703+0000","last_change":"2024-04-23T18:29:21.534750+0000","last_active":"2024-04-23T18:29:52.542703+0000","last_peered":"2024-04-23T18:29:52.542703+0000","last_clean":"2024-04-23T18:29:52.542703+0000","last_became_active":"2024-04-23T18:29:21.534461+0000","last_became_peered":"2024-04-23T18:29:21.534461+0000","last_unstale":"2024-04-23T18:29:52.542703+0000","last_undegraded":"2024-04-23T18:29:52.542703+0000","last_fullsized":"2024-04-23T18:29:52.542703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:35:55.703412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.910166+0000","last_change":"2024-04-23T18:29:13.504381+0000","last_active":"2024-04-23T18:32:20.910166+0000","last_peered":"2024-04-23T18:32:20.910166+0000","last_clean":"2024-04-23T18:32:20.910166+0000","last_became_active":"2024-04-23T18:29:13.504092+0000","last_became_peered":"2024-04-23T18:29:13.504092+0000","last_unstale":"2024-04-23T18:32:20.910166+0000","last_undegraded":"2024-04-23T18:32:20.910166+0000","last_fullsized":"2024-04-23T18:32:20.910166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:28.289132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.550679+0000","last_change":"2024-04-23T18:29:11.511197+0000","last_active":"2024-04-23T18:29:52.550679+0000","last_peered":"2024-04-23T18:29:52.550679+0000","last_clean":"2024-04-23T18:29:52.550679+0000","last_became_active":"2024-04-23T18:29:11.510456+0000","last_became_peered":"2024-04-23T18:29:11.510456+0000","last_unstale":"2024-04-23T18:29:52.550679+0000","last_undegraded":"2024-04-23T18:29:52.550679+0000","last_fullsized":"2024-04-23T18:29:52.550679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:15.310210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.545740+0000","last_change":"2024-04-23T18:29:15.507536+0000","last_active":"2024-04-23T18:29:52.545740+0000","last_peered":"2024-04-23T18:29:52.545740+0000","last_clean":"2024-04-23T18:29:52.545740+0000","last_became_active":"2024-04-23T18:29:15.506939+0000","last_became_peered":"2024-04-23T18:29:15.506939+0000","last_unstale":"2024-04-23T18:29:52.545740+0000","last_undegraded":"2024-04-23T18:29:52.545740+0000","last_fullsized":"2024-04-23T18:29:52.545740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:33.128258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.042869+0000","last_change":"2024-04-23T18:29:17.511932+0000","last_active":"2024-04-23T18:31:19.042869+0000","last_peered":"2024-04-23T18:31:19.042869+0000","last_clean":"2024-04-23T18:31:19.042869+0000","last_became_active":"2024-04-23T18:29:17.511559+0000","last_became_peered":"2024-04-23T18:29:17.511559+0000","last_unstale":"2024-04-23T18:31:19.042869+0000","last_undegraded":"2024-04-23T18:31:19.042869+0000","last_fullsized":"2024-04-23T18:31:19.042869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:32:09.008618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549463+0000","last_change":"2024-04-23T18:29:19.525590+0000","last_active":"2024-04-23T18:29:52.549463+0000","last_peered":"2024-04-23T18:29:52.549463+0000","last_clean":"2024-04-23T18:29:52.549463+0000","last_became_active":"2024-04-23T18:29:19.525302+0000","last_became_peered":"2024-04-23T18:29:19.525302+0000","last_unstale":"2024-04-23T18:29:52.549463+0000","last_undegraded":"2024-04-23T18:29:52.549463+0000","last_fullsized":"2024-04-23T18:29:52.549463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:57.944932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:18.716199+0000","last_change":"2024-04-23T18:29:21.530275+0000","last_active":"2024-04-23T18:31:18.716199+0000","last_peered":"2024-04-23T18:31:18.716199+0000","last_clean":"2024-04-23T18:31:18.716199+0000","last_became_active":"2024-04-23T18:29:21.530013+0000","last_became_peered":"2024-04-23T18:29:21.530013+0000","last_unstale":"2024-04-23T18:31:18.716199+0000","last_undegraded":"2024-04-23T18:31:18.716199+0000","last_fullsized":"2024-04-23T18:31:18.716199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:53.670984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544156+0000","last_change":"2024-04-23T18:29:13.506992+0000","last_active":"2024-04-23T18:29:52.544156+0000","last_peered":"2024-04-23T18:29:52.544156+0000","last_clean":"2024-04-23T18:29:52.544156+0000","last_became_active":"2024-04-23T18:29:13.506770+0000","last_became_peered":"2024-04-23T18:29:13.506770+0000","last_unstale":"2024-04-23T18:29:52.544156+0000","last_undegraded":"2024-04-23T18:29:52.544156+0000","last_fullsized":"2024-04-23T18:29:52.544156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:31:14.220069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.130507+0000","last_change":"2024-04-23T18:29:11.482617+0000","last_active":"2024-04-23T18:32:21.130507+0000","last_peered":"2024-04-23T18:32:21.130507+0000","last_clean":"2024-04-23T18:32:21.130507+0000","last_became_active":"2024-04-23T18:29:11.481884+0000","last_became_peered":"2024-04-23T18:29:11.481884+0000","last_unstale":"2024-04-23T18:32:21.130507+0000","last_undegraded":"2024-04-23T18:32:21.130507+0000","last_fullsized":"2024-04-23T18:32:21.130507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:08:38.534696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549279+0000","last_change":"2024-04-23T18:29:15.508345+0000","last_active":"2024-04-23T18:29:52.549279+0000","last_peered":"2024-04-23T18:29:52.549279+0000","last_clean":"2024-04-23T18:29:52.549279+0000","last_became_active":"2024-04-23T18:29:15.508018+0000","last_became_peered":"2024-04-23T18:29:15.508018+0000","last_unstale":"2024-04-23T18:29:52.549279+0000","last_undegraded":"2024-04-23T18:29:52.549279+0000","last_fullsized":"2024-04-23T18:29:52.549279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:44:46.349637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.565238+0000","last_change":"2024-04-23T18:29:17.515180+0000","last_active":"2024-04-23T18:32:20.565238+0000","last_peered":"2024-04-23T18:32:20.565238+0000","last_clean":"2024-04-23T18:32:20.565238+0000","last_became_active":"2024-04-23T18:29:17.514836+0000","last_became_peered":"2024-04-23T18:29:17.514836+0000","last_unstale":"2024-04-23T18:32:20.565238+0000","last_undegraded":"2024-04-23T18:32:20.565238+0000","last_fullsized":"2024-04-23T18:32:20.565238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:18.629550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541082+0000","last_change":"2024-04-23T18:29:19.527752+0000","last_active":"2024-04-23T18:29:52.541082+0000","last_peered":"2024-04-23T18:29:52.541082+0000","last_clean":"2024-04-23T18:29:52.541082+0000","last_became_active":"2024-04-23T18:29:19.527461+0000","last_became_peered":"2024-04-23T18:29:19.527461+0000","last_unstale":"2024-04-23T18:29:52.541082+0000","last_undegraded":"2024-04-23T18:29:52.541082+0000","last_fullsized":"2024-04-23T18:29:52.541082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:55.806105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547711+0000","last_change":"2024-04-23T18:29:21.529099+0000","last_active":"2024-04-23T18:29:52.547711+0000","last_peered":"2024-04-23T18:29:52.547711+0000","last_clean":"2024-04-23T18:29:52.547711+0000","last_became_active":"2024-04-23T18:29:21.528772+0000","last_became_peered":"2024-04-23T18:29:21.528772+0000","last_unstale":"2024-04-23T18:29:52.547711+0000","last_undegraded":"2024-04-23T18:29:52.547711+0000","last_fullsized":"2024-04-23T18:29:52.547711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:58.849572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.758624+0000","last_change":"2024-04-23T18:29:13.503536+0000","last_active":"2024-04-23T18:29:53.758624+0000","last_peered":"2024-04-23T18:29:53.758624+0000","last_clean":"2024-04-23T18:29:53.758624+0000","last_became_active":"2024-04-23T18:29:13.502849+0000","last_became_peered":"2024-04-23T18:29:13.502849+0000","last_unstale":"2024-04-23T18:29:53.758624+0000","last_undegraded":"2024-04-23T18:29:53.758624+0000","last_fullsized":"2024-04-23T18:29:53.758624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:27.393642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761184+0000","last_change":"2024-04-23T18:29:11.485392+0000","last_active":"2024-04-23T18:31:36.761184+0000","last_peered":"2024-04-23T18:31:36.761184+0000","last_clean":"2024-04-23T18:31:36.761184+0000","last_became_active":"2024-04-23T18:29:11.483628+0000","last_became_peered":"2024-04-23T18:29:11.483628+0000","last_unstale":"2024-04-23T18:31:36.761184+0000","last_undegraded":"2024-04-23T18:31:36.761184+0000","last_fullsized":"2024-04-23T18:31:36.761184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:50.092624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541320+0000","last_change":"2024-04-23T18:29:15.510472+0000","last_active":"2024-04-23T18:29:52.541320+0000","last_peered":"2024-04-23T18:29:52.541320+0000","last_clean":"2024-04-23T18:29:52.541320+0000","last_became_active":"2024-04-23T18:29:15.510130+0000","last_became_peered":"2024-04-23T18:29:15.510130+0000","last_unstale":"2024-04-23T18:29:52.541320+0000","last_undegraded":"2024-04-23T18:29:52.541320+0000","last_fullsized":"2024-04-23T18:29:52.541320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:21.124426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'41","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.618994+0000","last_change":"2024-04-23T18:29:17.510778+0000","last_active":"2024-04-23T18:32:20.618994+0000","last_peered":"2024-04-23T18:32:20.618994+0000","last_clean":"2024-04-23T18:32:20.618994+0000","last_became_active":"2024-04-23T18:29:17.510429+0000","last_became_peered":"2024-04-23T18:29:17.510429+0000","last_unstale":"2024-04-23T18:32:20.618994+0000","last_undegraded":"2024-04-23T18:32:20.618994+0000","last_fullsized":"2024-04-23T18:32:20.618994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:55.966235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543935+0000","last_change":"2024-04-23T18:29:19.519077+0000","last_active":"2024-04-23T18:29:52.543935+0000","last_peered":"2024-04-23T18:29:52.543935+0000","last_clean":"2024-04-23T18:29:52.543935+0000","last_became_active":"2024-04-23T18:29:19.518543+0000","last_became_peered":"2024-04-23T18:29:19.518543+0000","last_unstale":"2024-04-23T18:29:52.543935+0000","last_undegraded":"2024-04-23T18:29:52.543935+0000","last_fullsized":"2024-04-23T18:29:52.543935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:35:53.694069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551260+0000","last_change":"2024-04-23T18:29:21.534350+0000","last_active":"2024-04-23T18:29:52.551260+0000","last_peered":"2024-04-23T18:29:52.551260+0000","last_clean":"2024-04-23T18:29:52.551260+0000","last_became_active":"2024-04-23T18:29:21.534023+0000","last_became_peered":"2024-04-23T18:29:21.534023+0000","last_unstale":"2024-04-23T18:29:52.551260+0000","last_undegraded":"2024-04-23T18:29:52.551260+0000","last_fullsized":"2024-04-23T18:29:52.551260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:14:43.043132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'19","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762471+0000","last_change":"2024-04-23T18:29:13.501148+0000","last_active":"2024-04-23T18:31:36.762471+0000","last_peered":"2024-04-23T18:31:36.762471+0000","last_clean":"2024-04-23T18:31:36.762471+0000","last_became_active":"2024-04-23T18:29:13.500877+0000","last_became_peered":"2024-04-23T18:29:13.500877+0000","last_unstale":"2024-04-23T18:31:36.762471+0000","last_undegraded":"2024-04-23T18:31:36.762471+0000","last_fullsized":"2024-04-23T18:31:36.762471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:29:12.567941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":53,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.302552+0000","last_change":"2024-04-23T18:29:11.498275+0000","last_active":"2024-04-23T18:29:54.302552+0000","last_peered":"2024-04-23T18:29:54.302552+0000","last_clean":"2024-04-23T18:29:54.302552+0000","last_became_active":"2024-04-23T18:29:11.497953+0000","last_became_peered":"2024-04-23T18:29:11.497953+0000","last_unstale":"2024-04-23T18:29:54.302552+0000","last_undegraded":"2024-04-23T18:29:54.302552+0000","last_fullsized":"2024-04-23T18:29:54.302552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:39:13.562652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549826+0000","last_change":"2024-04-23T18:29:15.507545+0000","last_active":"2024-04-23T18:29:52.549826+0000","last_peered":"2024-04-23T18:29:52.549826+0000","last_clean":"2024-04-23T18:29:52.549826+0000","last_became_active":"2024-04-23T18:29:15.507253+0000","last_became_peered":"2024-04-23T18:29:15.507253+0000","last_unstale":"2024-04-23T18:29:52.549826+0000","last_undegraded":"2024-04-23T18:29:52.549826+0000","last_fullsized":"2024-04-23T18:29:52.549826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:24.598564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.028065+0000","last_change":"2024-04-23T18:29:17.514117+0000","last_active":"2024-04-23T18:31:19.028065+0000","last_peered":"2024-04-23T18:31:19.028065+0000","last_clean":"2024-04-23T18:31:19.028065+0000","last_became_active":"2024-04-23T18:29:17.512820+0000","last_became_peered":"2024-04-23T18:29:17.512820+0000","last_unstale":"2024-04-23T18:31:19.028065+0000","last_undegraded":"2024-04-23T18:31:19.028065+0000","last_fullsized":"2024-04-23T18:31:19.028065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:05.590357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541424+0000","last_change":"2024-04-23T18:29:19.525834+0000","last_active":"2024-04-23T18:29:52.541424+0000","last_peered":"2024-04-23T18:29:52.541424+0000","last_clean":"2024-04-23T18:29:52.541424+0000","last_became_active":"2024-04-23T18:29:19.525424+0000","last_became_peered":"2024-04-23T18:29:19.525424+0000","last_unstale":"2024-04-23T18:29:52.541424+0000","last_undegraded":"2024-04-23T18:29:52.541424+0000","last_fullsized":"2024-04-23T18:29:52.541424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:52.622390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.183703+0000","last_change":"2024-04-23T18:29:13.496471+0000","last_active":"2024-04-23T18:32:21.183703+0000","last_peered":"2024-04-23T18:32:21.183703+0000","last_clean":"2024-04-23T18:32:21.183703+0000","last_became_active":"2024-04-23T18:29:13.496179+0000","last_became_peered":"2024-04-23T18:29:13.496179+0000","last_unstale":"2024-04-23T18:32:21.183703+0000","last_undegraded":"2024-04-23T18:32:21.183703+0000","last_fullsized":"2024-04-23T18:32:21.183703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:31.148672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547581+0000","last_change":"2024-04-23T18:29:11.500546+0000","last_active":"2024-04-23T18:29:52.547581+0000","last_peered":"2024-04-23T18:29:52.547581+0000","last_clean":"2024-04-23T18:29:52.547581+0000","last_became_active":"2024-04-23T18:29:11.500118+0000","last_became_peered":"2024-04-23T18:29:11.500118+0000","last_unstale":"2024-04-23T18:29:52.547581+0000","last_undegraded":"2024-04-23T18:29:52.547581+0000","last_fullsized":"2024-04-23T18:29:52.547581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:46.386426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549417+0000","last_change":"2024-04-23T18:29:15.506605+0000","last_active":"2024-04-23T18:29:52.549417+0000","last_peered":"2024-04-23T18:29:52.549417+0000","last_clean":"2024-04-23T18:29:52.549417+0000","last_became_active":"2024-04-23T18:29:15.506197+0000","last_became_peered":"2024-04-23T18:29:15.506197+0000","last_unstale":"2024-04-23T18:29:52.549417+0000","last_undegraded":"2024-04-23T18:29:52.549417+0000","last_fullsized":"2024-04-23T18:29:52.549417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:23:51.396518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'57","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.049212+0000","last_change":"2024-04-23T18:29:17.515116+0000","last_active":"2024-04-23T18:31:19.049212+0000","last_peered":"2024-04-23T18:31:19.049212+0000","last_clean":"2024-04-23T18:31:19.049212+0000","last_became_active":"2024-04-23T18:29:17.514800+0000","last_became_peered":"2024-04-23T18:29:17.514800+0000","last_unstale":"2024-04-23T18:31:19.049212+0000","last_undegraded":"2024-04-23T18:31:19.049212+0000","last_fullsized":"2024-04-23T18:31:19.049212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:42.936606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542001+0000","last_change":"2024-04-23T18:29:19.524639+0000","last_active":"2024-04-23T18:29:52.542001+0000","last_peered":"2024-04-23T18:29:52.542001+0000","last_clean":"2024-04-23T18:29:52.542001+0000","last_became_active":"2024-04-23T18:29:19.524351+0000","last_became_peered":"2024-04-23T18:29:19.524351+0000","last_unstale":"2024-04-23T18:29:52.542001+0000","last_undegraded":"2024-04-23T18:29:52.542001+0000","last_fullsized":"2024-04-23T18:29:52.542001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:45.448270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.483433+0000","last_change":"2024-04-23T18:29:21.529140+0000","last_active":"2024-04-23T18:31:20.483433+0000","last_peered":"2024-04-23T18:31:20.483433+0000","last_clean":"2024-04-23T18:31:20.483433+0000","last_became_active":"2024-04-23T18:29:21.528819+0000","last_became_peered":"2024-04-23T18:29:21.528819+0000","last_unstale":"2024-04-23T18:31:20.483433+0000","last_undegraded":"2024-04-23T18:31:20.483433+0000","last_fullsized":"2024-04-23T18:31:20.483433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:12.967213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.809775+0000","last_change":"2024-04-23T18:29:13.499526+0000","last_active":"2024-04-23T18:29:54.809775+0000","last_peered":"2024-04-23T18:29:54.809775+0000","last_clean":"2024-04-23T18:29:54.809775+0000","last_became_active":"2024-04-23T18:29:13.499137+0000","last_became_peered":"2024-04-23T18:29:13.499137+0000","last_unstale":"2024-04-23T18:29:54.809775+0000","last_undegraded":"2024-04-23T18:29:54.809775+0000","last_fullsized":"2024-04-23T18:29:54.809775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:09:37.644601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543171+0000","last_change":"2024-04-23T18:29:11.500980+0000","last_active":"2024-04-23T18:29:52.543171+0000","last_peered":"2024-04-23T18:29:52.543171+0000","last_clean":"2024-04-23T18:29:52.543171+0000","last_became_active":"2024-04-23T18:29:11.500584+0000","last_became_peered":"2024-04-23T18:29:11.500584+0000","last_unstale":"2024-04-23T18:29:52.543171+0000","last_undegraded":"2024-04-23T18:29:52.543171+0000","last_fullsized":"2024-04-23T18:29:52.543171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:31.151193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544749+0000","last_change":"2024-04-23T18:29:15.503669+0000","last_active":"2024-04-23T18:29:52.544749+0000","last_peered":"2024-04-23T18:29:52.544749+0000","last_clean":"2024-04-23T18:29:52.544749+0000","last_became_active":"2024-04-23T18:29:15.503315+0000","last_became_peered":"2024-04-23T18:29:15.503315+0000","last_unstale":"2024-04-23T18:29:52.544749+0000","last_undegraded":"2024-04-23T18:29:52.544749+0000","last_fullsized":"2024-04-23T18:29:52.544749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:45.603211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.029019+0000","last_change":"2024-04-23T18:29:17.517217+0000","last_active":"2024-04-23T18:31:19.029019+0000","last_peered":"2024-04-23T18:31:19.029019+0000","last_clean":"2024-04-23T18:31:19.029019+0000","last_became_active":"2024-04-23T18:29:17.516934+0000","last_became_peered":"2024-04-23T18:29:17.516934+0000","last_unstale":"2024-04-23T18:31:19.029019+0000","last_undegraded":"2024-04-23T18:31:19.029019+0000","last_fullsized":"2024-04-23T18:31:19.029019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:47.490248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544700+0000","last_change":"2024-04-23T18:29:19.520167+0000","last_active":"2024-04-23T18:29:52.544700+0000","last_peered":"2024-04-23T18:29:52.544700+0000","last_clean":"2024-04-23T18:29:52.544700+0000","last_became_active":"2024-04-23T18:29:19.519854+0000","last_became_peered":"2024-04-23T18:29:19.519854+0000","last_unstale":"2024-04-23T18:29:52.544700+0000","last_undegraded":"2024-04-23T18:29:52.544700+0000","last_fullsized":"2024-04-23T18:29:52.544700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:49.515308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548061+0000","last_change":"2024-04-23T18:29:21.534768+0000","last_active":"2024-04-23T18:29:52.548061+0000","last_peered":"2024-04-23T18:29:52.548061+0000","last_clean":"2024-04-23T18:29:52.548061+0000","last_became_active":"2024-04-23T18:29:21.534487+0000","last_became_peered":"2024-04-23T18:29:21.534487+0000","last_unstale":"2024-04-23T18:29:52.548061+0000","last_undegraded":"2024-04-23T18:29:52.548061+0000","last_fullsized":"2024-04-23T18:29:52.548061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:32:46.393371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.901371+0000","last_change":"2024-04-23T18:29:13.503374+0000","last_active":"2024-04-23T18:32:20.901371+0000","last_peered":"2024-04-23T18:32:20.901371+0000","last_clean":"2024-04-23T18:32:20.901371+0000","last_became_active":"2024-04-23T18:29:13.502710+0000","last_became_peered":"2024-04-23T18:29:13.502710+0000","last_unstale":"2024-04-23T18:32:20.901371+0000","last_undegraded":"2024-04-23T18:32:20.901371+0000","last_fullsized":"2024-04-23T18:32:20.901371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:02.276254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544043+0000","last_change":"2024-04-23T18:29:11.498320+0000","last_active":"2024-04-23T18:29:52.544043+0000","last_peered":"2024-04-23T18:29:52.544043+0000","last_clean":"2024-04-23T18:29:52.544043+0000","last_became_active":"2024-04-23T18:29:11.497191+0000","last_became_peered":"2024-04-23T18:29:11.497191+0000","last_unstale":"2024-04-23T18:29:52.544043+0000","last_undegraded":"2024-04-23T18:29:52.544043+0000","last_fullsized":"2024-04-23T18:29:52.544043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:55.553919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543117+0000","last_change":"2024-04-23T18:29:15.502215+0000","last_active":"2024-04-23T18:29:52.543117+0000","last_peered":"2024-04-23T18:29:52.543117+0000","last_clean":"2024-04-23T18:29:52.543117+0000","last_became_active":"2024-04-23T18:29:15.501957+0000","last_became_peered":"2024-04-23T18:29:15.501957+0000","last_unstale":"2024-04-23T18:29:52.543117+0000","last_undegraded":"2024-04-23T18:29:52.543117+0000","last_fullsized":"2024-04-23T18:29:52.543117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:16:23.586603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.047239+0000","last_change":"2024-04-23T18:29:17.503422+0000","last_active":"2024-04-23T18:31:19.047239+0000","last_peered":"2024-04-23T18:31:19.047239+0000","last_clean":"2024-04-23T18:31:19.047239+0000","last_became_active":"2024-04-23T18:29:17.503196+0000","last_became_peered":"2024-04-23T18:29:17.503196+0000","last_unstale":"2024-04-23T18:31:19.047239+0000","last_undegraded":"2024-04-23T18:31:19.047239+0000","last_fullsized":"2024-04-23T18:31:19.047239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:30:37.507116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548417+0000","last_change":"2024-04-23T18:29:19.527985+0000","last_active":"2024-04-23T18:29:52.548417+0000","last_peered":"2024-04-23T18:29:52.548417+0000","last_clean":"2024-04-23T18:29:52.548417+0000","last_became_active":"2024-04-23T18:29:19.527687+0000","last_became_peered":"2024-04-23T18:29:19.527687+0000","last_unstale":"2024-04-23T18:29:52.548417+0000","last_undegraded":"2024-04-23T18:29:52.548417+0000","last_fullsized":"2024-04-23T18:29:52.548417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:54.022979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.542239+0000","last_change":"2024-04-23T18:29:21.534054+0000","last_active":"2024-04-23T18:31:20.542239+0000","last_peered":"2024-04-23T18:31:20.542239+0000","last_clean":"2024-04-23T18:31:20.542239+0000","last_became_active":"2024-04-23T18:29:21.533754+0000","last_became_peered":"2024-04-23T18:29:21.533754+0000","last_unstale":"2024-04-23T18:31:20.542239+0000","last_undegraded":"2024-04-23T18:31:20.542239+0000","last_fullsized":"2024-04-23T18:31:20.542239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:23.688720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.902182+0000","last_change":"2024-04-23T18:29:13.497462+0000","last_active":"2024-04-23T18:32:20.902182+0000","last_peered":"2024-04-23T18:32:20.902182+0000","last_clean":"2024-04-23T18:32:20.902182+0000","last_became_active":"2024-04-23T18:29:13.497121+0000","last_became_peered":"2024-04-23T18:29:13.497121+0000","last_unstale":"2024-04-23T18:32:20.902182+0000","last_undegraded":"2024-04-23T18:32:20.902182+0000","last_fullsized":"2024-04-23T18:32:20.902182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:19.423755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.207298+0000","last_change":"2024-04-23T18:29:11.504900+0000","last_active":"2024-04-23T18:29:53.207298+0000","last_peered":"2024-04-23T18:29:53.207298+0000","last_clean":"2024-04-23T18:29:53.207298+0000","last_became_active":"2024-04-23T18:29:11.504564+0000","last_became_peered":"2024-04-23T18:29:11.504564+0000","last_unstale":"2024-04-23T18:29:53.207298+0000","last_undegraded":"2024-04-23T18:29:53.207298+0000","last_fullsized":"2024-04-23T18:29:53.207298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:26.282130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547964+0000","last_change":"2024-04-23T18:29:15.506519+0000","last_active":"2024-04-23T18:29:52.547964+0000","last_peered":"2024-04-23T18:29:52.547964+0000","last_clean":"2024-04-23T18:29:52.547964+0000","last_became_active":"2024-04-23T18:29:15.506171+0000","last_became_peered":"2024-04-23T18:29:15.506171+0000","last_unstale":"2024-04-23T18:29:52.547964+0000","last_undegraded":"2024-04-23T18:29:52.547964+0000","last_fullsized":"2024-04-23T18:29:52.547964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:29:39.313604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552039+0000","last_change":"2024-04-23T18:29:17.517401+0000","last_active":"2024-04-23T18:29:52.552039+0000","last_peered":"2024-04-23T18:29:52.552039+0000","last_clean":"2024-04-23T18:29:52.552039+0000","last_became_active":"2024-04-23T18:29:17.517051+0000","last_became_peered":"2024-04-23T18:29:17.517051+0000","last_unstale":"2024-04-23T18:29:52.552039+0000","last_undegraded":"2024-04-23T18:29:52.552039+0000","last_fullsized":"2024-04-23T18:29:52.552039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:43.608104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":366,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585498+0000","last_change":"2024-04-23T18:29:19.527952+0000","last_active":"2024-04-23T18:32:20.585498+0000","last_peered":"2024-04-23T18:32:20.585498+0000","last_clean":"2024-04-23T18:32:20.585498+0000","last_became_active":"2024-04-23T18:29:19.527614+0000","last_became_peered":"2024-04-23T18:29:19.527614+0000","last_unstale":"2024-04-23T18:32:20.585498+0000","last_undegraded":"2024-04-23T18:32:20.585498+0000","last_fullsized":"2024-04-23T18:32:20.585498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:37.178104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.792678+0000","last_change":"2024-04-23T18:29:21.531583+0000","last_active":"2024-04-23T18:30:36.792678+0000","last_peered":"2024-04-23T18:30:36.792678+0000","last_clean":"2024-04-23T18:30:36.792678+0000","last_became_active":"2024-04-23T18:29:21.530619+0000","last_became_peered":"2024-04-23T18:29:21.530619+0000","last_unstale":"2024-04-23T18:30:36.792678+0000","last_undegraded":"2024-04-23T18:30:36.792678+0000","last_fullsized":"2024-04-23T18:30:36.792678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:02:25.354970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136433+0000","last_change":"2024-04-23T18:29:13.502162+0000","last_active":"2024-04-23T18:32:21.136433+0000","last_peered":"2024-04-23T18:32:21.136433+0000","last_clean":"2024-04-23T18:32:21.136433+0000","last_became_active":"2024-04-23T18:29:13.501741+0000","last_became_peered":"2024-04-23T18:29:13.501741+0000","last_unstale":"2024-04-23T18:32:21.136433+0000","last_undegraded":"2024-04-23T18:32:21.136433+0000","last_fullsized":"2024-04-23T18:32:21.136433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:24.039627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546726+0000","last_change":"2024-04-23T18:29:11.501098+0000","last_active":"2024-04-23T18:29:52.546726+0000","last_peered":"2024-04-23T18:29:52.546726+0000","last_clean":"2024-04-23T18:29:52.546726+0000","last_became_active":"2024-04-23T18:29:11.500781+0000","last_became_peered":"2024-04-23T18:29:11.500781+0000","last_unstale":"2024-04-23T18:29:52.546726+0000","last_undegraded":"2024-04-23T18:29:52.546726+0000","last_fullsized":"2024-04-23T18:29:52.546726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:49.661961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.553840+0000","last_change":"2024-04-23T18:29:52.550289+0000","last_active":"2024-04-23T18:29:52.553840+0000","last_peered":"2024-04-23T18:29:52.553840+0000","last_clean":"2024-04-23T18:29:52.553840+0000","last_became_active":"2024-04-23T18:29:52.549944+0000","last_became_peered":"2024-04-23T18:29:52.549944+0000","last_unstale":"2024-04-23T18:29:52.553840+0000","last_undegraded":"2024-04-23T18:29:52.553840+0000","last_fullsized":"2024-04-23T18:29:52.553840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.212007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.019745+0000","last_change":"2024-04-23T18:29:17.509362+0000","last_active":"2024-04-23T18:31:19.019745+0000","last_peered":"2024-04-23T18:31:19.019745+0000","last_clean":"2024-04-23T18:31:19.019745+0000","last_became_active":"2024-04-23T18:29:17.509076+0000","last_became_peered":"2024-04-23T18:29:17.509076+0000","last_unstale":"2024-04-23T18:31:19.019745+0000","last_undegraded":"2024-04-23T18:31:19.019745+0000","last_fullsized":"2024-04-23T18:31:19.019745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:59.200856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546279+0000","last_change":"2024-04-23T18:29:19.519211+0000","last_active":"2024-04-23T18:29:52.546279+0000","last_peered":"2024-04-23T18:29:52.546279+0000","last_clean":"2024-04-23T18:29:52.546279+0000","last_became_active":"2024-04-23T18:29:19.518673+0000","last_became_peered":"2024-04-23T18:29:19.518673+0000","last_unstale":"2024-04-23T18:29:52.546279+0000","last_undegraded":"2024-04-23T18:29:52.546279+0000","last_fullsized":"2024-04-23T18:29:52.546279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:16:13.613155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548269+0000","last_change":"2024-04-23T18:29:21.533731+0000","last_active":"2024-04-23T18:29:52.548269+0000","last_peered":"2024-04-23T18:29:52.548269+0000","last_clean":"2024-04-23T18:29:52.548269+0000","last_became_active":"2024-04-23T18:29:21.533187+0000","last_became_peered":"2024-04-23T18:29:21.533187+0000","last_unstale":"2024-04-23T18:29:52.548269+0000","last_undegraded":"2024-04-23T18:29:52.548269+0000","last_fullsized":"2024-04-23T18:29:52.548269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:16.140403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216088+0000","last_change":"2024-04-23T18:29:13.502229+0000","last_active":"2024-04-23T18:32:21.216088+0000","last_peered":"2024-04-23T18:32:21.216088+0000","last_clean":"2024-04-23T18:32:21.216088+0000","last_became_active":"2024-04-23T18:29:13.501974+0000","last_became_peered":"2024-04-23T18:29:13.501974+0000","last_unstale":"2024-04-23T18:32:21.216088+0000","last_undegraded":"2024-04-23T18:32:21.216088+0000","last_fullsized":"2024-04-23T18:32:21.216088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:41.117616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552635+0000","last_change":"2024-04-23T18:29:11.511621+0000","last_active":"2024-04-23T18:29:52.552635+0000","last_peered":"2024-04-23T18:29:52.552635+0000","last_clean":"2024-04-23T18:29:52.552635+0000","last_became_active":"2024-04-23T18:29:11.511297+0000","last_became_peered":"2024-04-23T18:29:11.511297+0000","last_unstale":"2024-04-23T18:29:52.552635+0000","last_undegraded":"2024-04-23T18:29:52.552635+0000","last_fullsized":"2024-04-23T18:29:52.552635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:59.862004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543723+0000","last_change":"2024-04-23T18:29:15.504950+0000","last_active":"2024-04-23T18:29:52.543723+0000","last_peered":"2024-04-23T18:29:52.543723+0000","last_clean":"2024-04-23T18:29:52.543723+0000","last_became_active":"2024-04-23T18:29:15.504528+0000","last_became_peered":"2024-04-23T18:29:15.504528+0000","last_unstale":"2024-04-23T18:29:52.543723+0000","last_undegraded":"2024-04-23T18:29:52.543723+0000","last_fullsized":"2024-04-23T18:29:52.543723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:41.352665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.020878+0000","last_change":"2024-04-23T18:29:17.513717+0000","last_active":"2024-04-23T18:31:19.020878+0000","last_peered":"2024-04-23T18:31:19.020878+0000","last_clean":"2024-04-23T18:31:19.020878+0000","last_became_active":"2024-04-23T18:29:17.513482+0000","last_became_peered":"2024-04-23T18:29:17.513482+0000","last_unstale":"2024-04-23T18:31:19.020878+0000","last_undegraded":"2024-04-23T18:31:19.020878+0000","last_fullsized":"2024-04-23T18:31:19.020878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:10:12.070821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549506+0000","last_change":"2024-04-23T18:29:19.526244+0000","last_active":"2024-04-23T18:29:52.549506+0000","last_peered":"2024-04-23T18:29:52.549506+0000","last_clean":"2024-04-23T18:29:52.549506+0000","last_became_active":"2024-04-23T18:29:19.525985+0000","last_became_peered":"2024-04-23T18:29:19.525985+0000","last_unstale":"2024-04-23T18:29:52.549506+0000","last_undegraded":"2024-04-23T18:29:52.549506+0000","last_fullsized":"2024-04-23T18:29:52.549506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:40.734604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551426+0000","last_change":"2024-04-23T18:29:21.528945+0000","last_active":"2024-04-23T18:29:52.551426+0000","last_peered":"2024-04-23T18:29:52.551426+0000","last_clean":"2024-04-23T18:29:52.551426+0000","last_became_active":"2024-04-23T18:29:21.528665+0000","last_became_peered":"2024-04-23T18:29:21.528665+0000","last_unstale":"2024-04-23T18:29:52.551426+0000","last_undegraded":"2024-04-23T18:29:52.551426+0000","last_fullsized":"2024-04-23T18:29:52.551426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:24.076754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.320824+0000","last_change":"2024-04-23T18:29:13.495164+0000","last_active":"2024-04-23T18:29:54.320824+0000","last_peered":"2024-04-23T18:29:54.320824+0000","last_clean":"2024-04-23T18:29:54.320824+0000","last_became_active":"2024-04-23T18:29:13.494647+0000","last_became_peered":"2024-04-23T18:29:13.494647+0000","last_unstale":"2024-04-23T18:29:54.320824+0000","last_undegraded":"2024-04-23T18:29:54.320824+0000","last_fullsized":"2024-04-23T18:29:54.320824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:29.887241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.266338+0000","last_change":"2024-04-23T18:29:11.496011+0000","last_active":"2024-04-23T18:31:17.266338+0000","last_peered":"2024-04-23T18:31:17.266338+0000","last_clean":"2024-04-23T18:31:17.266338+0000","last_became_active":"2024-04-23T18:29:11.495723+0000","last_became_peered":"2024-04-23T18:29:11.495723+0000","last_unstale":"2024-04-23T18:31:17.266338+0000","last_undegraded":"2024-04-23T18:31:17.266338+0000","last_fullsized":"2024-04-23T18:31:17.266338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:36:52.346753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543714+0000","last_change":"2024-04-23T18:29:15.510875+0000","last_active":"2024-04-23T18:29:52.543714+0000","last_peered":"2024-04-23T18:29:52.543714+0000","last_clean":"2024-04-23T18:29:52.543714+0000","last_became_active":"2024-04-23T18:29:15.510185+0000","last_became_peered":"2024-04-23T18:29:15.510185+0000","last_unstale":"2024-04-23T18:29:52.543714+0000","last_undegraded":"2024-04-23T18:29:52.543714+0000","last_fullsized":"2024-04-23T18:29:52.543714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:50.678177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'28","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.764076+0000","last_change":"2024-04-23T18:29:17.517329+0000","last_active":"2024-04-23T18:31:46.764076+0000","last_peered":"2024-04-23T18:31:46.764076+0000","last_clean":"2024-04-23T18:31:46.764076+0000","last_became_active":"2024-04-23T18:29:17.516989+0000","last_became_peered":"2024-04-23T18:29:17.516989+0000","last_unstale":"2024-04-23T18:31:46.764076+0000","last_undegraded":"2024-04-23T18:31:46.764076+0000","last_fullsized":"2024-04-23T18:31:46.764076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:12:42.263147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548315+0000","last_change":"2024-04-23T18:29:19.522484+0000","last_active":"2024-04-23T18:29:52.548315+0000","last_peered":"2024-04-23T18:29:52.548315+0000","last_clean":"2024-04-23T18:29:52.548315+0000","last_became_active":"2024-04-23T18:29:19.522217+0000","last_became_peered":"2024-04-23T18:29:19.522217+0000","last_unstale":"2024-04-23T18:29:52.548315+0000","last_undegraded":"2024-04-23T18:29:52.548315+0000","last_fullsized":"2024-04-23T18:29:52.548315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:36:35.803795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.054923+0000","last_change":"2024-04-23T18:29:21.533465+0000","last_active":"2024-04-23T18:31:19.054923+0000","last_peered":"2024-04-23T18:31:19.054923+0000","last_clean":"2024-04-23T18:31:19.054923+0000","last_became_active":"2024-04-23T18:29:21.533152+0000","last_became_peered":"2024-04-23T18:29:21.533152+0000","last_unstale":"2024-04-23T18:31:19.054923+0000","last_undegraded":"2024-04-23T18:31:19.054923+0000","last_fullsized":"2024-04-23T18:31:19.054923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:29.385592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.183234+0000","last_change":"2024-04-23T18:29:13.502434+0000","last_active":"2024-04-23T18:32:21.183234+0000","last_peered":"2024-04-23T18:32:21.183234+0000","last_clean":"2024-04-23T18:32:21.183234+0000","last_became_active":"2024-04-23T18:29:13.501782+0000","last_became_peered":"2024-04-23T18:29:13.501782+0000","last_unstale":"2024-04-23T18:32:21.183234+0000","last_undegraded":"2024-04-23T18:32:21.183234+0000","last_fullsized":"2024-04-23T18:32:21.183234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:12.786478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:16.758702+0000","last_change":"2024-04-23T18:29:11.501970+0000","last_active":"2024-04-23T18:31:16.758702+0000","last_peered":"2024-04-23T18:31:16.758702+0000","last_clean":"2024-04-23T18:31:16.758702+0000","last_became_active":"2024-04-23T18:29:11.501648+0000","last_became_peered":"2024-04-23T18:29:11.501648+0000","last_unstale":"2024-04-23T18:31:16.758702+0000","last_undegraded":"2024-04-23T18:31:16.758702+0000","last_fullsized":"2024-04-23T18:31:16.758702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:50.092624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.716953+0000","last_change":"2024-04-23T18:29:15.510030+0000","last_active":"2024-04-23T18:31:17.716953+0000","last_peered":"2024-04-23T18:31:17.716953+0000","last_clean":"2024-04-23T18:31:17.716953+0000","last_became_active":"2024-04-23T18:29:15.509725+0000","last_became_peered":"2024-04-23T18:29:15.509725+0000","last_unstale":"2024-04-23T18:31:17.716953+0000","last_undegraded":"2024-04-23T18:31:17.716953+0000","last_fullsized":"2024-04-23T18:31:17.716953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:56:00.300728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.580905+0000","last_change":"2024-04-23T18:29:17.515107+0000","last_active":"2024-04-23T18:32:20.580905+0000","last_peered":"2024-04-23T18:32:20.580905+0000","last_clean":"2024-04-23T18:32:20.580905+0000","last_became_active":"2024-04-23T18:29:17.514823+0000","last_became_peered":"2024-04-23T18:29:17.514823+0000","last_unstale":"2024-04-23T18:32:20.580905+0000","last_undegraded":"2024-04-23T18:32:20.580905+0000","last_fullsized":"2024-04-23T18:32:20.580905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:43:37.286173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547277+0000","last_change":"2024-04-23T18:29:19.519462+0000","last_active":"2024-04-23T18:29:52.547277+0000","last_peered":"2024-04-23T18:29:52.547277+0000","last_clean":"2024-04-23T18:29:52.547277+0000","last_became_active":"2024-04-23T18:29:19.519153+0000","last_became_peered":"2024-04-23T18:29:19.519153+0000","last_unstale":"2024-04-23T18:29:52.547277+0000","last_undegraded":"2024-04-23T18:29:52.547277+0000","last_fullsized":"2024-04-23T18:29:52.547277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:04:43.275499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.001111+0000","last_change":"2024-04-23T18:29:21.529659+0000","last_active":"2024-04-23T18:32:21.001111+0000","last_peered":"2024-04-23T18:32:21.001111+0000","last_clean":"2024-04-23T18:32:21.001111+0000","last_became_active":"2024-04-23T18:29:21.529331+0000","last_became_peered":"2024-04-23T18:29:21.529331+0000","last_unstale":"2024-04-23T18:32:21.001111+0000","last_undegraded":"2024-04-23T18:32:21.001111+0000","last_fullsized":"2024-04-23T18:32:21.001111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:10:52.515811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216418+0000","last_change":"2024-04-23T18:29:52.563032+0000","last_active":"2024-04-23T18:32:21.216418+0000","last_peered":"2024-04-23T18:32:21.216418+0000","last_clean":"2024-04-23T18:32:21.216418+0000","last_became_active":"2024-04-23T18:29:52.551523+0000","last_became_peered":"2024-04-23T18:29:52.551523+0000","last_unstale":"2024-04-23T18:32:21.216418+0000","last_undegraded":"2024-04-23T18:32:21.216418+0000","last_fullsized":"2024-04-23T18:32:21.216418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:09:27.042501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.540500+0000","last_change":"2024-04-23T18:29:11.489634+0000","last_active":"2024-04-23T18:29:52.540500+0000","last_peered":"2024-04-23T18:29:52.540500+0000","last_clean":"2024-04-23T18:29:52.540500+0000","last_became_active":"2024-04-23T18:29:11.489284+0000","last_became_peered":"2024-04-23T18:29:11.489284+0000","last_unstale":"2024-04-23T18:29:52.540500+0000","last_undegraded":"2024-04-23T18:29:52.540500+0000","last_fullsized":"2024-04-23T18:29:52.540500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:52.597685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549214+0000","last_change":"2024-04-23T18:29:13.497247+0000","last_active":"2024-04-23T18:29:52.549214+0000","last_peered":"2024-04-23T18:29:52.549214+0000","last_clean":"2024-04-23T18:29:52.549214+0000","last_became_active":"2024-04-23T18:29:13.496958+0000","last_became_peered":"2024-04-23T18:29:13.496958+0000","last_unstale":"2024-04-23T18:29:52.549214+0000","last_undegraded":"2024-04-23T18:29:52.549214+0000","last_fullsized":"2024-04-23T18:29:52.549214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:19.818744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546441+0000","last_change":"2024-04-23T18:29:11.487639+0000","last_active":"2024-04-23T18:29:52.546441+0000","last_peered":"2024-04-23T18:29:52.546441+0000","last_clean":"2024-04-23T18:29:52.546441+0000","last_became_active":"2024-04-23T18:29:11.486563+0000","last_became_peered":"2024-04-23T18:29:11.486563+0000","last_unstale":"2024-04-23T18:29:52.546441+0000","last_undegraded":"2024-04-23T18:29:52.546441+0000","last_fullsized":"2024-04-23T18:29:52.546441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:59.834673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.182969+0000","last_change":"2024-04-23T18:29:13.494907+0000","last_active":"2024-04-23T18:32:21.182969+0000","last_peered":"2024-04-23T18:32:21.182969+0000","last_clean":"2024-04-23T18:32:21.182969+0000","last_became_active":"2024-04-23T18:29:13.494683+0000","last_became_peered":"2024-04-23T18:29:13.494683+0000","last_unstale":"2024-04-23T18:32:21.182969+0000","last_undegraded":"2024-04-23T18:32:21.182969+0000","last_fullsized":"2024-04-23T18:32:21.182969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:39.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:16.759681+0000","last_change":"2024-04-23T18:29:11.511297+0000","last_active":"2024-04-23T18:31:16.759681+0000","last_peered":"2024-04-23T18:31:16.759681+0000","last_clean":"2024-04-23T18:31:16.759681+0000","last_became_active":"2024-04-23T18:29:11.510971+0000","last_became_peered":"2024-04-23T18:29:11.510971+0000","last_unstale":"2024-04-23T18:31:16.759681+0000","last_undegraded":"2024-04-23T18:31:16.759681+0000","last_fullsized":"2024-04-23T18:31:16.759681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:10.779475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278308+0000","last_change":"2024-04-23T18:29:13.497387+0000","last_active":"2024-04-23T18:31:17.278308+0000","last_peered":"2024-04-23T18:31:17.278308+0000","last_clean":"2024-04-23T18:31:17.278308+0000","last_became_active":"2024-04-23T18:29:13.497094+0000","last_became_peered":"2024-04-23T18:29:13.497094+0000","last_unstale":"2024-04-23T18:31:17.278308+0000","last_undegraded":"2024-04-23T18:31:17.278308+0000","last_fullsized":"2024-04-23T18:31:17.278308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:46:30.444504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547921+0000","last_change":"2024-04-23T18:29:11.492610+0000","last_active":"2024-04-23T18:29:52.547921+0000","last_peered":"2024-04-23T18:29:52.547921+0000","last_clean":"2024-04-23T18:29:52.547921+0000","last_became_active":"2024-04-23T18:29:11.492064+0000","last_became_peered":"2024-04-23T18:29:11.492064+0000","last_unstale":"2024-04-23T18:29:52.547921+0000","last_undegraded":"2024-04-23T18:29:52.547921+0000","last_fullsized":"2024-04-23T18:29:52.547921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:53.075916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998383+0000","last_change":"2024-04-23T18:29:13.502885+0000","last_active":"2024-04-23T18:32:20.998383+0000","last_peered":"2024-04-23T18:32:20.998383+0000","last_clean":"2024-04-23T18:32:20.998383+0000","last_became_active":"2024-04-23T18:29:13.502243+0000","last_became_peered":"2024-04-23T18:29:13.502243+0000","last_unstale":"2024-04-23T18:32:20.998383+0000","last_undegraded":"2024-04-23T18:32:20.998383+0000","last_fullsized":"2024-04-23T18:32:20.998383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:03:43.333220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548416+0000","last_change":"2024-04-23T18:29:11.486754+0000","last_active":"2024-04-23T18:29:52.548416+0000","last_peered":"2024-04-23T18:29:52.548416+0000","last_clean":"2024-04-23T18:29:52.548416+0000","last_became_active":"2024-04-23T18:29:11.486452+0000","last_became_peered":"2024-04-23T18:29:11.486452+0000","last_unstale":"2024-04-23T18:29:52.548416+0000","last_undegraded":"2024-04-23T18:29:52.548416+0000","last_fullsized":"2024-04-23T18:29:52.548416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:15.136106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185774+0000","last_change":"2024-04-23T18:29:13.507893+0000","last_active":"2024-04-23T18:32:21.185774+0000","last_peered":"2024-04-23T18:32:21.185774+0000","last_clean":"2024-04-23T18:32:21.185774+0000","last_became_active":"2024-04-23T18:29:13.507582+0000","last_became_peered":"2024-04-23T18:29:13.507582+0000","last_unstale":"2024-04-23T18:32:21.185774+0000","last_undegraded":"2024-04-23T18:32:21.185774+0000","last_fullsized":"2024-04-23T18:32:21.185774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:50.962263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544908+0000","last_change":"2024-04-23T18:29:11.495366+0000","last_active":"2024-04-23T18:29:52.544908+0000","last_peered":"2024-04-23T18:29:52.544908+0000","last_clean":"2024-04-23T18:29:52.544908+0000","last_became_active":"2024-04-23T18:29:11.493318+0000","last_became_peered":"2024-04-23T18:29:11.493318+0000","last_unstale":"2024-04-23T18:29:52.544908+0000","last_undegraded":"2024-04-23T18:29:52.544908+0000","last_fullsized":"2024-04-23T18:29:52.544908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:47:48.291376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'22","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136764+0000","last_change":"2024-04-23T18:29:13.499537+0000","last_active":"2024-04-23T18:32:21.136764+0000","last_peered":"2024-04-23T18:32:21.136764+0000","last_clean":"2024-04-23T18:32:21.136764+0000","last_became_active":"2024-04-23T18:29:13.499155+0000","last_became_peered":"2024-04-23T18:29:13.499155+0000","last_unstale":"2024-04-23T18:32:21.136764+0000","last_undegraded":"2024-04-23T18:32:21.136764+0000","last_fullsized":"2024-04-23T18:32:21.136764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:10:40.469094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544921+0000","last_change":"2024-04-23T18:29:11.486471+0000","last_active":"2024-04-23T18:29:52.544921+0000","last_peered":"2024-04-23T18:29:52.544921+0000","last_clean":"2024-04-23T18:29:52.544921+0000","last_became_active":"2024-04-23T18:29:11.485201+0000","last_became_peered":"2024-04-23T18:29:11.485201+0000","last_unstale":"2024-04-23T18:29:52.544921+0000","last_undegraded":"2024-04-23T18:29:52.544921+0000","last_fullsized":"2024-04-23T18:29:52.544921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:34.195698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.902933+0000","last_change":"2024-04-23T18:29:13.497344+0000","last_active":"2024-04-23T18:32:20.902933+0000","last_peered":"2024-04-23T18:32:20.902933+0000","last_clean":"2024-04-23T18:32:20.902933+0000","last_became_active":"2024-04-23T18:29:13.495654+0000","last_became_peered":"2024-04-23T18:29:13.495654+0000","last_unstale":"2024-04-23T18:32:20.902933+0000","last_undegraded":"2024-04-23T18:32:20.902933+0000","last_fullsized":"2024-04-23T18:32:20.902933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:15.838895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549092+0000","last_change":"2024-04-23T18:29:11.495685+0000","last_active":"2024-04-23T18:29:52.549092+0000","last_peered":"2024-04-23T18:29:52.549092+0000","last_clean":"2024-04-23T18:29:52.549092+0000","last_became_active":"2024-04-23T18:29:11.495224+0000","last_became_peered":"2024-04-23T18:29:11.495224+0000","last_unstale":"2024-04-23T18:29:52.549092+0000","last_undegraded":"2024-04-23T18:29:52.549092+0000","last_fullsized":"2024-04-23T18:29:52.549092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:44.033653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185125+0000","last_change":"2024-04-23T18:29:13.498009+0000","last_active":"2024-04-23T18:32:21.185125+0000","last_peered":"2024-04-23T18:32:21.185125+0000","last_clean":"2024-04-23T18:32:21.185125+0000","last_became_active":"2024-04-23T18:29:13.497588+0000","last_became_peered":"2024-04-23T18:29:13.497588+0000","last_unstale":"2024-04-23T18:32:21.185125+0000","last_undegraded":"2024-04-23T18:32:21.185125+0000","last_fullsized":"2024-04-23T18:32:21.185125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:34.172125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.299467+0000","last_change":"2024-04-23T18:29:11.496267+0000","last_active":"2024-04-23T18:29:54.299467+0000","last_peered":"2024-04-23T18:29:54.299467+0000","last_clean":"2024-04-23T18:29:54.299467+0000","last_became_active":"2024-04-23T18:29:11.495948+0000","last_became_peered":"2024-04-23T18:29:11.495948+0000","last_unstale":"2024-04-23T18:29:54.299467+0000","last_undegraded":"2024-04-23T18:29:54.299467+0000","last_fullsized":"2024-04-23T18:29:54.299467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:25:25.829104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278306+0000","last_change":"2024-04-23T18:29:13.501113+0000","last_active":"2024-04-23T18:31:17.278306+0000","last_peered":"2024-04-23T18:31:17.278306+0000","last_clean":"2024-04-23T18:31:17.278306+0000","last_became_active":"2024-04-23T18:29:13.500819+0000","last_became_peered":"2024-04-23T18:29:13.500819+0000","last_unstale":"2024-04-23T18:31:17.278306+0000","last_undegraded":"2024-04-23T18:31:17.278306+0000","last_fullsized":"2024-04-23T18:31:17.278306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:49.776673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546657+0000","last_change":"2024-04-23T18:29:11.493307+0000","last_active":"2024-04-23T18:29:52.546657+0000","last_peered":"2024-04-23T18:29:52.546657+0000","last_clean":"2024-04-23T18:29:52.546657+0000","last_became_active":"2024-04-23T18:29:11.492727+0000","last_became_peered":"2024-04-23T18:29:11.492727+0000","last_unstale":"2024-04-23T18:29:52.546657+0000","last_undegraded":"2024-04-23T18:29:52.546657+0000","last_fullsized":"2024-04-23T18:29:52.546657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:00.435842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216435+0000","last_change":"2024-04-23T18:29:13.503226+0000","last_active":"2024-04-23T18:32:21.216435+0000","last_peered":"2024-04-23T18:32:21.216435+0000","last_clean":"2024-04-23T18:32:21.216435+0000","last_became_active":"2024-04-23T18:29:13.502835+0000","last_became_peered":"2024-04-23T18:29:13.502835+0000","last_unstale":"2024-04-23T18:32:21.216435+0000","last_undegraded":"2024-04-23T18:32:21.216435+0000","last_fullsized":"2024-04-23T18:32:21.216435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:52.502192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.116559+0000","last_change":"2024-04-23T18:29:11.500172+0000","last_active":"2024-04-23T18:32:21.116559+0000","last_peered":"2024-04-23T18:32:21.116559+0000","last_clean":"2024-04-23T18:32:21.116559+0000","last_became_active":"2024-04-23T18:29:11.498708+0000","last_became_peered":"2024-04-23T18:29:11.498708+0000","last_unstale":"2024-04-23T18:32:21.116559+0000","last_undegraded":"2024-04-23T18:32:21.116559+0000","last_fullsized":"2024-04-23T18:32:21.116559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:30.568409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998106+0000","last_change":"2024-04-23T18:29:13.494415+0000","last_active":"2024-04-23T18:32:20.998106+0000","last_peered":"2024-04-23T18:32:20.998106+0000","last_clean":"2024-04-23T18:32:20.998106+0000","last_became_active":"2024-04-23T18:29:13.494121+0000","last_became_peered":"2024-04-23T18:29:13.494121+0000","last_unstale":"2024-04-23T18:32:20.998106+0000","last_undegraded":"2024-04-23T18:32:20.998106+0000","last_fullsized":"2024-04-23T18:32:20.998106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:53.187803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.785091+0000","last_change":"2024-04-23T18:29:11.490442+0000","last_active":"2024-04-23T18:30:36.785091+0000","last_peered":"2024-04-23T18:30:36.785091+0000","last_clean":"2024-04-23T18:30:36.785091+0000","last_became_active":"2024-04-23T18:29:11.489671+0000","last_became_peered":"2024-04-23T18:29:11.489671+0000","last_unstale":"2024-04-23T18:30:36.785091+0000","last_undegraded":"2024-04-23T18:30:36.785091+0000","last_fullsized":"2024-04-23T18:30:36.785091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:36.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185209+0000","last_change":"2024-04-23T18:29:13.507705+0000","last_active":"2024-04-23T18:32:21.185209+0000","last_peered":"2024-04-23T18:32:21.185209+0000","last_clean":"2024-04-23T18:32:21.185209+0000","last_became_active":"2024-04-23T18:29:13.507438+0000","last_became_peered":"2024-04-23T18:29:13.507438+0000","last_unstale":"2024-04-23T18:32:21.185209+0000","last_undegraded":"2024-04-23T18:32:21.185209+0000","last_fullsized":"2024-04-23T18:32:21.185209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:21.755001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.761106+0000","last_change":"2024-04-23T18:29:11.511457+0000","last_active":"2024-04-23T18:31:26.761106+0000","last_peered":"2024-04-23T18:31:26.761106+0000","last_clean":"2024-04-23T18:31:26.761106+0000","last_became_active":"2024-04-23T18:29:11.510882+0000","last_became_peered":"2024-04-23T18:29:11.510882+0000","last_unstale":"2024-04-23T18:31:26.761106+0000","last_undegraded":"2024-04-23T18:31:26.761106+0000","last_fullsized":"2024-04-23T18:31:26.761106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:53:49.753580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.183468+0000","last_change":"2024-04-23T18:29:13.497528+0000","last_active":"2024-04-23T18:32:21.183468+0000","last_peered":"2024-04-23T18:32:21.183468+0000","last_clean":"2024-04-23T18:32:21.183468+0000","last_became_active":"2024-04-23T18:29:13.497271+0000","last_became_peered":"2024-04-23T18:29:13.497271+0000","last_unstale":"2024-04-23T18:32:21.183468+0000","last_undegraded":"2024-04-23T18:32:21.183468+0000","last_fullsized":"2024-04-23T18:32:21.183468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:16:21.578410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552824+0000","last_change":"2024-04-23T18:29:11.507084+0000","last_active":"2024-04-23T18:29:52.552824+0000","last_peered":"2024-04-23T18:29:52.552824+0000","last_clean":"2024-04-23T18:29:52.552824+0000","last_became_active":"2024-04-23T18:29:11.506749+0000","last_became_peered":"2024-04-23T18:29:11.506749+0000","last_unstale":"2024-04-23T18:29:52.552824+0000","last_undegraded":"2024-04-23T18:29:52.552824+0000","last_fullsized":"2024-04-23T18:29:52.552824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:56.973382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278854+0000","last_change":"2024-04-23T18:29:13.501439+0000","last_active":"2024-04-23T18:31:17.278854+0000","last_peered":"2024-04-23T18:31:17.278854+0000","last_clean":"2024-04-23T18:31:17.278854+0000","last_became_active":"2024-04-23T18:29:13.501177+0000","last_became_peered":"2024-04-23T18:29:13.501177+0000","last_unstale":"2024-04-23T18:31:17.278854+0000","last_undegraded":"2024-04-23T18:31:17.278854+0000","last_fullsized":"2024-04-23T18:31:17.278854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:34.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760399+0000","last_change":"2024-04-23T18:29:11.485837+0000","last_active":"2024-04-23T18:31:31.760399+0000","last_peered":"2024-04-23T18:31:31.760399+0000","last_clean":"2024-04-23T18:31:31.760399+0000","last_became_active":"2024-04-23T18:29:11.484137+0000","last_became_peered":"2024-04-23T18:29:11.484137+0000","last_unstale":"2024-04-23T18:31:31.760399+0000","last_undegraded":"2024-04-23T18:31:31.760399+0000","last_fullsized":"2024-04-23T18:31:31.760399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:31.151193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.615235+0000","last_change":"2024-04-23T18:29:13.498423+0000","last_active":"2024-04-23T18:30:36.615235+0000","last_peered":"2024-04-23T18:30:36.615235+0000","last_clean":"2024-04-23T18:30:36.615235+0000","last_became_active":"2024-04-23T18:29:13.494034+0000","last_became_peered":"2024-04-23T18:29:13.494034+0000","last_unstale":"2024-04-23T18:30:36.615235+0000","last_undegraded":"2024-04-23T18:30:36.615235+0000","last_fullsized":"2024-04-23T18:30:36.615235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:54.917516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552128+0000","last_change":"2024-04-23T18:29:11.507132+0000","last_active":"2024-04-23T18:29:52.552128+0000","last_peered":"2024-04-23T18:29:52.552128+0000","last_clean":"2024-04-23T18:29:52.552128+0000","last_became_active":"2024-04-23T18:29:11.506801+0000","last_became_peered":"2024-04-23T18:29:11.506801+0000","last_unstale":"2024-04-23T18:29:52.552128+0000","last_undegraded":"2024-04-23T18:29:52.552128+0000","last_fullsized":"2024-04-23T18:29:52.552128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.831893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549216+0000","last_change":"2024-04-23T18:29:11.495271+0000","last_active":"2024-04-23T18:29:52.549216+0000","last_peered":"2024-04-23T18:29:52.549216+0000","last_clean":"2024-04-23T18:29:52.549216+0000","last_became_active":"2024-04-23T18:29:11.494891+0000","last_became_peered":"2024-04-23T18:29:11.494891+0000","last_unstale":"2024-04-23T18:29:52.549216+0000","last_undegraded":"2024-04-23T18:29:52.549216+0000","last_fullsized":"2024-04-23T18:29:52.549216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:22:00.867668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759697+0000","last_change":"2024-04-23T18:29:13.495173+0000","last_active":"2024-04-23T18:31:39.759697+0000","last_peered":"2024-04-23T18:31:39.759697+0000","last_clean":"2024-04-23T18:31:39.759697+0000","last_became_active":"2024-04-23T18:29:13.494850+0000","last_became_peered":"2024-04-23T18:29:13.494850+0000","last_unstale":"2024-04-23T18:31:39.759697+0000","last_undegraded":"2024-04-23T18:31:39.759697+0000","last_fullsized":"2024-04-23T18:31:39.759697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:34:01.705044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.122702+0000","last_change":"2024-04-23T18:29:11.495720+0000","last_active":"2024-04-23T18:32:21.122702+0000","last_peered":"2024-04-23T18:32:21.122702+0000","last_clean":"2024-04-23T18:32:21.122702+0000","last_became_active":"2024-04-23T18:29:11.495173+0000","last_became_peered":"2024-04-23T18:29:11.495173+0000","last_unstale":"2024-04-23T18:32:21.122702+0000","last_undegraded":"2024-04-23T18:32:21.122702+0000","last_fullsized":"2024-04-23T18:32:21.122702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:25:10.587855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.762456+0000","last_change":"2024-04-23T18:29:13.506361+0000","last_active":"2024-04-23T18:31:41.762456+0000","last_peered":"2024-04-23T18:31:41.762456+0000","last_clean":"2024-04-23T18:31:41.762456+0000","last_became_active":"2024-04-23T18:29:13.506122+0000","last_became_peered":"2024-04-23T18:29:13.506122+0000","last_unstale":"2024-04-23T18:31:41.762456+0000","last_undegraded":"2024-04-23T18:31:41.762456+0000","last_fullsized":"2024-04-23T18:31:41.762456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:28.025600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1604,"num_read_kb":1494,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640301,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48412,"kb_used_data":13076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323428,"statfs":{"total":96636764160,"available":96587190272,"internally_reserved":0,"allocated":13389824,"data_stored":13058752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640301,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44520,"kb_used_data":9184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327320,"statfs":{"total":96636764160,"available":96591175680,"internally_reserved":0,"allocated":9404416,"data_stored":9128922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42808,"kb_used_data":7472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329032,"statfs":{"total":96636764160,"available":96592928768,"internally_reserved":0,"allocated":7651328,"data_stored":7353470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50484,"kb_used_data":10988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321356,"statfs":{"total":96636764160,"available":96585068544,"internally_reserved":0,"allocated":11251712,"data_stored":10958282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:32:28.618 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T18:32:28.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:32:28.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.758+0000 7f8258c87640 1 Processor -- start 2024-04-23T18:32:28.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.758+0000 7f8258c87640 1 -- start start 2024-04-23T18:32:28.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.759+0000 7f8258c87640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f825412ea70 0x7f825412f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:28.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.759+0000 7f8258c87640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f825406e5a0 con 0x7f825412b4f0 2024-04-23T18:32:28.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.759+0000 7f8258c87640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f8254098cc0 con 0x7f825412ea70 2024-04-23T18:32:28.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.759+0000 7f825259c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f825412ea70 0x7f825412f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:28.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.759+0000 7f8251d9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f825412b4f0 0x7f825412b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41598/0 (socket says 172.21.15.62:41598) 2024-04-23T18:32:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.759+0000 7f8251d9b640 1 -- 172.21.15.62:0/1065972849 learned_addr learned my addr 172.21.15.62:0/1065972849 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.759+0000 7f825259c640 1 -- 172.21.15.62:0/1065972849 >> v1:172.21.15.62:6789/0 conn(0x7f825412b4f0 legacy=0x7f825412b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.759+0000 7f825259c640 1 -- 172.21.15.62:0/1065972849 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82540989d0 con 0x7f825412ea70 2024-04-23T18:32:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.760+0000 7f825259c640 1 --2- 172.21.15.62:0/1065972849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f825412ea70 0x7f825412f270 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f824c009720 tx=0x7f824c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe8bb73693517d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.760+0000 7f825159a640 1 -- 172.21.15.62:0/1065972849 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f824c035020 con 0x7f825412ea70 2024-04-23T18:32:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.760+0000 7f825159a640 1 -- 172.21.15.62:0/1065972849 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824c031760 con 0x7f825412ea70 2024-04-23T18:32:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.760+0000 7f825159a640 1 -- 172.21.15.62:0/1065972849 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f824c031a60 con 0x7f825412ea70 2024-04-23T18:32:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.761+0000 7f8258c87640 1 -- 172.21.15.62:0/1065972849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f825412ea70 msgr2=0x7f825412f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.761+0000 7f8258c87640 1 --2- 172.21.15.62:0/1065972849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f825412ea70 0x7f825412f270 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f824c009720 tx=0x7f824c02b8d0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.761+0000 7f8258c87640 1 -- 172.21.15.62:0/1065972849 shutdown_connections 2024-04-23T18:32:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.761+0000 7f8258c87640 1 --2- 172.21.15.62:0/1065972849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f825412ea70 0x7f825412f270 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.761+0000 7f8258c87640 1 -- 172.21.15.62:0/1065972849 >> 172.21.15.62:0/1065972849 conn(0x7f82540a1000 msgr2=0x7f82540a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:28.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.761+0000 7f8258c87640 1 -- 172.21.15.62:0/1065972849 shutdown_connections 2024-04-23T18:32:28.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.761+0000 7f8258c87640 1 -- 172.21.15.62:0/1065972849 wait complete. 2024-04-23T18:32:28.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.762+0000 7f8258c87640 1 Processor -- start 2024-04-23T18:32:28.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.762+0000 7f8258c87640 1 -- start start 2024-04-23T18:32:28.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.762+0000 7f8258c87640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f825412b4f0 0x7f825408b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:28.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.762+0000 7f8258c87640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f825412f930 con 0x7f825412b4f0 2024-04-23T18:32:28.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.762+0000 7f825259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f825412b4f0 0x7f825408b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:28.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.762+0000 7f825259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f825412b4f0 0x7f825408b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42216/0 (socket says 172.21.15.62:42216) 2024-04-23T18:32:28.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.762+0000 7f825259c640 1 -- 172.21.15.62:0/519209783 learned_addr learned my addr 172.21.15.62:0/519209783 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:28.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.762+0000 7f825259c640 1 -- 172.21.15.62:0/519209783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825408d6c0 con 0x7f825412b4f0 2024-04-23T18:32:28.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.762+0000 7f825259c640 1 --2- 172.21.15.62:0/519209783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f825412b4f0 0x7f825408b910 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f824c009840 tx=0x7f824c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:28.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.763+0000 7f824affd640 1 -- 172.21.15.62:0/519209783 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f824c03b930 con 0x7f825412b4f0 2024-04-23T18:32:28.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.763+0000 7f824affd640 1 -- 172.21.15.62:0/519209783 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824c03bb10 con 0x7f825412b4f0 2024-04-23T18:32:28.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.763+0000 7f8258c87640 1 -- 172.21.15.62:0/519209783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f825409a2e0 con 0x7f825412b4f0 2024-04-23T18:32:28.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.763+0000 7f824affd640 1 -- 172.21.15.62:0/519209783 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f824c03be30 con 0x7f825412b4f0 2024-04-23T18:32:28.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.763+0000 7f8258c87640 1 -- 172.21.15.62:0/519209783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f825408e350 con 0x7f825412b4f0 2024-04-23T18:32:28.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.763+0000 7f824affd640 1 -- 172.21.15.62:0/519209783 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f824c04c060 con 0x7f825412b4f0 2024-04-23T18:32:28.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.764+0000 7f824affd640 1 --2- 172.21.15.62:0/519209783 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f82340385c0 0x7f823403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:28.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.764+0000 7f824affd640 1 -- 172.21.15.62:0/519209783 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f824c06e000 con 0x7f825412b4f0 2024-04-23T18:32:28.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.764+0000 7f8258c87640 1 -- 172.21.15.62:0/519209783 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f825408d220 con 0x7f825412b4f0 2024-04-23T18:32:28.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.764+0000 7f8251d9b640 1 --2- 172.21.15.62:0/519209783 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f82340385c0 0x7f823403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:28.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.764+0000 7f8251d9b640 1 --2- 172.21.15.62:0/519209783 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f82340385c0 0x7f823403aa80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f823c007fd0 tx=0x7f823c007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:28.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.769+0000 7f824affd640 1 -- 172.21.15.62:0/519209783 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f824c040070 con 0x7f825412b4f0 2024-04-23T18:32:28.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.956+0000 7f8258c87640 1 -- 172.21.15.62:0/519209783 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82540505b0 con 0x7f82340385c0 2024-04-23T18:32:28.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.970+0000 7f824affd640 1 -- 172.21.15.62:0/519209783 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665693 (secure 0 0 0) 0x7f82540505b0 con 0x7f82340385c0 2024-04-23T18:32:28.969 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:32:28.975 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-04-23T18:32:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.975+0000 7f8258c87640 1 -- 172.21.15.62:0/519209783 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f82340385c0 msgr2=0x7f823403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.975+0000 7f8258c87640 1 --2- 172.21.15.62:0/519209783 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f82340385c0 0x7f823403aa80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f823c007fd0 tx=0x7f823c007ac0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.975+0000 7f8258c87640 1 -- 172.21.15.62:0/519209783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f825412b4f0 msgr2=0x7f825408b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.975+0000 7f8258c87640 1 --2- 172.21.15.62:0/519209783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f825412b4f0 0x7f825408b910 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f824c009840 tx=0x7f824c0046c0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.975+0000 7f8258c87640 1 -- 172.21.15.62:0/519209783 shutdown_connections 2024-04-23T18:32:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.975+0000 7f8258c87640 1 --2- 172.21.15.62:0/519209783 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f82340385c0 0x7f823403aa80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.975+0000 7f8258c87640 1 --2- 172.21.15.62:0/519209783 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f825412b4f0 0x7f825408b910 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.975+0000 7f8258c87640 1 -- 172.21.15.62:0/519209783 >> 172.21.15.62:0/519209783 conn(0x7f82540a1000 msgr2=0x7f825406cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:28.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.975+0000 7f8258c87640 1 -- 172.21.15.62:0/519209783 shutdown_connections 2024-04-23T18:32:28.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:28.975+0000 7f8258c87640 1 -- 172.21.15.62:0/519209783 wait complete. 2024-04-23T18:32:28.979 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-04-23T18:32:28.742935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412790,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4876,"num_read_kb":4453,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186228,"kb_used_data":40724,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377301132,"statfs":{"total":386547056640,"available":386356359168,"internally_reserved":0,"allocated":41701376,"data_stored":40499432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003980"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.392235+0000","last_change":"2024-04-23T18:29:11.496715+0000","last_active":"2024-04-23T18:31:20.392235+0000","last_peered":"2024-04-23T18:31:20.392235+0000","last_clean":"2024-04-23T18:31:20.392235+0000","last_became_active":"2024-04-23T18:29:11.495610+0000","last_became_peered":"2024-04-23T18:29:11.495610+0000","last_unstale":"2024-04-23T18:31:20.392235+0000","last_undegraded":"2024-04-23T18:31:20.392235+0000","last_fullsized":"2024-04-23T18:31:20.392235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:39:13.562652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216466+0000","last_change":"2024-04-23T18:29:13.493644+0000","last_active":"2024-04-23T18:32:21.216466+0000","last_peered":"2024-04-23T18:32:21.216466+0000","last_clean":"2024-04-23T18:32:21.216466+0000","last_became_active":"2024-04-23T18:29:13.492771+0000","last_became_peered":"2024-04-23T18:29:13.492771+0000","last_unstale":"2024-04-23T18:32:21.216466+0000","last_undegraded":"2024-04-23T18:32:21.216466+0000","last_fullsized":"2024-04-23T18:32:21.216466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:18.652802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549100+0000","last_change":"2024-04-23T18:29:11.495726+0000","last_active":"2024-04-23T18:29:52.549100+0000","last_peered":"2024-04-23T18:29:52.549100+0000","last_clean":"2024-04-23T18:29:52.549100+0000","last_became_active":"2024-04-23T18:29:11.495272+0000","last_became_peered":"2024-04-23T18:29:11.495272+0000","last_unstale":"2024-04-23T18:29:52.549100+0000","last_undegraded":"2024-04-23T18:29:52.549100+0000","last_fullsized":"2024-04-23T18:29:52.549100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:11:21.963212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.145581+0000","last_change":"2024-04-23T18:29:13.495212+0000","last_active":"2024-04-23T18:32:21.145581+0000","last_peered":"2024-04-23T18:32:21.145581+0000","last_clean":"2024-04-23T18:32:21.145581+0000","last_became_active":"2024-04-23T18:29:13.494969+0000","last_became_peered":"2024-04-23T18:29:13.494969+0000","last_unstale":"2024-04-23T18:32:21.145581+0000","last_undegraded":"2024-04-23T18:32:21.145581+0000","last_fullsized":"2024-04-23T18:32:21.145581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:31.120065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.883853+0000","last_change":"2024-04-23T18:29:11.505594+0000","last_active":"2024-04-23T18:32:20.883853+0000","last_peered":"2024-04-23T18:32:20.883853+0000","last_clean":"2024-04-23T18:32:20.883853+0000","last_became_active":"2024-04-23T18:29:11.505283+0000","last_became_peered":"2024-04-23T18:29:11.505283+0000","last_unstale":"2024-04-23T18:32:20.883853+0000","last_undegraded":"2024-04-23T18:32:20.883853+0000","last_fullsized":"2024-04-23T18:32:20.883853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:22.032624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549437+0000","last_change":"2024-04-23T18:29:13.495612+0000","last_active":"2024-04-23T18:29:52.549437+0000","last_peered":"2024-04-23T18:29:52.549437+0000","last_clean":"2024-04-23T18:29:52.549437+0000","last_became_active":"2024-04-23T18:29:13.495367+0000","last_became_peered":"2024-04-23T18:29:13.495367+0000","last_unstale":"2024-04-23T18:29:52.549437+0000","last_undegraded":"2024-04-23T18:29:52.549437+0000","last_fullsized":"2024-04-23T18:29:52.549437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:46.592957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542142+0000","last_change":"2024-04-23T18:29:11.496818+0000","last_active":"2024-04-23T18:29:52.542142+0000","last_peered":"2024-04-23T18:29:52.542142+0000","last_clean":"2024-04-23T18:29:52.542142+0000","last_became_active":"2024-04-23T18:29:11.495677+0000","last_became_peered":"2024-04-23T18:29:11.495677+0000","last_unstale":"2024-04-23T18:29:52.542142+0000","last_undegraded":"2024-04-23T18:29:52.542142+0000","last_fullsized":"2024-04-23T18:29:52.542142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:36.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223517+0000","last_change":"2024-04-23T18:29:52.558192+0000","last_active":"2024-04-23T18:32:21.223517+0000","last_peered":"2024-04-23T18:32:21.223517+0000","last_clean":"2024-04-23T18:32:21.223517+0000","last_became_active":"2024-04-23T18:29:52.548291+0000","last_became_peered":"2024-04-23T18:29:52.548291+0000","last_unstale":"2024-04-23T18:32:21.223517+0000","last_undegraded":"2024-04-23T18:32:21.223517+0000","last_fullsized":"2024-04-23T18:32:21.223517+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:21.650682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548661+0000","last_change":"2024-04-23T18:29:11.504896+0000","last_active":"2024-04-23T18:29:52.548661+0000","last_peered":"2024-04-23T18:29:52.548661+0000","last_clean":"2024-04-23T18:29:52.548661+0000","last_became_active":"2024-04-23T18:29:11.504554+0000","last_became_peered":"2024-04-23T18:29:11.504554+0000","last_unstale":"2024-04-23T18:29:52.548661+0000","last_undegraded":"2024-04-23T18:29:52.548661+0000","last_fullsized":"2024-04-23T18:29:52.548661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:17.981912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'5","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223019+0000","last_change":"2024-04-23T18:29:13.498634+0000","last_active":"2024-04-23T18:32:21.223019+0000","last_peered":"2024-04-23T18:32:21.223019+0000","last_clean":"2024-04-23T18:32:21.223019+0000","last_became_active":"2024-04-23T18:29:13.498378+0000","last_became_peered":"2024-04-23T18:29:13.498378+0000","last_unstale":"2024-04-23T18:32:21.223019+0000","last_undegraded":"2024-04-23T18:32:21.223019+0000","last_fullsized":"2024-04-23T18:32:21.223019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:53:35.946871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541220+0000","last_change":"2024-04-23T18:29:11.497271+0000","last_active":"2024-04-23T18:29:52.541220+0000","last_peered":"2024-04-23T18:29:52.541220+0000","last_clean":"2024-04-23T18:29:52.541220+0000","last_became_active":"2024-04-23T18:29:11.496923+0000","last_became_peered":"2024-04-23T18:29:11.496923+0000","last_unstale":"2024-04-23T18:29:52.541220+0000","last_undegraded":"2024-04-23T18:29:52.541220+0000","last_fullsized":"2024-04-23T18:29:52.541220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:28.851647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.758897+0000","last_change":"2024-04-23T18:29:13.503166+0000","last_active":"2024-04-23T18:29:53.758897+0000","last_peered":"2024-04-23T18:29:53.758897+0000","last_clean":"2024-04-23T18:29:53.758897+0000","last_became_active":"2024-04-23T18:29:13.502401+0000","last_became_peered":"2024-04-23T18:29:13.502401+0000","last_unstale":"2024-04-23T18:29:53.758897+0000","last_undegraded":"2024-04-23T18:29:53.758897+0000","last_fullsized":"2024-04-23T18:29:53.758897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:29:37.305411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.126025+0000","last_change":"2024-04-23T18:29:11.500102+0000","last_active":"2024-04-23T18:32:21.126025+0000","last_peered":"2024-04-23T18:32:21.126025+0000","last_clean":"2024-04-23T18:32:21.126025+0000","last_became_active":"2024-04-23T18:29:11.499772+0000","last_became_peered":"2024-04-23T18:29:11.499772+0000","last_unstale":"2024-04-23T18:32:21.126025+0000","last_undegraded":"2024-04-23T18:32:21.126025+0000","last_fullsized":"2024-04-23T18:32:21.126025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:33:31.780314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998531+0000","last_change":"2024-04-23T18:29:13.499669+0000","last_active":"2024-04-23T18:32:20.998531+0000","last_peered":"2024-04-23T18:32:20.998531+0000","last_clean":"2024-04-23T18:32:20.998531+0000","last_became_active":"2024-04-23T18:29:13.498965+0000","last_became_peered":"2024-04-23T18:29:13.498965+0000","last_unstale":"2024-04-23T18:32:20.998531+0000","last_undegraded":"2024-04-23T18:32:20.998531+0000","last_fullsized":"2024-04-23T18:32:20.998531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:55.148135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.524275+0000","last_change":"2024-04-23T18:29:11.493089+0000","last_active":"2024-04-23T18:31:20.524275+0000","last_peered":"2024-04-23T18:31:20.524275+0000","last_clean":"2024-04-23T18:31:20.524275+0000","last_became_active":"2024-04-23T18:29:11.491840+0000","last_became_peered":"2024-04-23T18:29:11.491840+0000","last_unstale":"2024-04-23T18:31:20.524275+0000","last_undegraded":"2024-04-23T18:31:20.524275+0000","last_fullsized":"2024-04-23T18:31:20.524275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:35.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136278+0000","last_change":"2024-04-23T18:29:13.505657+0000","last_active":"2024-04-23T18:32:21.136278+0000","last_peered":"2024-04-23T18:32:21.136278+0000","last_clean":"2024-04-23T18:32:21.136278+0000","last_became_active":"2024-04-23T18:29:13.505348+0000","last_became_peered":"2024-04-23T18:29:13.505348+0000","last_unstale":"2024-04-23T18:32:21.136278+0000","last_undegraded":"2024-04-23T18:32:21.136278+0000","last_fullsized":"2024-04-23T18:32:21.136278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:01.869007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.809404+0000","last_change":"2024-04-23T18:29:13.495619+0000","last_active":"2024-04-23T18:29:54.809404+0000","last_peered":"2024-04-23T18:29:54.809404+0000","last_clean":"2024-04-23T18:29:54.809404+0000","last_became_active":"2024-04-23T18:29:13.495337+0000","last_became_peered":"2024-04-23T18:29:13.495337+0000","last_unstale":"2024-04-23T18:29:54.809404+0000","last_undegraded":"2024-04-23T18:29:54.809404+0000","last_fullsized":"2024-04-23T18:29:54.809404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:01.568090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.207467+0000","last_change":"2024-04-23T18:29:11.502496+0000","last_active":"2024-04-23T18:29:53.207467+0000","last_peered":"2024-04-23T18:29:53.207467+0000","last_clean":"2024-04-23T18:29:53.207467+0000","last_became_active":"2024-04-23T18:29:11.501773+0000","last_became_peered":"2024-04-23T18:29:11.501773+0000","last_unstale":"2024-04-23T18:29:53.207467+0000","last_undegraded":"2024-04-23T18:29:53.207467+0000","last_fullsized":"2024-04-23T18:29:53.207467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:34.195698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.094606+0000","last_change":"2024-04-23T18:29:13.493129+0000","last_active":"2024-04-23T18:29:54.094606+0000","last_peered":"2024-04-23T18:29:54.094606+0000","last_clean":"2024-04-23T18:29:54.094606+0000","last_became_active":"2024-04-23T18:29:13.492366+0000","last_became_peered":"2024-04-23T18:29:13.492366+0000","last_unstale":"2024-04-23T18:29:54.094606+0000","last_undegraded":"2024-04-23T18:29:54.094606+0000","last_fullsized":"2024-04-23T18:29:54.094606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:55.148135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.500819+0000","last_change":"2024-04-23T18:29:11.486168+0000","last_active":"2024-04-23T18:31:20.500819+0000","last_peered":"2024-04-23T18:31:20.500819+0000","last_clean":"2024-04-23T18:31:20.500819+0000","last_became_active":"2024-04-23T18:29:11.484620+0000","last_became_peered":"2024-04-23T18:29:11.484620+0000","last_unstale":"2024-04-23T18:31:20.500819+0000","last_undegraded":"2024-04-23T18:31:20.500819+0000","last_fullsized":"2024-04-23T18:31:20.500819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:49.661961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'16","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216433+0000","last_change":"2024-04-23T18:29:13.496876+0000","last_active":"2024-04-23T18:32:21.216433+0000","last_peered":"2024-04-23T18:32:21.216433+0000","last_clean":"2024-04-23T18:32:21.216433+0000","last_became_active":"2024-04-23T18:29:13.495743+0000","last_became_peered":"2024-04-23T18:29:13.495743+0000","last_unstale":"2024-04-23T18:32:21.216433+0000","last_undegraded":"2024-04-23T18:32:21.216433+0000","last_fullsized":"2024-04-23T18:32:21.216433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:43.595018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547080+0000","last_change":"2024-04-23T18:29:11.494610+0000","last_active":"2024-04-23T18:29:52.547080+0000","last_peered":"2024-04-23T18:29:52.547080+0000","last_clean":"2024-04-23T18:29:52.547080+0000","last_became_active":"2024-04-23T18:29:11.493363+0000","last_became_peered":"2024-04-23T18:29:11.493363+0000","last_unstale":"2024-04-23T18:29:52.547080+0000","last_undegraded":"2024-04-23T18:29:52.547080+0000","last_fullsized":"2024-04-23T18:29:52.547080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:08:38.534696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759623+0000","last_change":"2024-04-23T18:29:13.502315+0000","last_active":"2024-04-23T18:31:39.759623+0000","last_peered":"2024-04-23T18:31:39.759623+0000","last_clean":"2024-04-23T18:31:39.759623+0000","last_became_active":"2024-04-23T18:29:13.501988+0000","last_became_peered":"2024-04-23T18:29:13.501988+0000","last_unstale":"2024-04-23T18:31:39.759623+0000","last_undegraded":"2024-04-23T18:31:39.759623+0000","last_fullsized":"2024-04-23T18:31:39.759623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:13:37.517178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546632+0000","last_change":"2024-04-23T18:29:11.503048+0000","last_active":"2024-04-23T18:29:52.546632+0000","last_peered":"2024-04-23T18:29:52.546632+0000","last_clean":"2024-04-23T18:29:52.546632+0000","last_became_active":"2024-04-23T18:29:11.502714+0000","last_became_peered":"2024-04-23T18:29:11.502714+0000","last_unstale":"2024-04-23T18:29:52.546632+0000","last_undegraded":"2024-04-23T18:29:52.546632+0000","last_fullsized":"2024-04-23T18:29:52.546632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:03.508942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216074+0000","last_change":"2024-04-23T18:29:13.499010+0000","last_active":"2024-04-23T18:32:21.216074+0000","last_peered":"2024-04-23T18:32:21.216074+0000","last_clean":"2024-04-23T18:32:21.216074+0000","last_became_active":"2024-04-23T18:29:13.498488+0000","last_became_peered":"2024-04-23T18:29:13.498488+0000","last_unstale":"2024-04-23T18:32:21.216074+0000","last_undegraded":"2024-04-23T18:32:21.216074+0000","last_fullsized":"2024-04-23T18:32:21.216074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:43.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548048+0000","last_change":"2024-04-23T18:29:11.495476+0000","last_active":"2024-04-23T18:29:52.548048+0000","last_peered":"2024-04-23T18:29:52.548048+0000","last_clean":"2024-04-23T18:29:52.548048+0000","last_became_active":"2024-04-23T18:29:11.495025+0000","last_became_peered":"2024-04-23T18:29:11.495025+0000","last_unstale":"2024-04-23T18:29:52.548048+0000","last_undegraded":"2024-04-23T18:29:52.548048+0000","last_fullsized":"2024-04-23T18:29:52.548048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:20.311305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.546632+0000","last_change":"2024-04-23T18:29:13.494330+0000","last_active":"2024-04-23T18:31:20.546632+0000","last_peered":"2024-04-23T18:31:20.546632+0000","last_clean":"2024-04-23T18:31:20.546632+0000","last_became_active":"2024-04-23T18:29:13.494080+0000","last_became_peered":"2024-04-23T18:29:13.494080+0000","last_unstale":"2024-04-23T18:31:20.546632+0000","last_undegraded":"2024-04-23T18:31:20.546632+0000","last_fullsized":"2024-04-23T18:31:20.546632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:19.116233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548882+0000","last_change":"2024-04-23T18:29:11.507699+0000","last_active":"2024-04-23T18:29:52.548882+0000","last_peered":"2024-04-23T18:29:52.548882+0000","last_clean":"2024-04-23T18:29:52.548882+0000","last_became_active":"2024-04-23T18:29:11.507336+0000","last_became_peered":"2024-04-23T18:29:11.507336+0000","last_unstale":"2024-04-23T18:29:52.548882+0000","last_undegraded":"2024-04-23T18:29:52.548882+0000","last_fullsized":"2024-04-23T18:29:52.548882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:33.718239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.160581+0000","last_change":"2024-04-23T18:29:21.530202+0000","last_active":"2024-04-23T18:32:21.160581+0000","last_peered":"2024-04-23T18:32:21.160581+0000","last_clean":"2024-04-23T18:32:21.160581+0000","last_became_active":"2024-04-23T18:29:21.529771+0000","last_became_peered":"2024-04-23T18:29:21.529771+0000","last_unstale":"2024-04-23T18:32:21.160581+0000","last_undegraded":"2024-04-23T18:32:21.160581+0000","last_fullsized":"2024-04-23T18:32:21.160581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:45.343308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'22","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216053+0000","last_change":"2024-04-23T18:29:52.561113+0000","last_active":"2024-04-23T18:32:21.216053+0000","last_peered":"2024-04-23T18:32:21.216053+0000","last_clean":"2024-04-23T18:32:21.216053+0000","last_became_active":"2024-04-23T18:29:52.549641+0000","last_became_peered":"2024-04-23T18:29:52.549641+0000","last_unstale":"2024-04-23T18:32:21.216053+0000","last_undegraded":"2024-04-23T18:32:21.216053+0000","last_fullsized":"2024-04-23T18:32:21.216053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:47:49.212714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":69,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761819+0000","last_change":"2024-04-23T18:29:11.512384+0000","last_active":"2024-04-23T18:31:31.761819+0000","last_peered":"2024-04-23T18:31:31.761819+0000","last_clean":"2024-04-23T18:31:31.761819+0000","last_became_active":"2024-04-23T18:29:11.512062+0000","last_became_peered":"2024-04-23T18:29:11.512062+0000","last_unstale":"2024-04-23T18:31:31.761819+0000","last_undegraded":"2024-04-23T18:31:31.761819+0000","last_fullsized":"2024-04-23T18:31:31.761819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:39.110614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552423+0000","last_change":"2024-04-23T18:29:15.508358+0000","last_active":"2024-04-23T18:29:52.552423+0000","last_peered":"2024-04-23T18:29:52.552423+0000","last_clean":"2024-04-23T18:29:52.552423+0000","last_became_active":"2024-04-23T18:29:15.508100+0000","last_became_peered":"2024-04-23T18:29:15.508100+0000","last_unstale":"2024-04-23T18:29:52.552423+0000","last_undegraded":"2024-04-23T18:29:52.552423+0000","last_fullsized":"2024-04-23T18:29:52.552423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:20.697054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.037486+0000","last_change":"2024-04-23T18:29:17.513687+0000","last_active":"2024-04-23T18:31:19.037486+0000","last_peered":"2024-04-23T18:31:19.037486+0000","last_clean":"2024-04-23T18:31:19.037486+0000","last_became_active":"2024-04-23T18:29:17.513368+0000","last_became_peered":"2024-04-23T18:29:17.513368+0000","last_unstale":"2024-04-23T18:31:19.037486+0000","last_undegraded":"2024-04-23T18:31:19.037486+0000","last_fullsized":"2024-04-23T18:31:19.037486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:24.244501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548046+0000","last_change":"2024-04-23T18:29:19.520367+0000","last_active":"2024-04-23T18:29:52.548046+0000","last_peered":"2024-04-23T18:29:52.548046+0000","last_clean":"2024-04-23T18:29:52.548046+0000","last_became_active":"2024-04-23T18:29:19.520066+0000","last_became_peered":"2024-04-23T18:29:19.520066+0000","last_unstale":"2024-04-23T18:29:52.548046+0000","last_undegraded":"2024-04-23T18:29:52.548046+0000","last_fullsized":"2024-04-23T18:29:52.548046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:25.717857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.543713+0000","last_change":"2024-04-23T18:29:21.530037+0000","last_active":"2024-04-23T18:31:20.543713+0000","last_peered":"2024-04-23T18:31:20.543713+0000","last_clean":"2024-04-23T18:31:20.543713+0000","last_became_active":"2024-04-23T18:29:21.529743+0000","last_became_peered":"2024-04-23T18:29:21.529743+0000","last_unstale":"2024-04-23T18:31:20.543713+0000","last_undegraded":"2024-04-23T18:31:20.543713+0000","last_fullsized":"2024-04-23T18:31:20.543713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:07.650347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'9","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.005291+0000","last_change":"2024-04-23T18:29:13.496552+0000","last_active":"2024-04-23T18:32:21.005291+0000","last_peered":"2024-04-23T18:32:21.005291+0000","last_clean":"2024-04-23T18:32:21.005291+0000","last_became_active":"2024-04-23T18:29:13.496299+0000","last_became_peered":"2024-04-23T18:29:13.496299+0000","last_unstale":"2024-04-23T18:32:21.005291+0000","last_undegraded":"2024-04-23T18:32:21.005291+0000","last_fullsized":"2024-04-23T18:32:21.005291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:46.067635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.207501+0000","last_change":"2024-04-23T18:29:11.497209+0000","last_active":"2024-04-23T18:29:53.207501+0000","last_peered":"2024-04-23T18:29:53.207501+0000","last_clean":"2024-04-23T18:29:53.207501+0000","last_became_active":"2024-04-23T18:29:11.496878+0000","last_became_peered":"2024-04-23T18:29:11.496878+0000","last_unstale":"2024-04-23T18:29:53.207501+0000","last_undegraded":"2024-04-23T18:29:53.207501+0000","last_fullsized":"2024-04-23T18:29:53.207501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:03.508942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547455+0000","last_change":"2024-04-23T18:29:15.504985+0000","last_active":"2024-04-23T18:29:52.547455+0000","last_peered":"2024-04-23T18:29:52.547455+0000","last_clean":"2024-04-23T18:29:52.547455+0000","last_became_active":"2024-04-23T18:29:15.504744+0000","last_became_peered":"2024-04-23T18:29:15.504744+0000","last_unstale":"2024-04-23T18:29:52.547455+0000","last_undegraded":"2024-04-23T18:29:52.547455+0000","last_fullsized":"2024-04-23T18:29:52.547455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:03.110961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548072+0000","last_change":"2024-04-23T18:29:17.510462+0000","last_active":"2024-04-23T18:29:52.548072+0000","last_peered":"2024-04-23T18:29:52.548072+0000","last_clean":"2024-04-23T18:29:52.548072+0000","last_became_active":"2024-04-23T18:29:17.510201+0000","last_became_peered":"2024-04-23T18:29:17.510201+0000","last_unstale":"2024-04-23T18:29:52.548072+0000","last_undegraded":"2024-04-23T18:29:52.548072+0000","last_fullsized":"2024-04-23T18:29:52.548072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:45:44.947602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546953+0000","last_change":"2024-04-23T18:29:19.528113+0000","last_active":"2024-04-23T18:29:52.546953+0000","last_peered":"2024-04-23T18:29:52.546953+0000","last_clean":"2024-04-23T18:29:52.546953+0000","last_became_active":"2024-04-23T18:29:19.527770+0000","last_became_peered":"2024-04-23T18:29:19.527770+0000","last_unstale":"2024-04-23T18:29:52.546953+0000","last_undegraded":"2024-04-23T18:29:52.546953+0000","last_fullsized":"2024-04-23T18:29:52.546953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:24.718294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546581+0000","last_change":"2024-04-23T18:29:21.526235+0000","last_active":"2024-04-23T18:29:52.546581+0000","last_peered":"2024-04-23T18:29:52.546581+0000","last_clean":"2024-04-23T18:29:52.546581+0000","last_became_active":"2024-04-23T18:29:21.525940+0000","last_became_peered":"2024-04-23T18:29:21.525940+0000","last_unstale":"2024-04-23T18:29:52.546581+0000","last_undegraded":"2024-04-23T18:29:52.546581+0000","last_fullsized":"2024-04-23T18:29:52.546581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:38.457462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216175+0000","last_change":"2024-04-23T18:29:13.496417+0000","last_active":"2024-04-23T18:32:21.216175+0000","last_peered":"2024-04-23T18:32:21.216175+0000","last_clean":"2024-04-23T18:32:21.216175+0000","last_became_active":"2024-04-23T18:29:13.496142+0000","last_became_peered":"2024-04-23T18:29:13.496142+0000","last_unstale":"2024-04-23T18:32:21.216175+0000","last_undegraded":"2024-04-23T18:32:21.216175+0000","last_fullsized":"2024-04-23T18:32:21.216175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:36:50.428324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549926+0000","last_change":"2024-04-23T18:29:11.504850+0000","last_active":"2024-04-23T18:29:52.549926+0000","last_peered":"2024-04-23T18:29:52.549926+0000","last_clean":"2024-04-23T18:29:52.549926+0000","last_became_active":"2024-04-23T18:29:11.504534+0000","last_became_peered":"2024-04-23T18:29:11.504534+0000","last_unstale":"2024-04-23T18:29:52.549926+0000","last_undegraded":"2024-04-23T18:29:52.549926+0000","last_fullsized":"2024-04-23T18:29:52.549926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:52.910514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549373+0000","last_change":"2024-04-23T18:29:15.510428+0000","last_active":"2024-04-23T18:29:52.549373+0000","last_peered":"2024-04-23T18:29:52.549373+0000","last_clean":"2024-04-23T18:29:52.549373+0000","last_became_active":"2024-04-23T18:29:15.510018+0000","last_became_peered":"2024-04-23T18:29:15.510018+0000","last_unstale":"2024-04-23T18:29:52.549373+0000","last_undegraded":"2024-04-23T18:29:52.549373+0000","last_fullsized":"2024-04-23T18:29:52.549373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:31.579537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.323469+0000","last_change":"2024-04-23T18:29:17.518086+0000","last_active":"2024-04-23T18:29:54.323469+0000","last_peered":"2024-04-23T18:29:54.323469+0000","last_clean":"2024-04-23T18:29:54.323469+0000","last_became_active":"2024-04-23T18:29:17.517679+0000","last_became_peered":"2024-04-23T18:29:17.517679+0000","last_unstale":"2024-04-23T18:29:54.323469+0000","last_undegraded":"2024-04-23T18:29:54.323469+0000","last_fullsized":"2024-04-23T18:29:54.323469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:02:29.059730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585443+0000","last_change":"2024-04-23T18:29:19.522798+0000","last_active":"2024-04-23T18:32:20.585443+0000","last_peered":"2024-04-23T18:32:20.585443+0000","last_clean":"2024-04-23T18:32:20.585443+0000","last_became_active":"2024-04-23T18:29:19.522434+0000","last_became_peered":"2024-04-23T18:29:19.522434+0000","last_unstale":"2024-04-23T18:32:20.585443+0000","last_undegraded":"2024-04-23T18:32:20.585443+0000","last_fullsized":"2024-04-23T18:32:20.585443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:32.658811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541070+0000","last_change":"2024-04-23T18:29:21.529767+0000","last_active":"2024-04-23T18:29:52.541070+0000","last_peered":"2024-04-23T18:29:52.541070+0000","last_clean":"2024-04-23T18:29:52.541070+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:29:52.541070+0000","last_undegraded":"2024-04-23T18:29:52.541070+0000","last_fullsized":"2024-04-23T18:29:52.541070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:48.933035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278231+0000","last_change":"2024-04-23T18:29:13.499630+0000","last_active":"2024-04-23T18:31:17.278231+0000","last_peered":"2024-04-23T18:31:17.278231+0000","last_clean":"2024-04-23T18:31:17.278231+0000","last_became_active":"2024-04-23T18:29:13.499248+0000","last_became_peered":"2024-04-23T18:29:13.499248+0000","last_unstale":"2024-04-23T18:31:17.278231+0000","last_undegraded":"2024-04-23T18:31:17.278231+0000","last_fullsized":"2024-04-23T18:31:17.278231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:55:09.572902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542903+0000","last_change":"2024-04-23T18:29:11.488862+0000","last_active":"2024-04-23T18:29:52.542903+0000","last_peered":"2024-04-23T18:29:52.542903+0000","last_clean":"2024-04-23T18:29:52.542903+0000","last_became_active":"2024-04-23T18:29:11.488531+0000","last_became_peered":"2024-04-23T18:29:11.488531+0000","last_unstale":"2024-04-23T18:29:52.542903+0000","last_undegraded":"2024-04-23T18:29:52.542903+0000","last_fullsized":"2024-04-23T18:29:52.542903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:28.851647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552314+0000","last_change":"2024-04-23T18:29:15.511603+0000","last_active":"2024-04-23T18:29:52.552314+0000","last_peered":"2024-04-23T18:29:52.552314+0000","last_clean":"2024-04-23T18:29:52.552314+0000","last_became_active":"2024-04-23T18:29:15.511249+0000","last_became_peered":"2024-04-23T18:29:15.511249+0000","last_unstale":"2024-04-23T18:29:52.552314+0000","last_undegraded":"2024-04-23T18:29:52.552314+0000","last_fullsized":"2024-04-23T18:29:52.552314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:43:24.269505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.032342+0000","last_change":"2024-04-23T18:29:17.518244+0000","last_active":"2024-04-23T18:31:19.032342+0000","last_peered":"2024-04-23T18:31:19.032342+0000","last_clean":"2024-04-23T18:31:19.032342+0000","last_became_active":"2024-04-23T18:29:17.517964+0000","last_became_peered":"2024-04-23T18:29:17.517964+0000","last_unstale":"2024-04-23T18:31:19.032342+0000","last_undegraded":"2024-04-23T18:31:19.032342+0000","last_fullsized":"2024-04-23T18:31:19.032342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:49.766603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":441,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.219733+0000","last_change":"2024-04-23T18:29:19.525252+0000","last_active":"2024-04-23T18:32:21.219733+0000","last_peered":"2024-04-23T18:32:21.219733+0000","last_clean":"2024-04-23T18:32:21.219733+0000","last_became_active":"2024-04-23T18:29:19.524881+0000","last_became_peered":"2024-04-23T18:29:19.524881+0000","last_unstale":"2024-04-23T18:32:21.219733+0000","last_undegraded":"2024-04-23T18:32:21.219733+0000","last_fullsized":"2024-04-23T18:32:21.219733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:32.759949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185271+0000","last_change":"2024-04-23T18:29:13.502374+0000","last_active":"2024-04-23T18:32:21.185271+0000","last_peered":"2024-04-23T18:32:21.185271+0000","last_clean":"2024-04-23T18:32:21.185271+0000","last_became_active":"2024-04-23T18:29:13.501472+0000","last_became_peered":"2024-04-23T18:29:13.501472+0000","last_unstale":"2024-04-23T18:32:21.185271+0000","last_undegraded":"2024-04-23T18:32:21.185271+0000","last_fullsized":"2024-04-23T18:32:21.185271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:48.669984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'5","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.605427+0000","last_change":"2024-04-23T18:29:11.483640+0000","last_active":"2024-04-23T18:30:36.605427+0000","last_peered":"2024-04-23T18:30:36.605427+0000","last_clean":"2024-04-23T18:30:36.605427+0000","last_became_active":"2024-04-23T18:29:11.481977+0000","last_became_peered":"2024-04-23T18:29:11.481977+0000","last_unstale":"2024-04-23T18:30:36.605427+0000","last_undegraded":"2024-04-23T18:30:36.605427+0000","last_fullsized":"2024-04-23T18:30:36.605427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:55.553919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543298+0000","last_change":"2024-04-23T18:29:15.510021+0000","last_active":"2024-04-23T18:29:52.543298+0000","last_peered":"2024-04-23T18:29:52.543298+0000","last_clean":"2024-04-23T18:29:52.543298+0000","last_became_active":"2024-04-23T18:29:15.509711+0000","last_became_peered":"2024-04-23T18:29:15.509711+0000","last_unstale":"2024-04-23T18:29:52.543298+0000","last_undegraded":"2024-04-23T18:29:52.543298+0000","last_fullsized":"2024-04-23T18:29:52.543298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:31.895433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'40","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.041931+0000","last_change":"2024-04-23T18:29:17.511358+0000","last_active":"2024-04-23T18:31:19.041931+0000","last_peered":"2024-04-23T18:31:19.041931+0000","last_clean":"2024-04-23T18:31:19.041931+0000","last_became_active":"2024-04-23T18:29:17.511085+0000","last_became_peered":"2024-04-23T18:29:17.511085+0000","last_unstale":"2024-04-23T18:31:19.041931+0000","last_undegraded":"2024-04-23T18:31:19.041931+0000","last_fullsized":"2024-04-23T18:31:19.041931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:33.909507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547808+0000","last_change":"2024-04-23T18:29:19.527807+0000","last_active":"2024-04-23T18:29:52.547808+0000","last_peered":"2024-04-23T18:29:52.547808+0000","last_clean":"2024-04-23T18:29:52.547808+0000","last_became_active":"2024-04-23T18:29:19.527505+0000","last_became_peered":"2024-04-23T18:29:19.527505+0000","last_unstale":"2024-04-23T18:29:52.547808+0000","last_undegraded":"2024-04-23T18:29:52.547808+0000","last_fullsized":"2024-04-23T18:29:52.547808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:22:25.429131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'13","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.636252+0000","last_change":"2024-04-23T18:29:21.532533+0000","last_active":"2024-04-23T18:32:20.636252+0000","last_peered":"2024-04-23T18:32:20.636252+0000","last_clean":"2024-04-23T18:32:20.636252+0000","last_became_active":"2024-04-23T18:29:21.532163+0000","last_became_peered":"2024-04-23T18:29:21.532163+0000","last_unstale":"2024-04-23T18:32:20.636252+0000","last_undegraded":"2024-04-23T18:32:20.636252+0000","last_fullsized":"2024-04-23T18:32:20.636252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:35.252958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.795754+0000","last_change":"2024-04-23T18:29:13.494415+0000","last_active":"2024-04-23T18:30:36.795754+0000","last_peered":"2024-04-23T18:30:36.795754+0000","last_clean":"2024-04-23T18:30:36.795754+0000","last_became_active":"2024-04-23T18:29:13.494108+0000","last_became_peered":"2024-04-23T18:29:13.494108+0000","last_unstale":"2024-04-23T18:30:36.795754+0000","last_undegraded":"2024-04-23T18:30:36.795754+0000","last_fullsized":"2024-04-23T18:30:36.795754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:48.393428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543652+0000","last_change":"2024-04-23T18:29:11.481951+0000","last_active":"2024-04-23T18:29:52.543652+0000","last_peered":"2024-04-23T18:29:52.543652+0000","last_clean":"2024-04-23T18:29:52.543652+0000","last_became_active":"2024-04-23T18:29:11.481419+0000","last_became_peered":"2024-04-23T18:29:11.481419+0000","last_unstale":"2024-04-23T18:29:52.543652+0000","last_undegraded":"2024-04-23T18:29:52.543652+0000","last_fullsized":"2024-04-23T18:29:52.543652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:30.568409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546778+0000","last_change":"2024-04-23T18:29:15.510512+0000","last_active":"2024-04-23T18:29:52.546778+0000","last_peered":"2024-04-23T18:29:52.546778+0000","last_clean":"2024-04-23T18:29:52.546778+0000","last_became_active":"2024-04-23T18:29:15.510135+0000","last_became_peered":"2024-04-23T18:29:15.510135+0000","last_unstale":"2024-04-23T18:29:52.546778+0000","last_undegraded":"2024-04-23T18:29:52.546778+0000","last_fullsized":"2024-04-23T18:29:52.546778+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:34:51.553982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.021828+0000","last_change":"2024-04-23T18:29:17.513711+0000","last_active":"2024-04-23T18:31:19.021828+0000","last_peered":"2024-04-23T18:31:19.021828+0000","last_clean":"2024-04-23T18:31:19.021828+0000","last_became_active":"2024-04-23T18:29:17.513447+0000","last_became_peered":"2024-04-23T18:29:17.513447+0000","last_unstale":"2024-04-23T18:31:19.021828+0000","last_undegraded":"2024-04-23T18:31:19.021828+0000","last_fullsized":"2024-04-23T18:31:19.021828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:53.226081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546745+0000","last_change":"2024-04-23T18:29:19.518994+0000","last_active":"2024-04-23T18:29:52.546745+0000","last_peered":"2024-04-23T18:29:52.546745+0000","last_clean":"2024-04-23T18:29:52.546745+0000","last_became_active":"2024-04-23T18:29:19.518695+0000","last_became_peered":"2024-04-23T18:29:19.518695+0000","last_unstale":"2024-04-23T18:29:52.546745+0000","last_undegraded":"2024-04-23T18:29:52.546745+0000","last_fullsized":"2024-04-23T18:29:52.546745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:31:26.171589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.187825+0000","last_change":"2024-04-23T18:29:21.533423+0000","last_active":"2024-04-23T18:32:21.187825+0000","last_peered":"2024-04-23T18:32:21.187825+0000","last_clean":"2024-04-23T18:32:21.187825+0000","last_became_active":"2024-04-23T18:29:21.533103+0000","last_became_peered":"2024-04-23T18:29:21.533103+0000","last_unstale":"2024-04-23T18:32:21.187825+0000","last_undegraded":"2024-04-23T18:32:21.187825+0000","last_fullsized":"2024-04-23T18:32:21.187825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:55:25.843294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'12","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216152+0000","last_change":"2024-04-23T18:29:13.500105+0000","last_active":"2024-04-23T18:32:21.216152+0000","last_peered":"2024-04-23T18:32:21.216152+0000","last_clean":"2024-04-23T18:32:21.216152+0000","last_became_active":"2024-04-23T18:29:13.499795+0000","last_became_peered":"2024-04-23T18:29:13.499795+0000","last_unstale":"2024-04-23T18:32:21.216152+0000","last_undegraded":"2024-04-23T18:32:21.216152+0000","last_fullsized":"2024-04-23T18:32:21.216152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:53:51.760582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552836+0000","last_change":"2024-04-23T18:29:11.503536+0000","last_active":"2024-04-23T18:29:52.552836+0000","last_peered":"2024-04-23T18:29:52.552836+0000","last_clean":"2024-04-23T18:29:52.552836+0000","last_became_active":"2024-04-23T18:29:11.503228+0000","last_became_peered":"2024-04-23T18:29:11.503228+0000","last_unstale":"2024-04-23T18:29:52.552836+0000","last_undegraded":"2024-04-23T18:29:52.552836+0000","last_fullsized":"2024-04-23T18:29:52.552836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:41.470810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548689+0000","last_change":"2024-04-23T18:29:15.510453+0000","last_active":"2024-04-23T18:29:52.548689+0000","last_peered":"2024-04-23T18:29:52.548689+0000","last_clean":"2024-04-23T18:29:52.548689+0000","last_became_active":"2024-04-23T18:29:15.509856+0000","last_became_peered":"2024-04-23T18:29:15.509856+0000","last_unstale":"2024-04-23T18:29:52.548689+0000","last_undegraded":"2024-04-23T18:29:52.548689+0000","last_fullsized":"2024-04-23T18:29:52.548689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:23.285461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'39","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.760976+0000","last_change":"2024-04-23T18:29:17.517429+0000","last_active":"2024-04-23T18:31:26.760976+0000","last_peered":"2024-04-23T18:31:26.760976+0000","last_clean":"2024-04-23T18:31:26.760976+0000","last_became_active":"2024-04-23T18:29:17.517116+0000","last_became_peered":"2024-04-23T18:29:17.517116+0000","last_unstale":"2024-04-23T18:31:26.760976+0000","last_undegraded":"2024-04-23T18:31:26.760976+0000","last_fullsized":"2024-04-23T18:31:26.760976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:11.788105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":348,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.336039+0000","last_change":"2024-04-23T18:29:19.518873+0000","last_active":"2024-04-23T18:32:21.336039+0000","last_peered":"2024-04-23T18:32:21.336039+0000","last_clean":"2024-04-23T18:32:21.336039+0000","last_became_active":"2024-04-23T18:29:19.518519+0000","last_became_peered":"2024-04-23T18:29:19.518519+0000","last_unstale":"2024-04-23T18:32:21.336039+0000","last_undegraded":"2024-04-23T18:32:21.336039+0000","last_fullsized":"2024-04-23T18:32:21.336039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:06:53.742445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548413+0000","last_change":"2024-04-23T18:29:21.529229+0000","last_active":"2024-04-23T18:29:52.548413+0000","last_peered":"2024-04-23T18:29:52.548413+0000","last_clean":"2024-04-23T18:29:52.548413+0000","last_became_active":"2024-04-23T18:29:21.528917+0000","last_became_peered":"2024-04-23T18:29:21.528917+0000","last_unstale":"2024-04-23T18:29:52.548413+0000","last_undegraded":"2024-04-23T18:29:52.548413+0000","last_fullsized":"2024-04-23T18:29:52.548413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:23.465133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.320304+0000","last_change":"2024-04-23T18:29:13.499442+0000","last_active":"2024-04-23T18:29:54.320304+0000","last_peered":"2024-04-23T18:29:54.320304+0000","last_clean":"2024-04-23T18:29:54.320304+0000","last_became_active":"2024-04-23T18:29:13.499216+0000","last_became_peered":"2024-04-23T18:29:13.499216+0000","last_unstale":"2024-04-23T18:29:54.320304+0000","last_undegraded":"2024-04-23T18:29:54.320304+0000","last_fullsized":"2024-04-23T18:29:54.320304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:58.980385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.550696+0000","last_change":"2024-04-23T18:29:11.511581+0000","last_active":"2024-04-23T18:29:52.550696+0000","last_peered":"2024-04-23T18:29:52.550696+0000","last_clean":"2024-04-23T18:29:52.550696+0000","last_became_active":"2024-04-23T18:29:11.511211+0000","last_became_peered":"2024-04-23T18:29:11.511211+0000","last_unstale":"2024-04-23T18:29:52.550696+0000","last_undegraded":"2024-04-23T18:29:52.550696+0000","last_fullsized":"2024-04-23T18:29:52.550696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:53.141133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547414+0000","last_change":"2024-04-23T18:29:15.510812+0000","last_active":"2024-04-23T18:29:52.547414+0000","last_peered":"2024-04-23T18:29:52.547414+0000","last_clean":"2024-04-23T18:29:52.547414+0000","last_became_active":"2024-04-23T18:29:15.510350+0000","last_became_peered":"2024-04-23T18:29:15.510350+0000","last_unstale":"2024-04-23T18:29:52.547414+0000","last_undegraded":"2024-04-23T18:29:52.547414+0000","last_fullsized":"2024-04-23T18:29:52.547414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:37.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'54","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.045638+0000","last_change":"2024-04-23T18:29:17.514012+0000","last_active":"2024-04-23T18:31:19.045638+0000","last_peered":"2024-04-23T18:31:19.045638+0000","last_clean":"2024-04-23T18:31:19.045638+0000","last_became_active":"2024-04-23T18:29:17.513298+0000","last_became_peered":"2024-04-23T18:29:17.513298+0000","last_unstale":"2024-04-23T18:31:19.045638+0000","last_undegraded":"2024-04-23T18:31:19.045638+0000","last_fullsized":"2024-04-23T18:31:19.045638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:28:12.293067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546424+0000","last_change":"2024-04-23T18:29:19.518358+0000","last_active":"2024-04-23T18:29:52.546424+0000","last_peered":"2024-04-23T18:29:52.546424+0000","last_clean":"2024-04-23T18:29:52.546424+0000","last_became_active":"2024-04-23T18:29:19.518015+0000","last_became_peered":"2024-04-23T18:29:19.518015+0000","last_unstale":"2024-04-23T18:29:52.546424+0000","last_undegraded":"2024-04-23T18:29:52.546424+0000","last_fullsized":"2024-04-23T18:29:52.546424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:30.663315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.316527+0000","last_change":"2024-04-23T18:29:21.529718+0000","last_active":"2024-04-23T18:32:21.316527+0000","last_peered":"2024-04-23T18:32:21.316527+0000","last_clean":"2024-04-23T18:32:21.316527+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:32:21.316527+0000","last_undegraded":"2024-04-23T18:32:21.316527+0000","last_fullsized":"2024-04-23T18:32:21.316527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:45.962860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.997048+0000","last_change":"2024-04-23T18:29:52.558115+0000","last_active":"2024-04-23T18:32:20.997048+0000","last_peered":"2024-04-23T18:32:20.997048+0000","last_clean":"2024-04-23T18:32:20.997048+0000","last_became_active":"2024-04-23T18:29:52.550778+0000","last_became_peered":"2024-04-23T18:29:52.550778+0000","last_unstale":"2024-04-23T18:32:20.997048+0000","last_undegraded":"2024-04-23T18:32:20.997048+0000","last_fullsized":"2024-04-23T18:32:20.997048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:43.467982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547787+0000","last_change":"2024-04-23T18:29:11.486362+0000","last_active":"2024-04-23T18:29:52.547787+0000","last_peered":"2024-04-23T18:29:52.547787+0000","last_clean":"2024-04-23T18:29:52.547787+0000","last_became_active":"2024-04-23T18:29:11.485899+0000","last_became_peered":"2024-04-23T18:29:11.485899+0000","last_unstale":"2024-04-23T18:29:52.547787+0000","last_undegraded":"2024-04-23T18:29:52.547787+0000","last_fullsized":"2024-04-23T18:29:52.547787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:10.908021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.190971+0000","last_change":"2024-04-23T18:29:15.507275+0000","last_active":"2024-04-23T18:31:20.190971+0000","last_peered":"2024-04-23T18:31:20.190971+0000","last_clean":"2024-04-23T18:31:20.190971+0000","last_became_active":"2024-04-23T18:29:15.506940+0000","last_became_peered":"2024-04-23T18:29:15.506940+0000","last_unstale":"2024-04-23T18:31:20.190971+0000","last_undegraded":"2024-04-23T18:31:20.190971+0000","last_fullsized":"2024-04-23T18:31:20.190971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:52.970455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.026166+0000","last_change":"2024-04-23T18:29:17.510208+0000","last_active":"2024-04-23T18:31:19.026166+0000","last_peered":"2024-04-23T18:31:19.026166+0000","last_clean":"2024-04-23T18:31:19.026166+0000","last_became_active":"2024-04-23T18:29:17.509586+0000","last_became_peered":"2024-04-23T18:29:17.509586+0000","last_unstale":"2024-04-23T18:31:19.026166+0000","last_undegraded":"2024-04-23T18:31:19.026166+0000","last_fullsized":"2024-04-23T18:31:19.026166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:06.298521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551606+0000","last_change":"2024-04-23T18:29:19.522554+0000","last_active":"2024-04-23T18:29:52.551606+0000","last_peered":"2024-04-23T18:29:52.551606+0000","last_clean":"2024-04-23T18:29:52.551606+0000","last_became_active":"2024-04-23T18:29:19.521939+0000","last_became_peered":"2024-04-23T18:29:19.521939+0000","last_unstale":"2024-04-23T18:29:52.551606+0000","last_undegraded":"2024-04-23T18:29:52.551606+0000","last_fullsized":"2024-04-23T18:29:52.551606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:46.071667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760279+0000","last_change":"2024-04-23T18:29:21.531398+0000","last_active":"2024-04-23T18:31:21.760279+0000","last_peered":"2024-04-23T18:31:21.760279+0000","last_clean":"2024-04-23T18:31:21.760279+0000","last_became_active":"2024-04-23T18:29:21.530270+0000","last_became_peered":"2024-04-23T18:29:21.530270+0000","last_unstale":"2024-04-23T18:31:21.760279+0000","last_undegraded":"2024-04-23T18:31:21.760279+0000","last_fullsized":"2024-04-23T18:31:21.760279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:10:11.666403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136387+0000","last_change":"2024-04-23T18:29:13.504743+0000","last_active":"2024-04-23T18:32:21.136387+0000","last_peered":"2024-04-23T18:32:21.136387+0000","last_clean":"2024-04-23T18:32:21.136387+0000","last_became_active":"2024-04-23T18:29:13.501430+0000","last_became_peered":"2024-04-23T18:29:13.501430+0000","last_unstale":"2024-04-23T18:32:21.136387+0000","last_undegraded":"2024-04-23T18:32:21.136387+0000","last_fullsized":"2024-04-23T18:32:21.136387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:05:51.964842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.456289+0000","last_change":"2024-04-23T18:29:11.507985+0000","last_active":"2024-04-23T18:31:20.456289+0000","last_peered":"2024-04-23T18:31:20.456289+0000","last_clean":"2024-04-23T18:31:20.456289+0000","last_became_active":"2024-04-23T18:29:11.507633+0000","last_became_peered":"2024-04-23T18:29:11.507633+0000","last_unstale":"2024-04-23T18:31:20.456289+0000","last_undegraded":"2024-04-23T18:31:20.456289+0000","last_fullsized":"2024-04-23T18:31:20.456289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:03:30.412489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"25'1","reported_seq":218,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.201543+0000","last_change":"2024-04-23T18:29:15.510939+0000","last_active":"2024-04-23T18:31:20.201543+0000","last_peered":"2024-04-23T18:31:20.201543+0000","last_clean":"2024-04-23T18:31:20.201543+0000","last_became_active":"2024-04-23T18:29:15.510579+0000","last_became_peered":"2024-04-23T18:29:15.510579+0000","last_unstale":"2024-04-23T18:31:20.201543+0000","last_undegraded":"2024-04-23T18:31:20.201543+0000","last_fullsized":"2024-04-23T18:31:20.201543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:29.858474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.052643+0000","last_change":"2024-04-23T18:29:17.513300+0000","last_active":"2024-04-23T18:31:19.052643+0000","last_peered":"2024-04-23T18:31:19.052643+0000","last_clean":"2024-04-23T18:31:19.052643+0000","last_became_active":"2024-04-23T18:29:17.512935+0000","last_became_peered":"2024-04-23T18:29:17.512935+0000","last_unstale":"2024-04-23T18:31:19.052643+0000","last_undegraded":"2024-04-23T18:31:19.052643+0000","last_fullsized":"2024-04-23T18:31:19.052643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:03.290679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":431,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.316969+0000","last_change":"2024-04-23T18:29:19.526537+0000","last_active":"2024-04-23T18:32:21.316969+0000","last_peered":"2024-04-23T18:32:21.316969+0000","last_clean":"2024-04-23T18:32:21.316969+0000","last_became_active":"2024-04-23T18:29:19.526260+0000","last_became_peered":"2024-04-23T18:29:19.526260+0000","last_unstale":"2024-04-23T18:32:21.316969+0000","last_undegraded":"2024-04-23T18:32:21.316969+0000","last_fullsized":"2024-04-23T18:32:21.316969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:52.097068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:29.758096+0000","last_change":"2024-04-23T18:29:21.527340+0000","last_active":"2024-04-23T18:31:29.758096+0000","last_peered":"2024-04-23T18:31:29.758096+0000","last_clean":"2024-04-23T18:31:29.758096+0000","last_became_active":"2024-04-23T18:29:21.527108+0000","last_became_peered":"2024-04-23T18:29:21.527108+0000","last_unstale":"2024-04-23T18:31:29.758096+0000","last_undegraded":"2024-04-23T18:31:29.758096+0000","last_fullsized":"2024-04-23T18:31:29.758096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:47.675158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760391+0000","last_change":"2024-04-23T18:29:13.504838+0000","last_active":"2024-04-23T18:31:31.760391+0000","last_peered":"2024-04-23T18:31:31.760391+0000","last_clean":"2024-04-23T18:31:31.760391+0000","last_became_active":"2024-04-23T18:29:13.504570+0000","last_became_peered":"2024-04-23T18:29:13.504570+0000","last_unstale":"2024-04-23T18:31:31.760391+0000","last_undegraded":"2024-04-23T18:31:31.760391+0000","last_fullsized":"2024-04-23T18:31:31.760391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:10:09.191900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.204695+0000","last_change":"2024-04-23T18:29:11.505849+0000","last_active":"2024-04-23T18:29:53.204695+0000","last_peered":"2024-04-23T18:29:53.204695+0000","last_clean":"2024-04-23T18:29:53.204695+0000","last_became_active":"2024-04-23T18:29:11.505531+0000","last_became_peered":"2024-04-23T18:29:11.505531+0000","last_unstale":"2024-04-23T18:29:53.204695+0000","last_undegraded":"2024-04-23T18:29:53.204695+0000","last_fullsized":"2024-04-23T18:29:53.204695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:10:07.184898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.201161+0000","last_change":"2024-04-23T18:29:15.506623+0000","last_active":"2024-04-23T18:31:20.201161+0000","last_peered":"2024-04-23T18:31:20.201161+0000","last_clean":"2024-04-23T18:31:20.201161+0000","last_became_active":"2024-04-23T18:29:15.505983+0000","last_became_peered":"2024-04-23T18:29:15.505983+0000","last_unstale":"2024-04-23T18:31:20.201161+0000","last_undegraded":"2024-04-23T18:31:20.201161+0000","last_fullsized":"2024-04-23T18:31:20.201161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:17.947594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551087+0000","last_change":"2024-04-23T18:29:17.513606+0000","last_active":"2024-04-23T18:29:52.551087+0000","last_peered":"2024-04-23T18:29:52.551087+0000","last_clean":"2024-04-23T18:29:52.551087+0000","last_became_active":"2024-04-23T18:29:17.513213+0000","last_became_peered":"2024-04-23T18:29:17.513213+0000","last_unstale":"2024-04-23T18:29:52.551087+0000","last_undegraded":"2024-04-23T18:29:52.551087+0000","last_fullsized":"2024-04-23T18:29:52.551087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:09:31.064767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":468,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.277024+0000","last_change":"2024-04-23T18:29:19.520435+0000","last_active":"2024-04-23T18:32:21.277024+0000","last_peered":"2024-04-23T18:32:21.277024+0000","last_clean":"2024-04-23T18:32:21.277024+0000","last_became_active":"2024-04-23T18:29:19.518528+0000","last_became_peered":"2024-04-23T18:29:19.518528+0000","last_unstale":"2024-04-23T18:32:21.277024+0000","last_undegraded":"2024-04-23T18:32:21.277024+0000","last_fullsized":"2024-04-23T18:32:21.277024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:42.794724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.335123+0000","last_change":"2024-04-23T18:29:21.531220+0000","last_active":"2024-04-23T18:31:20.335123+0000","last_peered":"2024-04-23T18:31:20.335123+0000","last_clean":"2024-04-23T18:31:20.335123+0000","last_became_active":"2024-04-23T18:29:21.530946+0000","last_became_peered":"2024-04-23T18:29:21.530946+0000","last_unstale":"2024-04-23T18:31:20.335123+0000","last_undegraded":"2024-04-23T18:31:20.335123+0000","last_fullsized":"2024-04-23T18:31:20.335123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:52:56.737823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.145303+0000","last_change":"2024-04-23T18:29:13.508059+0000","last_active":"2024-04-23T18:32:21.145303+0000","last_peered":"2024-04-23T18:32:21.145303+0000","last_clean":"2024-04-23T18:32:21.145303+0000","last_became_active":"2024-04-23T18:29:13.507813+0000","last_became_peered":"2024-04-23T18:29:13.507813+0000","last_unstale":"2024-04-23T18:32:21.145303+0000","last_undegraded":"2024-04-23T18:32:21.145303+0000","last_fullsized":"2024-04-23T18:32:21.145303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:51.116517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549983+0000","last_change":"2024-04-23T18:29:11.501752+0000","last_active":"2024-04-23T18:29:52.549983+0000","last_peered":"2024-04-23T18:29:52.549983+0000","last_clean":"2024-04-23T18:29:52.549983+0000","last_became_active":"2024-04-23T18:29:11.501432+0000","last_became_peered":"2024-04-23T18:29:11.501432+0000","last_unstale":"2024-04-23T18:29:52.549983+0000","last_undegraded":"2024-04-23T18:29:52.549983+0000","last_fullsized":"2024-04-23T18:29:52.549983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:25:19.599288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552068+0000","last_change":"2024-04-23T18:29:15.510003+0000","last_active":"2024-04-23T18:29:52.552068+0000","last_peered":"2024-04-23T18:29:52.552068+0000","last_clean":"2024-04-23T18:29:52.552068+0000","last_became_active":"2024-04-23T18:29:15.509701+0000","last_became_peered":"2024-04-23T18:29:15.509701+0000","last_unstale":"2024-04-23T18:29:52.552068+0000","last_undegraded":"2024-04-23T18:29:52.552068+0000","last_fullsized":"2024-04-23T18:29:52.552068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:40.349247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.038568+0000","last_change":"2024-04-23T18:29:17.509954+0000","last_active":"2024-04-23T18:31:19.038568+0000","last_peered":"2024-04-23T18:31:19.038568+0000","last_clean":"2024-04-23T18:31:19.038568+0000","last_became_active":"2024-04-23T18:29:17.509672+0000","last_became_peered":"2024-04-23T18:29:17.509672+0000","last_unstale":"2024-04-23T18:31:19.038568+0000","last_undegraded":"2024-04-23T18:31:19.038568+0000","last_fullsized":"2024-04-23T18:31:19.038568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:05:55.987108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543479+0000","last_change":"2024-04-23T18:29:19.527128+0000","last_active":"2024-04-23T18:29:52.543479+0000","last_peered":"2024-04-23T18:29:52.543479+0000","last_clean":"2024-04-23T18:29:52.543479+0000","last_became_active":"2024-04-23T18:29:19.526861+0000","last_became_peered":"2024-04-23T18:29:19.526861+0000","last_unstale":"2024-04-23T18:29:52.543479+0000","last_undegraded":"2024-04-23T18:29:52.543479+0000","last_fullsized":"2024-04-23T18:29:52.543479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:48:19.499447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.250373+0000","last_change":"2024-04-23T18:29:21.530887+0000","last_active":"2024-04-23T18:32:21.250373+0000","last_peered":"2024-04-23T18:32:21.250373+0000","last_clean":"2024-04-23T18:32:21.250373+0000","last_became_active":"2024-04-23T18:29:21.530612+0000","last_became_peered":"2024-04-23T18:29:21.530612+0000","last_unstale":"2024-04-23T18:32:21.250373+0000","last_undegraded":"2024-04-23T18:32:21.250373+0000","last_fullsized":"2024-04-23T18:32:21.250373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:46.345887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278266+0000","last_change":"2024-04-23T18:29:13.502952+0000","last_active":"2024-04-23T18:31:17.278266+0000","last_peered":"2024-04-23T18:31:17.278266+0000","last_clean":"2024-04-23T18:31:17.278266+0000","last_became_active":"2024-04-23T18:29:13.501636+0000","last_became_peered":"2024-04-23T18:29:13.501636+0000","last_unstale":"2024-04-23T18:31:17.278266+0000","last_undegraded":"2024-04-23T18:31:17.278266+0000","last_fullsized":"2024-04-23T18:31:17.278266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:48:13.470014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542806+0000","last_change":"2024-04-23T18:28:58.798997+0000","last_active":"2024-04-23T18:29:52.542806+0000","last_peered":"2024-04-23T18:29:52.542806+0000","last_clean":"2024-04-23T18:29:52.542806+0000","last_became_active":"2024-04-23T18:28:58.798001+0000","last_became_peered":"2024-04-23T18:28:58.798001+0000","last_unstale":"2024-04-23T18:29:52.542806+0000","last_undegraded":"2024-04-23T18:29:52.542806+0000","last_fullsized":"2024-04-23T18:29:52.542806+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_clean_scrub_stamp":"2024-04-23T18:28:57.410644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:20.472050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548752+0000","last_change":"2024-04-23T18:29:03.446652+0000","last_active":"2024-04-23T18:29:52.548752+0000","last_peered":"2024-04-23T18:29:52.548752+0000","last_clean":"2024-04-23T18:29:52.548752+0000","last_became_active":"2024-04-23T18:29:03.446324+0000","last_became_peered":"2024-04-23T18:29:03.446324+0000","last_unstale":"2024-04-23T18:29:52.548752+0000","last_undegraded":"2024-04-23T18:29:52.548752+0000","last_fullsized":"2024-04-23T18:29:52.548752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:19.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.210752+0000","last_change":"2024-04-23T18:29:11.512994+0000","last_active":"2024-04-23T18:32:21.210752+0000","last_peered":"2024-04-23T18:32:21.210752+0000","last_clean":"2024-04-23T18:32:21.210752+0000","last_became_active":"2024-04-23T18:29:11.512684+0000","last_became_peered":"2024-04-23T18:29:11.512684+0000","last_unstale":"2024-04-23T18:32:21.210752+0000","last_undegraded":"2024-04-23T18:32:21.210752+0000","last_fullsized":"2024-04-23T18:32:21.210752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:16.645799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546263+0000","last_change":"2024-04-23T18:29:15.509604+0000","last_active":"2024-04-23T18:29:52.546263+0000","last_peered":"2024-04-23T18:29:52.546263+0000","last_clean":"2024-04-23T18:29:52.546263+0000","last_became_active":"2024-04-23T18:29:15.509209+0000","last_became_peered":"2024-04-23T18:29:15.509209+0000","last_unstale":"2024-04-23T18:29:52.546263+0000","last_undegraded":"2024-04-23T18:29:52.546263+0000","last_fullsized":"2024-04-23T18:29:52.546263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:36.226721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.050188+0000","last_change":"2024-04-23T18:29:17.513782+0000","last_active":"2024-04-23T18:31:19.050188+0000","last_peered":"2024-04-23T18:31:19.050188+0000","last_clean":"2024-04-23T18:31:19.050188+0000","last_became_active":"2024-04-23T18:29:17.513504+0000","last_became_peered":"2024-04-23T18:29:17.513504+0000","last_unstale":"2024-04-23T18:31:19.050188+0000","last_undegraded":"2024-04-23T18:31:19.050188+0000","last_fullsized":"2024-04-23T18:31:19.050188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:21.911021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548534+0000","last_change":"2024-04-23T18:29:19.519375+0000","last_active":"2024-04-23T18:29:52.548534+0000","last_peered":"2024-04-23T18:29:52.548534+0000","last_clean":"2024-04-23T18:29:52.548534+0000","last_became_active":"2024-04-23T18:29:19.518974+0000","last_became_peered":"2024-04-23T18:29:19.518974+0000","last_unstale":"2024-04-23T18:29:52.548534+0000","last_undegraded":"2024-04-23T18:29:52.548534+0000","last_fullsized":"2024-04-23T18:29:52.548534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:36:01.680036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":162,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.226604+0000","last_change":"2024-04-23T18:29:21.532023+0000","last_active":"2024-04-23T18:32:21.226604+0000","last_peered":"2024-04-23T18:32:21.226604+0000","last_clean":"2024-04-23T18:32:21.226604+0000","last_became_active":"2024-04-23T18:29:21.531725+0000","last_became_peered":"2024-04-23T18:29:21.531725+0000","last_unstale":"2024-04-23T18:32:21.226604+0000","last_undegraded":"2024-04-23T18:32:21.226604+0000","last_fullsized":"2024-04-23T18:32:21.226604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:44:23.460941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'5","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.909403+0000","last_change":"2024-04-23T18:29:13.497272+0000","last_active":"2024-04-23T18:32:20.909403+0000","last_peered":"2024-04-23T18:32:20.909403+0000","last_clean":"2024-04-23T18:32:20.909403+0000","last_became_active":"2024-04-23T18:29:13.497008+0000","last_became_peered":"2024-04-23T18:29:13.497008+0000","last_unstale":"2024-04-23T18:32:20.909403+0000","last_undegraded":"2024-04-23T18:32:20.909403+0000","last_fullsized":"2024-04-23T18:32:20.909403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:19.658217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547412+0000","last_change":"2024-04-23T18:29:03.447767+0000","last_active":"2024-04-23T18:29:52.547412+0000","last_peered":"2024-04-23T18:29:52.547412+0000","last_clean":"2024-04-23T18:29:52.547412+0000","last_became_active":"2024-04-23T18:29:03.447404+0000","last_became_peered":"2024-04-23T18:29:03.447404+0000","last_unstale":"2024-04-23T18:29:52.547412+0000","last_undegraded":"2024-04-23T18:29:52.547412+0000","last_fullsized":"2024-04-23T18:29:52.547412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:01:15.340699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546565+0000","last_change":"2024-04-23T18:29:11.487391+0000","last_active":"2024-04-23T18:29:52.546565+0000","last_peered":"2024-04-23T18:29:52.546565+0000","last_clean":"2024-04-23T18:29:52.546565+0000","last_became_active":"2024-04-23T18:29:11.486538+0000","last_became_peered":"2024-04-23T18:29:11.486538+0000","last_unstale":"2024-04-23T18:29:52.546565+0000","last_undegraded":"2024-04-23T18:29:52.546565+0000","last_fullsized":"2024-04-23T18:29:52.546565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:31:33.533609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552721+0000","last_change":"2024-04-23T18:29:15.508321+0000","last_active":"2024-04-23T18:29:52.552721+0000","last_peered":"2024-04-23T18:29:52.552721+0000","last_clean":"2024-04-23T18:29:52.552721+0000","last_became_active":"2024-04-23T18:29:15.508020+0000","last_became_peered":"2024-04-23T18:29:15.508020+0000","last_unstale":"2024-04-23T18:29:52.552721+0000","last_undegraded":"2024-04-23T18:29:52.552721+0000","last_fullsized":"2024-04-23T18:29:52.552721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:05.187203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'274","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585466+0000","last_change":"2024-04-23T18:29:17.515301+0000","last_active":"2024-04-23T18:32:20.585466+0000","last_peered":"2024-04-23T18:32:20.585466+0000","last_clean":"2024-04-23T18:32:20.585466+0000","last_became_active":"2024-04-23T18:29:17.515023+0000","last_became_peered":"2024-04-23T18:29:17.515023+0000","last_unstale":"2024-04-23T18:32:20.585466+0000","last_undegraded":"2024-04-23T18:32:20.585466+0000","last_fullsized":"2024-04-23T18:32:20.585466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:57.739742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551884+0000","last_change":"2024-04-23T18:29:19.522666+0000","last_active":"2024-04-23T18:29:52.551884+0000","last_peered":"2024-04-23T18:29:52.551884+0000","last_clean":"2024-04-23T18:29:52.551884+0000","last_became_active":"2024-04-23T18:29:19.522105+0000","last_became_peered":"2024-04-23T18:29:19.522105+0000","last_unstale":"2024-04-23T18:29:52.551884+0000","last_undegraded":"2024-04-23T18:29:52.551884+0000","last_fullsized":"2024-04-23T18:29:52.551884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:35.556440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.621034+0000","last_change":"2024-04-23T18:29:21.533582+0000","last_active":"2024-04-23T18:30:36.621034+0000","last_peered":"2024-04-23T18:30:36.621034+0000","last_clean":"2024-04-23T18:30:36.621034+0000","last_became_active":"2024-04-23T18:29:21.532867+0000","last_became_peered":"2024-04-23T18:29:21.532867+0000","last_unstale":"2024-04-23T18:30:36.621034+0000","last_undegraded":"2024-04-23T18:30:36.621034+0000","last_fullsized":"2024-04-23T18:30:36.621034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:30:13.562825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549403+0000","last_change":"2024-04-23T18:29:13.499606+0000","last_active":"2024-04-23T18:29:52.549403+0000","last_peered":"2024-04-23T18:29:52.549403+0000","last_clean":"2024-04-23T18:29:52.549403+0000","last_became_active":"2024-04-23T18:29:13.499253+0000","last_became_peered":"2024-04-23T18:29:13.499253+0000","last_unstale":"2024-04-23T18:29:52.549403+0000","last_undegraded":"2024-04-23T18:29:52.549403+0000","last_fullsized":"2024-04-23T18:29:52.549403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:12:00.717757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.540896+0000","last_change":"2024-04-23T18:29:03.447054+0000","last_active":"2024-04-23T18:29:52.540896+0000","last_peered":"2024-04-23T18:29:52.540896+0000","last_clean":"2024-04-23T18:29:52.540896+0000","last_became_active":"2024-04-23T18:29:03.446647+0000","last_became_peered":"2024-04-23T18:29:03.446647+0000","last_unstale":"2024-04-23T18:29:52.540896+0000","last_undegraded":"2024-04-23T18:29:52.540896+0000","last_fullsized":"2024-04-23T18:29:52.540896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:57.409435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546219+0000","last_change":"2024-04-23T18:29:11.492974+0000","last_active":"2024-04-23T18:29:52.546219+0000","last_peered":"2024-04-23T18:29:52.546219+0000","last_clean":"2024-04-23T18:29:52.546219+0000","last_became_active":"2024-04-23T18:29:11.491953+0000","last_became_peered":"2024-04-23T18:29:11.491953+0000","last_unstale":"2024-04-23T18:29:52.546219+0000","last_undegraded":"2024-04-23T18:29:52.546219+0000","last_fullsized":"2024-04-23T18:29:52.546219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:45:27.531143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.563923+0000","last_change":"2024-04-23T18:29:52.563435+0000","last_active":"2024-04-23T18:29:52.563923+0000","last_peered":"2024-04-23T18:29:52.563923+0000","last_clean":"2024-04-23T18:29:52.563923+0000","last_became_active":"2024-04-23T18:29:52.551265+0000","last_became_peered":"2024-04-23T18:29:52.551265+0000","last_unstale":"2024-04-23T18:29:52.563923+0000","last_undegraded":"2024-04-23T18:29:52.563923+0000","last_fullsized":"2024-04-23T18:29:52.563923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:39.312725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585625+0000","last_change":"2024-04-23T18:29:17.514185+0000","last_active":"2024-04-23T18:32:20.585625+0000","last_peered":"2024-04-23T18:32:20.585625+0000","last_clean":"2024-04-23T18:32:20.585625+0000","last_became_active":"2024-04-23T18:29:17.513875+0000","last_became_peered":"2024-04-23T18:29:17.513875+0000","last_unstale":"2024-04-23T18:32:20.585625+0000","last_undegraded":"2024-04-23T18:32:20.585625+0000","last_fullsized":"2024-04-23T18:32:20.585625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:59:32.280321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548106+0000","last_change":"2024-04-23T18:29:19.519133+0000","last_active":"2024-04-23T18:29:52.548106+0000","last_peered":"2024-04-23T18:29:52.548106+0000","last_clean":"2024-04-23T18:29:52.548106+0000","last_became_active":"2024-04-23T18:29:19.518744+0000","last_became_peered":"2024-04-23T18:29:19.518744+0000","last_unstale":"2024-04-23T18:29:52.548106+0000","last_undegraded":"2024-04-23T18:29:52.548106+0000","last_fullsized":"2024-04-23T18:29:52.548106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:05:47.618962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.756328+0000","last_change":"2024-04-23T18:29:21.533685+0000","last_active":"2024-04-23T18:29:53.756328+0000","last_peered":"2024-04-23T18:29:53.756328+0000","last_clean":"2024-04-23T18:29:53.756328+0000","last_became_active":"2024-04-23T18:29:21.533358+0000","last_became_peered":"2024-04-23T18:29:21.533358+0000","last_unstale":"2024-04-23T18:29:53.756328+0000","last_undegraded":"2024-04-23T18:29:53.756328+0000","last_fullsized":"2024-04-23T18:29:53.756328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:52.473352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136286+0000","last_change":"2024-04-23T18:29:13.493749+0000","last_active":"2024-04-23T18:32:21.136286+0000","last_peered":"2024-04-23T18:32:21.136286+0000","last_clean":"2024-04-23T18:32:21.136286+0000","last_became_active":"2024-04-23T18:29:13.493321+0000","last_became_peered":"2024-04-23T18:29:13.493321+0000","last_unstale":"2024-04-23T18:32:21.136286+0000","last_undegraded":"2024-04-23T18:32:21.136286+0000","last_fullsized":"2024-04-23T18:32:21.136286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:42:30.926554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548411+0000","last_change":"2024-04-23T18:29:03.446774+0000","last_active":"2024-04-23T18:29:52.548411+0000","last_peered":"2024-04-23T18:29:52.548411+0000","last_clean":"2024-04-23T18:29:52.548411+0000","last_became_active":"2024-04-23T18:29:03.446457+0000","last_became_peered":"2024-04-23T18:29:03.446457+0000","last_unstale":"2024-04-23T18:29:52.548411+0000","last_undegraded":"2024-04-23T18:29:52.548411+0000","last_fullsized":"2024-04-23T18:29:52.548411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:14.074221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.863350+0000","last_change":"2024-04-23T18:29:11.483348+0000","last_active":"2024-04-23T18:32:20.863350+0000","last_peered":"2024-04-23T18:32:20.863350+0000","last_clean":"2024-04-23T18:32:20.863350+0000","last_became_active":"2024-04-23T18:29:11.482896+0000","last_became_peered":"2024-04-23T18:29:11.482896+0000","last_unstale":"2024-04-23T18:32:20.863350+0000","last_undegraded":"2024-04-23T18:32:20.863350+0000","last_fullsized":"2024-04-23T18:32:20.863350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:53.629794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548218+0000","last_change":"2024-04-23T18:29:15.507664+0000","last_active":"2024-04-23T18:29:52.548218+0000","last_peered":"2024-04-23T18:29:52.548218+0000","last_clean":"2024-04-23T18:29:52.548218+0000","last_became_active":"2024-04-23T18:29:15.507357+0000","last_became_peered":"2024-04-23T18:29:15.507357+0000","last_unstale":"2024-04-23T18:29:52.548218+0000","last_undegraded":"2024-04-23T18:29:52.548218+0000","last_fullsized":"2024-04-23T18:29:52.548218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:47.440112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.560727+0000","last_change":"2024-04-23T18:29:17.514159+0000","last_active":"2024-04-23T18:32:20.560727+0000","last_peered":"2024-04-23T18:32:20.560727+0000","last_clean":"2024-04-23T18:32:20.560727+0000","last_became_active":"2024-04-23T18:29:17.513393+0000","last_became_peered":"2024-04-23T18:29:17.513393+0000","last_unstale":"2024-04-23T18:32:20.560727+0000","last_undegraded":"2024-04-23T18:32:20.560727+0000","last_fullsized":"2024-04-23T18:32:20.560727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:46:31.465490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551911+0000","last_change":"2024-04-23T18:29:19.523513+0000","last_active":"2024-04-23T18:29:52.551911+0000","last_peered":"2024-04-23T18:29:52.551911+0000","last_clean":"2024-04-23T18:29:52.551911+0000","last_became_active":"2024-04-23T18:29:19.523070+0000","last_became_peered":"2024-04-23T18:29:19.523070+0000","last_unstale":"2024-04-23T18:29:52.551911+0000","last_undegraded":"2024-04-23T18:29:52.551911+0000","last_fullsized":"2024-04-23T18:29:52.551911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:53.579124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.926481+0000","last_change":"2024-04-23T18:29:21.529180+0000","last_active":"2024-04-23T18:32:20.926481+0000","last_peered":"2024-04-23T18:32:20.926481+0000","last_clean":"2024-04-23T18:32:20.926481+0000","last_became_active":"2024-04-23T18:29:21.528764+0000","last_became_peered":"2024-04-23T18:29:21.528764+0000","last_unstale":"2024-04-23T18:32:20.926481+0000","last_undegraded":"2024-04-23T18:32:20.926481+0000","last_fullsized":"2024-04-23T18:32:20.926481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:15:30.851670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546769+0000","last_change":"2024-04-23T18:29:13.507864+0000","last_active":"2024-04-23T18:29:52.546769+0000","last_peered":"2024-04-23T18:29:52.546769+0000","last_clean":"2024-04-23T18:29:52.546769+0000","last_became_active":"2024-04-23T18:29:13.507496+0000","last_became_peered":"2024-04-23T18:29:13.507496+0000","last_unstale":"2024-04-23T18:29:52.546769+0000","last_undegraded":"2024-04-23T18:29:52.546769+0000","last_fullsized":"2024-04-23T18:29:52.546769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:36.947062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541796+0000","last_change":"2024-04-23T18:29:11.483379+0000","last_active":"2024-04-23T18:29:52.541796+0000","last_peered":"2024-04-23T18:29:52.541796+0000","last_clean":"2024-04-23T18:29:52.541796+0000","last_became_active":"2024-04-23T18:29:11.482348+0000","last_became_peered":"2024-04-23T18:29:11.482348+0000","last_unstale":"2024-04-23T18:29:52.541796+0000","last_undegraded":"2024-04-23T18:29:52.541796+0000","last_fullsized":"2024-04-23T18:29:52.541796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:47:48.291376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547947+0000","last_change":"2024-04-23T18:29:03.446643+0000","last_active":"2024-04-23T18:29:52.547947+0000","last_peered":"2024-04-23T18:29:52.547947+0000","last_clean":"2024-04-23T18:29:52.547947+0000","last_became_active":"2024-04-23T18:29:03.446286+0000","last_became_peered":"2024-04-23T18:29:03.446286+0000","last_unstale":"2024-04-23T18:29:52.547947+0000","last_undegraded":"2024-04-23T18:29:52.547947+0000","last_fullsized":"2024-04-23T18:29:52.547947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:42.594846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:56.764032+0000","last_change":"2024-04-23T18:29:52.554181+0000","last_active":"2024-04-23T18:31:56.764032+0000","last_peered":"2024-04-23T18:31:56.764032+0000","last_clean":"2024-04-23T18:31:56.764032+0000","last_became_active":"2024-04-23T18:29:52.553851+0000","last_became_peered":"2024-04-23T18:29:52.553851+0000","last_unstale":"2024-04-23T18:31:56.764032+0000","last_undegraded":"2024-04-23T18:31:56.764032+0000","last_fullsized":"2024-04-23T18:31:56.764032+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:05.187203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'61","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756499+0000","last_change":"2024-04-23T18:29:17.513936+0000","last_active":"2024-04-23T18:31:19.756499+0000","last_peered":"2024-04-23T18:31:19.756499+0000","last_clean":"2024-04-23T18:31:19.756499+0000","last_became_active":"2024-04-23T18:29:17.513599+0000","last_became_peered":"2024-04-23T18:29:17.513599+0000","last_unstale":"2024-04-23T18:31:19.756499+0000","last_undegraded":"2024-04-23T18:31:19.756499+0000","last_fullsized":"2024-04-23T18:31:19.756499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:56:07.867139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541648+0000","last_change":"2024-04-23T18:29:19.526480+0000","last_active":"2024-04-23T18:29:52.541648+0000","last_peered":"2024-04-23T18:29:52.541648+0000","last_clean":"2024-04-23T18:29:52.541648+0000","last_became_active":"2024-04-23T18:29:19.526192+0000","last_became_peered":"2024-04-23T18:29:19.526192+0000","last_unstale":"2024-04-23T18:29:52.541648+0000","last_undegraded":"2024-04-23T18:29:52.541648+0000","last_fullsized":"2024-04-23T18:29:52.541648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:36:56.457757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.486845+0000","last_change":"2024-04-23T18:29:21.533405+0000","last_active":"2024-04-23T18:31:20.486845+0000","last_peered":"2024-04-23T18:31:20.486845+0000","last_clean":"2024-04-23T18:31:20.486845+0000","last_became_active":"2024-04-23T18:29:21.533202+0000","last_became_peered":"2024-04-23T18:29:21.533202+0000","last_unstale":"2024-04-23T18:31:20.486845+0000","last_undegraded":"2024-04-23T18:31:20.486845+0000","last_fullsized":"2024-04-23T18:31:20.486845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:54:11.716719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":32,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'1","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.759332+0000","last_change":"2024-04-23T18:29:13.507056+0000","last_active":"2024-04-23T18:31:21.759332+0000","last_peered":"2024-04-23T18:31:21.759332+0000","last_clean":"2024-04-23T18:31:21.759332+0000","last_became_active":"2024-04-23T18:29:13.506795+0000","last_became_peered":"2024-04-23T18:29:13.506795+0000","last_unstale":"2024-04-23T18:31:21.759332+0000","last_undegraded":"2024-04-23T18:31:21.759332+0000","last_fullsized":"2024-04-23T18:31:21.759332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:39.344472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548249+0000","last_change":"2024-04-23T18:29:11.492325+0000","last_active":"2024-04-23T18:29:52.548249+0000","last_peered":"2024-04-23T18:29:52.548249+0000","last_clean":"2024-04-23T18:29:52.548249+0000","last_became_active":"2024-04-23T18:29:11.491882+0000","last_became_peered":"2024-04-23T18:29:11.491882+0000","last_unstale":"2024-04-23T18:29:52.548249+0000","last_undegraded":"2024-04-23T18:29:52.548249+0000","last_fullsized":"2024-04-23T18:29:52.548249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:32:57.364121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552526+0000","last_change":"2024-04-23T18:29:03.447598+0000","last_active":"2024-04-23T18:29:52.552526+0000","last_peered":"2024-04-23T18:29:52.552526+0000","last_clean":"2024-04-23T18:29:52.552526+0000","last_became_active":"2024-04-23T18:29:03.447265+0000","last_became_peered":"2024-04-23T18:29:03.447265+0000","last_unstale":"2024-04-23T18:29:52.552526+0000","last_undegraded":"2024-04-23T18:29:52.552526+0000","last_fullsized":"2024-04-23T18:29:52.552526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:56.204409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548211+0000","last_change":"2024-04-23T18:29:15.506698+0000","last_active":"2024-04-23T18:29:52.548211+0000","last_peered":"2024-04-23T18:29:52.548211+0000","last_clean":"2024-04-23T18:29:52.548211+0000","last_became_active":"2024-04-23T18:29:15.506394+0000","last_became_peered":"2024-04-23T18:29:15.506394+0000","last_unstale":"2024-04-23T18:29:52.548211+0000","last_undegraded":"2024-04-23T18:29:52.548211+0000","last_fullsized":"2024-04-23T18:29:52.548211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:21.696617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543554+0000","last_change":"2024-04-23T18:29:17.515730+0000","last_active":"2024-04-23T18:29:52.543554+0000","last_peered":"2024-04-23T18:29:52.543554+0000","last_clean":"2024-04-23T18:29:52.543554+0000","last_became_active":"2024-04-23T18:29:17.515048+0000","last_became_peered":"2024-04-23T18:29:17.515048+0000","last_unstale":"2024-04-23T18:29:52.543554+0000","last_undegraded":"2024-04-23T18:29:52.543554+0000","last_fullsized":"2024-04-23T18:29:52.543554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:23.680483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":369,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585547+0000","last_change":"2024-04-23T18:29:19.518964+0000","last_active":"2024-04-23T18:32:20.585547+0000","last_peered":"2024-04-23T18:32:20.585547+0000","last_clean":"2024-04-23T18:32:20.585547+0000","last_became_active":"2024-04-23T18:29:19.518668+0000","last_became_peered":"2024-04-23T18:29:19.518668+0000","last_unstale":"2024-04-23T18:32:20.585547+0000","last_undegraded":"2024-04-23T18:32:20.585547+0000","last_fullsized":"2024-04-23T18:32:20.585547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:07.298508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.170755+0000","last_change":"2024-04-23T18:29:21.531478+0000","last_active":"2024-04-23T18:32:21.170755+0000","last_peered":"2024-04-23T18:32:21.170755+0000","last_clean":"2024-04-23T18:32:21.170755+0000","last_became_active":"2024-04-23T18:29:21.531185+0000","last_became_peered":"2024-04-23T18:29:21.531185+0000","last_unstale":"2024-04-23T18:32:21.170755+0000","last_undegraded":"2024-04-23T18:32:21.170755+0000","last_fullsized":"2024-04-23T18:32:21.170755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:10.167276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.538256+0000","last_change":"2024-04-23T18:29:13.504754+0000","last_active":"2024-04-23T18:31:20.538256+0000","last_peered":"2024-04-23T18:31:20.538256+0000","last_clean":"2024-04-23T18:31:20.538256+0000","last_became_active":"2024-04-23T18:29:13.503543+0000","last_became_peered":"2024-04-23T18:29:13.503543+0000","last_unstale":"2024-04-23T18:31:20.538256+0000","last_undegraded":"2024-04-23T18:31:20.538256+0000","last_fullsized":"2024-04-23T18:31:20.538256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:55:58.292535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760523+0000","last_change":"2024-04-23T18:29:11.505973+0000","last_active":"2024-04-23T18:31:21.760523+0000","last_peered":"2024-04-23T18:31:21.760523+0000","last_clean":"2024-04-23T18:31:21.760523+0000","last_became_active":"2024-04-23T18:29:11.505604+0000","last_became_peered":"2024-04-23T18:29:11.505604+0000","last_unstale":"2024-04-23T18:31:21.760523+0000","last_undegraded":"2024-04-23T18:31:21.760523+0000","last_fullsized":"2024-04-23T18:31:21.760523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:26.018597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548860+0000","last_change":"2024-04-23T18:29:03.446013+0000","last_active":"2024-04-23T18:29:52.548860+0000","last_peered":"2024-04-23T18:29:52.548860+0000","last_clean":"2024-04-23T18:29:52.548860+0000","last_became_active":"2024-04-23T18:29:03.445715+0000","last_became_peered":"2024-04-23T18:29:03.445715+0000","last_unstale":"2024-04-23T18:29:52.548860+0000","last_undegraded":"2024-04-23T18:29:52.548860+0000","last_fullsized":"2024-04-23T18:29:52.548860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:39.084066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.550999+0000","last_change":"2024-04-23T18:29:15.511864+0000","last_active":"2024-04-23T18:29:52.550999+0000","last_peered":"2024-04-23T18:29:52.550999+0000","last_clean":"2024-04-23T18:29:52.550999+0000","last_became_active":"2024-04-23T18:29:15.511553+0000","last_became_peered":"2024-04-23T18:29:15.511553+0000","last_unstale":"2024-04-23T18:29:52.550999+0000","last_undegraded":"2024-04-23T18:29:52.550999+0000","last_fullsized":"2024-04-23T18:29:52.550999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:20.797539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760395+0000","last_change":"2024-04-23T18:29:17.516388+0000","last_active":"2024-04-23T18:31:21.760395+0000","last_peered":"2024-04-23T18:31:21.760395+0000","last_clean":"2024-04-23T18:31:21.760395+0000","last_became_active":"2024-04-23T18:29:17.515741+0000","last_became_peered":"2024-04-23T18:29:17.515741+0000","last_unstale":"2024-04-23T18:31:21.760395+0000","last_undegraded":"2024-04-23T18:31:21.760395+0000","last_fullsized":"2024-04-23T18:31:21.760395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:57.339089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":399,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.326707+0000","last_change":"2024-04-23T18:29:19.526580+0000","last_active":"2024-04-23T18:32:21.326707+0000","last_peered":"2024-04-23T18:32:21.326707+0000","last_clean":"2024-04-23T18:32:21.326707+0000","last_became_active":"2024-04-23T18:29:19.526375+0000","last_became_peered":"2024-04-23T18:29:19.526375+0000","last_unstale":"2024-04-23T18:32:21.326707+0000","last_undegraded":"2024-04-23T18:32:21.326707+0000","last_fullsized":"2024-04-23T18:32:21.326707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:22.422967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.097904+0000","last_change":"2024-04-23T18:29:21.531204+0000","last_active":"2024-04-23T18:29:54.097904+0000","last_peered":"2024-04-23T18:29:54.097904+0000","last_clean":"2024-04-23T18:29:54.097904+0000","last_became_active":"2024-04-23T18:29:21.530911+0000","last_became_peered":"2024-04-23T18:29:21.530911+0000","last_unstale":"2024-04-23T18:29:54.097904+0000","last_undegraded":"2024-04-23T18:29:54.097904+0000","last_fullsized":"2024-04-23T18:29:54.097904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:38:26.331563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'16","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998529+0000","last_change":"2024-04-23T18:29:13.499873+0000","last_active":"2024-04-23T18:32:20.998529+0000","last_peered":"2024-04-23T18:32:20.998529+0000","last_clean":"2024-04-23T18:32:20.998529+0000","last_became_active":"2024-04-23T18:29:13.499603+0000","last_became_peered":"2024-04-23T18:29:13.499603+0000","last_unstale":"2024-04-23T18:32:20.998529+0000","last_undegraded":"2024-04-23T18:32:20.998529+0000","last_fullsized":"2024-04-23T18:32:20.998529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:17.317212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547877+0000","last_change":"2024-04-23T18:29:11.488874+0000","last_active":"2024-04-23T18:29:52.547877+0000","last_peered":"2024-04-23T18:29:52.547877+0000","last_clean":"2024-04-23T18:29:52.547877+0000","last_became_active":"2024-04-23T18:29:11.488500+0000","last_became_peered":"2024-04-23T18:29:11.488500+0000","last_unstale":"2024-04-23T18:29:52.547877+0000","last_undegraded":"2024-04-23T18:29:52.547877+0000","last_fullsized":"2024-04-23T18:29:52.547877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:52.597685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552056+0000","last_change":"2024-04-23T18:29:03.594008+0000","last_active":"2024-04-23T18:29:52.552056+0000","last_peered":"2024-04-23T18:29:52.552056+0000","last_clean":"2024-04-23T18:29:52.552056+0000","last_became_active":"2024-04-23T18:29:03.593691+0000","last_became_peered":"2024-04-23T18:29:03.593691+0000","last_unstale":"2024-04-23T18:29:52.552056+0000","last_undegraded":"2024-04-23T18:29:52.552056+0000","last_fullsized":"2024-04-23T18:29:52.552056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:18:59.128475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549901+0000","last_change":"2024-04-23T18:29:15.513067+0000","last_active":"2024-04-23T18:29:52.549901+0000","last_peered":"2024-04-23T18:29:52.549901+0000","last_clean":"2024-04-23T18:29:52.549901+0000","last_became_active":"2024-04-23T18:29:15.511207+0000","last_became_peered":"2024-04-23T18:29:15.511207+0000","last_unstale":"2024-04-23T18:29:52.549901+0000","last_undegraded":"2024-04-23T18:29:52.549901+0000","last_fullsized":"2024-04-23T18:29:52.549901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:23.658875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.036554+0000","last_change":"2024-04-23T18:29:17.515549+0000","last_active":"2024-04-23T18:31:19.036554+0000","last_peered":"2024-04-23T18:31:19.036554+0000","last_clean":"2024-04-23T18:31:19.036554+0000","last_became_active":"2024-04-23T18:29:17.515004+0000","last_became_peered":"2024-04-23T18:29:17.515004+0000","last_unstale":"2024-04-23T18:31:19.036554+0000","last_undegraded":"2024-04-23T18:31:19.036554+0000","last_fullsized":"2024-04-23T18:31:19.036554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:36.940155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547648+0000","last_change":"2024-04-23T18:29:19.518175+0000","last_active":"2024-04-23T18:29:52.547648+0000","last_peered":"2024-04-23T18:29:52.547648+0000","last_clean":"2024-04-23T18:29:52.547648+0000","last_became_active":"2024-04-23T18:29:19.517903+0000","last_became_peered":"2024-04-23T18:29:19.517903+0000","last_unstale":"2024-04-23T18:29:52.547648+0000","last_undegraded":"2024-04-23T18:29:52.547648+0000","last_fullsized":"2024-04-23T18:29:52.547648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:49:59.234459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.612385+0000","last_change":"2024-04-23T18:29:21.531285+0000","last_active":"2024-04-23T18:30:36.612385+0000","last_peered":"2024-04-23T18:30:36.612385+0000","last_clean":"2024-04-23T18:30:36.612385+0000","last_became_active":"2024-04-23T18:29:21.530980+0000","last_became_peered":"2024-04-23T18:29:21.530980+0000","last_unstale":"2024-04-23T18:30:36.612385+0000","last_undegraded":"2024-04-23T18:30:36.612385+0000","last_fullsized":"2024-04-23T18:30:36.612385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:04.723674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542703+0000","last_change":"2024-04-23T18:29:21.534750+0000","last_active":"2024-04-23T18:29:52.542703+0000","last_peered":"2024-04-23T18:29:52.542703+0000","last_clean":"2024-04-23T18:29:52.542703+0000","last_became_active":"2024-04-23T18:29:21.534461+0000","last_became_peered":"2024-04-23T18:29:21.534461+0000","last_unstale":"2024-04-23T18:29:52.542703+0000","last_undegraded":"2024-04-23T18:29:52.542703+0000","last_fullsized":"2024-04-23T18:29:52.542703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:35:55.703412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.910166+0000","last_change":"2024-04-23T18:29:13.504381+0000","last_active":"2024-04-23T18:32:20.910166+0000","last_peered":"2024-04-23T18:32:20.910166+0000","last_clean":"2024-04-23T18:32:20.910166+0000","last_became_active":"2024-04-23T18:29:13.504092+0000","last_became_peered":"2024-04-23T18:29:13.504092+0000","last_unstale":"2024-04-23T18:32:20.910166+0000","last_undegraded":"2024-04-23T18:32:20.910166+0000","last_fullsized":"2024-04-23T18:32:20.910166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:28.289132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.550679+0000","last_change":"2024-04-23T18:29:11.511197+0000","last_active":"2024-04-23T18:29:52.550679+0000","last_peered":"2024-04-23T18:29:52.550679+0000","last_clean":"2024-04-23T18:29:52.550679+0000","last_became_active":"2024-04-23T18:29:11.510456+0000","last_became_peered":"2024-04-23T18:29:11.510456+0000","last_unstale":"2024-04-23T18:29:52.550679+0000","last_undegraded":"2024-04-23T18:29:52.550679+0000","last_fullsized":"2024-04-23T18:29:52.550679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:15.310210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.545740+0000","last_change":"2024-04-23T18:29:15.507536+0000","last_active":"2024-04-23T18:29:52.545740+0000","last_peered":"2024-04-23T18:29:52.545740+0000","last_clean":"2024-04-23T18:29:52.545740+0000","last_became_active":"2024-04-23T18:29:15.506939+0000","last_became_peered":"2024-04-23T18:29:15.506939+0000","last_unstale":"2024-04-23T18:29:52.545740+0000","last_undegraded":"2024-04-23T18:29:52.545740+0000","last_fullsized":"2024-04-23T18:29:52.545740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:33.128258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.042869+0000","last_change":"2024-04-23T18:29:17.511932+0000","last_active":"2024-04-23T18:31:19.042869+0000","last_peered":"2024-04-23T18:31:19.042869+0000","last_clean":"2024-04-23T18:31:19.042869+0000","last_became_active":"2024-04-23T18:29:17.511559+0000","last_became_peered":"2024-04-23T18:29:17.511559+0000","last_unstale":"2024-04-23T18:31:19.042869+0000","last_undegraded":"2024-04-23T18:31:19.042869+0000","last_fullsized":"2024-04-23T18:31:19.042869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:32:09.008618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549463+0000","last_change":"2024-04-23T18:29:19.525590+0000","last_active":"2024-04-23T18:29:52.549463+0000","last_peered":"2024-04-23T18:29:52.549463+0000","last_clean":"2024-04-23T18:29:52.549463+0000","last_became_active":"2024-04-23T18:29:19.525302+0000","last_became_peered":"2024-04-23T18:29:19.525302+0000","last_unstale":"2024-04-23T18:29:52.549463+0000","last_undegraded":"2024-04-23T18:29:52.549463+0000","last_fullsized":"2024-04-23T18:29:52.549463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:57.944932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:18.716199+0000","last_change":"2024-04-23T18:29:21.530275+0000","last_active":"2024-04-23T18:31:18.716199+0000","last_peered":"2024-04-23T18:31:18.716199+0000","last_clean":"2024-04-23T18:31:18.716199+0000","last_became_active":"2024-04-23T18:29:21.530013+0000","last_became_peered":"2024-04-23T18:29:21.530013+0000","last_unstale":"2024-04-23T18:31:18.716199+0000","last_undegraded":"2024-04-23T18:31:18.716199+0000","last_fullsized":"2024-04-23T18:31:18.716199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:53.670984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544156+0000","last_change":"2024-04-23T18:29:13.506992+0000","last_active":"2024-04-23T18:29:52.544156+0000","last_peered":"2024-04-23T18:29:52.544156+0000","last_clean":"2024-04-23T18:29:52.544156+0000","last_became_active":"2024-04-23T18:29:13.506770+0000","last_became_peered":"2024-04-23T18:29:13.506770+0000","last_unstale":"2024-04-23T18:29:52.544156+0000","last_undegraded":"2024-04-23T18:29:52.544156+0000","last_fullsized":"2024-04-23T18:29:52.544156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:31:14.220069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.130507+0000","last_change":"2024-04-23T18:29:11.482617+0000","last_active":"2024-04-23T18:32:21.130507+0000","last_peered":"2024-04-23T18:32:21.130507+0000","last_clean":"2024-04-23T18:32:21.130507+0000","last_became_active":"2024-04-23T18:29:11.481884+0000","last_became_peered":"2024-04-23T18:29:11.481884+0000","last_unstale":"2024-04-23T18:32:21.130507+0000","last_undegraded":"2024-04-23T18:32:21.130507+0000","last_fullsized":"2024-04-23T18:32:21.130507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:08:38.534696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549279+0000","last_change":"2024-04-23T18:29:15.508345+0000","last_active":"2024-04-23T18:29:52.549279+0000","last_peered":"2024-04-23T18:29:52.549279+0000","last_clean":"2024-04-23T18:29:52.549279+0000","last_became_active":"2024-04-23T18:29:15.508018+0000","last_became_peered":"2024-04-23T18:29:15.508018+0000","last_unstale":"2024-04-23T18:29:52.549279+0000","last_undegraded":"2024-04-23T18:29:52.549279+0000","last_fullsized":"2024-04-23T18:29:52.549279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:44:46.349637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.565238+0000","last_change":"2024-04-23T18:29:17.515180+0000","last_active":"2024-04-23T18:32:20.565238+0000","last_peered":"2024-04-23T18:32:20.565238+0000","last_clean":"2024-04-23T18:32:20.565238+0000","last_became_active":"2024-04-23T18:29:17.514836+0000","last_became_peered":"2024-04-23T18:29:17.514836+0000","last_unstale":"2024-04-23T18:32:20.565238+0000","last_undegraded":"2024-04-23T18:32:20.565238+0000","last_fullsized":"2024-04-23T18:32:20.565238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:18.629550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541082+0000","last_change":"2024-04-23T18:29:19.527752+0000","last_active":"2024-04-23T18:29:52.541082+0000","last_peered":"2024-04-23T18:29:52.541082+0000","last_clean":"2024-04-23T18:29:52.541082+0000","last_became_active":"2024-04-23T18:29:19.527461+0000","last_became_peered":"2024-04-23T18:29:19.527461+0000","last_unstale":"2024-04-23T18:29:52.541082+0000","last_undegraded":"2024-04-23T18:29:52.541082+0000","last_fullsized":"2024-04-23T18:29:52.541082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:55.806105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547711+0000","last_change":"2024-04-23T18:29:21.529099+0000","last_active":"2024-04-23T18:29:52.547711+0000","last_peered":"2024-04-23T18:29:52.547711+0000","last_clean":"2024-04-23T18:29:52.547711+0000","last_became_active":"2024-04-23T18:29:21.528772+0000","last_became_peered":"2024-04-23T18:29:21.528772+0000","last_unstale":"2024-04-23T18:29:52.547711+0000","last_undegraded":"2024-04-23T18:29:52.547711+0000","last_fullsized":"2024-04-23T18:29:52.547711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:58.849572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.758624+0000","last_change":"2024-04-23T18:29:13.503536+0000","last_active":"2024-04-23T18:29:53.758624+0000","last_peered":"2024-04-23T18:29:53.758624+0000","last_clean":"2024-04-23T18:29:53.758624+0000","last_became_active":"2024-04-23T18:29:13.502849+0000","last_became_peered":"2024-04-23T18:29:13.502849+0000","last_unstale":"2024-04-23T18:29:53.758624+0000","last_undegraded":"2024-04-23T18:29:53.758624+0000","last_fullsized":"2024-04-23T18:29:53.758624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:27.393642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761184+0000","last_change":"2024-04-23T18:29:11.485392+0000","last_active":"2024-04-23T18:31:36.761184+0000","last_peered":"2024-04-23T18:31:36.761184+0000","last_clean":"2024-04-23T18:31:36.761184+0000","last_became_active":"2024-04-23T18:29:11.483628+0000","last_became_peered":"2024-04-23T18:29:11.483628+0000","last_unstale":"2024-04-23T18:31:36.761184+0000","last_undegraded":"2024-04-23T18:31:36.761184+0000","last_fullsized":"2024-04-23T18:31:36.761184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:50.092624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541320+0000","last_change":"2024-04-23T18:29:15.510472+0000","last_active":"2024-04-23T18:29:52.541320+0000","last_peered":"2024-04-23T18:29:52.541320+0000","last_clean":"2024-04-23T18:29:52.541320+0000","last_became_active":"2024-04-23T18:29:15.510130+0000","last_became_peered":"2024-04-23T18:29:15.510130+0000","last_unstale":"2024-04-23T18:29:52.541320+0000","last_undegraded":"2024-04-23T18:29:52.541320+0000","last_fullsized":"2024-04-23T18:29:52.541320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:21.124426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'41","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.618994+0000","last_change":"2024-04-23T18:29:17.510778+0000","last_active":"2024-04-23T18:32:20.618994+0000","last_peered":"2024-04-23T18:32:20.618994+0000","last_clean":"2024-04-23T18:32:20.618994+0000","last_became_active":"2024-04-23T18:29:17.510429+0000","last_became_peered":"2024-04-23T18:29:17.510429+0000","last_unstale":"2024-04-23T18:32:20.618994+0000","last_undegraded":"2024-04-23T18:32:20.618994+0000","last_fullsized":"2024-04-23T18:32:20.618994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:55.966235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543935+0000","last_change":"2024-04-23T18:29:19.519077+0000","last_active":"2024-04-23T18:29:52.543935+0000","last_peered":"2024-04-23T18:29:52.543935+0000","last_clean":"2024-04-23T18:29:52.543935+0000","last_became_active":"2024-04-23T18:29:19.518543+0000","last_became_peered":"2024-04-23T18:29:19.518543+0000","last_unstale":"2024-04-23T18:29:52.543935+0000","last_undegraded":"2024-04-23T18:29:52.543935+0000","last_fullsized":"2024-04-23T18:29:52.543935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:35:53.694069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551260+0000","last_change":"2024-04-23T18:29:21.534350+0000","last_active":"2024-04-23T18:29:52.551260+0000","last_peered":"2024-04-23T18:29:52.551260+0000","last_clean":"2024-04-23T18:29:52.551260+0000","last_became_active":"2024-04-23T18:29:21.534023+0000","last_became_peered":"2024-04-23T18:29:21.534023+0000","last_unstale":"2024-04-23T18:29:52.551260+0000","last_undegraded":"2024-04-23T18:29:52.551260+0000","last_fullsized":"2024-04-23T18:29:52.551260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:14:43.043132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'19","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762471+0000","last_change":"2024-04-23T18:29:13.501148+0000","last_active":"2024-04-23T18:31:36.762471+0000","last_peered":"2024-04-23T18:31:36.762471+0000","last_clean":"2024-04-23T18:31:36.762471+0000","last_became_active":"2024-04-23T18:29:13.500877+0000","last_became_peered":"2024-04-23T18:29:13.500877+0000","last_unstale":"2024-04-23T18:31:36.762471+0000","last_undegraded":"2024-04-23T18:31:36.762471+0000","last_fullsized":"2024-04-23T18:31:36.762471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:29:12.567941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":53,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.302552+0000","last_change":"2024-04-23T18:29:11.498275+0000","last_active":"2024-04-23T18:29:54.302552+0000","last_peered":"2024-04-23T18:29:54.302552+0000","last_clean":"2024-04-23T18:29:54.302552+0000","last_became_active":"2024-04-23T18:29:11.497953+0000","last_became_peered":"2024-04-23T18:29:11.497953+0000","last_unstale":"2024-04-23T18:29:54.302552+0000","last_undegraded":"2024-04-23T18:29:54.302552+0000","last_fullsized":"2024-04-23T18:29:54.302552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:39:13.562652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549826+0000","last_change":"2024-04-23T18:29:15.507545+0000","last_active":"2024-04-23T18:29:52.549826+0000","last_peered":"2024-04-23T18:29:52.549826+0000","last_clean":"2024-04-23T18:29:52.549826+0000","last_became_active":"2024-04-23T18:29:15.507253+0000","last_became_peered":"2024-04-23T18:29:15.507253+0000","last_unstale":"2024-04-23T18:29:52.549826+0000","last_undegraded":"2024-04-23T18:29:52.549826+0000","last_fullsized":"2024-04-23T18:29:52.549826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:24.598564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.028065+0000","last_change":"2024-04-23T18:29:17.514117+0000","last_active":"2024-04-23T18:31:19.028065+0000","last_peered":"2024-04-23T18:31:19.028065+0000","last_clean":"2024-04-23T18:31:19.028065+0000","last_became_active":"2024-04-23T18:29:17.512820+0000","last_became_peered":"2024-04-23T18:29:17.512820+0000","last_unstale":"2024-04-23T18:31:19.028065+0000","last_undegraded":"2024-04-23T18:31:19.028065+0000","last_fullsized":"2024-04-23T18:31:19.028065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:05.590357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541424+0000","last_change":"2024-04-23T18:29:19.525834+0000","last_active":"2024-04-23T18:29:52.541424+0000","last_peered":"2024-04-23T18:29:52.541424+0000","last_clean":"2024-04-23T18:29:52.541424+0000","last_became_active":"2024-04-23T18:29:19.525424+0000","last_became_peered":"2024-04-23T18:29:19.525424+0000","last_unstale":"2024-04-23T18:29:52.541424+0000","last_undegraded":"2024-04-23T18:29:52.541424+0000","last_fullsized":"2024-04-23T18:29:52.541424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:52.622390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.183703+0000","last_change":"2024-04-23T18:29:13.496471+0000","last_active":"2024-04-23T18:32:21.183703+0000","last_peered":"2024-04-23T18:32:21.183703+0000","last_clean":"2024-04-23T18:32:21.183703+0000","last_became_active":"2024-04-23T18:29:13.496179+0000","last_became_peered":"2024-04-23T18:29:13.496179+0000","last_unstale":"2024-04-23T18:32:21.183703+0000","last_undegraded":"2024-04-23T18:32:21.183703+0000","last_fullsized":"2024-04-23T18:32:21.183703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:31.148672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547581+0000","last_change":"2024-04-23T18:29:11.500546+0000","last_active":"2024-04-23T18:29:52.547581+0000","last_peered":"2024-04-23T18:29:52.547581+0000","last_clean":"2024-04-23T18:29:52.547581+0000","last_became_active":"2024-04-23T18:29:11.500118+0000","last_became_peered":"2024-04-23T18:29:11.500118+0000","last_unstale":"2024-04-23T18:29:52.547581+0000","last_undegraded":"2024-04-23T18:29:52.547581+0000","last_fullsized":"2024-04-23T18:29:52.547581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:46.386426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549417+0000","last_change":"2024-04-23T18:29:15.506605+0000","last_active":"2024-04-23T18:29:52.549417+0000","last_peered":"2024-04-23T18:29:52.549417+0000","last_clean":"2024-04-23T18:29:52.549417+0000","last_became_active":"2024-04-23T18:29:15.506197+0000","last_became_peered":"2024-04-23T18:29:15.506197+0000","last_unstale":"2024-04-23T18:29:52.549417+0000","last_undegraded":"2024-04-23T18:29:52.549417+0000","last_fullsized":"2024-04-23T18:29:52.549417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:23:51.396518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'57","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.049212+0000","last_change":"2024-04-23T18:29:17.515116+0000","last_active":"2024-04-23T18:31:19.049212+0000","last_peered":"2024-04-23T18:31:19.049212+0000","last_clean":"2024-04-23T18:31:19.049212+0000","last_became_active":"2024-04-23T18:29:17.514800+0000","last_became_peered":"2024-04-23T18:29:17.514800+0000","last_unstale":"2024-04-23T18:31:19.049212+0000","last_undegraded":"2024-04-23T18:31:19.049212+0000","last_fullsized":"2024-04-23T18:31:19.049212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:42.936606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542001+0000","last_change":"2024-04-23T18:29:19.524639+0000","last_active":"2024-04-23T18:29:52.542001+0000","last_peered":"2024-04-23T18:29:52.542001+0000","last_clean":"2024-04-23T18:29:52.542001+0000","last_became_active":"2024-04-23T18:29:19.524351+0000","last_became_peered":"2024-04-23T18:29:19.524351+0000","last_unstale":"2024-04-23T18:29:52.542001+0000","last_undegraded":"2024-04-23T18:29:52.542001+0000","last_fullsized":"2024-04-23T18:29:52.542001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:45.448270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.483433+0000","last_change":"2024-04-23T18:29:21.529140+0000","last_active":"2024-04-23T18:31:20.483433+0000","last_peered":"2024-04-23T18:31:20.483433+0000","last_clean":"2024-04-23T18:31:20.483433+0000","last_became_active":"2024-04-23T18:29:21.528819+0000","last_became_peered":"2024-04-23T18:29:21.528819+0000","last_unstale":"2024-04-23T18:31:20.483433+0000","last_undegraded":"2024-04-23T18:31:20.483433+0000","last_fullsized":"2024-04-23T18:31:20.483433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:12.967213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.809775+0000","last_change":"2024-04-23T18:29:13.499526+0000","last_active":"2024-04-23T18:29:54.809775+0000","last_peered":"2024-04-23T18:29:54.809775+0000","last_clean":"2024-04-23T18:29:54.809775+0000","last_became_active":"2024-04-23T18:29:13.499137+0000","last_became_peered":"2024-04-23T18:29:13.499137+0000","last_unstale":"2024-04-23T18:29:54.809775+0000","last_undegraded":"2024-04-23T18:29:54.809775+0000","last_fullsized":"2024-04-23T18:29:54.809775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:09:37.644601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543171+0000","last_change":"2024-04-23T18:29:11.500980+0000","last_active":"2024-04-23T18:29:52.543171+0000","last_peered":"2024-04-23T18:29:52.543171+0000","last_clean":"2024-04-23T18:29:52.543171+0000","last_became_active":"2024-04-23T18:29:11.500584+0000","last_became_peered":"2024-04-23T18:29:11.500584+0000","last_unstale":"2024-04-23T18:29:52.543171+0000","last_undegraded":"2024-04-23T18:29:52.543171+0000","last_fullsized":"2024-04-23T18:29:52.543171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:31.151193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544749+0000","last_change":"2024-04-23T18:29:15.503669+0000","last_active":"2024-04-23T18:29:52.544749+0000","last_peered":"2024-04-23T18:29:52.544749+0000","last_clean":"2024-04-23T18:29:52.544749+0000","last_became_active":"2024-04-23T18:29:15.503315+0000","last_became_peered":"2024-04-23T18:29:15.503315+0000","last_unstale":"2024-04-23T18:29:52.544749+0000","last_undegraded":"2024-04-23T18:29:52.544749+0000","last_fullsized":"2024-04-23T18:29:52.544749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:45.603211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.029019+0000","last_change":"2024-04-23T18:29:17.517217+0000","last_active":"2024-04-23T18:31:19.029019+0000","last_peered":"2024-04-23T18:31:19.029019+0000","last_clean":"2024-04-23T18:31:19.029019+0000","last_became_active":"2024-04-23T18:29:17.516934+0000","last_became_peered":"2024-04-23T18:29:17.516934+0000","last_unstale":"2024-04-23T18:31:19.029019+0000","last_undegraded":"2024-04-23T18:31:19.029019+0000","last_fullsized":"2024-04-23T18:31:19.029019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:47.490248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544700+0000","last_change":"2024-04-23T18:29:19.520167+0000","last_active":"2024-04-23T18:29:52.544700+0000","last_peered":"2024-04-23T18:29:52.544700+0000","last_clean":"2024-04-23T18:29:52.544700+0000","last_became_active":"2024-04-23T18:29:19.519854+0000","last_became_peered":"2024-04-23T18:29:19.519854+0000","last_unstale":"2024-04-23T18:29:52.544700+0000","last_undegraded":"2024-04-23T18:29:52.544700+0000","last_fullsized":"2024-04-23T18:29:52.544700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:49.515308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548061+0000","last_change":"2024-04-23T18:29:21.534768+0000","last_active":"2024-04-23T18:29:52.548061+0000","last_peered":"2024-04-23T18:29:52.548061+0000","last_clean":"2024-04-23T18:29:52.548061+0000","last_became_active":"2024-04-23T18:29:21.534487+0000","last_became_peered":"2024-04-23T18:29:21.534487+0000","last_unstale":"2024-04-23T18:29:52.548061+0000","last_undegraded":"2024-04-23T18:29:52.548061+0000","last_fullsized":"2024-04-23T18:29:52.548061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:32:46.393371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.901371+0000","last_change":"2024-04-23T18:29:13.503374+0000","last_active":"2024-04-23T18:32:20.901371+0000","last_peered":"2024-04-23T18:32:20.901371+0000","last_clean":"2024-04-23T18:32:20.901371+0000","last_became_active":"2024-04-23T18:29:13.502710+0000","last_became_peered":"2024-04-23T18:29:13.502710+0000","last_unstale":"2024-04-23T18:32:20.901371+0000","last_undegraded":"2024-04-23T18:32:20.901371+0000","last_fullsized":"2024-04-23T18:32:20.901371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:02.276254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544043+0000","last_change":"2024-04-23T18:29:11.498320+0000","last_active":"2024-04-23T18:29:52.544043+0000","last_peered":"2024-04-23T18:29:52.544043+0000","last_clean":"2024-04-23T18:29:52.544043+0000","last_became_active":"2024-04-23T18:29:11.497191+0000","last_became_peered":"2024-04-23T18:29:11.497191+0000","last_unstale":"2024-04-23T18:29:52.544043+0000","last_undegraded":"2024-04-23T18:29:52.544043+0000","last_fullsized":"2024-04-23T18:29:52.544043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:55.553919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543117+0000","last_change":"2024-04-23T18:29:15.502215+0000","last_active":"2024-04-23T18:29:52.543117+0000","last_peered":"2024-04-23T18:29:52.543117+0000","last_clean":"2024-04-23T18:29:52.543117+0000","last_became_active":"2024-04-23T18:29:15.501957+0000","last_became_peered":"2024-04-23T18:29:15.501957+0000","last_unstale":"2024-04-23T18:29:52.543117+0000","last_undegraded":"2024-04-23T18:29:52.543117+0000","last_fullsized":"2024-04-23T18:29:52.543117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:16:23.586603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.047239+0000","last_change":"2024-04-23T18:29:17.503422+0000","last_active":"2024-04-23T18:31:19.047239+0000","last_peered":"2024-04-23T18:31:19.047239+0000","last_clean":"2024-04-23T18:31:19.047239+0000","last_became_active":"2024-04-23T18:29:17.503196+0000","last_became_peered":"2024-04-23T18:29:17.503196+0000","last_unstale":"2024-04-23T18:31:19.047239+0000","last_undegraded":"2024-04-23T18:31:19.047239+0000","last_fullsized":"2024-04-23T18:31:19.047239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:30:37.507116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548417+0000","last_change":"2024-04-23T18:29:19.527985+0000","last_active":"2024-04-23T18:29:52.548417+0000","last_peered":"2024-04-23T18:29:52.548417+0000","last_clean":"2024-04-23T18:29:52.548417+0000","last_became_active":"2024-04-23T18:29:19.527687+0000","last_became_peered":"2024-04-23T18:29:19.527687+0000","last_unstale":"2024-04-23T18:29:52.548417+0000","last_undegraded":"2024-04-23T18:29:52.548417+0000","last_fullsized":"2024-04-23T18:29:52.548417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:54.022979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.542239+0000","last_change":"2024-04-23T18:29:21.534054+0000","last_active":"2024-04-23T18:31:20.542239+0000","last_peered":"2024-04-23T18:31:20.542239+0000","last_clean":"2024-04-23T18:31:20.542239+0000","last_became_active":"2024-04-23T18:29:21.533754+0000","last_became_peered":"2024-04-23T18:29:21.533754+0000","last_unstale":"2024-04-23T18:31:20.542239+0000","last_undegraded":"2024-04-23T18:31:20.542239+0000","last_fullsized":"2024-04-23T18:31:20.542239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:23.688720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.902182+0000","last_change":"2024-04-23T18:29:13.497462+0000","last_active":"2024-04-23T18:32:20.902182+0000","last_peered":"2024-04-23T18:32:20.902182+0000","last_clean":"2024-04-23T18:32:20.902182+0000","last_became_active":"2024-04-23T18:29:13.497121+0000","last_became_peered":"2024-04-23T18:29:13.497121+0000","last_unstale":"2024-04-23T18:32:20.902182+0000","last_undegraded":"2024-04-23T18:32:20.902182+0000","last_fullsized":"2024-04-23T18:32:20.902182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:19.423755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.207298+0000","last_change":"2024-04-23T18:29:11.504900+0000","last_active":"2024-04-23T18:29:53.207298+0000","last_peered":"2024-04-23T18:29:53.207298+0000","last_clean":"2024-04-23T18:29:53.207298+0000","last_became_active":"2024-04-23T18:29:11.504564+0000","last_became_peered":"2024-04-23T18:29:11.504564+0000","last_unstale":"2024-04-23T18:29:53.207298+0000","last_undegraded":"2024-04-23T18:29:53.207298+0000","last_fullsized":"2024-04-23T18:29:53.207298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:26.282130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547964+0000","last_change":"2024-04-23T18:29:15.506519+0000","last_active":"2024-04-23T18:29:52.547964+0000","last_peered":"2024-04-23T18:29:52.547964+0000","last_clean":"2024-04-23T18:29:52.547964+0000","last_became_active":"2024-04-23T18:29:15.506171+0000","last_became_peered":"2024-04-23T18:29:15.506171+0000","last_unstale":"2024-04-23T18:29:52.547964+0000","last_undegraded":"2024-04-23T18:29:52.547964+0000","last_fullsized":"2024-04-23T18:29:52.547964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:29:39.313604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552039+0000","last_change":"2024-04-23T18:29:17.517401+0000","last_active":"2024-04-23T18:29:52.552039+0000","last_peered":"2024-04-23T18:29:52.552039+0000","last_clean":"2024-04-23T18:29:52.552039+0000","last_became_active":"2024-04-23T18:29:17.517051+0000","last_became_peered":"2024-04-23T18:29:17.517051+0000","last_unstale":"2024-04-23T18:29:52.552039+0000","last_undegraded":"2024-04-23T18:29:52.552039+0000","last_fullsized":"2024-04-23T18:29:52.552039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:43.608104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":366,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585498+0000","last_change":"2024-04-23T18:29:19.527952+0000","last_active":"2024-04-23T18:32:20.585498+0000","last_peered":"2024-04-23T18:32:20.585498+0000","last_clean":"2024-04-23T18:32:20.585498+0000","last_became_active":"2024-04-23T18:29:19.527614+0000","last_became_peered":"2024-04-23T18:29:19.527614+0000","last_unstale":"2024-04-23T18:32:20.585498+0000","last_undegraded":"2024-04-23T18:32:20.585498+0000","last_fullsized":"2024-04-23T18:32:20.585498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:37.178104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.792678+0000","last_change":"2024-04-23T18:29:21.531583+0000","last_active":"2024-04-23T18:30:36.792678+0000","last_peered":"2024-04-23T18:30:36.792678+0000","last_clean":"2024-04-23T18:30:36.792678+0000","last_became_active":"2024-04-23T18:29:21.530619+0000","last_became_peered":"2024-04-23T18:29:21.530619+0000","last_unstale":"2024-04-23T18:30:36.792678+0000","last_undegraded":"2024-04-23T18:30:36.792678+0000","last_fullsized":"2024-04-23T18:30:36.792678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:02:25.354970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136433+0000","last_change":"2024-04-23T18:29:13.502162+0000","last_active":"2024-04-23T18:32:21.136433+0000","last_peered":"2024-04-23T18:32:21.136433+0000","last_clean":"2024-04-23T18:32:21.136433+0000","last_became_active":"2024-04-23T18:29:13.501741+0000","last_became_peered":"2024-04-23T18:29:13.501741+0000","last_unstale":"2024-04-23T18:32:21.136433+0000","last_undegraded":"2024-04-23T18:32:21.136433+0000","last_fullsized":"2024-04-23T18:32:21.136433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:24.039627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546726+0000","last_change":"2024-04-23T18:29:11.501098+0000","last_active":"2024-04-23T18:29:52.546726+0000","last_peered":"2024-04-23T18:29:52.546726+0000","last_clean":"2024-04-23T18:29:52.546726+0000","last_became_active":"2024-04-23T18:29:11.500781+0000","last_became_peered":"2024-04-23T18:29:11.500781+0000","last_unstale":"2024-04-23T18:29:52.546726+0000","last_undegraded":"2024-04-23T18:29:52.546726+0000","last_fullsized":"2024-04-23T18:29:52.546726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:49.661961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.553840+0000","last_change":"2024-04-23T18:29:52.550289+0000","last_active":"2024-04-23T18:29:52.553840+0000","last_peered":"2024-04-23T18:29:52.553840+0000","last_clean":"2024-04-23T18:29:52.553840+0000","last_became_active":"2024-04-23T18:29:52.549944+0000","last_became_peered":"2024-04-23T18:29:52.549944+0000","last_unstale":"2024-04-23T18:29:52.553840+0000","last_undegraded":"2024-04-23T18:29:52.553840+0000","last_fullsized":"2024-04-23T18:29:52.553840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.212007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.019745+0000","last_change":"2024-04-23T18:29:17.509362+0000","last_active":"2024-04-23T18:31:19.019745+0000","last_peered":"2024-04-23T18:31:19.019745+0000","last_clean":"2024-04-23T18:31:19.019745+0000","last_became_active":"2024-04-23T18:29:17.509076+0000","last_became_peered":"2024-04-23T18:29:17.509076+0000","last_unstale":"2024-04-23T18:31:19.019745+0000","last_undegraded":"2024-04-23T18:31:19.019745+0000","last_fullsized":"2024-04-23T18:31:19.019745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:59.200856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546279+0000","last_change":"2024-04-23T18:29:19.519211+0000","last_active":"2024-04-23T18:29:52.546279+0000","last_peered":"2024-04-23T18:29:52.546279+0000","last_clean":"2024-04-23T18:29:52.546279+0000","last_became_active":"2024-04-23T18:29:19.518673+0000","last_became_peered":"2024-04-23T18:29:19.518673+0000","last_unstale":"2024-04-23T18:29:52.546279+0000","last_undegraded":"2024-04-23T18:29:52.546279+0000","last_fullsized":"2024-04-23T18:29:52.546279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:16:13.613155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548269+0000","last_change":"2024-04-23T18:29:21.533731+0000","last_active":"2024-04-23T18:29:52.548269+0000","last_peered":"2024-04-23T18:29:52.548269+0000","last_clean":"2024-04-23T18:29:52.548269+0000","last_became_active":"2024-04-23T18:29:21.533187+0000","last_became_peered":"2024-04-23T18:29:21.533187+0000","last_unstale":"2024-04-23T18:29:52.548269+0000","last_undegraded":"2024-04-23T18:29:52.548269+0000","last_fullsized":"2024-04-23T18:29:52.548269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:16.140403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216088+0000","last_change":"2024-04-23T18:29:13.502229+0000","last_active":"2024-04-23T18:32:21.216088+0000","last_peered":"2024-04-23T18:32:21.216088+0000","last_clean":"2024-04-23T18:32:21.216088+0000","last_became_active":"2024-04-23T18:29:13.501974+0000","last_became_peered":"2024-04-23T18:29:13.501974+0000","last_unstale":"2024-04-23T18:32:21.216088+0000","last_undegraded":"2024-04-23T18:32:21.216088+0000","last_fullsized":"2024-04-23T18:32:21.216088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:41.117616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552635+0000","last_change":"2024-04-23T18:29:11.511621+0000","last_active":"2024-04-23T18:29:52.552635+0000","last_peered":"2024-04-23T18:29:52.552635+0000","last_clean":"2024-04-23T18:29:52.552635+0000","last_became_active":"2024-04-23T18:29:11.511297+0000","last_became_peered":"2024-04-23T18:29:11.511297+0000","last_unstale":"2024-04-23T18:29:52.552635+0000","last_undegraded":"2024-04-23T18:29:52.552635+0000","last_fullsized":"2024-04-23T18:29:52.552635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:59.862004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543723+0000","last_change":"2024-04-23T18:29:15.504950+0000","last_active":"2024-04-23T18:29:52.543723+0000","last_peered":"2024-04-23T18:29:52.543723+0000","last_clean":"2024-04-23T18:29:52.543723+0000","last_became_active":"2024-04-23T18:29:15.504528+0000","last_became_peered":"2024-04-23T18:29:15.504528+0000","last_unstale":"2024-04-23T18:29:52.543723+0000","last_undegraded":"2024-04-23T18:29:52.543723+0000","last_fullsized":"2024-04-23T18:29:52.543723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:41.352665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.020878+0000","last_change":"2024-04-23T18:29:17.513717+0000","last_active":"2024-04-23T18:31:19.020878+0000","last_peered":"2024-04-23T18:31:19.020878+0000","last_clean":"2024-04-23T18:31:19.020878+0000","last_became_active":"2024-04-23T18:29:17.513482+0000","last_became_peered":"2024-04-23T18:29:17.513482+0000","last_unstale":"2024-04-23T18:31:19.020878+0000","last_undegraded":"2024-04-23T18:31:19.020878+0000","last_fullsized":"2024-04-23T18:31:19.020878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:10:12.070821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549506+0000","last_change":"2024-04-23T18:29:19.526244+0000","last_active":"2024-04-23T18:29:52.549506+0000","last_peered":"2024-04-23T18:29:52.549506+0000","last_clean":"2024-04-23T18:29:52.549506+0000","last_became_active":"2024-04-23T18:29:19.525985+0000","last_became_peered":"2024-04-23T18:29:19.525985+0000","last_unstale":"2024-04-23T18:29:52.549506+0000","last_undegraded":"2024-04-23T18:29:52.549506+0000","last_fullsized":"2024-04-23T18:29:52.549506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:40.734604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551426+0000","last_change":"2024-04-23T18:29:21.528945+0000","last_active":"2024-04-23T18:29:52.551426+0000","last_peered":"2024-04-23T18:29:52.551426+0000","last_clean":"2024-04-23T18:29:52.551426+0000","last_became_active":"2024-04-23T18:29:21.528665+0000","last_became_peered":"2024-04-23T18:29:21.528665+0000","last_unstale":"2024-04-23T18:29:52.551426+0000","last_undegraded":"2024-04-23T18:29:52.551426+0000","last_fullsized":"2024-04-23T18:29:52.551426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:24.076754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.320824+0000","last_change":"2024-04-23T18:29:13.495164+0000","last_active":"2024-04-23T18:29:54.320824+0000","last_peered":"2024-04-23T18:29:54.320824+0000","last_clean":"2024-04-23T18:29:54.320824+0000","last_became_active":"2024-04-23T18:29:13.494647+0000","last_became_peered":"2024-04-23T18:29:13.494647+0000","last_unstale":"2024-04-23T18:29:54.320824+0000","last_undegraded":"2024-04-23T18:29:54.320824+0000","last_fullsized":"2024-04-23T18:29:54.320824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:29.887241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.266338+0000","last_change":"2024-04-23T18:29:11.496011+0000","last_active":"2024-04-23T18:31:17.266338+0000","last_peered":"2024-04-23T18:31:17.266338+0000","last_clean":"2024-04-23T18:31:17.266338+0000","last_became_active":"2024-04-23T18:29:11.495723+0000","last_became_peered":"2024-04-23T18:29:11.495723+0000","last_unstale":"2024-04-23T18:31:17.266338+0000","last_undegraded":"2024-04-23T18:31:17.266338+0000","last_fullsized":"2024-04-23T18:31:17.266338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:36:52.346753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543714+0000","last_change":"2024-04-23T18:29:15.510875+0000","last_active":"2024-04-23T18:29:52.543714+0000","last_peered":"2024-04-23T18:29:52.543714+0000","last_clean":"2024-04-23T18:29:52.543714+0000","last_became_active":"2024-04-23T18:29:15.510185+0000","last_became_peered":"2024-04-23T18:29:15.510185+0000","last_unstale":"2024-04-23T18:29:52.543714+0000","last_undegraded":"2024-04-23T18:29:52.543714+0000","last_fullsized":"2024-04-23T18:29:52.543714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:50.678177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'28","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.764076+0000","last_change":"2024-04-23T18:29:17.517329+0000","last_active":"2024-04-23T18:31:46.764076+0000","last_peered":"2024-04-23T18:31:46.764076+0000","last_clean":"2024-04-23T18:31:46.764076+0000","last_became_active":"2024-04-23T18:29:17.516989+0000","last_became_peered":"2024-04-23T18:29:17.516989+0000","last_unstale":"2024-04-23T18:31:46.764076+0000","last_undegraded":"2024-04-23T18:31:46.764076+0000","last_fullsized":"2024-04-23T18:31:46.764076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:12:42.263147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548315+0000","last_change":"2024-04-23T18:29:19.522484+0000","last_active":"2024-04-23T18:29:52.548315+0000","last_peered":"2024-04-23T18:29:52.548315+0000","last_clean":"2024-04-23T18:29:52.548315+0000","last_became_active":"2024-04-23T18:29:19.522217+0000","last_became_peered":"2024-04-23T18:29:19.522217+0000","last_unstale":"2024-04-23T18:29:52.548315+0000","last_undegraded":"2024-04-23T18:29:52.548315+0000","last_fullsized":"2024-04-23T18:29:52.548315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:36:35.803795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.054923+0000","last_change":"2024-04-23T18:29:21.533465+0000","last_active":"2024-04-23T18:31:19.054923+0000","last_peered":"2024-04-23T18:31:19.054923+0000","last_clean":"2024-04-23T18:31:19.054923+0000","last_became_active":"2024-04-23T18:29:21.533152+0000","last_became_peered":"2024-04-23T18:29:21.533152+0000","last_unstale":"2024-04-23T18:31:19.054923+0000","last_undegraded":"2024-04-23T18:31:19.054923+0000","last_fullsized":"2024-04-23T18:31:19.054923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:29.385592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.183234+0000","last_change":"2024-04-23T18:29:13.502434+0000","last_active":"2024-04-23T18:32:21.183234+0000","last_peered":"2024-04-23T18:32:21.183234+0000","last_clean":"2024-04-23T18:32:21.183234+0000","last_became_active":"2024-04-23T18:29:13.501782+0000","last_became_peered":"2024-04-23T18:29:13.501782+0000","last_unstale":"2024-04-23T18:32:21.183234+0000","last_undegraded":"2024-04-23T18:32:21.183234+0000","last_fullsized":"2024-04-23T18:32:21.183234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:12.786478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:16.758702+0000","last_change":"2024-04-23T18:29:11.501970+0000","last_active":"2024-04-23T18:31:16.758702+0000","last_peered":"2024-04-23T18:31:16.758702+0000","last_clean":"2024-04-23T18:31:16.758702+0000","last_became_active":"2024-04-23T18:29:11.501648+0000","last_became_peered":"2024-04-23T18:29:11.501648+0000","last_unstale":"2024-04-23T18:31:16.758702+0000","last_undegraded":"2024-04-23T18:31:16.758702+0000","last_fullsized":"2024-04-23T18:31:16.758702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:50.092624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.716953+0000","last_change":"2024-04-23T18:29:15.510030+0000","last_active":"2024-04-23T18:31:17.716953+0000","last_peered":"2024-04-23T18:31:17.716953+0000","last_clean":"2024-04-23T18:31:17.716953+0000","last_became_active":"2024-04-23T18:29:15.509725+0000","last_became_peered":"2024-04-23T18:29:15.509725+0000","last_unstale":"2024-04-23T18:31:17.716953+0000","last_undegraded":"2024-04-23T18:31:17.716953+0000","last_fullsized":"2024-04-23T18:31:17.716953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:56:00.300728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.580905+0000","last_change":"2024-04-23T18:29:17.515107+0000","last_active":"2024-04-23T18:32:20.580905+0000","last_peered":"2024-04-23T18:32:20.580905+0000","last_clean":"2024-04-23T18:32:20.580905+0000","last_became_active":"2024-04-23T18:29:17.514823+0000","last_became_peered":"2024-04-23T18:29:17.514823+0000","last_unstale":"2024-04-23T18:32:20.580905+0000","last_undegraded":"2024-04-23T18:32:20.580905+0000","last_fullsized":"2024-04-23T18:32:20.580905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:43:37.286173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547277+0000","last_change":"2024-04-23T18:29:19.519462+0000","last_active":"2024-04-23T18:29:52.547277+0000","last_peered":"2024-04-23T18:29:52.547277+0000","last_clean":"2024-04-23T18:29:52.547277+0000","last_became_active":"2024-04-23T18:29:19.519153+0000","last_became_peered":"2024-04-23T18:29:19.519153+0000","last_unstale":"2024-04-23T18:29:52.547277+0000","last_undegraded":"2024-04-23T18:29:52.547277+0000","last_fullsized":"2024-04-23T18:29:52.547277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:04:43.275499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.001111+0000","last_change":"2024-04-23T18:29:21.529659+0000","last_active":"2024-04-23T18:32:21.001111+0000","last_peered":"2024-04-23T18:32:21.001111+0000","last_clean":"2024-04-23T18:32:21.001111+0000","last_became_active":"2024-04-23T18:29:21.529331+0000","last_became_peered":"2024-04-23T18:29:21.529331+0000","last_unstale":"2024-04-23T18:32:21.001111+0000","last_undegraded":"2024-04-23T18:32:21.001111+0000","last_fullsized":"2024-04-23T18:32:21.001111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:10:52.515811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216418+0000","last_change":"2024-04-23T18:29:52.563032+0000","last_active":"2024-04-23T18:32:21.216418+0000","last_peered":"2024-04-23T18:32:21.216418+0000","last_clean":"2024-04-23T18:32:21.216418+0000","last_became_active":"2024-04-23T18:29:52.551523+0000","last_became_peered":"2024-04-23T18:29:52.551523+0000","last_unstale":"2024-04-23T18:32:21.216418+0000","last_undegraded":"2024-04-23T18:32:21.216418+0000","last_fullsized":"2024-04-23T18:32:21.216418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:09:27.042501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.540500+0000","last_change":"2024-04-23T18:29:11.489634+0000","last_active":"2024-04-23T18:29:52.540500+0000","last_peered":"2024-04-23T18:29:52.540500+0000","last_clean":"2024-04-23T18:29:52.540500+0000","last_became_active":"2024-04-23T18:29:11.489284+0000","last_became_peered":"2024-04-23T18:29:11.489284+0000","last_unstale":"2024-04-23T18:29:52.540500+0000","last_undegraded":"2024-04-23T18:29:52.540500+0000","last_fullsized":"2024-04-23T18:29:52.540500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:52.597685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549214+0000","last_change":"2024-04-23T18:29:13.497247+0000","last_active":"2024-04-23T18:29:52.549214+0000","last_peered":"2024-04-23T18:29:52.549214+0000","last_clean":"2024-04-23T18:29:52.549214+0000","last_became_active":"2024-04-23T18:29:13.496958+0000","last_became_peered":"2024-04-23T18:29:13.496958+0000","last_unstale":"2024-04-23T18:29:52.549214+0000","last_undegraded":"2024-04-23T18:29:52.549214+0000","last_fullsized":"2024-04-23T18:29:52.549214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:19.818744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546441+0000","last_change":"2024-04-23T18:29:11.487639+0000","last_active":"2024-04-23T18:29:52.546441+0000","last_peered":"2024-04-23T18:29:52.546441+0000","last_clean":"2024-04-23T18:29:52.546441+0000","last_became_active":"2024-04-23T18:29:11.486563+0000","last_became_peered":"2024-04-23T18:29:11.486563+0000","last_unstale":"2024-04-23T18:29:52.546441+0000","last_undegraded":"2024-04-23T18:29:52.546441+0000","last_fullsized":"2024-04-23T18:29:52.546441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:59.834673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.182969+0000","last_change":"2024-04-23T18:29:13.494907+0000","last_active":"2024-04-23T18:32:21.182969+0000","last_peered":"2024-04-23T18:32:21.182969+0000","last_clean":"2024-04-23T18:32:21.182969+0000","last_became_active":"2024-04-23T18:29:13.494683+0000","last_became_peered":"2024-04-23T18:29:13.494683+0000","last_unstale":"2024-04-23T18:32:21.182969+0000","last_undegraded":"2024-04-23T18:32:21.182969+0000","last_fullsized":"2024-04-23T18:32:21.182969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:39.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:16.759681+0000","last_change":"2024-04-23T18:29:11.511297+0000","last_active":"2024-04-23T18:31:16.759681+0000","last_peered":"2024-04-23T18:31:16.759681+0000","last_clean":"2024-04-23T18:31:16.759681+0000","last_became_active":"2024-04-23T18:29:11.510971+0000","last_became_peered":"2024-04-23T18:29:11.510971+0000","last_unstale":"2024-04-23T18:31:16.759681+0000","last_undegraded":"2024-04-23T18:31:16.759681+0000","last_fullsized":"2024-04-23T18:31:16.759681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:10.779475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278308+0000","last_change":"2024-04-23T18:29:13.497387+0000","last_active":"2024-04-23T18:31:17.278308+0000","last_peered":"2024-04-23T18:31:17.278308+0000","last_clean":"2024-04-23T18:31:17.278308+0000","last_became_active":"2024-04-23T18:29:13.497094+0000","last_became_peered":"2024-04-23T18:29:13.497094+0000","last_unstale":"2024-04-23T18:31:17.278308+0000","last_undegraded":"2024-04-23T18:31:17.278308+0000","last_fullsized":"2024-04-23T18:31:17.278308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:46:30.444504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547921+0000","last_change":"2024-04-23T18:29:11.492610+0000","last_active":"2024-04-23T18:29:52.547921+0000","last_peered":"2024-04-23T18:29:52.547921+0000","last_clean":"2024-04-23T18:29:52.547921+0000","last_became_active":"2024-04-23T18:29:11.492064+0000","last_became_peered":"2024-04-23T18:29:11.492064+0000","last_unstale":"2024-04-23T18:29:52.547921+0000","last_undegraded":"2024-04-23T18:29:52.547921+0000","last_fullsized":"2024-04-23T18:29:52.547921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:53.075916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998383+0000","last_change":"2024-04-23T18:29:13.502885+0000","last_active":"2024-04-23T18:32:20.998383+0000","last_peered":"2024-04-23T18:32:20.998383+0000","last_clean":"2024-04-23T18:32:20.998383+0000","last_became_active":"2024-04-23T18:29:13.502243+0000","last_became_peered":"2024-04-23T18:29:13.502243+0000","last_unstale":"2024-04-23T18:32:20.998383+0000","last_undegraded":"2024-04-23T18:32:20.998383+0000","last_fullsized":"2024-04-23T18:32:20.998383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:03:43.333220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548416+0000","last_change":"2024-04-23T18:29:11.486754+0000","last_active":"2024-04-23T18:29:52.548416+0000","last_peered":"2024-04-23T18:29:52.548416+0000","last_clean":"2024-04-23T18:29:52.548416+0000","last_became_active":"2024-04-23T18:29:11.486452+0000","last_became_peered":"2024-04-23T18:29:11.486452+0000","last_unstale":"2024-04-23T18:29:52.548416+0000","last_undegraded":"2024-04-23T18:29:52.548416+0000","last_fullsized":"2024-04-23T18:29:52.548416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:15.136106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185774+0000","last_change":"2024-04-23T18:29:13.507893+0000","last_active":"2024-04-23T18:32:21.185774+0000","last_peered":"2024-04-23T18:32:21.185774+0000","last_clean":"2024-04-23T18:32:21.185774+0000","last_became_active":"2024-04-23T18:29:13.507582+0000","last_became_peered":"2024-04-23T18:29:13.507582+0000","last_unstale":"2024-04-23T18:32:21.185774+0000","last_undegraded":"2024-04-23T18:32:21.185774+0000","last_fullsized":"2024-04-23T18:32:21.185774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:50.962263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544908+0000","last_change":"2024-04-23T18:29:11.495366+0000","last_active":"2024-04-23T18:29:52.544908+0000","last_peered":"2024-04-23T18:29:52.544908+0000","last_clean":"2024-04-23T18:29:52.544908+0000","last_became_active":"2024-04-23T18:29:11.493318+0000","last_became_peered":"2024-04-23T18:29:11.493318+0000","last_unstale":"2024-04-23T18:29:52.544908+0000","last_undegraded":"2024-04-23T18:29:52.544908+0000","last_fullsized":"2024-04-23T18:29:52.544908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:47:48.291376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'22","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136764+0000","last_change":"2024-04-23T18:29:13.499537+0000","last_active":"2024-04-23T18:32:21.136764+0000","last_peered":"2024-04-23T18:32:21.136764+0000","last_clean":"2024-04-23T18:32:21.136764+0000","last_became_active":"2024-04-23T18:29:13.499155+0000","last_became_peered":"2024-04-23T18:29:13.499155+0000","last_unstale":"2024-04-23T18:32:21.136764+0000","last_undegraded":"2024-04-23T18:32:21.136764+0000","last_fullsized":"2024-04-23T18:32:21.136764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:10:40.469094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544921+0000","last_change":"2024-04-23T18:29:11.486471+0000","last_active":"2024-04-23T18:29:52.544921+0000","last_peered":"2024-04-23T18:29:52.544921+0000","last_clean":"2024-04-23T18:29:52.544921+0000","last_became_active":"2024-04-23T18:29:11.485201+0000","last_became_peered":"2024-04-23T18:29:11.485201+0000","last_unstale":"2024-04-23T18:29:52.544921+0000","last_undegraded":"2024-04-23T18:29:52.544921+0000","last_fullsized":"2024-04-23T18:29:52.544921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:34.195698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.902933+0000","last_change":"2024-04-23T18:29:13.497344+0000","last_active":"2024-04-23T18:32:20.902933+0000","last_peered":"2024-04-23T18:32:20.902933+0000","last_clean":"2024-04-23T18:32:20.902933+0000","last_became_active":"2024-04-23T18:29:13.495654+0000","last_became_peered":"2024-04-23T18:29:13.495654+0000","last_unstale":"2024-04-23T18:32:20.902933+0000","last_undegraded":"2024-04-23T18:32:20.902933+0000","last_fullsized":"2024-04-23T18:32:20.902933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:15.838895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549092+0000","last_change":"2024-04-23T18:29:11.495685+0000","last_active":"2024-04-23T18:29:52.549092+0000","last_peered":"2024-04-23T18:29:52.549092+0000","last_clean":"2024-04-23T18:29:52.549092+0000","last_became_active":"2024-04-23T18:29:11.495224+0000","last_became_peered":"2024-04-23T18:29:11.495224+0000","last_unstale":"2024-04-23T18:29:52.549092+0000","last_undegraded":"2024-04-23T18:29:52.549092+0000","last_fullsized":"2024-04-23T18:29:52.549092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:44.033653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185125+0000","last_change":"2024-04-23T18:29:13.498009+0000","last_active":"2024-04-23T18:32:21.185125+0000","last_peered":"2024-04-23T18:32:21.185125+0000","last_clean":"2024-04-23T18:32:21.185125+0000","last_became_active":"2024-04-23T18:29:13.497588+0000","last_became_peered":"2024-04-23T18:29:13.497588+0000","last_unstale":"2024-04-23T18:32:21.185125+0000","last_undegraded":"2024-04-23T18:32:21.185125+0000","last_fullsized":"2024-04-23T18:32:21.185125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:34.172125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.299467+0000","last_change":"2024-04-23T18:29:11.496267+0000","last_active":"2024-04-23T18:29:54.299467+0000","last_peered":"2024-04-23T18:29:54.299467+0000","last_clean":"2024-04-23T18:29:54.299467+0000","last_became_active":"2024-04-23T18:29:11.495948+0000","last_became_peered":"2024-04-23T18:29:11.495948+0000","last_unstale":"2024-04-23T18:29:54.299467+0000","last_undegraded":"2024-04-23T18:29:54.299467+0000","last_fullsized":"2024-04-23T18:29:54.299467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:25:25.829104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278306+0000","last_change":"2024-04-23T18:29:13.501113+0000","last_active":"2024-04-23T18:31:17.278306+0000","last_peered":"2024-04-23T18:31:17.278306+0000","last_clean":"2024-04-23T18:31:17.278306+0000","last_became_active":"2024-04-23T18:29:13.500819+0000","last_became_peered":"2024-04-23T18:29:13.500819+0000","last_unstale":"2024-04-23T18:31:17.278306+0000","last_undegraded":"2024-04-23T18:31:17.278306+0000","last_fullsized":"2024-04-23T18:31:17.278306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:49.776673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546657+0000","last_change":"2024-04-23T18:29:11.493307+0000","last_active":"2024-04-23T18:29:52.546657+0000","last_peered":"2024-04-23T18:29:52.546657+0000","last_clean":"2024-04-23T18:29:52.546657+0000","last_became_active":"2024-04-23T18:29:11.492727+0000","last_became_peered":"2024-04-23T18:29:11.492727+0000","last_unstale":"2024-04-23T18:29:52.546657+0000","last_undegraded":"2024-04-23T18:29:52.546657+0000","last_fullsized":"2024-04-23T18:29:52.546657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:00.435842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216435+0000","last_change":"2024-04-23T18:29:13.503226+0000","last_active":"2024-04-23T18:32:21.216435+0000","last_peered":"2024-04-23T18:32:21.216435+0000","last_clean":"2024-04-23T18:32:21.216435+0000","last_became_active":"2024-04-23T18:29:13.502835+0000","last_became_peered":"2024-04-23T18:29:13.502835+0000","last_unstale":"2024-04-23T18:32:21.216435+0000","last_undegraded":"2024-04-23T18:32:21.216435+0000","last_fullsized":"2024-04-23T18:32:21.216435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:52.502192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.116559+0000","last_change":"2024-04-23T18:29:11.500172+0000","last_active":"2024-04-23T18:32:21.116559+0000","last_peered":"2024-04-23T18:32:21.116559+0000","last_clean":"2024-04-23T18:32:21.116559+0000","last_became_active":"2024-04-23T18:29:11.498708+0000","last_became_peered":"2024-04-23T18:29:11.498708+0000","last_unstale":"2024-04-23T18:32:21.116559+0000","last_undegraded":"2024-04-23T18:32:21.116559+0000","last_fullsized":"2024-04-23T18:32:21.116559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:30.568409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998106+0000","last_change":"2024-04-23T18:29:13.494415+0000","last_active":"2024-04-23T18:32:20.998106+0000","last_peered":"2024-04-23T18:32:20.998106+0000","last_clean":"2024-04-23T18:32:20.998106+0000","last_became_active":"2024-04-23T18:29:13.494121+0000","last_became_peered":"2024-04-23T18:29:13.494121+0000","last_unstale":"2024-04-23T18:32:20.998106+0000","last_undegraded":"2024-04-23T18:32:20.998106+0000","last_fullsized":"2024-04-23T18:32:20.998106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:53.187803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.785091+0000","last_change":"2024-04-23T18:29:11.490442+0000","last_active":"2024-04-23T18:30:36.785091+0000","last_peered":"2024-04-23T18:30:36.785091+0000","last_clean":"2024-04-23T18:30:36.785091+0000","last_became_active":"2024-04-23T18:29:11.489671+0000","last_became_peered":"2024-04-23T18:29:11.489671+0000","last_unstale":"2024-04-23T18:30:36.785091+0000","last_undegraded":"2024-04-23T18:30:36.785091+0000","last_fullsized":"2024-04-23T18:30:36.785091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:36.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185209+0000","last_change":"2024-04-23T18:29:13.507705+0000","last_active":"2024-04-23T18:32:21.185209+0000","last_peered":"2024-04-23T18:32:21.185209+0000","last_clean":"2024-04-23T18:32:21.185209+0000","last_became_active":"2024-04-23T18:29:13.507438+0000","last_became_peered":"2024-04-23T18:29:13.507438+0000","last_unstale":"2024-04-23T18:32:21.185209+0000","last_undegraded":"2024-04-23T18:32:21.185209+0000","last_fullsized":"2024-04-23T18:32:21.185209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:21.755001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.761106+0000","last_change":"2024-04-23T18:29:11.511457+0000","last_active":"2024-04-23T18:31:26.761106+0000","last_peered":"2024-04-23T18:31:26.761106+0000","last_clean":"2024-04-23T18:31:26.761106+0000","last_became_active":"2024-04-23T18:29:11.510882+0000","last_became_peered":"2024-04-23T18:29:11.510882+0000","last_unstale":"2024-04-23T18:31:26.761106+0000","last_undegraded":"2024-04-23T18:31:26.761106+0000","last_fullsized":"2024-04-23T18:31:26.761106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:53:49.753580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.183468+0000","last_change":"2024-04-23T18:29:13.497528+0000","last_active":"2024-04-23T18:32:21.183468+0000","last_peered":"2024-04-23T18:32:21.183468+0000","last_clean":"2024-04-23T18:32:21.183468+0000","last_became_active":"2024-04-23T18:29:13.497271+0000","last_became_peered":"2024-04-23T18:29:13.497271+0000","last_unstale":"2024-04-23T18:32:21.183468+0000","last_undegraded":"2024-04-23T18:32:21.183468+0000","last_fullsized":"2024-04-23T18:32:21.183468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:16:21.578410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552824+0000","last_change":"2024-04-23T18:29:11.507084+0000","last_active":"2024-04-23T18:29:52.552824+0000","last_peered":"2024-04-23T18:29:52.552824+0000","last_clean":"2024-04-23T18:29:52.552824+0000","last_became_active":"2024-04-23T18:29:11.506749+0000","last_became_peered":"2024-04-23T18:29:11.506749+0000","last_unstale":"2024-04-23T18:29:52.552824+0000","last_undegraded":"2024-04-23T18:29:52.552824+0000","last_fullsized":"2024-04-23T18:29:52.552824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:56.973382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278854+0000","last_change":"2024-04-23T18:29:13.501439+0000","last_active":"2024-04-23T18:31:17.278854+0000","last_peered":"2024-04-23T18:31:17.278854+0000","last_clean":"2024-04-23T18:31:17.278854+0000","last_became_active":"2024-04-23T18:29:13.501177+0000","last_became_peered":"2024-04-23T18:29:13.501177+0000","last_unstale":"2024-04-23T18:31:17.278854+0000","last_undegraded":"2024-04-23T18:31:17.278854+0000","last_fullsized":"2024-04-23T18:31:17.278854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:34.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760399+0000","last_change":"2024-04-23T18:29:11.485837+0000","last_active":"2024-04-23T18:31:31.760399+0000","last_peered":"2024-04-23T18:31:31.760399+0000","last_clean":"2024-04-23T18:31:31.760399+0000","last_became_active":"2024-04-23T18:29:11.484137+0000","last_became_peered":"2024-04-23T18:29:11.484137+0000","last_unstale":"2024-04-23T18:31:31.760399+0000","last_undegraded":"2024-04-23T18:31:31.760399+0000","last_fullsized":"2024-04-23T18:31:31.760399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:31.151193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.615235+0000","last_change":"2024-04-23T18:29:13.498423+0000","last_active":"2024-04-23T18:30:36.615235+0000","last_peered":"2024-04-23T18:30:36.615235+0000","last_clean":"2024-04-23T18:30:36.615235+0000","last_became_active":"2024-04-23T18:29:13.494034+0000","last_became_peered":"2024-04-23T18:29:13.494034+0000","last_unstale":"2024-04-23T18:30:36.615235+0000","last_undegraded":"2024-04-23T18:30:36.615235+0000","last_fullsized":"2024-04-23T18:30:36.615235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:54.917516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552128+0000","last_change":"2024-04-23T18:29:11.507132+0000","last_active":"2024-04-23T18:29:52.552128+0000","last_peered":"2024-04-23T18:29:52.552128+0000","last_clean":"2024-04-23T18:29:52.552128+0000","last_became_active":"2024-04-23T18:29:11.506801+0000","last_became_peered":"2024-04-23T18:29:11.506801+0000","last_unstale":"2024-04-23T18:29:52.552128+0000","last_undegraded":"2024-04-23T18:29:52.552128+0000","last_fullsized":"2024-04-23T18:29:52.552128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.831893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549216+0000","last_change":"2024-04-23T18:29:11.495271+0000","last_active":"2024-04-23T18:29:52.549216+0000","last_peered":"2024-04-23T18:29:52.549216+0000","last_clean":"2024-04-23T18:29:52.549216+0000","last_became_active":"2024-04-23T18:29:11.494891+0000","last_became_peered":"2024-04-23T18:29:11.494891+0000","last_unstale":"2024-04-23T18:29:52.549216+0000","last_undegraded":"2024-04-23T18:29:52.549216+0000","last_fullsized":"2024-04-23T18:29:52.549216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:22:00.867668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759697+0000","last_change":"2024-04-23T18:29:13.495173+0000","last_active":"2024-04-23T18:31:39.759697+0000","last_peered":"2024-04-23T18:31:39.759697+0000","last_clean":"2024-04-23T18:31:39.759697+0000","last_became_active":"2024-04-23T18:29:13.494850+0000","last_became_peered":"2024-04-23T18:29:13.494850+0000","last_unstale":"2024-04-23T18:31:39.759697+0000","last_undegraded":"2024-04-23T18:31:39.759697+0000","last_fullsized":"2024-04-23T18:31:39.759697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:34:01.705044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.122702+0000","last_change":"2024-04-23T18:29:11.495720+0000","last_active":"2024-04-23T18:32:21.122702+0000","last_peered":"2024-04-23T18:32:21.122702+0000","last_clean":"2024-04-23T18:32:21.122702+0000","last_became_active":"2024-04-23T18:29:11.495173+0000","last_became_peered":"2024-04-23T18:29:11.495173+0000","last_unstale":"2024-04-23T18:32:21.122702+0000","last_undegraded":"2024-04-23T18:32:21.122702+0000","last_fullsized":"2024-04-23T18:32:21.122702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:25:10.587855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.762456+0000","last_change":"2024-04-23T18:29:13.506361+0000","last_active":"2024-04-23T18:31:41.762456+0000","last_peered":"2024-04-23T18:31:41.762456+0000","last_clean":"2024-04-23T18:31:41.762456+0000","last_became_active":"2024-04-23T18:29:13.506122+0000","last_became_peered":"2024-04-23T18:29:13.506122+0000","last_unstale":"2024-04-23T18:31:41.762456+0000","last_undegraded":"2024-04-23T18:31:41.762456+0000","last_fullsized":"2024-04-23T18:31:41.762456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:28.025600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1604,"num_read_kb":1494,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640302,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48416,"kb_used_data":13080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323424,"statfs":{"total":96636764160,"available":96587186176,"internally_reserved":0,"allocated":13393920,"data_stored":13058939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44520,"kb_used_data":9184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327320,"statfs":{"total":96636764160,"available":96591175680,"internally_reserved":0,"allocated":9404416,"data_stored":9128922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42808,"kb_used_data":7472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329032,"statfs":{"total":96636764160,"available":96592928768,"internally_reserved":0,"allocated":7651328,"data_stored":7353289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50484,"kb_used_data":10988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321356,"statfs":{"total":96636764160,"available":96585068544,"internally_reserved":0,"allocated":11251712,"data_stored":10958282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:32:28.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T18:32:29.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.128+0000 7ff69618f640 1 Processor -- start 2024-04-23T18:32:29.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.128+0000 7ff69618f640 1 -- start start 2024-04-23T18:32:29.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.129+0000 7ff69618f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff69012ea70 0x7ff69012f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:29.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.129+0000 7ff69618f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69006e5a0 con 0x7ff69012b4f0 2024-04-23T18:32:29.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.129+0000 7ff69618f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ff690098cc0 con 0x7ff69012ea70 2024-04-23T18:32:29.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.129+0000 7ff68f7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff69012ea70 0x7ff69012f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:29.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.129+0000 7ff68effd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff69012b4f0 0x7ff69012b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41610/0 (socket says 172.21.15.62:41610) 2024-04-23T18:32:29.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.129+0000 7ff68effd640 1 -- 172.21.15.62:0/1500063255 learned_addr learned my addr 172.21.15.62:0/1500063255 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:29.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.129+0000 7ff68f7fe640 1 -- 172.21.15.62:0/1500063255 >> v1:172.21.15.62:6789/0 conn(0x7ff69012b4f0 legacy=0x7ff69012b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:29.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.129+0000 7ff68f7fe640 1 -- 172.21.15.62:0/1500063255 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6900989d0 con 0x7ff69012ea70 2024-04-23T18:32:29.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.130+0000 7ff68f7fe640 1 --2- 172.21.15.62:0/1500063255 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff69012ea70 0x7ff69012f270 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff678009720 tx=0x7ff67802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50ae32c07688953 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:29.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.130+0000 7ff68e7fc640 1 -- 172.21.15.62:0/1500063255 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff678035020 con 0x7ff69012ea70 2024-04-23T18:32:29.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.130+0000 7ff68e7fc640 1 -- 172.21.15.62:0/1500063255 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff678031760 con 0x7ff69012ea70 2024-04-23T18:32:29.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.130+0000 7ff68e7fc640 1 -- 172.21.15.62:0/1500063255 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff678031a60 con 0x7ff69012ea70 2024-04-23T18:32:29.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.131+0000 7ff69618f640 1 -- 172.21.15.62:0/1500063255 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff69012ea70 msgr2=0x7ff69012f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:29.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.131+0000 7ff69618f640 1 --2- 172.21.15.62:0/1500063255 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff69012ea70 0x7ff69012f270 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff678009720 tx=0x7ff67802b8d0 comp rx=0 tx=0).stop 2024-04-23T18:32:29.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.131+0000 7ff69618f640 1 -- 172.21.15.62:0/1500063255 shutdown_connections 2024-04-23T18:32:29.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.131+0000 7ff69618f640 1 --2- 172.21.15.62:0/1500063255 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff69012ea70 0x7ff69012f270 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:29.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.131+0000 7ff69618f640 1 -- 172.21.15.62:0/1500063255 >> 172.21.15.62:0/1500063255 conn(0x7ff6900a1000 msgr2=0x7ff6900a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:29.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.131+0000 7ff69618f640 1 -- 172.21.15.62:0/1500063255 shutdown_connections 2024-04-23T18:32:29.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.131+0000 7ff69618f640 1 -- 172.21.15.62:0/1500063255 wait complete. 2024-04-23T18:32:29.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.131+0000 7ff69618f640 1 Processor -- start 2024-04-23T18:32:29.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.132+0000 7ff69618f640 1 -- start start 2024-04-23T18:32:29.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.132+0000 7ff69618f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff69012b4f0 0x7ff69008b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:29.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.132+0000 7ff69618f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff69012f930 con 0x7ff69012b4f0 2024-04-23T18:32:29.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.132+0000 7ff68f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff69012b4f0 0x7ff69008b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:29.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.132+0000 7ff68f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff69012b4f0 0x7ff69008b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42242/0 (socket says 172.21.15.62:42242) 2024-04-23T18:32:29.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.132+0000 7ff68f7fe640 1 -- 172.21.15.62:0/243208780 learned_addr learned my addr 172.21.15.62:0/243208780 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:29.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.132+0000 7ff68f7fe640 1 -- 172.21.15.62:0/243208780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69008d6c0 con 0x7ff69012b4f0 2024-04-23T18:32:29.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.133+0000 7ff68f7fe640 1 --2- 172.21.15.62:0/243208780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff69012b4f0 0x7ff69008b910 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ff678009720 tx=0x7ff6780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:29.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.133+0000 7ff687fff640 1 -- 172.21.15.62:0/243208780 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff67803be40 con 0x7ff69012b4f0 2024-04-23T18:32:29.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.133+0000 7ff687fff640 1 -- 172.21.15.62:0/243208780 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6780453f0 con 0x7ff69012b4f0 2024-04-23T18:32:29.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.133+0000 7ff69618f640 1 -- 172.21.15.62:0/243208780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69009a2e0 con 0x7ff69012b4f0 2024-04-23T18:32:29.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.133+0000 7ff687fff640 1 -- 172.21.15.62:0/243208780 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6780456f0 con 0x7ff69012b4f0 2024-04-23T18:32:29.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.133+0000 7ff69618f640 1 -- 172.21.15.62:0/243208780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff69008e350 con 0x7ff69012b4f0 2024-04-23T18:32:29.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.134+0000 7ff687fff640 1 -- 172.21.15.62:0/243208780 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff67804c060 con 0x7ff69012b4f0 2024-04-23T18:32:29.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.134+0000 7ff69618f640 1 -- 172.21.15.62:0/243208780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69008d220 con 0x7ff69012b4f0 2024-04-23T18:32:29.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.134+0000 7ff687fff640 1 --2- 172.21.15.62:0/243208780 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff6700385c0 0x7ff67003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:29.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.134+0000 7ff687fff640 1 -- 172.21.15.62:0/243208780 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7ff67806e1c0 con 0x7ff69012b4f0 2024-04-23T18:32:29.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.134+0000 7ff68effd640 1 --2- 172.21.15.62:0/243208780 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff6700385c0 0x7ff67003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:29.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.135+0000 7ff68effd640 1 --2- 172.21.15.62:0/243208780 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff6700385c0 0x7ff67003aa80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff680000f60 tx=0x7ff680007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:29.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.139+0000 7ff687fff640 1 -- 172.21.15.62:0/243208780 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff678040070 con 0x7ff69012b4f0 2024-04-23T18:32:29.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-23T18:32:29.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.323+0000 7ff69618f640 1 -- 172.21.15.62:0/243208780 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6900505b0 con 0x7ff69012b4f0 2024-04-23T18:32:29.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.325+0000 7ff687fff640 1 -- 172.21.15.62:0/243208780 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+20974 (secure 0 0 0) 0x7ff6780393b0 con 0x7ff69012b4f0 2024-04-23T18:32:29.317 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:32:29.317 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":34,"fsid":"7bde1cd1-e3f4-4fcb-8bbb-8f7edde199b6","created":"2024-04-23T18:28:46.460262+0000","modified":"2024-04-23T18:29:52.537194+0000","last_up_change":"2024-04-23T18:28:56.409542+0000","last_in_change":"2024-04-23T18:28:47.543459+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T18:28:56.697816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T18:29:02.075590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-23T18:29:09.468361+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-23T18:29:11.792050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-23T18:29:13.745938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-23T18:29:15.575428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-23T18:29:17.521252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-23T18:29:19.594077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"09209063-cd8c-480c-aee7-4c548f693d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6801","nonce":2641588406}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6803","nonce":2641588406}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6807","nonce":2641588406}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":2641588406},{"type":"v1","addr":"172.21.15.62:6805","nonce":2641588406}]},"public_addr":"172.21.15.62:6801/2641588406","cluster_addr":"172.21.15.62:6803/2641588406","heartbeat_back_addr":"172.21.15.62:6807/2641588406","heartbeat_front_addr":"172.21.15.62:6805/2641588406","state":["exists","up"]},{"osd":1,"uuid":"cebd6eb1-aa92-4110-8388-1bbcdc3915f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6810","nonce":2736386629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6814","nonce":2736386629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6822","nonce":2736386629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":2736386629},{"type":"v1","addr":"172.21.15.119:6818","nonce":2736386629}]},"public_addr":"172.21.15.119:6810/2736386629","cluster_addr":"172.21.15.119:6814/2736386629","heartbeat_back_addr":"172.21.15.119:6822/2736386629","heartbeat_front_addr":"172.21.15.119:6818/2736386629","state":["exists","up"]},{"osd":2,"uuid":"4970a460-2342-49bc-8c74-902633fa8a4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6801","nonce":2624052101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6803","nonce":2624052101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6807","nonce":2624052101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2624052101},{"type":"v1","addr":"172.21.15.119:6805","nonce":2624052101}]},"public_addr":"172.21.15.119:6801/2624052101","cluster_addr":"172.21.15.119:6803/2624052101","heartbeat_back_addr":"172.21.15.119:6807/2624052101","heartbeat_front_addr":"172.21.15.119:6805/2624052101","state":["exists","up"]},{"osd":3,"uuid":"eae08f42-0b0e-4a3c-8720-34a38fbd5de0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6809","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6811","nonce":3910610681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6813","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6815","nonce":3910610681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6823","nonce":3910610681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6817","nonce":3910610681},{"type":"v1","addr":"172.21.15.119:6819","nonce":3910610681}]},"public_addr":"172.21.15.119:6811/3910610681","cluster_addr":"172.21.15.119:6815/3910610681","heartbeat_back_addr":"172.21.15.119:6823/3910610681","heartbeat_front_addr":"172.21.15.119:6819/3910610681","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.607829+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.773992+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.768859+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T18:28:52.775730+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]},{"pgid":"5.3","mappings":[{"from":0,"to":2}]},{"pgid":"5.6","mappings":[{"from":0,"to":1}]},{"pgid":"5.1a","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T18:32:29.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.327+0000 7ff69618f640 1 -- 172.21.15.62:0/243208780 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff6700385c0 msgr2=0x7ff67003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:29.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.327+0000 7ff69618f640 1 --2- 172.21.15.62:0/243208780 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff6700385c0 0x7ff67003aa80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff680000f60 tx=0x7ff680007a80 comp rx=0 tx=0).stop 2024-04-23T18:32:29.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.327+0000 7ff69618f640 1 -- 172.21.15.62:0/243208780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff69012b4f0 msgr2=0x7ff69008b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:29.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.327+0000 7ff69618f640 1 --2- 172.21.15.62:0/243208780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff69012b4f0 0x7ff69008b910 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ff678009720 tx=0x7ff6780046c0 comp rx=0 tx=0).stop 2024-04-23T18:32:29.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.327+0000 7ff69618f640 1 -- 172.21.15.62:0/243208780 shutdown_connections 2024-04-23T18:32:29.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.327+0000 7ff69618f640 1 --2- 172.21.15.62:0/243208780 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff6700385c0 0x7ff67003aa80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:29.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.327+0000 7ff69618f640 1 --2- 172.21.15.62:0/243208780 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff69012b4f0 0x7ff69008b910 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:29.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.327+0000 7ff69618f640 1 -- 172.21.15.62:0/243208780 >> 172.21.15.62:0/243208780 conn(0x7ff6900a1000 msgr2=0x7ff69006cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:29.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.327+0000 7ff69618f640 1 -- 172.21.15.62:0/243208780 shutdown_connections 2024-04-23T18:32:29.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:29.327+0000 7ff69618f640 1 -- 172.21.15.62:0/243208780 wait complete. 2024-04-23T18:32:30.331 INFO:tasks.ceph:Scrubbing osd.0 2024-04-23T18:32:30.331 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-23T18:32:30.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.456+0000 7f38a2648640 1 Processor -- start 2024-04-23T18:32:30.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.456+0000 7f38a2648640 1 -- start start 2024-04-23T18:32:30.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.456+0000 7f38a2648640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f389c12bb70 0x7f389c12bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:30.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.456+0000 7f38a2648640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f389c06d950 con 0x7f389c095f00 2024-04-23T18:32:30.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.456+0000 7f38a2648640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f389c06e290 con 0x7f389c12bb70 2024-04-23T18:32:30.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.456+0000 7f389bfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f389c12bb70 0x7f389c12bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:30.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.456+0000 7f389b7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f389c095f00 0x7f389c096370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41616/0 (socket says 172.21.15.62:41616) 2024-04-23T18:32:30.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.456+0000 7f389b7fe640 1 -- 172.21.15.62:0/1286975669 learned_addr learned my addr 172.21.15.62:0/1286975669 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:30.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.457+0000 7f389bfff640 1 -- 172.21.15.62:0/1286975669 >> v1:172.21.15.62:6789/0 conn(0x7f389c095f00 legacy=0x7f389c096370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.457+0000 7f389affd640 1 -- 172.21.15.62:0/1286975669 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3658203049 0 0) 0x7f389c06d950 con 0x7f389c095f00 2024-04-23T18:32:30.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.457+0000 7f389bfff640 1 -- 172.21.15.62:0/1286975669 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c12b740 con 0x7f389c12bb70 2024-04-23T18:32:30.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.457+0000 7f389bfff640 1 --2- 172.21.15.62:0/1286975669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f389c12bb70 0x7f389c12bf50 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f388c009720 tx=0x7f388c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4690bfebf80e8d33 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.458+0000 7f389affd640 1 -- 172.21.15.62:0/1286975669 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f388c0316d0 con 0x7f389c12bb70 2024-04-23T18:32:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.458+0000 7f389affd640 1 -- 172.21.15.62:0/1286975669 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388c037070 con 0x7f389c12bb70 2024-04-23T18:32:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.458+0000 7f389affd640 1 -- 172.21.15.62:0/1286975669 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f388c0319c0 con 0x7f389c12bb70 2024-04-23T18:32:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.458+0000 7f38a2648640 1 -- 172.21.15.62:0/1286975669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f389c12bb70 msgr2=0x7f389c12bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.458+0000 7f38a2648640 1 --2- 172.21.15.62:0/1286975669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f389c12bb70 0x7f389c12bf50 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f388c009720 tx=0x7f388c02b840 comp rx=0 tx=0).stop 2024-04-23T18:32:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.458+0000 7f38a2648640 1 -- 172.21.15.62:0/1286975669 shutdown_connections 2024-04-23T18:32:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.458+0000 7f38a2648640 1 --2- 172.21.15.62:0/1286975669 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f389c12bb70 0x7f389c12bf50 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.458+0000 7f38a2648640 1 -- 172.21.15.62:0/1286975669 >> 172.21.15.62:0/1286975669 conn(0x7f389c09aef0 msgr2=0x7f389c09b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.458+0000 7f38a2648640 1 -- 172.21.15.62:0/1286975669 shutdown_connections 2024-04-23T18:32:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.458+0000 7f38a2648640 1 -- 172.21.15.62:0/1286975669 wait complete. 2024-04-23T18:32:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.459+0000 7f38a2648640 1 Processor -- start 2024-04-23T18:32:30.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.459+0000 7f38a2648640 1 -- start start 2024-04-23T18:32:30.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.460+0000 7f38a2648640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f389c095f00 0x7f389c123ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.460+0000 7f38a2648640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f389c12c490 con 0x7f389c095f00 2024-04-23T18:32:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.460+0000 7f389bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f389c095f00 0x7f389c123ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.460+0000 7f389bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f389c095f00 0x7f389c123ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42272/0 (socket says 172.21.15.62:42272) 2024-04-23T18:32:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.460+0000 7f389bfff640 1 -- 172.21.15.62:0/3265684393 learned_addr learned my addr 172.21.15.62:0/3265684393 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.460+0000 7f389bfff640 1 -- 172.21.15.62:0/3265684393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c06fa10 con 0x7f389c095f00 2024-04-23T18:32:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.460+0000 7f389bfff640 1 --2- 172.21.15.62:0/3265684393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f389c095f00 0x7f389c123ef0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f388c009720 tx=0x7f388c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.460+0000 7f3898ff9640 1 -- 172.21.15.62:0/3265684393 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f388c004160 con 0x7f389c095f00 2024-04-23T18:32:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.460+0000 7f3898ff9640 1 -- 172.21.15.62:0/3265684393 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388c004320 con 0x7f389c095f00 2024-04-23T18:32:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.460+0000 7f38a2648640 1 -- 172.21.15.62:0/3265684393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389c1b46a0 con 0x7f389c095f00 2024-04-23T18:32:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.460+0000 7f3898ff9640 1 -- 172.21.15.62:0/3265684393 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f388c032640 con 0x7f389c095f00 2024-04-23T18:32:30.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.460+0000 7f38a2648640 1 -- 172.21.15.62:0/3265684393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389c06fd20 con 0x7f389c095f00 2024-04-23T18:32:30.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.461+0000 7f38a2648640 1 -- 172.21.15.62:0/3265684393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f389c073310 con 0x7f389c095f00 2024-04-23T18:32:30.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.461+0000 7f3898ff9640 1 -- 172.21.15.62:0/3265684393 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f388c0327e0 con 0x7f389c095f00 2024-04-23T18:32:30.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.461+0000 7f3898ff9640 1 --2- 172.21.15.62:0/3265684393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f38880385c0 0x7f388803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:30.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.462+0000 7f3898ff9640 1 -- 172.21.15.62:0/3265684393 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f388c02f050 con 0x7f389c095f00 2024-04-23T18:32:30.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.462+0000 7f3898ff9640 1 --2- 172.21.15.62:0/3265684393 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3888044a20 0x7f3888046ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:30.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.462+0000 7f3898ff9640 1 -- 172.21.15.62:0/3265684393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3888047590 con 0x7f3888044a20 2024-04-23T18:32:30.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.462+0000 7f3898ff9640 1 -- 172.21.15.62:0/3265684393 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f388c075050 con 0x7f389c095f00 2024-04-23T18:32:30.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.462+0000 7f389b7fe640 1 --2- 172.21.15.62:0/3265684393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f38880385c0 0x7f388803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:30.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.462+0000 7f38a0be5640 1 --2- 172.21.15.62:0/3265684393 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3888044a20 0x7f3888046ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:30.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.462+0000 7f38a0be5640 1 --2- 172.21.15.62:0/3265684393 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3888044a20 0x7f3888046ec0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:30.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.462+0000 7f389b7fe640 1 --2- 172.21.15.62:0/3265684393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f38880385c0 0x7f388803aa80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3890000c00 tx=0x7f3890007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:30.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.463+0000 7f3898ff9640 1 -- 172.21.15.62:0/3265684393 <== osd.0 v2:172.21.15.62:6800/2641588406 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3888047590 con 0x7f3888044a20 2024-04-23T18:32:30.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.476+0000 7f38a2648640 1 -- 172.21.15.62:0/3265684393 --> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f389c0505b0 con 0x7f3888044a20 2024-04-23T18:32:30.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.476+0000 7f3898ff9640 1 -- 172.21.15.62:0/3265684393 <== osd.0 v2:172.21.15.62:6800/2641588406 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f389c0505b0 con 0x7f3888044a20 2024-04-23T18:32:30.468 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-23T18:32:30.468 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T18:32:30.468 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-23T18:32:30.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.477+0000 7f38a2648640 1 -- 172.21.15.62:0/3265684393 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3888044a20 msgr2=0x7f3888046ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.477+0000 7f38a2648640 1 --2- 172.21.15.62:0/3265684393 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3888044a20 0x7f3888046ec0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.477+0000 7f38a2648640 1 -- 172.21.15.62:0/3265684393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f38880385c0 msgr2=0x7f388803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.477+0000 7f38a2648640 1 --2- 172.21.15.62:0/3265684393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f38880385c0 0x7f388803aa80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3890000c00 tx=0x7f3890007910 comp rx=0 tx=0).stop 2024-04-23T18:32:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.477+0000 7f38a2648640 1 -- 172.21.15.62:0/3265684393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f389c095f00 msgr2=0x7f389c123ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.477+0000 7f38a2648640 1 --2- 172.21.15.62:0/3265684393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f389c095f00 0x7f389c123ef0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f388c009720 tx=0x7f388c0046c0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.477+0000 7f38a2648640 1 -- 172.21.15.62:0/3265684393 shutdown_connections 2024-04-23T18:32:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.477+0000 7f38a2648640 1 --2- 172.21.15.62:0/3265684393 >> [v2:172.21.15.62:6800/2641588406,v1:172.21.15.62:6801/2641588406] conn(0x7f3888044a20 0x7f3888046ec0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.477+0000 7f38a2648640 1 --2- 172.21.15.62:0/3265684393 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f38880385c0 0x7f388803aa80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.477+0000 7f38a2648640 1 --2- 172.21.15.62:0/3265684393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f389c095f00 0x7f389c123ef0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.477+0000 7f38a2648640 1 -- 172.21.15.62:0/3265684393 >> 172.21.15.62:0/3265684393 conn(0x7f389c09aef0 msgr2=0x7f389c1b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.477+0000 7f38a2648640 1 -- 172.21.15.62:0/3265684393 shutdown_connections 2024-04-23T18:32:30.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.477+0000 7f38a2648640 1 -- 172.21.15.62:0/3265684393 wait complete. 2024-04-23T18:32:30.479 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-23T18:32:30.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.588+0000 7f75e1352640 1 Processor -- start 2024-04-23T18:32:30.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.588+0000 7f75e1352640 1 -- start start 2024-04-23T18:32:30.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.589+0000 7f75e1352640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75dc12fa60 0x7f75dc131e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:30.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.589+0000 7f75e1352640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75dc093e70 con 0x7f75dc093380 2024-04-23T18:32:30.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.589+0000 7f75e1352640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f75dc098f60 con 0x7f75dc12fa60 2024-04-23T18:32:30.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.589+0000 7f75da7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75dc12fa60 0x7f75dc131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:30.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.589+0000 7f75daffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f75dc093380 0x7f75dc093760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41620/0 (socket says 172.21.15.62:41620) 2024-04-23T18:32:30.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.589+0000 7f75daffd640 1 -- 172.21.15.62:0/1245371648 learned_addr learned my addr 172.21.15.62:0/1245371648 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:30.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.589+0000 7f75da7fc640 1 -- 172.21.15.62:0/1245371648 >> v1:172.21.15.62:6789/0 conn(0x7f75dc093380 legacy=0x7f75dc093760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.589+0000 7f75da7fc640 1 -- 172.21.15.62:0/1245371648 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75dc096730 con 0x7f75dc12fa60 2024-04-23T18:32:30.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.589+0000 7f75d9ffb640 1 -- 172.21.15.62:0/1245371648 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1557288354 0 0) 0x7f75dc093e70 con 0x7f75dc093380 2024-04-23T18:32:30.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.590+0000 7f75da7fc640 1 --2- 172.21.15.62:0/1245371648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc12fa60 0x7f75dc131e50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009720 tx=0x7f75c402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7038188524f65f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:30.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.590+0000 7f75d9ffb640 1 -- 172.21.15.62:0/1245371648 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75c40316d0 con 0x7f75dc12fa60 2024-04-23T18:32:30.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.590+0000 7f75d9ffb640 1 -- 172.21.15.62:0/1245371648 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c4037070 con 0x7f75dc12fa60 2024-04-23T18:32:30.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.590+0000 7f75d9ffb640 1 -- 172.21.15.62:0/1245371648 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75c40319c0 con 0x7f75dc12fa60 2024-04-23T18:32:30.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.591+0000 7f75e1352640 1 -- 172.21.15.62:0/1245371648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc12fa60 msgr2=0x7f75dc131e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.591+0000 7f75e1352640 1 --2- 172.21.15.62:0/1245371648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc12fa60 0x7f75dc131e50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009720 tx=0x7f75c402b840 comp rx=0 tx=0).stop 2024-04-23T18:32:30.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.591+0000 7f75e1352640 1 -- 172.21.15.62:0/1245371648 shutdown_connections 2024-04-23T18:32:30.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.591+0000 7f75e1352640 1 --2- 172.21.15.62:0/1245371648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc12fa60 0x7f75dc131e50 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.591+0000 7f75e1352640 1 -- 172.21.15.62:0/1245371648 >> 172.21.15.62:0/1245371648 conn(0x7f75dc099d00 msgr2=0x7f75dc0975d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:30.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.591+0000 7f75e1352640 1 -- 172.21.15.62:0/1245371648 shutdown_connections 2024-04-23T18:32:30.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.591+0000 7f75e1352640 1 -- 172.21.15.62:0/1245371648 wait complete. 2024-04-23T18:32:30.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.592+0000 7f75e1352640 1 Processor -- start 2024-04-23T18:32:30.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.592+0000 7f75e1352640 1 -- start start 2024-04-23T18:32:30.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.592+0000 7f75e1352640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc093380 0x7f75dc1c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.592+0000 7f75e1352640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc096110 con 0x7f75dc093380 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.592+0000 7f75daffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc093380 0x7f75dc1c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.592+0000 7f75daffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc093380 0x7f75dc1c3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42288/0 (socket says 172.21.15.62:42288) 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.592+0000 7f75daffd640 1 -- 172.21.15.62:0/3401601617 learned_addr learned my addr 172.21.15.62:0/3401601617 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.592+0000 7f75daffd640 1 -- 172.21.15.62:0/3401601617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75dc126310 con 0x7f75dc093380 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.593+0000 7f75daffd640 1 --2- 172.21.15.62:0/3401601617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc093380 0x7f75dc1c3370 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f75d400c420 tx=0x7f75d400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.593+0000 7f75d37fe640 1 -- 172.21.15.62:0/3401601617 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4018070 con 0x7f75dc093380 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.593+0000 7f75d37fe640 1 -- 172.21.15.62:0/3401601617 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d40074d0 con 0x7f75dc093380 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.593+0000 7f75d37fe640 1 -- 172.21.15.62:0/3401601617 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75d4004950 con 0x7f75dc093380 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.593+0000 7f75e1352640 1 -- 172.21.15.62:0/3401601617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75dc09b800 con 0x7f75dc093380 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.593+0000 7f75e1352640 1 -- 172.21.15.62:0/3401601617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75dc06f2e0 con 0x7f75dc093380 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.594+0000 7f75d37fe640 1 -- 172.21.15.62:0/3401601617 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f75d401b070 con 0x7f75dc093380 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.594+0000 7f75e1352640 1 -- 172.21.15.62:0/3401601617 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75dc0505b0 con 0x7f75dc093380 2024-04-23T18:32:30.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.594+0000 7f75d37fe640 1 --2- 172.21.15.62:0/3401601617 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f75bc0385c0 0x7f75bc03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:30.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.594+0000 7f75d37fe640 1 -- 172.21.15.62:0/3401601617 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f75d404b450 con 0x7f75dc093380 2024-04-23T18:32:30.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.594+0000 7f75da7fc640 1 --2- 172.21.15.62:0/3401601617 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f75bc0385c0 0x7f75bc03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:30.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.594+0000 7f75da7fc640 1 --2- 172.21.15.62:0/3401601617 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f75bc0385c0 0x7f75bc03aa80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f75c4036000 tx=0x7f75c4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:30.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.598+0000 7f75d37fe640 1 -- 172.21.15.62:0/3401601617 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f75d4011980 con 0x7f75dc093380 2024-04-23T18:32:30.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.782+0000 7f75e1352640 1 -- 172.21.15.62:0/3401601617 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f75dc06ba30 con 0x7f75bc0385c0 2024-04-23T18:32:30.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.783+0000 7f75d37fe640 1 -- 172.21.15.62:0/3401601617 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f75dc06ba30 con 0x7f75bc0385c0 2024-04-23T18:32:30.774 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 0 to deep-scrub 2024-04-23T18:32:30.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.785+0000 7f75e1352640 1 -- 172.21.15.62:0/3401601617 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f75bc0385c0 msgr2=0x7f75bc03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.785+0000 7f75e1352640 1 --2- 172.21.15.62:0/3401601617 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f75bc0385c0 0x7f75bc03aa80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f75c4036000 tx=0x7f75c4008030 comp rx=0 tx=0).stop 2024-04-23T18:32:30.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.785+0000 7f75e1352640 1 -- 172.21.15.62:0/3401601617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc093380 msgr2=0x7f75dc1c3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.785+0000 7f75e1352640 1 --2- 172.21.15.62:0/3401601617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc093380 0x7f75dc1c3370 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f75d400c420 tx=0x7f75d400c8e0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.785+0000 7f75e1352640 1 -- 172.21.15.62:0/3401601617 shutdown_connections 2024-04-23T18:32:30.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.785+0000 7f75e1352640 1 --2- 172.21.15.62:0/3401601617 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f75bc0385c0 0x7f75bc03aa80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.785+0000 7f75e1352640 1 --2- 172.21.15.62:0/3401601617 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc093380 0x7f75dc1c3370 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.785+0000 7f75e1352640 1 -- 172.21.15.62:0/3401601617 >> 172.21.15.62:0/3401601617 conn(0x7f75dc099d00 msgr2=0x7f75dc12d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:30.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.785+0000 7f75e1352640 1 -- 172.21.15.62:0/3401601617 shutdown_connections 2024-04-23T18:32:30.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.785+0000 7f75e1352640 1 -- 172.21.15.62:0/3401601617 wait complete. 2024-04-23T18:32:30.790 INFO:tasks.ceph:Scrubbing osd.1 2024-04-23T18:32:30.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-23T18:32:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.902+0000 7f9df6f59640 1 Processor -- start 2024-04-23T18:32:30.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.902+0000 7f9df6f59640 1 -- start start 2024-04-23T18:32:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.902+0000 7f9df6f59640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9df0096150 0x7f9df0131a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.902+0000 7f9df6f59640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9df0095b80 con 0x7f9df012c900 2024-04-23T18:32:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.902+0000 7f9df6f59640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f9df0097010 con 0x7f9df0096150 2024-04-23T18:32:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.902+0000 7f9df4cf5640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9df012c900 0x7f9df012cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41624/0 (socket says 172.21.15.62:41624) 2024-04-23T18:32:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.902+0000 7f9df4cf5640 1 -- 172.21.15.62:0/887297262 learned_addr learned my addr 172.21.15.62:0/887297262 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.902+0000 7f9deffff640 1 --2- 172.21.15.62:0/887297262 >> v2:172.21.15.62:3300/0 conn(0x7f9df0096150 0x7f9df0131a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.902+0000 7f9def7fe640 1 -- 172.21.15.62:0/887297262 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 730328121 0 0) 0x7f9df0095b80 con 0x7f9df012c900 2024-04-23T18:32:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.903+0000 7f9def7fe640 1 -- 172.21.15.62:0/887297262 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9de0003520 con 0x7f9df012c900 2024-04-23T18:32:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.903+0000 7f9deffff640 1 -- 172.21.15.62:0/887297262 >> v1:172.21.15.62:6789/0 conn(0x7f9df012c900 legacy=0x7f9df012cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.903+0000 7f9deffff640 1 -- 172.21.15.62:0/887297262 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df00968c0 con 0x7f9df0096150 2024-04-23T18:32:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.903+0000 7f9deffff640 1 --2- 172.21.15.62:0/887297262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df0096150 0x7f9df0131a10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009720 tx=0x7f9ddc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49eea0adfb34cebb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.903+0000 7f9def7fe640 1 -- 172.21.15.62:0/887297262 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc0316d0 con 0x7f9df0096150 2024-04-23T18:32:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.903+0000 7f9def7fe640 1 -- 172.21.15.62:0/887297262 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ddc037070 con 0x7f9df0096150 2024-04-23T18:32:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.904+0000 7f9def7fe640 1 -- 172.21.15.62:0/887297262 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc0319a0 con 0x7f9df0096150 2024-04-23T18:32:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.904+0000 7f9df6f59640 1 -- 172.21.15.62:0/887297262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df0096150 msgr2=0x7f9df0131a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.904+0000 7f9df6f59640 1 --2- 172.21.15.62:0/887297262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df0096150 0x7f9df0131a10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009720 tx=0x7f9ddc02b840 comp rx=0 tx=0).stop 2024-04-23T18:32:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.904+0000 7f9df6f59640 1 -- 172.21.15.62:0/887297262 shutdown_connections 2024-04-23T18:32:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.904+0000 7f9df6f59640 1 --2- 172.21.15.62:0/887297262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df0096150 0x7f9df0131a10 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.904+0000 7f9df6f59640 1 -- 172.21.15.62:0/887297262 >> 172.21.15.62:0/887297262 conn(0x7f9df009aef0 msgr2=0x7f9df009b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:30.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.904+0000 7f9df6f59640 1 -- 172.21.15.62:0/887297262 shutdown_connections 2024-04-23T18:32:30.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.904+0000 7f9df6f59640 1 -- 172.21.15.62:0/887297262 wait complete. 2024-04-23T18:32:30.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.905+0000 7f9df6f59640 1 Processor -- start 2024-04-23T18:32:30.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.905+0000 7f9df6f59640 1 -- start start 2024-04-23T18:32:30.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.905+0000 7f9df6f59640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df0096150 0x7f9df0128540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:30.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.905+0000 7f9df6f59640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9df01320d0 con 0x7f9df0096150 2024-04-23T18:32:30.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.906+0000 7f9df4cf5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df0096150 0x7f9df0128540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:30.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.906+0000 7f9df4cf5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df0096150 0x7f9df0128540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42306/0 (socket says 172.21.15.62:42306) 2024-04-23T18:32:30.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.906+0000 7f9df4cf5640 1 -- 172.21.15.62:0/4252506383 learned_addr learned my addr 172.21.15.62:0/4252506383 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:30.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.906+0000 7f9df4cf5640 1 -- 172.21.15.62:0/4252506383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df006dbc0 con 0x7f9df0096150 2024-04-23T18:32:30.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.906+0000 7f9df4cf5640 1 --2- 172.21.15.62:0/4252506383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df0096150 0x7f9df0128540 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9de400c3b0 tx=0x7f9de400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:30.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.906+0000 7f9ded7fa640 1 -- 172.21.15.62:0/4252506383 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de4017070 con 0x7f9df0096150 2024-04-23T18:32:30.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.906+0000 7f9ded7fa640 1 -- 172.21.15.62:0/4252506383 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de4005c10 con 0x7f9df0096150 2024-04-23T18:32:30.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.906+0000 7f9df6f59640 1 -- 172.21.15.62:0/4252506383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df006f220 con 0x7f9df0096150 2024-04-23T18:32:30.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.906+0000 7f9ded7fa640 1 -- 172.21.15.62:0/4252506383 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de40070d0 con 0x7f9df0096150 2024-04-23T18:32:30.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.906+0000 7f9df6f59640 1 -- 172.21.15.62:0/4252506383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df006e5f0 con 0x7f9df0096150 2024-04-23T18:32:30.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.907+0000 7f9ded7fa640 1 -- 172.21.15.62:0/4252506383 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f9de401a070 con 0x7f9df0096150 2024-04-23T18:32:30.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.907+0000 7f9df6f59640 1 -- 172.21.15.62:0/4252506383 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9df00505b0 con 0x7f9df0096150 2024-04-23T18:32:30.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.907+0000 7f9ded7fa640 1 --2- 172.21.15.62:0/4252506383 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9dd40385c0 0x7f9dd403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:30.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.907+0000 7f9ded7fa640 1 -- 172.21.15.62:0/4252506383 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f9de404b4c0 con 0x7f9df0096150 2024-04-23T18:32:30.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.907+0000 7f9ded7fa640 1 --2- 172.21.15.62:0/4252506383 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x7f9dd4044940 0x7f9dd4046de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:30.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.907+0000 7f9ded7fa640 1 -- 172.21.15.62:0/4252506383 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9de4015e70 con 0x7f9dd4044940 2024-04-23T18:32:30.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.907+0000 7f9ded7fa640 1 -- 172.21.15.62:0/4252506383 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9de4052050 con 0x7f9df0096150 2024-04-23T18:32:30.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.908+0000 7f9deffff640 1 --2- 172.21.15.62:0/4252506383 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9dd40385c0 0x7f9dd403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:30.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.908+0000 7f9df54f6640 1 --2- 172.21.15.62:0/4252506383 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x7f9dd4044940 0x7f9dd4046de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:30.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.908+0000 7f9df54f6640 1 --2- 172.21.15.62:0/4252506383 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x7f9dd4044940 0x7f9dd4046de0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:30.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.908+0000 7f9deffff640 1 --2- 172.21.15.62:0/4252506383 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9dd40385c0 0x7f9dd403aa80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc036000 tx=0x7f9ddc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:30.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.909+0000 7f9ded7fa640 1 -- 172.21.15.62:0/4252506383 <== osd.1 v2:172.21.15.119:6808/2736386629 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9de4015e70 con 0x7f9dd4044940 2024-04-23T18:32:30.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.922+0000 7f9df6f59640 1 -- 172.21.15.62:0/4252506383 --> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9df006ee70 con 0x7f9dd4044940 2024-04-23T18:32:30.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.922+0000 7f9ded7fa640 1 -- 172.21.15.62:0/4252506383 <== osd.1 v2:172.21.15.119:6808/2736386629 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9df006ee70 con 0x7f9dd4044940 2024-04-23T18:32:30.914 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-23T18:32:30.914 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T18:32:30.914 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-23T18:32:30.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.923+0000 7f9df6f59640 1 -- 172.21.15.62:0/4252506383 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x7f9dd4044940 msgr2=0x7f9dd4046de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.923+0000 7f9df6f59640 1 --2- 172.21.15.62:0/4252506383 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x7f9dd4044940 0x7f9dd4046de0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.923+0000 7f9df6f59640 1 -- 172.21.15.62:0/4252506383 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9dd40385c0 msgr2=0x7f9dd403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.923+0000 7f9df6f59640 1 --2- 172.21.15.62:0/4252506383 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9dd40385c0 0x7f9dd403aa80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc036000 tx=0x7f9ddc008030 comp rx=0 tx=0).stop 2024-04-23T18:32:30.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.923+0000 7f9df6f59640 1 -- 172.21.15.62:0/4252506383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df0096150 msgr2=0x7f9df0128540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:30.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.923+0000 7f9df6f59640 1 --2- 172.21.15.62:0/4252506383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df0096150 0x7f9df0128540 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9de400c3b0 tx=0x7f9de400c870 comp rx=0 tx=0).stop 2024-04-23T18:32:30.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.923+0000 7f9df6f59640 1 -- 172.21.15.62:0/4252506383 shutdown_connections 2024-04-23T18:32:30.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.923+0000 7f9df6f59640 1 --2- 172.21.15.62:0/4252506383 >> [v2:172.21.15.119:6808/2736386629,v1:172.21.15.119:6810/2736386629] conn(0x7f9dd4044940 0x7f9dd4046de0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.923+0000 7f9df6f59640 1 --2- 172.21.15.62:0/4252506383 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f9dd40385c0 0x7f9dd403aa80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.923+0000 7f9df6f59640 1 --2- 172.21.15.62:0/4252506383 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9df0096150 0x7f9df0128540 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:30.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.923+0000 7f9df6f59640 1 -- 172.21.15.62:0/4252506383 >> 172.21.15.62:0/4252506383 conn(0x7f9df009aef0 msgr2=0x7f9df0121c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:30.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.923+0000 7f9df6f59640 1 -- 172.21.15.62:0/4252506383 shutdown_connections 2024-04-23T18:32:30.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:30.923+0000 7f9df6f59640 1 -- 172.21.15.62:0/4252506383 wait complete. 2024-04-23T18:32:30.925 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-23T18:32:31.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.034+0000 7fbb35fe7640 1 Processor -- start 2024-04-23T18:32:31.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.034+0000 7fbb35fe7640 1 -- start start 2024-04-23T18:32:31.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.034+0000 7fbb35fe7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbb3012b9b0 0x7fbb3012bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.034+0000 7fbb35fe7640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb3012b7b0 con 0x7fbb3012e930 2024-04-23T18:32:31.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.034+0000 7fbb35fe7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fbb30095bc0 con 0x7fbb3012b9b0 2024-04-23T18:32:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.034+0000 7fbb2f7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbb3012b9b0 0x7fbb3012bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.034+0000 7fbb2effd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbb3012e930 0x7fbb3012ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41636/0 (socket says 172.21.15.62:41636) 2024-04-23T18:32:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.034+0000 7fbb2effd640 1 -- 172.21.15.62:0/625092973 learned_addr learned my addr 172.21.15.62:0/625092973 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.034+0000 7fbb2f7fe640 1 -- 172.21.15.62:0/625092973 >> v1:172.21.15.62:6789/0 conn(0x7fbb3012e930 legacy=0x7fbb3012ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.035+0000 7fbb2f7fe640 1 -- 172.21.15.62:0/625092973 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb30072ea0 con 0x7fbb3012b9b0 2024-04-23T18:32:31.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.035+0000 7fbb2e7fc640 1 -- 172.21.15.62:0/625092973 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121254425 0 0) 0x7fbb3012b7b0 con 0x7fbb3012e930 2024-04-23T18:32:31.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.035+0000 7fbb2f7fe640 1 --2- 172.21.15.62:0/625092973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb3012b9b0 0x7fbb3012bd90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009720 tx=0x7fbb2002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6181211fc3485ddd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.035+0000 7fbb2e7fc640 1 -- 172.21.15.62:0/625092973 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb200316d0 con 0x7fbb3012b9b0 2024-04-23T18:32:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.035+0000 7fbb2e7fc640 1 -- 172.21.15.62:0/625092973 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb20037070 con 0x7fbb3012b9b0 2024-04-23T18:32:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.035+0000 7fbb2e7fc640 1 -- 172.21.15.62:0/625092973 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb200319c0 con 0x7fbb3012b9b0 2024-04-23T18:32:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.036+0000 7fbb35fe7640 1 -- 172.21.15.62:0/625092973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb3012b9b0 msgr2=0x7fbb3012bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.036+0000 7fbb35fe7640 1 --2- 172.21.15.62:0/625092973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb3012b9b0 0x7fbb3012bd90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009720 tx=0x7fbb2002b840 comp rx=0 tx=0).stop 2024-04-23T18:32:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.036+0000 7fbb35fe7640 1 -- 172.21.15.62:0/625092973 shutdown_connections 2024-04-23T18:32:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.036+0000 7fbb35fe7640 1 --2- 172.21.15.62:0/625092973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb3012b9b0 0x7fbb3012bd90 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.036+0000 7fbb35fe7640 1 -- 172.21.15.62:0/625092973 >> 172.21.15.62:0/625092973 conn(0x7fbb3009e000 msgr2=0x7fbb3009e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.036+0000 7fbb35fe7640 1 -- 172.21.15.62:0/625092973 shutdown_connections 2024-04-23T18:32:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.036+0000 7fbb35fe7640 1 -- 172.21.15.62:0/625092973 wait complete. 2024-04-23T18:32:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.037+0000 7fbb35fe7640 1 Processor -- start 2024-04-23T18:32:31.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.037+0000 7fbb35fe7640 1 -- start start 2024-04-23T18:32:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.037+0000 7fbb35fe7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb3012b9b0 0x7fbb30123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.037+0000 7fbb35fe7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbb300735b0 con 0x7fbb3012b9b0 2024-04-23T18:32:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.037+0000 7fbb2f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb3012b9b0 0x7fbb30123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.037+0000 7fbb2f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb3012b9b0 0x7fbb30123350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42318/0 (socket says 172.21.15.62:42318) 2024-04-23T18:32:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.037+0000 7fbb2f7fe640 1 -- 172.21.15.62:0/3242508941 learned_addr learned my addr 172.21.15.62:0/3242508941 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.038+0000 7fbb2f7fe640 1 -- 172.21.15.62:0/3242508941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb30124490 con 0x7fbb3012b9b0 2024-04-23T18:32:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.038+0000 7fbb2f7fe640 1 --2- 172.21.15.62:0/3242508941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb3012b9b0 0x7fbb30123350 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009720 tx=0x7fbb200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.038+0000 7fbb17fff640 1 -- 172.21.15.62:0/3242508941 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb20032640 con 0x7fbb3012b9b0 2024-04-23T18:32:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.038+0000 7fbb17fff640 1 -- 172.21.15.62:0/3242508941 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb20032800 con 0x7fbb3012b9b0 2024-04-23T18:32:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.038+0000 7fbb35fe7640 1 -- 172.21.15.62:0/3242508941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb301249d0 con 0x7fbb3012b9b0 2024-04-23T18:32:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.038+0000 7fbb17fff640 1 -- 172.21.15.62:0/3242508941 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb20032b20 con 0x7fbb3012b9b0 2024-04-23T18:32:31.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.038+0000 7fbb35fe7640 1 -- 172.21.15.62:0/3242508941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb30123890 con 0x7fbb3012b9b0 2024-04-23T18:32:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.039+0000 7fbb17fff640 1 -- 172.21.15.62:0/3242508941 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fbb2004c060 con 0x7fbb3012b9b0 2024-04-23T18:32:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.039+0000 7fbb35fe7640 1 -- 172.21.15.62:0/3242508941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb300505b0 con 0x7fbb3012b9b0 2024-04-23T18:32:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.039+0000 7fbb17fff640 1 --2- 172.21.15.62:0/3242508941 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbb1c0385c0 0x7fbb1c03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.039+0000 7fbb17fff640 1 -- 172.21.15.62:0/3242508941 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fbb2002f050 con 0x7fbb3012b9b0 2024-04-23T18:32:31.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.039+0000 7fbb2effd640 1 --2- 172.21.15.62:0/3242508941 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbb1c0385c0 0x7fbb1c03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.040+0000 7fbb2effd640 1 --2- 172.21.15.62:0/3242508941 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbb1c0385c0 0x7fbb1c03aa80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbb24000c00 tx=0x7fbb24007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.044+0000 7fbb17fff640 1 -- 172.21.15.62:0/3242508941 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbb20040070 con 0x7fbb3012b9b0 2024-04-23T18:32:31.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.227+0000 7fbb35fe7640 1 -- 172.21.15.62:0/3242508941 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fbb301b6a10 con 0x7fbb1c0385c0 2024-04-23T18:32:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.227+0000 7fbb17fff640 1 -- 172.21.15.62:0/3242508941 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbb301b6a10 con 0x7fbb1c0385c0 2024-04-23T18:32:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 1 to deep-scrub 2024-04-23T18:32:31.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.229+0000 7fbb35fe7640 1 -- 172.21.15.62:0/3242508941 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbb1c0385c0 msgr2=0x7fbb1c03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.229+0000 7fbb35fe7640 1 --2- 172.21.15.62:0/3242508941 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbb1c0385c0 0x7fbb1c03aa80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fbb24000c00 tx=0x7fbb24007910 comp rx=0 tx=0).stop 2024-04-23T18:32:31.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.229+0000 7fbb35fe7640 1 -- 172.21.15.62:0/3242508941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb3012b9b0 msgr2=0x7fbb30123350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.229+0000 7fbb35fe7640 1 --2- 172.21.15.62:0/3242508941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb3012b9b0 0x7fbb30123350 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009720 tx=0x7fbb200046c0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.229+0000 7fbb35fe7640 1 -- 172.21.15.62:0/3242508941 shutdown_connections 2024-04-23T18:32:31.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.229+0000 7fbb35fe7640 1 --2- 172.21.15.62:0/3242508941 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fbb1c0385c0 0x7fbb1c03aa80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.229+0000 7fbb35fe7640 1 --2- 172.21.15.62:0/3242508941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb3012b9b0 0x7fbb30123350 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.229+0000 7fbb35fe7640 1 -- 172.21.15.62:0/3242508941 >> 172.21.15.62:0/3242508941 conn(0x7fbb3009e000 msgr2=0x7fbb301b6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:31.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.229+0000 7fbb35fe7640 1 -- 172.21.15.62:0/3242508941 shutdown_connections 2024-04-23T18:32:31.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.229+0000 7fbb35fe7640 1 -- 172.21.15.62:0/3242508941 wait complete. 2024-04-23T18:32:31.231 INFO:tasks.ceph:Scrubbing osd.2 2024-04-23T18:32:31.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-23T18:32:31.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.343+0000 7f416cf60640 1 Processor -- start 2024-04-23T18:32:31.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.343+0000 7f416cf60640 1 -- start start 2024-04-23T18:32:31.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.344+0000 7f416cf60640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f416806d400 0x7f416806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.344+0000 7f416cf60640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f416809e210 con 0x7f416806dd20 2024-04-23T18:32:31.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.344+0000 7f416cf60640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4168098e00 con 0x7f416806d400 2024-04-23T18:32:31.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.344+0000 7f416659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f416806d400 0x7f416806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.344+0000 7f4165d9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f416806dd20 0x7f4168096060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41638/0 (socket says 172.21.15.62:41638) 2024-04-23T18:32:31.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.344+0000 7f416659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f416806d400 0x7f416806d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42332/0 (socket says 172.21.15.62:42332) 2024-04-23T18:32:31.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.344+0000 7f4165d9b640 1 -- 172.21.15.62:0/2874311181 learned_addr learned my addr 172.21.15.62:0/2874311181 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:31.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.344+0000 7f416659c640 1 -- 172.21.15.62:0/2874311181 >> v1:172.21.15.62:6789/0 conn(0x7f416806dd20 legacy=0x7f4168096060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.344+0000 7f416659c640 1 -- 172.21.15.62:0/2874311181 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41680989c0 con 0x7f416806d400 2024-04-23T18:32:31.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.344+0000 7f416559a640 1 -- 172.21.15.62:0/2874311181 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2491730316 0 0) 0x7f416809e210 con 0x7f416806dd20 2024-04-23T18:32:31.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.345+0000 7f416659c640 1 --2- 172.21.15.62:0/2874311181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416806d400 0x7f416806d7e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4160009d90 tx=0x7f416002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266a32e5f2bf1330 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.345+0000 7f416559a640 1 -- 172.21.15.62:0/2874311181 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4160039070 con 0x7f416806d400 2024-04-23T18:32:31.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.345+0000 7f416559a640 1 -- 172.21.15.62:0/2874311181 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416002cb10 con 0x7f416806d400 2024-04-23T18:32:31.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.345+0000 7f416559a640 1 -- 172.21.15.62:0/2874311181 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f416002ce10 con 0x7f416806d400 2024-04-23T18:32:31.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.346+0000 7f416cf60640 1 -- 172.21.15.62:0/2874311181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416806d400 msgr2=0x7f416806d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.346+0000 7f416cf60640 1 --2- 172.21.15.62:0/2874311181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416806d400 0x7f416806d7e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4160009d90 tx=0x7f416002beb0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.346+0000 7f416cf60640 1 -- 172.21.15.62:0/2874311181 shutdown_connections 2024-04-23T18:32:31.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.346+0000 7f416cf60640 1 --2- 172.21.15.62:0/2874311181 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416806d400 0x7f416806d7e0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.346+0000 7f416cf60640 1 -- 172.21.15.62:0/2874311181 >> 172.21.15.62:0/2874311181 conn(0x7f41680a13c0 msgr2=0x7f416809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:31.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.346+0000 7f416cf60640 1 -- 172.21.15.62:0/2874311181 shutdown_connections 2024-04-23T18:32:31.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.346+0000 7f416cf60640 1 -- 172.21.15.62:0/2874311181 wait complete. 2024-04-23T18:32:31.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.347+0000 7f416cf60640 1 Processor -- start 2024-04-23T18:32:31.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.347+0000 7f416cf60640 1 -- start start 2024-04-23T18:32:31.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.347+0000 7f416cf60640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416806d400 0x7f41681c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.347+0000 7f416cf60640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f416806e2f0 con 0x7f416806d400 2024-04-23T18:32:31.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.347+0000 7f416659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416806d400 0x7f41681c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.347+0000 7f416659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416806d400 0x7f41681c33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42348/0 (socket says 172.21.15.62:42348) 2024-04-23T18:32:31.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.347+0000 7f416659c640 1 -- 172.21.15.62:0/1803894214 learned_addr learned my addr 172.21.15.62:0/1803894214 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:31.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.347+0000 7f416659c640 1 -- 172.21.15.62:0/1803894214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4168093330 con 0x7f416806d400 2024-04-23T18:32:31.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.348+0000 7f416659c640 1 --2- 172.21.15.62:0/1803894214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416806d400 0x7f41681c33c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4160037040 tx=0x7f4160004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.348+0000 7f4156ffd640 1 -- 172.21.15.62:0/1803894214 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4160044020 con 0x7f416806d400 2024-04-23T18:32:31.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.348+0000 7f4156ffd640 1 -- 172.21.15.62:0/1803894214 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416003f5a0 con 0x7f416806d400 2024-04-23T18:32:31.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.348+0000 7f416cf60640 1 -- 172.21.15.62:0/1803894214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4168094f80 con 0x7f416806d400 2024-04-23T18:32:31.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.348+0000 7f4156ffd640 1 -- 172.21.15.62:0/1803894214 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4160039040 con 0x7f416806d400 2024-04-23T18:32:31.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.348+0000 7f416cf60640 1 -- 172.21.15.62:0/1803894214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41681ab3a0 con 0x7f416806d400 2024-04-23T18:32:31.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.349+0000 7f416cf60640 1 -- 172.21.15.62:0/1803894214 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41680505b0 con 0x7f416806d400 2024-04-23T18:32:31.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.349+0000 7f4156ffd640 1 -- 172.21.15.62:0/1803894214 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f4160047020 con 0x7f416806d400 2024-04-23T18:32:31.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.349+0000 7f4156ffd640 1 --2- 172.21.15.62:0/1803894214 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f41480385c0 0x7f414803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.349+0000 7f4156ffd640 1 -- 172.21.15.62:0/1803894214 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f416006eef0 con 0x7f416806d400 2024-04-23T18:32:31.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.349+0000 7f4156ffd640 1 --2- 172.21.15.62:0/1803894214 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x7f41480449c0 0x7f4148046e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.349+0000 7f4156ffd640 1 -- 172.21.15.62:0/1803894214 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f416002ee50 con 0x7f41480449c0 2024-04-23T18:32:31.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.349+0000 7f4156ffd640 1 -- 172.21.15.62:0/1803894214 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f41600715a0 con 0x7f416806d400 2024-04-23T18:32:31.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.349+0000 7f4165d9b640 1 --2- 172.21.15.62:0/1803894214 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f41480385c0 0x7f414803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.349+0000 7f4166d9d640 1 --2- 172.21.15.62:0/1803894214 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x7f41480449c0 0x7f4148046e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.350+0000 7f4165d9b640 1 --2- 172.21.15.62:0/1803894214 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f41480385c0 0x7f414803aa80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f415c000c00 tx=0x7f415c007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.350+0000 7f4166d9d640 1 --2- 172.21.15.62:0/1803894214 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x7f41480449c0 0x7f4148046e60 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.350+0000 7f4156ffd640 1 -- 172.21.15.62:0/1803894214 <== osd.2 v2:172.21.15.119:6800/2624052101 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f416002ee50 con 0x7f41480449c0 2024-04-23T18:32:31.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f416cf60640 1 -- 172.21.15.62:0/1803894214 --> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f41681aaf60 con 0x7f41480449c0 2024-04-23T18:32:31.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f4156ffd640 1 -- 172.21.15.62:0/1803894214 <== osd.2 v2:172.21.15.119:6800/2624052101 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f41681aaf60 con 0x7f41480449c0 2024-04-23T18:32:31.356 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-23T18:32:31.356 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T18:32:31.356 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-23T18:32:31.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f416cf60640 1 -- 172.21.15.62:0/1803894214 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x7f41480449c0 msgr2=0x7f4148046e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f416cf60640 1 --2- 172.21.15.62:0/1803894214 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x7f41480449c0 0x7f4148046e60 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f416cf60640 1 -- 172.21.15.62:0/1803894214 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f41480385c0 msgr2=0x7f414803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f416cf60640 1 --2- 172.21.15.62:0/1803894214 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f41480385c0 0x7f414803aa80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f415c000c00 tx=0x7f415c007910 comp rx=0 tx=0).stop 2024-04-23T18:32:31.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f416cf60640 1 -- 172.21.15.62:0/1803894214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416806d400 msgr2=0x7f41681c33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f416cf60640 1 --2- 172.21.15.62:0/1803894214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416806d400 0x7f41681c33c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4160037040 tx=0x7f4160004a40 comp rx=0 tx=0).stop 2024-04-23T18:32:31.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f416cf60640 1 -- 172.21.15.62:0/1803894214 shutdown_connections 2024-04-23T18:32:31.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f416cf60640 1 --2- 172.21.15.62:0/1803894214 >> [v2:172.21.15.119:6800/2624052101,v1:172.21.15.119:6801/2624052101] conn(0x7f41480449c0 0x7f4148046e60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f416cf60640 1 --2- 172.21.15.62:0/1803894214 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f41480385c0 0x7f414803aa80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f416cf60640 1 --2- 172.21.15.62:0/1803894214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f416806d400 0x7f41681c33c0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f416cf60640 1 -- 172.21.15.62:0/1803894214 >> 172.21.15.62:0/1803894214 conn(0x7f41680a13c0 msgr2=0x7f416809b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:31.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.364+0000 7f416cf60640 1 -- 172.21.15.62:0/1803894214 shutdown_connections 2024-04-23T18:32:31.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.365+0000 7f416cf60640 1 -- 172.21.15.62:0/1803894214 wait complete. 2024-04-23T18:32:31.366 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-23T18:32:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.476+0000 7f1a2edf2640 1 Processor -- start 2024-04-23T18:32:31.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.476+0000 7f1a2edf2640 1 -- start start 2024-04-23T18:32:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.476+0000 7f1a2edf2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1a28097d70 0x7f1a281340b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.476+0000 7f1a2edf2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2809c180 con 0x7f1a28097280 2024-04-23T18:32:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.476+0000 7f1a2edf2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1a28098600 con 0x7f1a28097d70 2024-04-23T18:32:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.476+0000 7f1a27fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1a28097d70 0x7f1a281340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.476+0000 7f1a2cb8e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1a28097280 0x7f1a28097660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41642/0 (socket says 172.21.15.62:41642) 2024-04-23T18:32:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.476+0000 7f1a2cb8e640 1 -- 172.21.15.62:0/3579216794 learned_addr learned my addr 172.21.15.62:0/3579216794 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.477+0000 7f1a27fff640 1 -- 172.21.15.62:0/3579216794 >> v1:172.21.15.62:6789/0 conn(0x7f1a28097280 legacy=0x7f1a28097660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.477+0000 7f1a277fe640 1 -- 172.21.15.62:0/3579216794 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181000471 0 0) 0x7f1a2809c180 con 0x7f1a28097280 2024-04-23T18:32:31.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.477+0000 7f1a27fff640 1 -- 172.21.15.62:0/3579216794 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a28135600 con 0x7f1a28097d70 2024-04-23T18:32:31.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.477+0000 7f1a27fff640 1 --2- 172.21.15.62:0/3579216794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a28097d70 0x7f1a281340b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009720 tx=0x7f1a1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f967af282937e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.477+0000 7f1a277fe640 1 -- 172.21.15.62:0/3579216794 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a140316d0 con 0x7f1a28097d70 2024-04-23T18:32:31.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.478+0000 7f1a277fe640 1 -- 172.21.15.62:0/3579216794 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a14037070 con 0x7f1a28097d70 2024-04-23T18:32:31.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.478+0000 7f1a277fe640 1 -- 172.21.15.62:0/3579216794 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a140319c0 con 0x7f1a28097d70 2024-04-23T18:32:31.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.478+0000 7f1a2edf2640 1 -- 172.21.15.62:0/3579216794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a28097d70 msgr2=0x7f1a281340b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.478+0000 7f1a2edf2640 1 --2- 172.21.15.62:0/3579216794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a28097d70 0x7f1a281340b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009720 tx=0x7f1a1402b840 comp rx=0 tx=0).stop 2024-04-23T18:32:31.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.478+0000 7f1a2edf2640 1 -- 172.21.15.62:0/3579216794 shutdown_connections 2024-04-23T18:32:31.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.478+0000 7f1a2edf2640 1 --2- 172.21.15.62:0/3579216794 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a28097d70 0x7f1a281340b0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.478+0000 7f1a2edf2640 1 -- 172.21.15.62:0/3579216794 >> 172.21.15.62:0/3579216794 conn(0x7f1a2809f330 msgr2=0x7f1a2809b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.478+0000 7f1a2edf2640 1 -- 172.21.15.62:0/3579216794 shutdown_connections 2024-04-23T18:32:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.478+0000 7f1a2edf2640 1 -- 172.21.15.62:0/3579216794 wait complete. 2024-04-23T18:32:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.479+0000 7f1a2edf2640 1 Processor -- start 2024-04-23T18:32:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.479+0000 7f1a2edf2640 1 -- start start 2024-04-23T18:32:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.479+0000 7f1a2edf2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a28097280 0x7f1a281c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.479+0000 7f1a2edf2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1a281349c0 con 0x7f1a28097280 2024-04-23T18:32:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.479+0000 7f1a2cb8e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a28097280 0x7f1a281c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.479+0000 7f1a2cb8e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a28097280 0x7f1a281c37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42368/0 (socket says 172.21.15.62:42368) 2024-04-23T18:32:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.479+0000 7f1a2cb8e640 1 -- 172.21.15.62:0/1126538419 learned_addr learned my addr 172.21.15.62:0/1126538419 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.480+0000 7f1a2cb8e640 1 -- 172.21.15.62:0/1126538419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a28092800 con 0x7f1a28097280 2024-04-23T18:32:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.480+0000 7f1a2cb8e640 1 --2- 172.21.15.62:0/1126538419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a28097280 0x7f1a281c37e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c420 tx=0x7f1a1c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.480+0000 7f1a257fa640 1 -- 172.21.15.62:0/1126538419 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a1c018070 con 0x7f1a28097280 2024-04-23T18:32:31.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.480+0000 7f1a257fa640 1 -- 172.21.15.62:0/1126538419 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0074d0 con 0x7f1a28097280 2024-04-23T18:32:31.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.480+0000 7f1a2edf2640 1 -- 172.21.15.62:0/1126538419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2806e5f0 con 0x7f1a28097280 2024-04-23T18:32:31.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.480+0000 7f1a257fa640 1 -- 172.21.15.62:0/1126538419 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a1c004950 con 0x7f1a28097280 2024-04-23T18:32:31.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.480+0000 7f1a2edf2640 1 -- 172.21.15.62:0/1126538419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a28093490 con 0x7f1a28097280 2024-04-23T18:32:31.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.481+0000 7f1a257fa640 1 -- 172.21.15.62:0/1126538419 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f1a1c01b070 con 0x7f1a28097280 2024-04-23T18:32:31.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.481+0000 7f1a2edf2640 1 -- 172.21.15.62:0/1126538419 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a280505b0 con 0x7f1a28097280 2024-04-23T18:32:31.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.481+0000 7f1a257fa640 1 --2- 172.21.15.62:0/1126538419 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1a0c0385c0 0x7f1a0c03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.481+0000 7f1a257fa640 1 -- 172.21.15.62:0/1126538419 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f1a1c04b580 con 0x7f1a28097280 2024-04-23T18:32:31.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.482+0000 7f1a27fff640 1 --2- 172.21.15.62:0/1126538419 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1a0c0385c0 0x7f1a0c03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.482+0000 7f1a27fff640 1 --2- 172.21.15.62:0/1126538419 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1a0c0385c0 0x7f1a0c03aa80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009720 tx=0x7f1a14008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.486+0000 7f1a257fa640 1 -- 172.21.15.62:0/1126538419 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1a1c011980 con 0x7f1a28097280 2024-04-23T18:32:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.677+0000 7f1a2edf2640 1 -- 172.21.15.62:0/1126538419 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f1a28092fd0 con 0x7f1a0c0385c0 2024-04-23T18:32:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.678+0000 7f1a257fa640 1 -- 172.21.15.62:0/1126538419 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1a28092fd0 con 0x7f1a0c0385c0 2024-04-23T18:32:31.669 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 2 to deep-scrub 2024-04-23T18:32:31.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.681+0000 7f1a2edf2640 1 -- 172.21.15.62:0/1126538419 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1a0c0385c0 msgr2=0x7f1a0c03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.681+0000 7f1a2edf2640 1 --2- 172.21.15.62:0/1126538419 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1a0c0385c0 0x7f1a0c03aa80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009720 tx=0x7f1a14008030 comp rx=0 tx=0).stop 2024-04-23T18:32:31.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.681+0000 7f1a2edf2640 1 -- 172.21.15.62:0/1126538419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a28097280 msgr2=0x7f1a281c37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.681+0000 7f1a2edf2640 1 --2- 172.21.15.62:0/1126538419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a28097280 0x7f1a281c37e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c420 tx=0x7f1a1c00c8e0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.681+0000 7f1a2edf2640 1 -- 172.21.15.62:0/1126538419 shutdown_connections 2024-04-23T18:32:31.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.681+0000 7f1a2edf2640 1 --2- 172.21.15.62:0/1126538419 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f1a0c0385c0 0x7f1a0c03aa80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.681+0000 7f1a2edf2640 1 --2- 172.21.15.62:0/1126538419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a28097280 0x7f1a281c37e0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.681+0000 7f1a2edf2640 1 -- 172.21.15.62:0/1126538419 >> 172.21.15.62:0/1126538419 conn(0x7f1a2809f330 msgr2=0x7f1a2806d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:31.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.681+0000 7f1a2edf2640 1 -- 172.21.15.62:0/1126538419 shutdown_connections 2024-04-23T18:32:31.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.681+0000 7f1a2edf2640 1 -- 172.21.15.62:0/1126538419 wait complete. 2024-04-23T18:32:31.683 INFO:tasks.ceph:Scrubbing osd.3 2024-04-23T18:32:31.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-23T18:32:31.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.795+0000 7ff6e9722640 1 Processor -- start 2024-04-23T18:32:31.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.795+0000 7ff6e9722640 1 -- start start 2024-04-23T18:32:31.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.795+0000 7ff6e9722640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6e412ee80 0x7ff6e412f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.795+0000 7ff6e9722640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e4072ee0 con 0x7ff6e412f7a0 2024-04-23T18:32:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.795+0000 7ff6e9722640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e409db10 con 0x7ff6e412ee80 2024-04-23T18:32:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.796+0000 7ff6e2ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6e412ee80 0x7ff6e412f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.796+0000 7ff6e27fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff6e412f7a0 0x7ff6e406b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41658/0 (socket says 172.21.15.62:41658) 2024-04-23T18:32:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.796+0000 7ff6e27fc640 1 -- 172.21.15.62:0/1600507882 learned_addr learned my addr 172.21.15.62:0/1600507882 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.796+0000 7ff6e2ffd640 1 -- 172.21.15.62:0/1600507882 >> v1:172.21.15.62:6789/0 conn(0x7ff6e412f7a0 legacy=0x7ff6e406b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.796+0000 7ff6e1ffb640 1 -- 172.21.15.62:0/1600507882 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2525770182 0 0) 0x7ff6e4072ee0 con 0x7ff6e412f7a0 2024-04-23T18:32:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.796+0000 7ff6e2ffd640 1 -- 172.21.15.62:0/1600507882 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e4095ca0 con 0x7ff6e412ee80 2024-04-23T18:32:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.797+0000 7ff6e2ffd640 1 --2- 172.21.15.62:0/1600507882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6e412ee80 0x7ff6e412f260 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009720 tx=0x7ff6dc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acf2948e203ffe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.797+0000 7ff6e1ffb640 1 -- 172.21.15.62:0/1600507882 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6dc0316d0 con 0x7ff6e412ee80 2024-04-23T18:32:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.797+0000 7ff6e1ffb640 1 -- 172.21.15.62:0/1600507882 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6dc037070 con 0x7ff6e412ee80 2024-04-23T18:32:31.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.797+0000 7ff6e1ffb640 1 -- 172.21.15.62:0/1600507882 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6dc0319c0 con 0x7ff6e412ee80 2024-04-23T18:32:31.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.797+0000 7ff6e9722640 1 -- 172.21.15.62:0/1600507882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6e412ee80 msgr2=0x7ff6e412f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.797+0000 7ff6e9722640 1 --2- 172.21.15.62:0/1600507882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6e412ee80 0x7ff6e412f260 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009720 tx=0x7ff6dc02b840 comp rx=0 tx=0).stop 2024-04-23T18:32:31.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.797+0000 7ff6e9722640 1 -- 172.21.15.62:0/1600507882 shutdown_connections 2024-04-23T18:32:31.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.797+0000 7ff6e9722640 1 --2- 172.21.15.62:0/1600507882 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6e412ee80 0x7ff6e412f260 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.797+0000 7ff6e9722640 1 -- 172.21.15.62:0/1600507882 >> 172.21.15.62:0/1600507882 conn(0x7ff6e409e110 msgr2=0x7ff6e409e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.797+0000 7ff6e9722640 1 -- 172.21.15.62:0/1600507882 shutdown_connections 2024-04-23T18:32:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.797+0000 7ff6e9722640 1 -- 172.21.15.62:0/1600507882 wait complete. 2024-04-23T18:32:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.798+0000 7ff6e9722640 1 Processor -- start 2024-04-23T18:32:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.798+0000 7ff6e9722640 1 -- start start 2024-04-23T18:32:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.799+0000 7ff6e9722640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6e412ee80 0x7ff6e4126ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.799+0000 7ff6e9722640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e4095860 con 0x7ff6e412ee80 2024-04-23T18:32:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.799+0000 7ff6e2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6e412ee80 0x7ff6e4126ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.799+0000 7ff6e2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6e412ee80 0x7ff6e4126ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42386/0 (socket says 172.21.15.62:42386) 2024-04-23T18:32:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.799+0000 7ff6e2ffd640 1 -- 172.21.15.62:0/688629918 learned_addr learned my addr 172.21.15.62:0/688629918 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.799+0000 7ff6e2ffd640 1 -- 172.21.15.62:0/688629918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e4128310 con 0x7ff6e412ee80 2024-04-23T18:32:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.799+0000 7ff6e2ffd640 1 --2- 172.21.15.62:0/688629918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6e412ee80 0x7ff6e4126ac0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc02b880 tx=0x7ff6dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.799+0000 7ff6db7fe640 1 -- 172.21.15.62:0/688629918 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6dc004160 con 0x7ff6e412ee80 2024-04-23T18:32:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.799+0000 7ff6db7fe640 1 -- 172.21.15.62:0/688629918 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6dc004300 con 0x7ff6e412ee80 2024-04-23T18:32:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.799+0000 7ff6db7fe640 1 -- 172.21.15.62:0/688629918 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6dc032640 con 0x7ff6e412ee80 2024-04-23T18:32:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.799+0000 7ff6e9722640 1 -- 172.21.15.62:0/688629918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e41299b0 con 0x7ff6e412ee80 2024-04-23T18:32:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.799+0000 7ff6e9722640 1 -- 172.21.15.62:0/688629918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e4129420 con 0x7ff6e412ee80 2024-04-23T18:32:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.800+0000 7ff6e9722640 1 -- 172.21.15.62:0/688629918 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6e40505b0 con 0x7ff6e412ee80 2024-04-23T18:32:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.800+0000 7ff6db7fe640 1 -- 172.21.15.62:0/688629918 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff6dc0327e0 con 0x7ff6e412ee80 2024-04-23T18:32:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.800+0000 7ff6db7fe640 1 --2- 172.21.15.62:0/688629918 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff6c40385c0 0x7ff6c403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.800+0000 7ff6db7fe640 1 -- 172.21.15.62:0/688629918 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7ff6dc02f050 con 0x7ff6e412ee80 2024-04-23T18:32:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.801+0000 7ff6db7fe640 1 --2- 172.21.15.62:0/688629918 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x7ff6c4044a20 0x7ff6c4046ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.801+0000 7ff6db7fe640 1 -- 172.21.15.62:0/688629918 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6dc04de80 con 0x7ff6c4044a20 2024-04-23T18:32:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.801+0000 7ff6db7fe640 1 -- 172.21.15.62:0/688629918 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff6dc075050 con 0x7ff6e412ee80 2024-04-23T18:32:31.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.801+0000 7ff6e27fc640 1 --2- 172.21.15.62:0/688629918 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff6c40385c0 0x7ff6c403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.801+0000 7ff6e37fe640 1 --2- 172.21.15.62:0/688629918 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x7ff6c4044a20 0x7ff6c4046ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.801+0000 7ff6e37fe640 1 --2- 172.21.15.62:0/688629918 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x7ff6c4044a20 0x7ff6c4046ec0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.801+0000 7ff6e27fc640 1 --2- 172.21.15.62:0/688629918 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff6c40385c0 0x7ff6c403aa80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc000c00 tx=0x7ff6cc007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.802+0000 7ff6db7fe640 1 -- 172.21.15.62:0/688629918 <== osd.3 v2:172.21.15.119:6809/3910610681 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6dc04de80 con 0x7ff6c4044a20 2024-04-23T18:32:31.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.815+0000 7ff6e9722640 1 -- 172.21.15.62:0/688629918 --> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff6e4098d90 con 0x7ff6c4044a20 2024-04-23T18:32:31.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6db7fe640 1 -- 172.21.15.62:0/688629918 <== osd.3 v2:172.21.15.119:6809/3910610681 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff6e4098d90 con 0x7ff6c4044a20 2024-04-23T18:32:31.807 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-04-23T18:32:31.807 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T18:32:31.807 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-04-23T18:32:31.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6e9722640 1 -- 172.21.15.62:0/688629918 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x7ff6c4044a20 msgr2=0x7ff6c4046ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6e9722640 1 --2- 172.21.15.62:0/688629918 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x7ff6c4044a20 0x7ff6c4046ec0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6e9722640 1 -- 172.21.15.62:0/688629918 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff6c40385c0 msgr2=0x7ff6c403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6e9722640 1 --2- 172.21.15.62:0/688629918 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff6c40385c0 0x7ff6c403aa80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc000c00 tx=0x7ff6cc007970 comp rx=0 tx=0).stop 2024-04-23T18:32:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6e9722640 1 -- 172.21.15.62:0/688629918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6e412ee80 msgr2=0x7ff6e4126ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6e9722640 1 --2- 172.21.15.62:0/688629918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6e412ee80 0x7ff6e4126ac0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc02b880 tx=0x7ff6dc0046c0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6e9722640 1 -- 172.21.15.62:0/688629918 shutdown_connections 2024-04-23T18:32:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6e9722640 1 --2- 172.21.15.62:0/688629918 >> [v2:172.21.15.119:6809/3910610681,v1:172.21.15.119:6811/3910610681] conn(0x7ff6c4044a20 0x7ff6c4046ec0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6e9722640 1 --2- 172.21.15.62:0/688629918 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff6c40385c0 0x7ff6c403aa80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6e9722640 1 --2- 172.21.15.62:0/688629918 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6e412ee80 0x7ff6e4126ac0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6e9722640 1 -- 172.21.15.62:0/688629918 >> 172.21.15.62:0/688629918 conn(0x7ff6e409e110 msgr2=0x7ff6e4098680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6e9722640 1 -- 172.21.15.62:0/688629918 shutdown_connections 2024-04-23T18:32:31.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.816+0000 7ff6e9722640 1 -- 172.21.15.62:0/688629918 wait complete. 2024-04-23T18:32:31.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-23T18:32:31.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.926+0000 7f11617b6640 1 Processor -- start 2024-04-23T18:32:31.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.926+0000 7f11617b6640 1 -- start start 2024-04-23T18:32:31.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.927+0000 7f11617b6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f115c12c2e0 0x7f115c133e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.927+0000 7f11617b6640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f115c098e40 con 0x7f115c12b5d0 2024-04-23T18:32:31.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.927+0000 7f11617b6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f115c12b9b0 con 0x7f115c12c2e0 2024-04-23T18:32:31.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.927+0000 7f115a7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f115c12c2e0 0x7f115c133e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.927+0000 7f115affd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f115c12b5d0 0x7f115c12bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41664/0 (socket says 172.21.15.62:41664) 2024-04-23T18:32:31.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.927+0000 7f115affd640 1 -- 172.21.15.62:0/450624516 learned_addr learned my addr 172.21.15.62:0/450624516 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:31.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.927+0000 7f115a7fc640 1 -- 172.21.15.62:0/450624516 >> v1:172.21.15.62:6789/0 conn(0x7f115c12b5d0 legacy=0x7f115c12bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.927+0000 7f115a7fc640 1 -- 172.21.15.62:0/450624516 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c06e040 con 0x7f115c12c2e0 2024-04-23T18:32:31.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.928+0000 7f115a7fc640 1 --2- 172.21.15.62:0/450624516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c12c2e0 0x7f115c133e30 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1144009720 tx=0x7f114402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38be03422298b63a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.928+0000 7f1159ffb640 1 -- 172.21.15.62:0/450624516 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1144035020 con 0x7f115c12c2e0 2024-04-23T18:32:31.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.928+0000 7f1159ffb640 1 -- 172.21.15.62:0/450624516 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1144031760 con 0x7f115c12c2e0 2024-04-23T18:32:31.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.928+0000 7f1159ffb640 1 -- 172.21.15.62:0/450624516 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1144031a60 con 0x7f115c12c2e0 2024-04-23T18:32:31.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.928+0000 7f11617b6640 1 -- 172.21.15.62:0/450624516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c12c2e0 msgr2=0x7f115c133e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:31.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.928+0000 7f11617b6640 1 --2- 172.21.15.62:0/450624516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c12c2e0 0x7f115c133e30 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1144009720 tx=0x7f114402b8d0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.928+0000 7f11617b6640 1 -- 172.21.15.62:0/450624516 shutdown_connections 2024-04-23T18:32:31.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.928+0000 7f11617b6640 1 --2- 172.21.15.62:0/450624516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c12c2e0 0x7f115c133e30 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:31.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.928+0000 7f11617b6640 1 -- 172.21.15.62:0/450624516 >> 172.21.15.62:0/450624516 conn(0x7f115c0a11b0 msgr2=0x7f115c0a15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:31.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.929+0000 7f11617b6640 1 -- 172.21.15.62:0/450624516 shutdown_connections 2024-04-23T18:32:31.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.929+0000 7f11617b6640 1 -- 172.21.15.62:0/450624516 wait complete. 2024-04-23T18:32:31.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.929+0000 7f11617b6640 1 Processor -- start 2024-04-23T18:32:31.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.929+0000 7f11617b6640 1 -- start start 2024-04-23T18:32:31.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.930+0000 7f11617b6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c12b5d0 0x7f115c12fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.930+0000 7f11617b6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f115c1344f0 con 0x7f115c12b5d0 2024-04-23T18:32:31.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.930+0000 7f115affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c12b5d0 0x7f115c12fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.930+0000 7f115affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c12b5d0 0x7f115c12fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42408/0 (socket says 172.21.15.62:42408) 2024-04-23T18:32:31.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.930+0000 7f115affd640 1 -- 172.21.15.62:0/2244351671 learned_addr learned my addr 172.21.15.62:0/2244351671 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:31.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.930+0000 7f115affd640 1 -- 172.21.15.62:0/2244351671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c1312a0 con 0x7f115c12b5d0 2024-04-23T18:32:31.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.930+0000 7f115affd640 1 --2- 172.21.15.62:0/2244351671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c12b5d0 0x7f115c12fe30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f114c00cb40 tx=0x7f114c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.930+0000 7f11537fe640 1 -- 172.21.15.62:0/2244351671 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f114c017070 con 0x7f115c12b5d0 2024-04-23T18:32:31.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.930+0000 7f11537fe640 1 -- 172.21.15.62:0/2244351671 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f114c00ab30 con 0x7f115c12b5d0 2024-04-23T18:32:31.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.931+0000 7f11617b6640 1 -- 172.21.15.62:0/2244351671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115c131f10 con 0x7f115c12b5d0 2024-04-23T18:32:31.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.931+0000 7f11537fe640 1 -- 172.21.15.62:0/2244351671 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f114c00ae10 con 0x7f115c12b5d0 2024-04-23T18:32:31.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.931+0000 7f11617b6640 1 -- 172.21.15.62:0/2244351671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f115c132640 con 0x7f115c12b5d0 2024-04-23T18:32:31.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.931+0000 7f11537fe640 1 -- 172.21.15.62:0/2244351671 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f114c01a070 con 0x7f115c12b5d0 2024-04-23T18:32:31.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.932+0000 7f11537fe640 1 --2- 172.21.15.62:0/2244351671 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f113c038570 0x7f113c03aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:31.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.932+0000 7f11537fe640 1 -- 172.21.15.62:0/2244351671 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f114c04bde0 con 0x7f115c12b5d0 2024-04-23T18:32:31.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.932+0000 7f11617b6640 1 -- 172.21.15.62:0/2244351671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f115c0505b0 con 0x7f115c12b5d0 2024-04-23T18:32:31.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.932+0000 7f115a7fc640 1 --2- 172.21.15.62:0/2244351671 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f113c038570 0x7f113c03aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:31.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.932+0000 7f115a7fc640 1 --2- 172.21.15.62:0/2244351671 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f113c038570 0x7f113c03aa30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1144036000 tx=0x7f1144008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:31.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:31.936+0000 7f11537fe640 1 -- 172.21.15.62:0/2244351671 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f114c01a520 con 0x7f115c12b5d0 2024-04-23T18:32:32.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.120+0000 7f11617b6640 1 -- 172.21.15.62:0/2244351671 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f115c068d50 con 0x7f113c038570 2024-04-23T18:32:32.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.121+0000 7f11537fe640 1 -- 172.21.15.62:0/2244351671 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f11440093c0 con 0x7f113c038570 2024-04-23T18:32:32.113 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 3 to deep-scrub 2024-04-23T18:32:32.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.123+0000 7f11617b6640 1 -- 172.21.15.62:0/2244351671 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f113c038570 msgr2=0x7f113c03aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:32.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.123+0000 7f11617b6640 1 --2- 172.21.15.62:0/2244351671 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f113c038570 0x7f113c03aa30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1144036000 tx=0x7f1144008030 comp rx=0 tx=0).stop 2024-04-23T18:32:32.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.123+0000 7f11617b6640 1 -- 172.21.15.62:0/2244351671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c12b5d0 msgr2=0x7f115c12fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:32.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.123+0000 7f11617b6640 1 --2- 172.21.15.62:0/2244351671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c12b5d0 0x7f115c12fe30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f114c00cb40 tx=0x7f114c00cf40 comp rx=0 tx=0).stop 2024-04-23T18:32:32.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.123+0000 7f11617b6640 1 -- 172.21.15.62:0/2244351671 shutdown_connections 2024-04-23T18:32:32.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.123+0000 7f11617b6640 1 --2- 172.21.15.62:0/2244351671 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f113c038570 0x7f113c03aa30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:32.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.123+0000 7f11617b6640 1 --2- 172.21.15.62:0/2244351671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f115c12b5d0 0x7f115c12fe30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:32.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.123+0000 7f11617b6640 1 -- 172.21.15.62:0/2244351671 >> 172.21.15.62:0/2244351671 conn(0x7f115c0a11b0 msgr2=0x7f115c09b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:32.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.123+0000 7f11617b6640 1 -- 172.21.15.62:0/2244351671 shutdown_connections 2024-04-23T18:32:32.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.123+0000 7f11617b6640 1 -- 172.21.15.62:0/2244351671 wait complete. 2024-04-23T18:32:32.125 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:32:32.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.233+0000 7fb22bcfd640 1 Processor -- start 2024-04-23T18:32:32.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.234+0000 7fb22bcfd640 1 -- start start 2024-04-23T18:32:32.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.234+0000 7fb22bcfd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb2241284a0 0x7fb224128880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:32.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.234+0000 7fb22bcfd640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb224096500 con 0x7fb22412b5b0 2024-04-23T18:32:32.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.234+0000 7fb22bcfd640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb224128050 con 0x7fb2241284a0 2024-04-23T18:32:32.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.234+0000 7fb229a99640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb2241284a0 0x7fb224128880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:32.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.234+0000 7fb229298640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb22412b5b0 0x7fb22412b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41668/0 (socket says 172.21.15.62:41668) 2024-04-23T18:32:32.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.234+0000 7fb229298640 1 -- 172.21.15.62:0/1710874137 learned_addr learned my addr 172.21.15.62:0/1710874137 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:32.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.234+0000 7fb228a97640 1 -- 172.21.15.62:0/1710874137 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1012741873 0 0) 0x7fb224096500 con 0x7fb22412b5b0 2024-04-23T18:32:32.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.234+0000 7fb228a97640 1 -- 172.21.15.62:0/1710874137 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb210003520 con 0x7fb22412b5b0 2024-04-23T18:32:32.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.234+0000 7fb229a99640 1 -- 172.21.15.62:0/1710874137 >> v1:172.21.15.62:6789/0 conn(0x7fb22412b5b0 legacy=0x7fb22412b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:32.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.234+0000 7fb229a99640 1 -- 172.21.15.62:0/1710874137 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb224098fd0 con 0x7fb2241284a0 2024-04-23T18:32:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.235+0000 7fb229a99640 1 --2- 172.21.15.62:0/1710874137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2241284a0 0x7fb224128880 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb218009720 tx=0x7fb21802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e4955cc084dfc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.235+0000 7fb228a97640 1 -- 172.21.15.62:0/1710874137 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2180316d0 con 0x7fb2241284a0 2024-04-23T18:32:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.235+0000 7fb228a97640 1 -- 172.21.15.62:0/1710874137 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb218037070 con 0x7fb2241284a0 2024-04-23T18:32:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.235+0000 7fb228a97640 1 -- 172.21.15.62:0/1710874137 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2180319c0 con 0x7fb2241284a0 2024-04-23T18:32:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.236+0000 7fb22bcfd640 1 -- 172.21.15.62:0/1710874137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2241284a0 msgr2=0x7fb224128880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.236+0000 7fb22bcfd640 1 --2- 172.21.15.62:0/1710874137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2241284a0 0x7fb224128880 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb218009720 tx=0x7fb21802b840 comp rx=0 tx=0).stop 2024-04-23T18:32:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.236+0000 7fb22bcfd640 1 -- 172.21.15.62:0/1710874137 shutdown_connections 2024-04-23T18:32:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.236+0000 7fb22bcfd640 1 --2- 172.21.15.62:0/1710874137 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2241284a0 0x7fb224128880 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.236+0000 7fb22bcfd640 1 -- 172.21.15.62:0/1710874137 >> 172.21.15.62:0/1710874137 conn(0x7fb224099d70 msgr2=0x7fb224097640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.236+0000 7fb22bcfd640 1 -- 172.21.15.62:0/1710874137 shutdown_connections 2024-04-23T18:32:32.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.236+0000 7fb22bcfd640 1 -- 172.21.15.62:0/1710874137 wait complete. 2024-04-23T18:32:32.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.237+0000 7fb22bcfd640 1 Processor -- start 2024-04-23T18:32:32.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.237+0000 7fb22bcfd640 1 -- start start 2024-04-23T18:32:32.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.237+0000 7fb22bcfd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2241284a0 0x7fb22408afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:32.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.237+0000 7fb22bcfd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb224096940 con 0x7fb2241284a0 2024-04-23T18:32:32.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.237+0000 7fb229a99640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2241284a0 0x7fb22408afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:32.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.237+0000 7fb229a99640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2241284a0 0x7fb22408afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42428/0 (socket says 172.21.15.62:42428) 2024-04-23T18:32:32.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.237+0000 7fb229a99640 1 -- 172.21.15.62:0/25391370 learned_addr learned my addr 172.21.15.62:0/25391370 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:32.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.237+0000 7fb229a99640 1 -- 172.21.15.62:0/25391370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22408c630 con 0x7fb2241284a0 2024-04-23T18:32:32.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.238+0000 7fb229a99640 1 --2- 172.21.15.62:0/25391370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2241284a0 0x7fb22408afb0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb218000c00 tx=0x7fb2180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:32.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.238+0000 7fb2167fc640 1 -- 172.21.15.62:0/25391370 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb218032560 con 0x7fb2241284a0 2024-04-23T18:32:32.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.238+0000 7fb2167fc640 1 -- 172.21.15.62:0/25391370 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb218032700 con 0x7fb2241284a0 2024-04-23T18:32:32.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.238+0000 7fb22bcfd640 1 -- 172.21.15.62:0/25391370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22408d760 con 0x7fb2241284a0 2024-04-23T18:32:32.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.238+0000 7fb2167fc640 1 -- 172.21.15.62:0/25391370 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb218032a00 con 0x7fb2241284a0 2024-04-23T18:32:32.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.238+0000 7fb22bcfd640 1 -- 172.21.15.62:0/25391370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22408b6d0 con 0x7fb2241284a0 2024-04-23T18:32:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.239+0000 7fb2167fc640 1 -- 172.21.15.62:0/25391370 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb21804c060 con 0x7fb2241284a0 2024-04-23T18:32:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.239+0000 7fb22bcfd640 1 -- 172.21.15.62:0/25391370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2240505b0 con 0x7fb2241284a0 2024-04-23T18:32:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.239+0000 7fb2167fc640 1 --2- 172.21.15.62:0/25391370 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2080385c0 0x7fb20803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:32.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.239+0000 7fb2167fc640 1 -- 172.21.15.62:0/25391370 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb21802f050 con 0x7fb2241284a0 2024-04-23T18:32:32.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.239+0000 7fb229298640 1 --2- 172.21.15.62:0/25391370 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2080385c0 0x7fb20803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:32.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.240+0000 7fb229298640 1 --2- 172.21.15.62:0/25391370 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2080385c0 0x7fb20803aa80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb220001610 tx=0x7fb220007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:32.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.244+0000 7fb2167fc640 1 -- 172.21.15.62:0/25391370 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb218040070 con 0x7fb2241284a0 2024-04-23T18:32:32.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.425+0000 7fb22bcfd640 1 -- 172.21.15.62:0/25391370 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2241273b0 con 0x7fb2080385c0 2024-04-23T18:32:32.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.440+0000 7fb2167fc640 1 -- 172.21.15.62:0/25391370 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665667 (secure 0 0 0) 0x7fb2241273b0 con 0x7fb2080385c0 2024-04-23T18:32:32.440 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:32:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-04-23T18:32:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.445+0000 7fb22bcfd640 1 -- 172.21.15.62:0/25391370 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2080385c0 msgr2=0x7fb20803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.445+0000 7fb22bcfd640 1 --2- 172.21.15.62:0/25391370 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2080385c0 0x7fb20803aa80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb220001610 tx=0x7fb220007970 comp rx=0 tx=0).stop 2024-04-23T18:32:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.445+0000 7fb22bcfd640 1 -- 172.21.15.62:0/25391370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2241284a0 msgr2=0x7fb22408afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.445+0000 7fb22bcfd640 1 --2- 172.21.15.62:0/25391370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2241284a0 0x7fb22408afb0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb218000c00 tx=0x7fb2180046c0 comp rx=0 tx=0).stop 2024-04-23T18:32:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.445+0000 7fb22bcfd640 1 -- 172.21.15.62:0/25391370 shutdown_connections 2024-04-23T18:32:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.445+0000 7fb22bcfd640 1 --2- 172.21.15.62:0/25391370 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb2080385c0 0x7fb20803aa80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.445+0000 7fb22bcfd640 1 --2- 172.21.15.62:0/25391370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2241284a0 0x7fb22408afb0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.445+0000 7fb22bcfd640 1 -- 172.21.15.62:0/25391370 >> 172.21.15.62:0/25391370 conn(0x7fb224099d70 msgr2=0x7fb224094140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.445+0000 7fb22bcfd640 1 -- 172.21.15.62:0/25391370 shutdown_connections 2024-04-23T18:32:32.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:32.445+0000 7fb22bcfd640 1 -- 172.21.15.62:0/25391370 wait complete. 2024-04-23T18:32:32.449 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-04-23T18:32:30.743634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412790,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4921,"num_read_kb":4498,"num_write":2118,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4506,"ondisk_log_size":4506,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":175672,"kb_used_data":30168,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377311688,"statfs":{"total":386547056640,"available":386367168512,"internally_reserved":0,"allocated":30892032,"data_stored":29690088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":542,"num_read_kb":497,"num_write":398,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004089"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.392235+0000","last_change":"2024-04-23T18:29:11.496715+0000","last_active":"2024-04-23T18:31:20.392235+0000","last_peered":"2024-04-23T18:31:20.392235+0000","last_clean":"2024-04-23T18:31:20.392235+0000","last_became_active":"2024-04-23T18:29:11.495610+0000","last_became_peered":"2024-04-23T18:29:11.495610+0000","last_unstale":"2024-04-23T18:31:20.392235+0000","last_undegraded":"2024-04-23T18:31:20.392235+0000","last_fullsized":"2024-04-23T18:31:20.392235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:39:13.562652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216466+0000","last_change":"2024-04-23T18:29:13.493644+0000","last_active":"2024-04-23T18:32:21.216466+0000","last_peered":"2024-04-23T18:32:21.216466+0000","last_clean":"2024-04-23T18:32:21.216466+0000","last_became_active":"2024-04-23T18:29:13.492771+0000","last_became_peered":"2024-04-23T18:29:13.492771+0000","last_unstale":"2024-04-23T18:32:21.216466+0000","last_undegraded":"2024-04-23T18:32:21.216466+0000","last_fullsized":"2024-04-23T18:32:21.216466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:18.652802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549100+0000","last_change":"2024-04-23T18:29:11.495726+0000","last_active":"2024-04-23T18:29:52.549100+0000","last_peered":"2024-04-23T18:29:52.549100+0000","last_clean":"2024-04-23T18:29:52.549100+0000","last_became_active":"2024-04-23T18:29:11.495272+0000","last_became_peered":"2024-04-23T18:29:11.495272+0000","last_unstale":"2024-04-23T18:29:52.549100+0000","last_undegraded":"2024-04-23T18:29:52.549100+0000","last_fullsized":"2024-04-23T18:29:52.549100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:11:21.963212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.145581+0000","last_change":"2024-04-23T18:29:13.495212+0000","last_active":"2024-04-23T18:32:21.145581+0000","last_peered":"2024-04-23T18:32:21.145581+0000","last_clean":"2024-04-23T18:32:21.145581+0000","last_became_active":"2024-04-23T18:29:13.494969+0000","last_became_peered":"2024-04-23T18:29:13.494969+0000","last_unstale":"2024-04-23T18:32:21.145581+0000","last_undegraded":"2024-04-23T18:32:21.145581+0000","last_fullsized":"2024-04-23T18:32:21.145581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:31.120065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.883853+0000","last_change":"2024-04-23T18:29:11.505594+0000","last_active":"2024-04-23T18:32:20.883853+0000","last_peered":"2024-04-23T18:32:20.883853+0000","last_clean":"2024-04-23T18:32:20.883853+0000","last_became_active":"2024-04-23T18:29:11.505283+0000","last_became_peered":"2024-04-23T18:29:11.505283+0000","last_unstale":"2024-04-23T18:32:20.883853+0000","last_undegraded":"2024-04-23T18:32:20.883853+0000","last_fullsized":"2024-04-23T18:32:20.883853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:22.032624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549437+0000","last_change":"2024-04-23T18:29:13.495612+0000","last_active":"2024-04-23T18:29:52.549437+0000","last_peered":"2024-04-23T18:29:52.549437+0000","last_clean":"2024-04-23T18:29:52.549437+0000","last_became_active":"2024-04-23T18:29:13.495367+0000","last_became_peered":"2024-04-23T18:29:13.495367+0000","last_unstale":"2024-04-23T18:29:52.549437+0000","last_undegraded":"2024-04-23T18:29:52.549437+0000","last_fullsized":"2024-04-23T18:29:52.549437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:46.592957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542142+0000","last_change":"2024-04-23T18:29:11.496818+0000","last_active":"2024-04-23T18:29:52.542142+0000","last_peered":"2024-04-23T18:29:52.542142+0000","last_clean":"2024-04-23T18:29:52.542142+0000","last_became_active":"2024-04-23T18:29:11.495677+0000","last_became_peered":"2024-04-23T18:29:11.495677+0000","last_unstale":"2024-04-23T18:29:52.542142+0000","last_undegraded":"2024-04-23T18:29:52.542142+0000","last_fullsized":"2024-04-23T18:29:52.542142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:36.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223517+0000","last_change":"2024-04-23T18:29:52.558192+0000","last_active":"2024-04-23T18:32:21.223517+0000","last_peered":"2024-04-23T18:32:21.223517+0000","last_clean":"2024-04-23T18:32:21.223517+0000","last_became_active":"2024-04-23T18:29:52.548291+0000","last_became_peered":"2024-04-23T18:29:52.548291+0000","last_unstale":"2024-04-23T18:32:21.223517+0000","last_undegraded":"2024-04-23T18:32:21.223517+0000","last_fullsized":"2024-04-23T18:32:21.223517+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:21.650682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548661+0000","last_change":"2024-04-23T18:29:11.504896+0000","last_active":"2024-04-23T18:29:52.548661+0000","last_peered":"2024-04-23T18:29:52.548661+0000","last_clean":"2024-04-23T18:29:52.548661+0000","last_became_active":"2024-04-23T18:29:11.504554+0000","last_became_peered":"2024-04-23T18:29:11.504554+0000","last_unstale":"2024-04-23T18:29:52.548661+0000","last_undegraded":"2024-04-23T18:29:52.548661+0000","last_fullsized":"2024-04-23T18:29:52.548661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:17.981912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'5","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223019+0000","last_change":"2024-04-23T18:29:13.498634+0000","last_active":"2024-04-23T18:32:21.223019+0000","last_peered":"2024-04-23T18:32:21.223019+0000","last_clean":"2024-04-23T18:32:21.223019+0000","last_became_active":"2024-04-23T18:29:13.498378+0000","last_became_peered":"2024-04-23T18:29:13.498378+0000","last_unstale":"2024-04-23T18:32:21.223019+0000","last_undegraded":"2024-04-23T18:32:21.223019+0000","last_fullsized":"2024-04-23T18:32:21.223019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:53:35.946871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541220+0000","last_change":"2024-04-23T18:29:11.497271+0000","last_active":"2024-04-23T18:29:52.541220+0000","last_peered":"2024-04-23T18:29:52.541220+0000","last_clean":"2024-04-23T18:29:52.541220+0000","last_became_active":"2024-04-23T18:29:11.496923+0000","last_became_peered":"2024-04-23T18:29:11.496923+0000","last_unstale":"2024-04-23T18:29:52.541220+0000","last_undegraded":"2024-04-23T18:29:52.541220+0000","last_fullsized":"2024-04-23T18:29:52.541220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:28.851647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.758897+0000","last_change":"2024-04-23T18:29:13.503166+0000","last_active":"2024-04-23T18:29:53.758897+0000","last_peered":"2024-04-23T18:29:53.758897+0000","last_clean":"2024-04-23T18:29:53.758897+0000","last_became_active":"2024-04-23T18:29:13.502401+0000","last_became_peered":"2024-04-23T18:29:13.502401+0000","last_unstale":"2024-04-23T18:29:53.758897+0000","last_undegraded":"2024-04-23T18:29:53.758897+0000","last_fullsized":"2024-04-23T18:29:53.758897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:29:37.305411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.126025+0000","last_change":"2024-04-23T18:29:11.500102+0000","last_active":"2024-04-23T18:32:21.126025+0000","last_peered":"2024-04-23T18:32:21.126025+0000","last_clean":"2024-04-23T18:32:21.126025+0000","last_became_active":"2024-04-23T18:29:11.499772+0000","last_became_peered":"2024-04-23T18:29:11.499772+0000","last_unstale":"2024-04-23T18:32:21.126025+0000","last_undegraded":"2024-04-23T18:32:21.126025+0000","last_fullsized":"2024-04-23T18:32:21.126025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:33:31.780314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998531+0000","last_change":"2024-04-23T18:29:13.499669+0000","last_active":"2024-04-23T18:32:20.998531+0000","last_peered":"2024-04-23T18:32:20.998531+0000","last_clean":"2024-04-23T18:32:20.998531+0000","last_became_active":"2024-04-23T18:29:13.498965+0000","last_became_peered":"2024-04-23T18:29:13.498965+0000","last_unstale":"2024-04-23T18:32:20.998531+0000","last_undegraded":"2024-04-23T18:32:20.998531+0000","last_fullsized":"2024-04-23T18:32:20.998531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:55.148135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.524275+0000","last_change":"2024-04-23T18:29:11.493089+0000","last_active":"2024-04-23T18:31:20.524275+0000","last_peered":"2024-04-23T18:31:20.524275+0000","last_clean":"2024-04-23T18:31:20.524275+0000","last_became_active":"2024-04-23T18:29:11.491840+0000","last_became_peered":"2024-04-23T18:29:11.491840+0000","last_unstale":"2024-04-23T18:31:20.524275+0000","last_undegraded":"2024-04-23T18:31:20.524275+0000","last_fullsized":"2024-04-23T18:31:20.524275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:35.568983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136278+0000","last_change":"2024-04-23T18:29:13.505657+0000","last_active":"2024-04-23T18:32:21.136278+0000","last_peered":"2024-04-23T18:32:21.136278+0000","last_clean":"2024-04-23T18:32:21.136278+0000","last_became_active":"2024-04-23T18:29:13.505348+0000","last_became_peered":"2024-04-23T18:29:13.505348+0000","last_unstale":"2024-04-23T18:32:21.136278+0000","last_undegraded":"2024-04-23T18:32:21.136278+0000","last_fullsized":"2024-04-23T18:32:21.136278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:01.869007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.809404+0000","last_change":"2024-04-23T18:29:13.495619+0000","last_active":"2024-04-23T18:29:54.809404+0000","last_peered":"2024-04-23T18:29:54.809404+0000","last_clean":"2024-04-23T18:29:54.809404+0000","last_became_active":"2024-04-23T18:29:13.495337+0000","last_became_peered":"2024-04-23T18:29:13.495337+0000","last_unstale":"2024-04-23T18:29:54.809404+0000","last_undegraded":"2024-04-23T18:29:54.809404+0000","last_fullsized":"2024-04-23T18:29:54.809404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:01.568090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.207467+0000","last_change":"2024-04-23T18:29:11.502496+0000","last_active":"2024-04-23T18:29:53.207467+0000","last_peered":"2024-04-23T18:29:53.207467+0000","last_clean":"2024-04-23T18:29:53.207467+0000","last_became_active":"2024-04-23T18:29:11.501773+0000","last_became_peered":"2024-04-23T18:29:11.501773+0000","last_unstale":"2024-04-23T18:29:53.207467+0000","last_undegraded":"2024-04-23T18:29:53.207467+0000","last_fullsized":"2024-04-23T18:29:53.207467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:34.195698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.094606+0000","last_change":"2024-04-23T18:29:13.493129+0000","last_active":"2024-04-23T18:29:54.094606+0000","last_peered":"2024-04-23T18:29:54.094606+0000","last_clean":"2024-04-23T18:29:54.094606+0000","last_became_active":"2024-04-23T18:29:13.492366+0000","last_became_peered":"2024-04-23T18:29:13.492366+0000","last_unstale":"2024-04-23T18:29:54.094606+0000","last_undegraded":"2024-04-23T18:29:54.094606+0000","last_fullsized":"2024-04-23T18:29:54.094606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:55.148135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.500819+0000","last_change":"2024-04-23T18:29:11.486168+0000","last_active":"2024-04-23T18:31:20.500819+0000","last_peered":"2024-04-23T18:31:20.500819+0000","last_clean":"2024-04-23T18:31:20.500819+0000","last_became_active":"2024-04-23T18:29:11.484620+0000","last_became_peered":"2024-04-23T18:29:11.484620+0000","last_unstale":"2024-04-23T18:31:20.500819+0000","last_undegraded":"2024-04-23T18:31:20.500819+0000","last_fullsized":"2024-04-23T18:31:20.500819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:49.661961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'16","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216433+0000","last_change":"2024-04-23T18:29:13.496876+0000","last_active":"2024-04-23T18:32:21.216433+0000","last_peered":"2024-04-23T18:32:21.216433+0000","last_clean":"2024-04-23T18:32:21.216433+0000","last_became_active":"2024-04-23T18:29:13.495743+0000","last_became_peered":"2024-04-23T18:29:13.495743+0000","last_unstale":"2024-04-23T18:32:21.216433+0000","last_undegraded":"2024-04-23T18:32:21.216433+0000","last_fullsized":"2024-04-23T18:32:21.216433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:43.595018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547080+0000","last_change":"2024-04-23T18:29:11.494610+0000","last_active":"2024-04-23T18:29:52.547080+0000","last_peered":"2024-04-23T18:29:52.547080+0000","last_clean":"2024-04-23T18:29:52.547080+0000","last_became_active":"2024-04-23T18:29:11.493363+0000","last_became_peered":"2024-04-23T18:29:11.493363+0000","last_unstale":"2024-04-23T18:29:52.547080+0000","last_undegraded":"2024-04-23T18:29:52.547080+0000","last_fullsized":"2024-04-23T18:29:52.547080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:08:38.534696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'3","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759623+0000","last_change":"2024-04-23T18:29:13.502315+0000","last_active":"2024-04-23T18:31:39.759623+0000","last_peered":"2024-04-23T18:31:39.759623+0000","last_clean":"2024-04-23T18:31:39.759623+0000","last_became_active":"2024-04-23T18:29:13.501988+0000","last_became_peered":"2024-04-23T18:29:13.501988+0000","last_unstale":"2024-04-23T18:31:39.759623+0000","last_undegraded":"2024-04-23T18:31:39.759623+0000","last_fullsized":"2024-04-23T18:31:39.759623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:13:37.517178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546632+0000","last_change":"2024-04-23T18:29:11.503048+0000","last_active":"2024-04-23T18:29:52.546632+0000","last_peered":"2024-04-23T18:29:52.546632+0000","last_clean":"2024-04-23T18:29:52.546632+0000","last_became_active":"2024-04-23T18:29:11.502714+0000","last_became_peered":"2024-04-23T18:29:11.502714+0000","last_unstale":"2024-04-23T18:29:52.546632+0000","last_undegraded":"2024-04-23T18:29:52.546632+0000","last_fullsized":"2024-04-23T18:29:52.546632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:03.508942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216074+0000","last_change":"2024-04-23T18:29:13.499010+0000","last_active":"2024-04-23T18:32:21.216074+0000","last_peered":"2024-04-23T18:32:21.216074+0000","last_clean":"2024-04-23T18:32:21.216074+0000","last_became_active":"2024-04-23T18:29:13.498488+0000","last_became_peered":"2024-04-23T18:29:13.498488+0000","last_unstale":"2024-04-23T18:32:21.216074+0000","last_undegraded":"2024-04-23T18:32:21.216074+0000","last_fullsized":"2024-04-23T18:32:21.216074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:43.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548048+0000","last_change":"2024-04-23T18:29:11.495476+0000","last_active":"2024-04-23T18:29:52.548048+0000","last_peered":"2024-04-23T18:29:52.548048+0000","last_clean":"2024-04-23T18:29:52.548048+0000","last_became_active":"2024-04-23T18:29:11.495025+0000","last_became_peered":"2024-04-23T18:29:11.495025+0000","last_unstale":"2024-04-23T18:29:52.548048+0000","last_undegraded":"2024-04-23T18:29:52.548048+0000","last_fullsized":"2024-04-23T18:29:52.548048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:20.311305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.546632+0000","last_change":"2024-04-23T18:29:13.494330+0000","last_active":"2024-04-23T18:31:20.546632+0000","last_peered":"2024-04-23T18:31:20.546632+0000","last_clean":"2024-04-23T18:31:20.546632+0000","last_became_active":"2024-04-23T18:29:13.494080+0000","last_became_peered":"2024-04-23T18:29:13.494080+0000","last_unstale":"2024-04-23T18:31:20.546632+0000","last_undegraded":"2024-04-23T18:31:20.546632+0000","last_fullsized":"2024-04-23T18:31:20.546632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:19.116233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548882+0000","last_change":"2024-04-23T18:29:11.507699+0000","last_active":"2024-04-23T18:29:52.548882+0000","last_peered":"2024-04-23T18:29:52.548882+0000","last_clean":"2024-04-23T18:29:52.548882+0000","last_became_active":"2024-04-23T18:29:11.507336+0000","last_became_peered":"2024-04-23T18:29:11.507336+0000","last_unstale":"2024-04-23T18:29:52.548882+0000","last_undegraded":"2024-04-23T18:29:52.548882+0000","last_fullsized":"2024-04-23T18:29:52.548882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:33.718239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.160581+0000","last_change":"2024-04-23T18:29:21.530202+0000","last_active":"2024-04-23T18:32:21.160581+0000","last_peered":"2024-04-23T18:32:21.160581+0000","last_clean":"2024-04-23T18:32:21.160581+0000","last_became_active":"2024-04-23T18:29:21.529771+0000","last_became_peered":"2024-04-23T18:29:21.529771+0000","last_unstale":"2024-04-23T18:32:21.160581+0000","last_undegraded":"2024-04-23T18:32:21.160581+0000","last_fullsized":"2024-04-23T18:32:21.160581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:45.343308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'22","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216053+0000","last_change":"2024-04-23T18:29:52.561113+0000","last_active":"2024-04-23T18:32:21.216053+0000","last_peered":"2024-04-23T18:32:21.216053+0000","last_clean":"2024-04-23T18:32:21.216053+0000","last_became_active":"2024-04-23T18:29:52.549641+0000","last_became_peered":"2024-04-23T18:29:52.549641+0000","last_unstale":"2024-04-23T18:32:21.216053+0000","last_undegraded":"2024-04-23T18:32:21.216053+0000","last_fullsized":"2024-04-23T18:32:21.216053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:47:49.212714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":69,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761819+0000","last_change":"2024-04-23T18:29:11.512384+0000","last_active":"2024-04-23T18:31:31.761819+0000","last_peered":"2024-04-23T18:31:31.761819+0000","last_clean":"2024-04-23T18:31:31.761819+0000","last_became_active":"2024-04-23T18:29:11.512062+0000","last_became_peered":"2024-04-23T18:29:11.512062+0000","last_unstale":"2024-04-23T18:31:31.761819+0000","last_undegraded":"2024-04-23T18:31:31.761819+0000","last_fullsized":"2024-04-23T18:31:31.761819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:39.110614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552423+0000","last_change":"2024-04-23T18:29:15.508358+0000","last_active":"2024-04-23T18:29:52.552423+0000","last_peered":"2024-04-23T18:29:52.552423+0000","last_clean":"2024-04-23T18:29:52.552423+0000","last_became_active":"2024-04-23T18:29:15.508100+0000","last_became_peered":"2024-04-23T18:29:15.508100+0000","last_unstale":"2024-04-23T18:29:52.552423+0000","last_undegraded":"2024-04-23T18:29:52.552423+0000","last_fullsized":"2024-04-23T18:29:52.552423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:20.697054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.037486+0000","last_change":"2024-04-23T18:29:17.513687+0000","last_active":"2024-04-23T18:31:19.037486+0000","last_peered":"2024-04-23T18:31:19.037486+0000","last_clean":"2024-04-23T18:31:19.037486+0000","last_became_active":"2024-04-23T18:29:17.513368+0000","last_became_peered":"2024-04-23T18:29:17.513368+0000","last_unstale":"2024-04-23T18:31:19.037486+0000","last_undegraded":"2024-04-23T18:31:19.037486+0000","last_fullsized":"2024-04-23T18:31:19.037486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:24.244501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548046+0000","last_change":"2024-04-23T18:29:19.520367+0000","last_active":"2024-04-23T18:29:52.548046+0000","last_peered":"2024-04-23T18:29:52.548046+0000","last_clean":"2024-04-23T18:29:52.548046+0000","last_became_active":"2024-04-23T18:29:19.520066+0000","last_became_peered":"2024-04-23T18:29:19.520066+0000","last_unstale":"2024-04-23T18:29:52.548046+0000","last_undegraded":"2024-04-23T18:29:52.548046+0000","last_fullsized":"2024-04-23T18:29:52.548046+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:25.717857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.543713+0000","last_change":"2024-04-23T18:29:21.530037+0000","last_active":"2024-04-23T18:31:20.543713+0000","last_peered":"2024-04-23T18:31:20.543713+0000","last_clean":"2024-04-23T18:31:20.543713+0000","last_became_active":"2024-04-23T18:29:21.529743+0000","last_became_peered":"2024-04-23T18:29:21.529743+0000","last_unstale":"2024-04-23T18:31:20.543713+0000","last_undegraded":"2024-04-23T18:31:20.543713+0000","last_fullsized":"2024-04-23T18:31:20.543713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:07.650347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'9","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.005291+0000","last_change":"2024-04-23T18:29:13.496552+0000","last_active":"2024-04-23T18:32:21.005291+0000","last_peered":"2024-04-23T18:32:21.005291+0000","last_clean":"2024-04-23T18:32:21.005291+0000","last_became_active":"2024-04-23T18:29:13.496299+0000","last_became_peered":"2024-04-23T18:29:13.496299+0000","last_unstale":"2024-04-23T18:32:21.005291+0000","last_undegraded":"2024-04-23T18:32:21.005291+0000","last_fullsized":"2024-04-23T18:32:21.005291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:46.067635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.207501+0000","last_change":"2024-04-23T18:29:11.497209+0000","last_active":"2024-04-23T18:29:53.207501+0000","last_peered":"2024-04-23T18:29:53.207501+0000","last_clean":"2024-04-23T18:29:53.207501+0000","last_became_active":"2024-04-23T18:29:11.496878+0000","last_became_peered":"2024-04-23T18:29:11.496878+0000","last_unstale":"2024-04-23T18:29:53.207501+0000","last_undegraded":"2024-04-23T18:29:53.207501+0000","last_fullsized":"2024-04-23T18:29:53.207501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:03.508942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547455+0000","last_change":"2024-04-23T18:29:15.504985+0000","last_active":"2024-04-23T18:29:52.547455+0000","last_peered":"2024-04-23T18:29:52.547455+0000","last_clean":"2024-04-23T18:29:52.547455+0000","last_became_active":"2024-04-23T18:29:15.504744+0000","last_became_peered":"2024-04-23T18:29:15.504744+0000","last_unstale":"2024-04-23T18:29:52.547455+0000","last_undegraded":"2024-04-23T18:29:52.547455+0000","last_fullsized":"2024-04-23T18:29:52.547455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:03.110961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548072+0000","last_change":"2024-04-23T18:29:17.510462+0000","last_active":"2024-04-23T18:29:52.548072+0000","last_peered":"2024-04-23T18:29:52.548072+0000","last_clean":"2024-04-23T18:29:52.548072+0000","last_became_active":"2024-04-23T18:29:17.510201+0000","last_became_peered":"2024-04-23T18:29:17.510201+0000","last_unstale":"2024-04-23T18:29:52.548072+0000","last_undegraded":"2024-04-23T18:29:52.548072+0000","last_fullsized":"2024-04-23T18:29:52.548072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:45:44.947602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546953+0000","last_change":"2024-04-23T18:29:19.528113+0000","last_active":"2024-04-23T18:29:52.546953+0000","last_peered":"2024-04-23T18:29:52.546953+0000","last_clean":"2024-04-23T18:29:52.546953+0000","last_became_active":"2024-04-23T18:29:19.527770+0000","last_became_peered":"2024-04-23T18:29:19.527770+0000","last_unstale":"2024-04-23T18:29:52.546953+0000","last_undegraded":"2024-04-23T18:29:52.546953+0000","last_fullsized":"2024-04-23T18:29:52.546953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:24.718294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546581+0000","last_change":"2024-04-23T18:29:21.526235+0000","last_active":"2024-04-23T18:29:52.546581+0000","last_peered":"2024-04-23T18:29:52.546581+0000","last_clean":"2024-04-23T18:29:52.546581+0000","last_became_active":"2024-04-23T18:29:21.525940+0000","last_became_peered":"2024-04-23T18:29:21.525940+0000","last_unstale":"2024-04-23T18:29:52.546581+0000","last_undegraded":"2024-04-23T18:29:52.546581+0000","last_fullsized":"2024-04-23T18:29:52.546581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:59:38.457462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216175+0000","last_change":"2024-04-23T18:29:13.496417+0000","last_active":"2024-04-23T18:32:21.216175+0000","last_peered":"2024-04-23T18:32:21.216175+0000","last_clean":"2024-04-23T18:32:21.216175+0000","last_became_active":"2024-04-23T18:29:13.496142+0000","last_became_peered":"2024-04-23T18:29:13.496142+0000","last_unstale":"2024-04-23T18:32:21.216175+0000","last_undegraded":"2024-04-23T18:32:21.216175+0000","last_fullsized":"2024-04-23T18:32:21.216175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:36:50.428324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549926+0000","last_change":"2024-04-23T18:29:11.504850+0000","last_active":"2024-04-23T18:29:52.549926+0000","last_peered":"2024-04-23T18:29:52.549926+0000","last_clean":"2024-04-23T18:29:52.549926+0000","last_became_active":"2024-04-23T18:29:11.504534+0000","last_became_peered":"2024-04-23T18:29:11.504534+0000","last_unstale":"2024-04-23T18:29:52.549926+0000","last_undegraded":"2024-04-23T18:29:52.549926+0000","last_fullsized":"2024-04-23T18:29:52.549926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:52.910514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549373+0000","last_change":"2024-04-23T18:29:15.510428+0000","last_active":"2024-04-23T18:29:52.549373+0000","last_peered":"2024-04-23T18:29:52.549373+0000","last_clean":"2024-04-23T18:29:52.549373+0000","last_became_active":"2024-04-23T18:29:15.510018+0000","last_became_peered":"2024-04-23T18:29:15.510018+0000","last_unstale":"2024-04-23T18:29:52.549373+0000","last_undegraded":"2024-04-23T18:29:52.549373+0000","last_fullsized":"2024-04-23T18:29:52.549373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:31.579537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.323469+0000","last_change":"2024-04-23T18:29:17.518086+0000","last_active":"2024-04-23T18:29:54.323469+0000","last_peered":"2024-04-23T18:29:54.323469+0000","last_clean":"2024-04-23T18:29:54.323469+0000","last_became_active":"2024-04-23T18:29:17.517679+0000","last_became_peered":"2024-04-23T18:29:17.517679+0000","last_unstale":"2024-04-23T18:29:54.323469+0000","last_undegraded":"2024-04-23T18:29:54.323469+0000","last_fullsized":"2024-04-23T18:29:54.323469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:02:29.059730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585443+0000","last_change":"2024-04-23T18:29:19.522798+0000","last_active":"2024-04-23T18:32:20.585443+0000","last_peered":"2024-04-23T18:32:20.585443+0000","last_clean":"2024-04-23T18:32:20.585443+0000","last_became_active":"2024-04-23T18:29:19.522434+0000","last_became_peered":"2024-04-23T18:29:19.522434+0000","last_unstale":"2024-04-23T18:32:20.585443+0000","last_undegraded":"2024-04-23T18:32:20.585443+0000","last_fullsized":"2024-04-23T18:32:20.585443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:04:32.658811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541070+0000","last_change":"2024-04-23T18:29:21.529767+0000","last_active":"2024-04-23T18:29:52.541070+0000","last_peered":"2024-04-23T18:29:52.541070+0000","last_clean":"2024-04-23T18:29:52.541070+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:29:52.541070+0000","last_undegraded":"2024-04-23T18:29:52.541070+0000","last_fullsized":"2024-04-23T18:29:52.541070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:48:48.933035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278231+0000","last_change":"2024-04-23T18:29:13.499630+0000","last_active":"2024-04-23T18:31:17.278231+0000","last_peered":"2024-04-23T18:31:17.278231+0000","last_clean":"2024-04-23T18:31:17.278231+0000","last_became_active":"2024-04-23T18:29:13.499248+0000","last_became_peered":"2024-04-23T18:29:13.499248+0000","last_unstale":"2024-04-23T18:31:17.278231+0000","last_undegraded":"2024-04-23T18:31:17.278231+0000","last_fullsized":"2024-04-23T18:31:17.278231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:55:09.572902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542903+0000","last_change":"2024-04-23T18:29:11.488862+0000","last_active":"2024-04-23T18:29:52.542903+0000","last_peered":"2024-04-23T18:29:52.542903+0000","last_clean":"2024-04-23T18:29:52.542903+0000","last_became_active":"2024-04-23T18:29:11.488531+0000","last_became_peered":"2024-04-23T18:29:11.488531+0000","last_unstale":"2024-04-23T18:29:52.542903+0000","last_undegraded":"2024-04-23T18:29:52.542903+0000","last_fullsized":"2024-04-23T18:29:52.542903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:28.851647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552314+0000","last_change":"2024-04-23T18:29:15.511603+0000","last_active":"2024-04-23T18:29:52.552314+0000","last_peered":"2024-04-23T18:29:52.552314+0000","last_clean":"2024-04-23T18:29:52.552314+0000","last_became_active":"2024-04-23T18:29:15.511249+0000","last_became_peered":"2024-04-23T18:29:15.511249+0000","last_unstale":"2024-04-23T18:29:52.552314+0000","last_undegraded":"2024-04-23T18:29:52.552314+0000","last_fullsized":"2024-04-23T18:29:52.552314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:43:24.269505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.032342+0000","last_change":"2024-04-23T18:29:17.518244+0000","last_active":"2024-04-23T18:31:19.032342+0000","last_peered":"2024-04-23T18:31:19.032342+0000","last_clean":"2024-04-23T18:31:19.032342+0000","last_became_active":"2024-04-23T18:29:17.517964+0000","last_became_peered":"2024-04-23T18:29:17.517964+0000","last_unstale":"2024-04-23T18:31:19.032342+0000","last_undegraded":"2024-04-23T18:31:19.032342+0000","last_fullsized":"2024-04-23T18:31:19.032342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:49.766603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":444,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.752318+0000","last_change":"2024-04-23T18:29:19.525252+0000","last_active":"2024-04-23T18:32:27.752318+0000","last_peered":"2024-04-23T18:32:27.752318+0000","last_clean":"2024-04-23T18:32:27.752318+0000","last_became_active":"2024-04-23T18:29:19.524881+0000","last_became_peered":"2024-04-23T18:29:19.524881+0000","last_unstale":"2024-04-23T18:32:27.752318+0000","last_undegraded":"2024-04-23T18:32:27.752318+0000","last_fullsized":"2024-04-23T18:32:27.752318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:32.759949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185271+0000","last_change":"2024-04-23T18:29:13.502374+0000","last_active":"2024-04-23T18:32:21.185271+0000","last_peered":"2024-04-23T18:32:21.185271+0000","last_clean":"2024-04-23T18:32:21.185271+0000","last_became_active":"2024-04-23T18:29:13.501472+0000","last_became_peered":"2024-04-23T18:29:13.501472+0000","last_unstale":"2024-04-23T18:32:21.185271+0000","last_undegraded":"2024-04-23T18:32:21.185271+0000","last_fullsized":"2024-04-23T18:32:21.185271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:48.669984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'5","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.605427+0000","last_change":"2024-04-23T18:29:11.483640+0000","last_active":"2024-04-23T18:30:36.605427+0000","last_peered":"2024-04-23T18:30:36.605427+0000","last_clean":"2024-04-23T18:30:36.605427+0000","last_became_active":"2024-04-23T18:29:11.481977+0000","last_became_peered":"2024-04-23T18:29:11.481977+0000","last_unstale":"2024-04-23T18:30:36.605427+0000","last_undegraded":"2024-04-23T18:30:36.605427+0000","last_fullsized":"2024-04-23T18:30:36.605427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:55.553919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543298+0000","last_change":"2024-04-23T18:29:15.510021+0000","last_active":"2024-04-23T18:29:52.543298+0000","last_peered":"2024-04-23T18:29:52.543298+0000","last_clean":"2024-04-23T18:29:52.543298+0000","last_became_active":"2024-04-23T18:29:15.509711+0000","last_became_peered":"2024-04-23T18:29:15.509711+0000","last_unstale":"2024-04-23T18:29:52.543298+0000","last_undegraded":"2024-04-23T18:29:52.543298+0000","last_fullsized":"2024-04-23T18:29:52.543298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:31.895433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'40","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.041931+0000","last_change":"2024-04-23T18:29:17.511358+0000","last_active":"2024-04-23T18:31:19.041931+0000","last_peered":"2024-04-23T18:31:19.041931+0000","last_clean":"2024-04-23T18:31:19.041931+0000","last_became_active":"2024-04-23T18:29:17.511085+0000","last_became_peered":"2024-04-23T18:29:17.511085+0000","last_unstale":"2024-04-23T18:31:19.041931+0000","last_undegraded":"2024-04-23T18:31:19.041931+0000","last_fullsized":"2024-04-23T18:31:19.041931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:33.909507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547808+0000","last_change":"2024-04-23T18:29:19.527807+0000","last_active":"2024-04-23T18:29:52.547808+0000","last_peered":"2024-04-23T18:29:52.547808+0000","last_clean":"2024-04-23T18:29:52.547808+0000","last_became_active":"2024-04-23T18:29:19.527505+0000","last_became_peered":"2024-04-23T18:29:19.527505+0000","last_unstale":"2024-04-23T18:29:52.547808+0000","last_undegraded":"2024-04-23T18:29:52.547808+0000","last_fullsized":"2024-04-23T18:29:52.547808+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:22:25.429131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'13","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.636252+0000","last_change":"2024-04-23T18:29:21.532533+0000","last_active":"2024-04-23T18:32:20.636252+0000","last_peered":"2024-04-23T18:32:20.636252+0000","last_clean":"2024-04-23T18:32:20.636252+0000","last_became_active":"2024-04-23T18:29:21.532163+0000","last_became_peered":"2024-04-23T18:29:21.532163+0000","last_unstale":"2024-04-23T18:32:20.636252+0000","last_undegraded":"2024-04-23T18:32:20.636252+0000","last_fullsized":"2024-04-23T18:32:20.636252+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:51:35.252958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.795754+0000","last_change":"2024-04-23T18:29:13.494415+0000","last_active":"2024-04-23T18:30:36.795754+0000","last_peered":"2024-04-23T18:30:36.795754+0000","last_clean":"2024-04-23T18:30:36.795754+0000","last_became_active":"2024-04-23T18:29:13.494108+0000","last_became_peered":"2024-04-23T18:29:13.494108+0000","last_unstale":"2024-04-23T18:30:36.795754+0000","last_undegraded":"2024-04-23T18:30:36.795754+0000","last_fullsized":"2024-04-23T18:30:36.795754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:48.393428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543652+0000","last_change":"2024-04-23T18:29:11.481951+0000","last_active":"2024-04-23T18:29:52.543652+0000","last_peered":"2024-04-23T18:29:52.543652+0000","last_clean":"2024-04-23T18:29:52.543652+0000","last_became_active":"2024-04-23T18:29:11.481419+0000","last_became_peered":"2024-04-23T18:29:11.481419+0000","last_unstale":"2024-04-23T18:29:52.543652+0000","last_undegraded":"2024-04-23T18:29:52.543652+0000","last_fullsized":"2024-04-23T18:29:52.543652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:30.568409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546778+0000","last_change":"2024-04-23T18:29:15.510512+0000","last_active":"2024-04-23T18:29:52.546778+0000","last_peered":"2024-04-23T18:29:52.546778+0000","last_clean":"2024-04-23T18:29:52.546778+0000","last_became_active":"2024-04-23T18:29:15.510135+0000","last_became_peered":"2024-04-23T18:29:15.510135+0000","last_unstale":"2024-04-23T18:29:52.546778+0000","last_undegraded":"2024-04-23T18:29:52.546778+0000","last_fullsized":"2024-04-23T18:29:52.546778+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:34:51.553982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.021828+0000","last_change":"2024-04-23T18:29:17.513711+0000","last_active":"2024-04-23T18:31:19.021828+0000","last_peered":"2024-04-23T18:31:19.021828+0000","last_clean":"2024-04-23T18:31:19.021828+0000","last_became_active":"2024-04-23T18:29:17.513447+0000","last_became_peered":"2024-04-23T18:29:17.513447+0000","last_unstale":"2024-04-23T18:31:19.021828+0000","last_undegraded":"2024-04-23T18:31:19.021828+0000","last_fullsized":"2024-04-23T18:31:19.021828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:53.226081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546745+0000","last_change":"2024-04-23T18:29:19.518994+0000","last_active":"2024-04-23T18:29:52.546745+0000","last_peered":"2024-04-23T18:29:52.546745+0000","last_clean":"2024-04-23T18:29:52.546745+0000","last_became_active":"2024-04-23T18:29:19.518695+0000","last_became_peered":"2024-04-23T18:29:19.518695+0000","last_unstale":"2024-04-23T18:29:52.546745+0000","last_undegraded":"2024-04-23T18:29:52.546745+0000","last_fullsized":"2024-04-23T18:29:52.546745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:31:26.171589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.187825+0000","last_change":"2024-04-23T18:29:21.533423+0000","last_active":"2024-04-23T18:32:21.187825+0000","last_peered":"2024-04-23T18:32:21.187825+0000","last_clean":"2024-04-23T18:32:21.187825+0000","last_became_active":"2024-04-23T18:29:21.533103+0000","last_became_peered":"2024-04-23T18:29:21.533103+0000","last_unstale":"2024-04-23T18:32:21.187825+0000","last_undegraded":"2024-04-23T18:32:21.187825+0000","last_fullsized":"2024-04-23T18:32:21.187825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:55:25.843294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'12","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216152+0000","last_change":"2024-04-23T18:29:13.500105+0000","last_active":"2024-04-23T18:32:21.216152+0000","last_peered":"2024-04-23T18:32:21.216152+0000","last_clean":"2024-04-23T18:32:21.216152+0000","last_became_active":"2024-04-23T18:29:13.499795+0000","last_became_peered":"2024-04-23T18:29:13.499795+0000","last_unstale":"2024-04-23T18:32:21.216152+0000","last_undegraded":"2024-04-23T18:32:21.216152+0000","last_fullsized":"2024-04-23T18:32:21.216152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:53:51.760582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552836+0000","last_change":"2024-04-23T18:29:11.503536+0000","last_active":"2024-04-23T18:29:52.552836+0000","last_peered":"2024-04-23T18:29:52.552836+0000","last_clean":"2024-04-23T18:29:52.552836+0000","last_became_active":"2024-04-23T18:29:11.503228+0000","last_became_peered":"2024-04-23T18:29:11.503228+0000","last_unstale":"2024-04-23T18:29:52.552836+0000","last_undegraded":"2024-04-23T18:29:52.552836+0000","last_fullsized":"2024-04-23T18:29:52.552836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:41.470810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548689+0000","last_change":"2024-04-23T18:29:15.510453+0000","last_active":"2024-04-23T18:29:52.548689+0000","last_peered":"2024-04-23T18:29:52.548689+0000","last_clean":"2024-04-23T18:29:52.548689+0000","last_became_active":"2024-04-23T18:29:15.509856+0000","last_became_peered":"2024-04-23T18:29:15.509856+0000","last_unstale":"2024-04-23T18:29:52.548689+0000","last_undegraded":"2024-04-23T18:29:52.548689+0000","last_fullsized":"2024-04-23T18:29:52.548689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:23.285461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'39","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.760976+0000","last_change":"2024-04-23T18:29:17.517429+0000","last_active":"2024-04-23T18:31:26.760976+0000","last_peered":"2024-04-23T18:31:26.760976+0000","last_clean":"2024-04-23T18:31:26.760976+0000","last_became_active":"2024-04-23T18:29:17.517116+0000","last_became_peered":"2024-04-23T18:29:17.517116+0000","last_unstale":"2024-04-23T18:31:26.760976+0000","last_undegraded":"2024-04-23T18:31:26.760976+0000","last_fullsized":"2024-04-23T18:31:26.760976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:11.788105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":351,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.753716+0000","last_change":"2024-04-23T18:29:19.518873+0000","last_active":"2024-04-23T18:32:27.753716+0000","last_peered":"2024-04-23T18:32:27.753716+0000","last_clean":"2024-04-23T18:32:27.753716+0000","last_became_active":"2024-04-23T18:29:19.518519+0000","last_became_peered":"2024-04-23T18:29:19.518519+0000","last_unstale":"2024-04-23T18:32:27.753716+0000","last_undegraded":"2024-04-23T18:32:27.753716+0000","last_fullsized":"2024-04-23T18:32:27.753716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:06:53.742445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548413+0000","last_change":"2024-04-23T18:29:21.529229+0000","last_active":"2024-04-23T18:29:52.548413+0000","last_peered":"2024-04-23T18:29:52.548413+0000","last_clean":"2024-04-23T18:29:52.548413+0000","last_became_active":"2024-04-23T18:29:21.528917+0000","last_became_peered":"2024-04-23T18:29:21.528917+0000","last_unstale":"2024-04-23T18:29:52.548413+0000","last_undegraded":"2024-04-23T18:29:52.548413+0000","last_fullsized":"2024-04-23T18:29:52.548413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:23.465133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.320304+0000","last_change":"2024-04-23T18:29:13.499442+0000","last_active":"2024-04-23T18:29:54.320304+0000","last_peered":"2024-04-23T18:29:54.320304+0000","last_clean":"2024-04-23T18:29:54.320304+0000","last_became_active":"2024-04-23T18:29:13.499216+0000","last_became_peered":"2024-04-23T18:29:13.499216+0000","last_unstale":"2024-04-23T18:29:54.320304+0000","last_undegraded":"2024-04-23T18:29:54.320304+0000","last_fullsized":"2024-04-23T18:29:54.320304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:58.980385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.550696+0000","last_change":"2024-04-23T18:29:11.511581+0000","last_active":"2024-04-23T18:29:52.550696+0000","last_peered":"2024-04-23T18:29:52.550696+0000","last_clean":"2024-04-23T18:29:52.550696+0000","last_became_active":"2024-04-23T18:29:11.511211+0000","last_became_peered":"2024-04-23T18:29:11.511211+0000","last_unstale":"2024-04-23T18:29:52.550696+0000","last_undegraded":"2024-04-23T18:29:52.550696+0000","last_fullsized":"2024-04-23T18:29:52.550696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:53.141133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547414+0000","last_change":"2024-04-23T18:29:15.510812+0000","last_active":"2024-04-23T18:29:52.547414+0000","last_peered":"2024-04-23T18:29:52.547414+0000","last_clean":"2024-04-23T18:29:52.547414+0000","last_became_active":"2024-04-23T18:29:15.510350+0000","last_became_peered":"2024-04-23T18:29:15.510350+0000","last_unstale":"2024-04-23T18:29:52.547414+0000","last_undegraded":"2024-04-23T18:29:52.547414+0000","last_fullsized":"2024-04-23T18:29:52.547414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:37.877903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'54","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.045638+0000","last_change":"2024-04-23T18:29:17.514012+0000","last_active":"2024-04-23T18:31:19.045638+0000","last_peered":"2024-04-23T18:31:19.045638+0000","last_clean":"2024-04-23T18:31:19.045638+0000","last_became_active":"2024-04-23T18:29:17.513298+0000","last_became_peered":"2024-04-23T18:29:17.513298+0000","last_unstale":"2024-04-23T18:31:19.045638+0000","last_undegraded":"2024-04-23T18:31:19.045638+0000","last_fullsized":"2024-04-23T18:31:19.045638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:28:12.293067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546424+0000","last_change":"2024-04-23T18:29:19.518358+0000","last_active":"2024-04-23T18:29:52.546424+0000","last_peered":"2024-04-23T18:29:52.546424+0000","last_clean":"2024-04-23T18:29:52.546424+0000","last_became_active":"2024-04-23T18:29:19.518015+0000","last_became_peered":"2024-04-23T18:29:19.518015+0000","last_unstale":"2024-04-23T18:29:52.546424+0000","last_undegraded":"2024-04-23T18:29:52.546424+0000","last_fullsized":"2024-04-23T18:29:52.546424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:01:30.663315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.316527+0000","last_change":"2024-04-23T18:29:21.529718+0000","last_active":"2024-04-23T18:32:21.316527+0000","last_peered":"2024-04-23T18:32:21.316527+0000","last_clean":"2024-04-23T18:32:21.316527+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:32:21.316527+0000","last_undegraded":"2024-04-23T18:32:21.316527+0000","last_fullsized":"2024-04-23T18:32:21.316527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:45.962860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.997048+0000","last_change":"2024-04-23T18:29:52.558115+0000","last_active":"2024-04-23T18:32:20.997048+0000","last_peered":"2024-04-23T18:32:20.997048+0000","last_clean":"2024-04-23T18:32:20.997048+0000","last_became_active":"2024-04-23T18:29:52.550778+0000","last_became_peered":"2024-04-23T18:29:52.550778+0000","last_unstale":"2024-04-23T18:32:20.997048+0000","last_undegraded":"2024-04-23T18:32:20.997048+0000","last_fullsized":"2024-04-23T18:32:20.997048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:43.467982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547787+0000","last_change":"2024-04-23T18:29:11.486362+0000","last_active":"2024-04-23T18:29:52.547787+0000","last_peered":"2024-04-23T18:29:52.547787+0000","last_clean":"2024-04-23T18:29:52.547787+0000","last_became_active":"2024-04-23T18:29:11.485899+0000","last_became_peered":"2024-04-23T18:29:11.485899+0000","last_unstale":"2024-04-23T18:29:52.547787+0000","last_undegraded":"2024-04-23T18:29:52.547787+0000","last_fullsized":"2024-04-23T18:29:52.547787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:10.908021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.190971+0000","last_change":"2024-04-23T18:29:15.507275+0000","last_active":"2024-04-23T18:31:20.190971+0000","last_peered":"2024-04-23T18:31:20.190971+0000","last_clean":"2024-04-23T18:31:20.190971+0000","last_became_active":"2024-04-23T18:29:15.506940+0000","last_became_peered":"2024-04-23T18:29:15.506940+0000","last_unstale":"2024-04-23T18:31:20.190971+0000","last_undegraded":"2024-04-23T18:31:20.190971+0000","last_fullsized":"2024-04-23T18:31:20.190971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:52.970455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.026166+0000","last_change":"2024-04-23T18:29:17.510208+0000","last_active":"2024-04-23T18:31:19.026166+0000","last_peered":"2024-04-23T18:31:19.026166+0000","last_clean":"2024-04-23T18:31:19.026166+0000","last_became_active":"2024-04-23T18:29:17.509586+0000","last_became_peered":"2024-04-23T18:29:17.509586+0000","last_unstale":"2024-04-23T18:31:19.026166+0000","last_undegraded":"2024-04-23T18:31:19.026166+0000","last_fullsized":"2024-04-23T18:31:19.026166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:06.298521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551606+0000","last_change":"2024-04-23T18:29:19.522554+0000","last_active":"2024-04-23T18:29:52.551606+0000","last_peered":"2024-04-23T18:29:52.551606+0000","last_clean":"2024-04-23T18:29:52.551606+0000","last_became_active":"2024-04-23T18:29:19.521939+0000","last_became_peered":"2024-04-23T18:29:19.521939+0000","last_unstale":"2024-04-23T18:29:52.551606+0000","last_undegraded":"2024-04-23T18:29:52.551606+0000","last_fullsized":"2024-04-23T18:29:52.551606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:46.071667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760279+0000","last_change":"2024-04-23T18:29:21.531398+0000","last_active":"2024-04-23T18:31:21.760279+0000","last_peered":"2024-04-23T18:31:21.760279+0000","last_clean":"2024-04-23T18:31:21.760279+0000","last_became_active":"2024-04-23T18:29:21.530270+0000","last_became_peered":"2024-04-23T18:29:21.530270+0000","last_unstale":"2024-04-23T18:31:21.760279+0000","last_undegraded":"2024-04-23T18:31:21.760279+0000","last_fullsized":"2024-04-23T18:31:21.760279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:10:11.666403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136387+0000","last_change":"2024-04-23T18:29:13.504743+0000","last_active":"2024-04-23T18:32:21.136387+0000","last_peered":"2024-04-23T18:32:21.136387+0000","last_clean":"2024-04-23T18:32:21.136387+0000","last_became_active":"2024-04-23T18:29:13.501430+0000","last_became_peered":"2024-04-23T18:29:13.501430+0000","last_unstale":"2024-04-23T18:32:21.136387+0000","last_undegraded":"2024-04-23T18:32:21.136387+0000","last_fullsized":"2024-04-23T18:32:21.136387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:05:51.964842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.456289+0000","last_change":"2024-04-23T18:29:11.507985+0000","last_active":"2024-04-23T18:31:20.456289+0000","last_peered":"2024-04-23T18:31:20.456289+0000","last_clean":"2024-04-23T18:31:20.456289+0000","last_became_active":"2024-04-23T18:29:11.507633+0000","last_became_peered":"2024-04-23T18:29:11.507633+0000","last_unstale":"2024-04-23T18:31:20.456289+0000","last_undegraded":"2024-04-23T18:31:20.456289+0000","last_fullsized":"2024-04-23T18:31:20.456289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:03:30.412489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"25'1","reported_seq":220,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.717254+0000","last_change":"2024-04-23T18:29:15.510939+0000","last_active":"2024-04-23T18:32:27.717254+0000","last_peered":"2024-04-23T18:32:27.717254+0000","last_clean":"2024-04-23T18:32:27.717254+0000","last_became_active":"2024-04-23T18:29:15.510579+0000","last_became_peered":"2024-04-23T18:29:15.510579+0000","last_unstale":"2024-04-23T18:32:27.717254+0000","last_undegraded":"2024-04-23T18:32:27.717254+0000","last_fullsized":"2024-04-23T18:32:27.717254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:29.858474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.052643+0000","last_change":"2024-04-23T18:29:17.513300+0000","last_active":"2024-04-23T18:31:19.052643+0000","last_peered":"2024-04-23T18:31:19.052643+0000","last_clean":"2024-04-23T18:31:19.052643+0000","last_became_active":"2024-04-23T18:29:17.512935+0000","last_became_peered":"2024-04-23T18:29:17.512935+0000","last_unstale":"2024-04-23T18:31:19.052643+0000","last_undegraded":"2024-04-23T18:31:19.052643+0000","last_fullsized":"2024-04-23T18:31:19.052643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:03.290679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":431,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.316969+0000","last_change":"2024-04-23T18:29:19.526537+0000","last_active":"2024-04-23T18:32:21.316969+0000","last_peered":"2024-04-23T18:32:21.316969+0000","last_clean":"2024-04-23T18:32:21.316969+0000","last_became_active":"2024-04-23T18:29:19.526260+0000","last_became_peered":"2024-04-23T18:29:19.526260+0000","last_unstale":"2024-04-23T18:32:21.316969+0000","last_undegraded":"2024-04-23T18:32:21.316969+0000","last_fullsized":"2024-04-23T18:32:21.316969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:52.097068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:29.758096+0000","last_change":"2024-04-23T18:29:21.527340+0000","last_active":"2024-04-23T18:31:29.758096+0000","last_peered":"2024-04-23T18:31:29.758096+0000","last_clean":"2024-04-23T18:31:29.758096+0000","last_became_active":"2024-04-23T18:29:21.527108+0000","last_became_peered":"2024-04-23T18:29:21.527108+0000","last_unstale":"2024-04-23T18:31:29.758096+0000","last_undegraded":"2024-04-23T18:31:29.758096+0000","last_fullsized":"2024-04-23T18:31:29.758096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:47.675158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760391+0000","last_change":"2024-04-23T18:29:13.504838+0000","last_active":"2024-04-23T18:31:31.760391+0000","last_peered":"2024-04-23T18:31:31.760391+0000","last_clean":"2024-04-23T18:31:31.760391+0000","last_became_active":"2024-04-23T18:29:13.504570+0000","last_became_peered":"2024-04-23T18:29:13.504570+0000","last_unstale":"2024-04-23T18:31:31.760391+0000","last_undegraded":"2024-04-23T18:31:31.760391+0000","last_fullsized":"2024-04-23T18:31:31.760391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:10:09.191900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.204695+0000","last_change":"2024-04-23T18:29:11.505849+0000","last_active":"2024-04-23T18:29:53.204695+0000","last_peered":"2024-04-23T18:29:53.204695+0000","last_clean":"2024-04-23T18:29:53.204695+0000","last_became_active":"2024-04-23T18:29:11.505531+0000","last_became_peered":"2024-04-23T18:29:11.505531+0000","last_unstale":"2024-04-23T18:29:53.204695+0000","last_undegraded":"2024-04-23T18:29:53.204695+0000","last_fullsized":"2024-04-23T18:29:53.204695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:10:07.184898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.201161+0000","last_change":"2024-04-23T18:29:15.506623+0000","last_active":"2024-04-23T18:31:20.201161+0000","last_peered":"2024-04-23T18:31:20.201161+0000","last_clean":"2024-04-23T18:31:20.201161+0000","last_became_active":"2024-04-23T18:29:15.505983+0000","last_became_peered":"2024-04-23T18:29:15.505983+0000","last_unstale":"2024-04-23T18:31:20.201161+0000","last_undegraded":"2024-04-23T18:31:20.201161+0000","last_fullsized":"2024-04-23T18:31:20.201161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:09:17.947594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551087+0000","last_change":"2024-04-23T18:29:17.513606+0000","last_active":"2024-04-23T18:29:52.551087+0000","last_peered":"2024-04-23T18:29:52.551087+0000","last_clean":"2024-04-23T18:29:52.551087+0000","last_became_active":"2024-04-23T18:29:17.513213+0000","last_became_peered":"2024-04-23T18:29:17.513213+0000","last_unstale":"2024-04-23T18:29:52.551087+0000","last_undegraded":"2024-04-23T18:29:52.551087+0000","last_fullsized":"2024-04-23T18:29:52.551087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:09:31.064767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":468,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.277024+0000","last_change":"2024-04-23T18:29:19.520435+0000","last_active":"2024-04-23T18:32:21.277024+0000","last_peered":"2024-04-23T18:32:21.277024+0000","last_clean":"2024-04-23T18:32:21.277024+0000","last_became_active":"2024-04-23T18:29:19.518528+0000","last_became_peered":"2024-04-23T18:29:19.518528+0000","last_unstale":"2024-04-23T18:32:21.277024+0000","last_undegraded":"2024-04-23T18:32:21.277024+0000","last_fullsized":"2024-04-23T18:32:21.277024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:42.794724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.335123+0000","last_change":"2024-04-23T18:29:21.531220+0000","last_active":"2024-04-23T18:31:20.335123+0000","last_peered":"2024-04-23T18:31:20.335123+0000","last_clean":"2024-04-23T18:31:20.335123+0000","last_became_active":"2024-04-23T18:29:21.530946+0000","last_became_peered":"2024-04-23T18:29:21.530946+0000","last_unstale":"2024-04-23T18:31:20.335123+0000","last_undegraded":"2024-04-23T18:31:20.335123+0000","last_fullsized":"2024-04-23T18:31:20.335123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:52:56.737823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.145303+0000","last_change":"2024-04-23T18:29:13.508059+0000","last_active":"2024-04-23T18:32:21.145303+0000","last_peered":"2024-04-23T18:32:21.145303+0000","last_clean":"2024-04-23T18:32:21.145303+0000","last_became_active":"2024-04-23T18:29:13.507813+0000","last_became_peered":"2024-04-23T18:29:13.507813+0000","last_unstale":"2024-04-23T18:32:21.145303+0000","last_undegraded":"2024-04-23T18:32:21.145303+0000","last_fullsized":"2024-04-23T18:32:21.145303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:51.116517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549983+0000","last_change":"2024-04-23T18:29:11.501752+0000","last_active":"2024-04-23T18:29:52.549983+0000","last_peered":"2024-04-23T18:29:52.549983+0000","last_clean":"2024-04-23T18:29:52.549983+0000","last_became_active":"2024-04-23T18:29:11.501432+0000","last_became_peered":"2024-04-23T18:29:11.501432+0000","last_unstale":"2024-04-23T18:29:52.549983+0000","last_undegraded":"2024-04-23T18:29:52.549983+0000","last_fullsized":"2024-04-23T18:29:52.549983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:25:19.599288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552068+0000","last_change":"2024-04-23T18:29:15.510003+0000","last_active":"2024-04-23T18:29:52.552068+0000","last_peered":"2024-04-23T18:29:52.552068+0000","last_clean":"2024-04-23T18:29:52.552068+0000","last_became_active":"2024-04-23T18:29:15.509701+0000","last_became_peered":"2024-04-23T18:29:15.509701+0000","last_unstale":"2024-04-23T18:29:52.552068+0000","last_undegraded":"2024-04-23T18:29:52.552068+0000","last_fullsized":"2024-04-23T18:29:52.552068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:40.349247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'38","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.038568+0000","last_change":"2024-04-23T18:29:17.509954+0000","last_active":"2024-04-23T18:31:19.038568+0000","last_peered":"2024-04-23T18:31:19.038568+0000","last_clean":"2024-04-23T18:31:19.038568+0000","last_became_active":"2024-04-23T18:29:17.509672+0000","last_became_peered":"2024-04-23T18:29:17.509672+0000","last_unstale":"2024-04-23T18:31:19.038568+0000","last_undegraded":"2024-04-23T18:31:19.038568+0000","last_fullsized":"2024-04-23T18:31:19.038568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:05:55.987108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543479+0000","last_change":"2024-04-23T18:29:19.527128+0000","last_active":"2024-04-23T18:29:52.543479+0000","last_peered":"2024-04-23T18:29:52.543479+0000","last_clean":"2024-04-23T18:29:52.543479+0000","last_became_active":"2024-04-23T18:29:19.526861+0000","last_became_peered":"2024-04-23T18:29:19.526861+0000","last_unstale":"2024-04-23T18:29:52.543479+0000","last_undegraded":"2024-04-23T18:29:52.543479+0000","last_fullsized":"2024-04-23T18:29:52.543479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:48:19.499447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.250373+0000","last_change":"2024-04-23T18:29:21.530887+0000","last_active":"2024-04-23T18:32:21.250373+0000","last_peered":"2024-04-23T18:32:21.250373+0000","last_clean":"2024-04-23T18:32:21.250373+0000","last_became_active":"2024-04-23T18:29:21.530612+0000","last_became_peered":"2024-04-23T18:29:21.530612+0000","last_unstale":"2024-04-23T18:32:21.250373+0000","last_undegraded":"2024-04-23T18:32:21.250373+0000","last_fullsized":"2024-04-23T18:32:21.250373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:46.345887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278266+0000","last_change":"2024-04-23T18:29:13.502952+0000","last_active":"2024-04-23T18:31:17.278266+0000","last_peered":"2024-04-23T18:31:17.278266+0000","last_clean":"2024-04-23T18:31:17.278266+0000","last_became_active":"2024-04-23T18:29:13.501636+0000","last_became_peered":"2024-04-23T18:29:13.501636+0000","last_unstale":"2024-04-23T18:31:17.278266+0000","last_undegraded":"2024-04-23T18:31:17.278266+0000","last_fullsized":"2024-04-23T18:31:17.278266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:48:13.470014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542806+0000","last_change":"2024-04-23T18:28:58.798997+0000","last_active":"2024-04-23T18:29:52.542806+0000","last_peered":"2024-04-23T18:29:52.542806+0000","last_clean":"2024-04-23T18:29:52.542806+0000","last_became_active":"2024-04-23T18:28:58.798001+0000","last_became_peered":"2024-04-23T18:28:58.798001+0000","last_unstale":"2024-04-23T18:29:52.542806+0000","last_undegraded":"2024-04-23T18:29:52.542806+0000","last_fullsized":"2024-04-23T18:29:52.542806+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_clean_scrub_stamp":"2024-04-23T18:28:57.410644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:20.472050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548752+0000","last_change":"2024-04-23T18:29:03.446652+0000","last_active":"2024-04-23T18:29:52.548752+0000","last_peered":"2024-04-23T18:29:52.548752+0000","last_clean":"2024-04-23T18:29:52.548752+0000","last_became_active":"2024-04-23T18:29:03.446324+0000","last_became_peered":"2024-04-23T18:29:03.446324+0000","last_unstale":"2024-04-23T18:29:52.548752+0000","last_undegraded":"2024-04-23T18:29:52.548752+0000","last_fullsized":"2024-04-23T18:29:52.548752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:19.548449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.210752+0000","last_change":"2024-04-23T18:29:11.512994+0000","last_active":"2024-04-23T18:32:21.210752+0000","last_peered":"2024-04-23T18:32:21.210752+0000","last_clean":"2024-04-23T18:32:21.210752+0000","last_became_active":"2024-04-23T18:29:11.512684+0000","last_became_peered":"2024-04-23T18:29:11.512684+0000","last_unstale":"2024-04-23T18:32:21.210752+0000","last_undegraded":"2024-04-23T18:32:21.210752+0000","last_fullsized":"2024-04-23T18:32:21.210752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:05:16.645799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546263+0000","last_change":"2024-04-23T18:29:15.509604+0000","last_active":"2024-04-23T18:29:52.546263+0000","last_peered":"2024-04-23T18:29:52.546263+0000","last_clean":"2024-04-23T18:29:52.546263+0000","last_became_active":"2024-04-23T18:29:15.509209+0000","last_became_peered":"2024-04-23T18:29:15.509209+0000","last_unstale":"2024-04-23T18:29:52.546263+0000","last_undegraded":"2024-04-23T18:29:52.546263+0000","last_fullsized":"2024-04-23T18:29:52.546263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:36.226721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.050188+0000","last_change":"2024-04-23T18:29:17.513782+0000","last_active":"2024-04-23T18:31:19.050188+0000","last_peered":"2024-04-23T18:31:19.050188+0000","last_clean":"2024-04-23T18:31:19.050188+0000","last_became_active":"2024-04-23T18:29:17.513504+0000","last_became_peered":"2024-04-23T18:29:17.513504+0000","last_unstale":"2024-04-23T18:31:19.050188+0000","last_undegraded":"2024-04-23T18:31:19.050188+0000","last_fullsized":"2024-04-23T18:31:19.050188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:21.911021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548534+0000","last_change":"2024-04-23T18:29:19.519375+0000","last_active":"2024-04-23T18:29:52.548534+0000","last_peered":"2024-04-23T18:29:52.548534+0000","last_clean":"2024-04-23T18:29:52.548534+0000","last_became_active":"2024-04-23T18:29:19.518974+0000","last_became_peered":"2024-04-23T18:29:19.518974+0000","last_unstale":"2024-04-23T18:29:52.548534+0000","last_undegraded":"2024-04-23T18:29:52.548534+0000","last_fullsized":"2024-04-23T18:29:52.548534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:36:01.680036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":162,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.226604+0000","last_change":"2024-04-23T18:29:21.532023+0000","last_active":"2024-04-23T18:32:21.226604+0000","last_peered":"2024-04-23T18:32:21.226604+0000","last_clean":"2024-04-23T18:32:21.226604+0000","last_became_active":"2024-04-23T18:29:21.531725+0000","last_became_peered":"2024-04-23T18:29:21.531725+0000","last_unstale":"2024-04-23T18:32:21.226604+0000","last_undegraded":"2024-04-23T18:32:21.226604+0000","last_fullsized":"2024-04-23T18:32:21.226604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:44:23.460941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'5","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.909403+0000","last_change":"2024-04-23T18:29:13.497272+0000","last_active":"2024-04-23T18:32:20.909403+0000","last_peered":"2024-04-23T18:32:20.909403+0000","last_clean":"2024-04-23T18:32:20.909403+0000","last_became_active":"2024-04-23T18:29:13.497008+0000","last_became_peered":"2024-04-23T18:29:13.497008+0000","last_unstale":"2024-04-23T18:32:20.909403+0000","last_undegraded":"2024-04-23T18:32:20.909403+0000","last_fullsized":"2024-04-23T18:32:20.909403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:19.658217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547412+0000","last_change":"2024-04-23T18:29:03.447767+0000","last_active":"2024-04-23T18:29:52.547412+0000","last_peered":"2024-04-23T18:29:52.547412+0000","last_clean":"2024-04-23T18:29:52.547412+0000","last_became_active":"2024-04-23T18:29:03.447404+0000","last_became_peered":"2024-04-23T18:29:03.447404+0000","last_unstale":"2024-04-23T18:29:52.547412+0000","last_undegraded":"2024-04-23T18:29:52.547412+0000","last_fullsized":"2024-04-23T18:29:52.547412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:01:15.340699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546565+0000","last_change":"2024-04-23T18:29:11.487391+0000","last_active":"2024-04-23T18:29:52.546565+0000","last_peered":"2024-04-23T18:29:52.546565+0000","last_clean":"2024-04-23T18:29:52.546565+0000","last_became_active":"2024-04-23T18:29:11.486538+0000","last_became_peered":"2024-04-23T18:29:11.486538+0000","last_unstale":"2024-04-23T18:29:52.546565+0000","last_undegraded":"2024-04-23T18:29:52.546565+0000","last_fullsized":"2024-04-23T18:29:52.546565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:31:33.533609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552721+0000","last_change":"2024-04-23T18:29:15.508321+0000","last_active":"2024-04-23T18:29:52.552721+0000","last_peered":"2024-04-23T18:29:52.552721+0000","last_clean":"2024-04-23T18:29:52.552721+0000","last_became_active":"2024-04-23T18:29:15.508020+0000","last_became_peered":"2024-04-23T18:29:15.508020+0000","last_unstale":"2024-04-23T18:29:52.552721+0000","last_undegraded":"2024-04-23T18:29:52.552721+0000","last_fullsized":"2024-04-23T18:29:52.552721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:05.187203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'274","reported_seq":477,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585466+0000","last_change":"2024-04-23T18:29:17.515301+0000","last_active":"2024-04-23T18:32:20.585466+0000","last_peered":"2024-04-23T18:32:20.585466+0000","last_clean":"2024-04-23T18:32:20.585466+0000","last_became_active":"2024-04-23T18:29:17.515023+0000","last_became_peered":"2024-04-23T18:29:17.515023+0000","last_unstale":"2024-04-23T18:32:20.585466+0000","last_undegraded":"2024-04-23T18:32:20.585466+0000","last_fullsized":"2024-04-23T18:32:20.585466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:07:57.739742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551884+0000","last_change":"2024-04-23T18:29:19.522666+0000","last_active":"2024-04-23T18:29:52.551884+0000","last_peered":"2024-04-23T18:29:52.551884+0000","last_clean":"2024-04-23T18:29:52.551884+0000","last_became_active":"2024-04-23T18:29:19.522105+0000","last_became_peered":"2024-04-23T18:29:19.522105+0000","last_unstale":"2024-04-23T18:29:52.551884+0000","last_undegraded":"2024-04-23T18:29:52.551884+0000","last_fullsized":"2024-04-23T18:29:52.551884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:35.556440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.621034+0000","last_change":"2024-04-23T18:29:21.533582+0000","last_active":"2024-04-23T18:30:36.621034+0000","last_peered":"2024-04-23T18:30:36.621034+0000","last_clean":"2024-04-23T18:30:36.621034+0000","last_became_active":"2024-04-23T18:29:21.532867+0000","last_became_peered":"2024-04-23T18:29:21.532867+0000","last_unstale":"2024-04-23T18:30:36.621034+0000","last_undegraded":"2024-04-23T18:30:36.621034+0000","last_fullsized":"2024-04-23T18:30:36.621034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:30:13.562825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549403+0000","last_change":"2024-04-23T18:29:13.499606+0000","last_active":"2024-04-23T18:29:52.549403+0000","last_peered":"2024-04-23T18:29:52.549403+0000","last_clean":"2024-04-23T18:29:52.549403+0000","last_became_active":"2024-04-23T18:29:13.499253+0000","last_became_peered":"2024-04-23T18:29:13.499253+0000","last_unstale":"2024-04-23T18:29:52.549403+0000","last_undegraded":"2024-04-23T18:29:52.549403+0000","last_fullsized":"2024-04-23T18:29:52.549403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:12:00.717757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.540896+0000","last_change":"2024-04-23T18:29:03.447054+0000","last_active":"2024-04-23T18:29:52.540896+0000","last_peered":"2024-04-23T18:29:52.540896+0000","last_clean":"2024-04-23T18:29:52.540896+0000","last_became_active":"2024-04-23T18:29:03.446647+0000","last_became_peered":"2024-04-23T18:29:03.446647+0000","last_unstale":"2024-04-23T18:29:52.540896+0000","last_undegraded":"2024-04-23T18:29:52.540896+0000","last_fullsized":"2024-04-23T18:29:52.540896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:57.409435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546219+0000","last_change":"2024-04-23T18:29:11.492974+0000","last_active":"2024-04-23T18:29:52.546219+0000","last_peered":"2024-04-23T18:29:52.546219+0000","last_clean":"2024-04-23T18:29:52.546219+0000","last_became_active":"2024-04-23T18:29:11.491953+0000","last_became_peered":"2024-04-23T18:29:11.491953+0000","last_unstale":"2024-04-23T18:29:52.546219+0000","last_undegraded":"2024-04-23T18:29:52.546219+0000","last_fullsized":"2024-04-23T18:29:52.546219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:45:27.531143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.563923+0000","last_change":"2024-04-23T18:29:52.563435+0000","last_active":"2024-04-23T18:29:52.563923+0000","last_peered":"2024-04-23T18:29:52.563923+0000","last_clean":"2024-04-23T18:29:52.563923+0000","last_became_active":"2024-04-23T18:29:52.551265+0000","last_became_peered":"2024-04-23T18:29:52.551265+0000","last_unstale":"2024-04-23T18:29:52.563923+0000","last_undegraded":"2024-04-23T18:29:52.563923+0000","last_fullsized":"2024-04-23T18:29:52.563923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:59:39.312725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585625+0000","last_change":"2024-04-23T18:29:17.514185+0000","last_active":"2024-04-23T18:32:20.585625+0000","last_peered":"2024-04-23T18:32:20.585625+0000","last_clean":"2024-04-23T18:32:20.585625+0000","last_became_active":"2024-04-23T18:29:17.513875+0000","last_became_peered":"2024-04-23T18:29:17.513875+0000","last_unstale":"2024-04-23T18:32:20.585625+0000","last_undegraded":"2024-04-23T18:32:20.585625+0000","last_fullsized":"2024-04-23T18:32:20.585625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:59:32.280321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548106+0000","last_change":"2024-04-23T18:29:19.519133+0000","last_active":"2024-04-23T18:29:52.548106+0000","last_peered":"2024-04-23T18:29:52.548106+0000","last_clean":"2024-04-23T18:29:52.548106+0000","last_became_active":"2024-04-23T18:29:19.518744+0000","last_became_peered":"2024-04-23T18:29:19.518744+0000","last_unstale":"2024-04-23T18:29:52.548106+0000","last_undegraded":"2024-04-23T18:29:52.548106+0000","last_fullsized":"2024-04-23T18:29:52.548106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:05:47.618962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.756328+0000","last_change":"2024-04-23T18:29:21.533685+0000","last_active":"2024-04-23T18:29:53.756328+0000","last_peered":"2024-04-23T18:29:53.756328+0000","last_clean":"2024-04-23T18:29:53.756328+0000","last_became_active":"2024-04-23T18:29:21.533358+0000","last_became_peered":"2024-04-23T18:29:21.533358+0000","last_unstale":"2024-04-23T18:29:53.756328+0000","last_undegraded":"2024-04-23T18:29:53.756328+0000","last_fullsized":"2024-04-23T18:29:53.756328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:52.473352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136286+0000","last_change":"2024-04-23T18:29:13.493749+0000","last_active":"2024-04-23T18:32:21.136286+0000","last_peered":"2024-04-23T18:32:21.136286+0000","last_clean":"2024-04-23T18:32:21.136286+0000","last_became_active":"2024-04-23T18:29:13.493321+0000","last_became_peered":"2024-04-23T18:29:13.493321+0000","last_unstale":"2024-04-23T18:32:21.136286+0000","last_undegraded":"2024-04-23T18:32:21.136286+0000","last_fullsized":"2024-04-23T18:32:21.136286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:42:30.926554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548411+0000","last_change":"2024-04-23T18:29:03.446774+0000","last_active":"2024-04-23T18:29:52.548411+0000","last_peered":"2024-04-23T18:29:52.548411+0000","last_clean":"2024-04-23T18:29:52.548411+0000","last_became_active":"2024-04-23T18:29:03.446457+0000","last_became_peered":"2024-04-23T18:29:03.446457+0000","last_unstale":"2024-04-23T18:29:52.548411+0000","last_undegraded":"2024-04-23T18:29:52.548411+0000","last_fullsized":"2024-04-23T18:29:52.548411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:14.074221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.863350+0000","last_change":"2024-04-23T18:29:11.483348+0000","last_active":"2024-04-23T18:32:20.863350+0000","last_peered":"2024-04-23T18:32:20.863350+0000","last_clean":"2024-04-23T18:32:20.863350+0000","last_became_active":"2024-04-23T18:29:11.482896+0000","last_became_peered":"2024-04-23T18:29:11.482896+0000","last_unstale":"2024-04-23T18:32:20.863350+0000","last_undegraded":"2024-04-23T18:32:20.863350+0000","last_fullsized":"2024-04-23T18:32:20.863350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:53.629794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548218+0000","last_change":"2024-04-23T18:29:15.507664+0000","last_active":"2024-04-23T18:29:52.548218+0000","last_peered":"2024-04-23T18:29:52.548218+0000","last_clean":"2024-04-23T18:29:52.548218+0000","last_became_active":"2024-04-23T18:29:15.507357+0000","last_became_peered":"2024-04-23T18:29:15.507357+0000","last_unstale":"2024-04-23T18:29:52.548218+0000","last_undegraded":"2024-04-23T18:29:52.548218+0000","last_fullsized":"2024-04-23T18:29:52.548218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:47.440112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.560727+0000","last_change":"2024-04-23T18:29:17.514159+0000","last_active":"2024-04-23T18:32:20.560727+0000","last_peered":"2024-04-23T18:32:20.560727+0000","last_clean":"2024-04-23T18:32:20.560727+0000","last_became_active":"2024-04-23T18:29:17.513393+0000","last_became_peered":"2024-04-23T18:29:17.513393+0000","last_unstale":"2024-04-23T18:32:20.560727+0000","last_undegraded":"2024-04-23T18:32:20.560727+0000","last_fullsized":"2024-04-23T18:32:20.560727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:46:31.465490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551911+0000","last_change":"2024-04-23T18:29:19.523513+0000","last_active":"2024-04-23T18:29:52.551911+0000","last_peered":"2024-04-23T18:29:52.551911+0000","last_clean":"2024-04-23T18:29:52.551911+0000","last_became_active":"2024-04-23T18:29:19.523070+0000","last_became_peered":"2024-04-23T18:29:19.523070+0000","last_unstale":"2024-04-23T18:29:52.551911+0000","last_undegraded":"2024-04-23T18:29:52.551911+0000","last_fullsized":"2024-04-23T18:29:52.551911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:53.579124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.926481+0000","last_change":"2024-04-23T18:29:21.529180+0000","last_active":"2024-04-23T18:32:20.926481+0000","last_peered":"2024-04-23T18:32:20.926481+0000","last_clean":"2024-04-23T18:32:20.926481+0000","last_became_active":"2024-04-23T18:29:21.528764+0000","last_became_peered":"2024-04-23T18:29:21.528764+0000","last_unstale":"2024-04-23T18:32:20.926481+0000","last_undegraded":"2024-04-23T18:32:20.926481+0000","last_fullsized":"2024-04-23T18:32:20.926481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:15:30.851670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546769+0000","last_change":"2024-04-23T18:29:13.507864+0000","last_active":"2024-04-23T18:29:52.546769+0000","last_peered":"2024-04-23T18:29:52.546769+0000","last_clean":"2024-04-23T18:29:52.546769+0000","last_became_active":"2024-04-23T18:29:13.507496+0000","last_became_peered":"2024-04-23T18:29:13.507496+0000","last_unstale":"2024-04-23T18:29:52.546769+0000","last_undegraded":"2024-04-23T18:29:52.546769+0000","last_fullsized":"2024-04-23T18:29:52.546769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:36.947062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541796+0000","last_change":"2024-04-23T18:29:11.483379+0000","last_active":"2024-04-23T18:29:52.541796+0000","last_peered":"2024-04-23T18:29:52.541796+0000","last_clean":"2024-04-23T18:29:52.541796+0000","last_became_active":"2024-04-23T18:29:11.482348+0000","last_became_peered":"2024-04-23T18:29:11.482348+0000","last_unstale":"2024-04-23T18:29:52.541796+0000","last_undegraded":"2024-04-23T18:29:52.541796+0000","last_fullsized":"2024-04-23T18:29:52.541796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:47:48.291376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547947+0000","last_change":"2024-04-23T18:29:03.446643+0000","last_active":"2024-04-23T18:29:52.547947+0000","last_peered":"2024-04-23T18:29:52.547947+0000","last_clean":"2024-04-23T18:29:52.547947+0000","last_became_active":"2024-04-23T18:29:03.446286+0000","last_became_peered":"2024-04-23T18:29:03.446286+0000","last_unstale":"2024-04-23T18:29:52.547947+0000","last_undegraded":"2024-04-23T18:29:52.547947+0000","last_fullsized":"2024-04-23T18:29:52.547947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:42.594846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:56.764032+0000","last_change":"2024-04-23T18:29:52.554181+0000","last_active":"2024-04-23T18:31:56.764032+0000","last_peered":"2024-04-23T18:31:56.764032+0000","last_clean":"2024-04-23T18:31:56.764032+0000","last_became_active":"2024-04-23T18:29:52.553851+0000","last_became_peered":"2024-04-23T18:29:52.553851+0000","last_unstale":"2024-04-23T18:31:56.764032+0000","last_undegraded":"2024-04-23T18:31:56.764032+0000","last_fullsized":"2024-04-23T18:31:56.764032+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:05.187203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'67","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.841467+0000","last_change":"2024-04-23T18:29:17.513936+0000","last_active":"2024-04-23T18:32:27.841467+0000","last_peered":"2024-04-23T18:32:27.841467+0000","last_clean":"2024-04-23T18:32:27.841467+0000","last_became_active":"2024-04-23T18:29:17.513599+0000","last_became_peered":"2024-04-23T18:29:17.513599+0000","last_unstale":"2024-04-23T18:32:27.841467+0000","last_undegraded":"2024-04-23T18:32:27.841467+0000","last_fullsized":"2024-04-23T18:32:27.841467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:56:07.867139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541648+0000","last_change":"2024-04-23T18:29:19.526480+0000","last_active":"2024-04-23T18:29:52.541648+0000","last_peered":"2024-04-23T18:29:52.541648+0000","last_clean":"2024-04-23T18:29:52.541648+0000","last_became_active":"2024-04-23T18:29:19.526192+0000","last_became_peered":"2024-04-23T18:29:19.526192+0000","last_unstale":"2024-04-23T18:29:52.541648+0000","last_undegraded":"2024-04-23T18:29:52.541648+0000","last_fullsized":"2024-04-23T18:29:52.541648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:36:56.457757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.486845+0000","last_change":"2024-04-23T18:29:21.533405+0000","last_active":"2024-04-23T18:31:20.486845+0000","last_peered":"2024-04-23T18:31:20.486845+0000","last_clean":"2024-04-23T18:31:20.486845+0000","last_became_active":"2024-04-23T18:29:21.533202+0000","last_became_peered":"2024-04-23T18:29:21.533202+0000","last_unstale":"2024-04-23T18:31:20.486845+0000","last_undegraded":"2024-04-23T18:31:20.486845+0000","last_fullsized":"2024-04-23T18:31:20.486845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:54:11.716719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":32,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'1","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.759332+0000","last_change":"2024-04-23T18:29:13.507056+0000","last_active":"2024-04-23T18:31:21.759332+0000","last_peered":"2024-04-23T18:31:21.759332+0000","last_clean":"2024-04-23T18:31:21.759332+0000","last_became_active":"2024-04-23T18:29:13.506795+0000","last_became_peered":"2024-04-23T18:29:13.506795+0000","last_unstale":"2024-04-23T18:31:21.759332+0000","last_undegraded":"2024-04-23T18:31:21.759332+0000","last_fullsized":"2024-04-23T18:31:21.759332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:39.344472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548249+0000","last_change":"2024-04-23T18:29:11.492325+0000","last_active":"2024-04-23T18:29:52.548249+0000","last_peered":"2024-04-23T18:29:52.548249+0000","last_clean":"2024-04-23T18:29:52.548249+0000","last_became_active":"2024-04-23T18:29:11.491882+0000","last_became_peered":"2024-04-23T18:29:11.491882+0000","last_unstale":"2024-04-23T18:29:52.548249+0000","last_undegraded":"2024-04-23T18:29:52.548249+0000","last_fullsized":"2024-04-23T18:29:52.548249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:32:57.364121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552526+0000","last_change":"2024-04-23T18:29:03.447598+0000","last_active":"2024-04-23T18:29:52.552526+0000","last_peered":"2024-04-23T18:29:52.552526+0000","last_clean":"2024-04-23T18:29:52.552526+0000","last_became_active":"2024-04-23T18:29:03.447265+0000","last_became_peered":"2024-04-23T18:29:03.447265+0000","last_unstale":"2024-04-23T18:29:52.552526+0000","last_undegraded":"2024-04-23T18:29:52.552526+0000","last_fullsized":"2024-04-23T18:29:52.552526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:56.204409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548211+0000","last_change":"2024-04-23T18:29:15.506698+0000","last_active":"2024-04-23T18:29:52.548211+0000","last_peered":"2024-04-23T18:29:52.548211+0000","last_clean":"2024-04-23T18:29:52.548211+0000","last_became_active":"2024-04-23T18:29:15.506394+0000","last_became_peered":"2024-04-23T18:29:15.506394+0000","last_unstale":"2024-04-23T18:29:52.548211+0000","last_undegraded":"2024-04-23T18:29:52.548211+0000","last_fullsized":"2024-04-23T18:29:52.548211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:21.696617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543554+0000","last_change":"2024-04-23T18:29:17.515730+0000","last_active":"2024-04-23T18:29:52.543554+0000","last_peered":"2024-04-23T18:29:52.543554+0000","last_clean":"2024-04-23T18:29:52.543554+0000","last_became_active":"2024-04-23T18:29:17.515048+0000","last_became_peered":"2024-04-23T18:29:17.515048+0000","last_unstale":"2024-04-23T18:29:52.543554+0000","last_undegraded":"2024-04-23T18:29:52.543554+0000","last_fullsized":"2024-04-23T18:29:52.543554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:23.680483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":369,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585547+0000","last_change":"2024-04-23T18:29:19.518964+0000","last_active":"2024-04-23T18:32:20.585547+0000","last_peered":"2024-04-23T18:32:20.585547+0000","last_clean":"2024-04-23T18:32:20.585547+0000","last_became_active":"2024-04-23T18:29:19.518668+0000","last_became_peered":"2024-04-23T18:29:19.518668+0000","last_unstale":"2024-04-23T18:32:20.585547+0000","last_undegraded":"2024-04-23T18:32:20.585547+0000","last_fullsized":"2024-04-23T18:32:20.585547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:07.298508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.170755+0000","last_change":"2024-04-23T18:29:21.531478+0000","last_active":"2024-04-23T18:32:21.170755+0000","last_peered":"2024-04-23T18:32:21.170755+0000","last_clean":"2024-04-23T18:32:21.170755+0000","last_became_active":"2024-04-23T18:29:21.531185+0000","last_became_peered":"2024-04-23T18:29:21.531185+0000","last_unstale":"2024-04-23T18:32:21.170755+0000","last_undegraded":"2024-04-23T18:32:21.170755+0000","last_fullsized":"2024-04-23T18:32:21.170755+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:10.167276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.538256+0000","last_change":"2024-04-23T18:29:13.504754+0000","last_active":"2024-04-23T18:31:20.538256+0000","last_peered":"2024-04-23T18:31:20.538256+0000","last_clean":"2024-04-23T18:31:20.538256+0000","last_became_active":"2024-04-23T18:29:13.503543+0000","last_became_peered":"2024-04-23T18:29:13.503543+0000","last_unstale":"2024-04-23T18:31:20.538256+0000","last_undegraded":"2024-04-23T18:31:20.538256+0000","last_fullsized":"2024-04-23T18:31:20.538256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:55:58.292535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760523+0000","last_change":"2024-04-23T18:29:11.505973+0000","last_active":"2024-04-23T18:31:21.760523+0000","last_peered":"2024-04-23T18:31:21.760523+0000","last_clean":"2024-04-23T18:31:21.760523+0000","last_became_active":"2024-04-23T18:29:11.505604+0000","last_became_peered":"2024-04-23T18:29:11.505604+0000","last_unstale":"2024-04-23T18:31:21.760523+0000","last_undegraded":"2024-04-23T18:31:21.760523+0000","last_fullsized":"2024-04-23T18:31:21.760523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:26.018597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548860+0000","last_change":"2024-04-23T18:29:03.446013+0000","last_active":"2024-04-23T18:29:52.548860+0000","last_peered":"2024-04-23T18:29:52.548860+0000","last_clean":"2024-04-23T18:29:52.548860+0000","last_became_active":"2024-04-23T18:29:03.445715+0000","last_became_peered":"2024-04-23T18:29:03.445715+0000","last_unstale":"2024-04-23T18:29:52.548860+0000","last_undegraded":"2024-04-23T18:29:52.548860+0000","last_fullsized":"2024-04-23T18:29:52.548860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:39.084066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.550999+0000","last_change":"2024-04-23T18:29:15.511864+0000","last_active":"2024-04-23T18:29:52.550999+0000","last_peered":"2024-04-23T18:29:52.550999+0000","last_clean":"2024-04-23T18:29:52.550999+0000","last_became_active":"2024-04-23T18:29:15.511553+0000","last_became_peered":"2024-04-23T18:29:15.511553+0000","last_unstale":"2024-04-23T18:29:52.550999+0000","last_undegraded":"2024-04-23T18:29:52.550999+0000","last_fullsized":"2024-04-23T18:29:52.550999+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:20.797539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760395+0000","last_change":"2024-04-23T18:29:17.516388+0000","last_active":"2024-04-23T18:31:21.760395+0000","last_peered":"2024-04-23T18:31:21.760395+0000","last_clean":"2024-04-23T18:31:21.760395+0000","last_became_active":"2024-04-23T18:29:17.515741+0000","last_became_peered":"2024-04-23T18:29:17.515741+0000","last_unstale":"2024-04-23T18:31:21.760395+0000","last_undegraded":"2024-04-23T18:31:21.760395+0000","last_fullsized":"2024-04-23T18:31:21.760395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:29:57.339089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":402,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.751100+0000","last_change":"2024-04-23T18:29:19.526580+0000","last_active":"2024-04-23T18:32:27.751100+0000","last_peered":"2024-04-23T18:32:27.751100+0000","last_clean":"2024-04-23T18:32:27.751100+0000","last_became_active":"2024-04-23T18:29:19.526375+0000","last_became_peered":"2024-04-23T18:29:19.526375+0000","last_unstale":"2024-04-23T18:32:27.751100+0000","last_undegraded":"2024-04-23T18:32:27.751100+0000","last_fullsized":"2024-04-23T18:32:27.751100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:22.422967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.097904+0000","last_change":"2024-04-23T18:29:21.531204+0000","last_active":"2024-04-23T18:29:54.097904+0000","last_peered":"2024-04-23T18:29:54.097904+0000","last_clean":"2024-04-23T18:29:54.097904+0000","last_became_active":"2024-04-23T18:29:21.530911+0000","last_became_peered":"2024-04-23T18:29:21.530911+0000","last_unstale":"2024-04-23T18:29:54.097904+0000","last_undegraded":"2024-04-23T18:29:54.097904+0000","last_fullsized":"2024-04-23T18:29:54.097904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:38:26.331563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'16","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998529+0000","last_change":"2024-04-23T18:29:13.499873+0000","last_active":"2024-04-23T18:32:20.998529+0000","last_peered":"2024-04-23T18:32:20.998529+0000","last_clean":"2024-04-23T18:32:20.998529+0000","last_became_active":"2024-04-23T18:29:13.499603+0000","last_became_peered":"2024-04-23T18:29:13.499603+0000","last_unstale":"2024-04-23T18:32:20.998529+0000","last_undegraded":"2024-04-23T18:32:20.998529+0000","last_fullsized":"2024-04-23T18:32:20.998529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:17.317212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547877+0000","last_change":"2024-04-23T18:29:11.488874+0000","last_active":"2024-04-23T18:29:52.547877+0000","last_peered":"2024-04-23T18:29:52.547877+0000","last_clean":"2024-04-23T18:29:52.547877+0000","last_became_active":"2024-04-23T18:29:11.488500+0000","last_became_peered":"2024-04-23T18:29:11.488500+0000","last_unstale":"2024-04-23T18:29:52.547877+0000","last_undegraded":"2024-04-23T18:29:52.547877+0000","last_fullsized":"2024-04-23T18:29:52.547877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:52.597685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552056+0000","last_change":"2024-04-23T18:29:03.594008+0000","last_active":"2024-04-23T18:29:52.552056+0000","last_peered":"2024-04-23T18:29:52.552056+0000","last_clean":"2024-04-23T18:29:52.552056+0000","last_became_active":"2024-04-23T18:29:03.593691+0000","last_became_peered":"2024-04-23T18:29:03.593691+0000","last_unstale":"2024-04-23T18:29:52.552056+0000","last_undegraded":"2024-04-23T18:29:52.552056+0000","last_fullsized":"2024-04-23T18:29:52.552056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:18:59.128475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549901+0000","last_change":"2024-04-23T18:29:15.513067+0000","last_active":"2024-04-23T18:29:52.549901+0000","last_peered":"2024-04-23T18:29:52.549901+0000","last_clean":"2024-04-23T18:29:52.549901+0000","last_became_active":"2024-04-23T18:29:15.511207+0000","last_became_peered":"2024-04-23T18:29:15.511207+0000","last_unstale":"2024-04-23T18:29:52.549901+0000","last_undegraded":"2024-04-23T18:29:52.549901+0000","last_fullsized":"2024-04-23T18:29:52.549901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:23.658875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.036554+0000","last_change":"2024-04-23T18:29:17.515549+0000","last_active":"2024-04-23T18:31:19.036554+0000","last_peered":"2024-04-23T18:31:19.036554+0000","last_clean":"2024-04-23T18:31:19.036554+0000","last_became_active":"2024-04-23T18:29:17.515004+0000","last_became_peered":"2024-04-23T18:29:17.515004+0000","last_unstale":"2024-04-23T18:31:19.036554+0000","last_undegraded":"2024-04-23T18:31:19.036554+0000","last_fullsized":"2024-04-23T18:31:19.036554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:36.940155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547648+0000","last_change":"2024-04-23T18:29:19.518175+0000","last_active":"2024-04-23T18:29:52.547648+0000","last_peered":"2024-04-23T18:29:52.547648+0000","last_clean":"2024-04-23T18:29:52.547648+0000","last_became_active":"2024-04-23T18:29:19.517903+0000","last_became_peered":"2024-04-23T18:29:19.517903+0000","last_unstale":"2024-04-23T18:29:52.547648+0000","last_undegraded":"2024-04-23T18:29:52.547648+0000","last_fullsized":"2024-04-23T18:29:52.547648+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:49:59.234459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.612385+0000","last_change":"2024-04-23T18:29:21.531285+0000","last_active":"2024-04-23T18:30:36.612385+0000","last_peered":"2024-04-23T18:30:36.612385+0000","last_clean":"2024-04-23T18:30:36.612385+0000","last_became_active":"2024-04-23T18:29:21.530980+0000","last_became_peered":"2024-04-23T18:29:21.530980+0000","last_unstale":"2024-04-23T18:30:36.612385+0000","last_undegraded":"2024-04-23T18:30:36.612385+0000","last_fullsized":"2024-04-23T18:30:36.612385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:19:04.723674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542703+0000","last_change":"2024-04-23T18:29:21.534750+0000","last_active":"2024-04-23T18:29:52.542703+0000","last_peered":"2024-04-23T18:29:52.542703+0000","last_clean":"2024-04-23T18:29:52.542703+0000","last_became_active":"2024-04-23T18:29:21.534461+0000","last_became_peered":"2024-04-23T18:29:21.534461+0000","last_unstale":"2024-04-23T18:29:52.542703+0000","last_undegraded":"2024-04-23T18:29:52.542703+0000","last_fullsized":"2024-04-23T18:29:52.542703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:35:55.703412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.910166+0000","last_change":"2024-04-23T18:29:13.504381+0000","last_active":"2024-04-23T18:32:20.910166+0000","last_peered":"2024-04-23T18:32:20.910166+0000","last_clean":"2024-04-23T18:32:20.910166+0000","last_became_active":"2024-04-23T18:29:13.504092+0000","last_became_peered":"2024-04-23T18:29:13.504092+0000","last_unstale":"2024-04-23T18:32:20.910166+0000","last_undegraded":"2024-04-23T18:32:20.910166+0000","last_fullsized":"2024-04-23T18:32:20.910166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:28.289132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.550679+0000","last_change":"2024-04-23T18:29:11.511197+0000","last_active":"2024-04-23T18:29:52.550679+0000","last_peered":"2024-04-23T18:29:52.550679+0000","last_clean":"2024-04-23T18:29:52.550679+0000","last_became_active":"2024-04-23T18:29:11.510456+0000","last_became_peered":"2024-04-23T18:29:11.510456+0000","last_unstale":"2024-04-23T18:29:52.550679+0000","last_undegraded":"2024-04-23T18:29:52.550679+0000","last_fullsized":"2024-04-23T18:29:52.550679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:15.310210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.545740+0000","last_change":"2024-04-23T18:29:15.507536+0000","last_active":"2024-04-23T18:29:52.545740+0000","last_peered":"2024-04-23T18:29:52.545740+0000","last_clean":"2024-04-23T18:29:52.545740+0000","last_became_active":"2024-04-23T18:29:15.506939+0000","last_became_peered":"2024-04-23T18:29:15.506939+0000","last_unstale":"2024-04-23T18:29:52.545740+0000","last_undegraded":"2024-04-23T18:29:52.545740+0000","last_fullsized":"2024-04-23T18:29:52.545740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:33.128258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.042869+0000","last_change":"2024-04-23T18:29:17.511932+0000","last_active":"2024-04-23T18:31:19.042869+0000","last_peered":"2024-04-23T18:31:19.042869+0000","last_clean":"2024-04-23T18:31:19.042869+0000","last_became_active":"2024-04-23T18:29:17.511559+0000","last_became_peered":"2024-04-23T18:29:17.511559+0000","last_unstale":"2024-04-23T18:31:19.042869+0000","last_undegraded":"2024-04-23T18:31:19.042869+0000","last_fullsized":"2024-04-23T18:31:19.042869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:32:09.008618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549463+0000","last_change":"2024-04-23T18:29:19.525590+0000","last_active":"2024-04-23T18:29:52.549463+0000","last_peered":"2024-04-23T18:29:52.549463+0000","last_clean":"2024-04-23T18:29:52.549463+0000","last_became_active":"2024-04-23T18:29:19.525302+0000","last_became_peered":"2024-04-23T18:29:19.525302+0000","last_unstale":"2024-04-23T18:29:52.549463+0000","last_undegraded":"2024-04-23T18:29:52.549463+0000","last_fullsized":"2024-04-23T18:29:52.549463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:57.944932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:18.716199+0000","last_change":"2024-04-23T18:29:21.530275+0000","last_active":"2024-04-23T18:31:18.716199+0000","last_peered":"2024-04-23T18:31:18.716199+0000","last_clean":"2024-04-23T18:31:18.716199+0000","last_became_active":"2024-04-23T18:29:21.530013+0000","last_became_peered":"2024-04-23T18:29:21.530013+0000","last_unstale":"2024-04-23T18:31:18.716199+0000","last_undegraded":"2024-04-23T18:31:18.716199+0000","last_fullsized":"2024-04-23T18:31:18.716199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:53.670984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544156+0000","last_change":"2024-04-23T18:29:13.506992+0000","last_active":"2024-04-23T18:29:52.544156+0000","last_peered":"2024-04-23T18:29:52.544156+0000","last_clean":"2024-04-23T18:29:52.544156+0000","last_became_active":"2024-04-23T18:29:13.506770+0000","last_became_peered":"2024-04-23T18:29:13.506770+0000","last_unstale":"2024-04-23T18:29:52.544156+0000","last_undegraded":"2024-04-23T18:29:52.544156+0000","last_fullsized":"2024-04-23T18:29:52.544156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:31:14.220069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.130507+0000","last_change":"2024-04-23T18:29:11.482617+0000","last_active":"2024-04-23T18:32:21.130507+0000","last_peered":"2024-04-23T18:32:21.130507+0000","last_clean":"2024-04-23T18:32:21.130507+0000","last_became_active":"2024-04-23T18:29:11.481884+0000","last_became_peered":"2024-04-23T18:29:11.481884+0000","last_unstale":"2024-04-23T18:32:21.130507+0000","last_undegraded":"2024-04-23T18:32:21.130507+0000","last_fullsized":"2024-04-23T18:32:21.130507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:08:38.534696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549279+0000","last_change":"2024-04-23T18:29:15.508345+0000","last_active":"2024-04-23T18:29:52.549279+0000","last_peered":"2024-04-23T18:29:52.549279+0000","last_clean":"2024-04-23T18:29:52.549279+0000","last_became_active":"2024-04-23T18:29:15.508018+0000","last_became_peered":"2024-04-23T18:29:15.508018+0000","last_unstale":"2024-04-23T18:29:52.549279+0000","last_undegraded":"2024-04-23T18:29:52.549279+0000","last_fullsized":"2024-04-23T18:29:52.549279+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:44:46.349637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.565238+0000","last_change":"2024-04-23T18:29:17.515180+0000","last_active":"2024-04-23T18:32:20.565238+0000","last_peered":"2024-04-23T18:32:20.565238+0000","last_clean":"2024-04-23T18:32:20.565238+0000","last_became_active":"2024-04-23T18:29:17.514836+0000","last_became_peered":"2024-04-23T18:29:17.514836+0000","last_unstale":"2024-04-23T18:32:20.565238+0000","last_undegraded":"2024-04-23T18:32:20.565238+0000","last_fullsized":"2024-04-23T18:32:20.565238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:18.629550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541082+0000","last_change":"2024-04-23T18:29:19.527752+0000","last_active":"2024-04-23T18:29:52.541082+0000","last_peered":"2024-04-23T18:29:52.541082+0000","last_clean":"2024-04-23T18:29:52.541082+0000","last_became_active":"2024-04-23T18:29:19.527461+0000","last_became_peered":"2024-04-23T18:29:19.527461+0000","last_unstale":"2024-04-23T18:29:52.541082+0000","last_undegraded":"2024-04-23T18:29:52.541082+0000","last_fullsized":"2024-04-23T18:29:52.541082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:55.806105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547711+0000","last_change":"2024-04-23T18:29:21.529099+0000","last_active":"2024-04-23T18:29:52.547711+0000","last_peered":"2024-04-23T18:29:52.547711+0000","last_clean":"2024-04-23T18:29:52.547711+0000","last_became_active":"2024-04-23T18:29:21.528772+0000","last_became_peered":"2024-04-23T18:29:21.528772+0000","last_unstale":"2024-04-23T18:29:52.547711+0000","last_undegraded":"2024-04-23T18:29:52.547711+0000","last_fullsized":"2024-04-23T18:29:52.547711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:40:58.849572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.758624+0000","last_change":"2024-04-23T18:29:13.503536+0000","last_active":"2024-04-23T18:29:53.758624+0000","last_peered":"2024-04-23T18:29:53.758624+0000","last_clean":"2024-04-23T18:29:53.758624+0000","last_became_active":"2024-04-23T18:29:13.502849+0000","last_became_peered":"2024-04-23T18:29:13.502849+0000","last_unstale":"2024-04-23T18:29:53.758624+0000","last_undegraded":"2024-04-23T18:29:53.758624+0000","last_fullsized":"2024-04-23T18:29:53.758624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:27.393642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761184+0000","last_change":"2024-04-23T18:29:11.485392+0000","last_active":"2024-04-23T18:31:36.761184+0000","last_peered":"2024-04-23T18:31:36.761184+0000","last_clean":"2024-04-23T18:31:36.761184+0000","last_became_active":"2024-04-23T18:29:11.483628+0000","last_became_peered":"2024-04-23T18:29:11.483628+0000","last_unstale":"2024-04-23T18:31:36.761184+0000","last_undegraded":"2024-04-23T18:31:36.761184+0000","last_fullsized":"2024-04-23T18:31:36.761184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:50.092624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541320+0000","last_change":"2024-04-23T18:29:15.510472+0000","last_active":"2024-04-23T18:29:52.541320+0000","last_peered":"2024-04-23T18:29:52.541320+0000","last_clean":"2024-04-23T18:29:52.541320+0000","last_became_active":"2024-04-23T18:29:15.510130+0000","last_became_peered":"2024-04-23T18:29:15.510130+0000","last_unstale":"2024-04-23T18:29:52.541320+0000","last_undegraded":"2024-04-23T18:29:52.541320+0000","last_fullsized":"2024-04-23T18:29:52.541320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:21.124426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'44","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.835218+0000","last_change":"2024-04-23T18:29:17.510778+0000","last_active":"2024-04-23T18:32:27.835218+0000","last_peered":"2024-04-23T18:32:27.835218+0000","last_clean":"2024-04-23T18:32:27.835218+0000","last_became_active":"2024-04-23T18:29:17.510429+0000","last_became_peered":"2024-04-23T18:29:17.510429+0000","last_unstale":"2024-04-23T18:32:27.835218+0000","last_undegraded":"2024-04-23T18:32:27.835218+0000","last_fullsized":"2024-04-23T18:32:27.835218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:55.966235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543935+0000","last_change":"2024-04-23T18:29:19.519077+0000","last_active":"2024-04-23T18:29:52.543935+0000","last_peered":"2024-04-23T18:29:52.543935+0000","last_clean":"2024-04-23T18:29:52.543935+0000","last_became_active":"2024-04-23T18:29:19.518543+0000","last_became_peered":"2024-04-23T18:29:19.518543+0000","last_unstale":"2024-04-23T18:29:52.543935+0000","last_undegraded":"2024-04-23T18:29:52.543935+0000","last_fullsized":"2024-04-23T18:29:52.543935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:35:53.694069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551260+0000","last_change":"2024-04-23T18:29:21.534350+0000","last_active":"2024-04-23T18:29:52.551260+0000","last_peered":"2024-04-23T18:29:52.551260+0000","last_clean":"2024-04-23T18:29:52.551260+0000","last_became_active":"2024-04-23T18:29:21.534023+0000","last_became_peered":"2024-04-23T18:29:21.534023+0000","last_unstale":"2024-04-23T18:29:52.551260+0000","last_undegraded":"2024-04-23T18:29:52.551260+0000","last_fullsized":"2024-04-23T18:29:52.551260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:14:43.043132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'19","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762471+0000","last_change":"2024-04-23T18:29:13.501148+0000","last_active":"2024-04-23T18:31:36.762471+0000","last_peered":"2024-04-23T18:31:36.762471+0000","last_clean":"2024-04-23T18:31:36.762471+0000","last_became_active":"2024-04-23T18:29:13.500877+0000","last_became_peered":"2024-04-23T18:29:13.500877+0000","last_unstale":"2024-04-23T18:31:36.762471+0000","last_undegraded":"2024-04-23T18:31:36.762471+0000","last_fullsized":"2024-04-23T18:31:36.762471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:29:12.567941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":53,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.302552+0000","last_change":"2024-04-23T18:29:11.498275+0000","last_active":"2024-04-23T18:29:54.302552+0000","last_peered":"2024-04-23T18:29:54.302552+0000","last_clean":"2024-04-23T18:29:54.302552+0000","last_became_active":"2024-04-23T18:29:11.497953+0000","last_became_peered":"2024-04-23T18:29:11.497953+0000","last_unstale":"2024-04-23T18:29:54.302552+0000","last_undegraded":"2024-04-23T18:29:54.302552+0000","last_fullsized":"2024-04-23T18:29:54.302552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:39:13.562652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549826+0000","last_change":"2024-04-23T18:29:15.507545+0000","last_active":"2024-04-23T18:29:52.549826+0000","last_peered":"2024-04-23T18:29:52.549826+0000","last_clean":"2024-04-23T18:29:52.549826+0000","last_became_active":"2024-04-23T18:29:15.507253+0000","last_became_peered":"2024-04-23T18:29:15.507253+0000","last_unstale":"2024-04-23T18:29:52.549826+0000","last_undegraded":"2024-04-23T18:29:52.549826+0000","last_fullsized":"2024-04-23T18:29:52.549826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:24.598564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.028065+0000","last_change":"2024-04-23T18:29:17.514117+0000","last_active":"2024-04-23T18:31:19.028065+0000","last_peered":"2024-04-23T18:31:19.028065+0000","last_clean":"2024-04-23T18:31:19.028065+0000","last_became_active":"2024-04-23T18:29:17.512820+0000","last_became_peered":"2024-04-23T18:29:17.512820+0000","last_unstale":"2024-04-23T18:31:19.028065+0000","last_undegraded":"2024-04-23T18:31:19.028065+0000","last_fullsized":"2024-04-23T18:31:19.028065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:05.590357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.541424+0000","last_change":"2024-04-23T18:29:19.525834+0000","last_active":"2024-04-23T18:29:52.541424+0000","last_peered":"2024-04-23T18:29:52.541424+0000","last_clean":"2024-04-23T18:29:52.541424+0000","last_became_active":"2024-04-23T18:29:19.525424+0000","last_became_peered":"2024-04-23T18:29:19.525424+0000","last_unstale":"2024-04-23T18:29:52.541424+0000","last_undegraded":"2024-04-23T18:29:52.541424+0000","last_fullsized":"2024-04-23T18:29:52.541424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:52.622390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.183703+0000","last_change":"2024-04-23T18:29:13.496471+0000","last_active":"2024-04-23T18:32:21.183703+0000","last_peered":"2024-04-23T18:32:21.183703+0000","last_clean":"2024-04-23T18:32:21.183703+0000","last_became_active":"2024-04-23T18:29:13.496179+0000","last_became_peered":"2024-04-23T18:29:13.496179+0000","last_unstale":"2024-04-23T18:32:21.183703+0000","last_undegraded":"2024-04-23T18:32:21.183703+0000","last_fullsized":"2024-04-23T18:32:21.183703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:31.148672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547581+0000","last_change":"2024-04-23T18:29:11.500546+0000","last_active":"2024-04-23T18:29:52.547581+0000","last_peered":"2024-04-23T18:29:52.547581+0000","last_clean":"2024-04-23T18:29:52.547581+0000","last_became_active":"2024-04-23T18:29:11.500118+0000","last_became_peered":"2024-04-23T18:29:11.500118+0000","last_unstale":"2024-04-23T18:29:52.547581+0000","last_undegraded":"2024-04-23T18:29:52.547581+0000","last_fullsized":"2024-04-23T18:29:52.547581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:58:46.386426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549417+0000","last_change":"2024-04-23T18:29:15.506605+0000","last_active":"2024-04-23T18:29:52.549417+0000","last_peered":"2024-04-23T18:29:52.549417+0000","last_clean":"2024-04-23T18:29:52.549417+0000","last_became_active":"2024-04-23T18:29:15.506197+0000","last_became_peered":"2024-04-23T18:29:15.506197+0000","last_unstale":"2024-04-23T18:29:52.549417+0000","last_undegraded":"2024-04-23T18:29:52.549417+0000","last_fullsized":"2024-04-23T18:29:52.549417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:23:51.396518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'63","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.892999+0000","last_change":"2024-04-23T18:29:17.515116+0000","last_active":"2024-04-23T18:32:27.892999+0000","last_peered":"2024-04-23T18:32:27.892999+0000","last_clean":"2024-04-23T18:32:27.892999+0000","last_became_active":"2024-04-23T18:29:17.514800+0000","last_became_peered":"2024-04-23T18:29:17.514800+0000","last_unstale":"2024-04-23T18:32:27.892999+0000","last_undegraded":"2024-04-23T18:32:27.892999+0000","last_fullsized":"2024-04-23T18:32:27.892999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:42.936606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.542001+0000","last_change":"2024-04-23T18:29:19.524639+0000","last_active":"2024-04-23T18:29:52.542001+0000","last_peered":"2024-04-23T18:29:52.542001+0000","last_clean":"2024-04-23T18:29:52.542001+0000","last_became_active":"2024-04-23T18:29:19.524351+0000","last_became_peered":"2024-04-23T18:29:19.524351+0000","last_unstale":"2024-04-23T18:29:52.542001+0000","last_undegraded":"2024-04-23T18:29:52.542001+0000","last_fullsized":"2024-04-23T18:29:52.542001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:45.448270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.483433+0000","last_change":"2024-04-23T18:29:21.529140+0000","last_active":"2024-04-23T18:31:20.483433+0000","last_peered":"2024-04-23T18:31:20.483433+0000","last_clean":"2024-04-23T18:31:20.483433+0000","last_became_active":"2024-04-23T18:29:21.528819+0000","last_became_peered":"2024-04-23T18:29:21.528819+0000","last_unstale":"2024-04-23T18:31:20.483433+0000","last_undegraded":"2024-04-23T18:31:20.483433+0000","last_fullsized":"2024-04-23T18:31:20.483433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:00:12.967213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.809775+0000","last_change":"2024-04-23T18:29:13.499526+0000","last_active":"2024-04-23T18:29:54.809775+0000","last_peered":"2024-04-23T18:29:54.809775+0000","last_clean":"2024-04-23T18:29:54.809775+0000","last_became_active":"2024-04-23T18:29:13.499137+0000","last_became_peered":"2024-04-23T18:29:13.499137+0000","last_unstale":"2024-04-23T18:29:54.809775+0000","last_undegraded":"2024-04-23T18:29:54.809775+0000","last_fullsized":"2024-04-23T18:29:54.809775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:09:37.644601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543171+0000","last_change":"2024-04-23T18:29:11.500980+0000","last_active":"2024-04-23T18:29:52.543171+0000","last_peered":"2024-04-23T18:29:52.543171+0000","last_clean":"2024-04-23T18:29:52.543171+0000","last_became_active":"2024-04-23T18:29:11.500584+0000","last_became_peered":"2024-04-23T18:29:11.500584+0000","last_unstale":"2024-04-23T18:29:52.543171+0000","last_undegraded":"2024-04-23T18:29:52.543171+0000","last_fullsized":"2024-04-23T18:29:52.543171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:31.151193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544749+0000","last_change":"2024-04-23T18:29:15.503669+0000","last_active":"2024-04-23T18:29:52.544749+0000","last_peered":"2024-04-23T18:29:52.544749+0000","last_clean":"2024-04-23T18:29:52.544749+0000","last_became_active":"2024-04-23T18:29:15.503315+0000","last_became_peered":"2024-04-23T18:29:15.503315+0000","last_unstale":"2024-04-23T18:29:52.544749+0000","last_undegraded":"2024-04-23T18:29:52.544749+0000","last_fullsized":"2024-04-23T18:29:52.544749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:45.603211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.029019+0000","last_change":"2024-04-23T18:29:17.517217+0000","last_active":"2024-04-23T18:31:19.029019+0000","last_peered":"2024-04-23T18:31:19.029019+0000","last_clean":"2024-04-23T18:31:19.029019+0000","last_became_active":"2024-04-23T18:29:17.516934+0000","last_became_peered":"2024-04-23T18:29:17.516934+0000","last_unstale":"2024-04-23T18:31:19.029019+0000","last_undegraded":"2024-04-23T18:31:19.029019+0000","last_fullsized":"2024-04-23T18:31:19.029019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:47.490248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544700+0000","last_change":"2024-04-23T18:29:19.520167+0000","last_active":"2024-04-23T18:29:52.544700+0000","last_peered":"2024-04-23T18:29:52.544700+0000","last_clean":"2024-04-23T18:29:52.544700+0000","last_became_active":"2024-04-23T18:29:19.519854+0000","last_became_peered":"2024-04-23T18:29:19.519854+0000","last_unstale":"2024-04-23T18:29:52.544700+0000","last_undegraded":"2024-04-23T18:29:52.544700+0000","last_fullsized":"2024-04-23T18:29:52.544700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:49.515308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548061+0000","last_change":"2024-04-23T18:29:21.534768+0000","last_active":"2024-04-23T18:29:52.548061+0000","last_peered":"2024-04-23T18:29:52.548061+0000","last_clean":"2024-04-23T18:29:52.548061+0000","last_became_active":"2024-04-23T18:29:21.534487+0000","last_became_peered":"2024-04-23T18:29:21.534487+0000","last_unstale":"2024-04-23T18:29:52.548061+0000","last_undegraded":"2024-04-23T18:29:52.548061+0000","last_fullsized":"2024-04-23T18:29:52.548061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:32:46.393371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.901371+0000","last_change":"2024-04-23T18:29:13.503374+0000","last_active":"2024-04-23T18:32:20.901371+0000","last_peered":"2024-04-23T18:32:20.901371+0000","last_clean":"2024-04-23T18:32:20.901371+0000","last_became_active":"2024-04-23T18:29:13.502710+0000","last_became_peered":"2024-04-23T18:29:13.502710+0000","last_unstale":"2024-04-23T18:32:20.901371+0000","last_undegraded":"2024-04-23T18:32:20.901371+0000","last_fullsized":"2024-04-23T18:32:20.901371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:47:02.276254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544043+0000","last_change":"2024-04-23T18:29:11.498320+0000","last_active":"2024-04-23T18:29:52.544043+0000","last_peered":"2024-04-23T18:29:52.544043+0000","last_clean":"2024-04-23T18:29:52.544043+0000","last_became_active":"2024-04-23T18:29:11.497191+0000","last_became_peered":"2024-04-23T18:29:11.497191+0000","last_unstale":"2024-04-23T18:29:52.544043+0000","last_undegraded":"2024-04-23T18:29:52.544043+0000","last_fullsized":"2024-04-23T18:29:52.544043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:33:55.553919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543117+0000","last_change":"2024-04-23T18:29:15.502215+0000","last_active":"2024-04-23T18:29:52.543117+0000","last_peered":"2024-04-23T18:29:52.543117+0000","last_clean":"2024-04-23T18:29:52.543117+0000","last_became_active":"2024-04-23T18:29:15.501957+0000","last_became_peered":"2024-04-23T18:29:15.501957+0000","last_unstale":"2024-04-23T18:29:52.543117+0000","last_undegraded":"2024-04-23T18:29:52.543117+0000","last_fullsized":"2024-04-23T18:29:52.543117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:16:23.586603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'35","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.886399+0000","last_change":"2024-04-23T18:29:17.503422+0000","last_active":"2024-04-23T18:32:27.886399+0000","last_peered":"2024-04-23T18:32:27.886399+0000","last_clean":"2024-04-23T18:32:27.886399+0000","last_became_active":"2024-04-23T18:29:17.503196+0000","last_became_peered":"2024-04-23T18:29:17.503196+0000","last_unstale":"2024-04-23T18:32:27.886399+0000","last_undegraded":"2024-04-23T18:32:27.886399+0000","last_fullsized":"2024-04-23T18:32:27.886399+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:30:37.507116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548417+0000","last_change":"2024-04-23T18:29:19.527985+0000","last_active":"2024-04-23T18:29:52.548417+0000","last_peered":"2024-04-23T18:29:52.548417+0000","last_clean":"2024-04-23T18:29:52.548417+0000","last_became_active":"2024-04-23T18:29:19.527687+0000","last_became_peered":"2024-04-23T18:29:19.527687+0000","last_unstale":"2024-04-23T18:29:52.548417+0000","last_undegraded":"2024-04-23T18:29:52.548417+0000","last_fullsized":"2024-04-23T18:29:52.548417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:54.022979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.542239+0000","last_change":"2024-04-23T18:29:21.534054+0000","last_active":"2024-04-23T18:31:20.542239+0000","last_peered":"2024-04-23T18:31:20.542239+0000","last_clean":"2024-04-23T18:31:20.542239+0000","last_became_active":"2024-04-23T18:29:21.533754+0000","last_became_peered":"2024-04-23T18:29:21.533754+0000","last_unstale":"2024-04-23T18:31:20.542239+0000","last_undegraded":"2024-04-23T18:31:20.542239+0000","last_fullsized":"2024-04-23T18:31:20.542239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:23.688720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.902182+0000","last_change":"2024-04-23T18:29:13.497462+0000","last_active":"2024-04-23T18:32:20.902182+0000","last_peered":"2024-04-23T18:32:20.902182+0000","last_clean":"2024-04-23T18:32:20.902182+0000","last_became_active":"2024-04-23T18:29:13.497121+0000","last_became_peered":"2024-04-23T18:29:13.497121+0000","last_unstale":"2024-04-23T18:32:20.902182+0000","last_undegraded":"2024-04-23T18:32:20.902182+0000","last_fullsized":"2024-04-23T18:32:20.902182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:00:19.423755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:53.207298+0000","last_change":"2024-04-23T18:29:11.504900+0000","last_active":"2024-04-23T18:29:53.207298+0000","last_peered":"2024-04-23T18:29:53.207298+0000","last_clean":"2024-04-23T18:29:53.207298+0000","last_became_active":"2024-04-23T18:29:11.504564+0000","last_became_peered":"2024-04-23T18:29:11.504564+0000","last_unstale":"2024-04-23T18:29:53.207298+0000","last_undegraded":"2024-04-23T18:29:53.207298+0000","last_fullsized":"2024-04-23T18:29:53.207298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:56:26.282130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547964+0000","last_change":"2024-04-23T18:29:15.506519+0000","last_active":"2024-04-23T18:29:52.547964+0000","last_peered":"2024-04-23T18:29:52.547964+0000","last_clean":"2024-04-23T18:29:52.547964+0000","last_became_active":"2024-04-23T18:29:15.506171+0000","last_became_peered":"2024-04-23T18:29:15.506171+0000","last_unstale":"2024-04-23T18:29:52.547964+0000","last_undegraded":"2024-04-23T18:29:52.547964+0000","last_fullsized":"2024-04-23T18:29:52.547964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:29:39.313604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552039+0000","last_change":"2024-04-23T18:29:17.517401+0000","last_active":"2024-04-23T18:29:52.552039+0000","last_peered":"2024-04-23T18:29:52.552039+0000","last_clean":"2024-04-23T18:29:52.552039+0000","last_became_active":"2024-04-23T18:29:17.517051+0000","last_became_peered":"2024-04-23T18:29:17.517051+0000","last_unstale":"2024-04-23T18:29:52.552039+0000","last_undegraded":"2024-04-23T18:29:52.552039+0000","last_fullsized":"2024-04-23T18:29:52.552039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:43.608104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":366,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.585498+0000","last_change":"2024-04-23T18:29:19.527952+0000","last_active":"2024-04-23T18:32:20.585498+0000","last_peered":"2024-04-23T18:32:20.585498+0000","last_clean":"2024-04-23T18:32:20.585498+0000","last_became_active":"2024-04-23T18:29:19.527614+0000","last_became_peered":"2024-04-23T18:29:19.527614+0000","last_unstale":"2024-04-23T18:32:20.585498+0000","last_undegraded":"2024-04-23T18:32:20.585498+0000","last_fullsized":"2024-04-23T18:32:20.585498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:15:37.178104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.792678+0000","last_change":"2024-04-23T18:29:21.531583+0000","last_active":"2024-04-23T18:30:36.792678+0000","last_peered":"2024-04-23T18:30:36.792678+0000","last_clean":"2024-04-23T18:30:36.792678+0000","last_became_active":"2024-04-23T18:29:21.530619+0000","last_became_peered":"2024-04-23T18:29:21.530619+0000","last_unstale":"2024-04-23T18:30:36.792678+0000","last_undegraded":"2024-04-23T18:30:36.792678+0000","last_fullsized":"2024-04-23T18:30:36.792678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:02:25.354970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136433+0000","last_change":"2024-04-23T18:29:13.502162+0000","last_active":"2024-04-23T18:32:21.136433+0000","last_peered":"2024-04-23T18:32:21.136433+0000","last_clean":"2024-04-23T18:32:21.136433+0000","last_became_active":"2024-04-23T18:29:13.501741+0000","last_became_peered":"2024-04-23T18:29:13.501741+0000","last_unstale":"2024-04-23T18:32:21.136433+0000","last_undegraded":"2024-04-23T18:32:21.136433+0000","last_fullsized":"2024-04-23T18:32:21.136433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:24.039627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546726+0000","last_change":"2024-04-23T18:29:11.501098+0000","last_active":"2024-04-23T18:29:52.546726+0000","last_peered":"2024-04-23T18:29:52.546726+0000","last_clean":"2024-04-23T18:29:52.546726+0000","last_became_active":"2024-04-23T18:29:11.500781+0000","last_became_peered":"2024-04-23T18:29:11.500781+0000","last_unstale":"2024-04-23T18:29:52.546726+0000","last_undegraded":"2024-04-23T18:29:52.546726+0000","last_fullsized":"2024-04-23T18:29:52.546726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:17:49.661961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.553840+0000","last_change":"2024-04-23T18:29:52.550289+0000","last_active":"2024-04-23T18:29:52.553840+0000","last_peered":"2024-04-23T18:29:52.553840+0000","last_clean":"2024-04-23T18:29:52.553840+0000","last_became_active":"2024-04-23T18:29:52.549944+0000","last_became_peered":"2024-04-23T18:29:52.549944+0000","last_unstale":"2024-04-23T18:29:52.553840+0000","last_undegraded":"2024-04-23T18:29:52.553840+0000","last_fullsized":"2024-04-23T18:29:52.553840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:51.212007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.019745+0000","last_change":"2024-04-23T18:29:17.509362+0000","last_active":"2024-04-23T18:31:19.019745+0000","last_peered":"2024-04-23T18:31:19.019745+0000","last_clean":"2024-04-23T18:31:19.019745+0000","last_became_active":"2024-04-23T18:29:17.509076+0000","last_became_peered":"2024-04-23T18:29:17.509076+0000","last_unstale":"2024-04-23T18:31:19.019745+0000","last_undegraded":"2024-04-23T18:31:19.019745+0000","last_fullsized":"2024-04-23T18:31:19.019745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:43:59.200856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546279+0000","last_change":"2024-04-23T18:29:19.519211+0000","last_active":"2024-04-23T18:29:52.546279+0000","last_peered":"2024-04-23T18:29:52.546279+0000","last_clean":"2024-04-23T18:29:52.546279+0000","last_became_active":"2024-04-23T18:29:19.518673+0000","last_became_peered":"2024-04-23T18:29:19.518673+0000","last_unstale":"2024-04-23T18:29:52.546279+0000","last_undegraded":"2024-04-23T18:29:52.546279+0000","last_fullsized":"2024-04-23T18:29:52.546279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:16:13.613155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548269+0000","last_change":"2024-04-23T18:29:21.533731+0000","last_active":"2024-04-23T18:29:52.548269+0000","last_peered":"2024-04-23T18:29:52.548269+0000","last_clean":"2024-04-23T18:29:52.548269+0000","last_became_active":"2024-04-23T18:29:21.533187+0000","last_became_peered":"2024-04-23T18:29:21.533187+0000","last_unstale":"2024-04-23T18:29:52.548269+0000","last_undegraded":"2024-04-23T18:29:52.548269+0000","last_fullsized":"2024-04-23T18:29:52.548269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:56:16.140403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216088+0000","last_change":"2024-04-23T18:29:13.502229+0000","last_active":"2024-04-23T18:32:21.216088+0000","last_peered":"2024-04-23T18:32:21.216088+0000","last_clean":"2024-04-23T18:32:21.216088+0000","last_became_active":"2024-04-23T18:29:13.501974+0000","last_became_peered":"2024-04-23T18:29:13.501974+0000","last_unstale":"2024-04-23T18:32:21.216088+0000","last_undegraded":"2024-04-23T18:32:21.216088+0000","last_fullsized":"2024-04-23T18:32:21.216088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:41.117616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552635+0000","last_change":"2024-04-23T18:29:11.511621+0000","last_active":"2024-04-23T18:29:52.552635+0000","last_peered":"2024-04-23T18:29:52.552635+0000","last_clean":"2024-04-23T18:29:52.552635+0000","last_became_active":"2024-04-23T18:29:11.511297+0000","last_became_peered":"2024-04-23T18:29:11.511297+0000","last_unstale":"2024-04-23T18:29:52.552635+0000","last_undegraded":"2024-04-23T18:29:52.552635+0000","last_fullsized":"2024-04-23T18:29:52.552635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:59.862004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543723+0000","last_change":"2024-04-23T18:29:15.504950+0000","last_active":"2024-04-23T18:29:52.543723+0000","last_peered":"2024-04-23T18:29:52.543723+0000","last_clean":"2024-04-23T18:29:52.543723+0000","last_became_active":"2024-04-23T18:29:15.504528+0000","last_became_peered":"2024-04-23T18:29:15.504528+0000","last_unstale":"2024-04-23T18:29:52.543723+0000","last_undegraded":"2024-04-23T18:29:52.543723+0000","last_fullsized":"2024-04-23T18:29:52.543723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:01:41.352665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'33","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.804355+0000","last_change":"2024-04-23T18:29:17.513717+0000","last_active":"2024-04-23T18:32:27.804355+0000","last_peered":"2024-04-23T18:32:27.804355+0000","last_clean":"2024-04-23T18:32:27.804355+0000","last_became_active":"2024-04-23T18:29:17.513482+0000","last_became_peered":"2024-04-23T18:29:17.513482+0000","last_unstale":"2024-04-23T18:32:27.804355+0000","last_undegraded":"2024-04-23T18:32:27.804355+0000","last_fullsized":"2024-04-23T18:32:27.804355+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:10:12.070821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549506+0000","last_change":"2024-04-23T18:29:19.526244+0000","last_active":"2024-04-23T18:29:52.549506+0000","last_peered":"2024-04-23T18:29:52.549506+0000","last_clean":"2024-04-23T18:29:52.549506+0000","last_became_active":"2024-04-23T18:29:19.525985+0000","last_became_peered":"2024-04-23T18:29:19.525985+0000","last_unstale":"2024-04-23T18:29:52.549506+0000","last_undegraded":"2024-04-23T18:29:52.549506+0000","last_fullsized":"2024-04-23T18:29:52.549506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:33:40.734604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.551426+0000","last_change":"2024-04-23T18:29:21.528945+0000","last_active":"2024-04-23T18:29:52.551426+0000","last_peered":"2024-04-23T18:29:52.551426+0000","last_clean":"2024-04-23T18:29:52.551426+0000","last_became_active":"2024-04-23T18:29:21.528665+0000","last_became_peered":"2024-04-23T18:29:21.528665+0000","last_unstale":"2024-04-23T18:29:52.551426+0000","last_undegraded":"2024-04-23T18:29:52.551426+0000","last_fullsized":"2024-04-23T18:29:52.551426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:55:24.076754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.320824+0000","last_change":"2024-04-23T18:29:13.495164+0000","last_active":"2024-04-23T18:29:54.320824+0000","last_peered":"2024-04-23T18:29:54.320824+0000","last_clean":"2024-04-23T18:29:54.320824+0000","last_became_active":"2024-04-23T18:29:13.494647+0000","last_became_peered":"2024-04-23T18:29:13.494647+0000","last_unstale":"2024-04-23T18:29:54.320824+0000","last_undegraded":"2024-04-23T18:29:54.320824+0000","last_fullsized":"2024-04-23T18:29:54.320824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:06:29.887241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.266338+0000","last_change":"2024-04-23T18:29:11.496011+0000","last_active":"2024-04-23T18:31:17.266338+0000","last_peered":"2024-04-23T18:31:17.266338+0000","last_clean":"2024-04-23T18:31:17.266338+0000","last_became_active":"2024-04-23T18:29:11.495723+0000","last_became_peered":"2024-04-23T18:29:11.495723+0000","last_unstale":"2024-04-23T18:31:17.266338+0000","last_undegraded":"2024-04-23T18:31:17.266338+0000","last_fullsized":"2024-04-23T18:31:17.266338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:36:52.346753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.543714+0000","last_change":"2024-04-23T18:29:15.510875+0000","last_active":"2024-04-23T18:29:52.543714+0000","last_peered":"2024-04-23T18:29:52.543714+0000","last_clean":"2024-04-23T18:29:52.543714+0000","last_became_active":"2024-04-23T18:29:15.510185+0000","last_became_peered":"2024-04-23T18:29:15.510185+0000","last_unstale":"2024-04-23T18:29:52.543714+0000","last_undegraded":"2024-04-23T18:29:52.543714+0000","last_fullsized":"2024-04-23T18:29:52.543714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:50.678177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'28","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.764076+0000","last_change":"2024-04-23T18:29:17.517329+0000","last_active":"2024-04-23T18:31:46.764076+0000","last_peered":"2024-04-23T18:31:46.764076+0000","last_clean":"2024-04-23T18:31:46.764076+0000","last_became_active":"2024-04-23T18:29:17.516989+0000","last_became_peered":"2024-04-23T18:29:17.516989+0000","last_unstale":"2024-04-23T18:31:46.764076+0000","last_undegraded":"2024-04-23T18:31:46.764076+0000","last_fullsized":"2024-04-23T18:31:46.764076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:12:42.263147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548315+0000","last_change":"2024-04-23T18:29:19.522484+0000","last_active":"2024-04-23T18:29:52.548315+0000","last_peered":"2024-04-23T18:29:52.548315+0000","last_clean":"2024-04-23T18:29:52.548315+0000","last_became_active":"2024-04-23T18:29:19.522217+0000","last_became_peered":"2024-04-23T18:29:19.522217+0000","last_unstale":"2024-04-23T18:29:52.548315+0000","last_undegraded":"2024-04-23T18:29:52.548315+0000","last_fullsized":"2024-04-23T18:29:52.548315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:36:35.803795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.054923+0000","last_change":"2024-04-23T18:29:21.533465+0000","last_active":"2024-04-23T18:31:19.054923+0000","last_peered":"2024-04-23T18:31:19.054923+0000","last_clean":"2024-04-23T18:31:19.054923+0000","last_became_active":"2024-04-23T18:29:21.533152+0000","last_became_peered":"2024-04-23T18:29:21.533152+0000","last_unstale":"2024-04-23T18:31:19.054923+0000","last_undegraded":"2024-04-23T18:31:19.054923+0000","last_fullsized":"2024-04-23T18:31:19.054923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:53:29.385592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.183234+0000","last_change":"2024-04-23T18:29:13.502434+0000","last_active":"2024-04-23T18:32:21.183234+0000","last_peered":"2024-04-23T18:32:21.183234+0000","last_clean":"2024-04-23T18:32:21.183234+0000","last_became_active":"2024-04-23T18:29:13.501782+0000","last_became_peered":"2024-04-23T18:29:13.501782+0000","last_unstale":"2024-04-23T18:32:21.183234+0000","last_undegraded":"2024-04-23T18:32:21.183234+0000","last_fullsized":"2024-04-23T18:32:21.183234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:12.786478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:16.758702+0000","last_change":"2024-04-23T18:29:11.501970+0000","last_active":"2024-04-23T18:31:16.758702+0000","last_peered":"2024-04-23T18:31:16.758702+0000","last_clean":"2024-04-23T18:31:16.758702+0000","last_became_active":"2024-04-23T18:29:11.501648+0000","last_became_peered":"2024-04-23T18:29:11.501648+0000","last_unstale":"2024-04-23T18:31:16.758702+0000","last_undegraded":"2024-04-23T18:31:16.758702+0000","last_fullsized":"2024-04-23T18:31:16.758702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:50.092624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.716953+0000","last_change":"2024-04-23T18:29:15.510030+0000","last_active":"2024-04-23T18:31:17.716953+0000","last_peered":"2024-04-23T18:31:17.716953+0000","last_clean":"2024-04-23T18:31:17.716953+0000","last_became_active":"2024-04-23T18:29:15.509725+0000","last_became_peered":"2024-04-23T18:29:15.509725+0000","last_unstale":"2024-04-23T18:31:17.716953+0000","last_undegraded":"2024-04-23T18:31:17.716953+0000","last_fullsized":"2024-04-23T18:31:17.716953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:56:00.300728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.580905+0000","last_change":"2024-04-23T18:29:17.515107+0000","last_active":"2024-04-23T18:32:20.580905+0000","last_peered":"2024-04-23T18:32:20.580905+0000","last_clean":"2024-04-23T18:32:20.580905+0000","last_became_active":"2024-04-23T18:29:17.514823+0000","last_became_peered":"2024-04-23T18:29:17.514823+0000","last_unstale":"2024-04-23T18:32:20.580905+0000","last_undegraded":"2024-04-23T18:32:20.580905+0000","last_fullsized":"2024-04-23T18:32:20.580905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:43:37.286173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547277+0000","last_change":"2024-04-23T18:29:19.519462+0000","last_active":"2024-04-23T18:29:52.547277+0000","last_peered":"2024-04-23T18:29:52.547277+0000","last_clean":"2024-04-23T18:29:52.547277+0000","last_became_active":"2024-04-23T18:29:19.519153+0000","last_became_peered":"2024-04-23T18:29:19.519153+0000","last_unstale":"2024-04-23T18:29:52.547277+0000","last_undegraded":"2024-04-23T18:29:52.547277+0000","last_fullsized":"2024-04-23T18:29:52.547277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:04:43.275499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.001111+0000","last_change":"2024-04-23T18:29:21.529659+0000","last_active":"2024-04-23T18:32:21.001111+0000","last_peered":"2024-04-23T18:32:21.001111+0000","last_clean":"2024-04-23T18:32:21.001111+0000","last_became_active":"2024-04-23T18:29:21.529331+0000","last_became_peered":"2024-04-23T18:29:21.529331+0000","last_unstale":"2024-04-23T18:32:21.001111+0000","last_undegraded":"2024-04-23T18:32:21.001111+0000","last_fullsized":"2024-04-23T18:32:21.001111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:10:52.515811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216418+0000","last_change":"2024-04-23T18:29:52.563032+0000","last_active":"2024-04-23T18:32:21.216418+0000","last_peered":"2024-04-23T18:32:21.216418+0000","last_clean":"2024-04-23T18:32:21.216418+0000","last_became_active":"2024-04-23T18:29:52.551523+0000","last_became_peered":"2024-04-23T18:29:52.551523+0000","last_unstale":"2024-04-23T18:32:21.216418+0000","last_undegraded":"2024-04-23T18:32:21.216418+0000","last_fullsized":"2024-04-23T18:32:21.216418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:09:27.042501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.540500+0000","last_change":"2024-04-23T18:29:11.489634+0000","last_active":"2024-04-23T18:29:52.540500+0000","last_peered":"2024-04-23T18:29:52.540500+0000","last_clean":"2024-04-23T18:29:52.540500+0000","last_became_active":"2024-04-23T18:29:11.489284+0000","last_became_peered":"2024-04-23T18:29:11.489284+0000","last_unstale":"2024-04-23T18:29:52.540500+0000","last_undegraded":"2024-04-23T18:29:52.540500+0000","last_fullsized":"2024-04-23T18:29:52.540500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:30:52.597685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549214+0000","last_change":"2024-04-23T18:29:13.497247+0000","last_active":"2024-04-23T18:29:52.549214+0000","last_peered":"2024-04-23T18:29:52.549214+0000","last_clean":"2024-04-23T18:29:52.549214+0000","last_became_active":"2024-04-23T18:29:13.496958+0000","last_became_peered":"2024-04-23T18:29:13.496958+0000","last_unstale":"2024-04-23T18:29:52.549214+0000","last_undegraded":"2024-04-23T18:29:52.549214+0000","last_fullsized":"2024-04-23T18:29:52.549214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:19.818744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546441+0000","last_change":"2024-04-23T18:29:11.487639+0000","last_active":"2024-04-23T18:29:52.546441+0000","last_peered":"2024-04-23T18:29:52.546441+0000","last_clean":"2024-04-23T18:29:52.546441+0000","last_became_active":"2024-04-23T18:29:11.486563+0000","last_became_peered":"2024-04-23T18:29:11.486563+0000","last_unstale":"2024-04-23T18:29:52.546441+0000","last_undegraded":"2024-04-23T18:29:52.546441+0000","last_fullsized":"2024-04-23T18:29:52.546441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:59.834673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.182969+0000","last_change":"2024-04-23T18:29:13.494907+0000","last_active":"2024-04-23T18:32:21.182969+0000","last_peered":"2024-04-23T18:32:21.182969+0000","last_clean":"2024-04-23T18:32:21.182969+0000","last_became_active":"2024-04-23T18:29:13.494683+0000","last_became_peered":"2024-04-23T18:29:13.494683+0000","last_unstale":"2024-04-23T18:32:21.182969+0000","last_undegraded":"2024-04-23T18:32:21.182969+0000","last_fullsized":"2024-04-23T18:32:21.182969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:39.418837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:16.759681+0000","last_change":"2024-04-23T18:29:11.511297+0000","last_active":"2024-04-23T18:31:16.759681+0000","last_peered":"2024-04-23T18:31:16.759681+0000","last_clean":"2024-04-23T18:31:16.759681+0000","last_became_active":"2024-04-23T18:29:11.510971+0000","last_became_peered":"2024-04-23T18:29:11.510971+0000","last_unstale":"2024-04-23T18:31:16.759681+0000","last_undegraded":"2024-04-23T18:31:16.759681+0000","last_fullsized":"2024-04-23T18:31:16.759681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:10.779475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278308+0000","last_change":"2024-04-23T18:29:13.497387+0000","last_active":"2024-04-23T18:31:17.278308+0000","last_peered":"2024-04-23T18:31:17.278308+0000","last_clean":"2024-04-23T18:31:17.278308+0000","last_became_active":"2024-04-23T18:29:13.497094+0000","last_became_peered":"2024-04-23T18:29:13.497094+0000","last_unstale":"2024-04-23T18:31:17.278308+0000","last_undegraded":"2024-04-23T18:31:17.278308+0000","last_fullsized":"2024-04-23T18:31:17.278308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:46:30.444504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.547921+0000","last_change":"2024-04-23T18:29:11.492610+0000","last_active":"2024-04-23T18:29:52.547921+0000","last_peered":"2024-04-23T18:29:52.547921+0000","last_clean":"2024-04-23T18:29:52.547921+0000","last_became_active":"2024-04-23T18:29:11.492064+0000","last_became_peered":"2024-04-23T18:29:11.492064+0000","last_unstale":"2024-04-23T18:29:52.547921+0000","last_undegraded":"2024-04-23T18:29:52.547921+0000","last_fullsized":"2024-04-23T18:29:52.547921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:53.075916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998383+0000","last_change":"2024-04-23T18:29:13.502885+0000","last_active":"2024-04-23T18:32:20.998383+0000","last_peered":"2024-04-23T18:32:20.998383+0000","last_clean":"2024-04-23T18:32:20.998383+0000","last_became_active":"2024-04-23T18:29:13.502243+0000","last_became_peered":"2024-04-23T18:29:13.502243+0000","last_unstale":"2024-04-23T18:32:20.998383+0000","last_undegraded":"2024-04-23T18:32:20.998383+0000","last_fullsized":"2024-04-23T18:32:20.998383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:03:43.333220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.548416+0000","last_change":"2024-04-23T18:29:11.486754+0000","last_active":"2024-04-23T18:29:52.548416+0000","last_peered":"2024-04-23T18:29:52.548416+0000","last_clean":"2024-04-23T18:29:52.548416+0000","last_became_active":"2024-04-23T18:29:11.486452+0000","last_became_peered":"2024-04-23T18:29:11.486452+0000","last_unstale":"2024-04-23T18:29:52.548416+0000","last_undegraded":"2024-04-23T18:29:52.548416+0000","last_fullsized":"2024-04-23T18:29:52.548416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:15.136106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185774+0000","last_change":"2024-04-23T18:29:13.507893+0000","last_active":"2024-04-23T18:32:21.185774+0000","last_peered":"2024-04-23T18:32:21.185774+0000","last_clean":"2024-04-23T18:32:21.185774+0000","last_became_active":"2024-04-23T18:29:13.507582+0000","last_became_peered":"2024-04-23T18:29:13.507582+0000","last_unstale":"2024-04-23T18:32:21.185774+0000","last_undegraded":"2024-04-23T18:32:21.185774+0000","last_fullsized":"2024-04-23T18:32:21.185774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:50.962263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544908+0000","last_change":"2024-04-23T18:29:11.495366+0000","last_active":"2024-04-23T18:29:52.544908+0000","last_peered":"2024-04-23T18:29:52.544908+0000","last_clean":"2024-04-23T18:29:52.544908+0000","last_became_active":"2024-04-23T18:29:11.493318+0000","last_became_peered":"2024-04-23T18:29:11.493318+0000","last_unstale":"2024-04-23T18:29:52.544908+0000","last_undegraded":"2024-04-23T18:29:52.544908+0000","last_fullsized":"2024-04-23T18:29:52.544908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:47:48.291376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'22","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.136764+0000","last_change":"2024-04-23T18:29:13.499537+0000","last_active":"2024-04-23T18:32:21.136764+0000","last_peered":"2024-04-23T18:32:21.136764+0000","last_clean":"2024-04-23T18:32:21.136764+0000","last_became_active":"2024-04-23T18:29:13.499155+0000","last_became_peered":"2024-04-23T18:29:13.499155+0000","last_unstale":"2024-04-23T18:32:21.136764+0000","last_undegraded":"2024-04-23T18:32:21.136764+0000","last_fullsized":"2024-04-23T18:32:21.136764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:10:40.469094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.544921+0000","last_change":"2024-04-23T18:29:11.486471+0000","last_active":"2024-04-23T18:29:52.544921+0000","last_peered":"2024-04-23T18:29:52.544921+0000","last_clean":"2024-04-23T18:29:52.544921+0000","last_became_active":"2024-04-23T18:29:11.485201+0000","last_became_peered":"2024-04-23T18:29:11.485201+0000","last_unstale":"2024-04-23T18:29:52.544921+0000","last_undegraded":"2024-04-23T18:29:52.544921+0000","last_fullsized":"2024-04-23T18:29:52.544921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:54:34.195698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.902933+0000","last_change":"2024-04-23T18:29:13.497344+0000","last_active":"2024-04-23T18:32:20.902933+0000","last_peered":"2024-04-23T18:32:20.902933+0000","last_clean":"2024-04-23T18:32:20.902933+0000","last_became_active":"2024-04-23T18:29:13.495654+0000","last_became_peered":"2024-04-23T18:29:13.495654+0000","last_unstale":"2024-04-23T18:32:20.902933+0000","last_undegraded":"2024-04-23T18:32:20.902933+0000","last_fullsized":"2024-04-23T18:32:20.902933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:15.838895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549092+0000","last_change":"2024-04-23T18:29:11.495685+0000","last_active":"2024-04-23T18:29:52.549092+0000","last_peered":"2024-04-23T18:29:52.549092+0000","last_clean":"2024-04-23T18:29:52.549092+0000","last_became_active":"2024-04-23T18:29:11.495224+0000","last_became_peered":"2024-04-23T18:29:11.495224+0000","last_unstale":"2024-04-23T18:29:52.549092+0000","last_undegraded":"2024-04-23T18:29:52.549092+0000","last_fullsized":"2024-04-23T18:29:52.549092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:44.033653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185125+0000","last_change":"2024-04-23T18:29:13.498009+0000","last_active":"2024-04-23T18:32:21.185125+0000","last_peered":"2024-04-23T18:32:21.185125+0000","last_clean":"2024-04-23T18:32:21.185125+0000","last_became_active":"2024-04-23T18:29:13.497588+0000","last_became_peered":"2024-04-23T18:29:13.497588+0000","last_unstale":"2024-04-23T18:32:21.185125+0000","last_undegraded":"2024-04-23T18:32:21.185125+0000","last_fullsized":"2024-04-23T18:32:21.185125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:34.172125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:54.299467+0000","last_change":"2024-04-23T18:29:11.496267+0000","last_active":"2024-04-23T18:29:54.299467+0000","last_peered":"2024-04-23T18:29:54.299467+0000","last_clean":"2024-04-23T18:29:54.299467+0000","last_became_active":"2024-04-23T18:29:11.495948+0000","last_became_peered":"2024-04-23T18:29:11.495948+0000","last_unstale":"2024-04-23T18:29:54.299467+0000","last_undegraded":"2024-04-23T18:29:54.299467+0000","last_fullsized":"2024-04-23T18:29:54.299467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:25:25.829104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278306+0000","last_change":"2024-04-23T18:29:13.501113+0000","last_active":"2024-04-23T18:31:17.278306+0000","last_peered":"2024-04-23T18:31:17.278306+0000","last_clean":"2024-04-23T18:31:17.278306+0000","last_became_active":"2024-04-23T18:29:13.500819+0000","last_became_peered":"2024-04-23T18:29:13.500819+0000","last_unstale":"2024-04-23T18:31:17.278306+0000","last_undegraded":"2024-04-23T18:31:17.278306+0000","last_fullsized":"2024-04-23T18:31:17.278306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:49.776673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.546657+0000","last_change":"2024-04-23T18:29:11.493307+0000","last_active":"2024-04-23T18:29:52.546657+0000","last_peered":"2024-04-23T18:29:52.546657+0000","last_clean":"2024-04-23T18:29:52.546657+0000","last_became_active":"2024-04-23T18:29:11.492727+0000","last_became_peered":"2024-04-23T18:29:11.492727+0000","last_unstale":"2024-04-23T18:29:52.546657+0000","last_undegraded":"2024-04-23T18:29:52.546657+0000","last_fullsized":"2024-04-23T18:29:52.546657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:00.435842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.216435+0000","last_change":"2024-04-23T18:29:13.503226+0000","last_active":"2024-04-23T18:32:21.216435+0000","last_peered":"2024-04-23T18:32:21.216435+0000","last_clean":"2024-04-23T18:32:21.216435+0000","last_became_active":"2024-04-23T18:29:13.502835+0000","last_became_peered":"2024-04-23T18:29:13.502835+0000","last_unstale":"2024-04-23T18:32:21.216435+0000","last_undegraded":"2024-04-23T18:32:21.216435+0000","last_fullsized":"2024-04-23T18:32:21.216435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:52.502192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.116559+0000","last_change":"2024-04-23T18:29:11.500172+0000","last_active":"2024-04-23T18:32:21.116559+0000","last_peered":"2024-04-23T18:32:21.116559+0000","last_clean":"2024-04-23T18:32:21.116559+0000","last_became_active":"2024-04-23T18:29:11.498708+0000","last_became_peered":"2024-04-23T18:29:11.498708+0000","last_unstale":"2024-04-23T18:32:21.116559+0000","last_undegraded":"2024-04-23T18:32:21.116559+0000","last_fullsized":"2024-04-23T18:32:21.116559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:30.568409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.998106+0000","last_change":"2024-04-23T18:29:13.494415+0000","last_active":"2024-04-23T18:32:20.998106+0000","last_peered":"2024-04-23T18:32:20.998106+0000","last_clean":"2024-04-23T18:32:20.998106+0000","last_became_active":"2024-04-23T18:29:13.494121+0000","last_became_peered":"2024-04-23T18:29:13.494121+0000","last_unstale":"2024-04-23T18:32:20.998106+0000","last_undegraded":"2024-04-23T18:32:20.998106+0000","last_fullsized":"2024-04-23T18:32:20.998106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:53.187803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.785091+0000","last_change":"2024-04-23T18:29:11.490442+0000","last_active":"2024-04-23T18:30:36.785091+0000","last_peered":"2024-04-23T18:30:36.785091+0000","last_clean":"2024-04-23T18:30:36.785091+0000","last_became_active":"2024-04-23T18:29:11.489671+0000","last_became_peered":"2024-04-23T18:29:11.489671+0000","last_unstale":"2024-04-23T18:30:36.785091+0000","last_undegraded":"2024-04-23T18:30:36.785091+0000","last_fullsized":"2024-04-23T18:30:36.785091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:08:36.017083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.185209+0000","last_change":"2024-04-23T18:29:13.507705+0000","last_active":"2024-04-23T18:32:21.185209+0000","last_peered":"2024-04-23T18:32:21.185209+0000","last_clean":"2024-04-23T18:32:21.185209+0000","last_became_active":"2024-04-23T18:29:13.507438+0000","last_became_peered":"2024-04-23T18:29:13.507438+0000","last_unstale":"2024-04-23T18:32:21.185209+0000","last_undegraded":"2024-04-23T18:32:21.185209+0000","last_fullsized":"2024-04-23T18:32:21.185209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:21.755001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.761106+0000","last_change":"2024-04-23T18:29:11.511457+0000","last_active":"2024-04-23T18:31:26.761106+0000","last_peered":"2024-04-23T18:31:26.761106+0000","last_clean":"2024-04-23T18:31:26.761106+0000","last_became_active":"2024-04-23T18:29:11.510882+0000","last_became_peered":"2024-04-23T18:29:11.510882+0000","last_unstale":"2024-04-23T18:31:26.761106+0000","last_undegraded":"2024-04-23T18:31:26.761106+0000","last_fullsized":"2024-04-23T18:31:26.761106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:53:49.753580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.183468+0000","last_change":"2024-04-23T18:29:13.497528+0000","last_active":"2024-04-23T18:32:21.183468+0000","last_peered":"2024-04-23T18:32:21.183468+0000","last_clean":"2024-04-23T18:32:21.183468+0000","last_became_active":"2024-04-23T18:29:13.497271+0000","last_became_peered":"2024-04-23T18:29:13.497271+0000","last_unstale":"2024-04-23T18:32:21.183468+0000","last_undegraded":"2024-04-23T18:32:21.183468+0000","last_fullsized":"2024-04-23T18:32:21.183468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:16:21.578410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552824+0000","last_change":"2024-04-23T18:29:11.507084+0000","last_active":"2024-04-23T18:29:52.552824+0000","last_peered":"2024-04-23T18:29:52.552824+0000","last_clean":"2024-04-23T18:29:52.552824+0000","last_became_active":"2024-04-23T18:29:11.506749+0000","last_became_peered":"2024-04-23T18:29:11.506749+0000","last_unstale":"2024-04-23T18:29:52.552824+0000","last_undegraded":"2024-04-23T18:29:52.552824+0000","last_fullsized":"2024-04-23T18:29:52.552824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:28:56.973382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.278854+0000","last_change":"2024-04-23T18:29:13.501439+0000","last_active":"2024-04-23T18:31:17.278854+0000","last_peered":"2024-04-23T18:31:17.278854+0000","last_clean":"2024-04-23T18:31:17.278854+0000","last_became_active":"2024-04-23T18:29:13.501177+0000","last_became_peered":"2024-04-23T18:29:13.501177+0000","last_unstale":"2024-04-23T18:31:17.278854+0000","last_undegraded":"2024-04-23T18:31:17.278854+0000","last_fullsized":"2024-04-23T18:31:17.278854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:25:34.218528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760399+0000","last_change":"2024-04-23T18:29:11.485837+0000","last_active":"2024-04-23T18:31:31.760399+0000","last_peered":"2024-04-23T18:31:31.760399+0000","last_clean":"2024-04-23T18:31:31.760399+0000","last_became_active":"2024-04-23T18:29:11.484137+0000","last_became_peered":"2024-04-23T18:29:11.484137+0000","last_unstale":"2024-04-23T18:31:31.760399+0000","last_undegraded":"2024-04-23T18:31:31.760399+0000","last_fullsized":"2024-04-23T18:31:31.760399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:46:31.151193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:30:36.615235+0000","last_change":"2024-04-23T18:29:13.498423+0000","last_active":"2024-04-23T18:30:36.615235+0000","last_peered":"2024-04-23T18:30:36.615235+0000","last_clean":"2024-04-23T18:30:36.615235+0000","last_became_active":"2024-04-23T18:29:13.494034+0000","last_became_peered":"2024-04-23T18:29:13.494034+0000","last_unstale":"2024-04-23T18:30:36.615235+0000","last_undegraded":"2024-04-23T18:30:36.615235+0000","last_fullsized":"2024-04-23T18:30:36.615235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:54.917516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.552128+0000","last_change":"2024-04-23T18:29:11.507132+0000","last_active":"2024-04-23T18:29:52.552128+0000","last_peered":"2024-04-23T18:29:52.552128+0000","last_clean":"2024-04-23T18:29:52.552128+0000","last_became_active":"2024-04-23T18:29:11.506801+0000","last_became_peered":"2024-04-23T18:29:11.506801+0000","last_unstale":"2024-04-23T18:29:52.552128+0000","last_undegraded":"2024-04-23T18:29:52.552128+0000","last_fullsized":"2024-04-23T18:29:52.552128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.831893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:29:52.549216+0000","last_change":"2024-04-23T18:29:11.495271+0000","last_active":"2024-04-23T18:29:52.549216+0000","last_peered":"2024-04-23T18:29:52.549216+0000","last_clean":"2024-04-23T18:29:52.549216+0000","last_became_active":"2024-04-23T18:29:11.494891+0000","last_became_peered":"2024-04-23T18:29:11.494891+0000","last_unstale":"2024-04-23T18:29:52.549216+0000","last_undegraded":"2024-04-23T18:29:52.549216+0000","last_fullsized":"2024-04-23T18:29:52.549216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:22:00.867668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759697+0000","last_change":"2024-04-23T18:29:13.495173+0000","last_active":"2024-04-23T18:31:39.759697+0000","last_peered":"2024-04-23T18:31:39.759697+0000","last_clean":"2024-04-23T18:31:39.759697+0000","last_became_active":"2024-04-23T18:29:13.494850+0000","last_became_peered":"2024-04-23T18:29:13.494850+0000","last_unstale":"2024-04-23T18:31:39.759697+0000","last_undegraded":"2024-04-23T18:31:39.759697+0000","last_fullsized":"2024-04-23T18:31:39.759697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:34:01.705044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.122702+0000","last_change":"2024-04-23T18:29:11.495720+0000","last_active":"2024-04-23T18:32:21.122702+0000","last_peered":"2024-04-23T18:32:21.122702+0000","last_clean":"2024-04-23T18:32:21.122702+0000","last_became_active":"2024-04-23T18:29:11.495173+0000","last_became_peered":"2024-04-23T18:29:11.495173+0000","last_unstale":"2024-04-23T18:32:21.122702+0000","last_undegraded":"2024-04-23T18:32:21.122702+0000","last_fullsized":"2024-04-23T18:32:21.122702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:25:10.587855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.762456+0000","last_change":"2024-04-23T18:29:13.506361+0000","last_active":"2024-04-23T18:31:41.762456+0000","last_peered":"2024-04-23T18:31:41.762456+0000","last_clean":"2024-04-23T18:31:41.762456+0000","last_became_active":"2024-04-23T18:29:13.506122+0000","last_became_peered":"2024-04-23T18:29:13.506122+0000","last_unstale":"2024-04-23T18:31:41.762456+0000","last_undegraded":"2024-04-23T18:31:41.762456+0000","last_fullsized":"2024-04-23T18:31:41.762456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:32:28.025600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1444,"num_read_kb":1230,"num_write":545,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1296,"ondisk_log_size":1296,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1604,"num_read_kb":1494,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":27910144,"data_stored":27910144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640302,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48416,"kb_used_data":13080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323424,"statfs":{"total":96636764160,"available":96587186176,"internally_reserved":0,"allocated":13393920,"data_stored":13058939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640302,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44520,"kb_used_data":9184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327320,"statfs":{"total":96636764160,"available":96591175680,"internally_reserved":0,"allocated":9404416,"data_stored":9128922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640303,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42808,"kb_used_data":7472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329032,"statfs":{"total":96636764160,"available":96592928768,"internally_reserved":0,"allocated":7651328,"data_stored":7353289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39928,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331912,"statfs":{"total":96636764160,"available":96595877888,"internally_reserved":0,"allocated":442368,"data_stored":148938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6615040,"data_stored":6615040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:32:32.459 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.460 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.460 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.460 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.460 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.460 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.460 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.460 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.460 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.461 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.461 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.461 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.461 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.461 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.461 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.461 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.461 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.461 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.462 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.462 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.462 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.462 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.462 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.462 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.462 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.462 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.462 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.463 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.463 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.463 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.463 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.463 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.463 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.463 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.463 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.463 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.463 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.464 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.464 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.464 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.464 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.464 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.464 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.464 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.464 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.464 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.465 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.465 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.465 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.465 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.465 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.465 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.465 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.465 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.465 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.465 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.466 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.466 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.466 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.466 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.466 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.466 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.466 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.466 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.466 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.467 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.467 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.467 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.467 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.467 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.467 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.467 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.467 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.467 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.468 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.468 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.468 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.468 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.468 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.468 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.468 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.468 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.468 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.469 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.469 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.469 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.469 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.469 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.469 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.469 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.469 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.469 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.469 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.470 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.470 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.470 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.470 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.470 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.470 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.470 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.470 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.470 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-23T18:28:57.410644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=28, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.471 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.471 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.471 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.471 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.471 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.471 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.471 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.471 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.471 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.471 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.472 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.472 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.472 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.472 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.472 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.472 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.472 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.472 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.472 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.473 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.473 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.473 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.473 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.473 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.473 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.473 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.473 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.473 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.474 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.474 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.474 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.474 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.474 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.474 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.474 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.474 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.474 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.475 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.475 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.475 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.475 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.475 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.475 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.475 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.475 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.475 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.475 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.476 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.476 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.476 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.476 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.476 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.476 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.476 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.476 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.476 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.477 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.477 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.477 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.477 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.477 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.477 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.477 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.477 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.477 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.477 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.478 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.478 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.478 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.478 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.478 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.478 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.478 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.478 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.478 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.479 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.479 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.479 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.479 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.479 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.479 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.479 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.479 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.479 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.479 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.480 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.480 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.480 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.480 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.480 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.480 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.480 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.481 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.481 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.481 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.481 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.481 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.481 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.481 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.481 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.481 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.482 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.482 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.482 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.482 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.482 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.482 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.482 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.482 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.482 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.482 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.483 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.483 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.483 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.483 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.483 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.483 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.483 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.483 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.483 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.484 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.484 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.484 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.484 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.484 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.484 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.484 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.484 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.484 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.484 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.485 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.485 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.485 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.485 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.485 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.485 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.485 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.485 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.485 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.486 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.486 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.486 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.486 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.486 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.486 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.486 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.486 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.486 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.487 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.487 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.487 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.487 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.487 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.487 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.487 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.487 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.487 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.487 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.488 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.488 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.488 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.488 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.488 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:32.488 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T18:32:52.489 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:32:52.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.610+0000 7f03bebe6640 1 Processor -- start 2024-04-23T18:32:52.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.610+0000 7f03bebe6640 1 -- start start 2024-04-23T18:32:52.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.610+0000 7f03bebe6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f03b812e920 0x7f03b8130d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:52.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.610+0000 7f03bebe6640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b8096500 con 0x7f03b81284a0 2024-04-23T18:32:52.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.610+0000 7f03bebe6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f03b8128050 con 0x7f03b812e920 2024-04-23T18:32:52.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.611+0000 7f03b7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f03b812e920 0x7f03b8130d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:52.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.611+0000 7f03bc982640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f03b81284a0 0x7f03b8128880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45730/0 (socket says 172.21.15.62:45730) 2024-04-23T18:32:52.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.611+0000 7f03bc982640 1 -- 172.21.15.62:0/1691828025 learned_addr learned my addr 172.21.15.62:0/1691828025 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:32:52.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.611+0000 7f03b7fff640 1 -- 172.21.15.62:0/1691828025 >> v1:172.21.15.62:6789/0 conn(0x7f03b81284a0 legacy=0x7f03b8128880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:52.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.611+0000 7f03b7fff640 1 -- 172.21.15.62:0/1691828025 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b8128f90 con 0x7f03b812e920 2024-04-23T18:32:52.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.611+0000 7f03b77fe640 1 -- 172.21.15.62:0/1691828025 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3411489082 0 0) 0x7f03b8096500 con 0x7f03b81284a0 2024-04-23T18:32:52.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.612+0000 7f03b7fff640 1 --2- 172.21.15.62:0/1691828025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b812e920 0x7f03b8130d10 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009720 tx=0x7f03a402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78226fb4591f6b26 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:52.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.612+0000 7f03b77fe640 1 -- 172.21.15.62:0/1691828025 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a40316d0 con 0x7f03b812e920 2024-04-23T18:32:52.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.612+0000 7f03b77fe640 1 -- 172.21.15.62:0/1691828025 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a4037070 con 0x7f03b812e920 2024-04-23T18:32:52.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.612+0000 7f03b77fe640 1 -- 172.21.15.62:0/1691828025 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03a40319c0 con 0x7f03b812e920 2024-04-23T18:32:52.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.612+0000 7f03bebe6640 1 -- 172.21.15.62:0/1691828025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b812e920 msgr2=0x7f03b8130d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:52.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.612+0000 7f03bebe6640 1 --2- 172.21.15.62:0/1691828025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b812e920 0x7f03b8130d10 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009720 tx=0x7f03a402b840 comp rx=0 tx=0).stop 2024-04-23T18:32:52.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.612+0000 7f03bebe6640 1 -- 172.21.15.62:0/1691828025 shutdown_connections 2024-04-23T18:32:52.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.612+0000 7f03bebe6640 1 --2- 172.21.15.62:0/1691828025 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b812e920 0x7f03b8130d10 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:52.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.612+0000 7f03bebe6640 1 -- 172.21.15.62:0/1691828025 >> 172.21.15.62:0/1691828025 conn(0x7f03b8099d70 msgr2=0x7f03b8097640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:52.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.612+0000 7f03bebe6640 1 -- 172.21.15.62:0/1691828025 shutdown_connections 2024-04-23T18:32:52.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.612+0000 7f03bebe6640 1 -- 172.21.15.62:0/1691828025 wait complete. 2024-04-23T18:32:52.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.613+0000 7f03bebe6640 1 Processor -- start 2024-04-23T18:32:52.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.613+0000 7f03bebe6640 1 -- start start 2024-04-23T18:32:52.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.614+0000 7f03bebe6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b81284a0 0x7f03b8123fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:52.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.614+0000 7f03bebe6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f03b8097040 con 0x7f03b81284a0 2024-04-23T18:32:52.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.614+0000 7f03bc982640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b81284a0 0x7f03b8123fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:52.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.614+0000 7f03bc982640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b81284a0 0x7f03b8123fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42506/0 (socket says 172.21.15.62:42506) 2024-04-23T18:32:52.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.614+0000 7f03bc982640 1 -- 172.21.15.62:0/1282037100 learned_addr learned my addr 172.21.15.62:0/1282037100 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:32:52.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.614+0000 7f03bc982640 1 -- 172.21.15.62:0/1282037100 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b806f750 con 0x7f03b81284a0 2024-04-23T18:32:52.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.614+0000 7f03bc982640 1 --2- 172.21.15.62:0/1282037100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b81284a0 0x7f03b8123fa0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00c370 tx=0x7f03ac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:52.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.615+0000 7f03b57fa640 1 -- 172.21.15.62:0/1282037100 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03ac007410 con 0x7f03b81284a0 2024-04-23T18:32:52.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.615+0000 7f03b57fa640 1 -- 172.21.15.62:0/1282037100 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ac0075d0 con 0x7f03b81284a0 2024-04-23T18:32:52.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.615+0000 7f03b57fa640 1 -- 172.21.15.62:0/1282037100 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03ac004950 con 0x7f03b81284a0 2024-04-23T18:32:52.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.615+0000 7f03bebe6640 1 -- 172.21.15.62:0/1282037100 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b8072fc0 con 0x7f03b81284a0 2024-04-23T18:32:52.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.615+0000 7f03bebe6640 1 -- 172.21.15.62:0/1282037100 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b806f9f0 con 0x7f03b81284a0 2024-04-23T18:32:52.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.616+0000 7f03b57fa640 1 -- 172.21.15.62:0/1282037100 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f03ac011070 con 0x7f03b81284a0 2024-04-23T18:32:52.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.616+0000 7f03b57fa640 1 --2- 172.21.15.62:0/1282037100 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f039c0385c0 0x7f039c03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:32:52.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.616+0000 7f03bebe6640 1 -- 172.21.15.62:0/1282037100 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b80505b0 con 0x7f03b81284a0 2024-04-23T18:32:52.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.616+0000 7f03b57fa640 1 -- 172.21.15.62:0/1282037100 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f03ac04bca0 con 0x7f03b81284a0 2024-04-23T18:32:52.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.616+0000 7f03b7fff640 1 --2- 172.21.15.62:0/1282037100 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f039c0385c0 0x7f039c03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:32:52.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.617+0000 7f03b7fff640 1 --2- 172.21.15.62:0/1282037100 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f039c0385c0 0x7f039c03aa80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f03a4036000 tx=0x7f03a4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:32:52.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.621+0000 7f03b57fa640 1 -- 172.21.15.62:0/1282037100 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f03b806f750 con 0x7f03b81284a0 2024-04-23T18:32:52.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.804+0000 7f03bebe6640 1 -- 172.21.15.62:0/1282037100 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03b806f140 con 0x7f039c0385c0 2024-04-23T18:32:52.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.819+0000 7f03b57fa640 1 -- 172.21.15.62:0/1282037100 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658835 (secure 0 0 0) 0x7f03b806f140 con 0x7f039c0385c0 2024-04-23T18:32:52.824 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:32:52.830 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-04-23T18:32:52.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.824+0000 7f03bebe6640 1 -- 172.21.15.62:0/1282037100 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f039c0385c0 msgr2=0x7f039c03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:52.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.824+0000 7f03bebe6640 1 --2- 172.21.15.62:0/1282037100 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f039c0385c0 0x7f039c03aa80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f03a4036000 tx=0x7f03a4008030 comp rx=0 tx=0).stop 2024-04-23T18:32:52.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.824+0000 7f03bebe6640 1 -- 172.21.15.62:0/1282037100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b81284a0 msgr2=0x7f03b8123fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:32:52.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.824+0000 7f03bebe6640 1 --2- 172.21.15.62:0/1282037100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b81284a0 0x7f03b8123fa0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f03ac00c370 tx=0x7f03ac00c830 comp rx=0 tx=0).stop 2024-04-23T18:32:52.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.824+0000 7f03bebe6640 1 -- 172.21.15.62:0/1282037100 shutdown_connections 2024-04-23T18:32:52.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.824+0000 7f03bebe6640 1 --2- 172.21.15.62:0/1282037100 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f039c0385c0 0x7f039c03aa80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:52.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.824+0000 7f03bebe6640 1 --2- 172.21.15.62:0/1282037100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f03b81284a0 0x7f03b8123fa0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:32:52.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.824+0000 7f03bebe6640 1 -- 172.21.15.62:0/1282037100 >> 172.21.15.62:0/1282037100 conn(0x7f03b8099d70 msgr2=0x7f03b8126750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:32:52.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.824+0000 7f03bebe6640 1 -- 172.21.15.62:0/1282037100 shutdown_connections 2024-04-23T18:32:52.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:32:52.824+0000 7f03bebe6640 1 -- 172.21.15.62:0/1282037100 wait complete. 2024-04-23T18:32:52.834 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-04-23T18:32:52.751230+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5092,"num_read_kb":4673,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4724,"ondisk_log_size":4724,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152568,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334792,"statfs":{"total":386547056640,"available":386390827008,"internally_reserved":0,"allocated":2973696,"data_stored":1776522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1042,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004235"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:20.394770+0000","last_change":"2024-04-23T18:29:11.496715+0000","last_active":"2024-04-23T18:31:20.394770+0000","last_peered":"2024-04-23T18:31:20.394770+0000","last_clean":"2024-04-23T18:31:20.394770+0000","last_became_active":"2024-04-23T18:29:11.495610+0000","last_became_peered":"2024-04-23T18:29:11.495610+0000","last_unstale":"2024-04-23T18:31:20.394770+0000","last_undegraded":"2024-04-23T18:31:20.394770+0000","last_fullsized":"2024-04-23T18:31:20.394770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223746+0000","last_change":"2024-04-23T18:29:13.493644+0000","last_active":"2024-04-23T18:32:21.223746+0000","last_peered":"2024-04-23T18:32:21.223746+0000","last_clean":"2024-04-23T18:32:21.223746+0000","last_became_active":"2024-04-23T18:29:13.492771+0000","last_became_peered":"2024-04-23T18:29:13.492771+0000","last_unstale":"2024-04-23T18:32:21.223746+0000","last_undegraded":"2024-04-23T18:32:21.223746+0000","last_fullsized":"2024-04-23T18:32:21.223746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756636+0000","last_change":"2024-04-23T18:29:11.495726+0000","last_active":"2024-04-23T18:31:19.756636+0000","last_peered":"2024-04-23T18:31:19.756636+0000","last_clean":"2024-04-23T18:31:19.756636+0000","last_became_active":"2024-04-23T18:29:11.495272+0000","last_became_peered":"2024-04-23T18:29:11.495272+0000","last_unstale":"2024-04-23T18:31:19.756636+0000","last_undegraded":"2024-04-23T18:31:19.756636+0000","last_fullsized":"2024-04-23T18:31:19.756636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'9","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.268862+0000","last_change":"2024-04-23T18:29:13.495212+0000","last_active":"2024-04-23T18:32:21.268862+0000","last_peered":"2024-04-23T18:32:21.268862+0000","last_clean":"2024-04-23T18:32:21.268862+0000","last_became_active":"2024-04-23T18:29:13.494969+0000","last_became_peered":"2024-04-23T18:29:13.494969+0000","last_unstale":"2024-04-23T18:32:21.268862+0000","last_undegraded":"2024-04-23T18:32:21.268862+0000","last_fullsized":"2024-04-23T18:32:21.268862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.886618+0000","last_change":"2024-04-23T18:29:11.505594+0000","last_active":"2024-04-23T18:32:20.886618+0000","last_peered":"2024-04-23T18:32:20.886618+0000","last_clean":"2024-04-23T18:32:20.886618+0000","last_became_active":"2024-04-23T18:29:11.505283+0000","last_became_peered":"2024-04-23T18:29:11.505283+0000","last_unstale":"2024-04-23T18:32:20.886618+0000","last_undegraded":"2024-04-23T18:32:20.886618+0000","last_fullsized":"2024-04-23T18:32:20.886618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.764053+0000","last_change":"2024-04-23T18:29:13.495612+0000","last_active":"2024-04-23T18:31:46.764053+0000","last_peered":"2024-04-23T18:31:46.764053+0000","last_clean":"2024-04-23T18:31:46.764053+0000","last_became_active":"2024-04-23T18:29:13.495367+0000","last_became_peered":"2024-04-23T18:29:13.495367+0000","last_unstale":"2024-04-23T18:31:46.764053+0000","last_undegraded":"2024-04-23T18:31:46.764053+0000","last_fullsized":"2024-04-23T18:31:46.764053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:11.757517+0000","last_change":"2024-04-23T18:29:11.496818+0000","last_active":"2024-04-23T18:31:11.757517+0000","last_peered":"2024-04-23T18:31:11.757517+0000","last_clean":"2024-04-23T18:31:11.757517+0000","last_became_active":"2024-04-23T18:29:11.495677+0000","last_became_peered":"2024-04-23T18:29:11.495677+0000","last_unstale":"2024-04-23T18:31:11.757517+0000","last_undegraded":"2024-04-23T18:31:11.757517+0000","last_fullsized":"2024-04-23T18:31:11.757517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.767585+0000","last_change":"2024-04-23T18:29:52.558192+0000","last_active":"2024-04-23T18:32:21.767585+0000","last_peered":"2024-04-23T18:32:21.767585+0000","last_clean":"2024-04-23T18:32:21.767585+0000","last_became_active":"2024-04-23T18:29:52.548291+0000","last_became_peered":"2024-04-23T18:29:52.548291+0000","last_unstale":"2024-04-23T18:32:21.767585+0000","last_undegraded":"2024-04-23T18:32:21.767585+0000","last_fullsized":"2024-04-23T18:32:21.767585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763341+0000","last_change":"2024-04-23T18:29:11.504896+0000","last_active":"2024-04-23T18:31:41.763341+0000","last_peered":"2024-04-23T18:31:41.763341+0000","last_clean":"2024-04-23T18:31:41.763341+0000","last_became_active":"2024-04-23T18:29:11.504554+0000","last_became_peered":"2024-04-23T18:29:11.504554+0000","last_unstale":"2024-04-23T18:31:41.763341+0000","last_undegraded":"2024-04-23T18:31:41.763341+0000","last_fullsized":"2024-04-23T18:31:41.763341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.271391+0000","last_change":"2024-04-23T18:29:13.498634+0000","last_active":"2024-04-23T18:32:21.271391+0000","last_peered":"2024-04-23T18:32:21.271391+0000","last_clean":"2024-04-23T18:32:21.271391+0000","last_became_active":"2024-04-23T18:29:13.498378+0000","last_became_peered":"2024-04-23T18:29:13.498378+0000","last_unstale":"2024-04-23T18:32:21.271391+0000","last_undegraded":"2024-04-23T18:32:21.271391+0000","last_fullsized":"2024-04-23T18:32:21.271391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.762004+0000","last_change":"2024-04-23T18:29:11.497271+0000","last_active":"2024-04-23T18:31:41.762004+0000","last_peered":"2024-04-23T18:31:41.762004+0000","last_clean":"2024-04-23T18:31:41.762004+0000","last_became_active":"2024-04-23T18:29:11.496923+0000","last_became_peered":"2024-04-23T18:29:11.496923+0000","last_unstale":"2024-04-23T18:31:41.762004+0000","last_undegraded":"2024-04-23T18:31:41.762004+0000","last_fullsized":"2024-04-23T18:31:41.762004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.469149+0000","last_change":"2024-04-23T18:32:49.469206+0000","last_active":"2024-04-23T18:32:49.469149+0000","last_peered":"2024-04-23T18:32:49.469149+0000","last_clean":"2024-04-23T18:32:49.469149+0000","last_became_active":"2024-04-23T18:29:13.502401+0000","last_became_peered":"2024-04-23T18:29:13.502401+0000","last_unstale":"2024-04-23T18:32:49.469149+0000","last_undegraded":"2024-04-23T18:32:49.469149+0000","last_fullsized":"2024-04-23T18:32:49.469149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:49.469055+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:49.469055+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.469055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:49:26.457594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.130109+0000","last_change":"2024-04-23T18:29:11.500102+0000","last_active":"2024-04-23T18:32:21.130109+0000","last_peered":"2024-04-23T18:32:21.130109+0000","last_clean":"2024-04-23T18:32:21.130109+0000","last_became_active":"2024-04-23T18:29:11.499772+0000","last_became_peered":"2024-04-23T18:29:11.499772+0000","last_unstale":"2024-04-23T18:32:21.130109+0000","last_undegraded":"2024-04-23T18:32:21.130109+0000","last_fullsized":"2024-04-23T18:32:21.130109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.007802+0000","last_change":"2024-04-23T18:29:13.499669+0000","last_active":"2024-04-23T18:32:21.007802+0000","last_peered":"2024-04-23T18:32:21.007802+0000","last_clean":"2024-04-23T18:32:21.007802+0000","last_became_active":"2024-04-23T18:29:13.498965+0000","last_became_peered":"2024-04-23T18:29:13.498965+0000","last_unstale":"2024-04-23T18:32:21.007802+0000","last_undegraded":"2024-04-23T18:32:21.007802+0000","last_fullsized":"2024-04-23T18:32:21.007802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:44.760213+0000","last_change":"2024-04-23T18:29:11.493089+0000","last_active":"2024-04-23T18:31:44.760213+0000","last_peered":"2024-04-23T18:31:44.760213+0000","last_clean":"2024-04-23T18:31:44.760213+0000","last_became_active":"2024-04-23T18:29:11.491840+0000","last_became_peered":"2024-04-23T18:29:11.491840+0000","last_unstale":"2024-04-23T18:31:44.760213+0000","last_undegraded":"2024-04-23T18:31:44.760213+0000","last_fullsized":"2024-04-23T18:31:44.760213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.145230+0000","last_change":"2024-04-23T18:29:13.505657+0000","last_active":"2024-04-23T18:32:21.145230+0000","last_peered":"2024-04-23T18:32:21.145230+0000","last_clean":"2024-04-23T18:32:21.145230+0000","last_became_active":"2024-04-23T18:29:13.505348+0000","last_became_peered":"2024-04-23T18:29:13.505348+0000","last_unstale":"2024-04-23T18:32:21.145230+0000","last_undegraded":"2024-04-23T18:32:21.145230+0000","last_fullsized":"2024-04-23T18:32:21.145230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762505+0000","last_change":"2024-04-23T18:29:13.495619+0000","last_active":"2024-04-23T18:31:36.762505+0000","last_peered":"2024-04-23T18:31:36.762505+0000","last_clean":"2024-04-23T18:31:36.762505+0000","last_became_active":"2024-04-23T18:29:13.495337+0000","last_became_peered":"2024-04-23T18:29:13.495337+0000","last_unstale":"2024-04-23T18:31:36.762505+0000","last_undegraded":"2024-04-23T18:31:36.762505+0000","last_fullsized":"2024-04-23T18:31:36.762505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761671+0000","last_change":"2024-04-23T18:29:11.502496+0000","last_active":"2024-04-23T18:31:36.761671+0000","last_peered":"2024-04-23T18:31:36.761671+0000","last_clean":"2024-04-23T18:31:36.761671+0000","last_became_active":"2024-04-23T18:29:11.501773+0000","last_became_peered":"2024-04-23T18:29:11.501773+0000","last_unstale":"2024-04-23T18:31:36.761671+0000","last_undegraded":"2024-04-23T18:31:36.761671+0000","last_fullsized":"2024-04-23T18:31:36.761671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761457+0000","last_change":"2024-04-23T18:29:13.493129+0000","last_active":"2024-04-23T18:31:36.761457+0000","last_peered":"2024-04-23T18:31:36.761457+0000","last_clean":"2024-04-23T18:31:36.761457+0000","last_became_active":"2024-04-23T18:29:13.492366+0000","last_became_peered":"2024-04-23T18:29:13.492366+0000","last_unstale":"2024-04-23T18:31:36.761457+0000","last_undegraded":"2024-04-23T18:31:36.761457+0000","last_fullsized":"2024-04-23T18:31:36.761457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761199+0000","last_change":"2024-04-23T18:29:11.486168+0000","last_active":"2024-04-23T18:31:36.761199+0000","last_peered":"2024-04-23T18:31:36.761199+0000","last_clean":"2024-04-23T18:31:36.761199+0000","last_became_active":"2024-04-23T18:29:11.484620+0000","last_became_peered":"2024-04-23T18:29:11.484620+0000","last_unstale":"2024-04-23T18:31:36.761199+0000","last_undegraded":"2024-04-23T18:31:36.761199+0000","last_fullsized":"2024-04-23T18:31:36.761199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'16","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223715+0000","last_change":"2024-04-23T18:29:13.496876+0000","last_active":"2024-04-23T18:32:21.223715+0000","last_peered":"2024-04-23T18:32:21.223715+0000","last_clean":"2024-04-23T18:32:21.223715+0000","last_became_active":"2024-04-23T18:29:13.495743+0000","last_became_peered":"2024-04-23T18:29:13.495743+0000","last_unstale":"2024-04-23T18:32:21.223715+0000","last_undegraded":"2024-04-23T18:32:21.223715+0000","last_fullsized":"2024-04-23T18:32:21.223715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761616+0000","last_change":"2024-04-23T18:29:11.494610+0000","last_active":"2024-04-23T18:31:36.761616+0000","last_peered":"2024-04-23T18:31:36.761616+0000","last_clean":"2024-04-23T18:31:36.761616+0000","last_became_active":"2024-04-23T18:29:11.493363+0000","last_became_peered":"2024-04-23T18:29:11.493363+0000","last_unstale":"2024-04-23T18:31:36.761616+0000","last_undegraded":"2024-04-23T18:31:36.761616+0000","last_fullsized":"2024-04-23T18:31:36.761616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'3","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.271497+0000","last_change":"2024-04-23T18:29:13.502315+0000","last_active":"2024-04-23T18:32:21.271497+0000","last_peered":"2024-04-23T18:32:21.271497+0000","last_clean":"2024-04-23T18:32:21.271497+0000","last_became_active":"2024-04-23T18:29:13.501988+0000","last_became_peered":"2024-04-23T18:29:13.501988+0000","last_unstale":"2024-04-23T18:32:21.271497+0000","last_undegraded":"2024-04-23T18:32:21.271497+0000","last_fullsized":"2024-04-23T18:32:21.271497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761581+0000","last_change":"2024-04-23T18:29:11.503048+0000","last_active":"2024-04-23T18:31:36.761581+0000","last_peered":"2024-04-23T18:31:36.761581+0000","last_clean":"2024-04-23T18:31:36.761581+0000","last_became_active":"2024-04-23T18:29:11.502714+0000","last_became_peered":"2024-04-23T18:29:11.502714+0000","last_unstale":"2024-04-23T18:31:36.761581+0000","last_undegraded":"2024-04-23T18:31:36.761581+0000","last_fullsized":"2024-04-23T18:31:36.761581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223180+0000","last_change":"2024-04-23T18:29:13.499010+0000","last_active":"2024-04-23T18:32:21.223180+0000","last_peered":"2024-04-23T18:32:21.223180+0000","last_clean":"2024-04-23T18:32:21.223180+0000","last_became_active":"2024-04-23T18:29:13.498488+0000","last_became_peered":"2024-04-23T18:29:13.498488+0000","last_unstale":"2024-04-23T18:32:21.223180+0000","last_undegraded":"2024-04-23T18:32:21.223180+0000","last_fullsized":"2024-04-23T18:32:21.223180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759612+0000","last_change":"2024-04-23T18:29:11.495476+0000","last_active":"2024-04-23T18:31:39.759612+0000","last_peered":"2024-04-23T18:31:39.759612+0000","last_clean":"2024-04-23T18:31:39.759612+0000","last_became_active":"2024-04-23T18:29:11.495025+0000","last_became_peered":"2024-04-23T18:29:11.495025+0000","last_unstale":"2024-04-23T18:31:39.759612+0000","last_undegraded":"2024-04-23T18:31:39.759612+0000","last_fullsized":"2024-04-23T18:31:39.759612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.762434+0000","last_change":"2024-04-23T18:29:13.494330+0000","last_active":"2024-04-23T18:31:41.762434+0000","last_peered":"2024-04-23T18:31:41.762434+0000","last_clean":"2024-04-23T18:31:41.762434+0000","last_became_active":"2024-04-23T18:29:13.494080+0000","last_became_peered":"2024-04-23T18:29:13.494080+0000","last_unstale":"2024-04-23T18:31:41.762434+0000","last_undegraded":"2024-04-23T18:31:41.762434+0000","last_fullsized":"2024-04-23T18:31:41.762434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761789+0000","last_change":"2024-04-23T18:29:11.507699+0000","last_active":"2024-04-23T18:31:31.761789+0000","last_peered":"2024-04-23T18:31:31.761789+0000","last_clean":"2024-04-23T18:31:31.761789+0000","last_became_active":"2024-04-23T18:29:11.507336+0000","last_became_peered":"2024-04-23T18:29:11.507336+0000","last_unstale":"2024-04-23T18:31:31.761789+0000","last_undegraded":"2024-04-23T18:31:31.761789+0000","last_fullsized":"2024-04-23T18:31:31.761789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.233621+0000","last_change":"2024-04-23T18:29:21.530202+0000","last_active":"2024-04-23T18:32:21.233621+0000","last_peered":"2024-04-23T18:32:21.233621+0000","last_clean":"2024-04-23T18:32:21.233621+0000","last_became_active":"2024-04-23T18:29:21.529771+0000","last_became_peered":"2024-04-23T18:29:21.529771+0000","last_unstale":"2024-04-23T18:32:21.233621+0000","last_undegraded":"2024-04-23T18:32:21.233621+0000","last_fullsized":"2024-04-23T18:32:21.233621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'22","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223515+0000","last_change":"2024-04-23T18:29:52.561113+0000","last_active":"2024-04-23T18:32:21.223515+0000","last_peered":"2024-04-23T18:32:21.223515+0000","last_clean":"2024-04-23T18:32:21.223515+0000","last_became_active":"2024-04-23T18:29:52.549641+0000","last_became_peered":"2024-04-23T18:29:52.549641+0000","last_unstale":"2024-04-23T18:32:21.223515+0000","last_undegraded":"2024-04-23T18:32:21.223515+0000","last_fullsized":"2024-04-23T18:32:21.223515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":69,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.877671+0000","last_change":"2024-04-23T18:29:11.512384+0000","last_active":"2024-04-23T18:32:27.877671+0000","last_peered":"2024-04-23T18:32:27.877671+0000","last_clean":"2024-04-23T18:32:27.877671+0000","last_became_active":"2024-04-23T18:29:11.512062+0000","last_became_peered":"2024-04-23T18:29:11.512062+0000","last_unstale":"2024-04-23T18:32:27.877671+0000","last_undegraded":"2024-04-23T18:32:27.877671+0000","last_fullsized":"2024-04-23T18:32:27.877671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.393499+0000","last_change":"2024-04-23T18:32:36.393525+0000","last_active":"2024-04-23T18:32:36.393499+0000","last_peered":"2024-04-23T18:32:36.393499+0000","last_clean":"2024-04-23T18:32:36.393499+0000","last_became_active":"2024-04-23T18:29:15.508100+0000","last_became_peered":"2024-04-23T18:29:15.508100+0000","last_unstale":"2024-04-23T18:32:36.393499+0000","last_undegraded":"2024-04-23T18:32:36.393499+0000","last_fullsized":"2024-04-23T18:32:36.393499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.393398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.393398+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.393398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:14.247382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.399695+0000","last_change":"2024-04-23T18:32:43.399750+0000","last_active":"2024-04-23T18:32:43.399695+0000","last_peered":"2024-04-23T18:32:43.399695+0000","last_clean":"2024-04-23T18:32:43.399695+0000","last_became_active":"2024-04-23T18:29:17.513368+0000","last_became_peered":"2024-04-23T18:29:17.513368+0000","last_unstale":"2024-04-23T18:32:43.399695+0000","last_undegraded":"2024-04-23T18:32:43.399695+0000","last_fullsized":"2024-04-23T18:32:43.399695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:43.399581+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:43.399581+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.399581+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:04.955093+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.915356+0000","last_change":"2024-04-23T18:32:35.915380+0000","last_active":"2024-04-23T18:32:35.915356+0000","last_peered":"2024-04-23T18:32:35.915356+0000","last_clean":"2024-04-23T18:32:35.915356+0000","last_became_active":"2024-04-23T18:29:19.520066+0000","last_became_peered":"2024-04-23T18:29:19.520066+0000","last_unstale":"2024-04-23T18:32:35.915356+0000","last_undegraded":"2024-04-23T18:32:35.915356+0000","last_fullsized":"2024-04-23T18:32:35.915356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.915263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.915263+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.915263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:33.026516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.763058+0000","last_change":"2024-04-23T18:29:21.530037+0000","last_active":"2024-04-23T18:31:46.763058+0000","last_peered":"2024-04-23T18:31:46.763058+0000","last_clean":"2024-04-23T18:31:46.763058+0000","last_became_active":"2024-04-23T18:29:21.529743+0000","last_became_peered":"2024-04-23T18:29:21.529743+0000","last_unstale":"2024-04-23T18:31:46.763058+0000","last_undegraded":"2024-04-23T18:31:46.763058+0000","last_fullsized":"2024-04-23T18:31:46.763058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'9","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.268939+0000","last_change":"2024-04-23T18:29:13.496552+0000","last_active":"2024-04-23T18:32:21.268939+0000","last_peered":"2024-04-23T18:32:21.268939+0000","last_clean":"2024-04-23T18:32:21.268939+0000","last_became_active":"2024-04-23T18:29:13.496299+0000","last_became_peered":"2024-04-23T18:29:13.496299+0000","last_unstale":"2024-04-23T18:32:21.268939+0000","last_undegraded":"2024-04-23T18:32:21.268939+0000","last_fullsized":"2024-04-23T18:32:21.268939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760271+0000","last_change":"2024-04-23T18:29:11.497209+0000","last_active":"2024-04-23T18:31:31.760271+0000","last_peered":"2024-04-23T18:31:31.760271+0000","last_clean":"2024-04-23T18:31:31.760271+0000","last_became_active":"2024-04-23T18:29:11.496878+0000","last_became_peered":"2024-04-23T18:29:11.496878+0000","last_unstale":"2024-04-23T18:31:31.760271+0000","last_undegraded":"2024-04-23T18:31:31.760271+0000","last_fullsized":"2024-04-23T18:31:31.760271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:34.758833+0000","last_change":"2024-04-23T18:29:15.504985+0000","last_active":"2024-04-23T18:31:34.758833+0000","last_peered":"2024-04-23T18:31:34.758833+0000","last_clean":"2024-04-23T18:31:34.758833+0000","last_became_active":"2024-04-23T18:29:15.504744+0000","last_became_peered":"2024-04-23T18:29:15.504744+0000","last_unstale":"2024-04-23T18:31:34.758833+0000","last_undegraded":"2024-04-23T18:31:34.758833+0000","last_fullsized":"2024-04-23T18:31:34.758833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.884623+0000","last_change":"2024-04-23T18:32:37.884678+0000","last_active":"2024-04-23T18:32:37.884623+0000","last_peered":"2024-04-23T18:32:37.884623+0000","last_clean":"2024-04-23T18:32:37.884623+0000","last_became_active":"2024-04-23T18:29:17.510201+0000","last_became_peered":"2024-04-23T18:29:17.510201+0000","last_unstale":"2024-04-23T18:32:37.884623+0000","last_undegraded":"2024-04-23T18:32:37.884623+0000","last_fullsized":"2024-04-23T18:32:37.884623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-23T18:32:37.884529+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-23T18:32:37.884529+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.884529+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.954621+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.869790+0000","last_change":"2024-04-23T18:32:43.869829+0000","last_active":"2024-04-23T18:32:43.869790+0000","last_peered":"2024-04-23T18:32:43.869790+0000","last_clean":"2024-04-23T18:32:43.869790+0000","last_became_active":"2024-04-23T18:29:19.527770+0000","last_became_peered":"2024-04-23T18:29:19.527770+0000","last_unstale":"2024-04-23T18:32:43.869790+0000","last_undegraded":"2024-04-23T18:32:43.869790+0000","last_fullsized":"2024-04-23T18:32:43.869790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:43.869698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:43.869698+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.869698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:06.080613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:54.761589+0000","last_change":"2024-04-23T18:29:21.526235+0000","last_active":"2024-04-23T18:31:54.761589+0000","last_peered":"2024-04-23T18:31:54.761589+0000","last_clean":"2024-04-23T18:31:54.761589+0000","last_became_active":"2024-04-23T18:29:21.525940+0000","last_became_peered":"2024-04-23T18:29:21.525940+0000","last_unstale":"2024-04-23T18:31:54.761589+0000","last_undegraded":"2024-04-23T18:31:54.761589+0000","last_fullsized":"2024-04-23T18:31:54.761589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.222685+0000","last_change":"2024-04-23T18:29:13.496417+0000","last_active":"2024-04-23T18:32:21.222685+0000","last_peered":"2024-04-23T18:32:21.222685+0000","last_clean":"2024-04-23T18:32:21.222685+0000","last_became_active":"2024-04-23T18:29:13.496142+0000","last_became_peered":"2024-04-23T18:29:13.496142+0000","last_unstale":"2024-04-23T18:32:21.222685+0000","last_undegraded":"2024-04-23T18:32:21.222685+0000","last_fullsized":"2024-04-23T18:32:21.222685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761746+0000","last_change":"2024-04-23T18:29:11.504850+0000","last_active":"2024-04-23T18:31:31.761746+0000","last_peered":"2024-04-23T18:31:31.761746+0000","last_clean":"2024-04-23T18:31:31.761746+0000","last_became_active":"2024-04-23T18:29:11.504534+0000","last_became_peered":"2024-04-23T18:29:11.504534+0000","last_unstale":"2024-04-23T18:31:31.761746+0000","last_undegraded":"2024-04-23T18:31:31.761746+0000","last_fullsized":"2024-04-23T18:31:31.761746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759710+0000","last_change":"2024-04-23T18:29:15.510428+0000","last_active":"2024-04-23T18:31:39.759710+0000","last_peered":"2024-04-23T18:31:39.759710+0000","last_clean":"2024-04-23T18:31:39.759710+0000","last_became_active":"2024-04-23T18:29:15.510018+0000","last_became_peered":"2024-04-23T18:29:15.510018+0000","last_unstale":"2024-04-23T18:31:39.759710+0000","last_undegraded":"2024-04-23T18:31:39.759710+0000","last_fullsized":"2024-04-23T18:31:39.759710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.411781+0000","last_change":"2024-04-23T18:32:39.411841+0000","last_active":"2024-04-23T18:32:39.411781+0000","last_peered":"2024-04-23T18:32:39.411781+0000","last_clean":"2024-04-23T18:32:39.411781+0000","last_became_active":"2024-04-23T18:29:17.517679+0000","last_became_peered":"2024-04-23T18:29:17.517679+0000","last_unstale":"2024-04-23T18:32:39.411781+0000","last_undegraded":"2024-04-23T18:32:39.411781+0000","last_fullsized":"2024-04-23T18:32:39.411781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:32:39.411679+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:32:39.411679+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.411679+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:33:43.011129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":385,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.902358+0000","last_change":"2024-04-23T18:29:19.522798+0000","last_active":"2024-04-23T18:32:27.902358+0000","last_peered":"2024-04-23T18:32:27.902358+0000","last_clean":"2024-04-23T18:32:27.902358+0000","last_became_active":"2024-04-23T18:29:19.522434+0000","last_became_peered":"2024-04-23T18:29:19.522434+0000","last_unstale":"2024-04-23T18:32:27.902358+0000","last_undegraded":"2024-04-23T18:32:27.902358+0000","last_fullsized":"2024-04-23T18:32:27.902358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.484842+0000","last_change":"2024-04-23T18:32:45.484880+0000","last_active":"2024-04-23T18:32:45.484842+0000","last_peered":"2024-04-23T18:32:45.484842+0000","last_clean":"2024-04-23T18:32:45.484842+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:32:45.484842+0000","last_undegraded":"2024-04-23T18:32:45.484842+0000","last_fullsized":"2024-04-23T18:32:45.484842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:45.484750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:45.484750+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.484750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:44.554843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759720+0000","last_change":"2024-04-23T18:29:13.499630+0000","last_active":"2024-04-23T18:31:39.759720+0000","last_peered":"2024-04-23T18:31:39.759720+0000","last_clean":"2024-04-23T18:31:39.759720+0000","last_became_active":"2024-04-23T18:29:13.499248+0000","last_became_peered":"2024-04-23T18:29:13.499248+0000","last_unstale":"2024-04-23T18:31:39.759720+0000","last_undegraded":"2024-04-23T18:31:39.759720+0000","last_fullsized":"2024-04-23T18:31:39.759720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760636+0000","last_change":"2024-04-23T18:29:11.488862+0000","last_active":"2024-04-23T18:31:31.760636+0000","last_peered":"2024-04-23T18:31:31.760636+0000","last_clean":"2024-04-23T18:31:31.760636+0000","last_became_active":"2024-04-23T18:29:11.488531+0000","last_became_peered":"2024-04-23T18:29:11.488531+0000","last_unstale":"2024-04-23T18:31:31.760636+0000","last_undegraded":"2024-04-23T18:31:31.760636+0000","last_fullsized":"2024-04-23T18:31:31.760636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.385497+0000","last_change":"2024-04-23T18:32:33.385539+0000","last_active":"2024-04-23T18:32:33.385497+0000","last_peered":"2024-04-23T18:32:33.385497+0000","last_clean":"2024-04-23T18:32:33.385497+0000","last_became_active":"2024-04-23T18:29:15.511249+0000","last_became_peered":"2024-04-23T18:29:15.511249+0000","last_unstale":"2024-04-23T18:32:33.385497+0000","last_undegraded":"2024-04-23T18:32:33.385497+0000","last_fullsized":"2024-04-23T18:32:33.385497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.385380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.385380+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.385380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:14.265560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.451350+0000","last_change":"2024-04-23T18:32:38.451387+0000","last_active":"2024-04-23T18:32:38.451350+0000","last_peered":"2024-04-23T18:32:38.451350+0000","last_clean":"2024-04-23T18:32:38.451350+0000","last_became_active":"2024-04-23T18:29:17.517964+0000","last_became_peered":"2024-04-23T18:29:17.517964+0000","last_unstale":"2024-04-23T18:32:38.451350+0000","last_undegraded":"2024-04-23T18:32:38.451350+0000","last_fullsized":"2024-04-23T18:32:38.451350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-04-23T18:32:38.451267+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-04-23T18:32:38.451267+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.451267+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:18:00.657607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":453,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.248993+0000","last_change":"2024-04-23T18:32:44.249059+0000","last_active":"2024-04-23T18:32:44.248993+0000","last_peered":"2024-04-23T18:32:44.248993+0000","last_clean":"2024-04-23T18:32:44.248993+0000","last_became_active":"2024-04-23T18:29:19.524881+0000","last_became_peered":"2024-04-23T18:29:19.524881+0000","last_unstale":"2024-04-23T18:32:44.248993+0000","last_undegraded":"2024-04-23T18:32:44.248993+0000","last_fullsized":"2024-04-23T18:32:44.248993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:44.248886+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:44.248886+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.248886+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:27.941657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.194117+0000","last_change":"2024-04-23T18:29:13.502374+0000","last_active":"2024-04-23T18:32:21.194117+0000","last_peered":"2024-04-23T18:32:21.194117+0000","last_clean":"2024-04-23T18:32:21.194117+0000","last_became_active":"2024-04-23T18:29:13.501472+0000","last_became_peered":"2024-04-23T18:29:13.501472+0000","last_unstale":"2024-04-23T18:32:21.194117+0000","last_undegraded":"2024-04-23T18:32:21.194117+0000","last_fullsized":"2024-04-23T18:32:21.194117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'5","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.759698+0000","last_change":"2024-04-23T18:29:11.483640+0000","last_active":"2024-04-23T18:31:26.759698+0000","last_peered":"2024-04-23T18:31:26.759698+0000","last_clean":"2024-04-23T18:31:26.759698+0000","last_became_active":"2024-04-23T18:29:11.481977+0000","last_became_peered":"2024-04-23T18:29:11.481977+0000","last_unstale":"2024-04-23T18:31:26.759698+0000","last_undegraded":"2024-04-23T18:31:26.759698+0000","last_fullsized":"2024-04-23T18:31:26.759698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.905456+0000","last_change":"2024-04-23T18:32:45.905482+0000","last_active":"2024-04-23T18:32:45.905456+0000","last_peered":"2024-04-23T18:32:45.905456+0000","last_clean":"2024-04-23T18:32:45.905456+0000","last_became_active":"2024-04-23T18:29:15.509711+0000","last_became_peered":"2024-04-23T18:29:15.509711+0000","last_unstale":"2024-04-23T18:32:45.905456+0000","last_undegraded":"2024-04-23T18:32:45.905456+0000","last_fullsized":"2024-04-23T18:32:45.905456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:45.905366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:45.905366+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.905366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:55:07.535829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'51","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.525412+0000","last_change":"2024-04-23T18:32:46.525489+0000","last_active":"2024-04-23T18:32:46.525412+0000","last_peered":"2024-04-23T18:32:46.525412+0000","last_clean":"2024-04-23T18:32:46.525412+0000","last_became_active":"2024-04-23T18:29:17.511085+0000","last_became_peered":"2024-04-23T18:29:17.511085+0000","last_unstale":"2024-04-23T18:32:46.525412+0000","last_undegraded":"2024-04-23T18:32:46.525412+0000","last_fullsized":"2024-04-23T18:32:46.525412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-04-23T18:32:46.525299+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-04-23T18:32:46.525299+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.525299+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:46:11.482573+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:34.758815+0000","last_change":"2024-04-23T18:29:19.527807+0000","last_active":"2024-04-23T18:31:34.758815+0000","last_peered":"2024-04-23T18:31:34.758815+0000","last_clean":"2024-04-23T18:31:34.758815+0000","last_became_active":"2024-04-23T18:29:19.527505+0000","last_became_peered":"2024-04-23T18:29:19.527505+0000","last_unstale":"2024-04-23T18:31:34.758815+0000","last_undegraded":"2024-04-23T18:31:34.758815+0000","last_fullsized":"2024-04-23T18:31:34.758815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'13","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.907177+0000","last_change":"2024-04-23T18:29:21.532533+0000","last_active":"2024-04-23T18:32:20.907177+0000","last_peered":"2024-04-23T18:32:20.907177+0000","last_clean":"2024-04-23T18:32:20.907177+0000","last_became_active":"2024-04-23T18:29:21.532163+0000","last_became_peered":"2024-04-23T18:29:21.532163+0000","last_unstale":"2024-04-23T18:32:20.907177+0000","last_undegraded":"2024-04-23T18:32:20.907177+0000","last_fullsized":"2024-04-23T18:32:20.907177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.759974+0000","last_change":"2024-04-23T18:29:13.494415+0000","last_active":"2024-04-23T18:31:26.759974+0000","last_peered":"2024-04-23T18:31:26.759974+0000","last_clean":"2024-04-23T18:31:26.759974+0000","last_became_active":"2024-04-23T18:29:13.494108+0000","last_became_peered":"2024-04-23T18:29:13.494108+0000","last_unstale":"2024-04-23T18:31:26.759974+0000","last_undegraded":"2024-04-23T18:31:26.759974+0000","last_fullsized":"2024-04-23T18:31:26.759974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.759651+0000","last_change":"2024-04-23T18:29:11.481951+0000","last_active":"2024-04-23T18:31:26.759651+0000","last_peered":"2024-04-23T18:31:26.759651+0000","last_clean":"2024-04-23T18:31:26.759651+0000","last_became_active":"2024-04-23T18:29:11.481419+0000","last_became_peered":"2024-04-23T18:29:11.481419+0000","last_unstale":"2024-04-23T18:31:26.759651+0000","last_undegraded":"2024-04-23T18:31:26.759651+0000","last_fullsized":"2024-04-23T18:31:26.759651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.197779+0000","last_change":"2024-04-23T18:32:49.197825+0000","last_active":"2024-04-23T18:32:49.197779+0000","last_peered":"2024-04-23T18:32:49.197779+0000","last_clean":"2024-04-23T18:32:49.197779+0000","last_became_active":"2024-04-23T18:29:15.510135+0000","last_became_peered":"2024-04-23T18:29:15.510135+0000","last_unstale":"2024-04-23T18:32:49.197779+0000","last_undegraded":"2024-04-23T18:32:49.197779+0000","last_fullsized":"2024-04-23T18:32:49.197779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:49.197658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:49.197658+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.197658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:11:00.797470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.367950+0000","last_change":"2024-04-23T18:32:45.367999+0000","last_active":"2024-04-23T18:32:45.367950+0000","last_peered":"2024-04-23T18:32:45.367950+0000","last_clean":"2024-04-23T18:32:45.367950+0000","last_became_active":"2024-04-23T18:29:17.513447+0000","last_became_peered":"2024-04-23T18:29:17.513447+0000","last_unstale":"2024-04-23T18:32:45.367950+0000","last_undegraded":"2024-04-23T18:32:45.367950+0000","last_fullsized":"2024-04-23T18:32:45.367950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:45.367847+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:45.367847+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.367847+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:39.796664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.422630+0000","last_change":"2024-04-23T18:32:33.422658+0000","last_active":"2024-04-23T18:32:33.422630+0000","last_peered":"2024-04-23T18:32:33.422630+0000","last_clean":"2024-04-23T18:32:33.422630+0000","last_became_active":"2024-04-23T18:29:19.518695+0000","last_became_peered":"2024-04-23T18:29:19.518695+0000","last_unstale":"2024-04-23T18:32:33.422630+0000","last_undegraded":"2024-04-23T18:32:33.422630+0000","last_fullsized":"2024-04-23T18:32:33.422630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.422540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.422540+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.422540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:19.231250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'5","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.196465+0000","last_change":"2024-04-23T18:29:21.533423+0000","last_active":"2024-04-23T18:32:21.196465+0000","last_peered":"2024-04-23T18:32:21.196465+0000","last_clean":"2024-04-23T18:32:21.196465+0000","last_became_active":"2024-04-23T18:29:21.533103+0000","last_became_peered":"2024-04-23T18:29:21.533103+0000","last_unstale":"2024-04-23T18:32:21.196465+0000","last_undegraded":"2024-04-23T18:32:21.196465+0000","last_fullsized":"2024-04-23T18:32:21.196465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'12","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223489+0000","last_change":"2024-04-23T18:29:13.500105+0000","last_active":"2024-04-23T18:32:21.223489+0000","last_peered":"2024-04-23T18:32:21.223489+0000","last_clean":"2024-04-23T18:32:21.223489+0000","last_became_active":"2024-04-23T18:29:13.499795+0000","last_became_peered":"2024-04-23T18:29:13.499795+0000","last_unstale":"2024-04-23T18:32:21.223489+0000","last_undegraded":"2024-04-23T18:32:21.223489+0000","last_fullsized":"2024-04-23T18:32:21.223489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.761159+0000","last_change":"2024-04-23T18:29:11.503536+0000","last_active":"2024-04-23T18:31:26.761159+0000","last_peered":"2024-04-23T18:31:26.761159+0000","last_clean":"2024-04-23T18:31:26.761159+0000","last_became_active":"2024-04-23T18:29:11.503228+0000","last_became_peered":"2024-04-23T18:29:11.503228+0000","last_unstale":"2024-04-23T18:31:26.761159+0000","last_undegraded":"2024-04-23T18:31:26.761159+0000","last_fullsized":"2024-04-23T18:31:26.761159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:29.758174+0000","last_change":"2024-04-23T18:29:15.510453+0000","last_active":"2024-04-23T18:31:29.758174+0000","last_peered":"2024-04-23T18:31:29.758174+0000","last_clean":"2024-04-23T18:31:29.758174+0000","last_became_active":"2024-04-23T18:29:15.509856+0000","last_became_peered":"2024-04-23T18:29:15.509856+0000","last_unstale":"2024-04-23T18:31:29.758174+0000","last_undegraded":"2024-04-23T18:31:29.758174+0000","last_fullsized":"2024-04-23T18:31:29.758174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'42","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.872256+0000","last_change":"2024-04-23T18:29:17.517429+0000","last_active":"2024-04-23T18:32:27.872256+0000","last_peered":"2024-04-23T18:32:27.872256+0000","last_clean":"2024-04-23T18:32:27.872256+0000","last_became_active":"2024-04-23T18:29:17.517116+0000","last_became_peered":"2024-04-23T18:29:17.517116+0000","last_unstale":"2024-04-23T18:32:27.872256+0000","last_undegraded":"2024-04-23T18:32:27.872256+0000","last_fullsized":"2024-04-23T18:32:27.872256+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":360,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.373965+0000","last_change":"2024-04-23T18:32:34.374033+0000","last_active":"2024-04-23T18:32:34.373965+0000","last_peered":"2024-04-23T18:32:34.373965+0000","last_clean":"2024-04-23T18:32:34.373965+0000","last_became_active":"2024-04-23T18:29:19.518519+0000","last_became_peered":"2024-04-23T18:29:19.518519+0000","last_unstale":"2024-04-23T18:32:34.373965+0000","last_undegraded":"2024-04-23T18:32:34.373965+0000","last_fullsized":"2024-04-23T18:32:34.373965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:34.373847+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:34.373847+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.373847+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:40:46.115582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:34.758869+0000","last_change":"2024-04-23T18:29:21.529229+0000","last_active":"2024-04-23T18:31:34.758869+0000","last_peered":"2024-04-23T18:31:34.758869+0000","last_clean":"2024-04-23T18:31:34.758869+0000","last_became_active":"2024-04-23T18:29:21.528917+0000","last_became_peered":"2024-04-23T18:29:21.528917+0000","last_unstale":"2024-04-23T18:31:34.758869+0000","last_undegraded":"2024-04-23T18:31:34.758869+0000","last_fullsized":"2024-04-23T18:31:34.758869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760307+0000","last_change":"2024-04-23T18:29:13.499442+0000","last_active":"2024-04-23T18:31:31.760307+0000","last_peered":"2024-04-23T18:31:31.760307+0000","last_clean":"2024-04-23T18:31:31.760307+0000","last_became_active":"2024-04-23T18:29:13.499216+0000","last_became_peered":"2024-04-23T18:29:13.499216+0000","last_unstale":"2024-04-23T18:31:31.760307+0000","last_undegraded":"2024-04-23T18:31:31.760307+0000","last_fullsized":"2024-04-23T18:31:31.760307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.761090+0000","last_change":"2024-04-23T18:29:11.511581+0000","last_active":"2024-04-23T18:31:26.761090+0000","last_peered":"2024-04-23T18:31:26.761090+0000","last_clean":"2024-04-23T18:31:26.761090+0000","last_became_active":"2024-04-23T18:29:11.511211+0000","last_became_peered":"2024-04-23T18:29:11.511211+0000","last_unstale":"2024-04-23T18:31:26.761090+0000","last_undegraded":"2024-04-23T18:31:26.761090+0000","last_fullsized":"2024-04-23T18:31:26.761090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.217057+0000","last_change":"2024-04-23T18:32:47.217082+0000","last_active":"2024-04-23T18:32:47.217057+0000","last_peered":"2024-04-23T18:32:47.217057+0000","last_clean":"2024-04-23T18:32:47.217057+0000","last_became_active":"2024-04-23T18:29:15.510350+0000","last_became_peered":"2024-04-23T18:29:15.510350+0000","last_unstale":"2024-04-23T18:32:47.217057+0000","last_undegraded":"2024-04-23T18:32:47.217057+0000","last_fullsized":"2024-04-23T18:32:47.217057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:47.216965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:47.216965+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.216965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:24.954770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'63","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.448578+0000","last_change":"2024-04-23T18:32:51.448618+0000","last_active":"2024-04-23T18:32:51.448578+0000","last_peered":"2024-04-23T18:32:51.448578+0000","last_clean":"2024-04-23T18:32:51.448578+0000","last_became_active":"2024-04-23T18:29:17.513298+0000","last_became_peered":"2024-04-23T18:29:17.513298+0000","last_unstale":"2024-04-23T18:32:51.448578+0000","last_undegraded":"2024-04-23T18:32:51.448578+0000","last_fullsized":"2024-04-23T18:32:51.448578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'63","last_scrub_stamp":"2024-04-23T18:32:51.448483+0000","last_deep_scrub":"34'63","last_deep_scrub_stamp":"2024-04-23T18:32:51.448483+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.448483+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:25.305379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.325801+0000","last_change":"2024-04-23T18:32:35.325849+0000","last_active":"2024-04-23T18:32:35.325801+0000","last_peered":"2024-04-23T18:32:35.325801+0000","last_clean":"2024-04-23T18:32:35.325801+0000","last_became_active":"2024-04-23T18:29:19.518015+0000","last_became_peered":"2024-04-23T18:29:19.518015+0000","last_unstale":"2024-04-23T18:32:35.325801+0000","last_undegraded":"2024-04-23T18:32:35.325801+0000","last_fullsized":"2024-04-23T18:32:35.325801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.325670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.325670+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.325670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:51.615968+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.326108+0000","last_change":"2024-04-23T18:29:21.529718+0000","last_active":"2024-04-23T18:32:21.326108+0000","last_peered":"2024-04-23T18:32:21.326108+0000","last_clean":"2024-04-23T18:32:21.326108+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:32:21.326108+0000","last_undegraded":"2024-04-23T18:32:21.326108+0000","last_fullsized":"2024-04-23T18:32:21.326108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.005904+0000","last_change":"2024-04-23T18:29:52.558115+0000","last_active":"2024-04-23T18:32:21.005904+0000","last_peered":"2024-04-23T18:32:21.005904+0000","last_clean":"2024-04-23T18:32:21.005904+0000","last_became_active":"2024-04-23T18:29:52.550778+0000","last_became_peered":"2024-04-23T18:29:52.550778+0000","last_unstale":"2024-04-23T18:32:21.005904+0000","last_undegraded":"2024-04-23T18:32:21.005904+0000","last_fullsized":"2024-04-23T18:32:21.005904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:29.758156+0000","last_change":"2024-04-23T18:29:11.486362+0000","last_active":"2024-04-23T18:31:29.758156+0000","last_peered":"2024-04-23T18:31:29.758156+0000","last_clean":"2024-04-23T18:31:29.758156+0000","last_became_active":"2024-04-23T18:29:11.485899+0000","last_became_peered":"2024-04-23T18:29:11.485899+0000","last_unstale":"2024-04-23T18:31:29.758156+0000","last_undegraded":"2024-04-23T18:31:29.758156+0000","last_fullsized":"2024-04-23T18:31:29.758156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.488213+0000","last_change":"2024-04-23T18:32:48.488240+0000","last_active":"2024-04-23T18:32:48.488213+0000","last_peered":"2024-04-23T18:32:48.488213+0000","last_clean":"2024-04-23T18:32:48.488213+0000","last_became_active":"2024-04-23T18:29:15.506940+0000","last_became_peered":"2024-04-23T18:29:15.506940+0000","last_unstale":"2024-04-23T18:32:48.488213+0000","last_undegraded":"2024-04-23T18:32:48.488213+0000","last_fullsized":"2024-04-23T18:32:48.488213+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:32:48.488120+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:32:48.488120+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.488120+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:48.524111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.911596+0000","last_change":"2024-04-23T18:32:38.911658+0000","last_active":"2024-04-23T18:32:38.911596+0000","last_peered":"2024-04-23T18:32:38.911596+0000","last_clean":"2024-04-23T18:32:38.911596+0000","last_became_active":"2024-04-23T18:29:17.509586+0000","last_became_peered":"2024-04-23T18:29:17.509586+0000","last_unstale":"2024-04-23T18:32:38.911596+0000","last_undegraded":"2024-04-23T18:32:38.911596+0000","last_fullsized":"2024-04-23T18:32:38.911596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:38.911496+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:38.911496+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.911496+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:46:03.868770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762732+0000","last_change":"2024-04-23T18:29:19.522554+0000","last_active":"2024-04-23T18:31:36.762732+0000","last_peered":"2024-04-23T18:31:36.762732+0000","last_clean":"2024-04-23T18:31:36.762732+0000","last_became_active":"2024-04-23T18:29:19.521939+0000","last_became_peered":"2024-04-23T18:29:19.521939+0000","last_unstale":"2024-04-23T18:31:36.762732+0000","last_undegraded":"2024-04-23T18:31:36.762732+0000","last_fullsized":"2024-04-23T18:31:36.762732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.276509+0000","last_change":"2024-04-23T18:29:21.531398+0000","last_active":"2024-04-23T18:32:21.276509+0000","last_peered":"2024-04-23T18:32:21.276509+0000","last_clean":"2024-04-23T18:32:21.276509+0000","last_became_active":"2024-04-23T18:29:21.530270+0000","last_became_peered":"2024-04-23T18:29:21.530270+0000","last_unstale":"2024-04-23T18:32:21.276509+0000","last_undegraded":"2024-04-23T18:32:21.276509+0000","last_fullsized":"2024-04-23T18:32:21.276509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.397427+0000","last_change":"2024-04-23T18:32:46.397470+0000","last_active":"2024-04-23T18:32:46.397427+0000","last_peered":"2024-04-23T18:32:46.397427+0000","last_clean":"2024-04-23T18:32:46.397427+0000","last_became_active":"2024-04-23T18:29:13.501430+0000","last_became_peered":"2024-04-23T18:29:13.501430+0000","last_unstale":"2024-04-23T18:32:46.397427+0000","last_undegraded":"2024-04-23T18:32:46.397427+0000","last_fullsized":"2024-04-23T18:32:46.397427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:46.397327+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:46.397327+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.397327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:08.260300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760407+0000","last_change":"2024-04-23T18:29:11.507985+0000","last_active":"2024-04-23T18:31:21.760407+0000","last_peered":"2024-04-23T18:31:21.760407+0000","last_clean":"2024-04-23T18:31:21.760407+0000","last_became_active":"2024-04-23T18:29:11.507633+0000","last_became_peered":"2024-04-23T18:29:11.507633+0000","last_unstale":"2024-04-23T18:31:21.760407+0000","last_undegraded":"2024-04-23T18:31:21.760407+0000","last_fullsized":"2024-04-23T18:31:21.760407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.266076+0000","last_change":"2024-04-23T18:32:46.266134+0000","last_active":"2024-04-23T18:32:46.266076+0000","last_peered":"2024-04-23T18:32:46.266076+0000","last_clean":"2024-04-23T18:32:46.266076+0000","last_became_active":"2024-04-23T18:29:15.510579+0000","last_became_peered":"2024-04-23T18:29:15.510579+0000","last_unstale":"2024-04-23T18:32:46.266076+0000","last_undegraded":"2024-04-23T18:32:46.266076+0000","last_fullsized":"2024-04-23T18:32:46.266076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:46.265967+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:46.265967+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.265967+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:25:58.382875+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.452470+0000","last_change":"2024-04-23T18:32:44.452506+0000","last_active":"2024-04-23T18:32:44.452470+0000","last_peered":"2024-04-23T18:32:44.452470+0000","last_clean":"2024-04-23T18:32:44.452470+0000","last_became_active":"2024-04-23T18:29:17.512935+0000","last_became_peered":"2024-04-23T18:29:17.512935+0000","last_unstale":"2024-04-23T18:32:44.452470+0000","last_undegraded":"2024-04-23T18:32:44.452470+0000","last_fullsized":"2024-04-23T18:32:44.452470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-23T18:32:44.452352+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-23T18:32:44.452352+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.452352+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:05.628659+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":443,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.342870+0000","last_change":"2024-04-23T18:32:32.342946+0000","last_active":"2024-04-23T18:32:32.342870+0000","last_peered":"2024-04-23T18:32:32.342870+0000","last_clean":"2024-04-23T18:32:32.342870+0000","last_became_active":"2024-04-23T18:29:19.526260+0000","last_became_peered":"2024-04-23T18:29:19.526260+0000","last_unstale":"2024-04-23T18:32:32.342870+0000","last_undegraded":"2024-04-23T18:32:32.342870+0000","last_fullsized":"2024-04-23T18:32:32.342870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:32.342765+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:32.342765+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.342765+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:52.808626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.278250+0000","last_change":"2024-04-23T18:29:21.527340+0000","last_active":"2024-04-23T18:32:21.278250+0000","last_peered":"2024-04-23T18:32:21.278250+0000","last_clean":"2024-04-23T18:32:21.278250+0000","last_became_active":"2024-04-23T18:29:21.527108+0000","last_became_peered":"2024-04-23T18:29:21.527108+0000","last_unstale":"2024-04-23T18:32:21.278250+0000","last_undegraded":"2024-04-23T18:32:21.278250+0000","last_fullsized":"2024-04-23T18:32:21.278250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'5","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.271486+0000","last_change":"2024-04-23T18:29:13.504838+0000","last_active":"2024-04-23T18:32:21.271486+0000","last_peered":"2024-04-23T18:32:21.271486+0000","last_clean":"2024-04-23T18:32:21.271486+0000","last_became_active":"2024-04-23T18:29:13.504570+0000","last_became_peered":"2024-04-23T18:29:13.504570+0000","last_unstale":"2024-04-23T18:32:21.271486+0000","last_undegraded":"2024-04-23T18:32:21.271486+0000","last_fullsized":"2024-04-23T18:32:21.271486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760354+0000","last_change":"2024-04-23T18:29:11.505849+0000","last_active":"2024-04-23T18:31:21.760354+0000","last_peered":"2024-04-23T18:31:21.760354+0000","last_clean":"2024-04-23T18:31:21.760354+0000","last_became_active":"2024-04-23T18:29:11.505531+0000","last_became_peered":"2024-04-23T18:29:11.505531+0000","last_unstale":"2024-04-23T18:31:21.760354+0000","last_undegraded":"2024-04-23T18:31:21.760354+0000","last_fullsized":"2024-04-23T18:31:21.760354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":428,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.926494+0000","last_change":"2024-04-23T18:32:49.926526+0000","last_active":"2024-04-23T18:32:49.926494+0000","last_peered":"2024-04-23T18:32:49.926494+0000","last_clean":"2024-04-23T18:32:49.926494+0000","last_became_active":"2024-04-23T18:29:15.505983+0000","last_became_peered":"2024-04-23T18:29:15.505983+0000","last_unstale":"2024-04-23T18:32:49.926494+0000","last_undegraded":"2024-04-23T18:32:49.926494+0000","last_fullsized":"2024-04-23T18:32:49.926494+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:32:49.926413+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:32:49.926413+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.926413+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:14.338142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.465248+0000","last_change":"2024-04-23T18:32:39.465286+0000","last_active":"2024-04-23T18:32:39.465248+0000","last_peered":"2024-04-23T18:32:39.465248+0000","last_clean":"2024-04-23T18:32:39.465248+0000","last_became_active":"2024-04-23T18:29:17.513213+0000","last_became_peered":"2024-04-23T18:29:17.513213+0000","last_unstale":"2024-04-23T18:32:39.465248+0000","last_undegraded":"2024-04-23T18:32:39.465248+0000","last_fullsized":"2024-04-23T18:32:39.465248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-23T18:32:39.465155+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-23T18:32:39.465155+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.465155+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:22.245175+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":480,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.880027+0000","last_change":"2024-04-23T18:32:39.880054+0000","last_active":"2024-04-23T18:32:39.880027+0000","last_peered":"2024-04-23T18:32:39.880027+0000","last_clean":"2024-04-23T18:32:39.880027+0000","last_became_active":"2024-04-23T18:29:19.518528+0000","last_became_peered":"2024-04-23T18:29:19.518528+0000","last_unstale":"2024-04-23T18:32:39.880027+0000","last_undegraded":"2024-04-23T18:32:39.880027+0000","last_fullsized":"2024-04-23T18:32:39.880027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:39.879912+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:39.879912+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.879912+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:36.345360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.480588+0000","last_change":"2024-04-23T18:32:49.480613+0000","last_active":"2024-04-23T18:32:49.480588+0000","last_peered":"2024-04-23T18:32:49.480588+0000","last_clean":"2024-04-23T18:32:49.480588+0000","last_became_active":"2024-04-23T18:29:21.530946+0000","last_became_peered":"2024-04-23T18:29:21.530946+0000","last_unstale":"2024-04-23T18:32:49.480588+0000","last_undegraded":"2024-04-23T18:32:49.480588+0000","last_fullsized":"2024-04-23T18:32:49.480588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:49.480502+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:49.480502+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.480502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:18.888990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.271777+0000","last_change":"2024-04-23T18:29:13.508059+0000","last_active":"2024-04-23T18:32:21.271777+0000","last_peered":"2024-04-23T18:32:21.271777+0000","last_clean":"2024-04-23T18:32:21.271777+0000","last_became_active":"2024-04-23T18:29:13.507813+0000","last_became_peered":"2024-04-23T18:29:13.507813+0000","last_unstale":"2024-04-23T18:32:21.271777+0000","last_undegraded":"2024-04-23T18:32:21.271777+0000","last_fullsized":"2024-04-23T18:32:21.271777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760317+0000","last_change":"2024-04-23T18:29:11.501752+0000","last_active":"2024-04-23T18:31:21.760317+0000","last_peered":"2024-04-23T18:31:21.760317+0000","last_clean":"2024-04-23T18:31:21.760317+0000","last_became_active":"2024-04-23T18:29:11.501432+0000","last_became_peered":"2024-04-23T18:29:11.501432+0000","last_unstale":"2024-04-23T18:31:21.760317+0000","last_undegraded":"2024-04-23T18:31:21.760317+0000","last_fullsized":"2024-04-23T18:31:21.760317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.427463+0000","last_change":"2024-04-23T18:32:34.427490+0000","last_active":"2024-04-23T18:32:34.427463+0000","last_peered":"2024-04-23T18:32:34.427463+0000","last_clean":"2024-04-23T18:32:34.427463+0000","last_became_active":"2024-04-23T18:29:15.509701+0000","last_became_peered":"2024-04-23T18:29:15.509701+0000","last_unstale":"2024-04-23T18:32:34.427463+0000","last_undegraded":"2024-04-23T18:32:34.427463+0000","last_fullsized":"2024-04-23T18:32:34.427463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:34.427372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:34.427372+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.427372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:27.299606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.866403+0000","last_change":"2024-04-23T18:32:40.866441+0000","last_active":"2024-04-23T18:32:40.866403+0000","last_peered":"2024-04-23T18:32:40.866403+0000","last_clean":"2024-04-23T18:32:40.866403+0000","last_became_active":"2024-04-23T18:29:17.509672+0000","last_became_peered":"2024-04-23T18:29:17.509672+0000","last_unstale":"2024-04-23T18:32:40.866403+0000","last_undegraded":"2024-04-23T18:32:40.866403+0000","last_fullsized":"2024-04-23T18:32:40.866403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:40.866301+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:40.866301+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.866301+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:40.902292+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.357680+0000","last_change":"2024-04-23T18:32:33.357709+0000","last_active":"2024-04-23T18:32:33.357680+0000","last_peered":"2024-04-23T18:32:33.357680+0000","last_clean":"2024-04-23T18:32:33.357680+0000","last_became_active":"2024-04-23T18:29:19.526861+0000","last_became_peered":"2024-04-23T18:29:19.526861+0000","last_unstale":"2024-04-23T18:32:33.357680+0000","last_undegraded":"2024-04-23T18:32:33.357680+0000","last_fullsized":"2024-04-23T18:32:33.357680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.357572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.357572+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.357572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:35:59.244732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.314603+0000","last_change":"2024-04-23T18:29:21.530887+0000","last_active":"2024-04-23T18:32:21.314603+0000","last_peered":"2024-04-23T18:32:21.314603+0000","last_clean":"2024-04-23T18:32:21.314603+0000","last_became_active":"2024-04-23T18:29:21.530612+0000","last_became_peered":"2024-04-23T18:29:21.530612+0000","last_unstale":"2024-04-23T18:32:21.314603+0000","last_undegraded":"2024-04-23T18:32:21.314603+0000","last_fullsized":"2024-04-23T18:32:21.314603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.476888+0000","last_change":"2024-04-23T18:32:50.476924+0000","last_active":"2024-04-23T18:32:50.476888+0000","last_peered":"2024-04-23T18:32:50.476888+0000","last_clean":"2024-04-23T18:32:50.476888+0000","last_became_active":"2024-04-23T18:29:13.501636+0000","last_became_peered":"2024-04-23T18:29:13.501636+0000","last_unstale":"2024-04-23T18:32:50.476888+0000","last_undegraded":"2024-04-23T18:32:50.476888+0000","last_fullsized":"2024-04-23T18:32:50.476888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:50.476795+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:50.476795+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.476795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:25.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":203,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:01.756708+0000","last_change":"2024-04-23T18:28:58.798997+0000","last_active":"2024-04-23T18:31:01.756708+0000","last_peered":"2024-04-23T18:31:01.756708+0000","last_clean":"2024-04-23T18:31:01.756708+0000","last_became_active":"2024-04-23T18:28:58.798001+0000","last_became_peered":"2024-04-23T18:28:58.798001+0000","last_unstale":"2024-04-23T18:31:01.756708+0000","last_undegraded":"2024-04-23T18:31:01.756708+0000","last_fullsized":"2024-04-23T18:31:01.756708+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_clean_scrub_stamp":"2024-04-23T18:28:57.410644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:11.758994+0000","last_change":"2024-04-23T18:29:03.446652+0000","last_active":"2024-04-23T18:31:11.758994+0000","last_peered":"2024-04-23T18:31:11.758994+0000","last_clean":"2024-04-23T18:31:11.758994+0000","last_became_active":"2024-04-23T18:29:03.446324+0000","last_became_peered":"2024-04-23T18:29:03.446324+0000","last_unstale":"2024-04-23T18:31:11.758994+0000","last_undegraded":"2024-04-23T18:31:11.758994+0000","last_fullsized":"2024-04-23T18:31:11.758994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.213054+0000","last_change":"2024-04-23T18:29:11.512994+0000","last_active":"2024-04-23T18:32:21.213054+0000","last_peered":"2024-04-23T18:32:21.213054+0000","last_clean":"2024-04-23T18:32:21.213054+0000","last_became_active":"2024-04-23T18:29:11.512684+0000","last_became_peered":"2024-04-23T18:29:11.512684+0000","last_unstale":"2024-04-23T18:32:21.213054+0000","last_undegraded":"2024-04-23T18:32:21.213054+0000","last_fullsized":"2024-04-23T18:32:21.213054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.866800+0000","last_change":"2024-04-23T18:32:46.866824+0000","last_active":"2024-04-23T18:32:46.866800+0000","last_peered":"2024-04-23T18:32:46.866800+0000","last_clean":"2024-04-23T18:32:46.866800+0000","last_became_active":"2024-04-23T18:29:15.509209+0000","last_became_peered":"2024-04-23T18:29:15.509209+0000","last_unstale":"2024-04-23T18:32:46.866800+0000","last_undegraded":"2024-04-23T18:32:46.866800+0000","last_fullsized":"2024-04-23T18:32:46.866800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:46.866699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:46.866699+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.866699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:45.485566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'87","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.423367+0000","last_change":"2024-04-23T18:32:47.423434+0000","last_active":"2024-04-23T18:32:47.423367+0000","last_peered":"2024-04-23T18:32:47.423367+0000","last_clean":"2024-04-23T18:32:47.423367+0000","last_became_active":"2024-04-23T18:29:17.513504+0000","last_became_peered":"2024-04-23T18:29:17.513504+0000","last_unstale":"2024-04-23T18:32:47.423367+0000","last_undegraded":"2024-04-23T18:32:47.423367+0000","last_fullsized":"2024-04-23T18:32:47.423367+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-04-23T18:32:47.423269+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-04-23T18:32:47.423269+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.423269+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:31.948251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.310579+0000","last_change":"2024-04-23T18:32:36.310603+0000","last_active":"2024-04-23T18:32:36.310579+0000","last_peered":"2024-04-23T18:32:36.310579+0000","last_clean":"2024-04-23T18:32:36.310579+0000","last_became_active":"2024-04-23T18:29:19.518974+0000","last_became_peered":"2024-04-23T18:29:19.518974+0000","last_unstale":"2024-04-23T18:32:36.310579+0000","last_undegraded":"2024-04-23T18:32:36.310579+0000","last_fullsized":"2024-04-23T18:32:36.310579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.310468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.310468+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.310468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:09:49.509664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.231843+0000","last_change":"2024-04-23T18:29:21.532023+0000","last_active":"2024-04-23T18:32:21.231843+0000","last_peered":"2024-04-23T18:32:21.231843+0000","last_clean":"2024-04-23T18:32:21.231843+0000","last_became_active":"2024-04-23T18:29:21.531725+0000","last_became_peered":"2024-04-23T18:29:21.531725+0000","last_unstale":"2024-04-23T18:32:21.231843+0000","last_undegraded":"2024-04-23T18:32:21.231843+0000","last_fullsized":"2024-04-23T18:32:21.231843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'5","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.268935+0000","last_change":"2024-04-23T18:29:13.497272+0000","last_active":"2024-04-23T18:32:21.268935+0000","last_peered":"2024-04-23T18:32:21.268935+0000","last_clean":"2024-04-23T18:32:21.268935+0000","last_became_active":"2024-04-23T18:29:13.497008+0000","last_became_peered":"2024-04-23T18:29:13.497008+0000","last_unstale":"2024-04-23T18:32:21.268935+0000","last_undegraded":"2024-04-23T18:32:21.268935+0000","last_fullsized":"2024-04-23T18:32:21.268935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:06.758243+0000","last_change":"2024-04-23T18:29:03.447767+0000","last_active":"2024-04-23T18:31:06.758243+0000","last_peered":"2024-04-23T18:31:06.758243+0000","last_clean":"2024-04-23T18:31:06.758243+0000","last_became_active":"2024-04-23T18:29:03.447404+0000","last_became_peered":"2024-04-23T18:29:03.447404+0000","last_unstale":"2024-04-23T18:31:06.758243+0000","last_undegraded":"2024-04-23T18:31:06.758243+0000","last_fullsized":"2024-04-23T18:31:06.758243+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756525+0000","last_change":"2024-04-23T18:29:11.487391+0000","last_active":"2024-04-23T18:31:19.756525+0000","last_peered":"2024-04-23T18:31:19.756525+0000","last_clean":"2024-04-23T18:31:19.756525+0000","last_became_active":"2024-04-23T18:29:11.486538+0000","last_became_peered":"2024-04-23T18:29:11.486538+0000","last_unstale":"2024-04-23T18:31:19.756525+0000","last_undegraded":"2024-04-23T18:31:19.756525+0000","last_fullsized":"2024-04-23T18:31:19.756525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.435741+0000","last_change":"2024-04-23T18:32:40.435765+0000","last_active":"2024-04-23T18:32:40.435741+0000","last_peered":"2024-04-23T18:32:40.435741+0000","last_clean":"2024-04-23T18:32:40.435741+0000","last_became_active":"2024-04-23T18:29:15.508020+0000","last_became_peered":"2024-04-23T18:29:15.508020+0000","last_unstale":"2024-04-23T18:32:40.435741+0000","last_undegraded":"2024-04-23T18:32:40.435741+0000","last_fullsized":"2024-04-23T18:32:40.435741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:40.435654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:40.435654+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.435654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:16.738684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'291","reported_seq":516,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.927400+0000","last_change":"2024-04-23T18:32:36.927476+0000","last_active":"2024-04-23T18:32:36.927400+0000","last_peered":"2024-04-23T18:32:36.927400+0000","last_clean":"2024-04-23T18:32:36.927400+0000","last_became_active":"2024-04-23T18:29:17.515023+0000","last_became_peered":"2024-04-23T18:29:17.515023+0000","last_unstale":"2024-04-23T18:32:36.927400+0000","last_undegraded":"2024-04-23T18:32:36.927400+0000","last_fullsized":"2024-04-23T18:32:36.927400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'291","last_scrub_stamp":"2024-04-23T18:32:36.927295+0000","last_deep_scrub":"34'291","last_deep_scrub_stamp":"2024-04-23T18:32:36.927295+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.927295+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:58.103602+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.761120+0000","last_change":"2024-04-23T18:29:19.522666+0000","last_active":"2024-04-23T18:31:26.761120+0000","last_peered":"2024-04-23T18:31:26.761120+0000","last_clean":"2024-04-23T18:31:26.761120+0000","last_became_active":"2024-04-23T18:29:19.522105+0000","last_became_peered":"2024-04-23T18:29:19.522105+0000","last_unstale":"2024-04-23T18:31:26.761120+0000","last_undegraded":"2024-04-23T18:31:26.761120+0000","last_fullsized":"2024-04-23T18:31:26.761120+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760717+0000","last_change":"2024-04-23T18:29:21.533582+0000","last_active":"2024-04-23T18:31:31.760717+0000","last_peered":"2024-04-23T18:31:31.760717+0000","last_clean":"2024-04-23T18:31:31.760717+0000","last_became_active":"2024-04-23T18:29:21.532867+0000","last_became_peered":"2024-04-23T18:29:21.532867+0000","last_unstale":"2024-04-23T18:31:31.760717+0000","last_undegraded":"2024-04-23T18:31:31.760717+0000","last_fullsized":"2024-04-23T18:31:31.760717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:24.757346+0000","last_change":"2024-04-23T18:29:13.499606+0000","last_active":"2024-04-23T18:31:24.757346+0000","last_peered":"2024-04-23T18:31:24.757346+0000","last_clean":"2024-04-23T18:31:24.757346+0000","last_became_active":"2024-04-23T18:29:13.499253+0000","last_became_peered":"2024-04-23T18:29:13.499253+0000","last_unstale":"2024-04-23T18:31:24.757346+0000","last_undegraded":"2024-04-23T18:31:24.757346+0000","last_fullsized":"2024-04-23T18:31:24.757346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:06.756834+0000","last_change":"2024-04-23T18:29:03.447054+0000","last_active":"2024-04-23T18:31:06.756834+0000","last_peered":"2024-04-23T18:31:06.756834+0000","last_clean":"2024-04-23T18:31:06.756834+0000","last_became_active":"2024-04-23T18:29:03.446647+0000","last_became_peered":"2024-04-23T18:29:03.446647+0000","last_unstale":"2024-04-23T18:31:06.756834+0000","last_undegraded":"2024-04-23T18:31:06.756834+0000","last_fullsized":"2024-04-23T18:31:06.756834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:14.755669+0000","last_change":"2024-04-23T18:29:11.492974+0000","last_active":"2024-04-23T18:31:14.755669+0000","last_peered":"2024-04-23T18:31:14.755669+0000","last_clean":"2024-04-23T18:31:14.755669+0000","last_became_active":"2024-04-23T18:29:11.491953+0000","last_became_peered":"2024-04-23T18:29:11.491953+0000","last_unstale":"2024-04-23T18:31:14.755669+0000","last_undegraded":"2024-04-23T18:31:14.755669+0000","last_fullsized":"2024-04-23T18:31:14.755669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.759640+0000","last_change":"2024-04-23T18:29:52.563435+0000","last_active":"2024-04-23T18:31:26.759640+0000","last_peered":"2024-04-23T18:31:26.759640+0000","last_clean":"2024-04-23T18:31:26.759640+0000","last_became_active":"2024-04-23T18:29:52.551265+0000","last_became_peered":"2024-04-23T18:29:52.551265+0000","last_unstale":"2024-04-23T18:31:26.759640+0000","last_undegraded":"2024-04-23T18:31:26.759640+0000","last_fullsized":"2024-04-23T18:31:26.759640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.370133+0000","last_change":"2024-04-23T18:32:42.370172+0000","last_active":"2024-04-23T18:32:42.370133+0000","last_peered":"2024-04-23T18:32:42.370133+0000","last_clean":"2024-04-23T18:32:42.370133+0000","last_became_active":"2024-04-23T18:29:17.513875+0000","last_became_peered":"2024-04-23T18:29:17.513875+0000","last_unstale":"2024-04-23T18:32:42.370133+0000","last_undegraded":"2024-04-23T18:32:42.370133+0000","last_fullsized":"2024-04-23T18:32:42.370133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-23T18:32:42.370053+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-23T18:32:42.370053+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.370053+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:16:11.051682+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:31.497695+0000","last_change":"2024-04-23T18:32:31.497737+0000","last_active":"2024-04-23T18:32:31.497695+0000","last_peered":"2024-04-23T18:32:31.497695+0000","last_clean":"2024-04-23T18:32:31.497695+0000","last_became_active":"2024-04-23T18:29:19.518744+0000","last_became_peered":"2024-04-23T18:29:19.518744+0000","last_unstale":"2024-04-23T18:32:31.497695+0000","last_undegraded":"2024-04-23T18:32:31.497695+0000","last_fullsized":"2024-04-23T18:32:31.497695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:31.497603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:31.497603+0000","last_clean_scrub_stamp":"2024-04-23T18:32:31.497603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:37.446181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762596+0000","last_change":"2024-04-23T18:29:21.533685+0000","last_active":"2024-04-23T18:31:36.762596+0000","last_peered":"2024-04-23T18:31:36.762596+0000","last_clean":"2024-04-23T18:31:36.762596+0000","last_became_active":"2024-04-23T18:29:21.533358+0000","last_became_peered":"2024-04-23T18:29:21.533358+0000","last_unstale":"2024-04-23T18:31:36.762596+0000","last_undegraded":"2024-04-23T18:31:36.762596+0000","last_fullsized":"2024-04-23T18:31:36.762596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.145357+0000","last_change":"2024-04-23T18:29:13.493749+0000","last_active":"2024-04-23T18:32:21.145357+0000","last_peered":"2024-04-23T18:32:21.145357+0000","last_clean":"2024-04-23T18:32:21.145357+0000","last_became_active":"2024-04-23T18:29:13.493321+0000","last_became_peered":"2024-04-23T18:29:13.493321+0000","last_unstale":"2024-04-23T18:32:21.145357+0000","last_undegraded":"2024-04-23T18:32:21.145357+0000","last_fullsized":"2024-04-23T18:32:21.145357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:06.758314+0000","last_change":"2024-04-23T18:29:03.446774+0000","last_active":"2024-04-23T18:31:06.758314+0000","last_peered":"2024-04-23T18:31:06.758314+0000","last_clean":"2024-04-23T18:31:06.758314+0000","last_became_active":"2024-04-23T18:29:03.446457+0000","last_became_peered":"2024-04-23T18:29:03.446457+0000","last_unstale":"2024-04-23T18:31:06.758314+0000","last_undegraded":"2024-04-23T18:31:06.758314+0000","last_fullsized":"2024-04-23T18:31:06.758314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.866035+0000","last_change":"2024-04-23T18:29:11.483348+0000","last_active":"2024-04-23T18:32:20.866035+0000","last_peered":"2024-04-23T18:32:20.866035+0000","last_clean":"2024-04-23T18:32:20.866035+0000","last_became_active":"2024-04-23T18:29:11.482896+0000","last_became_peered":"2024-04-23T18:29:11.482896+0000","last_unstale":"2024-04-23T18:32:20.866035+0000","last_undegraded":"2024-04-23T18:32:20.866035+0000","last_fullsized":"2024-04-23T18:32:20.866035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756611+0000","last_change":"2024-04-23T18:29:15.507664+0000","last_active":"2024-04-23T18:31:19.756611+0000","last_peered":"2024-04-23T18:31:19.756611+0000","last_clean":"2024-04-23T18:31:19.756611+0000","last_became_active":"2024-04-23T18:29:15.507357+0000","last_became_peered":"2024-04-23T18:29:15.507357+0000","last_unstale":"2024-04-23T18:31:19.756611+0000","last_undegraded":"2024-04-23T18:31:19.756611+0000","last_fullsized":"2024-04-23T18:31:19.756611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.576415+0000","last_change":"2024-04-23T18:29:17.514159+0000","last_active":"2024-04-23T18:32:20.576415+0000","last_peered":"2024-04-23T18:32:20.576415+0000","last_clean":"2024-04-23T18:32:20.576415+0000","last_became_active":"2024-04-23T18:29:17.513393+0000","last_became_peered":"2024-04-23T18:29:17.513393+0000","last_unstale":"2024-04-23T18:32:20.576415+0000","last_undegraded":"2024-04-23T18:32:20.576415+0000","last_fullsized":"2024-04-23T18:32:20.576415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761938+0000","last_change":"2024-04-23T18:29:19.523513+0000","last_active":"2024-04-23T18:31:31.761938+0000","last_peered":"2024-04-23T18:31:31.761938+0000","last_clean":"2024-04-23T18:31:31.761938+0000","last_became_active":"2024-04-23T18:29:19.523070+0000","last_became_peered":"2024-04-23T18:29:19.523070+0000","last_unstale":"2024-04-23T18:31:31.761938+0000","last_undegraded":"2024-04-23T18:31:31.761938+0000","last_fullsized":"2024-04-23T18:31:31.761938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.889005+0000","last_change":"2024-04-23T18:32:47.889033+0000","last_active":"2024-04-23T18:32:47.889005+0000","last_peered":"2024-04-23T18:32:47.889005+0000","last_clean":"2024-04-23T18:32:47.889005+0000","last_became_active":"2024-04-23T18:29:21.528764+0000","last_became_peered":"2024-04-23T18:29:21.528764+0000","last_unstale":"2024-04-23T18:32:47.889005+0000","last_undegraded":"2024-04-23T18:32:47.889005+0000","last_fullsized":"2024-04-23T18:32:47.889005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:47.888900+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:47.888900+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.888900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:11.470854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.759306+0000","last_change":"2024-04-23T18:29:13.507864+0000","last_active":"2024-04-23T18:31:21.759306+0000","last_peered":"2024-04-23T18:31:21.759306+0000","last_clean":"2024-04-23T18:31:21.759306+0000","last_became_active":"2024-04-23T18:29:13.507496+0000","last_became_peered":"2024-04-23T18:29:13.507496+0000","last_unstale":"2024-04-23T18:31:21.759306+0000","last_undegraded":"2024-04-23T18:31:21.759306+0000","last_fullsized":"2024-04-23T18:31:21.759306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:16.758194+0000","last_change":"2024-04-23T18:29:11.483379+0000","last_active":"2024-04-23T18:31:16.758194+0000","last_peered":"2024-04-23T18:31:16.758194+0000","last_clean":"2024-04-23T18:31:16.758194+0000","last_became_active":"2024-04-23T18:29:11.482348+0000","last_became_peered":"2024-04-23T18:29:11.482348+0000","last_unstale":"2024-04-23T18:31:16.758194+0000","last_undegraded":"2024-04-23T18:31:16.758194+0000","last_fullsized":"2024-04-23T18:31:16.758194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:09.754936+0000","last_change":"2024-04-23T18:29:03.446643+0000","last_active":"2024-04-23T18:31:09.754936+0000","last_peered":"2024-04-23T18:31:09.754936+0000","last_clean":"2024-04-23T18:31:09.754936+0000","last_became_active":"2024-04-23T18:29:03.446286+0000","last_became_peered":"2024-04-23T18:29:03.446286+0000","last_unstale":"2024-04-23T18:31:09.754936+0000","last_undegraded":"2024-04-23T18:31:09.754936+0000","last_fullsized":"2024-04-23T18:31:09.754936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.738327+0000","last_change":"2024-04-23T18:29:52.554181+0000","last_active":"2024-04-23T18:32:27.738327+0000","last_peered":"2024-04-23T18:32:27.738327+0000","last_clean":"2024-04-23T18:32:27.738327+0000","last_became_active":"2024-04-23T18:29:52.553851+0000","last_became_peered":"2024-04-23T18:29:52.553851+0000","last_unstale":"2024-04-23T18:32:27.738327+0000","last_undegraded":"2024-04-23T18:32:27.738327+0000","last_fullsized":"2024-04-23T18:32:27.738327+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'73","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.321059+0000","last_change":"2024-04-23T18:32:41.321101+0000","last_active":"2024-04-23T18:32:41.321059+0000","last_peered":"2024-04-23T18:32:41.321059+0000","last_clean":"2024-04-23T18:32:41.321059+0000","last_became_active":"2024-04-23T18:29:17.513599+0000","last_became_peered":"2024-04-23T18:29:17.513599+0000","last_unstale":"2024-04-23T18:32:41.321059+0000","last_undegraded":"2024-04-23T18:32:41.321059+0000","last_fullsized":"2024-04-23T18:32:41.321059+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'73","last_scrub_stamp":"2024-04-23T18:32:41.320952+0000","last_deep_scrub":"34'73","last_deep_scrub_stamp":"2024-04-23T18:32:41.320952+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.320952+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:13:39.361578+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.404899+0000","last_change":"2024-04-23T18:32:34.404932+0000","last_active":"2024-04-23T18:32:34.404899+0000","last_peered":"2024-04-23T18:32:34.404899+0000","last_clean":"2024-04-23T18:32:34.404899+0000","last_became_active":"2024-04-23T18:29:19.526192+0000","last_became_peered":"2024-04-23T18:29:19.526192+0000","last_unstale":"2024-04-23T18:32:34.404899+0000","last_undegraded":"2024-04-23T18:32:34.404899+0000","last_fullsized":"2024-04-23T18:32:34.404899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:34.404810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:34.404810+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.404810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:37.587320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759670+0000","last_change":"2024-04-23T18:29:21.533405+0000","last_active":"2024-04-23T18:31:39.759670+0000","last_peered":"2024-04-23T18:31:39.759670+0000","last_clean":"2024-04-23T18:31:39.759670+0000","last_became_active":"2024-04-23T18:29:21.533202+0000","last_became_peered":"2024-04-23T18:29:21.533202+0000","last_unstale":"2024-04-23T18:31:39.759670+0000","last_undegraded":"2024-04-23T18:31:39.759670+0000","last_fullsized":"2024-04-23T18:31:39.759670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":32,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.271779+0000","last_change":"2024-04-23T18:29:13.507056+0000","last_active":"2024-04-23T18:32:21.271779+0000","last_peered":"2024-04-23T18:32:21.271779+0000","last_clean":"2024-04-23T18:32:21.271779+0000","last_became_active":"2024-04-23T18:29:13.506795+0000","last_became_peered":"2024-04-23T18:29:13.506795+0000","last_unstale":"2024-04-23T18:32:21.271779+0000","last_undegraded":"2024-04-23T18:32:21.271779+0000","last_fullsized":"2024-04-23T18:32:21.271779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756589+0000","last_change":"2024-04-23T18:29:11.492325+0000","last_active":"2024-04-23T18:31:19.756589+0000","last_peered":"2024-04-23T18:31:19.756589+0000","last_clean":"2024-04-23T18:31:19.756589+0000","last_became_active":"2024-04-23T18:29:11.491882+0000","last_became_peered":"2024-04-23T18:29:11.491882+0000","last_unstale":"2024-04-23T18:31:19.756589+0000","last_undegraded":"2024-04-23T18:31:19.756589+0000","last_fullsized":"2024-04-23T18:31:19.756589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:11.759046+0000","last_change":"2024-04-23T18:29:03.447598+0000","last_active":"2024-04-23T18:31:11.759046+0000","last_peered":"2024-04-23T18:31:11.759046+0000","last_clean":"2024-04-23T18:31:11.759046+0000","last_became_active":"2024-04-23T18:29:03.447265+0000","last_became_peered":"2024-04-23T18:29:03.447265+0000","last_unstale":"2024-04-23T18:31:11.759046+0000","last_undegraded":"2024-04-23T18:31:11.759046+0000","last_fullsized":"2024-04-23T18:31:11.759046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.440817+0000","last_change":"2024-04-23T18:32:42.440839+0000","last_active":"2024-04-23T18:32:42.440817+0000","last_peered":"2024-04-23T18:32:42.440817+0000","last_clean":"2024-04-23T18:32:42.440817+0000","last_became_active":"2024-04-23T18:29:15.506394+0000","last_became_peered":"2024-04-23T18:29:15.506394+0000","last_unstale":"2024-04-23T18:32:42.440817+0000","last_undegraded":"2024-04-23T18:32:42.440817+0000","last_fullsized":"2024-04-23T18:32:42.440817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:42.440734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:42.440734+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.440734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:59.535655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.939904+0000","last_change":"2024-04-23T18:32:34.939954+0000","last_active":"2024-04-23T18:32:34.939904+0000","last_peered":"2024-04-23T18:32:34.939904+0000","last_clean":"2024-04-23T18:32:34.939904+0000","last_became_active":"2024-04-23T18:29:17.515048+0000","last_became_peered":"2024-04-23T18:29:17.515048+0000","last_unstale":"2024-04-23T18:32:34.939904+0000","last_undegraded":"2024-04-23T18:32:34.939904+0000","last_fullsized":"2024-04-23T18:32:34.939904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-04-23T18:32:34.939820+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-04-23T18:32:34.939820+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.939820+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:16:03.621449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.962427+0000","last_change":"2024-04-23T18:32:33.962456+0000","last_active":"2024-04-23T18:32:33.962427+0000","last_peered":"2024-04-23T18:32:33.962427+0000","last_clean":"2024-04-23T18:32:33.962427+0000","last_became_active":"2024-04-23T18:29:19.518668+0000","last_became_peered":"2024-04-23T18:29:19.518668+0000","last_unstale":"2024-04-23T18:32:33.962427+0000","last_undegraded":"2024-04-23T18:32:33.962427+0000","last_fullsized":"2024-04-23T18:32:33.962427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:33.962317+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:33.962317+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.962317+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:24:53.232240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.220825+0000","last_change":"2024-04-23T18:29:21.531478+0000","last_active":"2024-04-23T18:32:21.220825+0000","last_peered":"2024-04-23T18:32:21.220825+0000","last_clean":"2024-04-23T18:32:21.220825+0000","last_became_active":"2024-04-23T18:29:21.531185+0000","last_became_peered":"2024-04-23T18:29:21.531185+0000","last_unstale":"2024-04-23T18:32:21.220825+0000","last_undegraded":"2024-04-23T18:32:21.220825+0000","last_fullsized":"2024-04-23T18:32:21.220825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.354057+0000","last_change":"2024-04-23T18:32:44.354121+0000","last_active":"2024-04-23T18:32:44.354057+0000","last_peered":"2024-04-23T18:32:44.354057+0000","last_clean":"2024-04-23T18:32:44.354057+0000","last_became_active":"2024-04-23T18:29:13.503543+0000","last_became_peered":"2024-04-23T18:29:13.503543+0000","last_unstale":"2024-04-23T18:32:44.354057+0000","last_undegraded":"2024-04-23T18:32:44.354057+0000","last_fullsized":"2024-04-23T18:32:44.354057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:44.353948+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:44.353948+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.353948+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:19.427152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.878949+0000","last_change":"2024-04-23T18:29:11.505973+0000","last_active":"2024-04-23T18:32:27.878949+0000","last_peered":"2024-04-23T18:32:27.878949+0000","last_clean":"2024-04-23T18:32:27.878949+0000","last_became_active":"2024-04-23T18:29:11.505604+0000","last_became_peered":"2024-04-23T18:29:11.505604+0000","last_unstale":"2024-04-23T18:32:27.878949+0000","last_undegraded":"2024-04-23T18:32:27.878949+0000","last_fullsized":"2024-04-23T18:32:27.878949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:14.755770+0000","last_change":"2024-04-23T18:29:03.446013+0000","last_active":"2024-04-23T18:31:14.755770+0000","last_peered":"2024-04-23T18:31:14.755770+0000","last_clean":"2024-04-23T18:31:14.755770+0000","last_became_active":"2024-04-23T18:29:03.445715+0000","last_became_peered":"2024-04-23T18:29:03.445715+0000","last_unstale":"2024-04-23T18:31:14.755770+0000","last_undegraded":"2024-04-23T18:31:14.755770+0000","last_fullsized":"2024-04-23T18:31:14.755770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.423649+0000","last_change":"2024-04-23T18:32:32.423670+0000","last_active":"2024-04-23T18:32:32.423649+0000","last_peered":"2024-04-23T18:32:32.423649+0000","last_clean":"2024-04-23T18:32:32.423649+0000","last_became_active":"2024-04-23T18:29:15.511553+0000","last_became_peered":"2024-04-23T18:29:15.511553+0000","last_unstale":"2024-04-23T18:32:32.423649+0000","last_undegraded":"2024-04-23T18:32:32.423649+0000","last_fullsized":"2024-04-23T18:32:32.423649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.423553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.423553+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.423553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:27:15.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.225500+0000","last_change":"2024-04-23T18:29:17.516388+0000","last_active":"2024-04-23T18:32:21.225500+0000","last_peered":"2024-04-23T18:32:21.225500+0000","last_clean":"2024-04-23T18:32:21.225500+0000","last_became_active":"2024-04-23T18:29:17.515741+0000","last_became_peered":"2024-04-23T18:29:17.515741+0000","last_unstale":"2024-04-23T18:32:21.225500+0000","last_undegraded":"2024-04-23T18:32:21.225500+0000","last_fullsized":"2024-04-23T18:32:21.225500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":411,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.172157+0000","last_change":"2024-04-23T18:32:48.172218+0000","last_active":"2024-04-23T18:32:48.172157+0000","last_peered":"2024-04-23T18:32:48.172157+0000","last_clean":"2024-04-23T18:32:48.172157+0000","last_became_active":"2024-04-23T18:29:19.526375+0000","last_became_peered":"2024-04-23T18:29:19.526375+0000","last_unstale":"2024-04-23T18:32:48.172157+0000","last_undegraded":"2024-04-23T18:32:48.172157+0000","last_fullsized":"2024-04-23T18:32:48.172157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:48.172046+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:48.172046+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.172046+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:32:02.059338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761558+0000","last_change":"2024-04-23T18:29:21.531204+0000","last_active":"2024-04-23T18:31:36.761558+0000","last_peered":"2024-04-23T18:31:36.761558+0000","last_clean":"2024-04-23T18:31:36.761558+0000","last_became_active":"2024-04-23T18:29:21.530911+0000","last_became_peered":"2024-04-23T18:29:21.530911+0000","last_unstale":"2024-04-23T18:31:36.761558+0000","last_undegraded":"2024-04-23T18:31:36.761558+0000","last_fullsized":"2024-04-23T18:31:36.761558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'16","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.007529+0000","last_change":"2024-04-23T18:29:13.499873+0000","last_active":"2024-04-23T18:32:21.007529+0000","last_peered":"2024-04-23T18:32:21.007529+0000","last_clean":"2024-04-23T18:32:21.007529+0000","last_became_active":"2024-04-23T18:29:13.499603+0000","last_became_peered":"2024-04-23T18:29:13.499603+0000","last_unstale":"2024-04-23T18:32:21.007529+0000","last_undegraded":"2024-04-23T18:32:21.007529+0000","last_fullsized":"2024-04-23T18:32:21.007529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.759405+0000","last_change":"2024-04-23T18:29:11.488874+0000","last_active":"2024-04-23T18:31:21.759405+0000","last_peered":"2024-04-23T18:31:21.759405+0000","last_clean":"2024-04-23T18:31:21.759405+0000","last_became_active":"2024-04-23T18:29:11.488500+0000","last_became_peered":"2024-04-23T18:29:11.488500+0000","last_unstale":"2024-04-23T18:31:21.759405+0000","last_undegraded":"2024-04-23T18:31:21.759405+0000","last_fullsized":"2024-04-23T18:31:21.759405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:11.759100+0000","last_change":"2024-04-23T18:29:03.594008+0000","last_active":"2024-04-23T18:31:11.759100+0000","last_peered":"2024-04-23T18:31:11.759100+0000","last_clean":"2024-04-23T18:31:11.759100+0000","last_became_active":"2024-04-23T18:29:03.593691+0000","last_became_peered":"2024-04-23T18:29:03.593691+0000","last_unstale":"2024-04-23T18:31:11.759100+0000","last_undegraded":"2024-04-23T18:31:11.759100+0000","last_fullsized":"2024-04-23T18:31:11.759100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.430515+0000","last_change":"2024-04-23T18:32:35.430553+0000","last_active":"2024-04-23T18:32:35.430515+0000","last_peered":"2024-04-23T18:32:35.430515+0000","last_clean":"2024-04-23T18:32:35.430515+0000","last_became_active":"2024-04-23T18:29:15.511207+0000","last_became_peered":"2024-04-23T18:29:15.511207+0000","last_unstale":"2024-04-23T18:32:35.430515+0000","last_undegraded":"2024-04-23T18:32:35.430515+0000","last_fullsized":"2024-04-23T18:32:35.430515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.430424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.430424+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.430424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:13.560310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":189,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.411279+0000","last_change":"2024-04-23T18:32:40.411316+0000","last_active":"2024-04-23T18:32:40.411279+0000","last_peered":"2024-04-23T18:32:40.411279+0000","last_clean":"2024-04-23T18:32:40.411279+0000","last_became_active":"2024-04-23T18:29:17.515004+0000","last_became_peered":"2024-04-23T18:29:17.515004+0000","last_unstale":"2024-04-23T18:32:40.411279+0000","last_undegraded":"2024-04-23T18:32:40.411279+0000","last_fullsized":"2024-04-23T18:32:40.411279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-04-23T18:32:40.411192+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-04-23T18:32:40.411192+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.411192+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:44.354254+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.340748+0000","last_change":"2024-04-23T18:32:37.340779+0000","last_active":"2024-04-23T18:32:37.340748+0000","last_peered":"2024-04-23T18:32:37.340748+0000","last_clean":"2024-04-23T18:32:37.340748+0000","last_became_active":"2024-04-23T18:29:19.517903+0000","last_became_peered":"2024-04-23T18:29:19.517903+0000","last_unstale":"2024-04-23T18:32:37.340748+0000","last_undegraded":"2024-04-23T18:32:37.340748+0000","last_fullsized":"2024-04-23T18:32:37.340748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:37.340641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:37.340641+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.340641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:57:08.789904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761162+0000","last_change":"2024-04-23T18:29:21.531285+0000","last_active":"2024-04-23T18:31:36.761162+0000","last_peered":"2024-04-23T18:31:36.761162+0000","last_clean":"2024-04-23T18:31:36.761162+0000","last_became_active":"2024-04-23T18:29:21.530980+0000","last_became_peered":"2024-04-23T18:29:21.530980+0000","last_unstale":"2024-04-23T18:31:36.761162+0000","last_undegraded":"2024-04-23T18:31:36.761162+0000","last_fullsized":"2024-04-23T18:31:36.761162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.759671+0000","last_change":"2024-04-23T18:29:21.534750+0000","last_active":"2024-04-23T18:31:26.759671+0000","last_peered":"2024-04-23T18:31:26.759671+0000","last_clean":"2024-04-23T18:31:26.759671+0000","last_became_active":"2024-04-23T18:29:21.534461+0000","last_became_peered":"2024-04-23T18:29:21.534461+0000","last_unstale":"2024-04-23T18:31:26.759671+0000","last_undegraded":"2024-04-23T18:31:26.759671+0000","last_fullsized":"2024-04-23T18:31:26.759671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.912046+0000","last_change":"2024-04-23T18:29:13.504381+0000","last_active":"2024-04-23T18:32:20.912046+0000","last_peered":"2024-04-23T18:32:20.912046+0000","last_clean":"2024-04-23T18:32:20.912046+0000","last_became_active":"2024-04-23T18:29:13.504092+0000","last_became_peered":"2024-04-23T18:29:13.504092+0000","last_unstale":"2024-04-23T18:32:20.912046+0000","last_undegraded":"2024-04-23T18:32:20.912046+0000","last_fullsized":"2024-04-23T18:32:20.912046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761840+0000","last_change":"2024-04-23T18:29:11.511197+0000","last_active":"2024-04-23T18:31:31.761840+0000","last_peered":"2024-04-23T18:31:31.761840+0000","last_clean":"2024-04-23T18:31:31.761840+0000","last_became_active":"2024-04-23T18:29:11.510456+0000","last_became_peered":"2024-04-23T18:29:11.510456+0000","last_unstale":"2024-04-23T18:31:31.761840+0000","last_undegraded":"2024-04-23T18:31:31.761840+0000","last_fullsized":"2024-04-23T18:31:31.761840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.935480+0000","last_change":"2024-04-23T18:32:48.935502+0000","last_active":"2024-04-23T18:32:48.935480+0000","last_peered":"2024-04-23T18:32:48.935480+0000","last_clean":"2024-04-23T18:32:48.935480+0000","last_became_active":"2024-04-23T18:29:15.506939+0000","last_became_peered":"2024-04-23T18:29:15.506939+0000","last_unstale":"2024-04-23T18:32:48.935480+0000","last_undegraded":"2024-04-23T18:32:48.935480+0000","last_fullsized":"2024-04-23T18:32:48.935480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:48.935390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:48.935390+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.935390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:50:02.096302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.400386+0000","last_change":"2024-04-23T18:32:37.400423+0000","last_active":"2024-04-23T18:32:37.400386+0000","last_peered":"2024-04-23T18:32:37.400386+0000","last_clean":"2024-04-23T18:32:37.400386+0000","last_became_active":"2024-04-23T18:29:17.511559+0000","last_became_peered":"2024-04-23T18:29:17.511559+0000","last_unstale":"2024-04-23T18:32:37.400386+0000","last_undegraded":"2024-04-23T18:32:37.400386+0000","last_fullsized":"2024-04-23T18:32:37.400386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:37.400296+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:37.400296+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.400296+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:51.584214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763236+0000","last_change":"2024-04-23T18:29:19.525590+0000","last_active":"2024-04-23T18:31:41.763236+0000","last_peered":"2024-04-23T18:31:41.763236+0000","last_clean":"2024-04-23T18:31:41.763236+0000","last_became_active":"2024-04-23T18:29:19.525302+0000","last_became_peered":"2024-04-23T18:29:19.525302+0000","last_unstale":"2024-04-23T18:31:41.763236+0000","last_undegraded":"2024-04-23T18:31:41.763236+0000","last_fullsized":"2024-04-23T18:31:41.763236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:24.757275+0000","last_change":"2024-04-23T18:29:21.530275+0000","last_active":"2024-04-23T18:31:24.757275+0000","last_peered":"2024-04-23T18:31:24.757275+0000","last_clean":"2024-04-23T18:31:24.757275+0000","last_became_active":"2024-04-23T18:29:21.530013+0000","last_became_peered":"2024-04-23T18:29:21.530013+0000","last_unstale":"2024-04-23T18:31:24.757275+0000","last_undegraded":"2024-04-23T18:31:24.757275+0000","last_fullsized":"2024-04-23T18:31:24.757275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761488+0000","last_change":"2024-04-23T18:29:13.506992+0000","last_active":"2024-04-23T18:31:36.761488+0000","last_peered":"2024-04-23T18:31:36.761488+0000","last_clean":"2024-04-23T18:31:36.761488+0000","last_became_active":"2024-04-23T18:29:13.506770+0000","last_became_peered":"2024-04-23T18:29:13.506770+0000","last_unstale":"2024-04-23T18:31:36.761488+0000","last_undegraded":"2024-04-23T18:31:36.761488+0000","last_fullsized":"2024-04-23T18:31:36.761488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'6","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.133993+0000","last_change":"2024-04-23T18:29:11.482617+0000","last_active":"2024-04-23T18:32:21.133993+0000","last_peered":"2024-04-23T18:32:21.133993+0000","last_clean":"2024-04-23T18:32:21.133993+0000","last_became_active":"2024-04-23T18:29:11.481884+0000","last_became_peered":"2024-04-23T18:29:11.481884+0000","last_unstale":"2024-04-23T18:32:21.133993+0000","last_undegraded":"2024-04-23T18:32:21.133993+0000","last_fullsized":"2024-04-23T18:32:21.133993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.416384+0000","last_change":"2024-04-23T18:32:38.416412+0000","last_active":"2024-04-23T18:32:38.416384+0000","last_peered":"2024-04-23T18:32:38.416384+0000","last_clean":"2024-04-23T18:32:38.416384+0000","last_became_active":"2024-04-23T18:29:15.508018+0000","last_became_peered":"2024-04-23T18:29:15.508018+0000","last_unstale":"2024-04-23T18:32:38.416384+0000","last_undegraded":"2024-04-23T18:32:38.416384+0000","last_fullsized":"2024-04-23T18:32:38.416384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:38.416298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:38.416298+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.416298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:11.511574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.373264+0000","last_change":"2024-04-23T18:32:38.373308+0000","last_active":"2024-04-23T18:32:38.373264+0000","last_peered":"2024-04-23T18:32:38.373264+0000","last_clean":"2024-04-23T18:32:38.373264+0000","last_became_active":"2024-04-23T18:29:17.514836+0000","last_became_peered":"2024-04-23T18:29:17.514836+0000","last_unstale":"2024-04-23T18:32:38.373264+0000","last_undegraded":"2024-04-23T18:32:38.373264+0000","last_fullsized":"2024-04-23T18:32:38.373264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:38.373174+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:38.373174+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.373174+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:55.790896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.401686+0000","last_change":"2024-04-23T18:32:37.401709+0000","last_active":"2024-04-23T18:32:37.401686+0000","last_peered":"2024-04-23T18:32:37.401686+0000","last_clean":"2024-04-23T18:32:37.401686+0000","last_became_active":"2024-04-23T18:29:19.527461+0000","last_became_peered":"2024-04-23T18:29:19.527461+0000","last_unstale":"2024-04-23T18:32:37.401686+0000","last_undegraded":"2024-04-23T18:32:37.401686+0000","last_fullsized":"2024-04-23T18:32:37.401686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:37.401597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:37.401597+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.401597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:07:00.685354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:54.761655+0000","last_change":"2024-04-23T18:29:21.529099+0000","last_active":"2024-04-23T18:31:54.761655+0000","last_peered":"2024-04-23T18:31:54.761655+0000","last_clean":"2024-04-23T18:31:54.761655+0000","last_became_active":"2024-04-23T18:29:21.528772+0000","last_became_peered":"2024-04-23T18:29:21.528772+0000","last_unstale":"2024-04-23T18:31:54.761655+0000","last_undegraded":"2024-04-23T18:31:54.761655+0000","last_fullsized":"2024-04-23T18:31:54.761655+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:34.758783+0000","last_change":"2024-04-23T18:29:13.503536+0000","last_active":"2024-04-23T18:31:34.758783+0000","last_peered":"2024-04-23T18:31:34.758783+0000","last_clean":"2024-04-23T18:31:34.758783+0000","last_became_active":"2024-04-23T18:29:13.502849+0000","last_became_peered":"2024-04-23T18:29:13.502849+0000","last_unstale":"2024-04-23T18:31:34.758783+0000","last_undegraded":"2024-04-23T18:31:34.758783+0000","last_fullsized":"2024-04-23T18:31:34.758783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.876555+0000","last_change":"2024-04-23T18:29:11.485392+0000","last_active":"2024-04-23T18:32:27.876555+0000","last_peered":"2024-04-23T18:32:27.876555+0000","last_clean":"2024-04-23T18:32:27.876555+0000","last_became_active":"2024-04-23T18:29:11.483628+0000","last_became_peered":"2024-04-23T18:29:11.483628+0000","last_unstale":"2024-04-23T18:32:27.876555+0000","last_undegraded":"2024-04-23T18:32:27.876555+0000","last_fullsized":"2024-04-23T18:32:27.876555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.524247+0000","last_change":"2024-04-23T18:32:47.524270+0000","last_active":"2024-04-23T18:32:47.524247+0000","last_peered":"2024-04-23T18:32:47.524247+0000","last_clean":"2024-04-23T18:32:47.524247+0000","last_became_active":"2024-04-23T18:29:15.510130+0000","last_became_peered":"2024-04-23T18:29:15.510130+0000","last_unstale":"2024-04-23T18:32:47.524247+0000","last_undegraded":"2024-04-23T18:32:47.524247+0000","last_fullsized":"2024-04-23T18:32:47.524247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:47.524159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:47.524159+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.524159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:43.989607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.296594+0000","last_change":"2024-04-23T18:32:43.296633+0000","last_active":"2024-04-23T18:32:43.296594+0000","last_peered":"2024-04-23T18:32:43.296594+0000","last_clean":"2024-04-23T18:32:43.296594+0000","last_became_active":"2024-04-23T18:29:17.510429+0000","last_became_peered":"2024-04-23T18:29:17.510429+0000","last_unstale":"2024-04-23T18:32:43.296594+0000","last_undegraded":"2024-04-23T18:32:43.296594+0000","last_fullsized":"2024-04-23T18:32:43.296594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:43.296501+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:43.296501+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.296501+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:18.685380+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.936215+0000","last_change":"2024-04-23T18:32:32.936254+0000","last_active":"2024-04-23T18:32:32.936215+0000","last_peered":"2024-04-23T18:32:32.936215+0000","last_clean":"2024-04-23T18:32:32.936215+0000","last_became_active":"2024-04-23T18:29:19.518543+0000","last_became_peered":"2024-04-23T18:29:19.518543+0000","last_unstale":"2024-04-23T18:32:32.936215+0000","last_undegraded":"2024-04-23T18:32:32.936215+0000","last_fullsized":"2024-04-23T18:32:32.936215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.936101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.936101+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.936101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:36.879163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:51.764880+0000","last_change":"2024-04-23T18:29:21.534350+0000","last_active":"2024-04-23T18:31:51.764880+0000","last_peered":"2024-04-23T18:31:51.764880+0000","last_clean":"2024-04-23T18:31:51.764880+0000","last_became_active":"2024-04-23T18:29:21.534023+0000","last_became_peered":"2024-04-23T18:29:21.534023+0000","last_unstale":"2024-04-23T18:31:51.764880+0000","last_undegraded":"2024-04-23T18:31:51.764880+0000","last_fullsized":"2024-04-23T18:31:51.764880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'19","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.271554+0000","last_change":"2024-04-23T18:29:13.501148+0000","last_active":"2024-04-23T18:32:21.271554+0000","last_peered":"2024-04-23T18:32:21.271554+0000","last_clean":"2024-04-23T18:32:21.271554+0000","last_became_active":"2024-04-23T18:29:13.500877+0000","last_became_peered":"2024-04-23T18:29:13.500877+0000","last_unstale":"2024-04-23T18:32:21.271554+0000","last_undegraded":"2024-04-23T18:32:21.271554+0000","last_fullsized":"2024-04-23T18:32:21.271554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":53,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761652+0000","last_change":"2024-04-23T18:29:11.498275+0000","last_active":"2024-04-23T18:31:36.761652+0000","last_peered":"2024-04-23T18:31:36.761652+0000","last_clean":"2024-04-23T18:31:36.761652+0000","last_became_active":"2024-04-23T18:29:11.497953+0000","last_became_peered":"2024-04-23T18:29:11.497953+0000","last_unstale":"2024-04-23T18:31:36.761652+0000","last_undegraded":"2024-04-23T18:31:36.761652+0000","last_fullsized":"2024-04-23T18:31:36.761652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.458609+0000","last_change":"2024-04-23T18:32:41.458630+0000","last_active":"2024-04-23T18:32:41.458609+0000","last_peered":"2024-04-23T18:32:41.458609+0000","last_clean":"2024-04-23T18:32:41.458609+0000","last_became_active":"2024-04-23T18:29:15.507253+0000","last_became_peered":"2024-04-23T18:29:15.507253+0000","last_unstale":"2024-04-23T18:32:41.458609+0000","last_undegraded":"2024-04-23T18:32:41.458609+0000","last_fullsized":"2024-04-23T18:32:41.458609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:41.458516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:41.458516+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.458516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:55:39.924778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.406718+0000","last_change":"2024-04-23T18:32:43.406751+0000","last_active":"2024-04-23T18:32:43.406718+0000","last_peered":"2024-04-23T18:32:43.406718+0000","last_clean":"2024-04-23T18:32:43.406718+0000","last_became_active":"2024-04-23T18:29:17.512820+0000","last_became_peered":"2024-04-23T18:29:17.512820+0000","last_unstale":"2024-04-23T18:32:43.406718+0000","last_undegraded":"2024-04-23T18:32:43.406718+0000","last_fullsized":"2024-04-23T18:32:43.406718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:43.406635+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:43.406635+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.406635+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:40.517887+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.355989+0000","last_change":"2024-04-23T18:32:35.356012+0000","last_active":"2024-04-23T18:32:35.355989+0000","last_peered":"2024-04-23T18:32:35.355989+0000","last_clean":"2024-04-23T18:32:35.355989+0000","last_became_active":"2024-04-23T18:29:19.525424+0000","last_became_peered":"2024-04-23T18:29:19.525424+0000","last_unstale":"2024-04-23T18:32:35.355989+0000","last_undegraded":"2024-04-23T18:32:35.355989+0000","last_fullsized":"2024-04-23T18:32:35.355989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.355896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.355896+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.355896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:58:38.926439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.192066+0000","last_change":"2024-04-23T18:29:13.496471+0000","last_active":"2024-04-23T18:32:21.192066+0000","last_peered":"2024-04-23T18:32:21.192066+0000","last_clean":"2024-04-23T18:32:21.192066+0000","last_became_active":"2024-04-23T18:29:13.496179+0000","last_became_peered":"2024-04-23T18:29:13.496179+0000","last_unstale":"2024-04-23T18:32:21.192066+0000","last_undegraded":"2024-04-23T18:32:21.192066+0000","last_fullsized":"2024-04-23T18:32:21.192066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762448+0000","last_change":"2024-04-23T18:29:11.500546+0000","last_active":"2024-04-23T18:31:36.762448+0000","last_peered":"2024-04-23T18:31:36.762448+0000","last_clean":"2024-04-23T18:31:36.762448+0000","last_became_active":"2024-04-23T18:29:11.500118+0000","last_became_peered":"2024-04-23T18:29:11.500118+0000","last_unstale":"2024-04-23T18:31:36.762448+0000","last_undegraded":"2024-04-23T18:31:36.762448+0000","last_fullsized":"2024-04-23T18:31:36.762448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:14.755824+0000","last_change":"2024-04-23T18:29:15.506605+0000","last_active":"2024-04-23T18:31:14.755824+0000","last_peered":"2024-04-23T18:31:14.755824+0000","last_clean":"2024-04-23T18:31:14.755824+0000","last_became_active":"2024-04-23T18:29:15.506197+0000","last_became_peered":"2024-04-23T18:29:15.506197+0000","last_unstale":"2024-04-23T18:31:14.755824+0000","last_undegraded":"2024-04-23T18:31:14.755824+0000","last_fullsized":"2024-04-23T18:31:14.755824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'66","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.328809+0000","last_change":"2024-04-23T18:32:39.328853+0000","last_active":"2024-04-23T18:32:39.328809+0000","last_peered":"2024-04-23T18:32:39.328809+0000","last_clean":"2024-04-23T18:32:39.328809+0000","last_became_active":"2024-04-23T18:29:17.514800+0000","last_became_peered":"2024-04-23T18:29:17.514800+0000","last_unstale":"2024-04-23T18:32:39.328809+0000","last_undegraded":"2024-04-23T18:32:39.328809+0000","last_fullsized":"2024-04-23T18:32:39.328809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-04-23T18:32:39.328706+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-04-23T18:32:39.328706+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.328706+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:44:56.598841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.370215+0000","last_change":"2024-04-23T18:32:36.370241+0000","last_active":"2024-04-23T18:32:36.370215+0000","last_peered":"2024-04-23T18:32:36.370215+0000","last_clean":"2024-04-23T18:32:36.370215+0000","last_became_active":"2024-04-23T18:29:19.524351+0000","last_became_peered":"2024-04-23T18:29:19.524351+0000","last_unstale":"2024-04-23T18:32:36.370215+0000","last_undegraded":"2024-04-23T18:32:36.370215+0000","last_fullsized":"2024-04-23T18:32:36.370215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.370129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.370129+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.370129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:58.907049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:44.760250+0000","last_change":"2024-04-23T18:29:21.529140+0000","last_active":"2024-04-23T18:31:44.760250+0000","last_peered":"2024-04-23T18:31:44.760250+0000","last_clean":"2024-04-23T18:31:44.760250+0000","last_became_active":"2024-04-23T18:29:21.528819+0000","last_became_peered":"2024-04-23T18:29:21.528819+0000","last_unstale":"2024-04-23T18:31:44.760250+0000","last_undegraded":"2024-04-23T18:31:44.760250+0000","last_fullsized":"2024-04-23T18:31:44.760250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:14.755799+0000","last_change":"2024-04-23T18:29:13.499526+0000","last_active":"2024-04-23T18:31:14.755799+0000","last_peered":"2024-04-23T18:31:14.755799+0000","last_clean":"2024-04-23T18:31:14.755799+0000","last_became_active":"2024-04-23T18:29:13.499137+0000","last_became_peered":"2024-04-23T18:29:13.499137+0000","last_unstale":"2024-04-23T18:31:14.755799+0000","last_undegraded":"2024-04-23T18:31:14.755799+0000","last_fullsized":"2024-04-23T18:31:14.755799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761426+0000","last_change":"2024-04-23T18:29:11.500980+0000","last_active":"2024-04-23T18:31:36.761426+0000","last_peered":"2024-04-23T18:31:36.761426+0000","last_clean":"2024-04-23T18:31:36.761426+0000","last_became_active":"2024-04-23T18:29:11.500584+0000","last_became_peered":"2024-04-23T18:29:11.500584+0000","last_unstale":"2024-04-23T18:31:36.761426+0000","last_undegraded":"2024-04-23T18:31:36.761426+0000","last_fullsized":"2024-04-23T18:31:36.761426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.494478+0000","last_change":"2024-04-23T18:32:51.494521+0000","last_active":"2024-04-23T18:32:51.494478+0000","last_peered":"2024-04-23T18:32:51.494478+0000","last_clean":"2024-04-23T18:32:51.494478+0000","last_became_active":"2024-04-23T18:29:15.503315+0000","last_became_peered":"2024-04-23T18:29:15.503315+0000","last_unstale":"2024-04-23T18:32:51.494478+0000","last_undegraded":"2024-04-23T18:32:51.494478+0000","last_fullsized":"2024-04-23T18:32:51.494478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:51.494354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:51.494354+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.494354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:13.705269+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.829998+0000","last_change":"2024-04-23T18:29:17.517217+0000","last_active":"2024-04-23T18:32:27.829998+0000","last_peered":"2024-04-23T18:32:27.829998+0000","last_clean":"2024-04-23T18:32:27.829998+0000","last_became_active":"2024-04-23T18:29:17.516934+0000","last_became_peered":"2024-04-23T18:29:17.516934+0000","last_unstale":"2024-04-23T18:32:27.829998+0000","last_undegraded":"2024-04-23T18:32:27.829998+0000","last_fullsized":"2024-04-23T18:32:27.829998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:31.933324+0000","last_change":"2024-04-23T18:32:31.933350+0000","last_active":"2024-04-23T18:32:31.933324+0000","last_peered":"2024-04-23T18:32:31.933324+0000","last_clean":"2024-04-23T18:32:31.933324+0000","last_became_active":"2024-04-23T18:29:19.519854+0000","last_became_peered":"2024-04-23T18:29:19.519854+0000","last_unstale":"2024-04-23T18:32:31.933324+0000","last_undegraded":"2024-04-23T18:32:31.933324+0000","last_fullsized":"2024-04-23T18:32:31.933324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:31.933225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:31.933225+0000","last_clean_scrub_stamp":"2024-04-23T18:32:31.933225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:09.747281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763296+0000","last_change":"2024-04-23T18:29:21.534768+0000","last_active":"2024-04-23T18:31:41.763296+0000","last_peered":"2024-04-23T18:31:41.763296+0000","last_clean":"2024-04-23T18:31:41.763296+0000","last_became_active":"2024-04-23T18:29:21.534487+0000","last_became_peered":"2024-04-23T18:29:21.534487+0000","last_unstale":"2024-04-23T18:31:41.763296+0000","last_undegraded":"2024-04-23T18:31:41.763296+0000","last_fullsized":"2024-04-23T18:31:41.763296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.425530+0000","last_change":"2024-04-23T18:32:48.425557+0000","last_active":"2024-04-23T18:32:48.425530+0000","last_peered":"2024-04-23T18:32:48.425530+0000","last_clean":"2024-04-23T18:32:48.425530+0000","last_became_active":"2024-04-23T18:29:13.502710+0000","last_became_peered":"2024-04-23T18:29:13.502710+0000","last_unstale":"2024-04-23T18:32:48.425530+0000","last_undegraded":"2024-04-23T18:32:48.425530+0000","last_fullsized":"2024-04-23T18:32:48.425530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:48.425438+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:48.425438+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.425438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:21.214995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.762335+0000","last_change":"2024-04-23T18:29:11.498320+0000","last_active":"2024-04-23T18:31:41.762335+0000","last_peered":"2024-04-23T18:31:41.762335+0000","last_clean":"2024-04-23T18:31:41.762335+0000","last_became_active":"2024-04-23T18:29:11.497191+0000","last_became_peered":"2024-04-23T18:29:11.497191+0000","last_unstale":"2024-04-23T18:31:41.762335+0000","last_undegraded":"2024-04-23T18:31:41.762335+0000","last_fullsized":"2024-04-23T18:31:41.762335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.762775+0000","last_change":"2024-04-23T18:29:15.502215+0000","last_active":"2024-04-23T18:31:46.762775+0000","last_peered":"2024-04-23T18:31:46.762775+0000","last_clean":"2024-04-23T18:31:46.762775+0000","last_became_active":"2024-04-23T18:29:15.501957+0000","last_became_peered":"2024-04-23T18:29:15.501957+0000","last_unstale":"2024-04-23T18:31:46.762775+0000","last_undegraded":"2024-04-23T18:31:46.762775+0000","last_fullsized":"2024-04-23T18:31:46.762775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.245650+0000","last_change":"2024-04-23T18:32:45.245695+0000","last_active":"2024-04-23T18:32:45.245650+0000","last_peered":"2024-04-23T18:32:45.245650+0000","last_clean":"2024-04-23T18:32:45.245650+0000","last_became_active":"2024-04-23T18:29:17.503196+0000","last_became_peered":"2024-04-23T18:29:17.503196+0000","last_unstale":"2024-04-23T18:32:45.245650+0000","last_undegraded":"2024-04-23T18:32:45.245650+0000","last_fullsized":"2024-04-23T18:32:45.245650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:45.245551+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:45.245551+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.245551+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:00.152459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756624+0000","last_change":"2024-04-23T18:29:19.527985+0000","last_active":"2024-04-23T18:31:19.756624+0000","last_peered":"2024-04-23T18:31:19.756624+0000","last_clean":"2024-04-23T18:31:19.756624+0000","last_became_active":"2024-04-23T18:29:19.527687+0000","last_became_peered":"2024-04-23T18:29:19.527687+0000","last_unstale":"2024-04-23T18:31:19.756624+0000","last_undegraded":"2024-04-23T18:31:19.756624+0000","last_fullsized":"2024-04-23T18:31:19.756624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763279+0000","last_change":"2024-04-23T18:29:21.534054+0000","last_active":"2024-04-23T18:31:41.763279+0000","last_peered":"2024-04-23T18:31:41.763279+0000","last_clean":"2024-04-23T18:31:41.763279+0000","last_became_active":"2024-04-23T18:29:21.533754+0000","last_became_peered":"2024-04-23T18:29:21.533754+0000","last_unstale":"2024-04-23T18:31:41.763279+0000","last_undegraded":"2024-04-23T18:31:41.763279+0000","last_fullsized":"2024-04-23T18:31:41.763279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.912182+0000","last_change":"2024-04-23T18:29:13.497462+0000","last_active":"2024-04-23T18:32:20.912182+0000","last_peered":"2024-04-23T18:32:20.912182+0000","last_clean":"2024-04-23T18:32:20.912182+0000","last_became_active":"2024-04-23T18:29:13.497121+0000","last_became_peered":"2024-04-23T18:29:13.497121+0000","last_unstale":"2024-04-23T18:32:20.912182+0000","last_undegraded":"2024-04-23T18:32:20.912182+0000","last_fullsized":"2024-04-23T18:32:20.912182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763331+0000","last_change":"2024-04-23T18:29:11.504900+0000","last_active":"2024-04-23T18:31:41.763331+0000","last_peered":"2024-04-23T18:31:41.763331+0000","last_clean":"2024-04-23T18:31:41.763331+0000","last_became_active":"2024-04-23T18:29:11.504564+0000","last_became_peered":"2024-04-23T18:29:11.504564+0000","last_unstale":"2024-04-23T18:31:41.763331+0000","last_undegraded":"2024-04-23T18:31:41.763331+0000","last_fullsized":"2024-04-23T18:31:41.763331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.918227+0000","last_change":"2024-04-23T18:32:50.918254+0000","last_active":"2024-04-23T18:32:50.918227+0000","last_peered":"2024-04-23T18:32:50.918227+0000","last_clean":"2024-04-23T18:32:50.918227+0000","last_became_active":"2024-04-23T18:29:15.506171+0000","last_became_peered":"2024-04-23T18:29:15.506171+0000","last_unstale":"2024-04-23T18:32:50.918227+0000","last_undegraded":"2024-04-23T18:32:50.918227+0000","last_fullsized":"2024-04-23T18:32:50.918227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.918119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.918119+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.918119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:12.800419+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:16.759775+0000","last_change":"2024-04-23T18:29:17.517401+0000","last_active":"2024-04-23T18:31:16.759775+0000","last_peered":"2024-04-23T18:31:16.759775+0000","last_clean":"2024-04-23T18:31:16.759775+0000","last_became_active":"2024-04-23T18:29:17.517051+0000","last_became_peered":"2024-04-23T18:29:17.517051+0000","last_unstale":"2024-04-23T18:31:16.759775+0000","last_undegraded":"2024-04-23T18:31:16.759775+0000","last_fullsized":"2024-04-23T18:31:16.759775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":378,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.362588+0000","last_change":"2024-04-23T18:32:41.362652+0000","last_active":"2024-04-23T18:32:41.362588+0000","last_peered":"2024-04-23T18:32:41.362588+0000","last_clean":"2024-04-23T18:32:41.362588+0000","last_became_active":"2024-04-23T18:29:19.527614+0000","last_became_peered":"2024-04-23T18:29:19.527614+0000","last_unstale":"2024-04-23T18:32:41.362588+0000","last_undegraded":"2024-04-23T18:32:41.362588+0000","last_fullsized":"2024-04-23T18:32:41.362588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:41.362491+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:41.362491+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.362491+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:25:00.632414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763197+0000","last_change":"2024-04-23T18:29:21.531583+0000","last_active":"2024-04-23T18:31:41.763197+0000","last_peered":"2024-04-23T18:31:41.763197+0000","last_clean":"2024-04-23T18:31:41.763197+0000","last_became_active":"2024-04-23T18:29:21.530619+0000","last_became_peered":"2024-04-23T18:29:21.530619+0000","last_unstale":"2024-04-23T18:31:41.763197+0000","last_undegraded":"2024-04-23T18:31:41.763197+0000","last_fullsized":"2024-04-23T18:31:41.763197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.142959+0000","last_change":"2024-04-23T18:29:13.502162+0000","last_active":"2024-04-23T18:32:21.142959+0000","last_peered":"2024-04-23T18:32:21.142959+0000","last_clean":"2024-04-23T18:32:21.142959+0000","last_became_active":"2024-04-23T18:29:13.501741+0000","last_became_peered":"2024-04-23T18:29:13.501741+0000","last_unstale":"2024-04-23T18:32:21.142959+0000","last_undegraded":"2024-04-23T18:32:21.142959+0000","last_fullsized":"2024-04-23T18:32:21.142959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.762401+0000","last_change":"2024-04-23T18:29:11.501098+0000","last_active":"2024-04-23T18:31:41.762401+0000","last_peered":"2024-04-23T18:31:41.762401+0000","last_clean":"2024-04-23T18:31:41.762401+0000","last_became_active":"2024-04-23T18:29:11.500781+0000","last_became_peered":"2024-04-23T18:29:11.500781+0000","last_unstale":"2024-04-23T18:31:41.762401+0000","last_undegraded":"2024-04-23T18:31:41.762401+0000","last_fullsized":"2024-04-23T18:31:41.762401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.763087+0000","last_change":"2024-04-23T18:29:52.550289+0000","last_active":"2024-04-23T18:31:46.763087+0000","last_peered":"2024-04-23T18:31:46.763087+0000","last_clean":"2024-04-23T18:31:46.763087+0000","last_became_active":"2024-04-23T18:29:52.549944+0000","last_became_peered":"2024-04-23T18:29:52.549944+0000","last_unstale":"2024-04-23T18:31:46.763087+0000","last_undegraded":"2024-04-23T18:31:46.763087+0000","last_fullsized":"2024-04-23T18:31:46.763087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.837445+0000","last_change":"2024-04-23T18:32:41.837483+0000","last_active":"2024-04-23T18:32:41.837445+0000","last_peered":"2024-04-23T18:32:41.837445+0000","last_clean":"2024-04-23T18:32:41.837445+0000","last_became_active":"2024-04-23T18:29:17.509076+0000","last_became_peered":"2024-04-23T18:29:17.509076+0000","last_unstale":"2024-04-23T18:32:41.837445+0000","last_undegraded":"2024-04-23T18:32:41.837445+0000","last_fullsized":"2024-04-23T18:32:41.837445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-23T18:32:41.837343+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-23T18:32:41.837343+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.837343+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:11.245831+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.466736+0000","last_change":"2024-04-23T18:32:32.466759+0000","last_active":"2024-04-23T18:32:32.466736+0000","last_peered":"2024-04-23T18:32:32.466736+0000","last_clean":"2024-04-23T18:32:32.466736+0000","last_became_active":"2024-04-23T18:29:19.518673+0000","last_became_peered":"2024-04-23T18:29:19.518673+0000","last_unstale":"2024-04-23T18:32:32.466736+0000","last_undegraded":"2024-04-23T18:32:32.466736+0000","last_fullsized":"2024-04-23T18:32:32.466736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.466649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.466649+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.466649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:22:40.471567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.763176+0000","last_change":"2024-04-23T18:29:21.533731+0000","last_active":"2024-04-23T18:31:46.763176+0000","last_peered":"2024-04-23T18:31:46.763176+0000","last_clean":"2024-04-23T18:31:46.763176+0000","last_became_active":"2024-04-23T18:29:21.533187+0000","last_became_peered":"2024-04-23T18:29:21.533187+0000","last_unstale":"2024-04-23T18:31:46.763176+0000","last_undegraded":"2024-04-23T18:31:46.763176+0000","last_fullsized":"2024-04-23T18:31:46.763176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223207+0000","last_change":"2024-04-23T18:29:13.502229+0000","last_active":"2024-04-23T18:32:21.223207+0000","last_peered":"2024-04-23T18:32:21.223207+0000","last_clean":"2024-04-23T18:32:21.223207+0000","last_became_active":"2024-04-23T18:29:13.501974+0000","last_became_peered":"2024-04-23T18:29:13.501974+0000","last_unstale":"2024-04-23T18:32:21.223207+0000","last_undegraded":"2024-04-23T18:32:21.223207+0000","last_fullsized":"2024-04-23T18:32:21.223207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763395+0000","last_change":"2024-04-23T18:29:11.511621+0000","last_active":"2024-04-23T18:31:41.763395+0000","last_peered":"2024-04-23T18:31:41.763395+0000","last_clean":"2024-04-23T18:31:41.763395+0000","last_became_active":"2024-04-23T18:29:11.511297+0000","last_became_peered":"2024-04-23T18:29:11.511297+0000","last_unstale":"2024-04-23T18:31:41.763395+0000","last_undegraded":"2024-04-23T18:31:41.763395+0000","last_fullsized":"2024-04-23T18:31:41.763395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.503698+0000","last_change":"2024-04-23T18:32:50.503761+0000","last_active":"2024-04-23T18:32:50.503698+0000","last_peered":"2024-04-23T18:32:50.503698+0000","last_clean":"2024-04-23T18:32:50.503698+0000","last_became_active":"2024-04-23T18:29:15.504528+0000","last_became_peered":"2024-04-23T18:29:15.504528+0000","last_unstale":"2024-04-23T18:32:50.503698+0000","last_undegraded":"2024-04-23T18:32:50.503698+0000","last_fullsized":"2024-04-23T18:32:50.503698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.503597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.503597+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.503597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:20:31.588182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.345447+0000","last_change":"2024-04-23T18:32:42.345524+0000","last_active":"2024-04-23T18:32:42.345447+0000","last_peered":"2024-04-23T18:32:42.345447+0000","last_clean":"2024-04-23T18:32:42.345447+0000","last_became_active":"2024-04-23T18:29:17.513482+0000","last_became_peered":"2024-04-23T18:29:17.513482+0000","last_unstale":"2024-04-23T18:32:42.345447+0000","last_undegraded":"2024-04-23T18:32:42.345447+0000","last_fullsized":"2024-04-23T18:32:42.345447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:42.345340+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:42.345340+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.345340+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:11.159885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.763959+0000","last_change":"2024-04-23T18:29:19.526244+0000","last_active":"2024-04-23T18:31:46.763959+0000","last_peered":"2024-04-23T18:31:46.763959+0000","last_clean":"2024-04-23T18:31:46.763959+0000","last_became_active":"2024-04-23T18:29:19.525985+0000","last_became_peered":"2024-04-23T18:29:19.525985+0000","last_unstale":"2024-04-23T18:31:46.763959+0000","last_undegraded":"2024-04-23T18:31:46.763959+0000","last_fullsized":"2024-04-23T18:31:46.763959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.764206+0000","last_change":"2024-04-23T18:29:21.528945+0000","last_active":"2024-04-23T18:31:46.764206+0000","last_peered":"2024-04-23T18:31:46.764206+0000","last_clean":"2024-04-23T18:31:46.764206+0000","last_became_active":"2024-04-23T18:29:21.528665+0000","last_became_peered":"2024-04-23T18:29:21.528665+0000","last_unstale":"2024-04-23T18:31:46.764206+0000","last_undegraded":"2024-04-23T18:31:46.764206+0000","last_fullsized":"2024-04-23T18:31:46.764206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763258+0000","last_change":"2024-04-23T18:29:13.495164+0000","last_active":"2024-04-23T18:31:41.763258+0000","last_peered":"2024-04-23T18:31:41.763258+0000","last_clean":"2024-04-23T18:31:41.763258+0000","last_became_active":"2024-04-23T18:29:13.494647+0000","last_became_peered":"2024-04-23T18:29:13.494647+0000","last_unstale":"2024-04-23T18:31:41.763258+0000","last_undegraded":"2024-04-23T18:31:41.763258+0000","last_fullsized":"2024-04-23T18:31:41.763258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:17.269067+0000","last_change":"2024-04-23T18:29:11.496011+0000","last_active":"2024-04-23T18:31:17.269067+0000","last_peered":"2024-04-23T18:31:17.269067+0000","last_clean":"2024-04-23T18:31:17.269067+0000","last_became_active":"2024-04-23T18:29:11.495723+0000","last_became_peered":"2024-04-23T18:29:11.495723+0000","last_unstale":"2024-04-23T18:31:17.269067+0000","last_undegraded":"2024-04-23T18:31:17.269067+0000","last_fullsized":"2024-04-23T18:31:17.269067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.847864+0000","last_change":"2024-04-23T18:32:42.847886+0000","last_active":"2024-04-23T18:32:42.847864+0000","last_peered":"2024-04-23T18:32:42.847864+0000","last_clean":"2024-04-23T18:32:42.847864+0000","last_became_active":"2024-04-23T18:29:15.510185+0000","last_became_peered":"2024-04-23T18:29:15.510185+0000","last_unstale":"2024-04-23T18:32:42.847864+0000","last_undegraded":"2024-04-23T18:32:42.847864+0000","last_fullsized":"2024-04-23T18:32:42.847864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:42.847777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:42.847777+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.847777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:20:23.932361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'32","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.881329+0000","last_change":"2024-04-23T18:29:17.517329+0000","last_active":"2024-04-23T18:32:27.881329+0000","last_peered":"2024-04-23T18:32:27.881329+0000","last_clean":"2024-04-23T18:32:27.881329+0000","last_became_active":"2024-04-23T18:29:17.516989+0000","last_became_peered":"2024-04-23T18:29:17.516989+0000","last_unstale":"2024-04-23T18:32:27.881329+0000","last_undegraded":"2024-04-23T18:32:27.881329+0000","last_fullsized":"2024-04-23T18:32:27.881329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":38,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:51.764812+0000","last_change":"2024-04-23T18:29:19.522484+0000","last_active":"2024-04-23T18:31:51.764812+0000","last_peered":"2024-04-23T18:31:51.764812+0000","last_clean":"2024-04-23T18:31:51.764812+0000","last_became_active":"2024-04-23T18:29:19.522217+0000","last_became_peered":"2024-04-23T18:29:19.522217+0000","last_unstale":"2024-04-23T18:31:51.764812+0000","last_undegraded":"2024-04-23T18:31:51.764812+0000","last_fullsized":"2024-04-23T18:31:51.764812+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:18.496868+0000","last_clean_scrub_stamp":"2024-04-23T18:29:18.496868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.764140+0000","last_change":"2024-04-23T18:29:21.533465+0000","last_active":"2024-04-23T18:31:46.764140+0000","last_peered":"2024-04-23T18:31:46.764140+0000","last_clean":"2024-04-23T18:31:46.764140+0000","last_became_active":"2024-04-23T18:29:21.533152+0000","last_became_peered":"2024-04-23T18:29:21.533152+0000","last_unstale":"2024-04-23T18:31:46.764140+0000","last_undegraded":"2024-04-23T18:31:46.764140+0000","last_fullsized":"2024-04-23T18:31:46.764140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.191999+0000","last_change":"2024-04-23T18:29:13.502434+0000","last_active":"2024-04-23T18:32:21.191999+0000","last_peered":"2024-04-23T18:32:21.191999+0000","last_clean":"2024-04-23T18:32:21.191999+0000","last_became_active":"2024-04-23T18:29:13.501782+0000","last_became_peered":"2024-04-23T18:29:13.501782+0000","last_unstale":"2024-04-23T18:32:21.191999+0000","last_undegraded":"2024-04-23T18:32:21.191999+0000","last_fullsized":"2024-04-23T18:32:21.191999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.876639+0000","last_change":"2024-04-23T18:29:11.501970+0000","last_active":"2024-04-23T18:32:27.876639+0000","last_peered":"2024-04-23T18:32:27.876639+0000","last_clean":"2024-04-23T18:32:27.876639+0000","last_became_active":"2024-04-23T18:29:11.501648+0000","last_became_peered":"2024-04-23T18:29:11.501648+0000","last_unstale":"2024-04-23T18:32:27.876639+0000","last_undegraded":"2024-04-23T18:32:27.876639+0000","last_fullsized":"2024-04-23T18:32:27.876639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.904576+0000","last_change":"2024-04-23T18:32:44.904604+0000","last_active":"2024-04-23T18:32:44.904576+0000","last_peered":"2024-04-23T18:32:44.904576+0000","last_clean":"2024-04-23T18:32:44.904576+0000","last_became_active":"2024-04-23T18:29:15.509725+0000","last_became_peered":"2024-04-23T18:29:15.509725+0000","last_unstale":"2024-04-23T18:32:44.904576+0000","last_undegraded":"2024-04-23T18:32:44.904576+0000","last_fullsized":"2024-04-23T18:32:44.904576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-23T18:32:44.904494+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-23T18:32:44.904494+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.904494+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:04.452291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.890250+0000","last_change":"2024-04-23T18:29:17.515107+0000","last_active":"2024-04-23T18:32:27.890250+0000","last_peered":"2024-04-23T18:32:27.890250+0000","last_clean":"2024-04-23T18:32:27.890250+0000","last_became_active":"2024-04-23T18:29:17.514823+0000","last_became_peered":"2024-04-23T18:29:17.514823+0000","last_unstale":"2024-04-23T18:32:27.890250+0000","last_undegraded":"2024-04-23T18:32:27.890250+0000","last_fullsized":"2024-04-23T18:32:27.890250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:16.489701+0000","last_clean_scrub_stamp":"2024-04-23T18:29:16.489701+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.280462+0000","last_change":"2024-04-23T18:32:40.280484+0000","last_active":"2024-04-23T18:32:40.280462+0000","last_peered":"2024-04-23T18:32:40.280462+0000","last_clean":"2024-04-23T18:32:40.280462+0000","last_became_active":"2024-04-23T18:29:19.519153+0000","last_became_peered":"2024-04-23T18:29:19.519153+0000","last_unstale":"2024-04-23T18:32:40.280462+0000","last_undegraded":"2024-04-23T18:32:40.280462+0000","last_fullsized":"2024-04-23T18:32:40.280462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:40.280370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:40.280370+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.280370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:40.211480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.008771+0000","last_change":"2024-04-23T18:29:21.529659+0000","last_active":"2024-04-23T18:32:21.008771+0000","last_peered":"2024-04-23T18:32:21.008771+0000","last_clean":"2024-04-23T18:32:21.008771+0000","last_became_active":"2024-04-23T18:29:21.529331+0000","last_became_peered":"2024-04-23T18:29:21.529331+0000","last_unstale":"2024-04-23T18:32:21.008771+0000","last_undegraded":"2024-04-23T18:32:21.008771+0000","last_fullsized":"2024-04-23T18:32:21.008771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223218+0000","last_change":"2024-04-23T18:29:52.563032+0000","last_active":"2024-04-23T18:32:21.223218+0000","last_peered":"2024-04-23T18:32:21.223218+0000","last_clean":"2024-04-23T18:32:21.223218+0000","last_became_active":"2024-04-23T18:29:52.551523+0000","last_became_peered":"2024-04-23T18:29:52.551523+0000","last_unstale":"2024-04-23T18:32:21.223218+0000","last_undegraded":"2024-04-23T18:32:21.223218+0000","last_fullsized":"2024-04-23T18:32:21.223218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:16.758104+0000","last_change":"2024-04-23T18:29:11.489634+0000","last_active":"2024-04-23T18:31:16.758104+0000","last_peered":"2024-04-23T18:31:16.758104+0000","last_clean":"2024-04-23T18:31:16.758104+0000","last_became_active":"2024-04-23T18:29:11.489284+0000","last_became_peered":"2024-04-23T18:29:11.489284+0000","last_unstale":"2024-04-23T18:31:16.758104+0000","last_undegraded":"2024-04-23T18:31:16.758104+0000","last_fullsized":"2024-04-23T18:31:16.758104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:24.757307+0000","last_change":"2024-04-23T18:29:13.497247+0000","last_active":"2024-04-23T18:31:24.757307+0000","last_peered":"2024-04-23T18:31:24.757307+0000","last_clean":"2024-04-23T18:31:24.757307+0000","last_became_active":"2024-04-23T18:29:13.496958+0000","last_became_peered":"2024-04-23T18:29:13.496958+0000","last_unstale":"2024-04-23T18:31:24.757307+0000","last_undegraded":"2024-04-23T18:31:24.757307+0000","last_fullsized":"2024-04-23T18:31:24.757307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756515+0000","last_change":"2024-04-23T18:29:11.487639+0000","last_active":"2024-04-23T18:31:19.756515+0000","last_peered":"2024-04-23T18:31:19.756515+0000","last_clean":"2024-04-23T18:31:19.756515+0000","last_became_active":"2024-04-23T18:29:11.486563+0000","last_became_peered":"2024-04-23T18:29:11.486563+0000","last_unstale":"2024-04-23T18:31:19.756515+0000","last_undegraded":"2024-04-23T18:31:19.756515+0000","last_fullsized":"2024-04-23T18:31:19.756515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.191203+0000","last_change":"2024-04-23T18:29:13.494907+0000","last_active":"2024-04-23T18:32:21.191203+0000","last_peered":"2024-04-23T18:32:21.191203+0000","last_clean":"2024-04-23T18:32:21.191203+0000","last_became_active":"2024-04-23T18:29:13.494683+0000","last_became_peered":"2024-04-23T18:29:13.494683+0000","last_unstale":"2024-04-23T18:32:21.191203+0000","last_undegraded":"2024-04-23T18:32:21.191203+0000","last_fullsized":"2024-04-23T18:32:21.191203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.877505+0000","last_change":"2024-04-23T18:29:11.511297+0000","last_active":"2024-04-23T18:32:27.877505+0000","last_peered":"2024-04-23T18:32:27.877505+0000","last_clean":"2024-04-23T18:32:27.877505+0000","last_became_active":"2024-04-23T18:29:11.510971+0000","last_became_peered":"2024-04-23T18:29:11.510971+0000","last_unstale":"2024-04-23T18:32:27.877505+0000","last_undegraded":"2024-04-23T18:32:27.877505+0000","last_fullsized":"2024-04-23T18:32:27.877505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'12","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:24.757243+0000","last_change":"2024-04-23T18:29:13.497387+0000","last_active":"2024-04-23T18:31:24.757243+0000","last_peered":"2024-04-23T18:31:24.757243+0000","last_clean":"2024-04-23T18:31:24.757243+0000","last_became_active":"2024-04-23T18:29:13.497094+0000","last_became_peered":"2024-04-23T18:29:13.497094+0000","last_unstale":"2024-04-23T18:31:24.757243+0000","last_undegraded":"2024-04-23T18:31:24.757243+0000","last_fullsized":"2024-04-23T18:31:24.757243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756570+0000","last_change":"2024-04-23T18:29:11.492610+0000","last_active":"2024-04-23T18:31:19.756570+0000","last_peered":"2024-04-23T18:31:19.756570+0000","last_clean":"2024-04-23T18:31:19.756570+0000","last_became_active":"2024-04-23T18:29:11.492064+0000","last_became_peered":"2024-04-23T18:29:11.492064+0000","last_unstale":"2024-04-23T18:31:19.756570+0000","last_undegraded":"2024-04-23T18:31:19.756570+0000","last_fullsized":"2024-04-23T18:31:19.756570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.005233+0000","last_change":"2024-04-23T18:29:13.502885+0000","last_active":"2024-04-23T18:32:21.005233+0000","last_peered":"2024-04-23T18:32:21.005233+0000","last_clean":"2024-04-23T18:32:21.005233+0000","last_became_active":"2024-04-23T18:29:13.502243+0000","last_became_peered":"2024-04-23T18:29:13.502243+0000","last_unstale":"2024-04-23T18:32:21.005233+0000","last_undegraded":"2024-04-23T18:32:21.005233+0000","last_fullsized":"2024-04-23T18:32:21.005233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:24.757253+0000","last_change":"2024-04-23T18:29:11.486754+0000","last_active":"2024-04-23T18:31:24.757253+0000","last_peered":"2024-04-23T18:31:24.757253+0000","last_clean":"2024-04-23T18:31:24.757253+0000","last_became_active":"2024-04-23T18:29:11.486452+0000","last_became_peered":"2024-04-23T18:29:11.486452+0000","last_unstale":"2024-04-23T18:31:24.757253+0000","last_undegraded":"2024-04-23T18:31:24.757253+0000","last_fullsized":"2024-04-23T18:31:24.757253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.194017+0000","last_change":"2024-04-23T18:29:13.507893+0000","last_active":"2024-04-23T18:32:21.194017+0000","last_peered":"2024-04-23T18:32:21.194017+0000","last_clean":"2024-04-23T18:32:21.194017+0000","last_became_active":"2024-04-23T18:29:13.507582+0000","last_became_peered":"2024-04-23T18:29:13.507582+0000","last_unstale":"2024-04-23T18:32:21.194017+0000","last_undegraded":"2024-04-23T18:32:21.194017+0000","last_fullsized":"2024-04-23T18:32:21.194017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.759380+0000","last_change":"2024-04-23T18:29:11.495366+0000","last_active":"2024-04-23T18:31:21.759380+0000","last_peered":"2024-04-23T18:31:21.759380+0000","last_clean":"2024-04-23T18:31:21.759380+0000","last_became_active":"2024-04-23T18:29:11.493318+0000","last_became_peered":"2024-04-23T18:29:11.493318+0000","last_unstale":"2024-04-23T18:31:21.759380+0000","last_undegraded":"2024-04-23T18:31:21.759380+0000","last_fullsized":"2024-04-23T18:31:21.759380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'22","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.145367+0000","last_change":"2024-04-23T18:29:13.499537+0000","last_active":"2024-04-23T18:32:21.145367+0000","last_peered":"2024-04-23T18:32:21.145367+0000","last_clean":"2024-04-23T18:32:21.145367+0000","last_became_active":"2024-04-23T18:29:13.499155+0000","last_became_peered":"2024-04-23T18:29:13.499155+0000","last_unstale":"2024-04-23T18:32:21.145367+0000","last_undegraded":"2024-04-23T18:32:21.145367+0000","last_fullsized":"2024-04-23T18:32:21.145367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.758947+0000","last_change":"2024-04-23T18:29:11.486471+0000","last_active":"2024-04-23T18:31:21.758947+0000","last_peered":"2024-04-23T18:31:21.758947+0000","last_clean":"2024-04-23T18:31:21.758947+0000","last_became_active":"2024-04-23T18:29:11.485201+0000","last_became_peered":"2024-04-23T18:29:11.485201+0000","last_unstale":"2024-04-23T18:31:21.758947+0000","last_undegraded":"2024-04-23T18:31:21.758947+0000","last_fullsized":"2024-04-23T18:31:21.758947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.910127+0000","last_change":"2024-04-23T18:29:13.497344+0000","last_active":"2024-04-23T18:32:20.910127+0000","last_peered":"2024-04-23T18:32:20.910127+0000","last_clean":"2024-04-23T18:32:20.910127+0000","last_became_active":"2024-04-23T18:29:13.495654+0000","last_became_peered":"2024-04-23T18:29:13.495654+0000","last_unstale":"2024-04-23T18:32:20.910127+0000","last_undegraded":"2024-04-23T18:32:20.910127+0000","last_fullsized":"2024-04-23T18:32:20.910127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:24.757332+0000","last_change":"2024-04-23T18:29:11.495685+0000","last_active":"2024-04-23T18:31:24.757332+0000","last_peered":"2024-04-23T18:31:24.757332+0000","last_clean":"2024-04-23T18:31:24.757332+0000","last_became_active":"2024-04-23T18:29:11.495224+0000","last_became_peered":"2024-04-23T18:29:11.495224+0000","last_unstale":"2024-04-23T18:31:24.757332+0000","last_undegraded":"2024-04-23T18:31:24.757332+0000","last_fullsized":"2024-04-23T18:31:24.757332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.193995+0000","last_change":"2024-04-23T18:29:13.498009+0000","last_active":"2024-04-23T18:32:21.193995+0000","last_peered":"2024-04-23T18:32:21.193995+0000","last_clean":"2024-04-23T18:32:21.193995+0000","last_became_active":"2024-04-23T18:29:13.497588+0000","last_became_peered":"2024-04-23T18:29:13.497588+0000","last_unstale":"2024-04-23T18:32:21.193995+0000","last_undegraded":"2024-04-23T18:32:21.193995+0000","last_fullsized":"2024-04-23T18:32:21.193995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760305+0000","last_change":"2024-04-23T18:29:11.496267+0000","last_active":"2024-04-23T18:31:21.760305+0000","last_peered":"2024-04-23T18:31:21.760305+0000","last_clean":"2024-04-23T18:31:21.760305+0000","last_became_active":"2024-04-23T18:29:11.495948+0000","last_became_peered":"2024-04-23T18:29:11.495948+0000","last_unstale":"2024-04-23T18:31:21.760305+0000","last_undegraded":"2024-04-23T18:31:21.760305+0000","last_fullsized":"2024-04-23T18:31:21.760305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762691+0000","last_change":"2024-04-23T18:29:13.501113+0000","last_active":"2024-04-23T18:31:36.762691+0000","last_peered":"2024-04-23T18:31:36.762691+0000","last_clean":"2024-04-23T18:31:36.762691+0000","last_became_active":"2024-04-23T18:29:13.500819+0000","last_became_peered":"2024-04-23T18:29:13.500819+0000","last_unstale":"2024-04-23T18:31:36.762691+0000","last_undegraded":"2024-04-23T18:31:36.762691+0000","last_fullsized":"2024-04-23T18:31:36.762691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:29.758109+0000","last_change":"2024-04-23T18:29:11.493307+0000","last_active":"2024-04-23T18:31:29.758109+0000","last_peered":"2024-04-23T18:31:29.758109+0000","last_clean":"2024-04-23T18:31:29.758109+0000","last_became_active":"2024-04-23T18:29:11.492727+0000","last_became_peered":"2024-04-23T18:29:11.492727+0000","last_unstale":"2024-04-23T18:31:29.758109+0000","last_undegraded":"2024-04-23T18:31:29.758109+0000","last_fullsized":"2024-04-23T18:31:29.758109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223115+0000","last_change":"2024-04-23T18:29:13.503226+0000","last_active":"2024-04-23T18:32:21.223115+0000","last_peered":"2024-04-23T18:32:21.223115+0000","last_clean":"2024-04-23T18:32:21.223115+0000","last_became_active":"2024-04-23T18:29:13.502835+0000","last_became_peered":"2024-04-23T18:29:13.502835+0000","last_unstale":"2024-04-23T18:32:21.223115+0000","last_undegraded":"2024-04-23T18:32:21.223115+0000","last_fullsized":"2024-04-23T18:32:21.223115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.118836+0000","last_change":"2024-04-23T18:29:11.500172+0000","last_active":"2024-04-23T18:32:21.118836+0000","last_peered":"2024-04-23T18:32:21.118836+0000","last_clean":"2024-04-23T18:32:21.118836+0000","last_became_active":"2024-04-23T18:29:11.498708+0000","last_became_peered":"2024-04-23T18:29:11.498708+0000","last_unstale":"2024-04-23T18:32:21.118836+0000","last_undegraded":"2024-04-23T18:32:21.118836+0000","last_fullsized":"2024-04-23T18:32:21.118836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.005227+0000","last_change":"2024-04-23T18:29:13.494415+0000","last_active":"2024-04-23T18:32:21.005227+0000","last_peered":"2024-04-23T18:32:21.005227+0000","last_clean":"2024-04-23T18:32:21.005227+0000","last_became_active":"2024-04-23T18:29:13.494121+0000","last_became_peered":"2024-04-23T18:29:13.494121+0000","last_unstale":"2024-04-23T18:32:21.005227+0000","last_undegraded":"2024-04-23T18:32:21.005227+0000","last_fullsized":"2024-04-23T18:32:21.005227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.760018+0000","last_change":"2024-04-23T18:29:11.490442+0000","last_active":"2024-04-23T18:31:26.760018+0000","last_peered":"2024-04-23T18:31:26.760018+0000","last_clean":"2024-04-23T18:31:26.760018+0000","last_became_active":"2024-04-23T18:29:11.489671+0000","last_became_peered":"2024-04-23T18:29:11.489671+0000","last_unstale":"2024-04-23T18:31:26.760018+0000","last_undegraded":"2024-04-23T18:31:26.760018+0000","last_fullsized":"2024-04-23T18:31:26.760018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.194194+0000","last_change":"2024-04-23T18:29:13.507705+0000","last_active":"2024-04-23T18:32:21.194194+0000","last_peered":"2024-04-23T18:32:21.194194+0000","last_clean":"2024-04-23T18:32:21.194194+0000","last_became_active":"2024-04-23T18:29:13.507438+0000","last_became_peered":"2024-04-23T18:29:13.507438+0000","last_unstale":"2024-04-23T18:32:21.194194+0000","last_undegraded":"2024-04-23T18:32:21.194194+0000","last_fullsized":"2024-04-23T18:32:21.194194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.876374+0000","last_change":"2024-04-23T18:29:11.511457+0000","last_active":"2024-04-23T18:32:27.876374+0000","last_peered":"2024-04-23T18:32:27.876374+0000","last_clean":"2024-04-23T18:32:27.876374+0000","last_became_active":"2024-04-23T18:29:11.510882+0000","last_became_peered":"2024-04-23T18:29:11.510882+0000","last_unstale":"2024-04-23T18:32:27.876374+0000","last_undegraded":"2024-04-23T18:32:27.876374+0000","last_fullsized":"2024-04-23T18:32:27.876374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.191779+0000","last_change":"2024-04-23T18:29:13.497528+0000","last_active":"2024-04-23T18:32:21.191779+0000","last_peered":"2024-04-23T18:32:21.191779+0000","last_clean":"2024-04-23T18:32:21.191779+0000","last_became_active":"2024-04-23T18:29:13.497271+0000","last_became_peered":"2024-04-23T18:29:13.497271+0000","last_unstale":"2024-04-23T18:32:21.191779+0000","last_undegraded":"2024-04-23T18:32:21.191779+0000","last_fullsized":"2024-04-23T18:32:21.191779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.761149+0000","last_change":"2024-04-23T18:29:11.507084+0000","last_active":"2024-04-23T18:31:26.761149+0000","last_peered":"2024-04-23T18:31:26.761149+0000","last_clean":"2024-04-23T18:31:26.761149+0000","last_became_active":"2024-04-23T18:29:11.506749+0000","last_became_peered":"2024-04-23T18:29:11.506749+0000","last_unstale":"2024-04-23T18:31:26.761149+0000","last_undegraded":"2024-04-23T18:31:26.761149+0000","last_fullsized":"2024-04-23T18:31:26.761149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761764+0000","last_change":"2024-04-23T18:29:13.501439+0000","last_active":"2024-04-23T18:31:31.761764+0000","last_peered":"2024-04-23T18:31:31.761764+0000","last_clean":"2024-04-23T18:31:31.761764+0000","last_became_active":"2024-04-23T18:29:13.501177+0000","last_became_peered":"2024-04-23T18:29:13.501177+0000","last_unstale":"2024-04-23T18:31:31.761764+0000","last_undegraded":"2024-04-23T18:31:31.761764+0000","last_fullsized":"2024-04-23T18:31:31.761764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.877459+0000","last_change":"2024-04-23T18:29:11.485837+0000","last_active":"2024-04-23T18:32:27.877459+0000","last_peered":"2024-04-23T18:32:27.877459+0000","last_clean":"2024-04-23T18:32:27.877459+0000","last_became_active":"2024-04-23T18:29:11.484137+0000","last_became_peered":"2024-04-23T18:29:11.484137+0000","last_unstale":"2024-04-23T18:32:27.877459+0000","last_undegraded":"2024-04-23T18:32:27.877459+0000","last_fullsized":"2024-04-23T18:32:27.877459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.759907+0000","last_change":"2024-04-23T18:29:13.498423+0000","last_active":"2024-04-23T18:31:26.759907+0000","last_peered":"2024-04-23T18:31:26.759907+0000","last_clean":"2024-04-23T18:31:26.759907+0000","last_became_active":"2024-04-23T18:29:13.494034+0000","last_became_peered":"2024-04-23T18:29:13.494034+0000","last_unstale":"2024-04-23T18:31:26.759907+0000","last_undegraded":"2024-04-23T18:31:26.759907+0000","last_fullsized":"2024-04-23T18:31:26.759907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761949+0000","last_change":"2024-04-23T18:29:11.507132+0000","last_active":"2024-04-23T18:31:31.761949+0000","last_peered":"2024-04-23T18:31:31.761949+0000","last_clean":"2024-04-23T18:31:31.761949+0000","last_became_active":"2024-04-23T18:29:11.506801+0000","last_became_peered":"2024-04-23T18:29:11.506801+0000","last_unstale":"2024-04-23T18:31:31.761949+0000","last_undegraded":"2024-04-23T18:31:31.761949+0000","last_fullsized":"2024-04-23T18:31:31.761949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761714+0000","last_change":"2024-04-23T18:29:11.495271+0000","last_active":"2024-04-23T18:31:31.761714+0000","last_peered":"2024-04-23T18:31:31.761714+0000","last_clean":"2024-04-23T18:31:31.761714+0000","last_became_active":"2024-04-23T18:29:11.494891+0000","last_became_peered":"2024-04-23T18:29:11.494891+0000","last_unstale":"2024-04-23T18:31:31.761714+0000","last_undegraded":"2024-04-23T18:31:31.761714+0000","last_fullsized":"2024-04-23T18:31:31.761714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'5","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.269200+0000","last_change":"2024-04-23T18:29:13.495173+0000","last_active":"2024-04-23T18:32:21.269200+0000","last_peered":"2024-04-23T18:32:21.269200+0000","last_clean":"2024-04-23T18:32:21.269200+0000","last_became_active":"2024-04-23T18:29:13.494850+0000","last_became_peered":"2024-04-23T18:29:13.494850+0000","last_unstale":"2024-04-23T18:32:21.269200+0000","last_undegraded":"2024-04-23T18:32:21.269200+0000","last_fullsized":"2024-04-23T18:32:21.269200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.125536+0000","last_change":"2024-04-23T18:29:11.495720+0000","last_active":"2024-04-23T18:32:21.125536+0000","last_peered":"2024-04-23T18:32:21.125536+0000","last_clean":"2024-04-23T18:32:21.125536+0000","last_became_active":"2024-04-23T18:29:11.495173+0000","last_became_peered":"2024-04-23T18:29:11.495173+0000","last_unstale":"2024-04-23T18:32:21.125536+0000","last_undegraded":"2024-04-23T18:32:21.125536+0000","last_fullsized":"2024-04-23T18:32:21.125536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.271746+0000","last_change":"2024-04-23T18:29:13.506361+0000","last_active":"2024-04-23T18:32:21.271746+0000","last_peered":"2024-04-23T18:32:21.271746+0000","last_clean":"2024-04-23T18:32:21.271746+0000","last_became_active":"2024-04-23T18:29:13.506122+0000","last_became_peered":"2024-04-23T18:29:13.506122+0000","last_unstale":"2024-04-23T18:32:21.271746+0000","last_undegraded":"2024-04-23T18:32:21.271746+0000","last_fullsized":"2024-04-23T18:32:21.271746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1487,"ondisk_log_size":1487,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1604,"num_read_kb":1494,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640307,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39968,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331872,"statfs":{"total":96636764160,"available":96595836928,"internally_reserved":0,"allocated":483328,"data_stored":150732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640307,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":738603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640308,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1036288,"data_stored":738249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39928,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331912,"statfs":{"total":96636764160,"available":96595877888,"internally_reserved":0,"allocated":442368,"data_stored":148938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:32:52.881 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.881 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.881 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.881 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.881 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.882 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.882 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.882 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.882 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.882 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.882 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.882 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.882 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.883 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.883 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.883 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.883 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.883 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.883 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.883 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.883 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.883 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.883 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.884 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.884 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.884 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.884 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.884 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.884 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.884 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.884 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.884 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.885 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.885 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.885 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.885 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.885 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.885 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.885 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.886 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.886 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.886 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.886 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.886 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.886 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.886 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.887 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.887 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.887 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.887 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.890 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.890 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.890 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.890 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.890 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.891 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.891 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.891 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.891 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.891 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.891 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.891 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.891 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.891 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.892 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.892 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.892 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.892 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-23T18:28:57.410644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=28, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.892 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.892 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.892 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.892 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.893 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.893 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.893 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.893 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.893 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.893 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.893 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.893 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.894 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.894 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.894 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.894 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.894 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.894 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.894 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.894 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.894 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.895 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.895 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.895 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.895 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.895 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.895 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.896 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.896 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.896 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.896 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.896 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.896 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.897 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.897 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.897 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.897 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.897 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.897 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.897 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.897 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.897 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.898 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.898 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.898 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.898 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.898 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.898 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.898 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.898 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.899 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.899 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.899 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.899 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.899 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.899 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.899 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.899 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.899 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.900 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.900 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.900 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.900 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.900 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.900 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.900 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.900 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.900 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.901 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.901 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.901 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.901 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.901 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.901 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.901 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.901 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.901 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-23T18:29:18.496868+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=18, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.902 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.902 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.902 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.902 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-23T18:29:16.489701+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.902 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.902 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.902 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.902 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.902 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.902 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.903 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.903 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.903 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.903 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.903 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.903 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.903 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.903 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.903 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.903 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.904 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.904 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.904 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.904 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.904 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.904 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.904 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.904 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.904 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.905 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.905 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.905 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.905 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.905 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.905 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.905 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.905 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.905 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.905 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.906 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.906 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:32:52.906 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T18:33:12.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:33:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.027+0000 7ff5f1367640 1 Processor -- start 2024-04-23T18:33:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.027+0000 7ff5f1367640 1 -- start start 2024-04-23T18:33:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.027+0000 7ff5f1367640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff5ec12e920 0x7ff5ec130d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:33:13.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.027+0000 7ff5f1367640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5ec096500 con 0x7ff5ec1284a0 2024-04-23T18:33:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.027+0000 7ff5f1367640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ff5ec128050 con 0x7ff5ec12e920 2024-04-23T18:33:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.028+0000 7ff5e3fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff5ec12e920 0x7ff5ec130d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:33:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.028+0000 7ff5eaffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff5ec1284a0 0x7ff5ec128880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49724/0 (socket says 172.21.15.62:49724) 2024-04-23T18:33:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.028+0000 7ff5eaffd640 1 -- 172.21.15.62:0/4038688583 learned_addr learned my addr 172.21.15.62:0/4038688583 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:33:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.028+0000 7ff5e3fff640 1 -- 172.21.15.62:0/4038688583 >> v1:172.21.15.62:6789/0 conn(0x7ff5ec1284a0 legacy=0x7ff5ec128880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:33:13.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.028+0000 7ff5e3fff640 1 -- 172.21.15.62:0/4038688583 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ec128f90 con 0x7ff5ec12e920 2024-04-23T18:33:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.029+0000 7ff5e3fff640 1 --2- 172.21.15.62:0/4038688583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ec12e920 0x7ff5ec130d10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4009720 tx=0x7ff5d402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d23386d320f1a2a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:33:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.029+0000 7ff5ea7fc640 1 -- 172.21.15.62:0/4038688583 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5d40316d0 con 0x7ff5ec12e920 2024-04-23T18:33:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.029+0000 7ff5ea7fc640 1 -- 172.21.15.62:0/4038688583 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d4037070 con 0x7ff5ec12e920 2024-04-23T18:33:13.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.029+0000 7ff5ea7fc640 1 -- 172.21.15.62:0/4038688583 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5d40319c0 con 0x7ff5ec12e920 2024-04-23T18:33:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.029+0000 7ff5f1367640 1 -- 172.21.15.62:0/4038688583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ec12e920 msgr2=0x7ff5ec130d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:33:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.029+0000 7ff5f1367640 1 --2- 172.21.15.62:0/4038688583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ec12e920 0x7ff5ec130d10 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4009720 tx=0x7ff5d402b840 comp rx=0 tx=0).stop 2024-04-23T18:33:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.029+0000 7ff5f1367640 1 -- 172.21.15.62:0/4038688583 shutdown_connections 2024-04-23T18:33:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.029+0000 7ff5f1367640 1 --2- 172.21.15.62:0/4038688583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ec12e920 0x7ff5ec130d10 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:33:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.029+0000 7ff5f1367640 1 -- 172.21.15.62:0/4038688583 >> 172.21.15.62:0/4038688583 conn(0x7ff5ec099d70 msgr2=0x7ff5ec097640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:33:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.030+0000 7ff5f1367640 1 -- 172.21.15.62:0/4038688583 shutdown_connections 2024-04-23T18:33:13.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.030+0000 7ff5f1367640 1 -- 172.21.15.62:0/4038688583 wait complete. 2024-04-23T18:33:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.030+0000 7ff5f1367640 1 Processor -- start 2024-04-23T18:33:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.030+0000 7ff5f1367640 1 -- start start 2024-04-23T18:33:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.031+0000 7ff5f1367640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ec1284a0 0x7ff5ec1bcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:33:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.031+0000 7ff5f1367640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec097040 con 0x7ff5ec1284a0 2024-04-23T18:33:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.031+0000 7ff5eaffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ec1284a0 0x7ff5ec1bcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:33:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.031+0000 7ff5eaffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ec1284a0 0x7ff5ec1bcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42844/0 (socket says 172.21.15.62:42844) 2024-04-23T18:33:13.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.031+0000 7ff5eaffd640 1 -- 172.21.15.62:0/1484896149 learned_addr learned my addr 172.21.15.62:0/1484896149 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:33:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.031+0000 7ff5eaffd640 1 -- 172.21.15.62:0/1484896149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ec06e880 con 0x7ff5ec1284a0 2024-04-23T18:33:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.031+0000 7ff5eaffd640 1 --2- 172.21.15.62:0/1484896149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ec1284a0 0x7ff5ec1bcf30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00c480 tx=0x7ff5dc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:33:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.031+0000 7ff5e37fe640 1 -- 172.21.15.62:0/1484896149 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5dc017070 con 0x7ff5ec1284a0 2024-04-23T18:33:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.031+0000 7ff5e37fe640 1 -- 172.21.15.62:0/1484896149 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5dc005c10 con 0x7ff5ec1284a0 2024-04-23T18:33:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.031+0000 7ff5e37fe640 1 -- 172.21.15.62:0/1484896149 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5dc0070d0 con 0x7ff5ec1284a0 2024-04-23T18:33:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.031+0000 7ff5f1367640 1 -- 172.21.15.62:0/1484896149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5ec06f880 con 0x7ff5ec1284a0 2024-04-23T18:33:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.031+0000 7ff5f1367640 1 -- 172.21.15.62:0/1484896149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5ec06fcc0 con 0x7ff5ec1284a0 2024-04-23T18:33:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.032+0000 7ff5e37fe640 1 -- 172.21.15.62:0/1484896149 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7ff5dc01a070 con 0x7ff5ec1284a0 2024-04-23T18:33:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.033+0000 7ff5e37fe640 1 --2- 172.21.15.62:0/1484896149 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff5cc0385c0 0x7ff5cc03aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:33:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.033+0000 7ff5f1367640 1 -- 172.21.15.62:0/1484896149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5ec0505b0 con 0x7ff5ec1284a0 2024-04-23T18:33:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.033+0000 7ff5e37fe640 1 -- 172.21.15.62:0/1484896149 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7ff5dc04b3b0 con 0x7ff5ec1284a0 2024-04-23T18:33:13.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.033+0000 7ff5e3fff640 1 --2- 172.21.15.62:0/1484896149 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff5cc0385c0 0x7ff5cc03aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:33:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.033+0000 7ff5e3fff640 1 --2- 172.21.15.62:0/1484896149 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff5cc0385c0 0x7ff5cc03aa80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4036000 tx=0x7ff5d4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:33:13.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.037+0000 7ff5e37fe640 1 -- 172.21.15.62:0/1484896149 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff5dc007270 con 0x7ff5ec1284a0 2024-04-23T18:33:13.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.221+0000 7ff5f1367640 1 -- 172.21.15.62:0/1484896149 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5ec06bae0 con 0x7ff5cc0385c0 2024-04-23T18:33:13.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.236+0000 7ff5e37fe640 1 -- 172.21.15.62:0/1484896149 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661968 (secure 0 0 0) 0x7ff5ec06bae0 con 0x7ff5cc0385c0 2024-04-23T18:33:13.236 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:33:13.242 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-04-23T18:33:13.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.240+0000 7ff5f1367640 1 -- 172.21.15.62:0/1484896149 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff5cc0385c0 msgr2=0x7ff5cc03aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:33:13.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.240+0000 7ff5f1367640 1 --2- 172.21.15.62:0/1484896149 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff5cc0385c0 0x7ff5cc03aa80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4036000 tx=0x7ff5d4008030 comp rx=0 tx=0).stop 2024-04-23T18:33:13.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.240+0000 7ff5f1367640 1 -- 172.21.15.62:0/1484896149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ec1284a0 msgr2=0x7ff5ec1bcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:33:13.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.240+0000 7ff5f1367640 1 --2- 172.21.15.62:0/1484896149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ec1284a0 0x7ff5ec1bcf30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00c480 tx=0x7ff5dc00c940 comp rx=0 tx=0).stop 2024-04-23T18:33:13.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.241+0000 7ff5f1367640 1 -- 172.21.15.62:0/1484896149 shutdown_connections 2024-04-23T18:33:13.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.241+0000 7ff5f1367640 1 --2- 172.21.15.62:0/1484896149 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7ff5cc0385c0 0x7ff5cc03aa80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:33:13.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.241+0000 7ff5f1367640 1 --2- 172.21.15.62:0/1484896149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5ec1284a0 0x7ff5ec1bcf30 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:33:13.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.241+0000 7ff5f1367640 1 -- 172.21.15.62:0/1484896149 >> 172.21.15.62:0/1484896149 conn(0x7ff5ec099d70 msgr2=0x7ff5ec1b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:33:13.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.241+0000 7ff5f1367640 1 -- 172.21.15.62:0/1484896149 shutdown_connections 2024-04-23T18:33:13.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:13.241+0000 7ff5f1367640 1 -- 172.21.15.62:0/1484896149 wait complete. 2024-04-23T18:33:13.245 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-04-23T18:33:12.758194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5092,"num_read_kb":4673,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4772,"ondisk_log_size":4772,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156728,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330632,"statfs":{"total":386547056640,"available":386386567168,"internally_reserved":0,"allocated":2973696,"data_stored":1776522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":157476631},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1664,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004283"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.427969+0000","last_change":"2024-04-23T18:33:04.427995+0000","last_active":"2024-04-23T18:33:04.427969+0000","last_peered":"2024-04-23T18:33:04.427969+0000","last_clean":"2024-04-23T18:33:04.427969+0000","last_became_active":"2024-04-23T18:29:11.495610+0000","last_became_peered":"2024-04-23T18:29:11.495610+0000","last_unstale":"2024-04-23T18:33:04.427969+0000","last_undegraded":"2024-04-23T18:33:04.427969+0000","last_fullsized":"2024-04-23T18:33:04.427969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:04.427875+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:04.427875+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.427875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:27:47.245561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.888297+0000","last_change":"2024-04-23T18:33:02.888343+0000","last_active":"2024-04-23T18:33:02.888297+0000","last_peered":"2024-04-23T18:33:02.888297+0000","last_clean":"2024-04-23T18:33:02.888297+0000","last_became_active":"2024-04-23T18:29:13.492771+0000","last_became_peered":"2024-04-23T18:29:13.492771+0000","last_unstale":"2024-04-23T18:33:02.888297+0000","last_undegraded":"2024-04-23T18:33:02.888297+0000","last_fullsized":"2024-04-23T18:33:02.888297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:02.888182+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:02.888182+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.888182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:35.983458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.220938+0000","last_change":"2024-04-23T18:33:05.220961+0000","last_active":"2024-04-23T18:33:05.220938+0000","last_peered":"2024-04-23T18:33:05.220938+0000","last_clean":"2024-04-23T18:33:05.220938+0000","last_became_active":"2024-04-23T18:29:11.495272+0000","last_became_peered":"2024-04-23T18:29:11.495272+0000","last_unstale":"2024-04-23T18:33:05.220938+0000","last_undegraded":"2024-04-23T18:33:05.220938+0000","last_fullsized":"2024-04-23T18:33:05.220938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:05.220836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:05.220836+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.220836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:05.041452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'9","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.268862+0000","last_change":"2024-04-23T18:29:13.495212+0000","last_active":"2024-04-23T18:32:21.268862+0000","last_peered":"2024-04-23T18:32:21.268862+0000","last_clean":"2024-04-23T18:32:21.268862+0000","last_became_active":"2024-04-23T18:29:13.494969+0000","last_became_peered":"2024-04-23T18:29:13.494969+0000","last_unstale":"2024-04-23T18:32:21.268862+0000","last_undegraded":"2024-04-23T18:32:21.268862+0000","last_fullsized":"2024-04-23T18:32:21.268862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.886618+0000","last_change":"2024-04-23T18:29:11.505594+0000","last_active":"2024-04-23T18:32:20.886618+0000","last_peered":"2024-04-23T18:32:20.886618+0000","last_clean":"2024-04-23T18:32:20.886618+0000","last_became_active":"2024-04-23T18:29:11.505283+0000","last_became_peered":"2024-04-23T18:29:11.505283+0000","last_unstale":"2024-04-23T18:32:20.886618+0000","last_undegraded":"2024-04-23T18:32:20.886618+0000","last_fullsized":"2024-04-23T18:32:20.886618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.764053+0000","last_change":"2024-04-23T18:29:13.495612+0000","last_active":"2024-04-23T18:31:46.764053+0000","last_peered":"2024-04-23T18:31:46.764053+0000","last_clean":"2024-04-23T18:31:46.764053+0000","last_became_active":"2024-04-23T18:29:13.495367+0000","last_became_peered":"2024-04-23T18:29:13.495367+0000","last_unstale":"2024-04-23T18:31:46.764053+0000","last_undegraded":"2024-04-23T18:31:46.764053+0000","last_fullsized":"2024-04-23T18:31:46.764053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.345316+0000","last_change":"2024-04-23T18:33:02.345316+0000","last_active":"2024-04-23T18:33:02.345316+0000","last_peered":"2024-04-23T18:33:02.345316+0000","last_clean":"2024-04-23T18:33:02.345316+0000","last_became_active":"2024-04-23T18:29:11.495677+0000","last_became_peered":"2024-04-23T18:29:11.495677+0000","last_unstale":"2024-04-23T18:33:02.345316+0000","last_undegraded":"2024-04-23T18:33:02.345316+0000","last_fullsized":"2024-04-23T18:33:02.345316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:02.345200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:02.345200+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.345200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:21.009871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.767585+0000","last_change":"2024-04-23T18:29:52.558192+0000","last_active":"2024-04-23T18:32:21.767585+0000","last_peered":"2024-04-23T18:32:21.767585+0000","last_clean":"2024-04-23T18:32:21.767585+0000","last_became_active":"2024-04-23T18:29:52.548291+0000","last_became_peered":"2024-04-23T18:29:52.548291+0000","last_unstale":"2024-04-23T18:32:21.767585+0000","last_undegraded":"2024-04-23T18:32:21.767585+0000","last_fullsized":"2024-04-23T18:32:21.767585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763341+0000","last_change":"2024-04-23T18:29:11.504896+0000","last_active":"2024-04-23T18:31:41.763341+0000","last_peered":"2024-04-23T18:31:41.763341+0000","last_clean":"2024-04-23T18:31:41.763341+0000","last_became_active":"2024-04-23T18:29:11.504554+0000","last_became_peered":"2024-04-23T18:29:11.504554+0000","last_unstale":"2024-04-23T18:31:41.763341+0000","last_undegraded":"2024-04-23T18:31:41.763341+0000","last_fullsized":"2024-04-23T18:31:41.763341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.271391+0000","last_change":"2024-04-23T18:29:13.498634+0000","last_active":"2024-04-23T18:32:21.271391+0000","last_peered":"2024-04-23T18:32:21.271391+0000","last_clean":"2024-04-23T18:32:21.271391+0000","last_became_active":"2024-04-23T18:29:13.498378+0000","last_became_peered":"2024-04-23T18:29:13.498378+0000","last_unstale":"2024-04-23T18:32:21.271391+0000","last_undegraded":"2024-04-23T18:32:21.271391+0000","last_fullsized":"2024-04-23T18:32:21.271391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.354760+0000","last_change":"2024-04-23T18:32:58.354787+0000","last_active":"2024-04-23T18:32:58.354760+0000","last_peered":"2024-04-23T18:32:58.354760+0000","last_clean":"2024-04-23T18:32:58.354760+0000","last_became_active":"2024-04-23T18:29:11.496923+0000","last_became_peered":"2024-04-23T18:29:11.496923+0000","last_unstale":"2024-04-23T18:32:58.354760+0000","last_undegraded":"2024-04-23T18:32:58.354760+0000","last_fullsized":"2024-04-23T18:32:58.354760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:58.354674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:58.354674+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.354674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:20.236974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.469149+0000","last_change":"2024-04-23T18:32:49.469206+0000","last_active":"2024-04-23T18:32:49.469149+0000","last_peered":"2024-04-23T18:32:49.469149+0000","last_clean":"2024-04-23T18:32:49.469149+0000","last_became_active":"2024-04-23T18:29:13.502401+0000","last_became_peered":"2024-04-23T18:29:13.502401+0000","last_unstale":"2024-04-23T18:32:49.469149+0000","last_undegraded":"2024-04-23T18:32:49.469149+0000","last_fullsized":"2024-04-23T18:32:49.469149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:49.469055+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:49.469055+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.469055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:49:26.457594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.130109+0000","last_change":"2024-04-23T18:29:11.500102+0000","last_active":"2024-04-23T18:32:21.130109+0000","last_peered":"2024-04-23T18:32:21.130109+0000","last_clean":"2024-04-23T18:32:21.130109+0000","last_became_active":"2024-04-23T18:29:11.499772+0000","last_became_peered":"2024-04-23T18:29:11.499772+0000","last_unstale":"2024-04-23T18:32:21.130109+0000","last_undegraded":"2024-04-23T18:32:21.130109+0000","last_fullsized":"2024-04-23T18:32:21.130109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.372431+0000","last_change":"2024-04-23T18:32:57.372456+0000","last_active":"2024-04-23T18:32:57.372431+0000","last_peered":"2024-04-23T18:32:57.372431+0000","last_clean":"2024-04-23T18:32:57.372431+0000","last_became_active":"2024-04-23T18:29:13.498965+0000","last_became_peered":"2024-04-23T18:29:13.498965+0000","last_unstale":"2024-04-23T18:32:57.372431+0000","last_undegraded":"2024-04-23T18:32:57.372431+0000","last_fullsized":"2024-04-23T18:32:57.372431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:57.372339+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:57.372339+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.372339+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:21.784067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:44.760213+0000","last_change":"2024-04-23T18:29:11.493089+0000","last_active":"2024-04-23T18:31:44.760213+0000","last_peered":"2024-04-23T18:31:44.760213+0000","last_clean":"2024-04-23T18:31:44.760213+0000","last_became_active":"2024-04-23T18:29:11.491840+0000","last_became_peered":"2024-04-23T18:29:11.491840+0000","last_unstale":"2024-04-23T18:31:44.760213+0000","last_undegraded":"2024-04-23T18:31:44.760213+0000","last_fullsized":"2024-04-23T18:31:44.760213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.481113+0000","last_change":"2024-04-23T18:32:54.481145+0000","last_active":"2024-04-23T18:32:54.481113+0000","last_peered":"2024-04-23T18:32:54.481113+0000","last_clean":"2024-04-23T18:32:54.481113+0000","last_became_active":"2024-04-23T18:29:13.505348+0000","last_became_peered":"2024-04-23T18:29:13.505348+0000","last_unstale":"2024-04-23T18:32:54.481113+0000","last_undegraded":"2024-04-23T18:32:54.481113+0000","last_fullsized":"2024-04-23T18:32:54.481113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:54.481024+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:54.481024+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.481024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:53.099891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762505+0000","last_change":"2024-04-23T18:29:13.495619+0000","last_active":"2024-04-23T18:31:36.762505+0000","last_peered":"2024-04-23T18:31:36.762505+0000","last_clean":"2024-04-23T18:31:36.762505+0000","last_became_active":"2024-04-23T18:29:13.495337+0000","last_became_peered":"2024-04-23T18:29:13.495337+0000","last_unstale":"2024-04-23T18:31:36.762505+0000","last_undegraded":"2024-04-23T18:31:36.762505+0000","last_fullsized":"2024-04-23T18:31:36.762505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.931167+0000","last_change":"2024-04-23T18:33:08.931210+0000","last_active":"2024-04-23T18:33:08.931167+0000","last_peered":"2024-04-23T18:33:08.931167+0000","last_clean":"2024-04-23T18:33:08.931167+0000","last_became_active":"2024-04-23T18:29:11.501773+0000","last_became_peered":"2024-04-23T18:29:11.501773+0000","last_unstale":"2024-04-23T18:33:08.931167+0000","last_undegraded":"2024-04-23T18:33:08.931167+0000","last_fullsized":"2024-04-23T18:33:08.931167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:08.931040+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:08.931040+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.931040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:44.004243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.887546+0000","last_change":"2024-04-23T18:33:04.887572+0000","last_active":"2024-04-23T18:33:04.887546+0000","last_peered":"2024-04-23T18:33:04.887546+0000","last_clean":"2024-04-23T18:33:04.887546+0000","last_became_active":"2024-04-23T18:29:13.492366+0000","last_became_peered":"2024-04-23T18:29:13.492366+0000","last_unstale":"2024-04-23T18:33:04.887546+0000","last_undegraded":"2024-04-23T18:33:04.887546+0000","last_fullsized":"2024-04-23T18:33:04.887546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:04.887454+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:04.887454+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.887454+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:41.190483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.372844+0000","last_change":"2024-04-23T18:33:10.372871+0000","last_active":"2024-04-23T18:33:10.372844+0000","last_peered":"2024-04-23T18:33:10.372844+0000","last_clean":"2024-04-23T18:33:10.372844+0000","last_became_active":"2024-04-23T18:29:11.484620+0000","last_became_peered":"2024-04-23T18:29:11.484620+0000","last_unstale":"2024-04-23T18:33:10.372844+0000","last_undegraded":"2024-04-23T18:33:10.372844+0000","last_fullsized":"2024-04-23T18:33:10.372844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:10.372753+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:10.372753+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.372753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:43.468029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'16","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.898340+0000","last_change":"2024-04-23T18:33:07.898374+0000","last_active":"2024-04-23T18:33:07.898340+0000","last_peered":"2024-04-23T18:33:07.898340+0000","last_clean":"2024-04-23T18:33:07.898340+0000","last_became_active":"2024-04-23T18:29:13.495743+0000","last_became_peered":"2024-04-23T18:29:13.495743+0000","last_unstale":"2024-04-23T18:33:07.898340+0000","last_undegraded":"2024-04-23T18:33:07.898340+0000","last_fullsized":"2024-04-23T18:33:07.898340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:33:07.898227+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:33:07.898227+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.898227+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:29.453739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761616+0000","last_change":"2024-04-23T18:29:11.494610+0000","last_active":"2024-04-23T18:31:36.761616+0000","last_peered":"2024-04-23T18:31:36.761616+0000","last_clean":"2024-04-23T18:31:36.761616+0000","last_became_active":"2024-04-23T18:29:11.493363+0000","last_became_peered":"2024-04-23T18:29:11.493363+0000","last_unstale":"2024-04-23T18:31:36.761616+0000","last_undegraded":"2024-04-23T18:31:36.761616+0000","last_fullsized":"2024-04-23T18:31:36.761616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.223224+0000","last_change":"2024-04-23T18:33:01.223252+0000","last_active":"2024-04-23T18:33:01.223224+0000","last_peered":"2024-04-23T18:33:01.223224+0000","last_clean":"2024-04-23T18:33:01.223224+0000","last_became_active":"2024-04-23T18:29:13.501988+0000","last_became_peered":"2024-04-23T18:29:13.501988+0000","last_unstale":"2024-04-23T18:33:01.223224+0000","last_undegraded":"2024-04-23T18:33:01.223224+0000","last_fullsized":"2024-04-23T18:33:01.223224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:01.223122+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:01.223122+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.223122+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:46:24.673897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.881786+0000","last_change":"2024-04-23T18:33:06.881811+0000","last_active":"2024-04-23T18:33:06.881786+0000","last_peered":"2024-04-23T18:33:06.881786+0000","last_clean":"2024-04-23T18:33:06.881786+0000","last_became_active":"2024-04-23T18:29:11.502714+0000","last_became_peered":"2024-04-23T18:29:11.502714+0000","last_unstale":"2024-04-23T18:33:06.881786+0000","last_undegraded":"2024-04-23T18:33:06.881786+0000","last_fullsized":"2024-04-23T18:33:06.881786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:06.881695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:06.881695+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.881695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:02:23.976616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.408456+0000","last_change":"2024-04-23T18:32:56.408483+0000","last_active":"2024-04-23T18:32:56.408456+0000","last_peered":"2024-04-23T18:32:56.408456+0000","last_clean":"2024-04-23T18:32:56.408456+0000","last_became_active":"2024-04-23T18:29:13.498488+0000","last_became_peered":"2024-04-23T18:29:13.498488+0000","last_unstale":"2024-04-23T18:32:56.408456+0000","last_undegraded":"2024-04-23T18:32:56.408456+0000","last_fullsized":"2024-04-23T18:32:56.408456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:56.408370+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:56.408370+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.408370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:50:09.569283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759612+0000","last_change":"2024-04-23T18:29:11.495476+0000","last_active":"2024-04-23T18:31:39.759612+0000","last_peered":"2024-04-23T18:31:39.759612+0000","last_clean":"2024-04-23T18:31:39.759612+0000","last_became_active":"2024-04-23T18:29:11.495025+0000","last_became_peered":"2024-04-23T18:29:11.495025+0000","last_unstale":"2024-04-23T18:31:39.759612+0000","last_undegraded":"2024-04-23T18:31:39.759612+0000","last_fullsized":"2024-04-23T18:31:39.759612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.905112+0000","last_change":"2024-04-23T18:33:01.905141+0000","last_active":"2024-04-23T18:33:01.905112+0000","last_peered":"2024-04-23T18:33:01.905112+0000","last_clean":"2024-04-23T18:33:01.905112+0000","last_became_active":"2024-04-23T18:29:13.494080+0000","last_became_peered":"2024-04-23T18:29:13.494080+0000","last_unstale":"2024-04-23T18:33:01.905112+0000","last_undegraded":"2024-04-23T18:33:01.905112+0000","last_fullsized":"2024-04-23T18:33:01.905112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:01.905014+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:01.905014+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.905014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:34.294317+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761789+0000","last_change":"2024-04-23T18:29:11.507699+0000","last_active":"2024-04-23T18:31:31.761789+0000","last_peered":"2024-04-23T18:31:31.761789+0000","last_clean":"2024-04-23T18:31:31.761789+0000","last_became_active":"2024-04-23T18:29:11.507336+0000","last_became_peered":"2024-04-23T18:29:11.507336+0000","last_unstale":"2024-04-23T18:31:31.761789+0000","last_undegraded":"2024-04-23T18:31:31.761789+0000","last_fullsized":"2024-04-23T18:31:31.761789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'38","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.906998+0000","last_change":"2024-04-23T18:32:55.907029+0000","last_active":"2024-04-23T18:32:55.906998+0000","last_peered":"2024-04-23T18:32:55.906998+0000","last_clean":"2024-04-23T18:32:55.906998+0000","last_became_active":"2024-04-23T18:29:21.529771+0000","last_became_peered":"2024-04-23T18:29:21.529771+0000","last_unstale":"2024-04-23T18:32:55.906998+0000","last_undegraded":"2024-04-23T18:32:55.906998+0000","last_fullsized":"2024-04-23T18:32:55.906998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-04-23T18:32:55.906902+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-04-23T18:32:55.906902+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.906902+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:18.086470+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'22","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223515+0000","last_change":"2024-04-23T18:29:52.561113+0000","last_active":"2024-04-23T18:32:21.223515+0000","last_peered":"2024-04-23T18:32:21.223515+0000","last_clean":"2024-04-23T18:32:21.223515+0000","last_became_active":"2024-04-23T18:29:52.549641+0000","last_became_peered":"2024-04-23T18:29:52.549641+0000","last_unstale":"2024-04-23T18:32:21.223515+0000","last_undegraded":"2024-04-23T18:32:21.223515+0000","last_fullsized":"2024-04-23T18:32:21.223515+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":69,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.877671+0000","last_change":"2024-04-23T18:29:11.512384+0000","last_active":"2024-04-23T18:32:27.877671+0000","last_peered":"2024-04-23T18:32:27.877671+0000","last_clean":"2024-04-23T18:32:27.877671+0000","last_became_active":"2024-04-23T18:29:11.512062+0000","last_became_peered":"2024-04-23T18:29:11.512062+0000","last_unstale":"2024-04-23T18:32:27.877671+0000","last_undegraded":"2024-04-23T18:32:27.877671+0000","last_fullsized":"2024-04-23T18:32:27.877671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.393499+0000","last_change":"2024-04-23T18:32:36.393525+0000","last_active":"2024-04-23T18:32:36.393499+0000","last_peered":"2024-04-23T18:32:36.393499+0000","last_clean":"2024-04-23T18:32:36.393499+0000","last_became_active":"2024-04-23T18:29:15.508100+0000","last_became_peered":"2024-04-23T18:29:15.508100+0000","last_unstale":"2024-04-23T18:32:36.393499+0000","last_undegraded":"2024-04-23T18:32:36.393499+0000","last_fullsized":"2024-04-23T18:32:36.393499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.393398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.393398+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.393398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:14.247382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.399695+0000","last_change":"2024-04-23T18:32:43.399750+0000","last_active":"2024-04-23T18:32:43.399695+0000","last_peered":"2024-04-23T18:32:43.399695+0000","last_clean":"2024-04-23T18:32:43.399695+0000","last_became_active":"2024-04-23T18:29:17.513368+0000","last_became_peered":"2024-04-23T18:29:17.513368+0000","last_unstale":"2024-04-23T18:32:43.399695+0000","last_undegraded":"2024-04-23T18:32:43.399695+0000","last_fullsized":"2024-04-23T18:32:43.399695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:43.399581+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:43.399581+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.399581+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:04.955093+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.915356+0000","last_change":"2024-04-23T18:32:35.915380+0000","last_active":"2024-04-23T18:32:35.915356+0000","last_peered":"2024-04-23T18:32:35.915356+0000","last_clean":"2024-04-23T18:32:35.915356+0000","last_became_active":"2024-04-23T18:29:19.520066+0000","last_became_peered":"2024-04-23T18:29:19.520066+0000","last_unstale":"2024-04-23T18:32:35.915356+0000","last_undegraded":"2024-04-23T18:32:35.915356+0000","last_fullsized":"2024-04-23T18:32:35.915356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.915263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.915263+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.915263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:33.026516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.878515+0000","last_change":"2024-04-23T18:32:51.878542+0000","last_active":"2024-04-23T18:32:51.878515+0000","last_peered":"2024-04-23T18:32:51.878515+0000","last_clean":"2024-04-23T18:32:51.878515+0000","last_became_active":"2024-04-23T18:29:21.529743+0000","last_became_peered":"2024-04-23T18:29:21.529743+0000","last_unstale":"2024-04-23T18:32:51.878515+0000","last_undegraded":"2024-04-23T18:32:51.878515+0000","last_fullsized":"2024-04-23T18:32:51.878515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-23T18:32:51.878417+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-23T18:32:51.878417+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.878417+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:39.785762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.444752+0000","last_change":"2024-04-23T18:33:10.444793+0000","last_active":"2024-04-23T18:33:10.444752+0000","last_peered":"2024-04-23T18:33:10.444752+0000","last_clean":"2024-04-23T18:33:10.444752+0000","last_became_active":"2024-04-23T18:29:13.496299+0000","last_became_peered":"2024-04-23T18:29:13.496299+0000","last_unstale":"2024-04-23T18:33:10.444752+0000","last_undegraded":"2024-04-23T18:33:10.444752+0000","last_fullsized":"2024-04-23T18:33:10.444752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:10.444658+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:10.444658+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.444658+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:35:16.256466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.324567+0000","last_change":"2024-04-23T18:33:00.324598+0000","last_active":"2024-04-23T18:33:00.324567+0000","last_peered":"2024-04-23T18:33:00.324567+0000","last_clean":"2024-04-23T18:33:00.324567+0000","last_became_active":"2024-04-23T18:29:11.496878+0000","last_became_peered":"2024-04-23T18:29:11.496878+0000","last_unstale":"2024-04-23T18:33:00.324567+0000","last_undegraded":"2024-04-23T18:33:00.324567+0000","last_fullsized":"2024-04-23T18:33:00.324567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:00.324482+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:00.324482+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.324482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:37:16.117012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.219481+0000","last_change":"2024-04-23T18:32:55.219506+0000","last_active":"2024-04-23T18:32:55.219481+0000","last_peered":"2024-04-23T18:32:55.219481+0000","last_clean":"2024-04-23T18:32:55.219481+0000","last_became_active":"2024-04-23T18:29:15.504744+0000","last_became_peered":"2024-04-23T18:29:15.504744+0000","last_unstale":"2024-04-23T18:32:55.219481+0000","last_undegraded":"2024-04-23T18:32:55.219481+0000","last_fullsized":"2024-04-23T18:32:55.219481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:55.219376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:55.219376+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.219376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:01:48.896771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.884623+0000","last_change":"2024-04-23T18:32:37.884678+0000","last_active":"2024-04-23T18:32:37.884623+0000","last_peered":"2024-04-23T18:32:37.884623+0000","last_clean":"2024-04-23T18:32:37.884623+0000","last_became_active":"2024-04-23T18:29:17.510201+0000","last_became_peered":"2024-04-23T18:29:17.510201+0000","last_unstale":"2024-04-23T18:32:37.884623+0000","last_undegraded":"2024-04-23T18:32:37.884623+0000","last_fullsized":"2024-04-23T18:32:37.884623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-23T18:32:37.884529+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-23T18:32:37.884529+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.884529+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.954621+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.869790+0000","last_change":"2024-04-23T18:32:43.869829+0000","last_active":"2024-04-23T18:32:43.869790+0000","last_peered":"2024-04-23T18:32:43.869790+0000","last_clean":"2024-04-23T18:32:43.869790+0000","last_became_active":"2024-04-23T18:29:19.527770+0000","last_became_peered":"2024-04-23T18:29:19.527770+0000","last_unstale":"2024-04-23T18:32:43.869790+0000","last_undegraded":"2024-04-23T18:32:43.869790+0000","last_fullsized":"2024-04-23T18:32:43.869790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:43.869698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:43.869698+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.869698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:06.080613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.191867+0000","last_change":"2024-04-23T18:33:00.191895+0000","last_active":"2024-04-23T18:33:00.191867+0000","last_peered":"2024-04-23T18:33:00.191867+0000","last_clean":"2024-04-23T18:33:00.191867+0000","last_became_active":"2024-04-23T18:29:21.525940+0000","last_became_peered":"2024-04-23T18:29:21.525940+0000","last_unstale":"2024-04-23T18:33:00.191867+0000","last_undegraded":"2024-04-23T18:33:00.191867+0000","last_fullsized":"2024-04-23T18:33:00.191867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:00.191774+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:00.191774+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.191774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:05:50.166534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.222685+0000","last_change":"2024-04-23T18:29:13.496417+0000","last_active":"2024-04-23T18:32:21.222685+0000","last_peered":"2024-04-23T18:32:21.222685+0000","last_clean":"2024-04-23T18:32:21.222685+0000","last_became_active":"2024-04-23T18:29:13.496142+0000","last_became_peered":"2024-04-23T18:29:13.496142+0000","last_unstale":"2024-04-23T18:32:21.222685+0000","last_undegraded":"2024-04-23T18:32:21.222685+0000","last_fullsized":"2024-04-23T18:32:21.222685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761746+0000","last_change":"2024-04-23T18:29:11.504850+0000","last_active":"2024-04-23T18:31:31.761746+0000","last_peered":"2024-04-23T18:31:31.761746+0000","last_clean":"2024-04-23T18:31:31.761746+0000","last_became_active":"2024-04-23T18:29:11.504534+0000","last_became_peered":"2024-04-23T18:29:11.504534+0000","last_unstale":"2024-04-23T18:31:31.761746+0000","last_undegraded":"2024-04-23T18:31:31.761746+0000","last_fullsized":"2024-04-23T18:31:31.761746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.226403+0000","last_change":"2024-04-23T18:32:51.226428+0000","last_active":"2024-04-23T18:32:51.226403+0000","last_peered":"2024-04-23T18:32:51.226403+0000","last_clean":"2024-04-23T18:32:51.226403+0000","last_became_active":"2024-04-23T18:29:15.510018+0000","last_became_peered":"2024-04-23T18:29:15.510018+0000","last_unstale":"2024-04-23T18:32:51.226403+0000","last_undegraded":"2024-04-23T18:32:51.226403+0000","last_fullsized":"2024-04-23T18:32:51.226403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:51.226310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:51.226310+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.226310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:48.331725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.411781+0000","last_change":"2024-04-23T18:32:39.411841+0000","last_active":"2024-04-23T18:32:39.411781+0000","last_peered":"2024-04-23T18:32:39.411781+0000","last_clean":"2024-04-23T18:32:39.411781+0000","last_became_active":"2024-04-23T18:29:17.517679+0000","last_became_peered":"2024-04-23T18:29:17.517679+0000","last_unstale":"2024-04-23T18:32:39.411781+0000","last_undegraded":"2024-04-23T18:32:39.411781+0000","last_fullsized":"2024-04-23T18:32:39.411781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:32:39.411679+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:32:39.411679+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.411679+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:33:43.011129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":394,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.433045+0000","last_change":"2024-04-23T18:32:59.433088+0000","last_active":"2024-04-23T18:32:59.433045+0000","last_peered":"2024-04-23T18:32:59.433045+0000","last_clean":"2024-04-23T18:32:59.433045+0000","last_became_active":"2024-04-23T18:29:19.522434+0000","last_became_peered":"2024-04-23T18:29:19.522434+0000","last_unstale":"2024-04-23T18:32:59.433045+0000","last_undegraded":"2024-04-23T18:32:59.433045+0000","last_fullsized":"2024-04-23T18:32:59.433045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-04-23T18:32:59.432941+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-04-23T18:32:59.432941+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.432941+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:33.938084+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.484842+0000","last_change":"2024-04-23T18:32:45.484880+0000","last_active":"2024-04-23T18:32:45.484842+0000","last_peered":"2024-04-23T18:32:45.484842+0000","last_clean":"2024-04-23T18:32:45.484842+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:32:45.484842+0000","last_undegraded":"2024-04-23T18:32:45.484842+0000","last_fullsized":"2024-04-23T18:32:45.484842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:45.484750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:45.484750+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.484750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:44.554843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759720+0000","last_change":"2024-04-23T18:29:13.499630+0000","last_active":"2024-04-23T18:31:39.759720+0000","last_peered":"2024-04-23T18:31:39.759720+0000","last_clean":"2024-04-23T18:31:39.759720+0000","last_became_active":"2024-04-23T18:29:13.499248+0000","last_became_peered":"2024-04-23T18:29:13.499248+0000","last_unstale":"2024-04-23T18:31:39.759720+0000","last_undegraded":"2024-04-23T18:31:39.759720+0000","last_fullsized":"2024-04-23T18:31:39.759720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760636+0000","last_change":"2024-04-23T18:29:11.488862+0000","last_active":"2024-04-23T18:31:31.760636+0000","last_peered":"2024-04-23T18:31:31.760636+0000","last_clean":"2024-04-23T18:31:31.760636+0000","last_became_active":"2024-04-23T18:29:11.488531+0000","last_became_peered":"2024-04-23T18:29:11.488531+0000","last_unstale":"2024-04-23T18:31:31.760636+0000","last_undegraded":"2024-04-23T18:31:31.760636+0000","last_fullsized":"2024-04-23T18:31:31.760636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.385497+0000","last_change":"2024-04-23T18:32:33.385539+0000","last_active":"2024-04-23T18:32:33.385497+0000","last_peered":"2024-04-23T18:32:33.385497+0000","last_clean":"2024-04-23T18:32:33.385497+0000","last_became_active":"2024-04-23T18:29:15.511249+0000","last_became_peered":"2024-04-23T18:29:15.511249+0000","last_unstale":"2024-04-23T18:32:33.385497+0000","last_undegraded":"2024-04-23T18:32:33.385497+0000","last_fullsized":"2024-04-23T18:32:33.385497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.385380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.385380+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.385380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:14.265560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.451350+0000","last_change":"2024-04-23T18:32:38.451387+0000","last_active":"2024-04-23T18:32:38.451350+0000","last_peered":"2024-04-23T18:32:38.451350+0000","last_clean":"2024-04-23T18:32:38.451350+0000","last_became_active":"2024-04-23T18:29:17.517964+0000","last_became_peered":"2024-04-23T18:29:17.517964+0000","last_unstale":"2024-04-23T18:32:38.451350+0000","last_undegraded":"2024-04-23T18:32:38.451350+0000","last_fullsized":"2024-04-23T18:32:38.451350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-04-23T18:32:38.451267+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-04-23T18:32:38.451267+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.451267+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:18:00.657607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":453,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.248993+0000","last_change":"2024-04-23T18:32:44.249059+0000","last_active":"2024-04-23T18:32:44.248993+0000","last_peered":"2024-04-23T18:32:44.248993+0000","last_clean":"2024-04-23T18:32:44.248993+0000","last_became_active":"2024-04-23T18:29:19.524881+0000","last_became_peered":"2024-04-23T18:29:19.524881+0000","last_unstale":"2024-04-23T18:32:44.248993+0000","last_undegraded":"2024-04-23T18:32:44.248993+0000","last_fullsized":"2024-04-23T18:32:44.248993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:44.248886+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:44.248886+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.248886+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:27.941657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.427164+0000","last_change":"2024-04-23T18:32:52.427187+0000","last_active":"2024-04-23T18:32:52.427164+0000","last_peered":"2024-04-23T18:32:52.427164+0000","last_clean":"2024-04-23T18:32:52.427164+0000","last_became_active":"2024-04-23T18:29:13.501472+0000","last_became_peered":"2024-04-23T18:29:13.501472+0000","last_unstale":"2024-04-23T18:32:52.427164+0000","last_undegraded":"2024-04-23T18:32:52.427164+0000","last_fullsized":"2024-04-23T18:32:52.427164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:32:52.427080+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:32:52.427080+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.427080+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:43:34.900178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'5","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.759698+0000","last_change":"2024-04-23T18:29:11.483640+0000","last_active":"2024-04-23T18:31:26.759698+0000","last_peered":"2024-04-23T18:31:26.759698+0000","last_clean":"2024-04-23T18:31:26.759698+0000","last_became_active":"2024-04-23T18:29:11.481977+0000","last_became_peered":"2024-04-23T18:29:11.481977+0000","last_unstale":"2024-04-23T18:31:26.759698+0000","last_undegraded":"2024-04-23T18:31:26.759698+0000","last_fullsized":"2024-04-23T18:31:26.759698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.905456+0000","last_change":"2024-04-23T18:32:45.905482+0000","last_active":"2024-04-23T18:32:45.905456+0000","last_peered":"2024-04-23T18:32:45.905456+0000","last_clean":"2024-04-23T18:32:45.905456+0000","last_became_active":"2024-04-23T18:29:15.509711+0000","last_became_peered":"2024-04-23T18:29:15.509711+0000","last_unstale":"2024-04-23T18:32:45.905456+0000","last_undegraded":"2024-04-23T18:32:45.905456+0000","last_fullsized":"2024-04-23T18:32:45.905456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:45.905366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:45.905366+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.905366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:55:07.535829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'51","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.525412+0000","last_change":"2024-04-23T18:32:46.525489+0000","last_active":"2024-04-23T18:32:46.525412+0000","last_peered":"2024-04-23T18:32:46.525412+0000","last_clean":"2024-04-23T18:32:46.525412+0000","last_became_active":"2024-04-23T18:29:17.511085+0000","last_became_peered":"2024-04-23T18:29:17.511085+0000","last_unstale":"2024-04-23T18:32:46.525412+0000","last_undegraded":"2024-04-23T18:32:46.525412+0000","last_fullsized":"2024-04-23T18:32:46.525412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-04-23T18:32:46.525299+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-04-23T18:32:46.525299+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.525299+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:46:11.482573+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.255241+0000","last_change":"2024-04-23T18:32:52.255269+0000","last_active":"2024-04-23T18:32:52.255241+0000","last_peered":"2024-04-23T18:32:52.255241+0000","last_clean":"2024-04-23T18:32:52.255241+0000","last_became_active":"2024-04-23T18:29:19.527505+0000","last_became_peered":"2024-04-23T18:29:19.527505+0000","last_unstale":"2024-04-23T18:32:52.255241+0000","last_undegraded":"2024-04-23T18:32:52.255241+0000","last_fullsized":"2024-04-23T18:32:52.255241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:52.255147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:52.255147+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.255147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:39:47.960787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'13","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.907177+0000","last_change":"2024-04-23T18:29:21.532533+0000","last_active":"2024-04-23T18:32:20.907177+0000","last_peered":"2024-04-23T18:32:20.907177+0000","last_clean":"2024-04-23T18:32:20.907177+0000","last_became_active":"2024-04-23T18:29:21.532163+0000","last_became_peered":"2024-04-23T18:29:21.532163+0000","last_unstale":"2024-04-23T18:32:20.907177+0000","last_undegraded":"2024-04-23T18:32:20.907177+0000","last_fullsized":"2024-04-23T18:32:20.907177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.935085+0000","last_change":"2024-04-23T18:33:03.935115+0000","last_active":"2024-04-23T18:33:03.935085+0000","last_peered":"2024-04-23T18:33:03.935085+0000","last_clean":"2024-04-23T18:33:03.935085+0000","last_became_active":"2024-04-23T18:29:13.494108+0000","last_became_peered":"2024-04-23T18:29:13.494108+0000","last_unstale":"2024-04-23T18:33:03.935085+0000","last_undegraded":"2024-04-23T18:33:03.935085+0000","last_fullsized":"2024-04-23T18:33:03.935085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:03.934976+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:03.934976+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.934976+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:46.714997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.759651+0000","last_change":"2024-04-23T18:29:11.481951+0000","last_active":"2024-04-23T18:31:26.759651+0000","last_peered":"2024-04-23T18:31:26.759651+0000","last_clean":"2024-04-23T18:31:26.759651+0000","last_became_active":"2024-04-23T18:29:11.481419+0000","last_became_peered":"2024-04-23T18:29:11.481419+0000","last_unstale":"2024-04-23T18:31:26.759651+0000","last_undegraded":"2024-04-23T18:31:26.759651+0000","last_fullsized":"2024-04-23T18:31:26.759651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.197779+0000","last_change":"2024-04-23T18:32:49.197825+0000","last_active":"2024-04-23T18:32:49.197779+0000","last_peered":"2024-04-23T18:32:49.197779+0000","last_clean":"2024-04-23T18:32:49.197779+0000","last_became_active":"2024-04-23T18:29:15.510135+0000","last_became_peered":"2024-04-23T18:29:15.510135+0000","last_unstale":"2024-04-23T18:32:49.197779+0000","last_undegraded":"2024-04-23T18:32:49.197779+0000","last_fullsized":"2024-04-23T18:32:49.197779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:49.197658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:49.197658+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.197658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:11:00.797470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.367950+0000","last_change":"2024-04-23T18:32:45.367999+0000","last_active":"2024-04-23T18:32:45.367950+0000","last_peered":"2024-04-23T18:32:45.367950+0000","last_clean":"2024-04-23T18:32:45.367950+0000","last_became_active":"2024-04-23T18:29:17.513447+0000","last_became_peered":"2024-04-23T18:29:17.513447+0000","last_unstale":"2024-04-23T18:32:45.367950+0000","last_undegraded":"2024-04-23T18:32:45.367950+0000","last_fullsized":"2024-04-23T18:32:45.367950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:45.367847+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:45.367847+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.367847+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:39.796664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.422630+0000","last_change":"2024-04-23T18:32:33.422658+0000","last_active":"2024-04-23T18:32:33.422630+0000","last_peered":"2024-04-23T18:32:33.422630+0000","last_clean":"2024-04-23T18:32:33.422630+0000","last_became_active":"2024-04-23T18:29:19.518695+0000","last_became_peered":"2024-04-23T18:29:19.518695+0000","last_unstale":"2024-04-23T18:32:33.422630+0000","last_undegraded":"2024-04-23T18:32:33.422630+0000","last_fullsized":"2024-04-23T18:32:33.422630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.422540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.422540+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.422540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:19.231250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'5","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.196465+0000","last_change":"2024-04-23T18:29:21.533423+0000","last_active":"2024-04-23T18:32:21.196465+0000","last_peered":"2024-04-23T18:32:21.196465+0000","last_clean":"2024-04-23T18:32:21.196465+0000","last_became_active":"2024-04-23T18:29:21.533103+0000","last_became_peered":"2024-04-23T18:29:21.533103+0000","last_unstale":"2024-04-23T18:32:21.196465+0000","last_undegraded":"2024-04-23T18:32:21.196465+0000","last_fullsized":"2024-04-23T18:32:21.196465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.333366+0000","last_change":"2024-04-23T18:33:01.333394+0000","last_active":"2024-04-23T18:33:01.333366+0000","last_peered":"2024-04-23T18:33:01.333366+0000","last_clean":"2024-04-23T18:33:01.333366+0000","last_became_active":"2024-04-23T18:29:13.499795+0000","last_became_peered":"2024-04-23T18:29:13.499795+0000","last_unstale":"2024-04-23T18:33:01.333366+0000","last_undegraded":"2024-04-23T18:33:01.333366+0000","last_fullsized":"2024-04-23T18:33:01.333366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:33:01.333276+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:33:01.333276+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.333276+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:19.961956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.761159+0000","last_change":"2024-04-23T18:29:11.503536+0000","last_active":"2024-04-23T18:31:26.761159+0000","last_peered":"2024-04-23T18:31:26.761159+0000","last_clean":"2024-04-23T18:31:26.761159+0000","last_became_active":"2024-04-23T18:29:11.503228+0000","last_became_peered":"2024-04-23T18:29:11.503228+0000","last_unstale":"2024-04-23T18:31:26.761159+0000","last_undegraded":"2024-04-23T18:31:26.761159+0000","last_fullsized":"2024-04-23T18:31:26.761159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.210465+0000","last_change":"2024-04-23T18:32:50.210518+0000","last_active":"2024-04-23T18:32:50.210465+0000","last_peered":"2024-04-23T18:32:50.210465+0000","last_clean":"2024-04-23T18:32:50.210465+0000","last_became_active":"2024-04-23T18:29:15.509856+0000","last_became_peered":"2024-04-23T18:29:15.509856+0000","last_unstale":"2024-04-23T18:32:50.210465+0000","last_undegraded":"2024-04-23T18:32:50.210465+0000","last_fullsized":"2024-04-23T18:32:50.210465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.210358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.210358+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.210358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:56.040362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'48","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.397592+0000","last_change":"2024-04-23T18:32:56.397630+0000","last_active":"2024-04-23T18:32:56.397592+0000","last_peered":"2024-04-23T18:32:56.397592+0000","last_clean":"2024-04-23T18:32:56.397592+0000","last_became_active":"2024-04-23T18:29:17.517116+0000","last_became_peered":"2024-04-23T18:29:17.517116+0000","last_unstale":"2024-04-23T18:32:56.397592+0000","last_undegraded":"2024-04-23T18:32:56.397592+0000","last_fullsized":"2024-04-23T18:32:56.397592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:56.397494+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:56.397494+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.397494+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:45.517482+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":360,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.373965+0000","last_change":"2024-04-23T18:32:34.374033+0000","last_active":"2024-04-23T18:32:34.373965+0000","last_peered":"2024-04-23T18:32:34.373965+0000","last_clean":"2024-04-23T18:32:34.373965+0000","last_became_active":"2024-04-23T18:29:19.518519+0000","last_became_peered":"2024-04-23T18:29:19.518519+0000","last_unstale":"2024-04-23T18:32:34.373965+0000","last_undegraded":"2024-04-23T18:32:34.373965+0000","last_fullsized":"2024-04-23T18:32:34.373965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:34.373847+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:34.373847+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.373847+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:40:46.115582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:34.758869+0000","last_change":"2024-04-23T18:29:21.529229+0000","last_active":"2024-04-23T18:31:34.758869+0000","last_peered":"2024-04-23T18:31:34.758869+0000","last_clean":"2024-04-23T18:31:34.758869+0000","last_became_active":"2024-04-23T18:29:21.528917+0000","last_became_peered":"2024-04-23T18:29:21.528917+0000","last_unstale":"2024-04-23T18:31:34.758869+0000","last_undegraded":"2024-04-23T18:31:34.758869+0000","last_fullsized":"2024-04-23T18:31:34.758869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.456270+0000","last_change":"2024-04-23T18:32:55.456298+0000","last_active":"2024-04-23T18:32:55.456270+0000","last_peered":"2024-04-23T18:32:55.456270+0000","last_clean":"2024-04-23T18:32:55.456270+0000","last_became_active":"2024-04-23T18:29:13.499216+0000","last_became_peered":"2024-04-23T18:29:13.499216+0000","last_unstale":"2024-04-23T18:32:55.456270+0000","last_undegraded":"2024-04-23T18:32:55.456270+0000","last_fullsized":"2024-04-23T18:32:55.456270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:55.456182+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:55.456182+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.456182+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:19.038136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.761090+0000","last_change":"2024-04-23T18:29:11.511581+0000","last_active":"2024-04-23T18:31:26.761090+0000","last_peered":"2024-04-23T18:31:26.761090+0000","last_clean":"2024-04-23T18:31:26.761090+0000","last_became_active":"2024-04-23T18:29:11.511211+0000","last_became_peered":"2024-04-23T18:29:11.511211+0000","last_unstale":"2024-04-23T18:31:26.761090+0000","last_undegraded":"2024-04-23T18:31:26.761090+0000","last_fullsized":"2024-04-23T18:31:26.761090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.217057+0000","last_change":"2024-04-23T18:32:47.217082+0000","last_active":"2024-04-23T18:32:47.217057+0000","last_peered":"2024-04-23T18:32:47.217057+0000","last_clean":"2024-04-23T18:32:47.217057+0000","last_became_active":"2024-04-23T18:29:15.510350+0000","last_became_peered":"2024-04-23T18:29:15.510350+0000","last_unstale":"2024-04-23T18:32:47.217057+0000","last_undegraded":"2024-04-23T18:32:47.217057+0000","last_fullsized":"2024-04-23T18:32:47.217057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:47.216965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:47.216965+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.216965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:24.954770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'63","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.448578+0000","last_change":"2024-04-23T18:32:51.448618+0000","last_active":"2024-04-23T18:32:51.448578+0000","last_peered":"2024-04-23T18:32:51.448578+0000","last_clean":"2024-04-23T18:32:51.448578+0000","last_became_active":"2024-04-23T18:29:17.513298+0000","last_became_peered":"2024-04-23T18:29:17.513298+0000","last_unstale":"2024-04-23T18:32:51.448578+0000","last_undegraded":"2024-04-23T18:32:51.448578+0000","last_fullsized":"2024-04-23T18:32:51.448578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'63","last_scrub_stamp":"2024-04-23T18:32:51.448483+0000","last_deep_scrub":"34'63","last_deep_scrub_stamp":"2024-04-23T18:32:51.448483+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.448483+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:25.305379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.325801+0000","last_change":"2024-04-23T18:32:35.325849+0000","last_active":"2024-04-23T18:32:35.325801+0000","last_peered":"2024-04-23T18:32:35.325801+0000","last_clean":"2024-04-23T18:32:35.325801+0000","last_became_active":"2024-04-23T18:29:19.518015+0000","last_became_peered":"2024-04-23T18:29:19.518015+0000","last_unstale":"2024-04-23T18:32:35.325801+0000","last_undegraded":"2024-04-23T18:32:35.325801+0000","last_fullsized":"2024-04-23T18:32:35.325801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.325670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.325670+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.325670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:51.615968+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.326108+0000","last_change":"2024-04-23T18:29:21.529718+0000","last_active":"2024-04-23T18:32:21.326108+0000","last_peered":"2024-04-23T18:32:21.326108+0000","last_clean":"2024-04-23T18:32:21.326108+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:32:21.326108+0000","last_undegraded":"2024-04-23T18:32:21.326108+0000","last_fullsized":"2024-04-23T18:32:21.326108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.005904+0000","last_change":"2024-04-23T18:29:52.558115+0000","last_active":"2024-04-23T18:32:21.005904+0000","last_peered":"2024-04-23T18:32:21.005904+0000","last_clean":"2024-04-23T18:32:21.005904+0000","last_became_active":"2024-04-23T18:29:52.550778+0000","last_became_peered":"2024-04-23T18:29:52.550778+0000","last_unstale":"2024-04-23T18:32:21.005904+0000","last_undegraded":"2024-04-23T18:32:21.005904+0000","last_fullsized":"2024-04-23T18:32:21.005904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:29.758156+0000","last_change":"2024-04-23T18:29:11.486362+0000","last_active":"2024-04-23T18:31:29.758156+0000","last_peered":"2024-04-23T18:31:29.758156+0000","last_clean":"2024-04-23T18:31:29.758156+0000","last_became_active":"2024-04-23T18:29:11.485899+0000","last_became_peered":"2024-04-23T18:29:11.485899+0000","last_unstale":"2024-04-23T18:31:29.758156+0000","last_undegraded":"2024-04-23T18:31:29.758156+0000","last_fullsized":"2024-04-23T18:31:29.758156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.488213+0000","last_change":"2024-04-23T18:32:48.488240+0000","last_active":"2024-04-23T18:32:48.488213+0000","last_peered":"2024-04-23T18:32:48.488213+0000","last_clean":"2024-04-23T18:32:48.488213+0000","last_became_active":"2024-04-23T18:29:15.506940+0000","last_became_peered":"2024-04-23T18:29:15.506940+0000","last_unstale":"2024-04-23T18:32:48.488213+0000","last_undegraded":"2024-04-23T18:32:48.488213+0000","last_fullsized":"2024-04-23T18:32:48.488213+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:32:48.488120+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:32:48.488120+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.488120+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:48.524111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.911596+0000","last_change":"2024-04-23T18:32:38.911658+0000","last_active":"2024-04-23T18:32:38.911596+0000","last_peered":"2024-04-23T18:32:38.911596+0000","last_clean":"2024-04-23T18:32:38.911596+0000","last_became_active":"2024-04-23T18:29:17.509586+0000","last_became_peered":"2024-04-23T18:29:17.509586+0000","last_unstale":"2024-04-23T18:32:38.911596+0000","last_undegraded":"2024-04-23T18:32:38.911596+0000","last_fullsized":"2024-04-23T18:32:38.911596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:38.911496+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:38.911496+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.911496+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:46:03.868770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.434020+0000","last_change":"2024-04-23T18:32:53.434051+0000","last_active":"2024-04-23T18:32:53.434020+0000","last_peered":"2024-04-23T18:32:53.434020+0000","last_clean":"2024-04-23T18:32:53.434020+0000","last_became_active":"2024-04-23T18:29:19.521939+0000","last_became_peered":"2024-04-23T18:29:19.521939+0000","last_unstale":"2024-04-23T18:32:53.434020+0000","last_undegraded":"2024-04-23T18:32:53.434020+0000","last_fullsized":"2024-04-23T18:32:53.434020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:53.433929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:53.433929+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.433929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:02.751340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.276509+0000","last_change":"2024-04-23T18:29:21.531398+0000","last_active":"2024-04-23T18:32:21.276509+0000","last_peered":"2024-04-23T18:32:21.276509+0000","last_clean":"2024-04-23T18:32:21.276509+0000","last_became_active":"2024-04-23T18:29:21.530270+0000","last_became_peered":"2024-04-23T18:29:21.530270+0000","last_unstale":"2024-04-23T18:32:21.276509+0000","last_undegraded":"2024-04-23T18:32:21.276509+0000","last_fullsized":"2024-04-23T18:32:21.276509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.397427+0000","last_change":"2024-04-23T18:32:46.397470+0000","last_active":"2024-04-23T18:32:46.397427+0000","last_peered":"2024-04-23T18:32:46.397427+0000","last_clean":"2024-04-23T18:32:46.397427+0000","last_became_active":"2024-04-23T18:29:13.501430+0000","last_became_peered":"2024-04-23T18:29:13.501430+0000","last_unstale":"2024-04-23T18:32:46.397427+0000","last_undegraded":"2024-04-23T18:32:46.397427+0000","last_fullsized":"2024-04-23T18:32:46.397427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:46.397327+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:46.397327+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.397327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:08.260300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760407+0000","last_change":"2024-04-23T18:29:11.507985+0000","last_active":"2024-04-23T18:31:21.760407+0000","last_peered":"2024-04-23T18:31:21.760407+0000","last_clean":"2024-04-23T18:31:21.760407+0000","last_became_active":"2024-04-23T18:29:11.507633+0000","last_became_peered":"2024-04-23T18:29:11.507633+0000","last_unstale":"2024-04-23T18:31:21.760407+0000","last_undegraded":"2024-04-23T18:31:21.760407+0000","last_fullsized":"2024-04-23T18:31:21.760407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.266076+0000","last_change":"2024-04-23T18:32:46.266134+0000","last_active":"2024-04-23T18:32:46.266076+0000","last_peered":"2024-04-23T18:32:46.266076+0000","last_clean":"2024-04-23T18:32:46.266076+0000","last_became_active":"2024-04-23T18:29:15.510579+0000","last_became_peered":"2024-04-23T18:29:15.510579+0000","last_unstale":"2024-04-23T18:32:46.266076+0000","last_undegraded":"2024-04-23T18:32:46.266076+0000","last_fullsized":"2024-04-23T18:32:46.266076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:46.265967+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:46.265967+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.265967+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:25:58.382875+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.452470+0000","last_change":"2024-04-23T18:32:44.452506+0000","last_active":"2024-04-23T18:32:44.452470+0000","last_peered":"2024-04-23T18:32:44.452470+0000","last_clean":"2024-04-23T18:32:44.452470+0000","last_became_active":"2024-04-23T18:29:17.512935+0000","last_became_peered":"2024-04-23T18:29:17.512935+0000","last_unstale":"2024-04-23T18:32:44.452470+0000","last_undegraded":"2024-04-23T18:32:44.452470+0000","last_fullsized":"2024-04-23T18:32:44.452470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-23T18:32:44.452352+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-23T18:32:44.452352+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.452352+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:05.628659+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":443,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.342870+0000","last_change":"2024-04-23T18:32:32.342946+0000","last_active":"2024-04-23T18:32:32.342870+0000","last_peered":"2024-04-23T18:32:32.342870+0000","last_clean":"2024-04-23T18:32:32.342870+0000","last_became_active":"2024-04-23T18:29:19.526260+0000","last_became_peered":"2024-04-23T18:29:19.526260+0000","last_unstale":"2024-04-23T18:32:32.342870+0000","last_undegraded":"2024-04-23T18:32:32.342870+0000","last_fullsized":"2024-04-23T18:32:32.342870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:32.342765+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:32.342765+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.342765+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:52.808626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.278250+0000","last_change":"2024-04-23T18:29:21.527340+0000","last_active":"2024-04-23T18:32:21.278250+0000","last_peered":"2024-04-23T18:32:21.278250+0000","last_clean":"2024-04-23T18:32:21.278250+0000","last_became_active":"2024-04-23T18:29:21.527108+0000","last_became_peered":"2024-04-23T18:29:21.527108+0000","last_unstale":"2024-04-23T18:32:21.278250+0000","last_undegraded":"2024-04-23T18:32:21.278250+0000","last_fullsized":"2024-04-23T18:32:21.278250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'5","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.271486+0000","last_change":"2024-04-23T18:29:13.504838+0000","last_active":"2024-04-23T18:32:21.271486+0000","last_peered":"2024-04-23T18:32:21.271486+0000","last_clean":"2024-04-23T18:32:21.271486+0000","last_became_active":"2024-04-23T18:29:13.504570+0000","last_became_peered":"2024-04-23T18:29:13.504570+0000","last_unstale":"2024-04-23T18:32:21.271486+0000","last_undegraded":"2024-04-23T18:32:21.271486+0000","last_fullsized":"2024-04-23T18:32:21.271486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760354+0000","last_change":"2024-04-23T18:29:11.505849+0000","last_active":"2024-04-23T18:31:21.760354+0000","last_peered":"2024-04-23T18:31:21.760354+0000","last_clean":"2024-04-23T18:31:21.760354+0000","last_became_active":"2024-04-23T18:29:11.505531+0000","last_became_peered":"2024-04-23T18:29:11.505531+0000","last_unstale":"2024-04-23T18:31:21.760354+0000","last_undegraded":"2024-04-23T18:31:21.760354+0000","last_fullsized":"2024-04-23T18:31:21.760354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":428,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.926494+0000","last_change":"2024-04-23T18:32:49.926526+0000","last_active":"2024-04-23T18:32:49.926494+0000","last_peered":"2024-04-23T18:32:49.926494+0000","last_clean":"2024-04-23T18:32:49.926494+0000","last_became_active":"2024-04-23T18:29:15.505983+0000","last_became_peered":"2024-04-23T18:29:15.505983+0000","last_unstale":"2024-04-23T18:32:49.926494+0000","last_undegraded":"2024-04-23T18:32:49.926494+0000","last_fullsized":"2024-04-23T18:32:49.926494+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:32:49.926413+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:32:49.926413+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.926413+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:14.338142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.465248+0000","last_change":"2024-04-23T18:32:39.465286+0000","last_active":"2024-04-23T18:32:39.465248+0000","last_peered":"2024-04-23T18:32:39.465248+0000","last_clean":"2024-04-23T18:32:39.465248+0000","last_became_active":"2024-04-23T18:29:17.513213+0000","last_became_peered":"2024-04-23T18:29:17.513213+0000","last_unstale":"2024-04-23T18:32:39.465248+0000","last_undegraded":"2024-04-23T18:32:39.465248+0000","last_fullsized":"2024-04-23T18:32:39.465248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-23T18:32:39.465155+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-23T18:32:39.465155+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.465155+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:22.245175+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":480,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.880027+0000","last_change":"2024-04-23T18:32:39.880054+0000","last_active":"2024-04-23T18:32:39.880027+0000","last_peered":"2024-04-23T18:32:39.880027+0000","last_clean":"2024-04-23T18:32:39.880027+0000","last_became_active":"2024-04-23T18:29:19.518528+0000","last_became_peered":"2024-04-23T18:29:19.518528+0000","last_unstale":"2024-04-23T18:32:39.880027+0000","last_undegraded":"2024-04-23T18:32:39.880027+0000","last_fullsized":"2024-04-23T18:32:39.880027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:39.879912+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:39.879912+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.879912+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:36.345360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.480588+0000","last_change":"2024-04-23T18:32:49.480613+0000","last_active":"2024-04-23T18:32:49.480588+0000","last_peered":"2024-04-23T18:32:49.480588+0000","last_clean":"2024-04-23T18:32:49.480588+0000","last_became_active":"2024-04-23T18:29:21.530946+0000","last_became_peered":"2024-04-23T18:29:21.530946+0000","last_unstale":"2024-04-23T18:32:49.480588+0000","last_undegraded":"2024-04-23T18:32:49.480588+0000","last_fullsized":"2024-04-23T18:32:49.480588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:49.480502+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:49.480502+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.480502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:18.888990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.873946+0000","last_change":"2024-04-23T18:32:52.873980+0000","last_active":"2024-04-23T18:32:52.873946+0000","last_peered":"2024-04-23T18:32:52.873946+0000","last_clean":"2024-04-23T18:32:52.873946+0000","last_became_active":"2024-04-23T18:29:13.507813+0000","last_became_peered":"2024-04-23T18:29:13.507813+0000","last_unstale":"2024-04-23T18:32:52.873946+0000","last_undegraded":"2024-04-23T18:32:52.873946+0000","last_fullsized":"2024-04-23T18:32:52.873946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:52.873850+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:52.873850+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.873850+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:37:08.666381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760317+0000","last_change":"2024-04-23T18:29:11.501752+0000","last_active":"2024-04-23T18:31:21.760317+0000","last_peered":"2024-04-23T18:31:21.760317+0000","last_clean":"2024-04-23T18:31:21.760317+0000","last_became_active":"2024-04-23T18:29:11.501432+0000","last_became_peered":"2024-04-23T18:29:11.501432+0000","last_unstale":"2024-04-23T18:31:21.760317+0000","last_undegraded":"2024-04-23T18:31:21.760317+0000","last_fullsized":"2024-04-23T18:31:21.760317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.427463+0000","last_change":"2024-04-23T18:32:34.427490+0000","last_active":"2024-04-23T18:32:34.427463+0000","last_peered":"2024-04-23T18:32:34.427463+0000","last_clean":"2024-04-23T18:32:34.427463+0000","last_became_active":"2024-04-23T18:29:15.509701+0000","last_became_peered":"2024-04-23T18:29:15.509701+0000","last_unstale":"2024-04-23T18:32:34.427463+0000","last_undegraded":"2024-04-23T18:32:34.427463+0000","last_fullsized":"2024-04-23T18:32:34.427463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:34.427372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:34.427372+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.427372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:27.299606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.866403+0000","last_change":"2024-04-23T18:32:40.866441+0000","last_active":"2024-04-23T18:32:40.866403+0000","last_peered":"2024-04-23T18:32:40.866403+0000","last_clean":"2024-04-23T18:32:40.866403+0000","last_became_active":"2024-04-23T18:29:17.509672+0000","last_became_peered":"2024-04-23T18:29:17.509672+0000","last_unstale":"2024-04-23T18:32:40.866403+0000","last_undegraded":"2024-04-23T18:32:40.866403+0000","last_fullsized":"2024-04-23T18:32:40.866403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:40.866301+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:40.866301+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.866301+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:40.902292+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.357680+0000","last_change":"2024-04-23T18:32:33.357709+0000","last_active":"2024-04-23T18:32:33.357680+0000","last_peered":"2024-04-23T18:32:33.357680+0000","last_clean":"2024-04-23T18:32:33.357680+0000","last_became_active":"2024-04-23T18:29:19.526861+0000","last_became_peered":"2024-04-23T18:29:19.526861+0000","last_unstale":"2024-04-23T18:32:33.357680+0000","last_undegraded":"2024-04-23T18:32:33.357680+0000","last_fullsized":"2024-04-23T18:32:33.357680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.357572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.357572+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.357572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:35:59.244732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.921102+0000","last_change":"2024-04-23T18:32:59.921133+0000","last_active":"2024-04-23T18:32:59.921102+0000","last_peered":"2024-04-23T18:32:59.921102+0000","last_clean":"2024-04-23T18:32:59.921102+0000","last_became_active":"2024-04-23T18:29:21.530612+0000","last_became_peered":"2024-04-23T18:29:21.530612+0000","last_unstale":"2024-04-23T18:32:59.921102+0000","last_undegraded":"2024-04-23T18:32:59.921102+0000","last_fullsized":"2024-04-23T18:32:59.921102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-23T18:32:59.921013+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-23T18:32:59.921013+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.921013+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:38.050899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.476888+0000","last_change":"2024-04-23T18:32:50.476924+0000","last_active":"2024-04-23T18:32:50.476888+0000","last_peered":"2024-04-23T18:32:50.476888+0000","last_clean":"2024-04-23T18:32:50.476888+0000","last_became_active":"2024-04-23T18:29:13.501636+0000","last_became_peered":"2024-04-23T18:29:13.501636+0000","last_unstale":"2024-04-23T18:32:50.476888+0000","last_undegraded":"2024-04-23T18:32:50.476888+0000","last_fullsized":"2024-04-23T18:32:50.476888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:50.476795+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:50.476795+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.476795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:25.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":204,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:31.227994+0000","last_change":"2024-04-23T18:28:58.798997+0000","last_active":"2024-04-23T18:32:31.227994+0000","last_peered":"2024-04-23T18:32:31.227994+0000","last_clean":"2024-04-23T18:32:31.227994+0000","last_became_active":"2024-04-23T18:28:58.798001+0000","last_became_peered":"2024-04-23T18:28:58.798001+0000","last_unstale":"2024-04-23T18:32:31.227994+0000","last_undegraded":"2024-04-23T18:32:31.227994+0000","last_fullsized":"2024-04-23T18:32:31.227994+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:28:57.410644+0000","last_clean_scrub_stamp":"2024-04-23T18:28:57.410644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:11.758994+0000","last_change":"2024-04-23T18:29:03.446652+0000","last_active":"2024-04-23T18:31:11.758994+0000","last_peered":"2024-04-23T18:31:11.758994+0000","last_clean":"2024-04-23T18:31:11.758994+0000","last_became_active":"2024-04-23T18:29:03.446324+0000","last_became_peered":"2024-04-23T18:29:03.446324+0000","last_unstale":"2024-04-23T18:31:11.758994+0000","last_undegraded":"2024-04-23T18:31:11.758994+0000","last_fullsized":"2024-04-23T18:31:11.758994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.213054+0000","last_change":"2024-04-23T18:29:11.512994+0000","last_active":"2024-04-23T18:32:21.213054+0000","last_peered":"2024-04-23T18:32:21.213054+0000","last_clean":"2024-04-23T18:32:21.213054+0000","last_became_active":"2024-04-23T18:29:11.512684+0000","last_became_peered":"2024-04-23T18:29:11.512684+0000","last_unstale":"2024-04-23T18:32:21.213054+0000","last_undegraded":"2024-04-23T18:32:21.213054+0000","last_fullsized":"2024-04-23T18:32:21.213054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.866800+0000","last_change":"2024-04-23T18:32:46.866824+0000","last_active":"2024-04-23T18:32:46.866800+0000","last_peered":"2024-04-23T18:32:46.866800+0000","last_clean":"2024-04-23T18:32:46.866800+0000","last_became_active":"2024-04-23T18:29:15.509209+0000","last_became_peered":"2024-04-23T18:29:15.509209+0000","last_unstale":"2024-04-23T18:32:46.866800+0000","last_undegraded":"2024-04-23T18:32:46.866800+0000","last_fullsized":"2024-04-23T18:32:46.866800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:46.866699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:46.866699+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.866699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:45.485566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'87","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.423367+0000","last_change":"2024-04-23T18:32:47.423434+0000","last_active":"2024-04-23T18:32:47.423367+0000","last_peered":"2024-04-23T18:32:47.423367+0000","last_clean":"2024-04-23T18:32:47.423367+0000","last_became_active":"2024-04-23T18:29:17.513504+0000","last_became_peered":"2024-04-23T18:29:17.513504+0000","last_unstale":"2024-04-23T18:32:47.423367+0000","last_undegraded":"2024-04-23T18:32:47.423367+0000","last_fullsized":"2024-04-23T18:32:47.423367+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-04-23T18:32:47.423269+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-04-23T18:32:47.423269+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.423269+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:31.948251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.310579+0000","last_change":"2024-04-23T18:32:36.310603+0000","last_active":"2024-04-23T18:32:36.310579+0000","last_peered":"2024-04-23T18:32:36.310579+0000","last_clean":"2024-04-23T18:32:36.310579+0000","last_became_active":"2024-04-23T18:29:19.518974+0000","last_became_peered":"2024-04-23T18:29:19.518974+0000","last_unstale":"2024-04-23T18:32:36.310579+0000","last_undegraded":"2024-04-23T18:32:36.310579+0000","last_fullsized":"2024-04-23T18:32:36.310579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.310468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.310468+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.310468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:09:49.509664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.231843+0000","last_change":"2024-04-23T18:29:21.532023+0000","last_active":"2024-04-23T18:32:21.231843+0000","last_peered":"2024-04-23T18:32:21.231843+0000","last_clean":"2024-04-23T18:32:21.231843+0000","last_became_active":"2024-04-23T18:29:21.531725+0000","last_became_peered":"2024-04-23T18:29:21.531725+0000","last_unstale":"2024-04-23T18:32:21.231843+0000","last_undegraded":"2024-04-23T18:32:21.231843+0000","last_fullsized":"2024-04-23T18:32:21.231843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.478878+0000","last_change":"2024-04-23T18:33:09.478908+0000","last_active":"2024-04-23T18:33:09.478878+0000","last_peered":"2024-04-23T18:33:09.478878+0000","last_clean":"2024-04-23T18:33:09.478878+0000","last_became_active":"2024-04-23T18:29:13.497008+0000","last_became_peered":"2024-04-23T18:29:13.497008+0000","last_unstale":"2024-04-23T18:33:09.478878+0000","last_undegraded":"2024-04-23T18:33:09.478878+0000","last_fullsized":"2024-04-23T18:33:09.478878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:09.478793+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:09.478793+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.478793+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:03.219719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.122192+0000","last_change":"2024-04-23T18:29:03.447767+0000","last_active":"2024-04-23T18:32:32.122192+0000","last_peered":"2024-04-23T18:32:32.122192+0000","last_clean":"2024-04-23T18:32:32.122192+0000","last_became_active":"2024-04-23T18:29:03.447404+0000","last_became_peered":"2024-04-23T18:29:03.447404+0000","last_unstale":"2024-04-23T18:32:32.122192+0000","last_undegraded":"2024-04-23T18:32:32.122192+0000","last_fullsized":"2024-04-23T18:32:32.122192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756525+0000","last_change":"2024-04-23T18:29:11.487391+0000","last_active":"2024-04-23T18:31:19.756525+0000","last_peered":"2024-04-23T18:31:19.756525+0000","last_clean":"2024-04-23T18:31:19.756525+0000","last_became_active":"2024-04-23T18:29:11.486538+0000","last_became_peered":"2024-04-23T18:29:11.486538+0000","last_unstale":"2024-04-23T18:31:19.756525+0000","last_undegraded":"2024-04-23T18:31:19.756525+0000","last_fullsized":"2024-04-23T18:31:19.756525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.435741+0000","last_change":"2024-04-23T18:32:40.435765+0000","last_active":"2024-04-23T18:32:40.435741+0000","last_peered":"2024-04-23T18:32:40.435741+0000","last_clean":"2024-04-23T18:32:40.435741+0000","last_became_active":"2024-04-23T18:29:15.508020+0000","last_became_peered":"2024-04-23T18:29:15.508020+0000","last_unstale":"2024-04-23T18:32:40.435741+0000","last_undegraded":"2024-04-23T18:32:40.435741+0000","last_fullsized":"2024-04-23T18:32:40.435741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:40.435654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:40.435654+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.435654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:16.738684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'291","reported_seq":516,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.927400+0000","last_change":"2024-04-23T18:32:36.927476+0000","last_active":"2024-04-23T18:32:36.927400+0000","last_peered":"2024-04-23T18:32:36.927400+0000","last_clean":"2024-04-23T18:32:36.927400+0000","last_became_active":"2024-04-23T18:29:17.515023+0000","last_became_peered":"2024-04-23T18:29:17.515023+0000","last_unstale":"2024-04-23T18:32:36.927400+0000","last_undegraded":"2024-04-23T18:32:36.927400+0000","last_fullsized":"2024-04-23T18:32:36.927400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'291","last_scrub_stamp":"2024-04-23T18:32:36.927295+0000","last_deep_scrub":"34'291","last_deep_scrub_stamp":"2024-04-23T18:32:36.927295+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.927295+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:58.103602+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.428125+0000","last_change":"2024-04-23T18:32:55.428147+0000","last_active":"2024-04-23T18:32:55.428125+0000","last_peered":"2024-04-23T18:32:55.428125+0000","last_clean":"2024-04-23T18:32:55.428125+0000","last_became_active":"2024-04-23T18:29:19.522105+0000","last_became_peered":"2024-04-23T18:29:19.522105+0000","last_unstale":"2024-04-23T18:32:55.428125+0000","last_undegraded":"2024-04-23T18:32:55.428125+0000","last_fullsized":"2024-04-23T18:32:55.428125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:55.428038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:55.428038+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.428038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:30:42.649870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.760717+0000","last_change":"2024-04-23T18:29:21.533582+0000","last_active":"2024-04-23T18:31:31.760717+0000","last_peered":"2024-04-23T18:31:31.760717+0000","last_clean":"2024-04-23T18:31:31.760717+0000","last_became_active":"2024-04-23T18:29:21.532867+0000","last_became_peered":"2024-04-23T18:29:21.532867+0000","last_unstale":"2024-04-23T18:31:31.760717+0000","last_undegraded":"2024-04-23T18:31:31.760717+0000","last_fullsized":"2024-04-23T18:31:31.760717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:24.757346+0000","last_change":"2024-04-23T18:29:13.499606+0000","last_active":"2024-04-23T18:31:24.757346+0000","last_peered":"2024-04-23T18:31:24.757346+0000","last_clean":"2024-04-23T18:31:24.757346+0000","last_became_active":"2024-04-23T18:29:13.499253+0000","last_became_peered":"2024-04-23T18:29:13.499253+0000","last_unstale":"2024-04-23T18:31:24.757346+0000","last_undegraded":"2024-04-23T18:31:24.757346+0000","last_fullsized":"2024-04-23T18:31:24.757346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.337306+0000","last_change":"2024-04-23T18:33:11.337306+0000","last_active":"2024-04-23T18:33:11.337306+0000","last_peered":"2024-04-23T18:33:11.337306+0000","last_clean":"2024-04-23T18:33:11.337306+0000","last_became_active":"2024-04-23T18:29:03.446647+0000","last_became_peered":"2024-04-23T18:29:03.446647+0000","last_unstale":"2024-04-23T18:33:11.337306+0000","last_undegraded":"2024-04-23T18:33:11.337306+0000","last_fullsized":"2024-04-23T18:33:11.337306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:11.337177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:11.337177+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.337177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:54.117197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:14.755669+0000","last_change":"2024-04-23T18:29:11.492974+0000","last_active":"2024-04-23T18:31:14.755669+0000","last_peered":"2024-04-23T18:31:14.755669+0000","last_clean":"2024-04-23T18:31:14.755669+0000","last_became_active":"2024-04-23T18:29:11.491953+0000","last_became_peered":"2024-04-23T18:29:11.491953+0000","last_unstale":"2024-04-23T18:31:14.755669+0000","last_undegraded":"2024-04-23T18:31:14.755669+0000","last_fullsized":"2024-04-23T18:31:14.755669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.759640+0000","last_change":"2024-04-23T18:29:52.563435+0000","last_active":"2024-04-23T18:31:26.759640+0000","last_peered":"2024-04-23T18:31:26.759640+0000","last_clean":"2024-04-23T18:31:26.759640+0000","last_became_active":"2024-04-23T18:29:52.551265+0000","last_became_peered":"2024-04-23T18:29:52.551265+0000","last_unstale":"2024-04-23T18:31:26.759640+0000","last_undegraded":"2024-04-23T18:31:26.759640+0000","last_fullsized":"2024-04-23T18:31:26.759640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.370133+0000","last_change":"2024-04-23T18:32:42.370172+0000","last_active":"2024-04-23T18:32:42.370133+0000","last_peered":"2024-04-23T18:32:42.370133+0000","last_clean":"2024-04-23T18:32:42.370133+0000","last_became_active":"2024-04-23T18:29:17.513875+0000","last_became_peered":"2024-04-23T18:29:17.513875+0000","last_unstale":"2024-04-23T18:32:42.370133+0000","last_undegraded":"2024-04-23T18:32:42.370133+0000","last_fullsized":"2024-04-23T18:32:42.370133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-23T18:32:42.370053+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-23T18:32:42.370053+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.370053+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:16:11.051682+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:31.497695+0000","last_change":"2024-04-23T18:32:31.497737+0000","last_active":"2024-04-23T18:32:31.497695+0000","last_peered":"2024-04-23T18:32:31.497695+0000","last_clean":"2024-04-23T18:32:31.497695+0000","last_became_active":"2024-04-23T18:29:19.518744+0000","last_became_peered":"2024-04-23T18:29:19.518744+0000","last_unstale":"2024-04-23T18:32:31.497695+0000","last_undegraded":"2024-04-23T18:32:31.497695+0000","last_fullsized":"2024-04-23T18:32:31.497695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:31.497603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:31.497603+0000","last_clean_scrub_stamp":"2024-04-23T18:32:31.497603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:37.446181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762596+0000","last_change":"2024-04-23T18:29:21.533685+0000","last_active":"2024-04-23T18:31:36.762596+0000","last_peered":"2024-04-23T18:31:36.762596+0000","last_clean":"2024-04-23T18:31:36.762596+0000","last_became_active":"2024-04-23T18:29:21.533358+0000","last_became_peered":"2024-04-23T18:29:21.533358+0000","last_unstale":"2024-04-23T18:31:36.762596+0000","last_undegraded":"2024-04-23T18:31:36.762596+0000","last_fullsized":"2024-04-23T18:31:36.762596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.247711+0000","last_change":"2024-04-23T18:33:02.247736+0000","last_active":"2024-04-23T18:33:02.247711+0000","last_peered":"2024-04-23T18:33:02.247711+0000","last_clean":"2024-04-23T18:33:02.247711+0000","last_became_active":"2024-04-23T18:29:13.493321+0000","last_became_peered":"2024-04-23T18:29:13.493321+0000","last_unstale":"2024-04-23T18:33:02.247711+0000","last_undegraded":"2024-04-23T18:33:02.247711+0000","last_fullsized":"2024-04-23T18:33:02.247711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:02.247619+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:02.247619+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.247619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:16.283269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.122203+0000","last_change":"2024-04-23T18:29:03.446774+0000","last_active":"2024-04-23T18:32:32.122203+0000","last_peered":"2024-04-23T18:32:32.122203+0000","last_clean":"2024-04-23T18:32:32.122203+0000","last_became_active":"2024-04-23T18:29:03.446457+0000","last_became_peered":"2024-04-23T18:29:03.446457+0000","last_unstale":"2024-04-23T18:32:32.122203+0000","last_undegraded":"2024-04-23T18:32:32.122203+0000","last_fullsized":"2024-04-23T18:32:32.122203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.866035+0000","last_change":"2024-04-23T18:29:11.483348+0000","last_active":"2024-04-23T18:32:20.866035+0000","last_peered":"2024-04-23T18:32:20.866035+0000","last_clean":"2024-04-23T18:32:20.866035+0000","last_became_active":"2024-04-23T18:29:11.482896+0000","last_became_peered":"2024-04-23T18:29:11.482896+0000","last_unstale":"2024-04-23T18:32:20.866035+0000","last_undegraded":"2024-04-23T18:32:20.866035+0000","last_fullsized":"2024-04-23T18:32:20.866035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.239589+0000","last_change":"2024-04-23T18:32:53.239612+0000","last_active":"2024-04-23T18:32:53.239589+0000","last_peered":"2024-04-23T18:32:53.239589+0000","last_clean":"2024-04-23T18:32:53.239589+0000","last_became_active":"2024-04-23T18:29:15.507357+0000","last_became_peered":"2024-04-23T18:29:15.507357+0000","last_unstale":"2024-04-23T18:32:53.239589+0000","last_undegraded":"2024-04-23T18:32:53.239589+0000","last_fullsized":"2024-04-23T18:32:53.239589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:53.239511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:53.239511+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.239511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:19:54.363767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.488413+0000","last_change":"2024-04-23T18:33:04.488473+0000","last_active":"2024-04-23T18:33:04.488413+0000","last_peered":"2024-04-23T18:33:04.488413+0000","last_clean":"2024-04-23T18:33:04.488413+0000","last_became_active":"2024-04-23T18:29:17.513393+0000","last_became_peered":"2024-04-23T18:29:17.513393+0000","last_unstale":"2024-04-23T18:33:04.488413+0000","last_undegraded":"2024-04-23T18:33:04.488413+0000","last_fullsized":"2024-04-23T18:33:04.488413+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-04-23T18:33:04.488295+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-04-23T18:33:04.488295+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.488295+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:35:28.849946+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.456642+0000","last_change":"2024-04-23T18:33:03.456665+0000","last_active":"2024-04-23T18:33:03.456642+0000","last_peered":"2024-04-23T18:33:03.456642+0000","last_clean":"2024-04-23T18:33:03.456642+0000","last_became_active":"2024-04-23T18:29:19.523070+0000","last_became_peered":"2024-04-23T18:29:19.523070+0000","last_unstale":"2024-04-23T18:33:03.456642+0000","last_undegraded":"2024-04-23T18:33:03.456642+0000","last_fullsized":"2024-04-23T18:33:03.456642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:03.456548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:03.456548+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.456548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:18.440377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.889005+0000","last_change":"2024-04-23T18:32:47.889033+0000","last_active":"2024-04-23T18:32:47.889005+0000","last_peered":"2024-04-23T18:32:47.889005+0000","last_clean":"2024-04-23T18:32:47.889005+0000","last_became_active":"2024-04-23T18:29:21.528764+0000","last_became_peered":"2024-04-23T18:29:21.528764+0000","last_unstale":"2024-04-23T18:32:47.889005+0000","last_undegraded":"2024-04-23T18:32:47.889005+0000","last_fullsized":"2024-04-23T18:32:47.889005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:47.888900+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:47.888900+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.888900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:11.470854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.869117+0000","last_change":"2024-04-23T18:32:54.869141+0000","last_active":"2024-04-23T18:32:54.869117+0000","last_peered":"2024-04-23T18:32:54.869117+0000","last_clean":"2024-04-23T18:32:54.869117+0000","last_became_active":"2024-04-23T18:29:13.507496+0000","last_became_peered":"2024-04-23T18:29:13.507496+0000","last_unstale":"2024-04-23T18:32:54.869117+0000","last_undegraded":"2024-04-23T18:32:54.869117+0000","last_fullsized":"2024-04-23T18:32:54.869117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:32:54.869026+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:32:54.869026+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.869026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:13.533697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:16.758194+0000","last_change":"2024-04-23T18:29:11.483379+0000","last_active":"2024-04-23T18:31:16.758194+0000","last_peered":"2024-04-23T18:31:16.758194+0000","last_clean":"2024-04-23T18:31:16.758194+0000","last_became_active":"2024-04-23T18:29:11.482348+0000","last_became_peered":"2024-04-23T18:29:11.482348+0000","last_unstale":"2024-04-23T18:31:16.758194+0000","last_undegraded":"2024-04-23T18:31:16.758194+0000","last_fullsized":"2024-04-23T18:31:16.758194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:09.754936+0000","last_change":"2024-04-23T18:29:03.446643+0000","last_active":"2024-04-23T18:31:09.754936+0000","last_peered":"2024-04-23T18:31:09.754936+0000","last_clean":"2024-04-23T18:31:09.754936+0000","last_became_active":"2024-04-23T18:29:03.446286+0000","last_became_peered":"2024-04-23T18:29:03.446286+0000","last_unstale":"2024-04-23T18:31:09.754936+0000","last_undegraded":"2024-04-23T18:31:09.754936+0000","last_fullsized":"2024-04-23T18:31:09.754936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.738327+0000","last_change":"2024-04-23T18:29:52.554181+0000","last_active":"2024-04-23T18:32:27.738327+0000","last_peered":"2024-04-23T18:32:27.738327+0000","last_clean":"2024-04-23T18:32:27.738327+0000","last_became_active":"2024-04-23T18:29:52.553851+0000","last_became_peered":"2024-04-23T18:29:52.553851+0000","last_unstale":"2024-04-23T18:32:27.738327+0000","last_undegraded":"2024-04-23T18:32:27.738327+0000","last_fullsized":"2024-04-23T18:32:27.738327+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'73","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.321059+0000","last_change":"2024-04-23T18:32:41.321101+0000","last_active":"2024-04-23T18:32:41.321059+0000","last_peered":"2024-04-23T18:32:41.321059+0000","last_clean":"2024-04-23T18:32:41.321059+0000","last_became_active":"2024-04-23T18:29:17.513599+0000","last_became_peered":"2024-04-23T18:29:17.513599+0000","last_unstale":"2024-04-23T18:32:41.321059+0000","last_undegraded":"2024-04-23T18:32:41.321059+0000","last_fullsized":"2024-04-23T18:32:41.321059+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'73","last_scrub_stamp":"2024-04-23T18:32:41.320952+0000","last_deep_scrub":"34'73","last_deep_scrub_stamp":"2024-04-23T18:32:41.320952+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.320952+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:13:39.361578+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.404899+0000","last_change":"2024-04-23T18:32:34.404932+0000","last_active":"2024-04-23T18:32:34.404899+0000","last_peered":"2024-04-23T18:32:34.404899+0000","last_clean":"2024-04-23T18:32:34.404899+0000","last_became_active":"2024-04-23T18:29:19.526192+0000","last_became_peered":"2024-04-23T18:29:19.526192+0000","last_unstale":"2024-04-23T18:32:34.404899+0000","last_undegraded":"2024-04-23T18:32:34.404899+0000","last_fullsized":"2024-04-23T18:32:34.404899+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:34.404810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:34.404810+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.404810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:37.587320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759670+0000","last_change":"2024-04-23T18:29:21.533405+0000","last_active":"2024-04-23T18:31:39.759670+0000","last_peered":"2024-04-23T18:31:39.759670+0000","last_clean":"2024-04-23T18:31:39.759670+0000","last_became_active":"2024-04-23T18:29:21.533202+0000","last_became_peered":"2024-04-23T18:29:21.533202+0000","last_unstale":"2024-04-23T18:31:39.759670+0000","last_undegraded":"2024-04-23T18:31:39.759670+0000","last_fullsized":"2024-04-23T18:31:39.759670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":32,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.935773+0000","last_change":"2024-04-23T18:32:57.935822+0000","last_active":"2024-04-23T18:32:57.935773+0000","last_peered":"2024-04-23T18:32:57.935773+0000","last_clean":"2024-04-23T18:32:57.935773+0000","last_became_active":"2024-04-23T18:29:13.506795+0000","last_became_peered":"2024-04-23T18:29:13.506795+0000","last_unstale":"2024-04-23T18:32:57.935773+0000","last_undegraded":"2024-04-23T18:32:57.935773+0000","last_fullsized":"2024-04-23T18:32:57.935773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:57.935674+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:57.935674+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.935674+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:38.815854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756589+0000","last_change":"2024-04-23T18:29:11.492325+0000","last_active":"2024-04-23T18:31:19.756589+0000","last_peered":"2024-04-23T18:31:19.756589+0000","last_clean":"2024-04-23T18:31:19.756589+0000","last_became_active":"2024-04-23T18:29:11.491882+0000","last_became_peered":"2024-04-23T18:29:11.491882+0000","last_unstale":"2024-04-23T18:31:19.756589+0000","last_undegraded":"2024-04-23T18:31:19.756589+0000","last_fullsized":"2024-04-23T18:31:19.756589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:11.759046+0000","last_change":"2024-04-23T18:29:03.447598+0000","last_active":"2024-04-23T18:31:11.759046+0000","last_peered":"2024-04-23T18:31:11.759046+0000","last_clean":"2024-04-23T18:31:11.759046+0000","last_became_active":"2024-04-23T18:29:03.447265+0000","last_became_peered":"2024-04-23T18:29:03.447265+0000","last_unstale":"2024-04-23T18:31:11.759046+0000","last_undegraded":"2024-04-23T18:31:11.759046+0000","last_fullsized":"2024-04-23T18:31:11.759046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.440817+0000","last_change":"2024-04-23T18:32:42.440839+0000","last_active":"2024-04-23T18:32:42.440817+0000","last_peered":"2024-04-23T18:32:42.440817+0000","last_clean":"2024-04-23T18:32:42.440817+0000","last_became_active":"2024-04-23T18:29:15.506394+0000","last_became_peered":"2024-04-23T18:29:15.506394+0000","last_unstale":"2024-04-23T18:32:42.440817+0000","last_undegraded":"2024-04-23T18:32:42.440817+0000","last_fullsized":"2024-04-23T18:32:42.440817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:42.440734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:42.440734+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.440734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:59.535655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.939904+0000","last_change":"2024-04-23T18:32:34.939954+0000","last_active":"2024-04-23T18:32:34.939904+0000","last_peered":"2024-04-23T18:32:34.939904+0000","last_clean":"2024-04-23T18:32:34.939904+0000","last_became_active":"2024-04-23T18:29:17.515048+0000","last_became_peered":"2024-04-23T18:29:17.515048+0000","last_unstale":"2024-04-23T18:32:34.939904+0000","last_undegraded":"2024-04-23T18:32:34.939904+0000","last_fullsized":"2024-04-23T18:32:34.939904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-04-23T18:32:34.939820+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-04-23T18:32:34.939820+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.939820+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:16:03.621449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.962427+0000","last_change":"2024-04-23T18:32:33.962456+0000","last_active":"2024-04-23T18:32:33.962427+0000","last_peered":"2024-04-23T18:32:33.962427+0000","last_clean":"2024-04-23T18:32:33.962427+0000","last_became_active":"2024-04-23T18:29:19.518668+0000","last_became_peered":"2024-04-23T18:29:19.518668+0000","last_unstale":"2024-04-23T18:32:33.962427+0000","last_undegraded":"2024-04-23T18:32:33.962427+0000","last_fullsized":"2024-04-23T18:32:33.962427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:33.962317+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:33.962317+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.962317+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:24:53.232240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.220825+0000","last_change":"2024-04-23T18:29:21.531478+0000","last_active":"2024-04-23T18:32:21.220825+0000","last_peered":"2024-04-23T18:32:21.220825+0000","last_clean":"2024-04-23T18:32:21.220825+0000","last_became_active":"2024-04-23T18:29:21.531185+0000","last_became_peered":"2024-04-23T18:29:21.531185+0000","last_unstale":"2024-04-23T18:32:21.220825+0000","last_undegraded":"2024-04-23T18:32:21.220825+0000","last_fullsized":"2024-04-23T18:32:21.220825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.354057+0000","last_change":"2024-04-23T18:32:44.354121+0000","last_active":"2024-04-23T18:32:44.354057+0000","last_peered":"2024-04-23T18:32:44.354057+0000","last_clean":"2024-04-23T18:32:44.354057+0000","last_became_active":"2024-04-23T18:29:13.503543+0000","last_became_peered":"2024-04-23T18:29:13.503543+0000","last_unstale":"2024-04-23T18:32:44.354057+0000","last_undegraded":"2024-04-23T18:32:44.354057+0000","last_fullsized":"2024-04-23T18:32:44.354057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:44.353948+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:44.353948+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.353948+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:19.427152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.878949+0000","last_change":"2024-04-23T18:29:11.505973+0000","last_active":"2024-04-23T18:32:27.878949+0000","last_peered":"2024-04-23T18:32:27.878949+0000","last_clean":"2024-04-23T18:32:27.878949+0000","last_became_active":"2024-04-23T18:29:11.505604+0000","last_became_peered":"2024-04-23T18:29:11.505604+0000","last_unstale":"2024-04-23T18:32:27.878949+0000","last_undegraded":"2024-04-23T18:32:27.878949+0000","last_fullsized":"2024-04-23T18:32:27.878949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:14.755770+0000","last_change":"2024-04-23T18:29:03.446013+0000","last_active":"2024-04-23T18:31:14.755770+0000","last_peered":"2024-04-23T18:31:14.755770+0000","last_clean":"2024-04-23T18:31:14.755770+0000","last_became_active":"2024-04-23T18:29:03.445715+0000","last_became_peered":"2024-04-23T18:29:03.445715+0000","last_unstale":"2024-04-23T18:31:14.755770+0000","last_undegraded":"2024-04-23T18:31:14.755770+0000","last_fullsized":"2024-04-23T18:31:14.755770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.423649+0000","last_change":"2024-04-23T18:32:32.423670+0000","last_active":"2024-04-23T18:32:32.423649+0000","last_peered":"2024-04-23T18:32:32.423649+0000","last_clean":"2024-04-23T18:32:32.423649+0000","last_became_active":"2024-04-23T18:29:15.511553+0000","last_became_peered":"2024-04-23T18:29:15.511553+0000","last_unstale":"2024-04-23T18:32:32.423649+0000","last_undegraded":"2024-04-23T18:32:32.423649+0000","last_fullsized":"2024-04-23T18:32:32.423649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.423553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.423553+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.423553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:27:15.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.450357+0000","last_change":"2024-04-23T18:33:01.450404+0000","last_active":"2024-04-23T18:33:01.450357+0000","last_peered":"2024-04-23T18:33:01.450357+0000","last_clean":"2024-04-23T18:33:01.450357+0000","last_became_active":"2024-04-23T18:29:17.515741+0000","last_became_peered":"2024-04-23T18:29:17.515741+0000","last_unstale":"2024-04-23T18:33:01.450357+0000","last_undegraded":"2024-04-23T18:33:01.450357+0000","last_fullsized":"2024-04-23T18:33:01.450357+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:33:01.450263+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:33:01.450263+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.450263+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:17:37.262459+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":411,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.172157+0000","last_change":"2024-04-23T18:32:48.172218+0000","last_active":"2024-04-23T18:32:48.172157+0000","last_peered":"2024-04-23T18:32:48.172157+0000","last_clean":"2024-04-23T18:32:48.172157+0000","last_became_active":"2024-04-23T18:29:19.526375+0000","last_became_peered":"2024-04-23T18:29:19.526375+0000","last_unstale":"2024-04-23T18:32:48.172157+0000","last_undegraded":"2024-04-23T18:32:48.172157+0000","last_fullsized":"2024-04-23T18:32:48.172157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:48.172046+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:48.172046+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.172046+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:32:02.059338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761558+0000","last_change":"2024-04-23T18:29:21.531204+0000","last_active":"2024-04-23T18:31:36.761558+0000","last_peered":"2024-04-23T18:31:36.761558+0000","last_clean":"2024-04-23T18:31:36.761558+0000","last_became_active":"2024-04-23T18:29:21.530911+0000","last_became_peered":"2024-04-23T18:29:21.530911+0000","last_unstale":"2024-04-23T18:31:36.761558+0000","last_undegraded":"2024-04-23T18:31:36.761558+0000","last_fullsized":"2024-04-23T18:31:36.761558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'16","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.310296+0000","last_change":"2024-04-23T18:32:59.310357+0000","last_active":"2024-04-23T18:32:59.310296+0000","last_peered":"2024-04-23T18:32:59.310296+0000","last_clean":"2024-04-23T18:32:59.310296+0000","last_became_active":"2024-04-23T18:29:13.499603+0000","last_became_peered":"2024-04-23T18:29:13.499603+0000","last_unstale":"2024-04-23T18:32:59.310296+0000","last_undegraded":"2024-04-23T18:32:59.310296+0000","last_fullsized":"2024-04-23T18:32:59.310296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:32:59.310197+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:32:59.310197+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.310197+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:47.217542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.759405+0000","last_change":"2024-04-23T18:29:11.488874+0000","last_active":"2024-04-23T18:31:21.759405+0000","last_peered":"2024-04-23T18:31:21.759405+0000","last_clean":"2024-04-23T18:31:21.759405+0000","last_became_active":"2024-04-23T18:29:11.488500+0000","last_became_peered":"2024-04-23T18:29:11.488500+0000","last_unstale":"2024-04-23T18:31:21.759405+0000","last_undegraded":"2024-04-23T18:31:21.759405+0000","last_fullsized":"2024-04-23T18:31:21.759405+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:11.759100+0000","last_change":"2024-04-23T18:29:03.594008+0000","last_active":"2024-04-23T18:31:11.759100+0000","last_peered":"2024-04-23T18:31:11.759100+0000","last_clean":"2024-04-23T18:31:11.759100+0000","last_became_active":"2024-04-23T18:29:03.593691+0000","last_became_peered":"2024-04-23T18:29:03.593691+0000","last_unstale":"2024-04-23T18:31:11.759100+0000","last_undegraded":"2024-04-23T18:31:11.759100+0000","last_fullsized":"2024-04-23T18:31:11.759100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.430515+0000","last_change":"2024-04-23T18:32:35.430553+0000","last_active":"2024-04-23T18:32:35.430515+0000","last_peered":"2024-04-23T18:32:35.430515+0000","last_clean":"2024-04-23T18:32:35.430515+0000","last_became_active":"2024-04-23T18:29:15.511207+0000","last_became_peered":"2024-04-23T18:29:15.511207+0000","last_unstale":"2024-04-23T18:32:35.430515+0000","last_undegraded":"2024-04-23T18:32:35.430515+0000","last_fullsized":"2024-04-23T18:32:35.430515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.430424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.430424+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.430424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:13.560310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":189,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.411279+0000","last_change":"2024-04-23T18:32:40.411316+0000","last_active":"2024-04-23T18:32:40.411279+0000","last_peered":"2024-04-23T18:32:40.411279+0000","last_clean":"2024-04-23T18:32:40.411279+0000","last_became_active":"2024-04-23T18:29:17.515004+0000","last_became_peered":"2024-04-23T18:29:17.515004+0000","last_unstale":"2024-04-23T18:32:40.411279+0000","last_undegraded":"2024-04-23T18:32:40.411279+0000","last_fullsized":"2024-04-23T18:32:40.411279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-04-23T18:32:40.411192+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-04-23T18:32:40.411192+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.411192+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:44.354254+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.340748+0000","last_change":"2024-04-23T18:32:37.340779+0000","last_active":"2024-04-23T18:32:37.340748+0000","last_peered":"2024-04-23T18:32:37.340748+0000","last_clean":"2024-04-23T18:32:37.340748+0000","last_became_active":"2024-04-23T18:29:19.517903+0000","last_became_peered":"2024-04-23T18:29:19.517903+0000","last_unstale":"2024-04-23T18:32:37.340748+0000","last_undegraded":"2024-04-23T18:32:37.340748+0000","last_fullsized":"2024-04-23T18:32:37.340748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:37.340641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:37.340641+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.340641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:57:08.789904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.486371+0000","last_change":"2024-04-23T18:32:53.486399+0000","last_active":"2024-04-23T18:32:53.486371+0000","last_peered":"2024-04-23T18:32:53.486371+0000","last_clean":"2024-04-23T18:32:53.486371+0000","last_became_active":"2024-04-23T18:29:21.530980+0000","last_became_peered":"2024-04-23T18:29:21.530980+0000","last_unstale":"2024-04-23T18:32:53.486371+0000","last_undegraded":"2024-04-23T18:32:53.486371+0000","last_fullsized":"2024-04-23T18:32:53.486371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:53.486278+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:53.486278+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.486278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:55:15.116741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.759671+0000","last_change":"2024-04-23T18:29:21.534750+0000","last_active":"2024-04-23T18:31:26.759671+0000","last_peered":"2024-04-23T18:31:26.759671+0000","last_clean":"2024-04-23T18:31:26.759671+0000","last_became_active":"2024-04-23T18:29:21.534461+0000","last_became_peered":"2024-04-23T18:29:21.534461+0000","last_unstale":"2024-04-23T18:31:26.759671+0000","last_undegraded":"2024-04-23T18:31:26.759671+0000","last_fullsized":"2024-04-23T18:31:26.759671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'10","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.344362+0000","last_change":"2024-04-23T18:33:09.344387+0000","last_active":"2024-04-23T18:33:09.344362+0000","last_peered":"2024-04-23T18:33:09.344362+0000","last_clean":"2024-04-23T18:33:09.344362+0000","last_became_active":"2024-04-23T18:29:13.504092+0000","last_became_peered":"2024-04-23T18:29:13.504092+0000","last_unstale":"2024-04-23T18:33:09.344362+0000","last_undegraded":"2024-04-23T18:33:09.344362+0000","last_fullsized":"2024-04-23T18:33:09.344362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:09.344276+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:09.344276+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.344276+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:41.733579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761840+0000","last_change":"2024-04-23T18:29:11.511197+0000","last_active":"2024-04-23T18:31:31.761840+0000","last_peered":"2024-04-23T18:31:31.761840+0000","last_clean":"2024-04-23T18:31:31.761840+0000","last_became_active":"2024-04-23T18:29:11.510456+0000","last_became_peered":"2024-04-23T18:29:11.510456+0000","last_unstale":"2024-04-23T18:31:31.761840+0000","last_undegraded":"2024-04-23T18:31:31.761840+0000","last_fullsized":"2024-04-23T18:31:31.761840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.935480+0000","last_change":"2024-04-23T18:32:48.935502+0000","last_active":"2024-04-23T18:32:48.935480+0000","last_peered":"2024-04-23T18:32:48.935480+0000","last_clean":"2024-04-23T18:32:48.935480+0000","last_became_active":"2024-04-23T18:29:15.506939+0000","last_became_peered":"2024-04-23T18:29:15.506939+0000","last_unstale":"2024-04-23T18:32:48.935480+0000","last_undegraded":"2024-04-23T18:32:48.935480+0000","last_fullsized":"2024-04-23T18:32:48.935480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:48.935390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:48.935390+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.935390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:50:02.096302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.400386+0000","last_change":"2024-04-23T18:32:37.400423+0000","last_active":"2024-04-23T18:32:37.400386+0000","last_peered":"2024-04-23T18:32:37.400386+0000","last_clean":"2024-04-23T18:32:37.400386+0000","last_became_active":"2024-04-23T18:29:17.511559+0000","last_became_peered":"2024-04-23T18:29:17.511559+0000","last_unstale":"2024-04-23T18:32:37.400386+0000","last_undegraded":"2024-04-23T18:32:37.400386+0000","last_fullsized":"2024-04-23T18:32:37.400386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:37.400296+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:37.400296+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.400296+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:51.584214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.480619+0000","last_change":"2024-04-23T18:33:07.480642+0000","last_active":"2024-04-23T18:33:07.480619+0000","last_peered":"2024-04-23T18:33:07.480619+0000","last_clean":"2024-04-23T18:33:07.480619+0000","last_became_active":"2024-04-23T18:29:19.525302+0000","last_became_peered":"2024-04-23T18:29:19.525302+0000","last_unstale":"2024-04-23T18:33:07.480619+0000","last_undegraded":"2024-04-23T18:33:07.480619+0000","last_fullsized":"2024-04-23T18:33:07.480619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:07.480534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:07.480534+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.480534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:35.271244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:24.757275+0000","last_change":"2024-04-23T18:29:21.530275+0000","last_active":"2024-04-23T18:31:24.757275+0000","last_peered":"2024-04-23T18:31:24.757275+0000","last_clean":"2024-04-23T18:31:24.757275+0000","last_became_active":"2024-04-23T18:29:21.530013+0000","last_became_peered":"2024-04-23T18:29:21.530013+0000","last_unstale":"2024-04-23T18:31:24.757275+0000","last_undegraded":"2024-04-23T18:31:24.757275+0000","last_fullsized":"2024-04-23T18:31:24.757275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.936742+0000","last_change":"2024-04-23T18:32:58.936777+0000","last_active":"2024-04-23T18:32:58.936742+0000","last_peered":"2024-04-23T18:32:58.936742+0000","last_clean":"2024-04-23T18:32:58.936742+0000","last_became_active":"2024-04-23T18:29:13.506770+0000","last_became_peered":"2024-04-23T18:29:13.506770+0000","last_unstale":"2024-04-23T18:32:58.936742+0000","last_undegraded":"2024-04-23T18:32:58.936742+0000","last_fullsized":"2024-04-23T18:32:58.936742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:58.936659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:58.936659+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.936659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:56.612370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'6","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.133993+0000","last_change":"2024-04-23T18:29:11.482617+0000","last_active":"2024-04-23T18:32:21.133993+0000","last_peered":"2024-04-23T18:32:21.133993+0000","last_clean":"2024-04-23T18:32:21.133993+0000","last_became_active":"2024-04-23T18:29:11.481884+0000","last_became_peered":"2024-04-23T18:29:11.481884+0000","last_unstale":"2024-04-23T18:32:21.133993+0000","last_undegraded":"2024-04-23T18:32:21.133993+0000","last_fullsized":"2024-04-23T18:32:21.133993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.416384+0000","last_change":"2024-04-23T18:32:38.416412+0000","last_active":"2024-04-23T18:32:38.416384+0000","last_peered":"2024-04-23T18:32:38.416384+0000","last_clean":"2024-04-23T18:32:38.416384+0000","last_became_active":"2024-04-23T18:29:15.508018+0000","last_became_peered":"2024-04-23T18:29:15.508018+0000","last_unstale":"2024-04-23T18:32:38.416384+0000","last_undegraded":"2024-04-23T18:32:38.416384+0000","last_fullsized":"2024-04-23T18:32:38.416384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:38.416298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:38.416298+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.416298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:11.511574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.373264+0000","last_change":"2024-04-23T18:32:38.373308+0000","last_active":"2024-04-23T18:32:38.373264+0000","last_peered":"2024-04-23T18:32:38.373264+0000","last_clean":"2024-04-23T18:32:38.373264+0000","last_became_active":"2024-04-23T18:29:17.514836+0000","last_became_peered":"2024-04-23T18:29:17.514836+0000","last_unstale":"2024-04-23T18:32:38.373264+0000","last_undegraded":"2024-04-23T18:32:38.373264+0000","last_fullsized":"2024-04-23T18:32:38.373264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:38.373174+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:38.373174+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.373174+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:55.790896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.401686+0000","last_change":"2024-04-23T18:32:37.401709+0000","last_active":"2024-04-23T18:32:37.401686+0000","last_peered":"2024-04-23T18:32:37.401686+0000","last_clean":"2024-04-23T18:32:37.401686+0000","last_became_active":"2024-04-23T18:29:19.527461+0000","last_became_peered":"2024-04-23T18:29:19.527461+0000","last_unstale":"2024-04-23T18:32:37.401686+0000","last_undegraded":"2024-04-23T18:32:37.401686+0000","last_fullsized":"2024-04-23T18:32:37.401686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:37.401597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:37.401597+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.401597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:07:00.685354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:54.761655+0000","last_change":"2024-04-23T18:29:21.529099+0000","last_active":"2024-04-23T18:31:54.761655+0000","last_peered":"2024-04-23T18:31:54.761655+0000","last_clean":"2024-04-23T18:31:54.761655+0000","last_became_active":"2024-04-23T18:29:21.528772+0000","last_became_peered":"2024-04-23T18:29:21.528772+0000","last_unstale":"2024-04-23T18:31:54.761655+0000","last_undegraded":"2024-04-23T18:31:54.761655+0000","last_fullsized":"2024-04-23T18:31:54.761655+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.191516+0000","last_change":"2024-04-23T18:32:57.191542+0000","last_active":"2024-04-23T18:32:57.191516+0000","last_peered":"2024-04-23T18:32:57.191516+0000","last_clean":"2024-04-23T18:32:57.191516+0000","last_became_active":"2024-04-23T18:29:13.502849+0000","last_became_peered":"2024-04-23T18:29:13.502849+0000","last_unstale":"2024-04-23T18:32:57.191516+0000","last_undegraded":"2024-04-23T18:32:57.191516+0000","last_fullsized":"2024-04-23T18:32:57.191516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:57.191428+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:57.191428+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.191428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:28.194216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.876555+0000","last_change":"2024-04-23T18:29:11.485392+0000","last_active":"2024-04-23T18:32:27.876555+0000","last_peered":"2024-04-23T18:32:27.876555+0000","last_clean":"2024-04-23T18:32:27.876555+0000","last_became_active":"2024-04-23T18:29:11.483628+0000","last_became_peered":"2024-04-23T18:29:11.483628+0000","last_unstale":"2024-04-23T18:32:27.876555+0000","last_undegraded":"2024-04-23T18:32:27.876555+0000","last_fullsized":"2024-04-23T18:32:27.876555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.524247+0000","last_change":"2024-04-23T18:32:47.524270+0000","last_active":"2024-04-23T18:32:47.524247+0000","last_peered":"2024-04-23T18:32:47.524247+0000","last_clean":"2024-04-23T18:32:47.524247+0000","last_became_active":"2024-04-23T18:29:15.510130+0000","last_became_peered":"2024-04-23T18:29:15.510130+0000","last_unstale":"2024-04-23T18:32:47.524247+0000","last_undegraded":"2024-04-23T18:32:47.524247+0000","last_fullsized":"2024-04-23T18:32:47.524247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:47.524159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:47.524159+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.524159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:43.989607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.296594+0000","last_change":"2024-04-23T18:32:43.296633+0000","last_active":"2024-04-23T18:32:43.296594+0000","last_peered":"2024-04-23T18:32:43.296594+0000","last_clean":"2024-04-23T18:32:43.296594+0000","last_became_active":"2024-04-23T18:29:17.510429+0000","last_became_peered":"2024-04-23T18:29:17.510429+0000","last_unstale":"2024-04-23T18:32:43.296594+0000","last_undegraded":"2024-04-23T18:32:43.296594+0000","last_fullsized":"2024-04-23T18:32:43.296594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:43.296501+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:43.296501+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.296501+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:18.685380+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.936215+0000","last_change":"2024-04-23T18:32:32.936254+0000","last_active":"2024-04-23T18:32:32.936215+0000","last_peered":"2024-04-23T18:32:32.936215+0000","last_clean":"2024-04-23T18:32:32.936215+0000","last_became_active":"2024-04-23T18:29:19.518543+0000","last_became_peered":"2024-04-23T18:29:19.518543+0000","last_unstale":"2024-04-23T18:32:32.936215+0000","last_undegraded":"2024-04-23T18:32:32.936215+0000","last_fullsized":"2024-04-23T18:32:32.936215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.936101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.936101+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.936101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:36.879163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:51.764880+0000","last_change":"2024-04-23T18:29:21.534350+0000","last_active":"2024-04-23T18:31:51.764880+0000","last_peered":"2024-04-23T18:31:51.764880+0000","last_clean":"2024-04-23T18:31:51.764880+0000","last_became_active":"2024-04-23T18:29:21.534023+0000","last_became_peered":"2024-04-23T18:29:21.534023+0000","last_unstale":"2024-04-23T18:31:51.764880+0000","last_undegraded":"2024-04-23T18:31:51.764880+0000","last_fullsized":"2024-04-23T18:31:51.764880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'20","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.520369+0000","last_change":"2024-04-23T18:33:06.520421+0000","last_active":"2024-04-23T18:33:06.520369+0000","last_peered":"2024-04-23T18:33:06.520369+0000","last_clean":"2024-04-23T18:33:06.520369+0000","last_became_active":"2024-04-23T18:29:13.500877+0000","last_became_peered":"2024-04-23T18:29:13.500877+0000","last_unstale":"2024-04-23T18:33:06.520369+0000","last_undegraded":"2024-04-23T18:33:06.520369+0000","last_fullsized":"2024-04-23T18:33:06.520369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-04-23T18:33:06.520272+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-04-23T18:33:06.520272+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.520272+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:51.378293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":53,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761652+0000","last_change":"2024-04-23T18:29:11.498275+0000","last_active":"2024-04-23T18:31:36.761652+0000","last_peered":"2024-04-23T18:31:36.761652+0000","last_clean":"2024-04-23T18:31:36.761652+0000","last_became_active":"2024-04-23T18:29:11.497953+0000","last_became_peered":"2024-04-23T18:29:11.497953+0000","last_unstale":"2024-04-23T18:31:36.761652+0000","last_undegraded":"2024-04-23T18:31:36.761652+0000","last_fullsized":"2024-04-23T18:31:36.761652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.458609+0000","last_change":"2024-04-23T18:32:41.458630+0000","last_active":"2024-04-23T18:32:41.458609+0000","last_peered":"2024-04-23T18:32:41.458609+0000","last_clean":"2024-04-23T18:32:41.458609+0000","last_became_active":"2024-04-23T18:29:15.507253+0000","last_became_peered":"2024-04-23T18:29:15.507253+0000","last_unstale":"2024-04-23T18:32:41.458609+0000","last_undegraded":"2024-04-23T18:32:41.458609+0000","last_fullsized":"2024-04-23T18:32:41.458609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:41.458516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:41.458516+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.458516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:55:39.924778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.406718+0000","last_change":"2024-04-23T18:32:43.406751+0000","last_active":"2024-04-23T18:32:43.406718+0000","last_peered":"2024-04-23T18:32:43.406718+0000","last_clean":"2024-04-23T18:32:43.406718+0000","last_became_active":"2024-04-23T18:29:17.512820+0000","last_became_peered":"2024-04-23T18:29:17.512820+0000","last_unstale":"2024-04-23T18:32:43.406718+0000","last_undegraded":"2024-04-23T18:32:43.406718+0000","last_fullsized":"2024-04-23T18:32:43.406718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:43.406635+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:43.406635+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.406635+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:40.517887+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.355989+0000","last_change":"2024-04-23T18:32:35.356012+0000","last_active":"2024-04-23T18:32:35.355989+0000","last_peered":"2024-04-23T18:32:35.355989+0000","last_clean":"2024-04-23T18:32:35.355989+0000","last_became_active":"2024-04-23T18:29:19.525424+0000","last_became_peered":"2024-04-23T18:29:19.525424+0000","last_unstale":"2024-04-23T18:32:35.355989+0000","last_undegraded":"2024-04-23T18:32:35.355989+0000","last_fullsized":"2024-04-23T18:32:35.355989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.355896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.355896+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.355896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:58:38.926439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.192066+0000","last_change":"2024-04-23T18:29:13.496471+0000","last_active":"2024-04-23T18:32:21.192066+0000","last_peered":"2024-04-23T18:32:21.192066+0000","last_clean":"2024-04-23T18:32:21.192066+0000","last_became_active":"2024-04-23T18:29:13.496179+0000","last_became_peered":"2024-04-23T18:29:13.496179+0000","last_unstale":"2024-04-23T18:32:21.192066+0000","last_undegraded":"2024-04-23T18:32:21.192066+0000","last_fullsized":"2024-04-23T18:32:21.192066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762448+0000","last_change":"2024-04-23T18:29:11.500546+0000","last_active":"2024-04-23T18:31:36.762448+0000","last_peered":"2024-04-23T18:31:36.762448+0000","last_clean":"2024-04-23T18:31:36.762448+0000","last_became_active":"2024-04-23T18:29:11.500118+0000","last_became_peered":"2024-04-23T18:29:11.500118+0000","last_unstale":"2024-04-23T18:31:36.762448+0000","last_undegraded":"2024-04-23T18:31:36.762448+0000","last_fullsized":"2024-04-23T18:31:36.762448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.230024+0000","last_change":"2024-04-23T18:32:54.230060+0000","last_active":"2024-04-23T18:32:54.230024+0000","last_peered":"2024-04-23T18:32:54.230024+0000","last_clean":"2024-04-23T18:32:54.230024+0000","last_became_active":"2024-04-23T18:29:15.506197+0000","last_became_peered":"2024-04-23T18:29:15.506197+0000","last_unstale":"2024-04-23T18:32:54.230024+0000","last_undegraded":"2024-04-23T18:32:54.230024+0000","last_fullsized":"2024-04-23T18:32:54.230024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:54.229932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:54.229932+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.229932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:45:57.110850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'66","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.328809+0000","last_change":"2024-04-23T18:32:39.328853+0000","last_active":"2024-04-23T18:32:39.328809+0000","last_peered":"2024-04-23T18:32:39.328809+0000","last_clean":"2024-04-23T18:32:39.328809+0000","last_became_active":"2024-04-23T18:29:17.514800+0000","last_became_peered":"2024-04-23T18:29:17.514800+0000","last_unstale":"2024-04-23T18:32:39.328809+0000","last_undegraded":"2024-04-23T18:32:39.328809+0000","last_fullsized":"2024-04-23T18:32:39.328809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-04-23T18:32:39.328706+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-04-23T18:32:39.328706+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.328706+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:44:56.598841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.370215+0000","last_change":"2024-04-23T18:32:36.370241+0000","last_active":"2024-04-23T18:32:36.370215+0000","last_peered":"2024-04-23T18:32:36.370215+0000","last_clean":"2024-04-23T18:32:36.370215+0000","last_became_active":"2024-04-23T18:29:19.524351+0000","last_became_peered":"2024-04-23T18:29:19.524351+0000","last_unstale":"2024-04-23T18:32:36.370215+0000","last_undegraded":"2024-04-23T18:32:36.370215+0000","last_fullsized":"2024-04-23T18:32:36.370215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.370129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.370129+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.370129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:58.907049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:44.760250+0000","last_change":"2024-04-23T18:29:21.529140+0000","last_active":"2024-04-23T18:31:44.760250+0000","last_peered":"2024-04-23T18:31:44.760250+0000","last_clean":"2024-04-23T18:31:44.760250+0000","last_became_active":"2024-04-23T18:29:21.528819+0000","last_became_peered":"2024-04-23T18:29:21.528819+0000","last_unstale":"2024-04-23T18:31:44.760250+0000","last_undegraded":"2024-04-23T18:31:44.760250+0000","last_fullsized":"2024-04-23T18:31:44.760250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:14.755799+0000","last_change":"2024-04-23T18:29:13.499526+0000","last_active":"2024-04-23T18:31:14.755799+0000","last_peered":"2024-04-23T18:31:14.755799+0000","last_clean":"2024-04-23T18:31:14.755799+0000","last_became_active":"2024-04-23T18:29:13.499137+0000","last_became_peered":"2024-04-23T18:29:13.499137+0000","last_unstale":"2024-04-23T18:31:14.755799+0000","last_undegraded":"2024-04-23T18:31:14.755799+0000","last_fullsized":"2024-04-23T18:31:14.755799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.761426+0000","last_change":"2024-04-23T18:29:11.500980+0000","last_active":"2024-04-23T18:31:36.761426+0000","last_peered":"2024-04-23T18:31:36.761426+0000","last_clean":"2024-04-23T18:31:36.761426+0000","last_became_active":"2024-04-23T18:29:11.500584+0000","last_became_peered":"2024-04-23T18:29:11.500584+0000","last_unstale":"2024-04-23T18:31:36.761426+0000","last_undegraded":"2024-04-23T18:31:36.761426+0000","last_fullsized":"2024-04-23T18:31:36.761426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.494478+0000","last_change":"2024-04-23T18:32:51.494521+0000","last_active":"2024-04-23T18:32:51.494478+0000","last_peered":"2024-04-23T18:32:51.494478+0000","last_clean":"2024-04-23T18:32:51.494478+0000","last_became_active":"2024-04-23T18:29:15.503315+0000","last_became_peered":"2024-04-23T18:29:15.503315+0000","last_unstale":"2024-04-23T18:32:51.494478+0000","last_undegraded":"2024-04-23T18:32:51.494478+0000","last_fullsized":"2024-04-23T18:32:51.494478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:51.494354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:51.494354+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.494354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:13.705269+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.449417+0000","last_change":"2024-04-23T18:33:00.449461+0000","last_active":"2024-04-23T18:33:00.449417+0000","last_peered":"2024-04-23T18:33:00.449417+0000","last_clean":"2024-04-23T18:33:00.449417+0000","last_became_active":"2024-04-23T18:29:17.516934+0000","last_became_peered":"2024-04-23T18:29:17.516934+0000","last_unstale":"2024-04-23T18:33:00.449417+0000","last_undegraded":"2024-04-23T18:33:00.449417+0000","last_fullsized":"2024-04-23T18:33:00.449417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-23T18:33:00.449324+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-23T18:33:00.449324+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.449324+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:16.722855+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:31.933324+0000","last_change":"2024-04-23T18:32:31.933350+0000","last_active":"2024-04-23T18:32:31.933324+0000","last_peered":"2024-04-23T18:32:31.933324+0000","last_clean":"2024-04-23T18:32:31.933324+0000","last_became_active":"2024-04-23T18:29:19.519854+0000","last_became_peered":"2024-04-23T18:29:19.519854+0000","last_unstale":"2024-04-23T18:32:31.933324+0000","last_undegraded":"2024-04-23T18:32:31.933324+0000","last_fullsized":"2024-04-23T18:32:31.933324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:31.933225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:31.933225+0000","last_clean_scrub_stamp":"2024-04-23T18:32:31.933225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:09.747281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763296+0000","last_change":"2024-04-23T18:29:21.534768+0000","last_active":"2024-04-23T18:31:41.763296+0000","last_peered":"2024-04-23T18:31:41.763296+0000","last_clean":"2024-04-23T18:31:41.763296+0000","last_became_active":"2024-04-23T18:29:21.534487+0000","last_became_peered":"2024-04-23T18:29:21.534487+0000","last_unstale":"2024-04-23T18:31:41.763296+0000","last_undegraded":"2024-04-23T18:31:41.763296+0000","last_fullsized":"2024-04-23T18:31:41.763296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.425530+0000","last_change":"2024-04-23T18:32:48.425557+0000","last_active":"2024-04-23T18:32:48.425530+0000","last_peered":"2024-04-23T18:32:48.425530+0000","last_clean":"2024-04-23T18:32:48.425530+0000","last_became_active":"2024-04-23T18:29:13.502710+0000","last_became_peered":"2024-04-23T18:29:13.502710+0000","last_unstale":"2024-04-23T18:32:48.425530+0000","last_undegraded":"2024-04-23T18:32:48.425530+0000","last_fullsized":"2024-04-23T18:32:48.425530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:48.425438+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:48.425438+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.425438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:21.214995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.762335+0000","last_change":"2024-04-23T18:29:11.498320+0000","last_active":"2024-04-23T18:31:41.762335+0000","last_peered":"2024-04-23T18:31:41.762335+0000","last_clean":"2024-04-23T18:31:41.762335+0000","last_became_active":"2024-04-23T18:29:11.497191+0000","last_became_peered":"2024-04-23T18:29:11.497191+0000","last_unstale":"2024-04-23T18:31:41.762335+0000","last_undegraded":"2024-04-23T18:31:41.762335+0000","last_fullsized":"2024-04-23T18:31:41.762335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.464891+0000","last_change":"2024-04-23T18:32:52.464923+0000","last_active":"2024-04-23T18:32:52.464891+0000","last_peered":"2024-04-23T18:32:52.464891+0000","last_clean":"2024-04-23T18:32:52.464891+0000","last_became_active":"2024-04-23T18:29:15.501957+0000","last_became_peered":"2024-04-23T18:29:15.501957+0000","last_unstale":"2024-04-23T18:32:52.464891+0000","last_undegraded":"2024-04-23T18:32:52.464891+0000","last_fullsized":"2024-04-23T18:32:52.464891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:52.464769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:52.464769+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.464769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:12.012567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.245650+0000","last_change":"2024-04-23T18:32:45.245695+0000","last_active":"2024-04-23T18:32:45.245650+0000","last_peered":"2024-04-23T18:32:45.245650+0000","last_clean":"2024-04-23T18:32:45.245650+0000","last_became_active":"2024-04-23T18:29:17.503196+0000","last_became_peered":"2024-04-23T18:29:17.503196+0000","last_unstale":"2024-04-23T18:32:45.245650+0000","last_undegraded":"2024-04-23T18:32:45.245650+0000","last_fullsized":"2024-04-23T18:32:45.245650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:45.245551+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:45.245551+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.245551+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:00.152459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.211175+0000","last_change":"2024-04-23T18:32:56.211198+0000","last_active":"2024-04-23T18:32:56.211175+0000","last_peered":"2024-04-23T18:32:56.211175+0000","last_clean":"2024-04-23T18:32:56.211175+0000","last_became_active":"2024-04-23T18:29:19.527687+0000","last_became_peered":"2024-04-23T18:29:19.527687+0000","last_unstale":"2024-04-23T18:32:56.211175+0000","last_undegraded":"2024-04-23T18:32:56.211175+0000","last_fullsized":"2024-04-23T18:32:56.211175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:56.211082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:56.211082+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.211082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:29.050437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763279+0000","last_change":"2024-04-23T18:29:21.534054+0000","last_active":"2024-04-23T18:31:41.763279+0000","last_peered":"2024-04-23T18:31:41.763279+0000","last_clean":"2024-04-23T18:31:41.763279+0000","last_became_active":"2024-04-23T18:29:21.533754+0000","last_became_peered":"2024-04-23T18:29:21.533754+0000","last_unstale":"2024-04-23T18:31:41.763279+0000","last_undegraded":"2024-04-23T18:31:41.763279+0000","last_fullsized":"2024-04-23T18:31:41.763279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:20.912182+0000","last_change":"2024-04-23T18:29:13.497462+0000","last_active":"2024-04-23T18:32:20.912182+0000","last_peered":"2024-04-23T18:32:20.912182+0000","last_clean":"2024-04-23T18:32:20.912182+0000","last_became_active":"2024-04-23T18:29:13.497121+0000","last_became_peered":"2024-04-23T18:29:13.497121+0000","last_unstale":"2024-04-23T18:32:20.912182+0000","last_undegraded":"2024-04-23T18:32:20.912182+0000","last_fullsized":"2024-04-23T18:32:20.912182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763331+0000","last_change":"2024-04-23T18:29:11.504900+0000","last_active":"2024-04-23T18:31:41.763331+0000","last_peered":"2024-04-23T18:31:41.763331+0000","last_clean":"2024-04-23T18:31:41.763331+0000","last_became_active":"2024-04-23T18:29:11.504564+0000","last_became_peered":"2024-04-23T18:29:11.504564+0000","last_unstale":"2024-04-23T18:31:41.763331+0000","last_undegraded":"2024-04-23T18:31:41.763331+0000","last_fullsized":"2024-04-23T18:31:41.763331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.918227+0000","last_change":"2024-04-23T18:32:50.918254+0000","last_active":"2024-04-23T18:32:50.918227+0000","last_peered":"2024-04-23T18:32:50.918227+0000","last_clean":"2024-04-23T18:32:50.918227+0000","last_became_active":"2024-04-23T18:29:15.506171+0000","last_became_peered":"2024-04-23T18:29:15.506171+0000","last_unstale":"2024-04-23T18:32:50.918227+0000","last_undegraded":"2024-04-23T18:32:50.918227+0000","last_fullsized":"2024-04-23T18:32:50.918227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.918119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.918119+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.918119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:12.800419+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.419533+0000","last_change":"2024-04-23T18:32:57.419573+0000","last_active":"2024-04-23T18:32:57.419533+0000","last_peered":"2024-04-23T18:32:57.419533+0000","last_clean":"2024-04-23T18:32:57.419533+0000","last_became_active":"2024-04-23T18:29:17.517051+0000","last_became_peered":"2024-04-23T18:29:17.517051+0000","last_unstale":"2024-04-23T18:32:57.419533+0000","last_undegraded":"2024-04-23T18:32:57.419533+0000","last_fullsized":"2024-04-23T18:32:57.419533+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-23T18:32:57.419450+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-23T18:32:57.419450+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.419450+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:03.100050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":378,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.362588+0000","last_change":"2024-04-23T18:32:41.362652+0000","last_active":"2024-04-23T18:32:41.362588+0000","last_peered":"2024-04-23T18:32:41.362588+0000","last_clean":"2024-04-23T18:32:41.362588+0000","last_became_active":"2024-04-23T18:29:19.527614+0000","last_became_peered":"2024-04-23T18:29:19.527614+0000","last_unstale":"2024-04-23T18:32:41.362588+0000","last_undegraded":"2024-04-23T18:32:41.362588+0000","last_fullsized":"2024-04-23T18:32:41.362588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:41.362491+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:41.362491+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.362491+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:25:00.632414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763197+0000","last_change":"2024-04-23T18:29:21.531583+0000","last_active":"2024-04-23T18:31:41.763197+0000","last_peered":"2024-04-23T18:31:41.763197+0000","last_clean":"2024-04-23T18:31:41.763197+0000","last_became_active":"2024-04-23T18:29:21.530619+0000","last_became_peered":"2024-04-23T18:29:21.530619+0000","last_unstale":"2024-04-23T18:31:41.763197+0000","last_undegraded":"2024-04-23T18:31:41.763197+0000","last_fullsized":"2024-04-23T18:31:41.763197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.394288+0000","last_change":"2024-04-23T18:33:03.394334+0000","last_active":"2024-04-23T18:33:03.394288+0000","last_peered":"2024-04-23T18:33:03.394288+0000","last_clean":"2024-04-23T18:33:03.394288+0000","last_became_active":"2024-04-23T18:29:13.501741+0000","last_became_peered":"2024-04-23T18:29:13.501741+0000","last_unstale":"2024-04-23T18:33:03.394288+0000","last_undegraded":"2024-04-23T18:33:03.394288+0000","last_fullsized":"2024-04-23T18:33:03.394288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:03.394147+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:03.394147+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.394147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:25.573714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.762401+0000","last_change":"2024-04-23T18:29:11.501098+0000","last_active":"2024-04-23T18:31:41.762401+0000","last_peered":"2024-04-23T18:31:41.762401+0000","last_clean":"2024-04-23T18:31:41.762401+0000","last_became_active":"2024-04-23T18:29:11.500781+0000","last_became_peered":"2024-04-23T18:29:11.500781+0000","last_unstale":"2024-04-23T18:31:41.762401+0000","last_undegraded":"2024-04-23T18:31:41.762401+0000","last_fullsized":"2024-04-23T18:31:41.762401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.763087+0000","last_change":"2024-04-23T18:29:52.550289+0000","last_active":"2024-04-23T18:31:46.763087+0000","last_peered":"2024-04-23T18:31:46.763087+0000","last_clean":"2024-04-23T18:31:46.763087+0000","last_became_active":"2024-04-23T18:29:52.549944+0000","last_became_peered":"2024-04-23T18:29:52.549944+0000","last_unstale":"2024-04-23T18:31:46.763087+0000","last_undegraded":"2024-04-23T18:31:46.763087+0000","last_fullsized":"2024-04-23T18:31:46.763087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:14.475628+0000","last_clean_scrub_stamp":"2024-04-23T18:29:14.475628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.837445+0000","last_change":"2024-04-23T18:32:41.837483+0000","last_active":"2024-04-23T18:32:41.837445+0000","last_peered":"2024-04-23T18:32:41.837445+0000","last_clean":"2024-04-23T18:32:41.837445+0000","last_became_active":"2024-04-23T18:29:17.509076+0000","last_became_peered":"2024-04-23T18:29:17.509076+0000","last_unstale":"2024-04-23T18:32:41.837445+0000","last_undegraded":"2024-04-23T18:32:41.837445+0000","last_fullsized":"2024-04-23T18:32:41.837445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-23T18:32:41.837343+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-23T18:32:41.837343+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.837343+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:11.245831+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.466736+0000","last_change":"2024-04-23T18:32:32.466759+0000","last_active":"2024-04-23T18:32:32.466736+0000","last_peered":"2024-04-23T18:32:32.466736+0000","last_clean":"2024-04-23T18:32:32.466736+0000","last_became_active":"2024-04-23T18:29:19.518673+0000","last_became_peered":"2024-04-23T18:29:19.518673+0000","last_unstale":"2024-04-23T18:32:32.466736+0000","last_undegraded":"2024-04-23T18:32:32.466736+0000","last_fullsized":"2024-04-23T18:32:32.466736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.466649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.466649+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.466649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:22:40.471567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.763176+0000","last_change":"2024-04-23T18:29:21.533731+0000","last_active":"2024-04-23T18:31:46.763176+0000","last_peered":"2024-04-23T18:31:46.763176+0000","last_clean":"2024-04-23T18:31:46.763176+0000","last_became_active":"2024-04-23T18:29:21.533187+0000","last_became_peered":"2024-04-23T18:29:21.533187+0000","last_unstale":"2024-04-23T18:31:46.763176+0000","last_undegraded":"2024-04-23T18:31:46.763176+0000","last_fullsized":"2024-04-23T18:31:46.763176+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.441100+0000","last_change":"2024-04-23T18:33:05.441126+0000","last_active":"2024-04-23T18:33:05.441100+0000","last_peered":"2024-04-23T18:33:05.441100+0000","last_clean":"2024-04-23T18:33:05.441100+0000","last_became_active":"2024-04-23T18:29:13.501974+0000","last_became_peered":"2024-04-23T18:29:13.501974+0000","last_unstale":"2024-04-23T18:33:05.441100+0000","last_undegraded":"2024-04-23T18:33:05.441100+0000","last_fullsized":"2024-04-23T18:33:05.441100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:05.441015+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:05.441015+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.441015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:46.321194+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763395+0000","last_change":"2024-04-23T18:29:11.511621+0000","last_active":"2024-04-23T18:31:41.763395+0000","last_peered":"2024-04-23T18:31:41.763395+0000","last_clean":"2024-04-23T18:31:41.763395+0000","last_became_active":"2024-04-23T18:29:11.511297+0000","last_became_peered":"2024-04-23T18:29:11.511297+0000","last_unstale":"2024-04-23T18:31:41.763395+0000","last_undegraded":"2024-04-23T18:31:41.763395+0000","last_fullsized":"2024-04-23T18:31:41.763395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.503698+0000","last_change":"2024-04-23T18:32:50.503761+0000","last_active":"2024-04-23T18:32:50.503698+0000","last_peered":"2024-04-23T18:32:50.503698+0000","last_clean":"2024-04-23T18:32:50.503698+0000","last_became_active":"2024-04-23T18:29:15.504528+0000","last_became_peered":"2024-04-23T18:29:15.504528+0000","last_unstale":"2024-04-23T18:32:50.503698+0000","last_undegraded":"2024-04-23T18:32:50.503698+0000","last_fullsized":"2024-04-23T18:32:50.503698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.503597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.503597+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.503597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:20:31.588182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.345447+0000","last_change":"2024-04-23T18:32:42.345524+0000","last_active":"2024-04-23T18:32:42.345447+0000","last_peered":"2024-04-23T18:32:42.345447+0000","last_clean":"2024-04-23T18:32:42.345447+0000","last_became_active":"2024-04-23T18:29:17.513482+0000","last_became_peered":"2024-04-23T18:29:17.513482+0000","last_unstale":"2024-04-23T18:32:42.345447+0000","last_undegraded":"2024-04-23T18:32:42.345447+0000","last_fullsized":"2024-04-23T18:32:42.345447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:42.345340+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:42.345340+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.345340+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:11.159885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.418774+0000","last_change":"2024-04-23T18:33:11.418829+0000","last_active":"2024-04-23T18:33:11.418774+0000","last_peered":"2024-04-23T18:33:11.418774+0000","last_clean":"2024-04-23T18:33:11.418774+0000","last_became_active":"2024-04-23T18:29:19.525985+0000","last_became_peered":"2024-04-23T18:29:19.525985+0000","last_unstale":"2024-04-23T18:33:11.418774+0000","last_undegraded":"2024-04-23T18:33:11.418774+0000","last_fullsized":"2024-04-23T18:33:11.418774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:11.418670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:11.418670+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.418670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:53.730800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.764206+0000","last_change":"2024-04-23T18:29:21.528945+0000","last_active":"2024-04-23T18:31:46.764206+0000","last_peered":"2024-04-23T18:31:46.764206+0000","last_clean":"2024-04-23T18:31:46.764206+0000","last_became_active":"2024-04-23T18:29:21.528665+0000","last_became_peered":"2024-04-23T18:29:21.528665+0000","last_unstale":"2024-04-23T18:31:46.764206+0000","last_undegraded":"2024-04-23T18:31:46.764206+0000","last_fullsized":"2024-04-23T18:31:46.764206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763258+0000","last_change":"2024-04-23T18:29:13.495164+0000","last_active":"2024-04-23T18:31:41.763258+0000","last_peered":"2024-04-23T18:31:41.763258+0000","last_clean":"2024-04-23T18:31:41.763258+0000","last_became_active":"2024-04-23T18:29:13.494647+0000","last_became_peered":"2024-04-23T18:29:13.494647+0000","last_unstale":"2024-04-23T18:31:41.763258+0000","last_undegraded":"2024-04-23T18:31:41.763258+0000","last_fullsized":"2024-04-23T18:31:41.763258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.286296+0000","last_change":"2024-04-23T18:33:03.286325+0000","last_active":"2024-04-23T18:33:03.286296+0000","last_peered":"2024-04-23T18:33:03.286296+0000","last_clean":"2024-04-23T18:33:03.286296+0000","last_became_active":"2024-04-23T18:29:11.495723+0000","last_became_peered":"2024-04-23T18:29:11.495723+0000","last_unstale":"2024-04-23T18:33:03.286296+0000","last_undegraded":"2024-04-23T18:33:03.286296+0000","last_fullsized":"2024-04-23T18:33:03.286296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:03.286196+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:03.286196+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.286196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:59:50.509925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.847864+0000","last_change":"2024-04-23T18:32:42.847886+0000","last_active":"2024-04-23T18:32:42.847864+0000","last_peered":"2024-04-23T18:32:42.847864+0000","last_clean":"2024-04-23T18:32:42.847864+0000","last_became_active":"2024-04-23T18:29:15.510185+0000","last_became_peered":"2024-04-23T18:29:15.510185+0000","last_unstale":"2024-04-23T18:32:42.847864+0000","last_undegraded":"2024-04-23T18:32:42.847864+0000","last_fullsized":"2024-04-23T18:32:42.847864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:42.847777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:42.847777+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.847777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:20:23.932361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'34","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.386198+0000","last_change":"2024-04-23T18:32:58.386231+0000","last_active":"2024-04-23T18:32:58.386198+0000","last_peered":"2024-04-23T18:32:58.386198+0000","last_clean":"2024-04-23T18:32:58.386198+0000","last_became_active":"2024-04-23T18:29:17.516989+0000","last_became_peered":"2024-04-23T18:29:17.516989+0000","last_unstale":"2024-04-23T18:32:58.386198+0000","last_undegraded":"2024-04-23T18:32:58.386198+0000","last_fullsized":"2024-04-23T18:32:58.386198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-04-23T18:32:58.386098+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-04-23T18:32:58.386098+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.386098+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:39.139901+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":38,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.462758+0000","last_change":"2024-04-23T18:32:54.462797+0000","last_active":"2024-04-23T18:32:54.462758+0000","last_peered":"2024-04-23T18:32:54.462758+0000","last_clean":"2024-04-23T18:32:54.462758+0000","last_became_active":"2024-04-23T18:29:19.522217+0000","last_became_peered":"2024-04-23T18:29:19.522217+0000","last_unstale":"2024-04-23T18:32:54.462758+0000","last_undegraded":"2024-04-23T18:32:54.462758+0000","last_fullsized":"2024-04-23T18:32:54.462758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:54.462671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:54.462671+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.462671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:02:37.395360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.764140+0000","last_change":"2024-04-23T18:29:21.533465+0000","last_active":"2024-04-23T18:31:46.764140+0000","last_peered":"2024-04-23T18:31:46.764140+0000","last_clean":"2024-04-23T18:31:46.764140+0000","last_became_active":"2024-04-23T18:29:21.533152+0000","last_became_peered":"2024-04-23T18:29:21.533152+0000","last_unstale":"2024-04-23T18:31:46.764140+0000","last_undegraded":"2024-04-23T18:31:46.764140+0000","last_fullsized":"2024-04-23T18:31:46.764140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.413635+0000","last_change":"2024-04-23T18:33:07.413678+0000","last_active":"2024-04-23T18:33:07.413635+0000","last_peered":"2024-04-23T18:33:07.413635+0000","last_clean":"2024-04-23T18:33:07.413635+0000","last_became_active":"2024-04-23T18:29:13.501782+0000","last_became_peered":"2024-04-23T18:29:13.501782+0000","last_unstale":"2024-04-23T18:33:07.413635+0000","last_undegraded":"2024-04-23T18:33:07.413635+0000","last_fullsized":"2024-04-23T18:33:07.413635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:07.413496+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:07.413496+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.413496+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:45.543382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.946571+0000","last_change":"2024-04-23T18:33:10.946596+0000","last_active":"2024-04-23T18:33:10.946571+0000","last_peered":"2024-04-23T18:33:10.946571+0000","last_clean":"2024-04-23T18:33:10.946571+0000","last_became_active":"2024-04-23T18:29:11.501648+0000","last_became_peered":"2024-04-23T18:29:11.501648+0000","last_unstale":"2024-04-23T18:33:10.946571+0000","last_undegraded":"2024-04-23T18:33:10.946571+0000","last_fullsized":"2024-04-23T18:33:10.946571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:10.946483+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:10.946483+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.946483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:32.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.904576+0000","last_change":"2024-04-23T18:32:44.904604+0000","last_active":"2024-04-23T18:32:44.904576+0000","last_peered":"2024-04-23T18:32:44.904576+0000","last_clean":"2024-04-23T18:32:44.904576+0000","last_became_active":"2024-04-23T18:29:15.509725+0000","last_became_peered":"2024-04-23T18:29:15.509725+0000","last_unstale":"2024-04-23T18:32:44.904576+0000","last_undegraded":"2024-04-23T18:32:44.904576+0000","last_fullsized":"2024-04-23T18:32:44.904576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-23T18:32:44.904494+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-23T18:32:44.904494+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.904494+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:04.452291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.413489+0000","last_change":"2024-04-23T18:33:02.413529+0000","last_active":"2024-04-23T18:33:02.413489+0000","last_peered":"2024-04-23T18:33:02.413489+0000","last_clean":"2024-04-23T18:33:02.413489+0000","last_became_active":"2024-04-23T18:29:17.514823+0000","last_became_peered":"2024-04-23T18:29:17.514823+0000","last_unstale":"2024-04-23T18:33:02.413489+0000","last_undegraded":"2024-04-23T18:33:02.413489+0000","last_fullsized":"2024-04-23T18:33:02.413489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-04-23T18:33:02.413401+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-04-23T18:33:02.413401+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.413401+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:18.372633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.280462+0000","last_change":"2024-04-23T18:32:40.280484+0000","last_active":"2024-04-23T18:32:40.280462+0000","last_peered":"2024-04-23T18:32:40.280462+0000","last_clean":"2024-04-23T18:32:40.280462+0000","last_became_active":"2024-04-23T18:29:19.519153+0000","last_became_peered":"2024-04-23T18:29:19.519153+0000","last_unstale":"2024-04-23T18:32:40.280462+0000","last_undegraded":"2024-04-23T18:32:40.280462+0000","last_fullsized":"2024-04-23T18:32:40.280462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:40.280370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:40.280370+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.280370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:40.211480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.008771+0000","last_change":"2024-04-23T18:29:21.529659+0000","last_active":"2024-04-23T18:32:21.008771+0000","last_peered":"2024-04-23T18:32:21.008771+0000","last_clean":"2024-04-23T18:32:21.008771+0000","last_became_active":"2024-04-23T18:29:21.529331+0000","last_became_peered":"2024-04-23T18:29:21.529331+0000","last_unstale":"2024-04-23T18:32:21.008771+0000","last_undegraded":"2024-04-23T18:32:21.008771+0000","last_fullsized":"2024-04-23T18:32:21.008771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223218+0000","last_change":"2024-04-23T18:29:52.563032+0000","last_active":"2024-04-23T18:32:21.223218+0000","last_peered":"2024-04-23T18:32:21.223218+0000","last_clean":"2024-04-23T18:32:21.223218+0000","last_became_active":"2024-04-23T18:29:52.551523+0000","last_became_peered":"2024-04-23T18:29:52.551523+0000","last_unstale":"2024-04-23T18:32:21.223218+0000","last_undegraded":"2024-04-23T18:32:21.223218+0000","last_fullsized":"2024-04-23T18:32:21.223218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.409615+0000","last_change":"2024-04-23T18:33:06.409650+0000","last_active":"2024-04-23T18:33:06.409615+0000","last_peered":"2024-04-23T18:33:06.409615+0000","last_clean":"2024-04-23T18:33:06.409615+0000","last_became_active":"2024-04-23T18:29:11.489284+0000","last_became_peered":"2024-04-23T18:29:11.489284+0000","last_unstale":"2024-04-23T18:33:06.409615+0000","last_undegraded":"2024-04-23T18:33:06.409615+0000","last_fullsized":"2024-04-23T18:33:06.409615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:06.409508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:06.409508+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.409508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.085219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.191180+0000","last_change":"2024-04-23T18:33:06.191207+0000","last_active":"2024-04-23T18:33:06.191180+0000","last_peered":"2024-04-23T18:33:06.191180+0000","last_clean":"2024-04-23T18:33:06.191180+0000","last_became_active":"2024-04-23T18:29:13.496958+0000","last_became_peered":"2024-04-23T18:29:13.496958+0000","last_unstale":"2024-04-23T18:33:06.191180+0000","last_undegraded":"2024-04-23T18:33:06.191180+0000","last_fullsized":"2024-04-23T18:33:06.191180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:06.191085+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:06.191085+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.191085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:46:01.648450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756515+0000","last_change":"2024-04-23T18:29:11.487639+0000","last_active":"2024-04-23T18:31:19.756515+0000","last_peered":"2024-04-23T18:31:19.756515+0000","last_clean":"2024-04-23T18:31:19.756515+0000","last_became_active":"2024-04-23T18:29:11.486563+0000","last_became_peered":"2024-04-23T18:29:11.486563+0000","last_unstale":"2024-04-23T18:31:19.756515+0000","last_undegraded":"2024-04-23T18:31:19.756515+0000","last_fullsized":"2024-04-23T18:31:19.756515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.191203+0000","last_change":"2024-04-23T18:29:13.494907+0000","last_active":"2024-04-23T18:32:21.191203+0000","last_peered":"2024-04-23T18:32:21.191203+0000","last_clean":"2024-04-23T18:32:21.191203+0000","last_became_active":"2024-04-23T18:29:13.494683+0000","last_became_peered":"2024-04-23T18:29:13.494683+0000","last_unstale":"2024-04-23T18:32:21.191203+0000","last_undegraded":"2024-04-23T18:32:21.191203+0000","last_fullsized":"2024-04-23T18:32:21.191203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.877505+0000","last_change":"2024-04-23T18:29:11.511297+0000","last_active":"2024-04-23T18:32:27.877505+0000","last_peered":"2024-04-23T18:32:27.877505+0000","last_clean":"2024-04-23T18:32:27.877505+0000","last_became_active":"2024-04-23T18:29:11.510971+0000","last_became_peered":"2024-04-23T18:29:11.510971+0000","last_unstale":"2024-04-23T18:32:27.877505+0000","last_undegraded":"2024-04-23T18:32:27.877505+0000","last_fullsized":"2024-04-23T18:32:27.877505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.219688+0000","last_change":"2024-04-23T18:33:08.219714+0000","last_active":"2024-04-23T18:33:08.219688+0000","last_peered":"2024-04-23T18:33:08.219688+0000","last_clean":"2024-04-23T18:33:08.219688+0000","last_became_active":"2024-04-23T18:29:13.497094+0000","last_became_peered":"2024-04-23T18:29:13.497094+0000","last_unstale":"2024-04-23T18:33:08.219688+0000","last_undegraded":"2024-04-23T18:33:08.219688+0000","last_fullsized":"2024-04-23T18:33:08.219688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:33:08.219588+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:33:08.219588+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.219588+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:10.922039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:19.756570+0000","last_change":"2024-04-23T18:29:11.492610+0000","last_active":"2024-04-23T18:31:19.756570+0000","last_peered":"2024-04-23T18:31:19.756570+0000","last_clean":"2024-04-23T18:31:19.756570+0000","last_became_active":"2024-04-23T18:29:11.492064+0000","last_became_peered":"2024-04-23T18:29:11.492064+0000","last_unstale":"2024-04-23T18:31:19.756570+0000","last_undegraded":"2024-04-23T18:31:19.756570+0000","last_fullsized":"2024-04-23T18:31:19.756570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.172484+0000","last_change":"2024-04-23T18:32:59.172545+0000","last_active":"2024-04-23T18:32:59.172484+0000","last_peered":"2024-04-23T18:32:59.172484+0000","last_clean":"2024-04-23T18:32:59.172484+0000","last_became_active":"2024-04-23T18:29:13.502243+0000","last_became_peered":"2024-04-23T18:29:13.502243+0000","last_unstale":"2024-04-23T18:32:59.172484+0000","last_undegraded":"2024-04-23T18:32:59.172484+0000","last_fullsized":"2024-04-23T18:32:59.172484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:59.172373+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:59.172373+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.172373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:11.409328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:24.757253+0000","last_change":"2024-04-23T18:29:11.486754+0000","last_active":"2024-04-23T18:31:24.757253+0000","last_peered":"2024-04-23T18:31:24.757253+0000","last_clean":"2024-04-23T18:31:24.757253+0000","last_became_active":"2024-04-23T18:29:11.486452+0000","last_became_peered":"2024-04-23T18:29:11.486452+0000","last_unstale":"2024-04-23T18:31:24.757253+0000","last_undegraded":"2024-04-23T18:31:24.757253+0000","last_fullsized":"2024-04-23T18:31:24.757253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.894237+0000","last_change":"2024-04-23T18:32:53.894295+0000","last_active":"2024-04-23T18:32:53.894237+0000","last_peered":"2024-04-23T18:32:53.894237+0000","last_clean":"2024-04-23T18:32:53.894237+0000","last_became_active":"2024-04-23T18:29:13.507582+0000","last_became_peered":"2024-04-23T18:29:13.507582+0000","last_unstale":"2024-04-23T18:32:53.894237+0000","last_undegraded":"2024-04-23T18:32:53.894237+0000","last_fullsized":"2024-04-23T18:32:53.894237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:53.894122+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:53.894122+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.894122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:12.522802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.759380+0000","last_change":"2024-04-23T18:29:11.495366+0000","last_active":"2024-04-23T18:31:21.759380+0000","last_peered":"2024-04-23T18:31:21.759380+0000","last_clean":"2024-04-23T18:31:21.759380+0000","last_became_active":"2024-04-23T18:29:11.493318+0000","last_became_peered":"2024-04-23T18:29:11.493318+0000","last_unstale":"2024-04-23T18:31:21.759380+0000","last_undegraded":"2024-04-23T18:31:21.759380+0000","last_fullsized":"2024-04-23T18:31:21.759380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'22","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.145367+0000","last_change":"2024-04-23T18:29:13.499537+0000","last_active":"2024-04-23T18:32:21.145367+0000","last_peered":"2024-04-23T18:32:21.145367+0000","last_clean":"2024-04-23T18:32:21.145367+0000","last_became_active":"2024-04-23T18:29:13.499155+0000","last_became_peered":"2024-04-23T18:29:13.499155+0000","last_unstale":"2024-04-23T18:32:21.145367+0000","last_undegraded":"2024-04-23T18:32:21.145367+0000","last_fullsized":"2024-04-23T18:32:21.145367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.369361+0000","last_change":"2024-04-23T18:33:08.369384+0000","last_active":"2024-04-23T18:33:08.369361+0000","last_peered":"2024-04-23T18:33:08.369361+0000","last_clean":"2024-04-23T18:33:08.369361+0000","last_became_active":"2024-04-23T18:29:11.485201+0000","last_became_peered":"2024-04-23T18:29:11.485201+0000","last_unstale":"2024-04-23T18:33:08.369361+0000","last_undegraded":"2024-04-23T18:33:08.369361+0000","last_fullsized":"2024-04-23T18:33:08.369361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:08.369275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:08.369275+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.369275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:55.252697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.937207+0000","last_change":"2024-04-23T18:33:09.937232+0000","last_active":"2024-04-23T18:33:09.937207+0000","last_peered":"2024-04-23T18:33:09.937207+0000","last_clean":"2024-04-23T18:33:09.937207+0000","last_became_active":"2024-04-23T18:29:13.495654+0000","last_became_peered":"2024-04-23T18:29:13.495654+0000","last_unstale":"2024-04-23T18:33:09.937207+0000","last_undegraded":"2024-04-23T18:33:09.937207+0000","last_fullsized":"2024-04-23T18:33:09.937207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:09.937116+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:09.937116+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.937116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:04.365933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.264060+0000","last_change":"2024-04-23T18:33:09.264085+0000","last_active":"2024-04-23T18:33:09.264060+0000","last_peered":"2024-04-23T18:33:09.264060+0000","last_clean":"2024-04-23T18:33:09.264060+0000","last_became_active":"2024-04-23T18:29:11.495224+0000","last_became_peered":"2024-04-23T18:29:11.495224+0000","last_unstale":"2024-04-23T18:33:09.264060+0000","last_undegraded":"2024-04-23T18:33:09.264060+0000","last_fullsized":"2024-04-23T18:33:09.264060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:09.263963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:09.263963+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.263963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:07.216912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.193995+0000","last_change":"2024-04-23T18:29:13.498009+0000","last_active":"2024-04-23T18:32:21.193995+0000","last_peered":"2024-04-23T18:32:21.193995+0000","last_clean":"2024-04-23T18:32:21.193995+0000","last_became_active":"2024-04-23T18:29:13.497588+0000","last_became_peered":"2024-04-23T18:29:13.497588+0000","last_unstale":"2024-04-23T18:32:21.193995+0000","last_undegraded":"2024-04-23T18:32:21.193995+0000","last_fullsized":"2024-04-23T18:32:21.193995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:21.760305+0000","last_change":"2024-04-23T18:29:11.496267+0000","last_active":"2024-04-23T18:31:21.760305+0000","last_peered":"2024-04-23T18:31:21.760305+0000","last_clean":"2024-04-23T18:31:21.760305+0000","last_became_active":"2024-04-23T18:29:11.495948+0000","last_became_peered":"2024-04-23T18:29:11.495948+0000","last_unstale":"2024-04-23T18:31:21.760305+0000","last_undegraded":"2024-04-23T18:31:21.760305+0000","last_fullsized":"2024-04-23T18:31:21.760305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.513942+0000","last_change":"2024-04-23T18:33:08.514007+0000","last_active":"2024-04-23T18:33:08.513942+0000","last_peered":"2024-04-23T18:33:08.513942+0000","last_clean":"2024-04-23T18:33:08.513942+0000","last_became_active":"2024-04-23T18:29:13.500819+0000","last_became_peered":"2024-04-23T18:29:13.500819+0000","last_unstale":"2024-04-23T18:33:08.513942+0000","last_undegraded":"2024-04-23T18:33:08.513942+0000","last_fullsized":"2024-04-23T18:33:08.513942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:08.513818+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:08.513818+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.513818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:15:06.432888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:29.758109+0000","last_change":"2024-04-23T18:29:11.493307+0000","last_active":"2024-04-23T18:31:29.758109+0000","last_peered":"2024-04-23T18:31:29.758109+0000","last_clean":"2024-04-23T18:31:29.758109+0000","last_became_active":"2024-04-23T18:29:11.492727+0000","last_became_peered":"2024-04-23T18:29:11.492727+0000","last_unstale":"2024-04-23T18:31:29.758109+0000","last_undegraded":"2024-04-23T18:31:29.758109+0000","last_fullsized":"2024-04-23T18:31:29.758109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.189954+0000","last_change":"2024-04-23T18:32:58.189982+0000","last_active":"2024-04-23T18:32:58.189954+0000","last_peered":"2024-04-23T18:32:58.189954+0000","last_clean":"2024-04-23T18:32:58.189954+0000","last_became_active":"2024-04-23T18:29:13.502835+0000","last_became_peered":"2024-04-23T18:29:13.502835+0000","last_unstale":"2024-04-23T18:32:58.189954+0000","last_undegraded":"2024-04-23T18:32:58.189954+0000","last_fullsized":"2024-04-23T18:32:58.189954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:58.189852+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:58.189852+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.189852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:33.304629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.118836+0000","last_change":"2024-04-23T18:29:11.500172+0000","last_active":"2024-04-23T18:32:21.118836+0000","last_peered":"2024-04-23T18:32:21.118836+0000","last_clean":"2024-04-23T18:32:21.118836+0000","last_became_active":"2024-04-23T18:29:11.498708+0000","last_became_peered":"2024-04-23T18:29:11.498708+0000","last_unstale":"2024-04-23T18:32:21.118836+0000","last_undegraded":"2024-04-23T18:32:21.118836+0000","last_fullsized":"2024-04-23T18:32:21.118836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.869995+0000","last_change":"2024-04-23T18:33:05.870040+0000","last_active":"2024-04-23T18:33:05.869995+0000","last_peered":"2024-04-23T18:33:05.869995+0000","last_clean":"2024-04-23T18:33:05.869995+0000","last_became_active":"2024-04-23T18:29:13.494121+0000","last_became_peered":"2024-04-23T18:29:13.494121+0000","last_unstale":"2024-04-23T18:33:05.869995+0000","last_undegraded":"2024-04-23T18:33:05.869995+0000","last_fullsized":"2024-04-23T18:33:05.869995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:05.869897+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:05.869897+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.869897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:04.336158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.760018+0000","last_change":"2024-04-23T18:29:11.490442+0000","last_active":"2024-04-23T18:31:26.760018+0000","last_peered":"2024-04-23T18:31:26.760018+0000","last_clean":"2024-04-23T18:31:26.760018+0000","last_became_active":"2024-04-23T18:29:11.489671+0000","last_became_peered":"2024-04-23T18:29:11.489671+0000","last_unstale":"2024-04-23T18:31:26.760018+0000","last_undegraded":"2024-04-23T18:31:26.760018+0000","last_fullsized":"2024-04-23T18:31:26.760018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.886463+0000","last_change":"2024-04-23T18:32:56.886490+0000","last_active":"2024-04-23T18:32:56.886463+0000","last_peered":"2024-04-23T18:32:56.886463+0000","last_clean":"2024-04-23T18:32:56.886463+0000","last_became_active":"2024-04-23T18:29:13.507438+0000","last_became_peered":"2024-04-23T18:29:13.507438+0000","last_unstale":"2024-04-23T18:32:56.886463+0000","last_undegraded":"2024-04-23T18:32:56.886463+0000","last_fullsized":"2024-04-23T18:32:56.886463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:56.886359+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:56.886359+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.886359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:27:39.704045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.876374+0000","last_change":"2024-04-23T18:29:11.511457+0000","last_active":"2024-04-23T18:32:27.876374+0000","last_peered":"2024-04-23T18:32:27.876374+0000","last_clean":"2024-04-23T18:32:27.876374+0000","last_became_active":"2024-04-23T18:29:11.510882+0000","last_became_peered":"2024-04-23T18:29:11.510882+0000","last_unstale":"2024-04-23T18:32:27.876374+0000","last_undegraded":"2024-04-23T18:32:27.876374+0000","last_fullsized":"2024-04-23T18:32:27.876374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.191779+0000","last_change":"2024-04-23T18:29:13.497528+0000","last_active":"2024-04-23T18:32:21.191779+0000","last_peered":"2024-04-23T18:32:21.191779+0000","last_clean":"2024-04-23T18:32:21.191779+0000","last_became_active":"2024-04-23T18:29:13.497271+0000","last_became_peered":"2024-04-23T18:29:13.497271+0000","last_unstale":"2024-04-23T18:32:21.191779+0000","last_undegraded":"2024-04-23T18:32:21.191779+0000","last_fullsized":"2024-04-23T18:32:21.191779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.761149+0000","last_change":"2024-04-23T18:29:11.507084+0000","last_active":"2024-04-23T18:31:26.761149+0000","last_peered":"2024-04-23T18:31:26.761149+0000","last_clean":"2024-04-23T18:31:26.761149+0000","last_became_active":"2024-04-23T18:29:11.506749+0000","last_became_peered":"2024-04-23T18:29:11.506749+0000","last_unstale":"2024-04-23T18:31:26.761149+0000","last_undegraded":"2024-04-23T18:31:26.761149+0000","last_fullsized":"2024-04-23T18:31:26.761149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.488219+0000","last_change":"2024-04-23T18:33:05.488245+0000","last_active":"2024-04-23T18:33:05.488219+0000","last_peered":"2024-04-23T18:33:05.488219+0000","last_clean":"2024-04-23T18:33:05.488219+0000","last_became_active":"2024-04-23T18:29:13.501177+0000","last_became_peered":"2024-04-23T18:29:13.501177+0000","last_unstale":"2024-04-23T18:33:05.488219+0000","last_undegraded":"2024-04-23T18:33:05.488219+0000","last_fullsized":"2024-04-23T18:33:05.488219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:05.488136+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:05.488136+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.488136+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:00:41.028747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.877459+0000","last_change":"2024-04-23T18:29:11.485837+0000","last_active":"2024-04-23T18:32:27.877459+0000","last_peered":"2024-04-23T18:32:27.877459+0000","last_clean":"2024-04-23T18:32:27.877459+0000","last_became_active":"2024-04-23T18:29:11.484137+0000","last_became_peered":"2024-04-23T18:29:11.484137+0000","last_unstale":"2024-04-23T18:32:27.877459+0000","last_undegraded":"2024-04-23T18:32:27.877459+0000","last_fullsized":"2024-04-23T18:32:27.877459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.759907+0000","last_change":"2024-04-23T18:29:13.498423+0000","last_active":"2024-04-23T18:31:26.759907+0000","last_peered":"2024-04-23T18:31:26.759907+0000","last_clean":"2024-04-23T18:31:26.759907+0000","last_became_active":"2024-04-23T18:29:13.494034+0000","last_became_peered":"2024-04-23T18:29:13.494034+0000","last_unstale":"2024-04-23T18:31:26.759907+0000","last_undegraded":"2024-04-23T18:31:26.759907+0000","last_fullsized":"2024-04-23T18:31:26.759907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761949+0000","last_change":"2024-04-23T18:29:11.507132+0000","last_active":"2024-04-23T18:31:31.761949+0000","last_peered":"2024-04-23T18:31:31.761949+0000","last_clean":"2024-04-23T18:31:31.761949+0000","last_became_active":"2024-04-23T18:29:11.506801+0000","last_became_peered":"2024-04-23T18:29:11.506801+0000","last_unstale":"2024-04-23T18:31:31.761949+0000","last_undegraded":"2024-04-23T18:31:31.761949+0000","last_fullsized":"2024-04-23T18:31:31.761949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761714+0000","last_change":"2024-04-23T18:29:11.495271+0000","last_active":"2024-04-23T18:31:31.761714+0000","last_peered":"2024-04-23T18:31:31.761714+0000","last_clean":"2024-04-23T18:31:31.761714+0000","last_became_active":"2024-04-23T18:29:11.494891+0000","last_became_peered":"2024-04-23T18:29:11.494891+0000","last_unstale":"2024-04-23T18:31:31.761714+0000","last_undegraded":"2024-04-23T18:31:31.761714+0000","last_fullsized":"2024-04-23T18:31:31.761714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.263490+0000","last_change":"2024-04-23T18:33:04.263523+0000","last_active":"2024-04-23T18:33:04.263490+0000","last_peered":"2024-04-23T18:33:04.263490+0000","last_clean":"2024-04-23T18:33:04.263490+0000","last_became_active":"2024-04-23T18:29:13.494850+0000","last_became_peered":"2024-04-23T18:29:13.494850+0000","last_unstale":"2024-04-23T18:33:04.263490+0000","last_undegraded":"2024-04-23T18:33:04.263490+0000","last_fullsized":"2024-04-23T18:33:04.263490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:04.263392+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:04.263392+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.263392+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:45:01.339824+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.217798+0000","last_change":"2024-04-23T18:33:07.217825+0000","last_active":"2024-04-23T18:33:07.217798+0000","last_peered":"2024-04-23T18:33:07.217798+0000","last_clean":"2024-04-23T18:33:07.217798+0000","last_became_active":"2024-04-23T18:29:11.495173+0000","last_became_peered":"2024-04-23T18:29:11.495173+0000","last_unstale":"2024-04-23T18:33:07.217798+0000","last_undegraded":"2024-04-23T18:33:07.217798+0000","last_fullsized":"2024-04-23T18:33:07.217798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:07.217709+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:07.217709+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.217709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:39:38.244409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.919274+0000","last_change":"2024-04-23T18:33:00.919303+0000","last_active":"2024-04-23T18:33:00.919274+0000","last_peered":"2024-04-23T18:33:00.919274+0000","last_clean":"2024-04-23T18:33:00.919274+0000","last_became_active":"2024-04-23T18:29:13.506122+0000","last_became_peered":"2024-04-23T18:29:13.506122+0000","last_unstale":"2024-04-23T18:33:00.919274+0000","last_undegraded":"2024-04-23T18:33:00.919274+0000","last_fullsized":"2024-04-23T18:33:00.919274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:00.919186+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:00.919186+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.919186+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:47.802608+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1524,"ondisk_log_size":1524,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1604,"num_read_kb":1494,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640311,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39968,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331872,"statfs":{"total":96636764160,"available":96595836928,"internally_reserved":0,"allocated":483328,"data_stored":150732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640311,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":738603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640312,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1036288,"data_stored":738249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39928,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331912,"statfs":{"total":96636764160,"available":96595877888,"internally_reserved":0,"allocated":442368,"data_stored":148938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:33:13.256 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.256 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.256 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.257 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.257 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.257 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.257 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.257 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.257 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.257 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.258 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.258 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.258 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.258 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.258 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.258 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.259 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.259 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.259 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.259 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.259 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.259 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.259 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.260 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.260 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.260 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.260 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.260 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.260 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.260 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.261 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.261 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.261 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.261 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.261 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-23T18:28:57.410644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=28, tm_sec=57, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.261 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.261 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.262 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.262 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.262 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.262 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.262 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.262 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.262 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.262 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.263 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.263 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.263 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.263 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.263 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.263 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.263 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.263 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.264 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.264 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.264 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.264 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.264 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.264 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.264 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.265 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.265 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.265 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.265 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.265 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.265 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.265 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.266 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.266 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.266 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.266 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.266 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.266 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.266 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.267 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.267 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.267 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.267 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.267 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.267 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-23T18:29:14.475628+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.267 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.267 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.268 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.268 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.268 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.268 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.268 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.268 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.268 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.268 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.269 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.269 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.269 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.269 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.269 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.269 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.269 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.269 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.270 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.270 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.270 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.270 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.270 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.270 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.270 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.270 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:13.271 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T18:33:33.271 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:33:33.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.393+0000 7f99a2703640 1 Processor -- start 2024-04-23T18:33:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.393+0000 7f99a2703640 1 -- start start 2024-04-23T18:33:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.394+0000 7f99a2703640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f999c0933f0 0x7f999c0937d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:33:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.394+0000 7f99a2703640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999c098fd0 con 0x7f999c12c6c0 2024-04-23T18:33:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.394+0000 7f99a2703640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f999c0967a0 con 0x7f999c0933f0 2024-04-23T18:33:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.394+0000 7f999bfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f999c0933f0 0x7f999c0937d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:33:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.394+0000 7f999b7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f999c12c6c0 0x7f999c12cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40242/0 (socket says 172.21.15.62:40242) 2024-04-23T18:33:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.394+0000 7f999b7fe640 1 -- 172.21.15.62:0/3844242144 learned_addr learned my addr 172.21.15.62:0/3844242144 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:33:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.394+0000 7f999bfff640 1 -- 172.21.15.62:0/3844242144 >> v1:172.21.15.62:6789/0 conn(0x7f999c12c6c0 legacy=0x7f999c12cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:33:33.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.394+0000 7f999bfff640 1 -- 172.21.15.62:0/3844242144 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999c0970e0 con 0x7f999c0933f0 2024-04-23T18:33:33.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.395+0000 7f999bfff640 1 --2- 172.21.15.62:0/3844242144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f999c0933f0 0x7f999c0937d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9990009720 tx=0x7f999002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fff56518914bfd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:33:33.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.395+0000 7f999affd640 1 -- 172.21.15.62:0/3844242144 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99900316d0 con 0x7f999c0933f0 2024-04-23T18:33:33.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.395+0000 7f999affd640 1 -- 172.21.15.62:0/3844242144 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9990037070 con 0x7f999c0933f0 2024-04-23T18:33:33.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.395+0000 7f999affd640 1 -- 172.21.15.62:0/3844242144 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99900319c0 con 0x7f999c0933f0 2024-04-23T18:33:33.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.395+0000 7f99a2703640 1 -- 172.21.15.62:0/3844242144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f999c0933f0 msgr2=0x7f999c0937d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:33:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.395+0000 7f99a2703640 1 --2- 172.21.15.62:0/3844242144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f999c0933f0 0x7f999c0937d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9990009720 tx=0x7f999002b840 comp rx=0 tx=0).stop 2024-04-23T18:33:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.396+0000 7f99a2703640 1 -- 172.21.15.62:0/3844242144 shutdown_connections 2024-04-23T18:33:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.396+0000 7f99a2703640 1 --2- 172.21.15.62:0/3844242144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f999c0933f0 0x7f999c0937d0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:33:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.396+0000 7f99a2703640 1 -- 172.21.15.62:0/3844242144 >> 172.21.15.62:0/3844242144 conn(0x7f999c099d70 msgr2=0x7f999c097640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:33:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.396+0000 7f99a2703640 1 -- 172.21.15.62:0/3844242144 shutdown_connections 2024-04-23T18:33:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.396+0000 7f99a2703640 1 -- 172.21.15.62:0/3844242144 wait complete. 2024-04-23T18:33:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.396+0000 7f99a2703640 1 Processor -- start 2024-04-23T18:33:33.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.397+0000 7f99a2703640 1 -- start start 2024-04-23T18:33:33.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.397+0000 7f99a2703640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f999c0933f0 0x7f999c1c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:33:33.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.397+0000 7f99a2703640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f999c093d10 con 0x7f999c0933f0 2024-04-23T18:33:33.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.397+0000 7f999bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f999c0933f0 0x7f999c1c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:33:33.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.397+0000 7f999bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f999c0933f0 0x7f999c1c3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37182/0 (socket says 172.21.15.62:37182) 2024-04-23T18:33:33.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.397+0000 7f999bfff640 1 -- 172.21.15.62:0/3748607628 learned_addr learned my addr 172.21.15.62:0/3748607628 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:33:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.397+0000 7f999bfff640 1 -- 172.21.15.62:0/3748607628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999c06f5c0 con 0x7f999c0933f0 2024-04-23T18:33:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.397+0000 7f999bfff640 1 --2- 172.21.15.62:0/3748607628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f999c0933f0 0x7f999c1c3630 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f9990000c00 tx=0x7f99900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:33:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.398+0000 7f9998ff9640 1 -- 172.21.15.62:0/3748607628 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9990032640 con 0x7f999c0933f0 2024-04-23T18:33:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.398+0000 7f9998ff9640 1 -- 172.21.15.62:0/3748607628 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99900327e0 con 0x7f999c0933f0 2024-04-23T18:33:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.398+0000 7f99a2703640 1 -- 172.21.15.62:0/3748607628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f999c126380 con 0x7f999c0933f0 2024-04-23T18:33:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.398+0000 7f9998ff9640 1 -- 172.21.15.62:0/3748607628 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9990032b00 con 0x7f999c0933f0 2024-04-23T18:33:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.398+0000 7f99a2703640 1 -- 172.21.15.62:0/3748607628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f999c06ebe0 con 0x7f999c0933f0 2024-04-23T18:33:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.399+0000 7f9998ff9640 1 -- 172.21.15.62:0/3748607628 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f999004c060 con 0x7f999c0933f0 2024-04-23T18:33:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.399+0000 7f99a2703640 1 -- 172.21.15.62:0/3748607628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f999c0505b0 con 0x7f999c0933f0 2024-04-23T18:33:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.399+0000 7f9998ff9640 1 --2- 172.21.15.62:0/3748607628 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f99880385c0 0x7f998803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:33:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.399+0000 7f9998ff9640 1 -- 172.21.15.62:0/3748607628 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f999002f050 con 0x7f999c0933f0 2024-04-23T18:33:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.399+0000 7f999b7fe640 1 --2- 172.21.15.62:0/3748607628 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f99880385c0 0x7f998803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:33:33.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.400+0000 7f999b7fe640 1 --2- 172.21.15.62:0/3748607628 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f99880385c0 0x7f998803aa80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f998c007fd0 tx=0x7f998c007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:33:33.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.404+0000 7f9998ff9640 1 -- 172.21.15.62:0/3748607628 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9990040070 con 0x7f999c0933f0 2024-04-23T18:33:33.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.585+0000 7f99a2703640 1 -- 172.21.15.62:0/3748607628 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f999c06bae0 con 0x7f99880385c0 2024-04-23T18:33:33.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.601+0000 7f9998ff9640 1 -- 172.21.15.62:0/3748607628 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664916 (secure 0 0 0) 0x7f999c06bae0 con 0x7f99880385c0 2024-04-23T18:33:33.600 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:33:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-04-23T18:33:33.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.605+0000 7f99a2703640 1 -- 172.21.15.62:0/3748607628 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f99880385c0 msgr2=0x7f998803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:33:33.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.605+0000 7f99a2703640 1 --2- 172.21.15.62:0/3748607628 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f99880385c0 0x7f998803aa80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f998c007fd0 tx=0x7f998c007ac0 comp rx=0 tx=0).stop 2024-04-23T18:33:33.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.605+0000 7f99a2703640 1 -- 172.21.15.62:0/3748607628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f999c0933f0 msgr2=0x7f999c1c3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:33:33.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.605+0000 7f99a2703640 1 --2- 172.21.15.62:0/3748607628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f999c0933f0 0x7f999c1c3630 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f9990000c00 tx=0x7f99900046c0 comp rx=0 tx=0).stop 2024-04-23T18:33:33.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.605+0000 7f99a2703640 1 -- 172.21.15.62:0/3748607628 shutdown_connections 2024-04-23T18:33:33.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.606+0000 7f99a2703640 1 --2- 172.21.15.62:0/3748607628 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f99880385c0 0x7f998803aa80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:33:33.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.606+0000 7f99a2703640 1 --2- 172.21.15.62:0/3748607628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f999c0933f0 0x7f999c1c3630 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:33:33.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.606+0000 7f99a2703640 1 -- 172.21.15.62:0/3748607628 >> 172.21.15.62:0/3748607628 conn(0x7f999c099d70 msgr2=0x7f999c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:33:33.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.606+0000 7f99a2703640 1 -- 172.21.15.62:0/3748607628 shutdown_connections 2024-04-23T18:33:33.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:33.606+0000 7f99a2703640 1 -- 172.21.15.62:0/3748607628 wait complete. 2024-04-23T18:33:33.610 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-04-23T18:33:32.765232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5092,"num_read_kb":4673,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4782,"ondisk_log_size":4782,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165048,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322312,"statfs":{"total":386547056640,"available":386378047488,"internally_reserved":0,"allocated":2973696,"data_stored":1776522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":165996311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003898"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.427995+0000","last_change":"2024-04-23T18:33:04.427995+0000","last_active":"2024-04-23T18:33:04.427995+0000","last_peered":"2024-04-23T18:33:04.427995+0000","last_clean":"2024-04-23T18:33:04.427995+0000","last_became_active":"2024-04-23T18:29:11.495610+0000","last_became_peered":"2024-04-23T18:29:11.495610+0000","last_unstale":"2024-04-23T18:33:04.427995+0000","last_undegraded":"2024-04-23T18:33:04.427995+0000","last_fullsized":"2024-04-23T18:33:04.427995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:04.427875+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:04.427875+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.427875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:27:47.245561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.888297+0000","last_change":"2024-04-23T18:33:02.888343+0000","last_active":"2024-04-23T18:33:02.888297+0000","last_peered":"2024-04-23T18:33:02.888297+0000","last_clean":"2024-04-23T18:33:02.888297+0000","last_became_active":"2024-04-23T18:29:13.492771+0000","last_became_peered":"2024-04-23T18:29:13.492771+0000","last_unstale":"2024-04-23T18:33:02.888297+0000","last_undegraded":"2024-04-23T18:33:02.888297+0000","last_fullsized":"2024-04-23T18:33:02.888297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:02.888182+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:02.888182+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.888182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:35.983458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.220961+0000","last_change":"2024-04-23T18:33:05.220961+0000","last_active":"2024-04-23T18:33:05.220961+0000","last_peered":"2024-04-23T18:33:05.220961+0000","last_clean":"2024-04-23T18:33:05.220961+0000","last_became_active":"2024-04-23T18:29:11.495272+0000","last_became_peered":"2024-04-23T18:29:11.495272+0000","last_unstale":"2024-04-23T18:33:05.220961+0000","last_undegraded":"2024-04-23T18:33:05.220961+0000","last_fullsized":"2024-04-23T18:33:05.220961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:05.220836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:05.220836+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.220836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:05.041452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:17.405494+0000","last_change":"2024-04-23T18:33:17.405529+0000","last_active":"2024-04-23T18:33:17.405494+0000","last_peered":"2024-04-23T18:33:17.405494+0000","last_clean":"2024-04-23T18:33:17.405494+0000","last_became_active":"2024-04-23T18:29:13.494969+0000","last_became_peered":"2024-04-23T18:29:13.494969+0000","last_unstale":"2024-04-23T18:33:17.405494+0000","last_undegraded":"2024-04-23T18:33:17.405494+0000","last_fullsized":"2024-04-23T18:33:17.405494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:17.405400+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:17.405400+0000","last_clean_scrub_stamp":"2024-04-23T18:33:17.405400+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:56:01.377480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:28.493450+0000","last_change":"2024-04-23T18:33:28.493481+0000","last_active":"2024-04-23T18:33:28.493450+0000","last_peered":"2024-04-23T18:33:28.493450+0000","last_clean":"2024-04-23T18:33:28.493450+0000","last_became_active":"2024-04-23T18:29:11.505283+0000","last_became_peered":"2024-04-23T18:29:11.505283+0000","last_unstale":"2024-04-23T18:33:28.493450+0000","last_undegraded":"2024-04-23T18:33:28.493450+0000","last_fullsized":"2024-04-23T18:33:28.493450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:28.493354+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:28.493354+0000","last_clean_scrub_stamp":"2024-04-23T18:33:28.493354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:17:11.204043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:16.359353+0000","last_change":"2024-04-23T18:33:16.359380+0000","last_active":"2024-04-23T18:33:16.359353+0000","last_peered":"2024-04-23T18:33:16.359353+0000","last_clean":"2024-04-23T18:33:16.359353+0000","last_became_active":"2024-04-23T18:29:13.495367+0000","last_became_peered":"2024-04-23T18:29:13.495367+0000","last_unstale":"2024-04-23T18:33:16.359353+0000","last_undegraded":"2024-04-23T18:33:16.359353+0000","last_fullsized":"2024-04-23T18:33:16.359353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:16.359245+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:16.359245+0000","last_clean_scrub_stamp":"2024-04-23T18:33:16.359245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:36.330626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.345316+0000","last_change":"2024-04-23T18:33:02.345316+0000","last_active":"2024-04-23T18:33:02.345316+0000","last_peered":"2024-04-23T18:33:02.345316+0000","last_clean":"2024-04-23T18:33:02.345316+0000","last_became_active":"2024-04-23T18:29:11.495677+0000","last_became_peered":"2024-04-23T18:29:11.495677+0000","last_unstale":"2024-04-23T18:33:02.345316+0000","last_undegraded":"2024-04-23T18:33:02.345316+0000","last_fullsized":"2024-04-23T18:33:02.345316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:02.345200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:02.345200+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.345200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:21.009871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:24.523189+0000","last_change":"2024-04-23T18:33:24.523220+0000","last_active":"2024-04-23T18:33:24.523189+0000","last_peered":"2024-04-23T18:33:24.523189+0000","last_clean":"2024-04-23T18:33:24.523189+0000","last_became_active":"2024-04-23T18:29:52.548291+0000","last_became_peered":"2024-04-23T18:29:52.548291+0000","last_unstale":"2024-04-23T18:33:24.523189+0000","last_undegraded":"2024-04-23T18:33:24.523189+0000","last_fullsized":"2024-04-23T18:33:24.523189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:24.523097+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:24.523097+0000","last_clean_scrub_stamp":"2024-04-23T18:33:24.523097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:44:06.996195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763341+0000","last_change":"2024-04-23T18:29:11.504896+0000","last_active":"2024-04-23T18:31:41.763341+0000","last_peered":"2024-04-23T18:31:41.763341+0000","last_clean":"2024-04-23T18:31:41.763341+0000","last_became_active":"2024-04-23T18:29:11.504554+0000","last_became_peered":"2024-04-23T18:29:11.504554+0000","last_unstale":"2024-04-23T18:31:41.763341+0000","last_undegraded":"2024-04-23T18:31:41.763341+0000","last_fullsized":"2024-04-23T18:31:41.763341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:25.736601+0000","last_change":"2024-04-23T18:33:25.736628+0000","last_active":"2024-04-23T18:33:25.736601+0000","last_peered":"2024-04-23T18:33:25.736601+0000","last_clean":"2024-04-23T18:33:25.736601+0000","last_became_active":"2024-04-23T18:29:13.498378+0000","last_became_peered":"2024-04-23T18:29:13.498378+0000","last_unstale":"2024-04-23T18:33:25.736601+0000","last_undegraded":"2024-04-23T18:33:25.736601+0000","last_fullsized":"2024-04-23T18:33:25.736601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:25.736493+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:25.736493+0000","last_clean_scrub_stamp":"2024-04-23T18:33:25.736493+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:18:01.548689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.354760+0000","last_change":"2024-04-23T18:32:58.354787+0000","last_active":"2024-04-23T18:32:58.354760+0000","last_peered":"2024-04-23T18:32:58.354760+0000","last_clean":"2024-04-23T18:32:58.354760+0000","last_became_active":"2024-04-23T18:29:11.496923+0000","last_became_peered":"2024-04-23T18:29:11.496923+0000","last_unstale":"2024-04-23T18:32:58.354760+0000","last_undegraded":"2024-04-23T18:32:58.354760+0000","last_fullsized":"2024-04-23T18:32:58.354760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:58.354674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:58.354674+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.354674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:20.236974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.469206+0000","last_change":"2024-04-23T18:32:49.469206+0000","last_active":"2024-04-23T18:32:49.469206+0000","last_peered":"2024-04-23T18:32:49.469206+0000","last_clean":"2024-04-23T18:32:49.469206+0000","last_became_active":"2024-04-23T18:29:13.502401+0000","last_became_peered":"2024-04-23T18:29:13.502401+0000","last_unstale":"2024-04-23T18:32:49.469206+0000","last_undegraded":"2024-04-23T18:32:49.469206+0000","last_fullsized":"2024-04-23T18:32:49.469206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:49.469055+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:49.469055+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.469055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:49:26.457594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.130109+0000","last_change":"2024-04-23T18:29:11.500102+0000","last_active":"2024-04-23T18:32:21.130109+0000","last_peered":"2024-04-23T18:32:21.130109+0000","last_clean":"2024-04-23T18:32:21.130109+0000","last_became_active":"2024-04-23T18:29:11.499772+0000","last_became_peered":"2024-04-23T18:29:11.499772+0000","last_unstale":"2024-04-23T18:32:21.130109+0000","last_undegraded":"2024-04-23T18:32:21.130109+0000","last_fullsized":"2024-04-23T18:32:21.130109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.372456+0000","last_change":"2024-04-23T18:32:57.372456+0000","last_active":"2024-04-23T18:32:57.372456+0000","last_peered":"2024-04-23T18:32:57.372456+0000","last_clean":"2024-04-23T18:32:57.372456+0000","last_became_active":"2024-04-23T18:29:13.498965+0000","last_became_peered":"2024-04-23T18:29:13.498965+0000","last_unstale":"2024-04-23T18:32:57.372456+0000","last_undegraded":"2024-04-23T18:32:57.372456+0000","last_fullsized":"2024-04-23T18:32:57.372456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:57.372339+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:57.372339+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.372339+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:21.784067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:15.259959+0000","last_change":"2024-04-23T18:33:15.259986+0000","last_active":"2024-04-23T18:33:15.259959+0000","last_peered":"2024-04-23T18:33:15.259959+0000","last_clean":"2024-04-23T18:33:15.259959+0000","last_became_active":"2024-04-23T18:29:11.491840+0000","last_became_peered":"2024-04-23T18:29:11.491840+0000","last_unstale":"2024-04-23T18:33:15.259959+0000","last_undegraded":"2024-04-23T18:33:15.259959+0000","last_fullsized":"2024-04-23T18:33:15.259959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:15.259869+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:15.259869+0000","last_clean_scrub_stamp":"2024-04-23T18:33:15.259869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:59.645930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.481145+0000","last_change":"2024-04-23T18:32:54.481145+0000","last_active":"2024-04-23T18:32:54.481145+0000","last_peered":"2024-04-23T18:32:54.481145+0000","last_clean":"2024-04-23T18:32:54.481145+0000","last_became_active":"2024-04-23T18:29:13.505348+0000","last_became_peered":"2024-04-23T18:29:13.505348+0000","last_unstale":"2024-04-23T18:32:54.481145+0000","last_undegraded":"2024-04-23T18:32:54.481145+0000","last_fullsized":"2024-04-23T18:32:54.481145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:54.481024+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:54.481024+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.481024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:53.099891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:14.423937+0000","last_change":"2024-04-23T18:33:14.423963+0000","last_active":"2024-04-23T18:33:14.423937+0000","last_peered":"2024-04-23T18:33:14.423937+0000","last_clean":"2024-04-23T18:33:14.423937+0000","last_became_active":"2024-04-23T18:29:13.495337+0000","last_became_peered":"2024-04-23T18:29:13.495337+0000","last_unstale":"2024-04-23T18:33:14.423937+0000","last_undegraded":"2024-04-23T18:33:14.423937+0000","last_fullsized":"2024-04-23T18:33:14.423937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:14.423840+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:14.423840+0000","last_clean_scrub_stamp":"2024-04-23T18:33:14.423840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:42.803799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.931167+0000","last_change":"2024-04-23T18:33:08.931210+0000","last_active":"2024-04-23T18:33:08.931167+0000","last_peered":"2024-04-23T18:33:08.931167+0000","last_clean":"2024-04-23T18:33:08.931167+0000","last_became_active":"2024-04-23T18:29:11.501773+0000","last_became_peered":"2024-04-23T18:29:11.501773+0000","last_unstale":"2024-04-23T18:33:08.931167+0000","last_undegraded":"2024-04-23T18:33:08.931167+0000","last_fullsized":"2024-04-23T18:33:08.931167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:08.931040+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:08.931040+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.931040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:44.004243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.887546+0000","last_change":"2024-04-23T18:33:04.887572+0000","last_active":"2024-04-23T18:33:04.887546+0000","last_peered":"2024-04-23T18:33:04.887546+0000","last_clean":"2024-04-23T18:33:04.887546+0000","last_became_active":"2024-04-23T18:29:13.492366+0000","last_became_peered":"2024-04-23T18:29:13.492366+0000","last_unstale":"2024-04-23T18:33:04.887546+0000","last_undegraded":"2024-04-23T18:33:04.887546+0000","last_fullsized":"2024-04-23T18:33:04.887546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:04.887454+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:04.887454+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.887454+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:41.190483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.372844+0000","last_change":"2024-04-23T18:33:10.372871+0000","last_active":"2024-04-23T18:33:10.372844+0000","last_peered":"2024-04-23T18:33:10.372844+0000","last_clean":"2024-04-23T18:33:10.372844+0000","last_became_active":"2024-04-23T18:29:11.484620+0000","last_became_peered":"2024-04-23T18:29:11.484620+0000","last_unstale":"2024-04-23T18:33:10.372844+0000","last_undegraded":"2024-04-23T18:33:10.372844+0000","last_fullsized":"2024-04-23T18:33:10.372844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:10.372753+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:10.372753+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.372753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:43.468029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'16","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.898340+0000","last_change":"2024-04-23T18:33:07.898374+0000","last_active":"2024-04-23T18:33:07.898340+0000","last_peered":"2024-04-23T18:33:07.898340+0000","last_clean":"2024-04-23T18:33:07.898340+0000","last_became_active":"2024-04-23T18:29:13.495743+0000","last_became_peered":"2024-04-23T18:29:13.495743+0000","last_unstale":"2024-04-23T18:33:07.898340+0000","last_undegraded":"2024-04-23T18:33:07.898340+0000","last_fullsized":"2024-04-23T18:33:07.898340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:33:07.898227+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:33:07.898227+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.898227+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:29.453739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:21.772760+0000","last_change":"2024-04-23T18:33:21.772818+0000","last_active":"2024-04-23T18:33:21.772760+0000","last_peered":"2024-04-23T18:33:21.772760+0000","last_clean":"2024-04-23T18:33:21.772760+0000","last_became_active":"2024-04-23T18:29:11.493363+0000","last_became_peered":"2024-04-23T18:29:11.493363+0000","last_unstale":"2024-04-23T18:33:21.772760+0000","last_undegraded":"2024-04-23T18:33:21.772760+0000","last_fullsized":"2024-04-23T18:33:21.772760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:21.772658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:21.772658+0000","last_clean_scrub_stamp":"2024-04-23T18:33:21.772658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:27.453258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.223224+0000","last_change":"2024-04-23T18:33:01.223252+0000","last_active":"2024-04-23T18:33:01.223224+0000","last_peered":"2024-04-23T18:33:01.223224+0000","last_clean":"2024-04-23T18:33:01.223224+0000","last_became_active":"2024-04-23T18:29:13.501988+0000","last_became_peered":"2024-04-23T18:29:13.501988+0000","last_unstale":"2024-04-23T18:33:01.223224+0000","last_undegraded":"2024-04-23T18:33:01.223224+0000","last_fullsized":"2024-04-23T18:33:01.223224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:01.223122+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:01.223122+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.223122+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:46:24.673897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.881786+0000","last_change":"2024-04-23T18:33:06.881811+0000","last_active":"2024-04-23T18:33:06.881786+0000","last_peered":"2024-04-23T18:33:06.881786+0000","last_clean":"2024-04-23T18:33:06.881786+0000","last_became_active":"2024-04-23T18:29:11.502714+0000","last_became_peered":"2024-04-23T18:29:11.502714+0000","last_unstale":"2024-04-23T18:33:06.881786+0000","last_undegraded":"2024-04-23T18:33:06.881786+0000","last_fullsized":"2024-04-23T18:33:06.881786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:06.881695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:06.881695+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.881695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:02:23.976616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.408456+0000","last_change":"2024-04-23T18:32:56.408483+0000","last_active":"2024-04-23T18:32:56.408456+0000","last_peered":"2024-04-23T18:32:56.408456+0000","last_clean":"2024-04-23T18:32:56.408456+0000","last_became_active":"2024-04-23T18:29:13.498488+0000","last_became_peered":"2024-04-23T18:29:13.498488+0000","last_unstale":"2024-04-23T18:32:56.408456+0000","last_undegraded":"2024-04-23T18:32:56.408456+0000","last_fullsized":"2024-04-23T18:32:56.408456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:56.408370+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:56.408370+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.408370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:50:09.569283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.286138+0000","last_change":"2024-04-23T18:33:11.286165+0000","last_active":"2024-04-23T18:33:11.286138+0000","last_peered":"2024-04-23T18:33:11.286138+0000","last_clean":"2024-04-23T18:33:11.286138+0000","last_became_active":"2024-04-23T18:29:11.495025+0000","last_became_peered":"2024-04-23T18:29:11.495025+0000","last_unstale":"2024-04-23T18:33:11.286138+0000","last_undegraded":"2024-04-23T18:33:11.286138+0000","last_fullsized":"2024-04-23T18:33:11.286138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:11.286048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:11.286048+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.286048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:58.054788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.905112+0000","last_change":"2024-04-23T18:33:01.905141+0000","last_active":"2024-04-23T18:33:01.905112+0000","last_peered":"2024-04-23T18:33:01.905112+0000","last_clean":"2024-04-23T18:33:01.905112+0000","last_became_active":"2024-04-23T18:29:13.494080+0000","last_became_peered":"2024-04-23T18:29:13.494080+0000","last_unstale":"2024-04-23T18:33:01.905112+0000","last_undegraded":"2024-04-23T18:33:01.905112+0000","last_fullsized":"2024-04-23T18:33:01.905112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:01.905014+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:01.905014+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.905014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:34.294317+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:31.440576+0000","last_change":"2024-04-23T18:33:31.440603+0000","last_active":"2024-04-23T18:33:31.440576+0000","last_peered":"2024-04-23T18:33:31.440576+0000","last_clean":"2024-04-23T18:33:31.440576+0000","last_became_active":"2024-04-23T18:29:11.507336+0000","last_became_peered":"2024-04-23T18:29:11.507336+0000","last_unstale":"2024-04-23T18:33:31.440576+0000","last_undegraded":"2024-04-23T18:33:31.440576+0000","last_fullsized":"2024-04-23T18:33:31.440576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:31.440484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:31.440484+0000","last_clean_scrub_stamp":"2024-04-23T18:33:31.440484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:07.664670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'38","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.906998+0000","last_change":"2024-04-23T18:32:55.907029+0000","last_active":"2024-04-23T18:32:55.906998+0000","last_peered":"2024-04-23T18:32:55.906998+0000","last_clean":"2024-04-23T18:32:55.906998+0000","last_became_active":"2024-04-23T18:29:21.529771+0000","last_became_peered":"2024-04-23T18:29:21.529771+0000","last_unstale":"2024-04-23T18:32:55.906998+0000","last_undegraded":"2024-04-23T18:32:55.906998+0000","last_fullsized":"2024-04-23T18:32:55.906998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-04-23T18:32:55.906902+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-04-23T18:32:55.906902+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.906902+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:18.086470+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'22","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:25.481479+0000","last_change":"2024-04-23T18:33:25.481507+0000","last_active":"2024-04-23T18:33:25.481479+0000","last_peered":"2024-04-23T18:33:25.481479+0000","last_clean":"2024-04-23T18:33:25.481479+0000","last_became_active":"2024-04-23T18:29:52.549641+0000","last_became_peered":"2024-04-23T18:29:52.549641+0000","last_unstale":"2024-04-23T18:33:25.481479+0000","last_undegraded":"2024-04-23T18:33:25.481479+0000","last_fullsized":"2024-04-23T18:33:25.481479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-23T18:33:25.481391+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-23T18:33:25.481391+0000","last_clean_scrub_stamp":"2024-04-23T18:33:25.481391+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:34.798802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":69,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:22.457683+0000","last_change":"2024-04-23T18:33:22.457711+0000","last_active":"2024-04-23T18:33:22.457683+0000","last_peered":"2024-04-23T18:33:22.457683+0000","last_clean":"2024-04-23T18:33:22.457683+0000","last_became_active":"2024-04-23T18:29:11.512062+0000","last_became_peered":"2024-04-23T18:29:11.512062+0000","last_unstale":"2024-04-23T18:33:22.457683+0000","last_undegraded":"2024-04-23T18:33:22.457683+0000","last_fullsized":"2024-04-23T18:33:22.457683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:22.457594+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:22.457594+0000","last_clean_scrub_stamp":"2024-04-23T18:33:22.457594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:44.174801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.393499+0000","last_change":"2024-04-23T18:32:36.393525+0000","last_active":"2024-04-23T18:32:36.393499+0000","last_peered":"2024-04-23T18:32:36.393499+0000","last_clean":"2024-04-23T18:32:36.393499+0000","last_became_active":"2024-04-23T18:29:15.508100+0000","last_became_peered":"2024-04-23T18:29:15.508100+0000","last_unstale":"2024-04-23T18:32:36.393499+0000","last_undegraded":"2024-04-23T18:32:36.393499+0000","last_fullsized":"2024-04-23T18:32:36.393499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.393398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.393398+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.393398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:14.247382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.399695+0000","last_change":"2024-04-23T18:32:43.399750+0000","last_active":"2024-04-23T18:32:43.399695+0000","last_peered":"2024-04-23T18:32:43.399695+0000","last_clean":"2024-04-23T18:32:43.399695+0000","last_became_active":"2024-04-23T18:29:17.513368+0000","last_became_peered":"2024-04-23T18:29:17.513368+0000","last_unstale":"2024-04-23T18:32:43.399695+0000","last_undegraded":"2024-04-23T18:32:43.399695+0000","last_fullsized":"2024-04-23T18:32:43.399695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:43.399581+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:43.399581+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.399581+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:04.955093+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.915356+0000","last_change":"2024-04-23T18:32:35.915380+0000","last_active":"2024-04-23T18:32:35.915356+0000","last_peered":"2024-04-23T18:32:35.915356+0000","last_clean":"2024-04-23T18:32:35.915356+0000","last_became_active":"2024-04-23T18:29:19.520066+0000","last_became_peered":"2024-04-23T18:29:19.520066+0000","last_unstale":"2024-04-23T18:32:35.915356+0000","last_undegraded":"2024-04-23T18:32:35.915356+0000","last_fullsized":"2024-04-23T18:32:35.915356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.915263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.915263+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.915263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:33.026516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.878515+0000","last_change":"2024-04-23T18:32:51.878542+0000","last_active":"2024-04-23T18:32:51.878515+0000","last_peered":"2024-04-23T18:32:51.878515+0000","last_clean":"2024-04-23T18:32:51.878515+0000","last_became_active":"2024-04-23T18:29:21.529743+0000","last_became_peered":"2024-04-23T18:29:21.529743+0000","last_unstale":"2024-04-23T18:32:51.878515+0000","last_undegraded":"2024-04-23T18:32:51.878515+0000","last_fullsized":"2024-04-23T18:32:51.878515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-23T18:32:51.878417+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-23T18:32:51.878417+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.878417+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:39.785762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.444752+0000","last_change":"2024-04-23T18:33:10.444793+0000","last_active":"2024-04-23T18:33:10.444752+0000","last_peered":"2024-04-23T18:33:10.444752+0000","last_clean":"2024-04-23T18:33:10.444752+0000","last_became_active":"2024-04-23T18:29:13.496299+0000","last_became_peered":"2024-04-23T18:29:13.496299+0000","last_unstale":"2024-04-23T18:33:10.444752+0000","last_undegraded":"2024-04-23T18:33:10.444752+0000","last_fullsized":"2024-04-23T18:33:10.444752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:10.444658+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:10.444658+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.444658+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:35:16.256466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.324567+0000","last_change":"2024-04-23T18:33:00.324598+0000","last_active":"2024-04-23T18:33:00.324567+0000","last_peered":"2024-04-23T18:33:00.324567+0000","last_clean":"2024-04-23T18:33:00.324567+0000","last_became_active":"2024-04-23T18:29:11.496878+0000","last_became_peered":"2024-04-23T18:29:11.496878+0000","last_unstale":"2024-04-23T18:33:00.324567+0000","last_undegraded":"2024-04-23T18:33:00.324567+0000","last_fullsized":"2024-04-23T18:33:00.324567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:00.324482+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:00.324482+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.324482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:37:16.117012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.219481+0000","last_change":"2024-04-23T18:32:55.219506+0000","last_active":"2024-04-23T18:32:55.219481+0000","last_peered":"2024-04-23T18:32:55.219481+0000","last_clean":"2024-04-23T18:32:55.219481+0000","last_became_active":"2024-04-23T18:29:15.504744+0000","last_became_peered":"2024-04-23T18:29:15.504744+0000","last_unstale":"2024-04-23T18:32:55.219481+0000","last_undegraded":"2024-04-23T18:32:55.219481+0000","last_fullsized":"2024-04-23T18:32:55.219481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:55.219376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:55.219376+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.219376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:01:48.896771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.884623+0000","last_change":"2024-04-23T18:32:37.884678+0000","last_active":"2024-04-23T18:32:37.884623+0000","last_peered":"2024-04-23T18:32:37.884623+0000","last_clean":"2024-04-23T18:32:37.884623+0000","last_became_active":"2024-04-23T18:29:17.510201+0000","last_became_peered":"2024-04-23T18:29:17.510201+0000","last_unstale":"2024-04-23T18:32:37.884623+0000","last_undegraded":"2024-04-23T18:32:37.884623+0000","last_fullsized":"2024-04-23T18:32:37.884623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-23T18:32:37.884529+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-23T18:32:37.884529+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.884529+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.954621+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.869790+0000","last_change":"2024-04-23T18:32:43.869829+0000","last_active":"2024-04-23T18:32:43.869790+0000","last_peered":"2024-04-23T18:32:43.869790+0000","last_clean":"2024-04-23T18:32:43.869790+0000","last_became_active":"2024-04-23T18:29:19.527770+0000","last_became_peered":"2024-04-23T18:29:19.527770+0000","last_unstale":"2024-04-23T18:32:43.869790+0000","last_undegraded":"2024-04-23T18:32:43.869790+0000","last_fullsized":"2024-04-23T18:32:43.869790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:43.869698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:43.869698+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.869698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:06.080613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.191867+0000","last_change":"2024-04-23T18:33:00.191895+0000","last_active":"2024-04-23T18:33:00.191867+0000","last_peered":"2024-04-23T18:33:00.191867+0000","last_clean":"2024-04-23T18:33:00.191867+0000","last_became_active":"2024-04-23T18:29:21.525940+0000","last_became_peered":"2024-04-23T18:29:21.525940+0000","last_unstale":"2024-04-23T18:33:00.191867+0000","last_undegraded":"2024-04-23T18:33:00.191867+0000","last_fullsized":"2024-04-23T18:33:00.191867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:00.191774+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:00.191774+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.191774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:05:50.166534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:13.407412+0000","last_change":"2024-04-23T18:33:13.407434+0000","last_active":"2024-04-23T18:33:13.407412+0000","last_peered":"2024-04-23T18:33:13.407412+0000","last_clean":"2024-04-23T18:33:13.407412+0000","last_became_active":"2024-04-23T18:29:13.496142+0000","last_became_peered":"2024-04-23T18:29:13.496142+0000","last_unstale":"2024-04-23T18:33:13.407412+0000","last_undegraded":"2024-04-23T18:33:13.407412+0000","last_fullsized":"2024-04-23T18:33:13.407412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:13.407310+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:13.407310+0000","last_clean_scrub_stamp":"2024-04-23T18:33:13.407310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:15:28.507825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761746+0000","last_change":"2024-04-23T18:29:11.504850+0000","last_active":"2024-04-23T18:31:31.761746+0000","last_peered":"2024-04-23T18:31:31.761746+0000","last_clean":"2024-04-23T18:31:31.761746+0000","last_became_active":"2024-04-23T18:29:11.504534+0000","last_became_peered":"2024-04-23T18:29:11.504534+0000","last_unstale":"2024-04-23T18:31:31.761746+0000","last_undegraded":"2024-04-23T18:31:31.761746+0000","last_fullsized":"2024-04-23T18:31:31.761746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.226403+0000","last_change":"2024-04-23T18:32:51.226428+0000","last_active":"2024-04-23T18:32:51.226403+0000","last_peered":"2024-04-23T18:32:51.226403+0000","last_clean":"2024-04-23T18:32:51.226403+0000","last_became_active":"2024-04-23T18:29:15.510018+0000","last_became_peered":"2024-04-23T18:29:15.510018+0000","last_unstale":"2024-04-23T18:32:51.226403+0000","last_undegraded":"2024-04-23T18:32:51.226403+0000","last_fullsized":"2024-04-23T18:32:51.226403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:51.226310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:51.226310+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.226310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:48.331725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.411781+0000","last_change":"2024-04-23T18:32:39.411841+0000","last_active":"2024-04-23T18:32:39.411781+0000","last_peered":"2024-04-23T18:32:39.411781+0000","last_clean":"2024-04-23T18:32:39.411781+0000","last_became_active":"2024-04-23T18:29:17.517679+0000","last_became_peered":"2024-04-23T18:29:17.517679+0000","last_unstale":"2024-04-23T18:32:39.411781+0000","last_undegraded":"2024-04-23T18:32:39.411781+0000","last_fullsized":"2024-04-23T18:32:39.411781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:32:39.411679+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:32:39.411679+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.411679+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:33:43.011129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":394,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.433045+0000","last_change":"2024-04-23T18:32:59.433088+0000","last_active":"2024-04-23T18:32:59.433045+0000","last_peered":"2024-04-23T18:32:59.433045+0000","last_clean":"2024-04-23T18:32:59.433045+0000","last_became_active":"2024-04-23T18:29:19.522434+0000","last_became_peered":"2024-04-23T18:29:19.522434+0000","last_unstale":"2024-04-23T18:32:59.433045+0000","last_undegraded":"2024-04-23T18:32:59.433045+0000","last_fullsized":"2024-04-23T18:32:59.433045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-04-23T18:32:59.432941+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-04-23T18:32:59.432941+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.432941+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:33.938084+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.484842+0000","last_change":"2024-04-23T18:32:45.484880+0000","last_active":"2024-04-23T18:32:45.484842+0000","last_peered":"2024-04-23T18:32:45.484842+0000","last_clean":"2024-04-23T18:32:45.484842+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:32:45.484842+0000","last_undegraded":"2024-04-23T18:32:45.484842+0000","last_fullsized":"2024-04-23T18:32:45.484842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:45.484750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:45.484750+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.484750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:44.554843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:26.421725+0000","last_change":"2024-04-23T18:33:26.421752+0000","last_active":"2024-04-23T18:33:26.421725+0000","last_peered":"2024-04-23T18:33:26.421725+0000","last_clean":"2024-04-23T18:33:26.421725+0000","last_became_active":"2024-04-23T18:29:13.499248+0000","last_became_peered":"2024-04-23T18:29:13.499248+0000","last_unstale":"2024-04-23T18:33:26.421725+0000","last_undegraded":"2024-04-23T18:33:26.421725+0000","last_fullsized":"2024-04-23T18:33:26.421725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:26.421630+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:26.421630+0000","last_clean_scrub_stamp":"2024-04-23T18:33:26.421630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:04:38.089082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:18.796603+0000","last_change":"2024-04-23T18:33:18.796628+0000","last_active":"2024-04-23T18:33:18.796603+0000","last_peered":"2024-04-23T18:33:18.796603+0000","last_clean":"2024-04-23T18:33:18.796603+0000","last_became_active":"2024-04-23T18:29:11.488531+0000","last_became_peered":"2024-04-23T18:29:11.488531+0000","last_unstale":"2024-04-23T18:33:18.796603+0000","last_undegraded":"2024-04-23T18:33:18.796603+0000","last_fullsized":"2024-04-23T18:33:18.796603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:18.796499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:18.796499+0000","last_clean_scrub_stamp":"2024-04-23T18:33:18.796499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:01.729188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.385497+0000","last_change":"2024-04-23T18:32:33.385539+0000","last_active":"2024-04-23T18:32:33.385497+0000","last_peered":"2024-04-23T18:32:33.385497+0000","last_clean":"2024-04-23T18:32:33.385497+0000","last_became_active":"2024-04-23T18:29:15.511249+0000","last_became_peered":"2024-04-23T18:29:15.511249+0000","last_unstale":"2024-04-23T18:32:33.385497+0000","last_undegraded":"2024-04-23T18:32:33.385497+0000","last_fullsized":"2024-04-23T18:32:33.385497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.385380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.385380+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.385380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:14.265560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.451350+0000","last_change":"2024-04-23T18:32:38.451387+0000","last_active":"2024-04-23T18:32:38.451350+0000","last_peered":"2024-04-23T18:32:38.451350+0000","last_clean":"2024-04-23T18:32:38.451350+0000","last_became_active":"2024-04-23T18:29:17.517964+0000","last_became_peered":"2024-04-23T18:29:17.517964+0000","last_unstale":"2024-04-23T18:32:38.451350+0000","last_undegraded":"2024-04-23T18:32:38.451350+0000","last_fullsized":"2024-04-23T18:32:38.451350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-04-23T18:32:38.451267+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-04-23T18:32:38.451267+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.451267+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:18:00.657607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":453,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.248993+0000","last_change":"2024-04-23T18:32:44.249059+0000","last_active":"2024-04-23T18:32:44.248993+0000","last_peered":"2024-04-23T18:32:44.248993+0000","last_clean":"2024-04-23T18:32:44.248993+0000","last_became_active":"2024-04-23T18:29:19.524881+0000","last_became_peered":"2024-04-23T18:29:19.524881+0000","last_unstale":"2024-04-23T18:32:44.248993+0000","last_undegraded":"2024-04-23T18:32:44.248993+0000","last_fullsized":"2024-04-23T18:32:44.248993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:44.248886+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:44.248886+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.248886+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:27.941657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.427164+0000","last_change":"2024-04-23T18:32:52.427187+0000","last_active":"2024-04-23T18:32:52.427164+0000","last_peered":"2024-04-23T18:32:52.427164+0000","last_clean":"2024-04-23T18:32:52.427164+0000","last_became_active":"2024-04-23T18:29:13.501472+0000","last_became_peered":"2024-04-23T18:29:13.501472+0000","last_unstale":"2024-04-23T18:32:52.427164+0000","last_undegraded":"2024-04-23T18:32:52.427164+0000","last_fullsized":"2024-04-23T18:32:52.427164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:32:52.427080+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:32:52.427080+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.427080+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:43:34.900178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'5","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:16.478398+0000","last_change":"2024-04-23T18:33:16.478425+0000","last_active":"2024-04-23T18:33:16.478398+0000","last_peered":"2024-04-23T18:33:16.478398+0000","last_clean":"2024-04-23T18:33:16.478398+0000","last_became_active":"2024-04-23T18:29:11.481977+0000","last_became_peered":"2024-04-23T18:29:11.481977+0000","last_unstale":"2024-04-23T18:33:16.478398+0000","last_undegraded":"2024-04-23T18:33:16.478398+0000","last_fullsized":"2024-04-23T18:33:16.478398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:33:16.478310+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:33:16.478310+0000","last_clean_scrub_stamp":"2024-04-23T18:33:16.478310+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:51.551514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.905456+0000","last_change":"2024-04-23T18:32:45.905482+0000","last_active":"2024-04-23T18:32:45.905456+0000","last_peered":"2024-04-23T18:32:45.905456+0000","last_clean":"2024-04-23T18:32:45.905456+0000","last_became_active":"2024-04-23T18:29:15.509711+0000","last_became_peered":"2024-04-23T18:29:15.509711+0000","last_unstale":"2024-04-23T18:32:45.905456+0000","last_undegraded":"2024-04-23T18:32:45.905456+0000","last_fullsized":"2024-04-23T18:32:45.905456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:45.905366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:45.905366+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.905366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:55:07.535829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'51","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.525412+0000","last_change":"2024-04-23T18:32:46.525489+0000","last_active":"2024-04-23T18:32:46.525412+0000","last_peered":"2024-04-23T18:32:46.525412+0000","last_clean":"2024-04-23T18:32:46.525412+0000","last_became_active":"2024-04-23T18:29:17.511085+0000","last_became_peered":"2024-04-23T18:29:17.511085+0000","last_unstale":"2024-04-23T18:32:46.525412+0000","last_undegraded":"2024-04-23T18:32:46.525412+0000","last_fullsized":"2024-04-23T18:32:46.525412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-04-23T18:32:46.525299+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-04-23T18:32:46.525299+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.525299+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:46:11.482573+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.255241+0000","last_change":"2024-04-23T18:32:52.255269+0000","last_active":"2024-04-23T18:32:52.255241+0000","last_peered":"2024-04-23T18:32:52.255241+0000","last_clean":"2024-04-23T18:32:52.255241+0000","last_became_active":"2024-04-23T18:29:19.527505+0000","last_became_peered":"2024-04-23T18:29:19.527505+0000","last_unstale":"2024-04-23T18:32:52.255241+0000","last_undegraded":"2024-04-23T18:32:52.255241+0000","last_fullsized":"2024-04-23T18:32:52.255241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:52.255147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:52.255147+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.255147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:39:47.960787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'13","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:21.502813+0000","last_change":"2024-04-23T18:33:21.502813+0000","last_active":"2024-04-23T18:33:21.502813+0000","last_peered":"2024-04-23T18:33:21.502813+0000","last_clean":"2024-04-23T18:33:21.502813+0000","last_became_active":"2024-04-23T18:29:21.532163+0000","last_became_peered":"2024-04-23T18:29:21.532163+0000","last_unstale":"2024-04-23T18:33:21.502813+0000","last_undegraded":"2024-04-23T18:33:21.502813+0000","last_fullsized":"2024-04-23T18:33:21.502813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-04-23T18:33:21.502620+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-04-23T18:33:21.502620+0000","last_clean_scrub_stamp":"2024-04-23T18:33:21.502620+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:49:58.491159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.935085+0000","last_change":"2024-04-23T18:33:03.935115+0000","last_active":"2024-04-23T18:33:03.935085+0000","last_peered":"2024-04-23T18:33:03.935085+0000","last_clean":"2024-04-23T18:33:03.935085+0000","last_became_active":"2024-04-23T18:29:13.494108+0000","last_became_peered":"2024-04-23T18:29:13.494108+0000","last_unstale":"2024-04-23T18:33:03.935085+0000","last_undegraded":"2024-04-23T18:33:03.935085+0000","last_fullsized":"2024-04-23T18:33:03.935085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:03.934976+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:03.934976+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.934976+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:46.714997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:12.356647+0000","last_change":"2024-04-23T18:33:12.356679+0000","last_active":"2024-04-23T18:33:12.356647+0000","last_peered":"2024-04-23T18:33:12.356647+0000","last_clean":"2024-04-23T18:33:12.356647+0000","last_became_active":"2024-04-23T18:29:11.481419+0000","last_became_peered":"2024-04-23T18:29:11.481419+0000","last_unstale":"2024-04-23T18:33:12.356647+0000","last_undegraded":"2024-04-23T18:33:12.356647+0000","last_fullsized":"2024-04-23T18:33:12.356647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:12.356553+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:12.356553+0000","last_clean_scrub_stamp":"2024-04-23T18:33:12.356553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:48.659583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.197779+0000","last_change":"2024-04-23T18:32:49.197825+0000","last_active":"2024-04-23T18:32:49.197779+0000","last_peered":"2024-04-23T18:32:49.197779+0000","last_clean":"2024-04-23T18:32:49.197779+0000","last_became_active":"2024-04-23T18:29:15.510135+0000","last_became_peered":"2024-04-23T18:29:15.510135+0000","last_unstale":"2024-04-23T18:32:49.197779+0000","last_undegraded":"2024-04-23T18:32:49.197779+0000","last_fullsized":"2024-04-23T18:32:49.197779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:49.197658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:49.197658+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.197658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:11:00.797470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.367950+0000","last_change":"2024-04-23T18:32:45.367999+0000","last_active":"2024-04-23T18:32:45.367950+0000","last_peered":"2024-04-23T18:32:45.367950+0000","last_clean":"2024-04-23T18:32:45.367950+0000","last_became_active":"2024-04-23T18:29:17.513447+0000","last_became_peered":"2024-04-23T18:29:17.513447+0000","last_unstale":"2024-04-23T18:32:45.367950+0000","last_undegraded":"2024-04-23T18:32:45.367950+0000","last_fullsized":"2024-04-23T18:32:45.367950+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:45.367847+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:45.367847+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.367847+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:39.796664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.422630+0000","last_change":"2024-04-23T18:32:33.422658+0000","last_active":"2024-04-23T18:32:33.422630+0000","last_peered":"2024-04-23T18:32:33.422630+0000","last_clean":"2024-04-23T18:32:33.422630+0000","last_became_active":"2024-04-23T18:29:19.518695+0000","last_became_peered":"2024-04-23T18:29:19.518695+0000","last_unstale":"2024-04-23T18:32:33.422630+0000","last_undegraded":"2024-04-23T18:32:33.422630+0000","last_fullsized":"2024-04-23T18:32:33.422630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.422540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.422540+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.422540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:19.231250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'6","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:27.728063+0000","last_change":"2024-04-23T18:33:27.728063+0000","last_active":"2024-04-23T18:33:27.728063+0000","last_peered":"2024-04-23T18:33:27.728063+0000","last_clean":"2024-04-23T18:33:27.728063+0000","last_became_active":"2024-04-23T18:29:21.533103+0000","last_became_peered":"2024-04-23T18:29:21.533103+0000","last_unstale":"2024-04-23T18:33:27.728063+0000","last_undegraded":"2024-04-23T18:33:27.728063+0000","last_fullsized":"2024-04-23T18:33:27.728063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:27.727942+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:27.727942+0000","last_clean_scrub_stamp":"2024-04-23T18:33:27.727942+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:42.711771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.333366+0000","last_change":"2024-04-23T18:33:01.333394+0000","last_active":"2024-04-23T18:33:01.333366+0000","last_peered":"2024-04-23T18:33:01.333366+0000","last_clean":"2024-04-23T18:33:01.333366+0000","last_became_active":"2024-04-23T18:29:13.499795+0000","last_became_peered":"2024-04-23T18:29:13.499795+0000","last_unstale":"2024-04-23T18:33:01.333366+0000","last_undegraded":"2024-04-23T18:33:01.333366+0000","last_fullsized":"2024-04-23T18:33:01.333366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:33:01.333276+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:33:01.333276+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.333276+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:19.961956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.761159+0000","last_change":"2024-04-23T18:29:11.503536+0000","last_active":"2024-04-23T18:31:26.761159+0000","last_peered":"2024-04-23T18:31:26.761159+0000","last_clean":"2024-04-23T18:31:26.761159+0000","last_became_active":"2024-04-23T18:29:11.503228+0000","last_became_peered":"2024-04-23T18:29:11.503228+0000","last_unstale":"2024-04-23T18:31:26.761159+0000","last_undegraded":"2024-04-23T18:31:26.761159+0000","last_fullsized":"2024-04-23T18:31:26.761159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.210465+0000","last_change":"2024-04-23T18:32:50.210518+0000","last_active":"2024-04-23T18:32:50.210465+0000","last_peered":"2024-04-23T18:32:50.210465+0000","last_clean":"2024-04-23T18:32:50.210465+0000","last_became_active":"2024-04-23T18:29:15.509856+0000","last_became_peered":"2024-04-23T18:29:15.509856+0000","last_unstale":"2024-04-23T18:32:50.210465+0000","last_undegraded":"2024-04-23T18:32:50.210465+0000","last_fullsized":"2024-04-23T18:32:50.210465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.210358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.210358+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.210358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:56.040362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'48","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.397592+0000","last_change":"2024-04-23T18:32:56.397630+0000","last_active":"2024-04-23T18:32:56.397592+0000","last_peered":"2024-04-23T18:32:56.397592+0000","last_clean":"2024-04-23T18:32:56.397592+0000","last_became_active":"2024-04-23T18:29:17.517116+0000","last_became_peered":"2024-04-23T18:29:17.517116+0000","last_unstale":"2024-04-23T18:32:56.397592+0000","last_undegraded":"2024-04-23T18:32:56.397592+0000","last_fullsized":"2024-04-23T18:32:56.397592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:56.397494+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:56.397494+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.397494+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:45.517482+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":360,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.373965+0000","last_change":"2024-04-23T18:32:34.374033+0000","last_active":"2024-04-23T18:32:34.373965+0000","last_peered":"2024-04-23T18:32:34.373965+0000","last_clean":"2024-04-23T18:32:34.373965+0000","last_became_active":"2024-04-23T18:29:19.518519+0000","last_became_peered":"2024-04-23T18:29:19.518519+0000","last_unstale":"2024-04-23T18:32:34.373965+0000","last_undegraded":"2024-04-23T18:32:34.373965+0000","last_fullsized":"2024-04-23T18:32:34.373965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:34.373847+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:34.373847+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.373847+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:40:46.115582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:34.758869+0000","last_change":"2024-04-23T18:29:21.529229+0000","last_active":"2024-04-23T18:31:34.758869+0000","last_peered":"2024-04-23T18:31:34.758869+0000","last_clean":"2024-04-23T18:31:34.758869+0000","last_became_active":"2024-04-23T18:29:21.528917+0000","last_became_peered":"2024-04-23T18:29:21.528917+0000","last_unstale":"2024-04-23T18:31:34.758869+0000","last_undegraded":"2024-04-23T18:31:34.758869+0000","last_fullsized":"2024-04-23T18:31:34.758869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.456270+0000","last_change":"2024-04-23T18:32:55.456298+0000","last_active":"2024-04-23T18:32:55.456270+0000","last_peered":"2024-04-23T18:32:55.456270+0000","last_clean":"2024-04-23T18:32:55.456270+0000","last_became_active":"2024-04-23T18:29:13.499216+0000","last_became_peered":"2024-04-23T18:29:13.499216+0000","last_unstale":"2024-04-23T18:32:55.456270+0000","last_undegraded":"2024-04-23T18:32:55.456270+0000","last_fullsized":"2024-04-23T18:32:55.456270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:55.456182+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:55.456182+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.456182+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:19.038136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:26.761090+0000","last_change":"2024-04-23T18:29:11.511581+0000","last_active":"2024-04-23T18:31:26.761090+0000","last_peered":"2024-04-23T18:31:26.761090+0000","last_clean":"2024-04-23T18:31:26.761090+0000","last_became_active":"2024-04-23T18:29:11.511211+0000","last_became_peered":"2024-04-23T18:29:11.511211+0000","last_unstale":"2024-04-23T18:31:26.761090+0000","last_undegraded":"2024-04-23T18:31:26.761090+0000","last_fullsized":"2024-04-23T18:31:26.761090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.217057+0000","last_change":"2024-04-23T18:32:47.217082+0000","last_active":"2024-04-23T18:32:47.217057+0000","last_peered":"2024-04-23T18:32:47.217057+0000","last_clean":"2024-04-23T18:32:47.217057+0000","last_became_active":"2024-04-23T18:29:15.510350+0000","last_became_peered":"2024-04-23T18:29:15.510350+0000","last_unstale":"2024-04-23T18:32:47.217057+0000","last_undegraded":"2024-04-23T18:32:47.217057+0000","last_fullsized":"2024-04-23T18:32:47.217057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:47.216965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:47.216965+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.216965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:24.954770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'63","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.448578+0000","last_change":"2024-04-23T18:32:51.448618+0000","last_active":"2024-04-23T18:32:51.448578+0000","last_peered":"2024-04-23T18:32:51.448578+0000","last_clean":"2024-04-23T18:32:51.448578+0000","last_became_active":"2024-04-23T18:29:17.513298+0000","last_became_peered":"2024-04-23T18:29:17.513298+0000","last_unstale":"2024-04-23T18:32:51.448578+0000","last_undegraded":"2024-04-23T18:32:51.448578+0000","last_fullsized":"2024-04-23T18:32:51.448578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'63","last_scrub_stamp":"2024-04-23T18:32:51.448483+0000","last_deep_scrub":"34'63","last_deep_scrub_stamp":"2024-04-23T18:32:51.448483+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.448483+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:25.305379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.325801+0000","last_change":"2024-04-23T18:32:35.325849+0000","last_active":"2024-04-23T18:32:35.325801+0000","last_peered":"2024-04-23T18:32:35.325801+0000","last_clean":"2024-04-23T18:32:35.325801+0000","last_became_active":"2024-04-23T18:29:19.518015+0000","last_became_peered":"2024-04-23T18:29:19.518015+0000","last_unstale":"2024-04-23T18:32:35.325801+0000","last_undegraded":"2024-04-23T18:32:35.325801+0000","last_fullsized":"2024-04-23T18:32:35.325801+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.325670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.325670+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.325670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:51.615968+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.326108+0000","last_change":"2024-04-23T18:29:21.529718+0000","last_active":"2024-04-23T18:32:21.326108+0000","last_peered":"2024-04-23T18:32:21.326108+0000","last_clean":"2024-04-23T18:32:21.326108+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:32:21.326108+0000","last_undegraded":"2024-04-23T18:32:21.326108+0000","last_fullsized":"2024-04-23T18:32:21.326108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:31.696955+0000","last_change":"2024-04-23T18:33:31.696980+0000","last_active":"2024-04-23T18:33:31.696955+0000","last_peered":"2024-04-23T18:33:31.696955+0000","last_clean":"2024-04-23T18:33:31.696955+0000","last_became_active":"2024-04-23T18:29:52.550778+0000","last_became_peered":"2024-04-23T18:29:52.550778+0000","last_unstale":"2024-04-23T18:33:31.696955+0000","last_undegraded":"2024-04-23T18:33:31.696955+0000","last_fullsized":"2024-04-23T18:33:31.696955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:31.696847+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:31.696847+0000","last_clean_scrub_stamp":"2024-04-23T18:33:31.696847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:42.394104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:20.282682+0000","last_change":"2024-04-23T18:33:20.282753+0000","last_active":"2024-04-23T18:33:20.282682+0000","last_peered":"2024-04-23T18:33:20.282682+0000","last_clean":"2024-04-23T18:33:20.282682+0000","last_became_active":"2024-04-23T18:29:11.485899+0000","last_became_peered":"2024-04-23T18:29:11.485899+0000","last_unstale":"2024-04-23T18:33:20.282682+0000","last_undegraded":"2024-04-23T18:33:20.282682+0000","last_fullsized":"2024-04-23T18:33:20.282682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:20.282575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:20.282575+0000","last_clean_scrub_stamp":"2024-04-23T18:33:20.282575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:36:57.269431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.488213+0000","last_change":"2024-04-23T18:32:48.488240+0000","last_active":"2024-04-23T18:32:48.488213+0000","last_peered":"2024-04-23T18:32:48.488213+0000","last_clean":"2024-04-23T18:32:48.488213+0000","last_became_active":"2024-04-23T18:29:15.506940+0000","last_became_peered":"2024-04-23T18:29:15.506940+0000","last_unstale":"2024-04-23T18:32:48.488213+0000","last_undegraded":"2024-04-23T18:32:48.488213+0000","last_fullsized":"2024-04-23T18:32:48.488213+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:32:48.488120+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:32:48.488120+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.488120+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:48.524111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.911596+0000","last_change":"2024-04-23T18:32:38.911658+0000","last_active":"2024-04-23T18:32:38.911596+0000","last_peered":"2024-04-23T18:32:38.911596+0000","last_clean":"2024-04-23T18:32:38.911596+0000","last_became_active":"2024-04-23T18:29:17.509586+0000","last_became_peered":"2024-04-23T18:29:17.509586+0000","last_unstale":"2024-04-23T18:32:38.911596+0000","last_undegraded":"2024-04-23T18:32:38.911596+0000","last_fullsized":"2024-04-23T18:32:38.911596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:38.911496+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:38.911496+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.911496+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:46:03.868770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.434020+0000","last_change":"2024-04-23T18:32:53.434051+0000","last_active":"2024-04-23T18:32:53.434020+0000","last_peered":"2024-04-23T18:32:53.434020+0000","last_clean":"2024-04-23T18:32:53.434020+0000","last_became_active":"2024-04-23T18:29:19.521939+0000","last_became_peered":"2024-04-23T18:29:19.521939+0000","last_unstale":"2024-04-23T18:32:53.434020+0000","last_undegraded":"2024-04-23T18:32:53.434020+0000","last_fullsized":"2024-04-23T18:32:53.434020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:53.433929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:53.433929+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.433929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:02.751340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:23.498478+0000","last_change":"2024-04-23T18:33:23.498510+0000","last_active":"2024-04-23T18:33:23.498478+0000","last_peered":"2024-04-23T18:33:23.498478+0000","last_clean":"2024-04-23T18:33:23.498478+0000","last_became_active":"2024-04-23T18:29:21.530270+0000","last_became_peered":"2024-04-23T18:29:21.530270+0000","last_unstale":"2024-04-23T18:33:23.498478+0000","last_undegraded":"2024-04-23T18:33:23.498478+0000","last_fullsized":"2024-04-23T18:33:23.498478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:23.498381+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:23.498381+0000","last_clean_scrub_stamp":"2024-04-23T18:33:23.498381+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:25.752665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.397427+0000","last_change":"2024-04-23T18:32:46.397470+0000","last_active":"2024-04-23T18:32:46.397427+0000","last_peered":"2024-04-23T18:32:46.397427+0000","last_clean":"2024-04-23T18:32:46.397427+0000","last_became_active":"2024-04-23T18:29:13.501430+0000","last_became_peered":"2024-04-23T18:29:13.501430+0000","last_unstale":"2024-04-23T18:32:46.397427+0000","last_undegraded":"2024-04-23T18:32:46.397427+0000","last_fullsized":"2024-04-23T18:32:46.397427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:46.397327+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:46.397327+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.397327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:08.260300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.122330+0000","last_change":"2024-04-23T18:29:11.507985+0000","last_active":"2024-04-23T18:32:32.122330+0000","last_peered":"2024-04-23T18:32:32.122330+0000","last_clean":"2024-04-23T18:32:32.122330+0000","last_became_active":"2024-04-23T18:29:11.507633+0000","last_became_peered":"2024-04-23T18:29:11.507633+0000","last_unstale":"2024-04-23T18:32:32.122330+0000","last_undegraded":"2024-04-23T18:32:32.122330+0000","last_fullsized":"2024-04-23T18:32:32.122330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.266076+0000","last_change":"2024-04-23T18:32:46.266134+0000","last_active":"2024-04-23T18:32:46.266076+0000","last_peered":"2024-04-23T18:32:46.266076+0000","last_clean":"2024-04-23T18:32:46.266076+0000","last_became_active":"2024-04-23T18:29:15.510579+0000","last_became_peered":"2024-04-23T18:29:15.510579+0000","last_unstale":"2024-04-23T18:32:46.266076+0000","last_undegraded":"2024-04-23T18:32:46.266076+0000","last_fullsized":"2024-04-23T18:32:46.266076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:46.265967+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:46.265967+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.265967+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:25:58.382875+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.452470+0000","last_change":"2024-04-23T18:32:44.452506+0000","last_active":"2024-04-23T18:32:44.452470+0000","last_peered":"2024-04-23T18:32:44.452470+0000","last_clean":"2024-04-23T18:32:44.452470+0000","last_became_active":"2024-04-23T18:29:17.512935+0000","last_became_peered":"2024-04-23T18:29:17.512935+0000","last_unstale":"2024-04-23T18:32:44.452470+0000","last_undegraded":"2024-04-23T18:32:44.452470+0000","last_fullsized":"2024-04-23T18:32:44.452470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-23T18:32:44.452352+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-23T18:32:44.452352+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.452352+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:05.628659+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":443,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.342870+0000","last_change":"2024-04-23T18:32:32.342946+0000","last_active":"2024-04-23T18:32:32.342870+0000","last_peered":"2024-04-23T18:32:32.342870+0000","last_clean":"2024-04-23T18:32:32.342870+0000","last_became_active":"2024-04-23T18:29:19.526260+0000","last_became_peered":"2024-04-23T18:29:19.526260+0000","last_unstale":"2024-04-23T18:32:32.342870+0000","last_undegraded":"2024-04-23T18:32:32.342870+0000","last_fullsized":"2024-04-23T18:32:32.342870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:32.342765+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:32.342765+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.342765+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:52.808626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:27.404206+0000","last_change":"2024-04-23T18:33:27.404270+0000","last_active":"2024-04-23T18:33:27.404206+0000","last_peered":"2024-04-23T18:33:27.404206+0000","last_clean":"2024-04-23T18:33:27.404206+0000","last_became_active":"2024-04-23T18:29:21.527108+0000","last_became_peered":"2024-04-23T18:29:21.527108+0000","last_unstale":"2024-04-23T18:33:27.404206+0000","last_undegraded":"2024-04-23T18:33:27.404206+0000","last_fullsized":"2024-04-23T18:33:27.404206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-04-23T18:33:27.404098+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-04-23T18:33:27.404098+0000","last_clean_scrub_stamp":"2024-04-23T18:33:27.404098+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:24:28.051984+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:19.477964+0000","last_change":"2024-04-23T18:33:19.477996+0000","last_active":"2024-04-23T18:33:19.477964+0000","last_peered":"2024-04-23T18:33:19.477964+0000","last_clean":"2024-04-23T18:33:19.477964+0000","last_became_active":"2024-04-23T18:29:13.504570+0000","last_became_peered":"2024-04-23T18:29:13.504570+0000","last_unstale":"2024-04-23T18:33:19.477964+0000","last_undegraded":"2024-04-23T18:33:19.477964+0000","last_fullsized":"2024-04-23T18:33:19.477964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:19.477867+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:19.477867+0000","last_clean_scrub_stamp":"2024-04-23T18:33:19.477867+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:24:04.002849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:26.536102+0000","last_change":"2024-04-23T18:33:26.536102+0000","last_active":"2024-04-23T18:33:26.536102+0000","last_peered":"2024-04-23T18:33:26.536102+0000","last_clean":"2024-04-23T18:33:26.536102+0000","last_became_active":"2024-04-23T18:29:11.505531+0000","last_became_peered":"2024-04-23T18:29:11.505531+0000","last_unstale":"2024-04-23T18:33:26.536102+0000","last_undegraded":"2024-04-23T18:33:26.536102+0000","last_fullsized":"2024-04-23T18:33:26.536102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:26.535971+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:26.535971+0000","last_clean_scrub_stamp":"2024-04-23T18:33:26.535971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:50:25.840864+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":428,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.926494+0000","last_change":"2024-04-23T18:32:49.926526+0000","last_active":"2024-04-23T18:32:49.926494+0000","last_peered":"2024-04-23T18:32:49.926494+0000","last_clean":"2024-04-23T18:32:49.926494+0000","last_became_active":"2024-04-23T18:29:15.505983+0000","last_became_peered":"2024-04-23T18:29:15.505983+0000","last_unstale":"2024-04-23T18:32:49.926494+0000","last_undegraded":"2024-04-23T18:32:49.926494+0000","last_fullsized":"2024-04-23T18:32:49.926494+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:32:49.926413+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:32:49.926413+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.926413+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:14.338142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.465248+0000","last_change":"2024-04-23T18:32:39.465286+0000","last_active":"2024-04-23T18:32:39.465248+0000","last_peered":"2024-04-23T18:32:39.465248+0000","last_clean":"2024-04-23T18:32:39.465248+0000","last_became_active":"2024-04-23T18:29:17.513213+0000","last_became_peered":"2024-04-23T18:29:17.513213+0000","last_unstale":"2024-04-23T18:32:39.465248+0000","last_undegraded":"2024-04-23T18:32:39.465248+0000","last_fullsized":"2024-04-23T18:32:39.465248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-23T18:32:39.465155+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-23T18:32:39.465155+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.465155+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:22.245175+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":480,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.880027+0000","last_change":"2024-04-23T18:32:39.880054+0000","last_active":"2024-04-23T18:32:39.880027+0000","last_peered":"2024-04-23T18:32:39.880027+0000","last_clean":"2024-04-23T18:32:39.880027+0000","last_became_active":"2024-04-23T18:29:19.518528+0000","last_became_peered":"2024-04-23T18:29:19.518528+0000","last_unstale":"2024-04-23T18:32:39.880027+0000","last_undegraded":"2024-04-23T18:32:39.880027+0000","last_fullsized":"2024-04-23T18:32:39.880027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:39.879912+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:39.879912+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.879912+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:36.345360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.480613+0000","last_change":"2024-04-23T18:32:49.480613+0000","last_active":"2024-04-23T18:32:49.480613+0000","last_peered":"2024-04-23T18:32:49.480613+0000","last_clean":"2024-04-23T18:32:49.480613+0000","last_became_active":"2024-04-23T18:29:21.530946+0000","last_became_peered":"2024-04-23T18:29:21.530946+0000","last_unstale":"2024-04-23T18:32:49.480613+0000","last_undegraded":"2024-04-23T18:32:49.480613+0000","last_fullsized":"2024-04-23T18:32:49.480613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:49.480502+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:49.480502+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.480502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:18.888990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.873946+0000","last_change":"2024-04-23T18:32:52.873980+0000","last_active":"2024-04-23T18:32:52.873946+0000","last_peered":"2024-04-23T18:32:52.873946+0000","last_clean":"2024-04-23T18:32:52.873946+0000","last_became_active":"2024-04-23T18:29:13.507813+0000","last_became_peered":"2024-04-23T18:29:13.507813+0000","last_unstale":"2024-04-23T18:32:52.873946+0000","last_undegraded":"2024-04-23T18:32:52.873946+0000","last_fullsized":"2024-04-23T18:32:52.873946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:52.873850+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:52.873850+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.873850+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:37:08.666381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.122281+0000","last_change":"2024-04-23T18:29:11.501752+0000","last_active":"2024-04-23T18:32:32.122281+0000","last_peered":"2024-04-23T18:32:32.122281+0000","last_clean":"2024-04-23T18:32:32.122281+0000","last_became_active":"2024-04-23T18:29:11.501432+0000","last_became_peered":"2024-04-23T18:29:11.501432+0000","last_unstale":"2024-04-23T18:32:32.122281+0000","last_undegraded":"2024-04-23T18:32:32.122281+0000","last_fullsized":"2024-04-23T18:32:32.122281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.427463+0000","last_change":"2024-04-23T18:32:34.427490+0000","last_active":"2024-04-23T18:32:34.427463+0000","last_peered":"2024-04-23T18:32:34.427463+0000","last_clean":"2024-04-23T18:32:34.427463+0000","last_became_active":"2024-04-23T18:29:15.509701+0000","last_became_peered":"2024-04-23T18:29:15.509701+0000","last_unstale":"2024-04-23T18:32:34.427463+0000","last_undegraded":"2024-04-23T18:32:34.427463+0000","last_fullsized":"2024-04-23T18:32:34.427463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:34.427372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:34.427372+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.427372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:27.299606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.866403+0000","last_change":"2024-04-23T18:32:40.866441+0000","last_active":"2024-04-23T18:32:40.866403+0000","last_peered":"2024-04-23T18:32:40.866403+0000","last_clean":"2024-04-23T18:32:40.866403+0000","last_became_active":"2024-04-23T18:29:17.509672+0000","last_became_peered":"2024-04-23T18:29:17.509672+0000","last_unstale":"2024-04-23T18:32:40.866403+0000","last_undegraded":"2024-04-23T18:32:40.866403+0000","last_fullsized":"2024-04-23T18:32:40.866403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:40.866301+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:40.866301+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.866301+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:40.902292+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.357680+0000","last_change":"2024-04-23T18:32:33.357709+0000","last_active":"2024-04-23T18:32:33.357680+0000","last_peered":"2024-04-23T18:32:33.357680+0000","last_clean":"2024-04-23T18:32:33.357680+0000","last_became_active":"2024-04-23T18:29:19.526861+0000","last_became_peered":"2024-04-23T18:29:19.526861+0000","last_unstale":"2024-04-23T18:32:33.357680+0000","last_undegraded":"2024-04-23T18:32:33.357680+0000","last_fullsized":"2024-04-23T18:32:33.357680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.357572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.357572+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.357572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:35:59.244732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.921133+0000","last_change":"2024-04-23T18:32:59.921133+0000","last_active":"2024-04-23T18:32:59.921133+0000","last_peered":"2024-04-23T18:32:59.921133+0000","last_clean":"2024-04-23T18:32:59.921133+0000","last_became_active":"2024-04-23T18:29:21.530612+0000","last_became_peered":"2024-04-23T18:29:21.530612+0000","last_unstale":"2024-04-23T18:32:59.921133+0000","last_undegraded":"2024-04-23T18:32:59.921133+0000","last_fullsized":"2024-04-23T18:32:59.921133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-23T18:32:59.921013+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-23T18:32:59.921013+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.921013+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:38.050899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.476924+0000","last_change":"2024-04-23T18:32:50.476924+0000","last_active":"2024-04-23T18:32:50.476924+0000","last_peered":"2024-04-23T18:32:50.476924+0000","last_clean":"2024-04-23T18:32:50.476924+0000","last_became_active":"2024-04-23T18:29:13.501636+0000","last_became_peered":"2024-04-23T18:29:13.501636+0000","last_unstale":"2024-04-23T18:32:50.476924+0000","last_undegraded":"2024-04-23T18:32:50.476924+0000","last_fullsized":"2024-04-23T18:32:50.476924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:50.476795+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:50.476795+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.476795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:25.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":214,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:17.830353+0000","last_change":"2024-04-23T18:33:17.830409+0000","last_active":"2024-04-23T18:33:17.830353+0000","last_peered":"2024-04-23T18:33:17.830353+0000","last_clean":"2024-04-23T18:33:17.830353+0000","last_became_active":"2024-04-23T18:28:58.798001+0000","last_became_peered":"2024-04-23T18:28:58.798001+0000","last_unstale":"2024-04-23T18:33:17.830353+0000","last_undegraded":"2024-04-23T18:33:17.830353+0000","last_fullsized":"2024-04-23T18:33:17.830353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-04-23T18:33:17.830243+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-04-23T18:33:17.830243+0000","last_clean_scrub_stamp":"2024-04-23T18:33:17.830243+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:27.147654+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.122213+0000","last_change":"2024-04-23T18:29:03.446652+0000","last_active":"2024-04-23T18:32:32.122213+0000","last_peered":"2024-04-23T18:32:32.122213+0000","last_clean":"2024-04-23T18:32:32.122213+0000","last_became_active":"2024-04-23T18:29:03.446324+0000","last_became_peered":"2024-04-23T18:29:03.446324+0000","last_unstale":"2024-04-23T18:32:32.122213+0000","last_undegraded":"2024-04-23T18:32:32.122213+0000","last_fullsized":"2024-04-23T18:32:32.122213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:21.454345+0000","last_change":"2024-04-23T18:33:21.454345+0000","last_active":"2024-04-23T18:33:21.454345+0000","last_peered":"2024-04-23T18:33:21.454345+0000","last_clean":"2024-04-23T18:33:21.454345+0000","last_became_active":"2024-04-23T18:29:11.512684+0000","last_became_peered":"2024-04-23T18:29:11.512684+0000","last_unstale":"2024-04-23T18:33:21.454345+0000","last_undegraded":"2024-04-23T18:33:21.454345+0000","last_fullsized":"2024-04-23T18:33:21.454345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:21.454232+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:21.454232+0000","last_clean_scrub_stamp":"2024-04-23T18:33:21.454232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:01.167381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.866824+0000","last_change":"2024-04-23T18:32:46.866824+0000","last_active":"2024-04-23T18:32:46.866824+0000","last_peered":"2024-04-23T18:32:46.866824+0000","last_clean":"2024-04-23T18:32:46.866824+0000","last_became_active":"2024-04-23T18:29:15.509209+0000","last_became_peered":"2024-04-23T18:29:15.509209+0000","last_unstale":"2024-04-23T18:32:46.866824+0000","last_undegraded":"2024-04-23T18:32:46.866824+0000","last_fullsized":"2024-04-23T18:32:46.866824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:46.866699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:46.866699+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.866699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:45.485566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'87","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.423367+0000","last_change":"2024-04-23T18:32:47.423434+0000","last_active":"2024-04-23T18:32:47.423367+0000","last_peered":"2024-04-23T18:32:47.423367+0000","last_clean":"2024-04-23T18:32:47.423367+0000","last_became_active":"2024-04-23T18:29:17.513504+0000","last_became_peered":"2024-04-23T18:29:17.513504+0000","last_unstale":"2024-04-23T18:32:47.423367+0000","last_undegraded":"2024-04-23T18:32:47.423367+0000","last_fullsized":"2024-04-23T18:32:47.423367+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-04-23T18:32:47.423269+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-04-23T18:32:47.423269+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.423269+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:31.948251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.310579+0000","last_change":"2024-04-23T18:32:36.310603+0000","last_active":"2024-04-23T18:32:36.310579+0000","last_peered":"2024-04-23T18:32:36.310579+0000","last_clean":"2024-04-23T18:32:36.310579+0000","last_became_active":"2024-04-23T18:29:19.518974+0000","last_became_peered":"2024-04-23T18:29:19.518974+0000","last_unstale":"2024-04-23T18:32:36.310579+0000","last_undegraded":"2024-04-23T18:32:36.310579+0000","last_fullsized":"2024-04-23T18:32:36.310579+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.310468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.310468+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.310468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:09:49.509664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":171,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:20.467836+0000","last_change":"2024-04-23T18:33:20.467879+0000","last_active":"2024-04-23T18:33:20.467836+0000","last_peered":"2024-04-23T18:33:20.467836+0000","last_clean":"2024-04-23T18:33:20.467836+0000","last_became_active":"2024-04-23T18:29:21.531725+0000","last_became_peered":"2024-04-23T18:29:21.531725+0000","last_unstale":"2024-04-23T18:33:20.467836+0000","last_undegraded":"2024-04-23T18:33:20.467836+0000","last_fullsized":"2024-04-23T18:33:20.467836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-04-23T18:33:20.467729+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-04-23T18:33:20.467729+0000","last_clean_scrub_stamp":"2024-04-23T18:33:20.467729+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:53.257286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.478878+0000","last_change":"2024-04-23T18:33:09.478908+0000","last_active":"2024-04-23T18:33:09.478878+0000","last_peered":"2024-04-23T18:33:09.478878+0000","last_clean":"2024-04-23T18:33:09.478878+0000","last_became_active":"2024-04-23T18:29:13.497008+0000","last_became_peered":"2024-04-23T18:29:13.497008+0000","last_unstale":"2024-04-23T18:33:09.478878+0000","last_undegraded":"2024-04-23T18:33:09.478878+0000","last_fullsized":"2024-04-23T18:33:09.478878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:09.478793+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:09.478793+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.478793+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:03.219719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.122192+0000","last_change":"2024-04-23T18:29:03.447767+0000","last_active":"2024-04-23T18:32:32.122192+0000","last_peered":"2024-04-23T18:32:32.122192+0000","last_clean":"2024-04-23T18:32:32.122192+0000","last_became_active":"2024-04-23T18:29:03.447404+0000","last_became_peered":"2024-04-23T18:29:03.447404+0000","last_unstale":"2024-04-23T18:32:32.122192+0000","last_undegraded":"2024-04-23T18:32:32.122192+0000","last_fullsized":"2024-04-23T18:32:32.122192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:22.326866+0000","last_change":"2024-04-23T18:33:22.326866+0000","last_active":"2024-04-23T18:33:22.326866+0000","last_peered":"2024-04-23T18:33:22.326866+0000","last_clean":"2024-04-23T18:33:22.326866+0000","last_became_active":"2024-04-23T18:29:11.486538+0000","last_became_peered":"2024-04-23T18:29:11.486538+0000","last_unstale":"2024-04-23T18:33:22.326866+0000","last_undegraded":"2024-04-23T18:33:22.326866+0000","last_fullsized":"2024-04-23T18:33:22.326866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:22.326686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:22.326686+0000","last_clean_scrub_stamp":"2024-04-23T18:33:22.326686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:11:21.758841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.435741+0000","last_change":"2024-04-23T18:32:40.435765+0000","last_active":"2024-04-23T18:32:40.435741+0000","last_peered":"2024-04-23T18:32:40.435741+0000","last_clean":"2024-04-23T18:32:40.435741+0000","last_became_active":"2024-04-23T18:29:15.508020+0000","last_became_peered":"2024-04-23T18:29:15.508020+0000","last_unstale":"2024-04-23T18:32:40.435741+0000","last_undegraded":"2024-04-23T18:32:40.435741+0000","last_fullsized":"2024-04-23T18:32:40.435741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:40.435654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:40.435654+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.435654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:16.738684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'291","reported_seq":517,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.927476+0000","last_change":"2024-04-23T18:32:36.927476+0000","last_active":"2024-04-23T18:32:36.927476+0000","last_peered":"2024-04-23T18:32:36.927476+0000","last_clean":"2024-04-23T18:32:36.927476+0000","last_became_active":"2024-04-23T18:29:17.515023+0000","last_became_peered":"2024-04-23T18:29:17.515023+0000","last_unstale":"2024-04-23T18:32:36.927476+0000","last_undegraded":"2024-04-23T18:32:36.927476+0000","last_fullsized":"2024-04-23T18:32:36.927476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'291","last_scrub_stamp":"2024-04-23T18:32:36.927295+0000","last_deep_scrub":"34'291","last_deep_scrub_stamp":"2024-04-23T18:32:36.927295+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.927295+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:58.103602+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.428147+0000","last_change":"2024-04-23T18:32:55.428147+0000","last_active":"2024-04-23T18:32:55.428147+0000","last_peered":"2024-04-23T18:32:55.428147+0000","last_clean":"2024-04-23T18:32:55.428147+0000","last_became_active":"2024-04-23T18:29:19.522105+0000","last_became_peered":"2024-04-23T18:29:19.522105+0000","last_unstale":"2024-04-23T18:32:55.428147+0000","last_undegraded":"2024-04-23T18:32:55.428147+0000","last_fullsized":"2024-04-23T18:32:55.428147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:55.428038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:55.428038+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.428038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:30:42.649870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:28.757875+0000","last_change":"2024-04-23T18:33:28.757941+0000","last_active":"2024-04-23T18:33:28.757875+0000","last_peered":"2024-04-23T18:33:28.757875+0000","last_clean":"2024-04-23T18:33:28.757875+0000","last_became_active":"2024-04-23T18:29:21.532867+0000","last_became_peered":"2024-04-23T18:29:21.532867+0000","last_unstale":"2024-04-23T18:33:28.757875+0000","last_undegraded":"2024-04-23T18:33:28.757875+0000","last_fullsized":"2024-04-23T18:33:28.757875+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-23T18:33:28.757767+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-23T18:33:28.757767+0000","last_clean_scrub_stamp":"2024-04-23T18:33:28.757767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:37.761007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:16.247540+0000","last_change":"2024-04-23T18:33:16.247567+0000","last_active":"2024-04-23T18:33:16.247540+0000","last_peered":"2024-04-23T18:33:16.247540+0000","last_clean":"2024-04-23T18:33:16.247540+0000","last_became_active":"2024-04-23T18:29:13.499253+0000","last_became_peered":"2024-04-23T18:29:13.499253+0000","last_unstale":"2024-04-23T18:33:16.247540+0000","last_undegraded":"2024-04-23T18:33:16.247540+0000","last_fullsized":"2024-04-23T18:33:16.247540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-23T18:33:16.247440+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-23T18:33:16.247440+0000","last_clean_scrub_stamp":"2024-04-23T18:33:16.247440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:40:13.131062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.337306+0000","last_change":"2024-04-23T18:33:11.337306+0000","last_active":"2024-04-23T18:33:11.337306+0000","last_peered":"2024-04-23T18:33:11.337306+0000","last_clean":"2024-04-23T18:33:11.337306+0000","last_became_active":"2024-04-23T18:29:03.446647+0000","last_became_peered":"2024-04-23T18:29:03.446647+0000","last_unstale":"2024-04-23T18:33:11.337306+0000","last_undegraded":"2024-04-23T18:33:11.337306+0000","last_fullsized":"2024-04-23T18:33:11.337306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:11.337177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:11.337177+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.337177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:54.117197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:17.242431+0000","last_change":"2024-04-23T18:33:17.242458+0000","last_active":"2024-04-23T18:33:17.242431+0000","last_peered":"2024-04-23T18:33:17.242431+0000","last_clean":"2024-04-23T18:33:17.242431+0000","last_became_active":"2024-04-23T18:29:11.491953+0000","last_became_peered":"2024-04-23T18:29:11.491953+0000","last_unstale":"2024-04-23T18:33:17.242431+0000","last_undegraded":"2024-04-23T18:33:17.242431+0000","last_fullsized":"2024-04-23T18:33:17.242431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:17.242339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:17.242339+0000","last_clean_scrub_stamp":"2024-04-23T18:33:17.242339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:01.349691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:26.435036+0000","last_change":"2024-04-23T18:33:26.435087+0000","last_active":"2024-04-23T18:33:26.435036+0000","last_peered":"2024-04-23T18:33:26.435036+0000","last_clean":"2024-04-23T18:33:26.435036+0000","last_became_active":"2024-04-23T18:29:52.551265+0000","last_became_peered":"2024-04-23T18:29:52.551265+0000","last_unstale":"2024-04-23T18:33:26.435036+0000","last_undegraded":"2024-04-23T18:33:26.435036+0000","last_fullsized":"2024-04-23T18:33:26.435036+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:26.434912+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:26.434912+0000","last_clean_scrub_stamp":"2024-04-23T18:33:26.434912+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:09.367601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.370172+0000","last_change":"2024-04-23T18:32:42.370172+0000","last_active":"2024-04-23T18:32:42.370172+0000","last_peered":"2024-04-23T18:32:42.370172+0000","last_clean":"2024-04-23T18:32:42.370172+0000","last_became_active":"2024-04-23T18:29:17.513875+0000","last_became_peered":"2024-04-23T18:29:17.513875+0000","last_unstale":"2024-04-23T18:32:42.370172+0000","last_undegraded":"2024-04-23T18:32:42.370172+0000","last_fullsized":"2024-04-23T18:32:42.370172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-23T18:32:42.370053+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-23T18:32:42.370053+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.370053+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:16:11.051682+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:31.497737+0000","last_change":"2024-04-23T18:32:31.497737+0000","last_active":"2024-04-23T18:32:31.497737+0000","last_peered":"2024-04-23T18:32:31.497737+0000","last_clean":"2024-04-23T18:32:31.497737+0000","last_became_active":"2024-04-23T18:29:19.518744+0000","last_became_peered":"2024-04-23T18:29:19.518744+0000","last_unstale":"2024-04-23T18:32:31.497737+0000","last_undegraded":"2024-04-23T18:32:31.497737+0000","last_fullsized":"2024-04-23T18:32:31.497737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:31.497603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:31.497603+0000","last_clean_scrub_stamp":"2024-04-23T18:32:31.497603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:37.446181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762596+0000","last_change":"2024-04-23T18:29:21.533685+0000","last_active":"2024-04-23T18:31:36.762596+0000","last_peered":"2024-04-23T18:31:36.762596+0000","last_clean":"2024-04-23T18:31:36.762596+0000","last_became_active":"2024-04-23T18:29:21.533358+0000","last_became_peered":"2024-04-23T18:29:21.533358+0000","last_unstale":"2024-04-23T18:31:36.762596+0000","last_undegraded":"2024-04-23T18:31:36.762596+0000","last_fullsized":"2024-04-23T18:31:36.762596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.247736+0000","last_change":"2024-04-23T18:33:02.247736+0000","last_active":"2024-04-23T18:33:02.247736+0000","last_peered":"2024-04-23T18:33:02.247736+0000","last_clean":"2024-04-23T18:33:02.247736+0000","last_became_active":"2024-04-23T18:29:13.493321+0000","last_became_peered":"2024-04-23T18:29:13.493321+0000","last_unstale":"2024-04-23T18:33:02.247736+0000","last_undegraded":"2024-04-23T18:33:02.247736+0000","last_fullsized":"2024-04-23T18:33:02.247736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:02.247619+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:02.247619+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.247619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:16.283269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.122203+0000","last_change":"2024-04-23T18:29:03.446774+0000","last_active":"2024-04-23T18:32:32.122203+0000","last_peered":"2024-04-23T18:32:32.122203+0000","last_clean":"2024-04-23T18:32:32.122203+0000","last_became_active":"2024-04-23T18:29:03.446457+0000","last_became_peered":"2024-04-23T18:29:03.446457+0000","last_unstale":"2024-04-23T18:32:32.122203+0000","last_undegraded":"2024-04-23T18:32:32.122203+0000","last_fullsized":"2024-04-23T18:32:32.122203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:14.439946+0000","last_change":"2024-04-23T18:33:14.439946+0000","last_active":"2024-04-23T18:33:14.439946+0000","last_peered":"2024-04-23T18:33:14.439946+0000","last_clean":"2024-04-23T18:33:14.439946+0000","last_became_active":"2024-04-23T18:29:11.482896+0000","last_became_peered":"2024-04-23T18:29:11.482896+0000","last_unstale":"2024-04-23T18:33:14.439946+0000","last_undegraded":"2024-04-23T18:33:14.439946+0000","last_fullsized":"2024-04-23T18:33:14.439946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:14.439753+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:14.439753+0000","last_clean_scrub_stamp":"2024-04-23T18:33:14.439753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:02:31.534674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.239612+0000","last_change":"2024-04-23T18:32:53.239612+0000","last_active":"2024-04-23T18:32:53.239612+0000","last_peered":"2024-04-23T18:32:53.239612+0000","last_clean":"2024-04-23T18:32:53.239612+0000","last_became_active":"2024-04-23T18:29:15.507357+0000","last_became_peered":"2024-04-23T18:29:15.507357+0000","last_unstale":"2024-04-23T18:32:53.239612+0000","last_undegraded":"2024-04-23T18:32:53.239612+0000","last_fullsized":"2024-04-23T18:32:53.239612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:53.239511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:53.239511+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.239511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:19:54.363767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.488413+0000","last_change":"2024-04-23T18:33:04.488473+0000","last_active":"2024-04-23T18:33:04.488413+0000","last_peered":"2024-04-23T18:33:04.488413+0000","last_clean":"2024-04-23T18:33:04.488413+0000","last_became_active":"2024-04-23T18:29:17.513393+0000","last_became_peered":"2024-04-23T18:29:17.513393+0000","last_unstale":"2024-04-23T18:33:04.488413+0000","last_undegraded":"2024-04-23T18:33:04.488413+0000","last_fullsized":"2024-04-23T18:33:04.488413+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-04-23T18:33:04.488295+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-04-23T18:33:04.488295+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.488295+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:35:28.849946+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.456642+0000","last_change":"2024-04-23T18:33:03.456665+0000","last_active":"2024-04-23T18:33:03.456642+0000","last_peered":"2024-04-23T18:33:03.456642+0000","last_clean":"2024-04-23T18:33:03.456642+0000","last_became_active":"2024-04-23T18:29:19.523070+0000","last_became_peered":"2024-04-23T18:29:19.523070+0000","last_unstale":"2024-04-23T18:33:03.456642+0000","last_undegraded":"2024-04-23T18:33:03.456642+0000","last_fullsized":"2024-04-23T18:33:03.456642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:03.456548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:03.456548+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.456548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:18.440377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.889005+0000","last_change":"2024-04-23T18:32:47.889033+0000","last_active":"2024-04-23T18:32:47.889005+0000","last_peered":"2024-04-23T18:32:47.889005+0000","last_clean":"2024-04-23T18:32:47.889005+0000","last_became_active":"2024-04-23T18:29:21.528764+0000","last_became_peered":"2024-04-23T18:29:21.528764+0000","last_unstale":"2024-04-23T18:32:47.889005+0000","last_undegraded":"2024-04-23T18:32:47.889005+0000","last_fullsized":"2024-04-23T18:32:47.889005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:47.888900+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:47.888900+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.888900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:11.470854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.869141+0000","last_change":"2024-04-23T18:32:54.869141+0000","last_active":"2024-04-23T18:32:54.869141+0000","last_peered":"2024-04-23T18:32:54.869141+0000","last_clean":"2024-04-23T18:32:54.869141+0000","last_became_active":"2024-04-23T18:29:13.507496+0000","last_became_peered":"2024-04-23T18:29:13.507496+0000","last_unstale":"2024-04-23T18:32:54.869141+0000","last_undegraded":"2024-04-23T18:32:54.869141+0000","last_fullsized":"2024-04-23T18:32:54.869141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:32:54.869026+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:32:54.869026+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.869026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:13.533697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:15.480660+0000","last_change":"2024-04-23T18:33:15.480660+0000","last_active":"2024-04-23T18:33:15.480660+0000","last_peered":"2024-04-23T18:33:15.480660+0000","last_clean":"2024-04-23T18:33:15.480660+0000","last_became_active":"2024-04-23T18:29:11.482348+0000","last_became_peered":"2024-04-23T18:29:11.482348+0000","last_unstale":"2024-04-23T18:33:15.480660+0000","last_undegraded":"2024-04-23T18:33:15.480660+0000","last_fullsized":"2024-04-23T18:33:15.480660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:15.480495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:15.480495+0000","last_clean_scrub_stamp":"2024-04-23T18:33:15.480495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.036007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:19.264717+0000","last_change":"2024-04-23T18:33:19.264738+0000","last_active":"2024-04-23T18:33:19.264717+0000","last_peered":"2024-04-23T18:33:19.264717+0000","last_clean":"2024-04-23T18:33:19.264717+0000","last_became_active":"2024-04-23T18:29:03.446286+0000","last_became_peered":"2024-04-23T18:29:03.446286+0000","last_unstale":"2024-04-23T18:33:19.264717+0000","last_undegraded":"2024-04-23T18:33:19.264717+0000","last_fullsized":"2024-04-23T18:33:19.264717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:19.264632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:19.264632+0000","last_clean_scrub_stamp":"2024-04-23T18:33:19.264632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:25:21.621895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:23.502004+0000","last_change":"2024-04-23T18:33:23.502032+0000","last_active":"2024-04-23T18:33:23.502004+0000","last_peered":"2024-04-23T18:33:23.502004+0000","last_clean":"2024-04-23T18:33:23.502004+0000","last_became_active":"2024-04-23T18:29:52.553851+0000","last_became_peered":"2024-04-23T18:29:52.553851+0000","last_unstale":"2024-04-23T18:33:23.502004+0000","last_undegraded":"2024-04-23T18:33:23.502004+0000","last_fullsized":"2024-04-23T18:33:23.502004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:23.501922+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:23.501922+0000","last_clean_scrub_stamp":"2024-04-23T18:33:23.501922+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:57.358817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'73","reported_seq":150,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.321101+0000","last_change":"2024-04-23T18:32:41.321101+0000","last_active":"2024-04-23T18:32:41.321101+0000","last_peered":"2024-04-23T18:32:41.321101+0000","last_clean":"2024-04-23T18:32:41.321101+0000","last_became_active":"2024-04-23T18:29:17.513599+0000","last_became_peered":"2024-04-23T18:29:17.513599+0000","last_unstale":"2024-04-23T18:32:41.321101+0000","last_undegraded":"2024-04-23T18:32:41.321101+0000","last_fullsized":"2024-04-23T18:32:41.321101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'73","last_scrub_stamp":"2024-04-23T18:32:41.320952+0000","last_deep_scrub":"34'73","last_deep_scrub_stamp":"2024-04-23T18:32:41.320952+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.320952+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:13:39.361578+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.404932+0000","last_change":"2024-04-23T18:32:34.404932+0000","last_active":"2024-04-23T18:32:34.404932+0000","last_peered":"2024-04-23T18:32:34.404932+0000","last_clean":"2024-04-23T18:32:34.404932+0000","last_became_active":"2024-04-23T18:29:19.526192+0000","last_became_peered":"2024-04-23T18:29:19.526192+0000","last_unstale":"2024-04-23T18:32:34.404932+0000","last_undegraded":"2024-04-23T18:32:34.404932+0000","last_fullsized":"2024-04-23T18:32:34.404932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:34.404810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:34.404810+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.404810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:37.587320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:39.759670+0000","last_change":"2024-04-23T18:29:21.533405+0000","last_active":"2024-04-23T18:31:39.759670+0000","last_peered":"2024-04-23T18:31:39.759670+0000","last_clean":"2024-04-23T18:31:39.759670+0000","last_became_active":"2024-04-23T18:29:21.533202+0000","last_became_peered":"2024-04-23T18:29:21.533202+0000","last_unstale":"2024-04-23T18:31:39.759670+0000","last_undegraded":"2024-04-23T18:31:39.759670+0000","last_fullsized":"2024-04-23T18:31:39.759670+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":32,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.935822+0000","last_change":"2024-04-23T18:32:57.935822+0000","last_active":"2024-04-23T18:32:57.935822+0000","last_peered":"2024-04-23T18:32:57.935822+0000","last_clean":"2024-04-23T18:32:57.935822+0000","last_became_active":"2024-04-23T18:29:13.506795+0000","last_became_peered":"2024-04-23T18:29:13.506795+0000","last_unstale":"2024-04-23T18:32:57.935822+0000","last_undegraded":"2024-04-23T18:32:57.935822+0000","last_fullsized":"2024-04-23T18:32:57.935822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:57.935674+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:57.935674+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.935674+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:38.815854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:24.380541+0000","last_change":"2024-04-23T18:33:24.380541+0000","last_active":"2024-04-23T18:33:24.380541+0000","last_peered":"2024-04-23T18:33:24.380541+0000","last_clean":"2024-04-23T18:33:24.380541+0000","last_became_active":"2024-04-23T18:29:11.491882+0000","last_became_peered":"2024-04-23T18:29:11.491882+0000","last_unstale":"2024-04-23T18:33:24.380541+0000","last_undegraded":"2024-04-23T18:33:24.380541+0000","last_fullsized":"2024-04-23T18:33:24.380541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:24.380405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:24.380405+0000","last_clean_scrub_stamp":"2024-04-23T18:33:24.380405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:02:59.746649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.122221+0000","last_change":"2024-04-23T18:29:03.447598+0000","last_active":"2024-04-23T18:32:32.122221+0000","last_peered":"2024-04-23T18:32:32.122221+0000","last_clean":"2024-04-23T18:32:32.122221+0000","last_became_active":"2024-04-23T18:29:03.447265+0000","last_became_peered":"2024-04-23T18:29:03.447265+0000","last_unstale":"2024-04-23T18:32:32.122221+0000","last_undegraded":"2024-04-23T18:32:32.122221+0000","last_fullsized":"2024-04-23T18:32:32.122221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.440839+0000","last_change":"2024-04-23T18:32:42.440839+0000","last_active":"2024-04-23T18:32:42.440839+0000","last_peered":"2024-04-23T18:32:42.440839+0000","last_clean":"2024-04-23T18:32:42.440839+0000","last_became_active":"2024-04-23T18:29:15.506394+0000","last_became_peered":"2024-04-23T18:29:15.506394+0000","last_unstale":"2024-04-23T18:32:42.440839+0000","last_undegraded":"2024-04-23T18:32:42.440839+0000","last_fullsized":"2024-04-23T18:32:42.440839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:42.440734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:42.440734+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.440734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:59.535655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.939954+0000","last_change":"2024-04-23T18:32:34.939954+0000","last_active":"2024-04-23T18:32:34.939954+0000","last_peered":"2024-04-23T18:32:34.939954+0000","last_clean":"2024-04-23T18:32:34.939954+0000","last_became_active":"2024-04-23T18:29:17.515048+0000","last_became_peered":"2024-04-23T18:29:17.515048+0000","last_unstale":"2024-04-23T18:32:34.939954+0000","last_undegraded":"2024-04-23T18:32:34.939954+0000","last_fullsized":"2024-04-23T18:32:34.939954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-04-23T18:32:34.939820+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-04-23T18:32:34.939820+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.939820+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:16:03.621449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":382,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.962456+0000","last_change":"2024-04-23T18:32:33.962456+0000","last_active":"2024-04-23T18:32:33.962456+0000","last_peered":"2024-04-23T18:32:33.962456+0000","last_clean":"2024-04-23T18:32:33.962456+0000","last_became_active":"2024-04-23T18:29:19.518668+0000","last_became_peered":"2024-04-23T18:29:19.518668+0000","last_unstale":"2024-04-23T18:32:33.962456+0000","last_undegraded":"2024-04-23T18:32:33.962456+0000","last_fullsized":"2024-04-23T18:32:33.962456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:33.962317+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:33.962317+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.962317+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:24:53.232240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.220825+0000","last_change":"2024-04-23T18:29:21.531478+0000","last_active":"2024-04-23T18:32:21.220825+0000","last_peered":"2024-04-23T18:32:21.220825+0000","last_clean":"2024-04-23T18:32:21.220825+0000","last_became_active":"2024-04-23T18:29:21.531185+0000","last_became_peered":"2024-04-23T18:29:21.531185+0000","last_unstale":"2024-04-23T18:32:21.220825+0000","last_undegraded":"2024-04-23T18:32:21.220825+0000","last_fullsized":"2024-04-23T18:32:21.220825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.354121+0000","last_change":"2024-04-23T18:32:44.354121+0000","last_active":"2024-04-23T18:32:44.354121+0000","last_peered":"2024-04-23T18:32:44.354121+0000","last_clean":"2024-04-23T18:32:44.354121+0000","last_became_active":"2024-04-23T18:29:13.503543+0000","last_became_peered":"2024-04-23T18:29:13.503543+0000","last_unstale":"2024-04-23T18:32:44.354121+0000","last_undegraded":"2024-04-23T18:32:44.354121+0000","last_fullsized":"2024-04-23T18:32:44.354121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:44.353948+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:44.353948+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.353948+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:19.427152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:25.489126+0000","last_change":"2024-04-23T18:33:25.489126+0000","last_active":"2024-04-23T18:33:25.489126+0000","last_peered":"2024-04-23T18:33:25.489126+0000","last_clean":"2024-04-23T18:33:25.489126+0000","last_became_active":"2024-04-23T18:29:11.505604+0000","last_became_peered":"2024-04-23T18:29:11.505604+0000","last_unstale":"2024-04-23T18:33:25.489126+0000","last_undegraded":"2024-04-23T18:33:25.489126+0000","last_fullsized":"2024-04-23T18:33:25.489126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:25.489010+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:25.489010+0000","last_clean_scrub_stamp":"2024-04-23T18:33:25.489010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:02.186513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:18.275506+0000","last_change":"2024-04-23T18:33:18.275506+0000","last_active":"2024-04-23T18:33:18.275506+0000","last_peered":"2024-04-23T18:33:18.275506+0000","last_clean":"2024-04-23T18:33:18.275506+0000","last_became_active":"2024-04-23T18:29:03.445715+0000","last_became_peered":"2024-04-23T18:29:03.445715+0000","last_unstale":"2024-04-23T18:33:18.275506+0000","last_undegraded":"2024-04-23T18:33:18.275506+0000","last_fullsized":"2024-04-23T18:33:18.275506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:18.275380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:18.275380+0000","last_clean_scrub_stamp":"2024-04-23T18:33:18.275380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:49.220282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.423670+0000","last_change":"2024-04-23T18:32:32.423670+0000","last_active":"2024-04-23T18:32:32.423670+0000","last_peered":"2024-04-23T18:32:32.423670+0000","last_clean":"2024-04-23T18:32:32.423670+0000","last_became_active":"2024-04-23T18:29:15.511553+0000","last_became_peered":"2024-04-23T18:29:15.511553+0000","last_unstale":"2024-04-23T18:32:32.423670+0000","last_undegraded":"2024-04-23T18:32:32.423670+0000","last_fullsized":"2024-04-23T18:32:32.423670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.423553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.423553+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.423553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:27:15.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.450404+0000","last_change":"2024-04-23T18:33:01.450404+0000","last_active":"2024-04-23T18:33:01.450404+0000","last_peered":"2024-04-23T18:33:01.450404+0000","last_clean":"2024-04-23T18:33:01.450404+0000","last_became_active":"2024-04-23T18:29:17.515741+0000","last_became_peered":"2024-04-23T18:29:17.515741+0000","last_unstale":"2024-04-23T18:33:01.450404+0000","last_undegraded":"2024-04-23T18:33:01.450404+0000","last_fullsized":"2024-04-23T18:33:01.450404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:33:01.450263+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:33:01.450263+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.450263+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:17:37.262459+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":412,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.172218+0000","last_change":"2024-04-23T18:32:48.172218+0000","last_active":"2024-04-23T18:32:48.172218+0000","last_peered":"2024-04-23T18:32:48.172218+0000","last_clean":"2024-04-23T18:32:48.172218+0000","last_became_active":"2024-04-23T18:29:19.526375+0000","last_became_peered":"2024-04-23T18:29:19.526375+0000","last_unstale":"2024-04-23T18:32:48.172218+0000","last_undegraded":"2024-04-23T18:32:48.172218+0000","last_fullsized":"2024-04-23T18:32:48.172218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:48.172046+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:48.172046+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.172046+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:32:02.059338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:26.749036+0000","last_change":"2024-04-23T18:33:26.749078+0000","last_active":"2024-04-23T18:33:26.749036+0000","last_peered":"2024-04-23T18:33:26.749036+0000","last_clean":"2024-04-23T18:33:26.749036+0000","last_became_active":"2024-04-23T18:29:21.530911+0000","last_became_peered":"2024-04-23T18:29:21.530911+0000","last_unstale":"2024-04-23T18:33:26.749036+0000","last_undegraded":"2024-04-23T18:33:26.749036+0000","last_fullsized":"2024-04-23T18:33:26.749036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:33:26.748927+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:33:26.748927+0000","last_clean_scrub_stamp":"2024-04-23T18:33:26.748927+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:42.708158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'16","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.310357+0000","last_change":"2024-04-23T18:32:59.310357+0000","last_active":"2024-04-23T18:32:59.310357+0000","last_peered":"2024-04-23T18:32:59.310357+0000","last_clean":"2024-04-23T18:32:59.310357+0000","last_became_active":"2024-04-23T18:29:13.499603+0000","last_became_peered":"2024-04-23T18:29:13.499603+0000","last_unstale":"2024-04-23T18:32:59.310357+0000","last_undegraded":"2024-04-23T18:32:59.310357+0000","last_fullsized":"2024-04-23T18:32:59.310357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:32:59.310197+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:32:59.310197+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.310197+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:47.217542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:19.752875+0000","last_change":"2024-04-23T18:33:19.752875+0000","last_active":"2024-04-23T18:33:19.752875+0000","last_peered":"2024-04-23T18:33:19.752875+0000","last_clean":"2024-04-23T18:33:19.752875+0000","last_became_active":"2024-04-23T18:29:11.488500+0000","last_became_peered":"2024-04-23T18:29:11.488500+0000","last_unstale":"2024-04-23T18:33:19.752875+0000","last_undegraded":"2024-04-23T18:33:19.752875+0000","last_fullsized":"2024-04-23T18:33:19.752875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:19.752732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:19.752732+0000","last_clean_scrub_stamp":"2024-04-23T18:33:19.752732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:31:06.974564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.122295+0000","last_change":"2024-04-23T18:29:03.594008+0000","last_active":"2024-04-23T18:32:32.122295+0000","last_peered":"2024-04-23T18:32:32.122295+0000","last_clean":"2024-04-23T18:32:32.122295+0000","last_became_active":"2024-04-23T18:29:03.593691+0000","last_became_peered":"2024-04-23T18:29:03.593691+0000","last_unstale":"2024-04-23T18:32:32.122295+0000","last_undegraded":"2024-04-23T18:32:32.122295+0000","last_fullsized":"2024-04-23T18:32:32.122295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:02.434205+0000","last_clean_scrub_stamp":"2024-04-23T18:29:02.434205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.430553+0000","last_change":"2024-04-23T18:32:35.430553+0000","last_active":"2024-04-23T18:32:35.430553+0000","last_peered":"2024-04-23T18:32:35.430553+0000","last_clean":"2024-04-23T18:32:35.430553+0000","last_became_active":"2024-04-23T18:29:15.511207+0000","last_became_peered":"2024-04-23T18:29:15.511207+0000","last_unstale":"2024-04-23T18:32:35.430553+0000","last_undegraded":"2024-04-23T18:32:35.430553+0000","last_fullsized":"2024-04-23T18:32:35.430553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.430424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.430424+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.430424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:13.560310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.411316+0000","last_change":"2024-04-23T18:32:40.411316+0000","last_active":"2024-04-23T18:32:40.411316+0000","last_peered":"2024-04-23T18:32:40.411316+0000","last_clean":"2024-04-23T18:32:40.411316+0000","last_became_active":"2024-04-23T18:29:17.515004+0000","last_became_peered":"2024-04-23T18:29:17.515004+0000","last_unstale":"2024-04-23T18:32:40.411316+0000","last_undegraded":"2024-04-23T18:32:40.411316+0000","last_fullsized":"2024-04-23T18:32:40.411316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-04-23T18:32:40.411192+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-04-23T18:32:40.411192+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.411192+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:44.354254+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.340779+0000","last_change":"2024-04-23T18:32:37.340779+0000","last_active":"2024-04-23T18:32:37.340779+0000","last_peered":"2024-04-23T18:32:37.340779+0000","last_clean":"2024-04-23T18:32:37.340779+0000","last_became_active":"2024-04-23T18:29:19.517903+0000","last_became_peered":"2024-04-23T18:29:19.517903+0000","last_unstale":"2024-04-23T18:32:37.340779+0000","last_undegraded":"2024-04-23T18:32:37.340779+0000","last_fullsized":"2024-04-23T18:32:37.340779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:37.340641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:37.340641+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.340641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:57:08.789904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.486371+0000","last_change":"2024-04-23T18:32:53.486399+0000","last_active":"2024-04-23T18:32:53.486371+0000","last_peered":"2024-04-23T18:32:53.486371+0000","last_clean":"2024-04-23T18:32:53.486371+0000","last_became_active":"2024-04-23T18:29:21.530980+0000","last_became_peered":"2024-04-23T18:29:21.530980+0000","last_unstale":"2024-04-23T18:32:53.486371+0000","last_undegraded":"2024-04-23T18:32:53.486371+0000","last_fullsized":"2024-04-23T18:32:53.486371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:53.486278+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:53.486278+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.486278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:55:15.116741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:22.456065+0000","last_change":"2024-04-23T18:33:22.456065+0000","last_active":"2024-04-23T18:33:22.456065+0000","last_peered":"2024-04-23T18:33:22.456065+0000","last_clean":"2024-04-23T18:33:22.456065+0000","last_became_active":"2024-04-23T18:29:21.534461+0000","last_became_peered":"2024-04-23T18:29:21.534461+0000","last_unstale":"2024-04-23T18:33:22.456065+0000","last_undegraded":"2024-04-23T18:33:22.456065+0000","last_fullsized":"2024-04-23T18:33:22.456065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:22.455900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:22.455900+0000","last_clean_scrub_stamp":"2024-04-23T18:33:22.455900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:57.978414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'10","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.344362+0000","last_change":"2024-04-23T18:33:09.344387+0000","last_active":"2024-04-23T18:33:09.344362+0000","last_peered":"2024-04-23T18:33:09.344362+0000","last_clean":"2024-04-23T18:33:09.344362+0000","last_became_active":"2024-04-23T18:29:13.504092+0000","last_became_peered":"2024-04-23T18:29:13.504092+0000","last_unstale":"2024-04-23T18:33:09.344362+0000","last_undegraded":"2024-04-23T18:33:09.344362+0000","last_fullsized":"2024-04-23T18:33:09.344362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:09.344276+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:09.344276+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.344276+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:41.733579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761840+0000","last_change":"2024-04-23T18:29:11.511197+0000","last_active":"2024-04-23T18:31:31.761840+0000","last_peered":"2024-04-23T18:31:31.761840+0000","last_clean":"2024-04-23T18:31:31.761840+0000","last_became_active":"2024-04-23T18:29:11.510456+0000","last_became_peered":"2024-04-23T18:29:11.510456+0000","last_unstale":"2024-04-23T18:31:31.761840+0000","last_undegraded":"2024-04-23T18:31:31.761840+0000","last_fullsized":"2024-04-23T18:31:31.761840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.935480+0000","last_change":"2024-04-23T18:32:48.935502+0000","last_active":"2024-04-23T18:32:48.935480+0000","last_peered":"2024-04-23T18:32:48.935480+0000","last_clean":"2024-04-23T18:32:48.935480+0000","last_became_active":"2024-04-23T18:29:15.506939+0000","last_became_peered":"2024-04-23T18:29:15.506939+0000","last_unstale":"2024-04-23T18:32:48.935480+0000","last_undegraded":"2024-04-23T18:32:48.935480+0000","last_fullsized":"2024-04-23T18:32:48.935480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:48.935390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:48.935390+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.935390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:50:02.096302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.400386+0000","last_change":"2024-04-23T18:32:37.400423+0000","last_active":"2024-04-23T18:32:37.400386+0000","last_peered":"2024-04-23T18:32:37.400386+0000","last_clean":"2024-04-23T18:32:37.400386+0000","last_became_active":"2024-04-23T18:29:17.511559+0000","last_became_peered":"2024-04-23T18:29:17.511559+0000","last_unstale":"2024-04-23T18:32:37.400386+0000","last_undegraded":"2024-04-23T18:32:37.400386+0000","last_fullsized":"2024-04-23T18:32:37.400386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:37.400296+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:37.400296+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.400296+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:51.584214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.480619+0000","last_change":"2024-04-23T18:33:07.480642+0000","last_active":"2024-04-23T18:33:07.480619+0000","last_peered":"2024-04-23T18:33:07.480619+0000","last_clean":"2024-04-23T18:33:07.480619+0000","last_became_active":"2024-04-23T18:29:19.525302+0000","last_became_peered":"2024-04-23T18:29:19.525302+0000","last_unstale":"2024-04-23T18:33:07.480619+0000","last_undegraded":"2024-04-23T18:33:07.480619+0000","last_fullsized":"2024-04-23T18:33:07.480619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:07.480534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:07.480534+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.480534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:35.271244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:30.784832+0000","last_change":"2024-04-23T18:29:21.530275+0000","last_active":"2024-04-23T18:32:30.784832+0000","last_peered":"2024-04-23T18:32:30.784832+0000","last_clean":"2024-04-23T18:32:30.784832+0000","last_became_active":"2024-04-23T18:29:21.530013+0000","last_became_peered":"2024-04-23T18:29:21.530013+0000","last_unstale":"2024-04-23T18:32:30.784832+0000","last_undegraded":"2024-04-23T18:32:30.784832+0000","last_fullsized":"2024-04-23T18:32:30.784832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.936742+0000","last_change":"2024-04-23T18:32:58.936777+0000","last_active":"2024-04-23T18:32:58.936742+0000","last_peered":"2024-04-23T18:32:58.936742+0000","last_clean":"2024-04-23T18:32:58.936742+0000","last_became_active":"2024-04-23T18:29:13.506770+0000","last_became_peered":"2024-04-23T18:29:13.506770+0000","last_unstale":"2024-04-23T18:32:58.936742+0000","last_undegraded":"2024-04-23T18:32:58.936742+0000","last_fullsized":"2024-04-23T18:32:58.936742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:58.936659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:58.936659+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.936659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:56.612370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:13.402922+0000","last_change":"2024-04-23T18:33:13.402990+0000","last_active":"2024-04-23T18:33:13.402922+0000","last_peered":"2024-04-23T18:33:13.402922+0000","last_clean":"2024-04-23T18:33:13.402922+0000","last_became_active":"2024-04-23T18:29:11.481884+0000","last_became_peered":"2024-04-23T18:29:11.481884+0000","last_unstale":"2024-04-23T18:33:13.402922+0000","last_undegraded":"2024-04-23T18:33:13.402922+0000","last_fullsized":"2024-04-23T18:33:13.402922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:13.402815+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:13.402815+0000","last_clean_scrub_stamp":"2024-04-23T18:33:13.402815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:11.869076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.416384+0000","last_change":"2024-04-23T18:32:38.416412+0000","last_active":"2024-04-23T18:32:38.416384+0000","last_peered":"2024-04-23T18:32:38.416384+0000","last_clean":"2024-04-23T18:32:38.416384+0000","last_became_active":"2024-04-23T18:29:15.508018+0000","last_became_peered":"2024-04-23T18:29:15.508018+0000","last_unstale":"2024-04-23T18:32:38.416384+0000","last_undegraded":"2024-04-23T18:32:38.416384+0000","last_fullsized":"2024-04-23T18:32:38.416384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:38.416298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:38.416298+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.416298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:11.511574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.373264+0000","last_change":"2024-04-23T18:32:38.373308+0000","last_active":"2024-04-23T18:32:38.373264+0000","last_peered":"2024-04-23T18:32:38.373264+0000","last_clean":"2024-04-23T18:32:38.373264+0000","last_became_active":"2024-04-23T18:29:17.514836+0000","last_became_peered":"2024-04-23T18:29:17.514836+0000","last_unstale":"2024-04-23T18:32:38.373264+0000","last_undegraded":"2024-04-23T18:32:38.373264+0000","last_fullsized":"2024-04-23T18:32:38.373264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:38.373174+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:38.373174+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.373174+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:55.790896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.401686+0000","last_change":"2024-04-23T18:32:37.401709+0000","last_active":"2024-04-23T18:32:37.401686+0000","last_peered":"2024-04-23T18:32:37.401686+0000","last_clean":"2024-04-23T18:32:37.401686+0000","last_became_active":"2024-04-23T18:29:19.527461+0000","last_became_peered":"2024-04-23T18:29:19.527461+0000","last_unstale":"2024-04-23T18:32:37.401686+0000","last_undegraded":"2024-04-23T18:32:37.401686+0000","last_fullsized":"2024-04-23T18:32:37.401686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:37.401597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:37.401597+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.401597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:07:00.685354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:28.429617+0000","last_change":"2024-04-23T18:33:28.429639+0000","last_active":"2024-04-23T18:33:28.429617+0000","last_peered":"2024-04-23T18:33:28.429617+0000","last_clean":"2024-04-23T18:33:28.429617+0000","last_became_active":"2024-04-23T18:29:21.528772+0000","last_became_peered":"2024-04-23T18:29:21.528772+0000","last_unstale":"2024-04-23T18:33:28.429617+0000","last_undegraded":"2024-04-23T18:33:28.429617+0000","last_fullsized":"2024-04-23T18:33:28.429617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:28.429508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:28.429508+0000","last_clean_scrub_stamp":"2024-04-23T18:33:28.429508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:40.019004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.191516+0000","last_change":"2024-04-23T18:32:57.191542+0000","last_active":"2024-04-23T18:32:57.191516+0000","last_peered":"2024-04-23T18:32:57.191516+0000","last_clean":"2024-04-23T18:32:57.191516+0000","last_became_active":"2024-04-23T18:29:13.502849+0000","last_became_peered":"2024-04-23T18:29:13.502849+0000","last_unstale":"2024-04-23T18:32:57.191516+0000","last_undegraded":"2024-04-23T18:32:57.191516+0000","last_fullsized":"2024-04-23T18:32:57.191516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:57.191428+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:57.191428+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.191428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:28.194216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:17.429589+0000","last_change":"2024-04-23T18:33:17.429613+0000","last_active":"2024-04-23T18:33:17.429589+0000","last_peered":"2024-04-23T18:33:17.429589+0000","last_clean":"2024-04-23T18:33:17.429589+0000","last_became_active":"2024-04-23T18:29:11.483628+0000","last_became_peered":"2024-04-23T18:29:11.483628+0000","last_unstale":"2024-04-23T18:33:17.429589+0000","last_undegraded":"2024-04-23T18:33:17.429589+0000","last_fullsized":"2024-04-23T18:33:17.429589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:17.429501+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:17.429501+0000","last_clean_scrub_stamp":"2024-04-23T18:33:17.429501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:11.858318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.524247+0000","last_change":"2024-04-23T18:32:47.524270+0000","last_active":"2024-04-23T18:32:47.524247+0000","last_peered":"2024-04-23T18:32:47.524247+0000","last_clean":"2024-04-23T18:32:47.524247+0000","last_became_active":"2024-04-23T18:29:15.510130+0000","last_became_peered":"2024-04-23T18:29:15.510130+0000","last_unstale":"2024-04-23T18:32:47.524247+0000","last_undegraded":"2024-04-23T18:32:47.524247+0000","last_fullsized":"2024-04-23T18:32:47.524247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:47.524159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:47.524159+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.524159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:43.989607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.296594+0000","last_change":"2024-04-23T18:32:43.296633+0000","last_active":"2024-04-23T18:32:43.296594+0000","last_peered":"2024-04-23T18:32:43.296594+0000","last_clean":"2024-04-23T18:32:43.296594+0000","last_became_active":"2024-04-23T18:29:17.510429+0000","last_became_peered":"2024-04-23T18:29:17.510429+0000","last_unstale":"2024-04-23T18:32:43.296594+0000","last_undegraded":"2024-04-23T18:32:43.296594+0000","last_fullsized":"2024-04-23T18:32:43.296594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:43.296501+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:43.296501+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.296501+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:18.685380+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.936215+0000","last_change":"2024-04-23T18:32:32.936254+0000","last_active":"2024-04-23T18:32:32.936215+0000","last_peered":"2024-04-23T18:32:32.936215+0000","last_clean":"2024-04-23T18:32:32.936215+0000","last_became_active":"2024-04-23T18:29:19.518543+0000","last_became_peered":"2024-04-23T18:29:19.518543+0000","last_unstale":"2024-04-23T18:32:32.936215+0000","last_undegraded":"2024-04-23T18:32:32.936215+0000","last_fullsized":"2024-04-23T18:32:32.936215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.936101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.936101+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.936101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:36.879163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:51.764880+0000","last_change":"2024-04-23T18:29:21.534350+0000","last_active":"2024-04-23T18:31:51.764880+0000","last_peered":"2024-04-23T18:31:51.764880+0000","last_clean":"2024-04-23T18:31:51.764880+0000","last_became_active":"2024-04-23T18:29:21.534023+0000","last_became_peered":"2024-04-23T18:29:21.534023+0000","last_unstale":"2024-04-23T18:31:51.764880+0000","last_undegraded":"2024-04-23T18:31:51.764880+0000","last_fullsized":"2024-04-23T18:31:51.764880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'20","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.520369+0000","last_change":"2024-04-23T18:33:06.520421+0000","last_active":"2024-04-23T18:33:06.520369+0000","last_peered":"2024-04-23T18:33:06.520369+0000","last_clean":"2024-04-23T18:33:06.520369+0000","last_became_active":"2024-04-23T18:29:13.500877+0000","last_became_peered":"2024-04-23T18:29:13.500877+0000","last_unstale":"2024-04-23T18:33:06.520369+0000","last_undegraded":"2024-04-23T18:33:06.520369+0000","last_fullsized":"2024-04-23T18:33:06.520369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-04-23T18:33:06.520272+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-04-23T18:33:06.520272+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.520272+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:51.378293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":53,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:23.728121+0000","last_change":"2024-04-23T18:33:23.728149+0000","last_active":"2024-04-23T18:33:23.728121+0000","last_peered":"2024-04-23T18:33:23.728121+0000","last_clean":"2024-04-23T18:33:23.728121+0000","last_became_active":"2024-04-23T18:29:11.497953+0000","last_became_peered":"2024-04-23T18:29:11.497953+0000","last_unstale":"2024-04-23T18:33:23.728121+0000","last_undegraded":"2024-04-23T18:33:23.728121+0000","last_fullsized":"2024-04-23T18:33:23.728121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:23.728030+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:23.728030+0000","last_clean_scrub_stamp":"2024-04-23T18:33:23.728030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:58.233173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.458609+0000","last_change":"2024-04-23T18:32:41.458630+0000","last_active":"2024-04-23T18:32:41.458609+0000","last_peered":"2024-04-23T18:32:41.458609+0000","last_clean":"2024-04-23T18:32:41.458609+0000","last_became_active":"2024-04-23T18:29:15.507253+0000","last_became_peered":"2024-04-23T18:29:15.507253+0000","last_unstale":"2024-04-23T18:32:41.458609+0000","last_undegraded":"2024-04-23T18:32:41.458609+0000","last_fullsized":"2024-04-23T18:32:41.458609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:41.458516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:41.458516+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.458516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:55:39.924778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.406718+0000","last_change":"2024-04-23T18:32:43.406751+0000","last_active":"2024-04-23T18:32:43.406718+0000","last_peered":"2024-04-23T18:32:43.406718+0000","last_clean":"2024-04-23T18:32:43.406718+0000","last_became_active":"2024-04-23T18:29:17.512820+0000","last_became_peered":"2024-04-23T18:29:17.512820+0000","last_unstale":"2024-04-23T18:32:43.406718+0000","last_undegraded":"2024-04-23T18:32:43.406718+0000","last_fullsized":"2024-04-23T18:32:43.406718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:43.406635+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:43.406635+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.406635+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:40.517887+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.355989+0000","last_change":"2024-04-23T18:32:35.356012+0000","last_active":"2024-04-23T18:32:35.355989+0000","last_peered":"2024-04-23T18:32:35.355989+0000","last_clean":"2024-04-23T18:32:35.355989+0000","last_became_active":"2024-04-23T18:29:19.525424+0000","last_became_peered":"2024-04-23T18:29:19.525424+0000","last_unstale":"2024-04-23T18:32:35.355989+0000","last_undegraded":"2024-04-23T18:32:35.355989+0000","last_fullsized":"2024-04-23T18:32:35.355989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.355896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.355896+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.355896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:58:38.926439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:12.456113+0000","last_change":"2024-04-23T18:33:12.456113+0000","last_active":"2024-04-23T18:33:12.456113+0000","last_peered":"2024-04-23T18:33:12.456113+0000","last_clean":"2024-04-23T18:33:12.456113+0000","last_became_active":"2024-04-23T18:29:13.496179+0000","last_became_peered":"2024-04-23T18:29:13.496179+0000","last_unstale":"2024-04-23T18:33:12.456113+0000","last_undegraded":"2024-04-23T18:33:12.456113+0000","last_fullsized":"2024-04-23T18:33:12.456113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:12.455993+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:12.455993+0000","last_clean_scrub_stamp":"2024-04-23T18:33:12.455993+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:55:29.273245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:36.762448+0000","last_change":"2024-04-23T18:29:11.500546+0000","last_active":"2024-04-23T18:31:36.762448+0000","last_peered":"2024-04-23T18:31:36.762448+0000","last_clean":"2024-04-23T18:31:36.762448+0000","last_became_active":"2024-04-23T18:29:11.500118+0000","last_became_peered":"2024-04-23T18:29:11.500118+0000","last_unstale":"2024-04-23T18:31:36.762448+0000","last_undegraded":"2024-04-23T18:31:36.762448+0000","last_fullsized":"2024-04-23T18:31:36.762448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.230060+0000","last_change":"2024-04-23T18:32:54.230060+0000","last_active":"2024-04-23T18:32:54.230060+0000","last_peered":"2024-04-23T18:32:54.230060+0000","last_clean":"2024-04-23T18:32:54.230060+0000","last_became_active":"2024-04-23T18:29:15.506197+0000","last_became_peered":"2024-04-23T18:29:15.506197+0000","last_unstale":"2024-04-23T18:32:54.230060+0000","last_undegraded":"2024-04-23T18:32:54.230060+0000","last_fullsized":"2024-04-23T18:32:54.230060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:54.229932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:54.229932+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.229932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:45:57.110850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'66","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.328809+0000","last_change":"2024-04-23T18:32:39.328853+0000","last_active":"2024-04-23T18:32:39.328809+0000","last_peered":"2024-04-23T18:32:39.328809+0000","last_clean":"2024-04-23T18:32:39.328809+0000","last_became_active":"2024-04-23T18:29:17.514800+0000","last_became_peered":"2024-04-23T18:29:17.514800+0000","last_unstale":"2024-04-23T18:32:39.328809+0000","last_undegraded":"2024-04-23T18:32:39.328809+0000","last_fullsized":"2024-04-23T18:32:39.328809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-04-23T18:32:39.328706+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-04-23T18:32:39.328706+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.328706+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:44:56.598841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.370215+0000","last_change":"2024-04-23T18:32:36.370241+0000","last_active":"2024-04-23T18:32:36.370215+0000","last_peered":"2024-04-23T18:32:36.370215+0000","last_clean":"2024-04-23T18:32:36.370215+0000","last_became_active":"2024-04-23T18:29:19.524351+0000","last_became_peered":"2024-04-23T18:29:19.524351+0000","last_unstale":"2024-04-23T18:32:36.370215+0000","last_undegraded":"2024-04-23T18:32:36.370215+0000","last_fullsized":"2024-04-23T18:32:36.370215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.370129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.370129+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.370129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:58.907049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:29.460212+0000","last_change":"2024-04-23T18:33:29.460238+0000","last_active":"2024-04-23T18:33:29.460212+0000","last_peered":"2024-04-23T18:33:29.460212+0000","last_clean":"2024-04-23T18:33:29.460212+0000","last_became_active":"2024-04-23T18:29:21.528819+0000","last_became_peered":"2024-04-23T18:29:21.528819+0000","last_unstale":"2024-04-23T18:33:29.460212+0000","last_undegraded":"2024-04-23T18:33:29.460212+0000","last_fullsized":"2024-04-23T18:33:29.460212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-23T18:33:29.460103+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-23T18:33:29.460103+0000","last_clean_scrub_stamp":"2024-04-23T18:33:29.460103+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:13:37.061397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:12.313127+0000","last_change":"2024-04-23T18:33:12.313127+0000","last_active":"2024-04-23T18:33:12.313127+0000","last_peered":"2024-04-23T18:33:12.313127+0000","last_clean":"2024-04-23T18:33:12.313127+0000","last_became_active":"2024-04-23T18:29:13.499137+0000","last_became_peered":"2024-04-23T18:29:13.499137+0000","last_unstale":"2024-04-23T18:33:12.313127+0000","last_undegraded":"2024-04-23T18:33:12.313127+0000","last_fullsized":"2024-04-23T18:33:12.313127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:12.313012+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:12.313012+0000","last_clean_scrub_stamp":"2024-04-23T18:33:12.313012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:20:11.318686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:14.855537+0000","last_change":"2024-04-23T18:33:14.855562+0000","last_active":"2024-04-23T18:33:14.855537+0000","last_peered":"2024-04-23T18:33:14.855537+0000","last_clean":"2024-04-23T18:33:14.855537+0000","last_became_active":"2024-04-23T18:29:11.500584+0000","last_became_peered":"2024-04-23T18:29:11.500584+0000","last_unstale":"2024-04-23T18:33:14.855537+0000","last_undegraded":"2024-04-23T18:33:14.855537+0000","last_fullsized":"2024-04-23T18:33:14.855537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:14.855437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:14.855437+0000","last_clean_scrub_stamp":"2024-04-23T18:33:14.855437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:50.377951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.494521+0000","last_change":"2024-04-23T18:32:51.494521+0000","last_active":"2024-04-23T18:32:51.494521+0000","last_peered":"2024-04-23T18:32:51.494521+0000","last_clean":"2024-04-23T18:32:51.494521+0000","last_became_active":"2024-04-23T18:29:15.503315+0000","last_became_peered":"2024-04-23T18:29:15.503315+0000","last_unstale":"2024-04-23T18:32:51.494521+0000","last_undegraded":"2024-04-23T18:32:51.494521+0000","last_fullsized":"2024-04-23T18:32:51.494521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:51.494354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:51.494354+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.494354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:13.705269+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.449417+0000","last_change":"2024-04-23T18:33:00.449461+0000","last_active":"2024-04-23T18:33:00.449417+0000","last_peered":"2024-04-23T18:33:00.449417+0000","last_clean":"2024-04-23T18:33:00.449417+0000","last_became_active":"2024-04-23T18:29:17.516934+0000","last_became_peered":"2024-04-23T18:29:17.516934+0000","last_unstale":"2024-04-23T18:33:00.449417+0000","last_undegraded":"2024-04-23T18:33:00.449417+0000","last_fullsized":"2024-04-23T18:33:00.449417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-23T18:33:00.449324+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-23T18:33:00.449324+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.449324+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:16.722855+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:31.933324+0000","last_change":"2024-04-23T18:32:31.933350+0000","last_active":"2024-04-23T18:32:31.933324+0000","last_peered":"2024-04-23T18:32:31.933324+0000","last_clean":"2024-04-23T18:32:31.933324+0000","last_became_active":"2024-04-23T18:29:19.519854+0000","last_became_peered":"2024-04-23T18:29:19.519854+0000","last_unstale":"2024-04-23T18:32:31.933324+0000","last_undegraded":"2024-04-23T18:32:31.933324+0000","last_fullsized":"2024-04-23T18:32:31.933324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:31.933225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:31.933225+0000","last_clean_scrub_stamp":"2024-04-23T18:32:31.933225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:09.747281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763296+0000","last_change":"2024-04-23T18:29:21.534768+0000","last_active":"2024-04-23T18:31:41.763296+0000","last_peered":"2024-04-23T18:31:41.763296+0000","last_clean":"2024-04-23T18:31:41.763296+0000","last_became_active":"2024-04-23T18:29:21.534487+0000","last_became_peered":"2024-04-23T18:29:21.534487+0000","last_unstale":"2024-04-23T18:31:41.763296+0000","last_undegraded":"2024-04-23T18:31:41.763296+0000","last_fullsized":"2024-04-23T18:31:41.763296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.425530+0000","last_change":"2024-04-23T18:32:48.425557+0000","last_active":"2024-04-23T18:32:48.425530+0000","last_peered":"2024-04-23T18:32:48.425530+0000","last_clean":"2024-04-23T18:32:48.425530+0000","last_became_active":"2024-04-23T18:29:13.502710+0000","last_became_peered":"2024-04-23T18:29:13.502710+0000","last_unstale":"2024-04-23T18:32:48.425530+0000","last_undegraded":"2024-04-23T18:32:48.425530+0000","last_fullsized":"2024-04-23T18:32:48.425530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:48.425438+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:48.425438+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.425438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:21.214995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:24.712813+0000","last_change":"2024-04-23T18:33:24.712858+0000","last_active":"2024-04-23T18:33:24.712813+0000","last_peered":"2024-04-23T18:33:24.712813+0000","last_clean":"2024-04-23T18:33:24.712813+0000","last_became_active":"2024-04-23T18:29:11.497191+0000","last_became_peered":"2024-04-23T18:29:11.497191+0000","last_unstale":"2024-04-23T18:33:24.712813+0000","last_undegraded":"2024-04-23T18:33:24.712813+0000","last_fullsized":"2024-04-23T18:33:24.712813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:24.712698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:24.712698+0000","last_clean_scrub_stamp":"2024-04-23T18:33:24.712698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:40.986230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.464891+0000","last_change":"2024-04-23T18:32:52.464923+0000","last_active":"2024-04-23T18:32:52.464891+0000","last_peered":"2024-04-23T18:32:52.464891+0000","last_clean":"2024-04-23T18:32:52.464891+0000","last_became_active":"2024-04-23T18:29:15.501957+0000","last_became_peered":"2024-04-23T18:29:15.501957+0000","last_unstale":"2024-04-23T18:32:52.464891+0000","last_undegraded":"2024-04-23T18:32:52.464891+0000","last_fullsized":"2024-04-23T18:32:52.464891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:52.464769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:52.464769+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.464769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:12.012567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.245695+0000","last_change":"2024-04-23T18:32:45.245695+0000","last_active":"2024-04-23T18:32:45.245695+0000","last_peered":"2024-04-23T18:32:45.245695+0000","last_clean":"2024-04-23T18:32:45.245695+0000","last_became_active":"2024-04-23T18:29:17.503196+0000","last_became_peered":"2024-04-23T18:29:17.503196+0000","last_unstale":"2024-04-23T18:32:45.245695+0000","last_undegraded":"2024-04-23T18:32:45.245695+0000","last_fullsized":"2024-04-23T18:32:45.245695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:45.245551+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:45.245551+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.245551+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:00.152459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.211198+0000","last_change":"2024-04-23T18:32:56.211198+0000","last_active":"2024-04-23T18:32:56.211198+0000","last_peered":"2024-04-23T18:32:56.211198+0000","last_clean":"2024-04-23T18:32:56.211198+0000","last_became_active":"2024-04-23T18:29:19.527687+0000","last_became_peered":"2024-04-23T18:29:19.527687+0000","last_unstale":"2024-04-23T18:32:56.211198+0000","last_undegraded":"2024-04-23T18:32:56.211198+0000","last_fullsized":"2024-04-23T18:32:56.211198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:56.211082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:56.211082+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.211082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:29.050437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763279+0000","last_change":"2024-04-23T18:29:21.534054+0000","last_active":"2024-04-23T18:31:41.763279+0000","last_peered":"2024-04-23T18:31:41.763279+0000","last_clean":"2024-04-23T18:31:41.763279+0000","last_became_active":"2024-04-23T18:29:21.533754+0000","last_became_peered":"2024-04-23T18:29:21.533754+0000","last_unstale":"2024-04-23T18:31:41.763279+0000","last_undegraded":"2024-04-23T18:31:41.763279+0000","last_fullsized":"2024-04-23T18:31:41.763279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.271342+0000","last_change":"2024-04-23T18:33:10.271368+0000","last_active":"2024-04-23T18:33:10.271342+0000","last_peered":"2024-04-23T18:33:10.271342+0000","last_clean":"2024-04-23T18:33:10.271342+0000","last_became_active":"2024-04-23T18:29:13.497121+0000","last_became_peered":"2024-04-23T18:29:13.497121+0000","last_unstale":"2024-04-23T18:33:10.271342+0000","last_undegraded":"2024-04-23T18:33:10.271342+0000","last_fullsized":"2024-04-23T18:33:10.271342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-23T18:33:10.271244+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-23T18:33:10.271244+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.271244+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:45.140086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:30.472246+0000","last_change":"2024-04-23T18:33:30.472292+0000","last_active":"2024-04-23T18:33:30.472246+0000","last_peered":"2024-04-23T18:33:30.472246+0000","last_clean":"2024-04-23T18:33:30.472246+0000","last_became_active":"2024-04-23T18:29:11.504564+0000","last_became_peered":"2024-04-23T18:29:11.504564+0000","last_unstale":"2024-04-23T18:33:30.472246+0000","last_undegraded":"2024-04-23T18:33:30.472246+0000","last_fullsized":"2024-04-23T18:33:30.472246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:30.472113+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:30.472113+0000","last_clean_scrub_stamp":"2024-04-23T18:33:30.472113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:08:02.467495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.918227+0000","last_change":"2024-04-23T18:32:50.918254+0000","last_active":"2024-04-23T18:32:50.918227+0000","last_peered":"2024-04-23T18:32:50.918227+0000","last_clean":"2024-04-23T18:32:50.918227+0000","last_became_active":"2024-04-23T18:29:15.506171+0000","last_became_peered":"2024-04-23T18:29:15.506171+0000","last_unstale":"2024-04-23T18:32:50.918227+0000","last_undegraded":"2024-04-23T18:32:50.918227+0000","last_fullsized":"2024-04-23T18:32:50.918227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.918119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.918119+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.918119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:12.800419+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.419573+0000","last_change":"2024-04-23T18:32:57.419573+0000","last_active":"2024-04-23T18:32:57.419573+0000","last_peered":"2024-04-23T18:32:57.419573+0000","last_clean":"2024-04-23T18:32:57.419573+0000","last_became_active":"2024-04-23T18:29:17.517051+0000","last_became_peered":"2024-04-23T18:29:17.517051+0000","last_unstale":"2024-04-23T18:32:57.419573+0000","last_undegraded":"2024-04-23T18:32:57.419573+0000","last_fullsized":"2024-04-23T18:32:57.419573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-23T18:32:57.419450+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-23T18:32:57.419450+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.419450+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:03.100050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":379,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.362652+0000","last_change":"2024-04-23T18:32:41.362652+0000","last_active":"2024-04-23T18:32:41.362652+0000","last_peered":"2024-04-23T18:32:41.362652+0000","last_clean":"2024-04-23T18:32:41.362652+0000","last_became_active":"2024-04-23T18:29:19.527614+0000","last_became_peered":"2024-04-23T18:29:19.527614+0000","last_unstale":"2024-04-23T18:32:41.362652+0000","last_undegraded":"2024-04-23T18:32:41.362652+0000","last_fullsized":"2024-04-23T18:32:41.362652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:41.362491+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:41.362491+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.362491+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:25:00.632414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763197+0000","last_change":"2024-04-23T18:29:21.531583+0000","last_active":"2024-04-23T18:31:41.763197+0000","last_peered":"2024-04-23T18:31:41.763197+0000","last_clean":"2024-04-23T18:31:41.763197+0000","last_became_active":"2024-04-23T18:29:21.530619+0000","last_became_peered":"2024-04-23T18:29:21.530619+0000","last_unstale":"2024-04-23T18:31:41.763197+0000","last_undegraded":"2024-04-23T18:31:41.763197+0000","last_fullsized":"2024-04-23T18:31:41.763197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.394288+0000","last_change":"2024-04-23T18:33:03.394334+0000","last_active":"2024-04-23T18:33:03.394288+0000","last_peered":"2024-04-23T18:33:03.394288+0000","last_clean":"2024-04-23T18:33:03.394288+0000","last_became_active":"2024-04-23T18:29:13.501741+0000","last_became_peered":"2024-04-23T18:29:13.501741+0000","last_unstale":"2024-04-23T18:33:03.394288+0000","last_undegraded":"2024-04-23T18:33:03.394288+0000","last_fullsized":"2024-04-23T18:33:03.394288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:03.394147+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:03.394147+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.394147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:25.573714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:12.923491+0000","last_change":"2024-04-23T18:33:12.923516+0000","last_active":"2024-04-23T18:33:12.923491+0000","last_peered":"2024-04-23T18:33:12.923491+0000","last_clean":"2024-04-23T18:33:12.923491+0000","last_became_active":"2024-04-23T18:29:11.500781+0000","last_became_peered":"2024-04-23T18:29:11.500781+0000","last_unstale":"2024-04-23T18:33:12.923491+0000","last_undegraded":"2024-04-23T18:33:12.923491+0000","last_fullsized":"2024-04-23T18:33:12.923491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:12.923402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:12.923402+0000","last_clean_scrub_stamp":"2024-04-23T18:33:12.923402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:45.712959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:30.729921+0000","last_change":"2024-04-23T18:33:30.729968+0000","last_active":"2024-04-23T18:33:30.729921+0000","last_peered":"2024-04-23T18:33:30.729921+0000","last_clean":"2024-04-23T18:33:30.729921+0000","last_became_active":"2024-04-23T18:29:52.549944+0000","last_became_peered":"2024-04-23T18:29:52.549944+0000","last_unstale":"2024-04-23T18:33:30.729921+0000","last_undegraded":"2024-04-23T18:33:30.729921+0000","last_fullsized":"2024-04-23T18:33:30.729921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:30.729833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:30.729833+0000","last_clean_scrub_stamp":"2024-04-23T18:33:30.729833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:52.671500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.837445+0000","last_change":"2024-04-23T18:32:41.837483+0000","last_active":"2024-04-23T18:32:41.837445+0000","last_peered":"2024-04-23T18:32:41.837445+0000","last_clean":"2024-04-23T18:32:41.837445+0000","last_became_active":"2024-04-23T18:29:17.509076+0000","last_became_peered":"2024-04-23T18:29:17.509076+0000","last_unstale":"2024-04-23T18:32:41.837445+0000","last_undegraded":"2024-04-23T18:32:41.837445+0000","last_fullsized":"2024-04-23T18:32:41.837445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-23T18:32:41.837343+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-23T18:32:41.837343+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.837343+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:11.245831+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.466736+0000","last_change":"2024-04-23T18:32:32.466759+0000","last_active":"2024-04-23T18:32:32.466736+0000","last_peered":"2024-04-23T18:32:32.466736+0000","last_clean":"2024-04-23T18:32:32.466736+0000","last_became_active":"2024-04-23T18:29:19.518673+0000","last_became_peered":"2024-04-23T18:29:19.518673+0000","last_unstale":"2024-04-23T18:32:32.466736+0000","last_undegraded":"2024-04-23T18:32:32.466736+0000","last_fullsized":"2024-04-23T18:32:32.466736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.466649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.466649+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.466649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:22:40.471567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:29.749979+0000","last_change":"2024-04-23T18:33:29.750004+0000","last_active":"2024-04-23T18:33:29.749979+0000","last_peered":"2024-04-23T18:33:29.749979+0000","last_clean":"2024-04-23T18:33:29.749979+0000","last_became_active":"2024-04-23T18:29:21.533187+0000","last_became_peered":"2024-04-23T18:29:21.533187+0000","last_unstale":"2024-04-23T18:33:29.749979+0000","last_undegraded":"2024-04-23T18:33:29.749979+0000","last_fullsized":"2024-04-23T18:33:29.749979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:29.749876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:29.749876+0000","last_clean_scrub_stamp":"2024-04-23T18:33:29.749876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:01:05.290487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.441100+0000","last_change":"2024-04-23T18:33:05.441126+0000","last_active":"2024-04-23T18:33:05.441100+0000","last_peered":"2024-04-23T18:33:05.441100+0000","last_clean":"2024-04-23T18:33:05.441100+0000","last_became_active":"2024-04-23T18:29:13.501974+0000","last_became_peered":"2024-04-23T18:29:13.501974+0000","last_unstale":"2024-04-23T18:33:05.441100+0000","last_undegraded":"2024-04-23T18:33:05.441100+0000","last_fullsized":"2024-04-23T18:33:05.441100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:05.441015+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:05.441015+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.441015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:46.321194+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:24.451832+0000","last_change":"2024-04-23T18:33:24.451860+0000","last_active":"2024-04-23T18:33:24.451832+0000","last_peered":"2024-04-23T18:33:24.451832+0000","last_clean":"2024-04-23T18:33:24.451832+0000","last_became_active":"2024-04-23T18:29:11.511297+0000","last_became_peered":"2024-04-23T18:29:11.511297+0000","last_unstale":"2024-04-23T18:33:24.451832+0000","last_undegraded":"2024-04-23T18:33:24.451832+0000","last_fullsized":"2024-04-23T18:33:24.451832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:24.451739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:24.451739+0000","last_clean_scrub_stamp":"2024-04-23T18:33:24.451739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:02.322238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.503698+0000","last_change":"2024-04-23T18:32:50.503761+0000","last_active":"2024-04-23T18:32:50.503698+0000","last_peered":"2024-04-23T18:32:50.503698+0000","last_clean":"2024-04-23T18:32:50.503698+0000","last_became_active":"2024-04-23T18:29:15.504528+0000","last_became_peered":"2024-04-23T18:29:15.504528+0000","last_unstale":"2024-04-23T18:32:50.503698+0000","last_undegraded":"2024-04-23T18:32:50.503698+0000","last_fullsized":"2024-04-23T18:32:50.503698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.503597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.503597+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.503597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:20:31.588182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.345447+0000","last_change":"2024-04-23T18:32:42.345524+0000","last_active":"2024-04-23T18:32:42.345447+0000","last_peered":"2024-04-23T18:32:42.345447+0000","last_clean":"2024-04-23T18:32:42.345447+0000","last_became_active":"2024-04-23T18:29:17.513482+0000","last_became_peered":"2024-04-23T18:29:17.513482+0000","last_unstale":"2024-04-23T18:32:42.345447+0000","last_undegraded":"2024-04-23T18:32:42.345447+0000","last_fullsized":"2024-04-23T18:32:42.345447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:42.345340+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:42.345340+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.345340+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:11.159885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.418774+0000","last_change":"2024-04-23T18:33:11.418829+0000","last_active":"2024-04-23T18:33:11.418774+0000","last_peered":"2024-04-23T18:33:11.418774+0000","last_clean":"2024-04-23T18:33:11.418774+0000","last_became_active":"2024-04-23T18:29:19.525985+0000","last_became_peered":"2024-04-23T18:29:19.525985+0000","last_unstale":"2024-04-23T18:33:11.418774+0000","last_undegraded":"2024-04-23T18:33:11.418774+0000","last_fullsized":"2024-04-23T18:33:11.418774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:11.418670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:11.418670+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.418670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:53.730800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:15.396979+0000","last_change":"2024-04-23T18:33:15.397003+0000","last_active":"2024-04-23T18:33:15.396979+0000","last_peered":"2024-04-23T18:33:15.396979+0000","last_clean":"2024-04-23T18:33:15.396979+0000","last_became_active":"2024-04-23T18:29:21.528665+0000","last_became_peered":"2024-04-23T18:29:21.528665+0000","last_unstale":"2024-04-23T18:33:15.396979+0000","last_undegraded":"2024-04-23T18:33:15.396979+0000","last_fullsized":"2024-04-23T18:33:15.396979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:15.396887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:15.396887+0000","last_clean_scrub_stamp":"2024-04-23T18:33:15.396887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:59.736058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:18.427284+0000","last_change":"2024-04-23T18:33:18.427331+0000","last_active":"2024-04-23T18:33:18.427284+0000","last_peered":"2024-04-23T18:33:18.427284+0000","last_clean":"2024-04-23T18:33:18.427284+0000","last_became_active":"2024-04-23T18:29:13.494647+0000","last_became_peered":"2024-04-23T18:29:13.494647+0000","last_unstale":"2024-04-23T18:33:18.427284+0000","last_undegraded":"2024-04-23T18:33:18.427284+0000","last_fullsized":"2024-04-23T18:33:18.427284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:18.427151+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:18.427151+0000","last_clean_scrub_stamp":"2024-04-23T18:33:18.427151+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:31:27.364438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.286325+0000","last_change":"2024-04-23T18:33:03.286325+0000","last_active":"2024-04-23T18:33:03.286325+0000","last_peered":"2024-04-23T18:33:03.286325+0000","last_clean":"2024-04-23T18:33:03.286325+0000","last_became_active":"2024-04-23T18:29:11.495723+0000","last_became_peered":"2024-04-23T18:29:11.495723+0000","last_unstale":"2024-04-23T18:33:03.286325+0000","last_undegraded":"2024-04-23T18:33:03.286325+0000","last_fullsized":"2024-04-23T18:33:03.286325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:03.286196+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:03.286196+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.286196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:59:50.509925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.847864+0000","last_change":"2024-04-23T18:32:42.847886+0000","last_active":"2024-04-23T18:32:42.847864+0000","last_peered":"2024-04-23T18:32:42.847864+0000","last_clean":"2024-04-23T18:32:42.847864+0000","last_became_active":"2024-04-23T18:29:15.510185+0000","last_became_peered":"2024-04-23T18:29:15.510185+0000","last_unstale":"2024-04-23T18:32:42.847864+0000","last_undegraded":"2024-04-23T18:32:42.847864+0000","last_fullsized":"2024-04-23T18:32:42.847864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:42.847777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:42.847777+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.847777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:20:23.932361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'34","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.386198+0000","last_change":"2024-04-23T18:32:58.386231+0000","last_active":"2024-04-23T18:32:58.386198+0000","last_peered":"2024-04-23T18:32:58.386198+0000","last_clean":"2024-04-23T18:32:58.386198+0000","last_became_active":"2024-04-23T18:29:17.516989+0000","last_became_peered":"2024-04-23T18:29:17.516989+0000","last_unstale":"2024-04-23T18:32:58.386198+0000","last_undegraded":"2024-04-23T18:32:58.386198+0000","last_fullsized":"2024-04-23T18:32:58.386198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-04-23T18:32:58.386098+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-04-23T18:32:58.386098+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.386098+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:39.139901+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":38,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.462758+0000","last_change":"2024-04-23T18:32:54.462797+0000","last_active":"2024-04-23T18:32:54.462758+0000","last_peered":"2024-04-23T18:32:54.462758+0000","last_clean":"2024-04-23T18:32:54.462758+0000","last_became_active":"2024-04-23T18:29:19.522217+0000","last_became_peered":"2024-04-23T18:29:19.522217+0000","last_unstale":"2024-04-23T18:32:54.462758+0000","last_undegraded":"2024-04-23T18:32:54.462758+0000","last_fullsized":"2024-04-23T18:32:54.462758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:54.462671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:54.462671+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.462671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:02:37.395360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.764140+0000","last_change":"2024-04-23T18:29:21.533465+0000","last_active":"2024-04-23T18:31:46.764140+0000","last_peered":"2024-04-23T18:31:46.764140+0000","last_clean":"2024-04-23T18:31:46.764140+0000","last_became_active":"2024-04-23T18:29:21.533152+0000","last_became_peered":"2024-04-23T18:29:21.533152+0000","last_unstale":"2024-04-23T18:31:46.764140+0000","last_undegraded":"2024-04-23T18:31:46.764140+0000","last_fullsized":"2024-04-23T18:31:46.764140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.413635+0000","last_change":"2024-04-23T18:33:07.413678+0000","last_active":"2024-04-23T18:33:07.413635+0000","last_peered":"2024-04-23T18:33:07.413635+0000","last_clean":"2024-04-23T18:33:07.413635+0000","last_became_active":"2024-04-23T18:29:13.501782+0000","last_became_peered":"2024-04-23T18:29:13.501782+0000","last_unstale":"2024-04-23T18:33:07.413635+0000","last_undegraded":"2024-04-23T18:33:07.413635+0000","last_fullsized":"2024-04-23T18:33:07.413635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:07.413496+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:07.413496+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.413496+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:45.543382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.946596+0000","last_change":"2024-04-23T18:33:10.946596+0000","last_active":"2024-04-23T18:33:10.946596+0000","last_peered":"2024-04-23T18:33:10.946596+0000","last_clean":"2024-04-23T18:33:10.946596+0000","last_became_active":"2024-04-23T18:29:11.501648+0000","last_became_peered":"2024-04-23T18:29:11.501648+0000","last_unstale":"2024-04-23T18:33:10.946596+0000","last_undegraded":"2024-04-23T18:33:10.946596+0000","last_fullsized":"2024-04-23T18:33:10.946596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:10.946483+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:10.946483+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.946483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:32.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.904576+0000","last_change":"2024-04-23T18:32:44.904604+0000","last_active":"2024-04-23T18:32:44.904576+0000","last_peered":"2024-04-23T18:32:44.904576+0000","last_clean":"2024-04-23T18:32:44.904576+0000","last_became_active":"2024-04-23T18:29:15.509725+0000","last_became_peered":"2024-04-23T18:29:15.509725+0000","last_unstale":"2024-04-23T18:32:44.904576+0000","last_undegraded":"2024-04-23T18:32:44.904576+0000","last_fullsized":"2024-04-23T18:32:44.904576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-23T18:32:44.904494+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-23T18:32:44.904494+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.904494+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:04.452291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.413489+0000","last_change":"2024-04-23T18:33:02.413529+0000","last_active":"2024-04-23T18:33:02.413489+0000","last_peered":"2024-04-23T18:33:02.413489+0000","last_clean":"2024-04-23T18:33:02.413489+0000","last_became_active":"2024-04-23T18:29:17.514823+0000","last_became_peered":"2024-04-23T18:29:17.514823+0000","last_unstale":"2024-04-23T18:33:02.413489+0000","last_undegraded":"2024-04-23T18:33:02.413489+0000","last_fullsized":"2024-04-23T18:33:02.413489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-04-23T18:33:02.413401+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-04-23T18:33:02.413401+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.413401+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:18.372633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.280462+0000","last_change":"2024-04-23T18:32:40.280484+0000","last_active":"2024-04-23T18:32:40.280462+0000","last_peered":"2024-04-23T18:32:40.280462+0000","last_clean":"2024-04-23T18:32:40.280462+0000","last_became_active":"2024-04-23T18:29:19.519153+0000","last_became_peered":"2024-04-23T18:29:19.519153+0000","last_unstale":"2024-04-23T18:32:40.280462+0000","last_undegraded":"2024-04-23T18:32:40.280462+0000","last_fullsized":"2024-04-23T18:32:40.280462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:40.280370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:40.280370+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.280370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:40.211480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:19.447621+0000","last_change":"2024-04-23T18:33:19.447649+0000","last_active":"2024-04-23T18:33:19.447621+0000","last_peered":"2024-04-23T18:33:19.447621+0000","last_clean":"2024-04-23T18:33:19.447621+0000","last_became_active":"2024-04-23T18:29:21.529331+0000","last_became_peered":"2024-04-23T18:29:21.529331+0000","last_unstale":"2024-04-23T18:33:19.447621+0000","last_undegraded":"2024-04-23T18:33:19.447621+0000","last_fullsized":"2024-04-23T18:33:19.447621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:19.447542+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:19.447542+0000","last_clean_scrub_stamp":"2024-04-23T18:33:19.447542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:10.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:21.223218+0000","last_change":"2024-04-23T18:29:52.563032+0000","last_active":"2024-04-23T18:32:21.223218+0000","last_peered":"2024-04-23T18:32:21.223218+0000","last_clean":"2024-04-23T18:32:21.223218+0000","last_became_active":"2024-04-23T18:29:52.551523+0000","last_became_peered":"2024-04-23T18:29:52.551523+0000","last_unstale":"2024-04-23T18:32:21.223218+0000","last_undegraded":"2024-04-23T18:32:21.223218+0000","last_fullsized":"2024-04-23T18:32:21.223218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:12.467435+0000","last_clean_scrub_stamp":"2024-04-23T18:29:12.467435+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.409650+0000","last_change":"2024-04-23T18:33:06.409650+0000","last_active":"2024-04-23T18:33:06.409650+0000","last_peered":"2024-04-23T18:33:06.409650+0000","last_clean":"2024-04-23T18:33:06.409650+0000","last_became_active":"2024-04-23T18:29:11.489284+0000","last_became_peered":"2024-04-23T18:29:11.489284+0000","last_unstale":"2024-04-23T18:33:06.409650+0000","last_undegraded":"2024-04-23T18:33:06.409650+0000","last_fullsized":"2024-04-23T18:33:06.409650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:06.409508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:06.409508+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.409508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.085219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.191180+0000","last_change":"2024-04-23T18:33:06.191207+0000","last_active":"2024-04-23T18:33:06.191180+0000","last_peered":"2024-04-23T18:33:06.191180+0000","last_clean":"2024-04-23T18:33:06.191180+0000","last_became_active":"2024-04-23T18:29:13.496958+0000","last_became_peered":"2024-04-23T18:29:13.496958+0000","last_unstale":"2024-04-23T18:33:06.191180+0000","last_undegraded":"2024-04-23T18:33:06.191180+0000","last_fullsized":"2024-04-23T18:33:06.191180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:06.191085+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:06.191085+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.191085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:46:01.648450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:23.363748+0000","last_change":"2024-04-23T18:33:23.363748+0000","last_active":"2024-04-23T18:33:23.363748+0000","last_peered":"2024-04-23T18:33:23.363748+0000","last_clean":"2024-04-23T18:33:23.363748+0000","last_became_active":"2024-04-23T18:29:11.486563+0000","last_became_peered":"2024-04-23T18:29:11.486563+0000","last_unstale":"2024-04-23T18:33:23.363748+0000","last_undegraded":"2024-04-23T18:33:23.363748+0000","last_fullsized":"2024-04-23T18:33:23.363748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:23.363565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:23.363565+0000","last_clean_scrub_stamp":"2024-04-23T18:33:23.363565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:08.265861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:20.467767+0000","last_change":"2024-04-23T18:33:20.467793+0000","last_active":"2024-04-23T18:33:20.467767+0000","last_peered":"2024-04-23T18:33:20.467767+0000","last_clean":"2024-04-23T18:33:20.467767+0000","last_became_active":"2024-04-23T18:29:13.494683+0000","last_became_peered":"2024-04-23T18:29:13.494683+0000","last_unstale":"2024-04-23T18:33:20.467767+0000","last_undegraded":"2024-04-23T18:33:20.467767+0000","last_fullsized":"2024-04-23T18:33:20.467767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:33:20.467687+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:33:20.467687+0000","last_clean_scrub_stamp":"2024-04-23T18:33:20.467687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:55.559898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.122540+0000","last_change":"2024-04-23T18:29:11.511297+0000","last_active":"2024-04-23T18:32:32.122540+0000","last_peered":"2024-04-23T18:32:32.122540+0000","last_clean":"2024-04-23T18:32:32.122540+0000","last_became_active":"2024-04-23T18:29:11.510971+0000","last_became_peered":"2024-04-23T18:29:11.510971+0000","last_unstale":"2024-04-23T18:32:32.122540+0000","last_undegraded":"2024-04-23T18:32:32.122540+0000","last_fullsized":"2024-04-23T18:32:32.122540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.219688+0000","last_change":"2024-04-23T18:33:08.219714+0000","last_active":"2024-04-23T18:33:08.219688+0000","last_peered":"2024-04-23T18:33:08.219688+0000","last_clean":"2024-04-23T18:33:08.219688+0000","last_became_active":"2024-04-23T18:29:13.497094+0000","last_became_peered":"2024-04-23T18:29:13.497094+0000","last_unstale":"2024-04-23T18:33:08.219688+0000","last_undegraded":"2024-04-23T18:33:08.219688+0000","last_fullsized":"2024-04-23T18:33:08.219688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:33:08.219588+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:33:08.219588+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.219588+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:10.922039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:25.388007+0000","last_change":"2024-04-23T18:33:25.388034+0000","last_active":"2024-04-23T18:33:25.388007+0000","last_peered":"2024-04-23T18:33:25.388007+0000","last_clean":"2024-04-23T18:33:25.388007+0000","last_became_active":"2024-04-23T18:29:11.492064+0000","last_became_peered":"2024-04-23T18:29:11.492064+0000","last_unstale":"2024-04-23T18:33:25.388007+0000","last_undegraded":"2024-04-23T18:33:25.388007+0000","last_fullsized":"2024-04-23T18:33:25.388007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:25.387886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:25.387886+0000","last_clean_scrub_stamp":"2024-04-23T18:33:25.387886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:45:22.119958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.172545+0000","last_change":"2024-04-23T18:32:59.172545+0000","last_active":"2024-04-23T18:32:59.172545+0000","last_peered":"2024-04-23T18:32:59.172545+0000","last_clean":"2024-04-23T18:32:59.172545+0000","last_became_active":"2024-04-23T18:29:13.502243+0000","last_became_peered":"2024-04-23T18:29:13.502243+0000","last_unstale":"2024-04-23T18:32:59.172545+0000","last_undegraded":"2024-04-23T18:32:59.172545+0000","last_fullsized":"2024-04-23T18:32:59.172545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:59.172373+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:59.172373+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.172373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:11.409328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:21.326054+0000","last_change":"2024-04-23T18:33:21.326080+0000","last_active":"2024-04-23T18:33:21.326054+0000","last_peered":"2024-04-23T18:33:21.326054+0000","last_clean":"2024-04-23T18:33:21.326054+0000","last_became_active":"2024-04-23T18:29:11.486452+0000","last_became_peered":"2024-04-23T18:29:11.486452+0000","last_unstale":"2024-04-23T18:33:21.326054+0000","last_undegraded":"2024-04-23T18:33:21.326054+0000","last_fullsized":"2024-04-23T18:33:21.326054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:21.325963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:21.325963+0000","last_clean_scrub_stamp":"2024-04-23T18:33:21.325963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:18.055667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.894295+0000","last_change":"2024-04-23T18:32:53.894295+0000","last_active":"2024-04-23T18:32:53.894295+0000","last_peered":"2024-04-23T18:32:53.894295+0000","last_clean":"2024-04-23T18:32:53.894295+0000","last_became_active":"2024-04-23T18:29:13.507582+0000","last_became_peered":"2024-04-23T18:29:13.507582+0000","last_unstale":"2024-04-23T18:32:53.894295+0000","last_undegraded":"2024-04-23T18:32:53.894295+0000","last_fullsized":"2024-04-23T18:32:53.894295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:53.894122+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:53.894122+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.894122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:12.522802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:22.759180+0000","last_change":"2024-04-23T18:33:22.759180+0000","last_active":"2024-04-23T18:33:22.759180+0000","last_peered":"2024-04-23T18:33:22.759180+0000","last_clean":"2024-04-23T18:33:22.759180+0000","last_became_active":"2024-04-23T18:29:11.493318+0000","last_became_peered":"2024-04-23T18:29:11.493318+0000","last_unstale":"2024-04-23T18:33:22.759180+0000","last_undegraded":"2024-04-23T18:33:22.759180+0000","last_fullsized":"2024-04-23T18:33:22.759180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:22.759052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:22.759052+0000","last_clean_scrub_stamp":"2024-04-23T18:33:22.759052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:54:03.512856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'22","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:14.304260+0000","last_change":"2024-04-23T18:33:14.304260+0000","last_active":"2024-04-23T18:33:14.304260+0000","last_peered":"2024-04-23T18:33:14.304260+0000","last_clean":"2024-04-23T18:33:14.304260+0000","last_became_active":"2024-04-23T18:29:13.499155+0000","last_became_peered":"2024-04-23T18:29:13.499155+0000","last_unstale":"2024-04-23T18:33:14.304260+0000","last_undegraded":"2024-04-23T18:33:14.304260+0000","last_fullsized":"2024-04-23T18:33:14.304260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-23T18:33:14.304134+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-23T18:33:14.304134+0000","last_clean_scrub_stamp":"2024-04-23T18:33:14.304134+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:54.060618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.369384+0000","last_change":"2024-04-23T18:33:08.369384+0000","last_active":"2024-04-23T18:33:08.369384+0000","last_peered":"2024-04-23T18:33:08.369384+0000","last_clean":"2024-04-23T18:33:08.369384+0000","last_became_active":"2024-04-23T18:29:11.485201+0000","last_became_peered":"2024-04-23T18:29:11.485201+0000","last_unstale":"2024-04-23T18:33:08.369384+0000","last_undegraded":"2024-04-23T18:33:08.369384+0000","last_fullsized":"2024-04-23T18:33:08.369384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:08.369275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:08.369275+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.369275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:55.252697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.937232+0000","last_change":"2024-04-23T18:33:09.937232+0000","last_active":"2024-04-23T18:33:09.937232+0000","last_peered":"2024-04-23T18:33:09.937232+0000","last_clean":"2024-04-23T18:33:09.937232+0000","last_became_active":"2024-04-23T18:29:13.495654+0000","last_became_peered":"2024-04-23T18:29:13.495654+0000","last_unstale":"2024-04-23T18:33:09.937232+0000","last_undegraded":"2024-04-23T18:33:09.937232+0000","last_fullsized":"2024-04-23T18:33:09.937232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:09.937116+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:09.937116+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.937116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:04.365933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.264060+0000","last_change":"2024-04-23T18:33:09.264085+0000","last_active":"2024-04-23T18:33:09.264060+0000","last_peered":"2024-04-23T18:33:09.264060+0000","last_clean":"2024-04-23T18:33:09.264060+0000","last_became_active":"2024-04-23T18:29:11.495224+0000","last_became_peered":"2024-04-23T18:29:11.495224+0000","last_unstale":"2024-04-23T18:33:09.264060+0000","last_undegraded":"2024-04-23T18:33:09.264060+0000","last_fullsized":"2024-04-23T18:33:09.264060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:09.263963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:09.263963+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.263963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:07.216912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:13.883476+0000","last_change":"2024-04-23T18:33:13.883502+0000","last_active":"2024-04-23T18:33:13.883476+0000","last_peered":"2024-04-23T18:33:13.883476+0000","last_clean":"2024-04-23T18:33:13.883476+0000","last_became_active":"2024-04-23T18:29:13.497588+0000","last_became_peered":"2024-04-23T18:29:13.497588+0000","last_unstale":"2024-04-23T18:33:13.883476+0000","last_undegraded":"2024-04-23T18:33:13.883476+0000","last_fullsized":"2024-04-23T18:33:13.883476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:13.883382+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:13.883382+0000","last_clean_scrub_stamp":"2024-04-23T18:33:13.883382+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:49:50.871921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.122544+0000","last_change":"2024-04-23T18:29:11.496267+0000","last_active":"2024-04-23T18:32:32.122544+0000","last_peered":"2024-04-23T18:32:32.122544+0000","last_clean":"2024-04-23T18:32:32.122544+0000","last_became_active":"2024-04-23T18:29:11.495948+0000","last_became_peered":"2024-04-23T18:29:11.495948+0000","last_unstale":"2024-04-23T18:32:32.122544+0000","last_undegraded":"2024-04-23T18:32:32.122544+0000","last_fullsized":"2024-04-23T18:32:32.122544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.513942+0000","last_change":"2024-04-23T18:33:08.514007+0000","last_active":"2024-04-23T18:33:08.513942+0000","last_peered":"2024-04-23T18:33:08.513942+0000","last_clean":"2024-04-23T18:33:08.513942+0000","last_became_active":"2024-04-23T18:29:13.500819+0000","last_became_peered":"2024-04-23T18:29:13.500819+0000","last_unstale":"2024-04-23T18:33:08.513942+0000","last_undegraded":"2024-04-23T18:33:08.513942+0000","last_fullsized":"2024-04-23T18:33:08.513942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:08.513818+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:08.513818+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.513818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:15:06.432888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:13.339348+0000","last_change":"2024-04-23T18:33:13.339368+0000","last_active":"2024-04-23T18:33:13.339348+0000","last_peered":"2024-04-23T18:33:13.339348+0000","last_clean":"2024-04-23T18:33:13.339348+0000","last_became_active":"2024-04-23T18:29:11.492727+0000","last_became_peered":"2024-04-23T18:29:11.492727+0000","last_unstale":"2024-04-23T18:33:13.339348+0000","last_undegraded":"2024-04-23T18:33:13.339348+0000","last_fullsized":"2024-04-23T18:33:13.339348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:13.339268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:13.339268+0000","last_clean_scrub_stamp":"2024-04-23T18:33:13.339268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:05:20.784588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.189954+0000","last_change":"2024-04-23T18:32:58.189982+0000","last_active":"2024-04-23T18:32:58.189954+0000","last_peered":"2024-04-23T18:32:58.189954+0000","last_clean":"2024-04-23T18:32:58.189954+0000","last_became_active":"2024-04-23T18:29:13.502835+0000","last_became_peered":"2024-04-23T18:29:13.502835+0000","last_unstale":"2024-04-23T18:32:58.189954+0000","last_undegraded":"2024-04-23T18:32:58.189954+0000","last_fullsized":"2024-04-23T18:32:58.189954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:58.189852+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:58.189852+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.189852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:33.304629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:16.842275+0000","last_change":"2024-04-23T18:33:16.842303+0000","last_active":"2024-04-23T18:33:16.842275+0000","last_peered":"2024-04-23T18:33:16.842275+0000","last_clean":"2024-04-23T18:33:16.842275+0000","last_became_active":"2024-04-23T18:29:11.498708+0000","last_became_peered":"2024-04-23T18:29:11.498708+0000","last_unstale":"2024-04-23T18:33:16.842275+0000","last_undegraded":"2024-04-23T18:33:16.842275+0000","last_fullsized":"2024-04-23T18:33:16.842275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:16.842178+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:16.842178+0000","last_clean_scrub_stamp":"2024-04-23T18:33:16.842178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:43:59.315276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.869995+0000","last_change":"2024-04-23T18:33:05.870040+0000","last_active":"2024-04-23T18:33:05.869995+0000","last_peered":"2024-04-23T18:33:05.869995+0000","last_clean":"2024-04-23T18:33:05.869995+0000","last_became_active":"2024-04-23T18:29:13.494121+0000","last_became_peered":"2024-04-23T18:29:13.494121+0000","last_unstale":"2024-04-23T18:33:05.869995+0000","last_undegraded":"2024-04-23T18:33:05.869995+0000","last_fullsized":"2024-04-23T18:33:05.869995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:05.869897+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:05.869897+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.869897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:04.336158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:20.766420+0000","last_change":"2024-04-23T18:33:20.766460+0000","last_active":"2024-04-23T18:33:20.766420+0000","last_peered":"2024-04-23T18:33:20.766420+0000","last_clean":"2024-04-23T18:33:20.766420+0000","last_became_active":"2024-04-23T18:29:11.489671+0000","last_became_peered":"2024-04-23T18:29:11.489671+0000","last_unstale":"2024-04-23T18:33:20.766420+0000","last_undegraded":"2024-04-23T18:33:20.766420+0000","last_fullsized":"2024-04-23T18:33:20.766420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:20.766326+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:20.766326+0000","last_clean_scrub_stamp":"2024-04-23T18:33:20.766326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:00:09.886314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.886463+0000","last_change":"2024-04-23T18:32:56.886490+0000","last_active":"2024-04-23T18:32:56.886463+0000","last_peered":"2024-04-23T18:32:56.886463+0000","last_clean":"2024-04-23T18:32:56.886463+0000","last_became_active":"2024-04-23T18:29:13.507438+0000","last_became_peered":"2024-04-23T18:29:13.507438+0000","last_unstale":"2024-04-23T18:32:56.886463+0000","last_undegraded":"2024-04-23T18:32:56.886463+0000","last_fullsized":"2024-04-23T18:32:56.886463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:56.886359+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:56.886359+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.886359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:27:39.704045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:27.876374+0000","last_change":"2024-04-23T18:29:11.511457+0000","last_active":"2024-04-23T18:32:27.876374+0000","last_peered":"2024-04-23T18:32:27.876374+0000","last_clean":"2024-04-23T18:32:27.876374+0000","last_became_active":"2024-04-23T18:29:11.510882+0000","last_became_peered":"2024-04-23T18:29:11.510882+0000","last_unstale":"2024-04-23T18:32:27.876374+0000","last_undegraded":"2024-04-23T18:32:27.876374+0000","last_fullsized":"2024-04-23T18:32:27.876374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.959726+0000","last_change":"2024-04-23T18:33:11.959774+0000","last_active":"2024-04-23T18:33:11.959726+0000","last_peered":"2024-04-23T18:33:11.959726+0000","last_clean":"2024-04-23T18:33:11.959726+0000","last_became_active":"2024-04-23T18:29:13.497271+0000","last_became_peered":"2024-04-23T18:29:13.497271+0000","last_unstale":"2024-04-23T18:33:11.959726+0000","last_undegraded":"2024-04-23T18:33:11.959726+0000","last_fullsized":"2024-04-23T18:33:11.959726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-23T18:33:11.959620+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-23T18:33:11.959620+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.959620+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:56.484601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:27.519219+0000","last_change":"2024-04-23T18:33:27.519246+0000","last_active":"2024-04-23T18:33:27.519219+0000","last_peered":"2024-04-23T18:33:27.519219+0000","last_clean":"2024-04-23T18:33:27.519219+0000","last_became_active":"2024-04-23T18:29:11.506749+0000","last_became_peered":"2024-04-23T18:29:11.506749+0000","last_unstale":"2024-04-23T18:33:27.519219+0000","last_undegraded":"2024-04-23T18:33:27.519219+0000","last_fullsized":"2024-04-23T18:33:27.519219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:27.519118+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:27.519118+0000","last_clean_scrub_stamp":"2024-04-23T18:33:27.519118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:55.534154+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.488219+0000","last_change":"2024-04-23T18:33:05.488245+0000","last_active":"2024-04-23T18:33:05.488219+0000","last_peered":"2024-04-23T18:33:05.488219+0000","last_clean":"2024-04-23T18:33:05.488219+0000","last_became_active":"2024-04-23T18:29:13.501177+0000","last_became_peered":"2024-04-23T18:29:13.501177+0000","last_unstale":"2024-04-23T18:33:05.488219+0000","last_undegraded":"2024-04-23T18:33:05.488219+0000","last_fullsized":"2024-04-23T18:33:05.488219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:05.488136+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:05.488136+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.488136+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:00:41.028747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:18.427371+0000","last_change":"2024-04-23T18:33:18.427433+0000","last_active":"2024-04-23T18:33:18.427371+0000","last_peered":"2024-04-23T18:33:18.427371+0000","last_clean":"2024-04-23T18:33:18.427371+0000","last_became_active":"2024-04-23T18:29:11.484137+0000","last_became_peered":"2024-04-23T18:29:11.484137+0000","last_unstale":"2024-04-23T18:33:18.427371+0000","last_undegraded":"2024-04-23T18:33:18.427371+0000","last_fullsized":"2024-04-23T18:33:18.427371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:18.427238+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:18.427238+0000","last_clean_scrub_stamp":"2024-04-23T18:33:18.427238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:40.290211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:15.855596+0000","last_change":"2024-04-23T18:33:15.855624+0000","last_active":"2024-04-23T18:33:15.855596+0000","last_peered":"2024-04-23T18:33:15.855596+0000","last_clean":"2024-04-23T18:33:15.855596+0000","last_became_active":"2024-04-23T18:29:13.494034+0000","last_became_peered":"2024-04-23T18:29:13.494034+0000","last_unstale":"2024-04-23T18:33:15.855596+0000","last_undegraded":"2024-04-23T18:33:15.855596+0000","last_fullsized":"2024-04-23T18:33:15.855596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:15.855512+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:15.855512+0000","last_clean_scrub_stamp":"2024-04-23T18:33:15.855512+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:49.712408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:29.447190+0000","last_change":"2024-04-23T18:33:29.447216+0000","last_active":"2024-04-23T18:33:29.447190+0000","last_peered":"2024-04-23T18:33:29.447190+0000","last_clean":"2024-04-23T18:33:29.447190+0000","last_became_active":"2024-04-23T18:29:11.506801+0000","last_became_peered":"2024-04-23T18:29:11.506801+0000","last_unstale":"2024-04-23T18:33:29.447190+0000","last_undegraded":"2024-04-23T18:33:29.447190+0000","last_fullsized":"2024-04-23T18:33:29.447190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:29.447095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:29.447095+0000","last_clean_scrub_stamp":"2024-04-23T18:33:29.447095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:41.471117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:31.761714+0000","last_change":"2024-04-23T18:29:11.495271+0000","last_active":"2024-04-23T18:31:31.761714+0000","last_peered":"2024-04-23T18:31:31.761714+0000","last_clean":"2024-04-23T18:31:31.761714+0000","last_became_active":"2024-04-23T18:29:11.494891+0000","last_became_peered":"2024-04-23T18:29:11.494891+0000","last_unstale":"2024-04-23T18:31:31.761714+0000","last_undegraded":"2024-04-23T18:31:31.761714+0000","last_fullsized":"2024-04-23T18:31:31.761714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:10.460433+0000","last_clean_scrub_stamp":"2024-04-23T18:29:10.460433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.263490+0000","last_change":"2024-04-23T18:33:04.263523+0000","last_active":"2024-04-23T18:33:04.263490+0000","last_peered":"2024-04-23T18:33:04.263490+0000","last_clean":"2024-04-23T18:33:04.263490+0000","last_became_active":"2024-04-23T18:29:13.494850+0000","last_became_peered":"2024-04-23T18:29:13.494850+0000","last_unstale":"2024-04-23T18:33:04.263490+0000","last_undegraded":"2024-04-23T18:33:04.263490+0000","last_fullsized":"2024-04-23T18:33:04.263490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:04.263392+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:04.263392+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.263392+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:45:01.339824+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.217798+0000","last_change":"2024-04-23T18:33:07.217825+0000","last_active":"2024-04-23T18:33:07.217798+0000","last_peered":"2024-04-23T18:33:07.217798+0000","last_clean":"2024-04-23T18:33:07.217798+0000","last_became_active":"2024-04-23T18:29:11.495173+0000","last_became_peered":"2024-04-23T18:29:11.495173+0000","last_unstale":"2024-04-23T18:33:07.217798+0000","last_undegraded":"2024-04-23T18:33:07.217798+0000","last_fullsized":"2024-04-23T18:33:07.217798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:07.217709+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:07.217709+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.217709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:39:38.244409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.919274+0000","last_change":"2024-04-23T18:33:00.919303+0000","last_active":"2024-04-23T18:33:00.919274+0000","last_peered":"2024-04-23T18:33:00.919274+0000","last_clean":"2024-04-23T18:33:00.919274+0000","last_became_active":"2024-04-23T18:29:13.506122+0000","last_became_peered":"2024-04-23T18:29:13.506122+0000","last_unstale":"2024-04-23T18:33:00.919274+0000","last_undegraded":"2024-04-23T18:33:00.919274+0000","last_fullsized":"2024-04-23T18:33:00.919274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:00.919186+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:00.919186+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.919186+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:47.802608+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1524,"ondisk_log_size":1524,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1604,"num_read_kb":1494,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640315,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39968,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331872,"statfs":{"total":96636764160,"available":96595836928,"internally_reserved":0,"allocated":483328,"data_stored":150732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640315,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":738603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640316,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":738249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44088,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327752,"statfs":{"total":96636764160,"available":96591618048,"internally_reserved":0,"allocated":442368,"data_stored":148938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:33:33.620 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.620 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.620 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.621 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.621 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.621 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.621 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.621 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.622 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.622 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.622 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.622 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.622 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.622 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.623 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.623 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.623 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-23T18:29:02.434205+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=2, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.623 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.623 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.624 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.624 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.624 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.624 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.624 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.625 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.625 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-23T18:29:12.467435+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=12, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.625 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.625 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.625 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.625 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-23T18:29:10.460433+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=10, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:33.626 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T18:33:53.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:33:53.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.746+0000 7f92fd792640 1 Processor -- start 2024-04-23T18:33:53.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.746+0000 7f92fd792640 1 -- start start 2024-04-23T18:33:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.747+0000 7f92fd792640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f92f8131de0 0x7f92f81341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:33:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.747+0000 7f92fd792640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f806e5a0 con 0x7f92f812ea70 2024-04-23T18:33:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.747+0000 7f92fd792640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f92f8098cc0 con 0x7f92f8131de0 2024-04-23T18:33:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.747+0000 7f92f67fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f92f8131de0 0x7f92f81341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:33:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.747+0000 7f92f6ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f92f812ea70 0x7f92f812f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46388/0 (socket says 172.21.15.62:46388) 2024-04-23T18:33:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.747+0000 7f92f6ffd640 1 -- 172.21.15.62:0/3433300318 learned_addr learned my addr 172.21.15.62:0/3433300318 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:33:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.747+0000 7f92f67fc640 1 -- 172.21.15.62:0/3433300318 >> v1:172.21.15.62:6789/0 conn(0x7f92f812ea70 legacy=0x7f92f812f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:33:53.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.747+0000 7f92f67fc640 1 -- 172.21.15.62:0/3433300318 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f80989d0 con 0x7f92f8131de0 2024-04-23T18:33:53.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.748+0000 7f92f67fc640 1 --2- 172.21.15.62:0/3433300318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92f8131de0 0x7f92f81341d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009720 tx=0x7f92ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6337b507afbed8af server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:33:53.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.748+0000 7f92f5ffb640 1 -- 172.21.15.62:0/3433300318 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92ec035020 con 0x7f92f8131de0 2024-04-23T18:33:53.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.748+0000 7f92f5ffb640 1 -- 172.21.15.62:0/3433300318 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ec031760 con 0x7f92f8131de0 2024-04-23T18:33:53.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.748+0000 7f92f5ffb640 1 -- 172.21.15.62:0/3433300318 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92ec031a60 con 0x7f92f8131de0 2024-04-23T18:33:53.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.749+0000 7f92fd792640 1 -- 172.21.15.62:0/3433300318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92f8131de0 msgr2=0x7f92f81341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:33:53.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.749+0000 7f92fd792640 1 --2- 172.21.15.62:0/3433300318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92f8131de0 0x7f92f81341d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009720 tx=0x7f92ec02b8d0 comp rx=0 tx=0).stop 2024-04-23T18:33:53.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.749+0000 7f92fd792640 1 -- 172.21.15.62:0/3433300318 shutdown_connections 2024-04-23T18:33:53.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.749+0000 7f92fd792640 1 --2- 172.21.15.62:0/3433300318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92f8131de0 0x7f92f81341d0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:33:53.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.749+0000 7f92fd792640 1 -- 172.21.15.62:0/3433300318 >> 172.21.15.62:0/3433300318 conn(0x7f92f80a1000 msgr2=0x7f92f80a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:33:53.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.749+0000 7f92fd792640 1 -- 172.21.15.62:0/3433300318 shutdown_connections 2024-04-23T18:33:53.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.749+0000 7f92fd792640 1 -- 172.21.15.62:0/3433300318 wait complete. 2024-04-23T18:33:53.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.750+0000 7f92fd792640 1 Processor -- start 2024-04-23T18:33:53.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.750+0000 7f92fd792640 1 -- start start 2024-04-23T18:33:53.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.750+0000 7f92fd792640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92f812ea70 0x7f92f8097070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:33:53.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.750+0000 7f92fd792640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f92f8134710 con 0x7f92f812ea70 2024-04-23T18:33:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.750+0000 7f92f6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92f812ea70 0x7f92f8097070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:33:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.750+0000 7f92f6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92f812ea70 0x7f92f8097070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:34348/0 (socket says 172.21.15.62:34348) 2024-04-23T18:33:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.750+0000 7f92f6ffd640 1 -- 172.21.15.62:0/3619503776 learned_addr learned my addr 172.21.15.62:0/3619503776 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:33:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.750+0000 7f92f6ffd640 1 -- 172.21.15.62:0/3619503776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f8128120 con 0x7f92f812ea70 2024-04-23T18:33:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.751+0000 7f92f6ffd640 1 --2- 172.21.15.62:0/3619503776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92f812ea70 0x7f92f8097070 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f92e800c4a0 tx=0x7f92e800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:33:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.751+0000 7f92df7fe640 1 -- 172.21.15.62:0/3619503776 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e8017070 con 0x7f92f812ea70 2024-04-23T18:33:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.751+0000 7f92df7fe640 1 -- 172.21.15.62:0/3619503776 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e8005c10 con 0x7f92f812ea70 2024-04-23T18:33:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.751+0000 7f92fd792640 1 -- 172.21.15.62:0/3619503776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f81287e0 con 0x7f92f812ea70 2024-04-23T18:33:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.751+0000 7f92df7fe640 1 -- 172.21.15.62:0/3619503776 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92e8007070 con 0x7f92f812ea70 2024-04-23T18:33:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.751+0000 7f92fd792640 1 -- 172.21.15.62:0/3619503776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f812b190 con 0x7f92f812ea70 2024-04-23T18:33:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.752+0000 7f92df7fe640 1 -- 172.21.15.62:0/3619503776 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f92e801a070 con 0x7f92f812ea70 2024-04-23T18:33:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.752+0000 7f92fd792640 1 -- 172.21.15.62:0/3619503776 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f812a4f0 con 0x7f92f812ea70 2024-04-23T18:33:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.752+0000 7f92df7fe640 1 --2- 172.21.15.62:0/3619503776 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f92e40385c0 0x7f92e403aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:33:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.752+0000 7f92df7fe640 1 -- 172.21.15.62:0/3619503776 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f92e804b320 con 0x7f92f812ea70 2024-04-23T18:33:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.753+0000 7f92f67fc640 1 --2- 172.21.15.62:0/3619503776 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f92e40385c0 0x7f92e403aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:33:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.753+0000 7f92f67fc640 1 --2- 172.21.15.62:0/3619503776 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f92e40385c0 0x7f92e403aa80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f92ec036000 tx=0x7f92ec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:33:53.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.757+0000 7f92df7fe640 1 -- 172.21.15.62:0/3619503776 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f92e80117a0 con 0x7f92f812ea70 2024-04-23T18:33:53.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.941+0000 7f92fd792640 1 -- 172.21.15.62:0/3619503776 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92f812b420 con 0x7f92e40385c0 2024-04-23T18:33:53.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.957+0000 7f92df7fe640 1 -- 172.21.15.62:0/3619503776 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665869 (secure 0 0 0) 0x7f92f812b420 con 0x7f92e40385c0 2024-04-23T18:33:53.956 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:33:53.961 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-04-23T18:33:53.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.961+0000 7f92fd792640 1 -- 172.21.15.62:0/3619503776 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f92e40385c0 msgr2=0x7f92e403aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:33:53.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.961+0000 7f92fd792640 1 --2- 172.21.15.62:0/3619503776 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f92e40385c0 0x7f92e403aa80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f92ec036000 tx=0x7f92ec008030 comp rx=0 tx=0).stop 2024-04-23T18:33:53.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.961+0000 7f92fd792640 1 -- 172.21.15.62:0/3619503776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92f812ea70 msgr2=0x7f92f8097070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:33:53.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.961+0000 7f92fd792640 1 --2- 172.21.15.62:0/3619503776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92f812ea70 0x7f92f8097070 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f92e800c4a0 tx=0x7f92e800c960 comp rx=0 tx=0).stop 2024-04-23T18:33:53.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.961+0000 7f92fd792640 1 -- 172.21.15.62:0/3619503776 shutdown_connections 2024-04-23T18:33:53.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.961+0000 7f92fd792640 1 --2- 172.21.15.62:0/3619503776 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f92e40385c0 0x7f92e403aa80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:33:53.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.961+0000 7f92fd792640 1 --2- 172.21.15.62:0/3619503776 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92f812ea70 0x7f92f8097070 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:33:53.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.961+0000 7f92fd792640 1 -- 172.21.15.62:0/3619503776 >> 172.21.15.62:0/3619503776 conn(0x7f92f80a1000 msgr2=0x7f92f8099910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:33:53.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.962+0000 7f92fd792640 1 -- 172.21.15.62:0/3619503776 shutdown_connections 2024-04-23T18:33:53.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:33:53.962+0000 7f92fd792640 1 -- 172.21.15.62:0/3619503776 wait complete. 2024-04-23T18:33:53.965 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-04-23T18:33:52.772079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5092,"num_read_kb":4673,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4786,"ondisk_log_size":4786,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165048,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322312,"statfs":{"total":386547056640,"available":386378047488,"internally_reserved":0,"allocated":2973696,"data_stored":1776522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":165996311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003926"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.427995+0000","last_change":"2024-04-23T18:33:04.427995+0000","last_active":"2024-04-23T18:33:04.427995+0000","last_peered":"2024-04-23T18:33:04.427995+0000","last_clean":"2024-04-23T18:33:04.427995+0000","last_became_active":"2024-04-23T18:29:11.495610+0000","last_became_peered":"2024-04-23T18:29:11.495610+0000","last_unstale":"2024-04-23T18:33:04.427995+0000","last_undegraded":"2024-04-23T18:33:04.427995+0000","last_fullsized":"2024-04-23T18:33:04.427995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:04.427875+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:04.427875+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.427875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:27:47.245561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.888297+0000","last_change":"2024-04-23T18:33:02.888343+0000","last_active":"2024-04-23T18:33:02.888297+0000","last_peered":"2024-04-23T18:33:02.888297+0000","last_clean":"2024-04-23T18:33:02.888297+0000","last_became_active":"2024-04-23T18:29:13.492771+0000","last_became_peered":"2024-04-23T18:29:13.492771+0000","last_unstale":"2024-04-23T18:33:02.888297+0000","last_undegraded":"2024-04-23T18:33:02.888297+0000","last_fullsized":"2024-04-23T18:33:02.888297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:02.888182+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:02.888182+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.888182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:35.983458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.220961+0000","last_change":"2024-04-23T18:33:05.220961+0000","last_active":"2024-04-23T18:33:05.220961+0000","last_peered":"2024-04-23T18:33:05.220961+0000","last_clean":"2024-04-23T18:33:05.220961+0000","last_became_active":"2024-04-23T18:29:11.495272+0000","last_became_peered":"2024-04-23T18:29:11.495272+0000","last_unstale":"2024-04-23T18:33:05.220961+0000","last_undegraded":"2024-04-23T18:33:05.220961+0000","last_fullsized":"2024-04-23T18:33:05.220961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:05.220836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:05.220836+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.220836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:05.041452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:17.405494+0000","last_change":"2024-04-23T18:33:17.405529+0000","last_active":"2024-04-23T18:33:17.405494+0000","last_peered":"2024-04-23T18:33:17.405494+0000","last_clean":"2024-04-23T18:33:17.405494+0000","last_became_active":"2024-04-23T18:29:13.494969+0000","last_became_peered":"2024-04-23T18:29:13.494969+0000","last_unstale":"2024-04-23T18:33:17.405494+0000","last_undegraded":"2024-04-23T18:33:17.405494+0000","last_fullsized":"2024-04-23T18:33:17.405494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:17.405400+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:17.405400+0000","last_clean_scrub_stamp":"2024-04-23T18:33:17.405400+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:56:01.377480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:28.493450+0000","last_change":"2024-04-23T18:33:28.493481+0000","last_active":"2024-04-23T18:33:28.493450+0000","last_peered":"2024-04-23T18:33:28.493450+0000","last_clean":"2024-04-23T18:33:28.493450+0000","last_became_active":"2024-04-23T18:29:11.505283+0000","last_became_peered":"2024-04-23T18:29:11.505283+0000","last_unstale":"2024-04-23T18:33:28.493450+0000","last_undegraded":"2024-04-23T18:33:28.493450+0000","last_fullsized":"2024-04-23T18:33:28.493450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:28.493354+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:28.493354+0000","last_clean_scrub_stamp":"2024-04-23T18:33:28.493354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:17:11.204043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:16.359353+0000","last_change":"2024-04-23T18:33:16.359380+0000","last_active":"2024-04-23T18:33:16.359353+0000","last_peered":"2024-04-23T18:33:16.359353+0000","last_clean":"2024-04-23T18:33:16.359353+0000","last_became_active":"2024-04-23T18:29:13.495367+0000","last_became_peered":"2024-04-23T18:29:13.495367+0000","last_unstale":"2024-04-23T18:33:16.359353+0000","last_undegraded":"2024-04-23T18:33:16.359353+0000","last_fullsized":"2024-04-23T18:33:16.359353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:16.359245+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:16.359245+0000","last_clean_scrub_stamp":"2024-04-23T18:33:16.359245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:36.330626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.345316+0000","last_change":"2024-04-23T18:33:02.345316+0000","last_active":"2024-04-23T18:33:02.345316+0000","last_peered":"2024-04-23T18:33:02.345316+0000","last_clean":"2024-04-23T18:33:02.345316+0000","last_became_active":"2024-04-23T18:29:11.495677+0000","last_became_peered":"2024-04-23T18:29:11.495677+0000","last_unstale":"2024-04-23T18:33:02.345316+0000","last_undegraded":"2024-04-23T18:33:02.345316+0000","last_fullsized":"2024-04-23T18:33:02.345316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:02.345200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:02.345200+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.345200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:21.009871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:24.523189+0000","last_change":"2024-04-23T18:33:24.523220+0000","last_active":"2024-04-23T18:33:24.523189+0000","last_peered":"2024-04-23T18:33:24.523189+0000","last_clean":"2024-04-23T18:33:24.523189+0000","last_became_active":"2024-04-23T18:29:52.548291+0000","last_became_peered":"2024-04-23T18:29:52.548291+0000","last_unstale":"2024-04-23T18:33:24.523189+0000","last_undegraded":"2024-04-23T18:33:24.523189+0000","last_fullsized":"2024-04-23T18:33:24.523189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:24.523097+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:24.523097+0000","last_clean_scrub_stamp":"2024-04-23T18:33:24.523097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:44:06.996195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:32.428106+0000","last_change":"2024-04-23T18:33:32.428143+0000","last_active":"2024-04-23T18:33:32.428106+0000","last_peered":"2024-04-23T18:33:32.428106+0000","last_clean":"2024-04-23T18:33:32.428106+0000","last_became_active":"2024-04-23T18:29:11.504554+0000","last_became_peered":"2024-04-23T18:29:11.504554+0000","last_unstale":"2024-04-23T18:33:32.428106+0000","last_undegraded":"2024-04-23T18:33:32.428106+0000","last_fullsized":"2024-04-23T18:33:32.428106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:32.428020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:32.428020+0000","last_clean_scrub_stamp":"2024-04-23T18:33:32.428020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:56:59.459014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:25.736601+0000","last_change":"2024-04-23T18:33:25.736628+0000","last_active":"2024-04-23T18:33:25.736601+0000","last_peered":"2024-04-23T18:33:25.736601+0000","last_clean":"2024-04-23T18:33:25.736601+0000","last_became_active":"2024-04-23T18:29:13.498378+0000","last_became_peered":"2024-04-23T18:29:13.498378+0000","last_unstale":"2024-04-23T18:33:25.736601+0000","last_undegraded":"2024-04-23T18:33:25.736601+0000","last_fullsized":"2024-04-23T18:33:25.736601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:25.736493+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:25.736493+0000","last_clean_scrub_stamp":"2024-04-23T18:33:25.736493+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:18:01.548689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.354760+0000","last_change":"2024-04-23T18:32:58.354787+0000","last_active":"2024-04-23T18:32:58.354760+0000","last_peered":"2024-04-23T18:32:58.354760+0000","last_clean":"2024-04-23T18:32:58.354760+0000","last_became_active":"2024-04-23T18:29:11.496923+0000","last_became_peered":"2024-04-23T18:29:11.496923+0000","last_unstale":"2024-04-23T18:32:58.354760+0000","last_undegraded":"2024-04-23T18:32:58.354760+0000","last_fullsized":"2024-04-23T18:32:58.354760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:58.354674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:58.354674+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.354674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:20.236974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.469206+0000","last_change":"2024-04-23T18:32:49.469206+0000","last_active":"2024-04-23T18:32:49.469206+0000","last_peered":"2024-04-23T18:32:49.469206+0000","last_clean":"2024-04-23T18:32:49.469206+0000","last_became_active":"2024-04-23T18:29:13.502401+0000","last_became_peered":"2024-04-23T18:29:13.502401+0000","last_unstale":"2024-04-23T18:32:49.469206+0000","last_undegraded":"2024-04-23T18:32:49.469206+0000","last_fullsized":"2024-04-23T18:32:49.469206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:49.469055+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:49.469055+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.469055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:49:26.457594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:48.482871+0000","last_change":"2024-04-23T18:33:48.482903+0000","last_active":"2024-04-23T18:33:48.482871+0000","last_peered":"2024-04-23T18:33:48.482871+0000","last_clean":"2024-04-23T18:33:48.482871+0000","last_became_active":"2024-04-23T18:29:11.499772+0000","last_became_peered":"2024-04-23T18:29:11.499772+0000","last_unstale":"2024-04-23T18:33:48.482871+0000","last_undegraded":"2024-04-23T18:33:48.482871+0000","last_fullsized":"2024-04-23T18:33:48.482871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:48.482779+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:48.482779+0000","last_clean_scrub_stamp":"2024-04-23T18:33:48.482779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:07:11.786408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.372456+0000","last_change":"2024-04-23T18:32:57.372456+0000","last_active":"2024-04-23T18:32:57.372456+0000","last_peered":"2024-04-23T18:32:57.372456+0000","last_clean":"2024-04-23T18:32:57.372456+0000","last_became_active":"2024-04-23T18:29:13.498965+0000","last_became_peered":"2024-04-23T18:29:13.498965+0000","last_unstale":"2024-04-23T18:32:57.372456+0000","last_undegraded":"2024-04-23T18:32:57.372456+0000","last_fullsized":"2024-04-23T18:32:57.372456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:57.372339+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:57.372339+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.372339+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:21.784067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:15.259959+0000","last_change":"2024-04-23T18:33:15.259986+0000","last_active":"2024-04-23T18:33:15.259959+0000","last_peered":"2024-04-23T18:33:15.259959+0000","last_clean":"2024-04-23T18:33:15.259959+0000","last_became_active":"2024-04-23T18:29:11.491840+0000","last_became_peered":"2024-04-23T18:29:11.491840+0000","last_unstale":"2024-04-23T18:33:15.259959+0000","last_undegraded":"2024-04-23T18:33:15.259959+0000","last_fullsized":"2024-04-23T18:33:15.259959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:15.259869+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:15.259869+0000","last_clean_scrub_stamp":"2024-04-23T18:33:15.259869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:59.645930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.481145+0000","last_change":"2024-04-23T18:32:54.481145+0000","last_active":"2024-04-23T18:32:54.481145+0000","last_peered":"2024-04-23T18:32:54.481145+0000","last_clean":"2024-04-23T18:32:54.481145+0000","last_became_active":"2024-04-23T18:29:13.505348+0000","last_became_peered":"2024-04-23T18:29:13.505348+0000","last_unstale":"2024-04-23T18:32:54.481145+0000","last_undegraded":"2024-04-23T18:32:54.481145+0000","last_fullsized":"2024-04-23T18:32:54.481145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:54.481024+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:54.481024+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.481024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:53.099891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:14.423937+0000","last_change":"2024-04-23T18:33:14.423963+0000","last_active":"2024-04-23T18:33:14.423937+0000","last_peered":"2024-04-23T18:33:14.423937+0000","last_clean":"2024-04-23T18:33:14.423937+0000","last_became_active":"2024-04-23T18:29:13.495337+0000","last_became_peered":"2024-04-23T18:29:13.495337+0000","last_unstale":"2024-04-23T18:33:14.423937+0000","last_undegraded":"2024-04-23T18:33:14.423937+0000","last_fullsized":"2024-04-23T18:33:14.423937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:14.423840+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:14.423840+0000","last_clean_scrub_stamp":"2024-04-23T18:33:14.423840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:42.803799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.931167+0000","last_change":"2024-04-23T18:33:08.931210+0000","last_active":"2024-04-23T18:33:08.931167+0000","last_peered":"2024-04-23T18:33:08.931167+0000","last_clean":"2024-04-23T18:33:08.931167+0000","last_became_active":"2024-04-23T18:29:11.501773+0000","last_became_peered":"2024-04-23T18:29:11.501773+0000","last_unstale":"2024-04-23T18:33:08.931167+0000","last_undegraded":"2024-04-23T18:33:08.931167+0000","last_fullsized":"2024-04-23T18:33:08.931167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:08.931040+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:08.931040+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.931040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:44.004243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.887546+0000","last_change":"2024-04-23T18:33:04.887572+0000","last_active":"2024-04-23T18:33:04.887546+0000","last_peered":"2024-04-23T18:33:04.887546+0000","last_clean":"2024-04-23T18:33:04.887546+0000","last_became_active":"2024-04-23T18:29:13.492366+0000","last_became_peered":"2024-04-23T18:29:13.492366+0000","last_unstale":"2024-04-23T18:33:04.887546+0000","last_undegraded":"2024-04-23T18:33:04.887546+0000","last_fullsized":"2024-04-23T18:33:04.887546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:04.887454+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:04.887454+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.887454+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:41.190483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.372844+0000","last_change":"2024-04-23T18:33:10.372871+0000","last_active":"2024-04-23T18:33:10.372844+0000","last_peered":"2024-04-23T18:33:10.372844+0000","last_clean":"2024-04-23T18:33:10.372844+0000","last_became_active":"2024-04-23T18:29:11.484620+0000","last_became_peered":"2024-04-23T18:29:11.484620+0000","last_unstale":"2024-04-23T18:33:10.372844+0000","last_undegraded":"2024-04-23T18:33:10.372844+0000","last_fullsized":"2024-04-23T18:33:10.372844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:10.372753+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:10.372753+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.372753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:43.468029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'16","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.898340+0000","last_change":"2024-04-23T18:33:07.898374+0000","last_active":"2024-04-23T18:33:07.898340+0000","last_peered":"2024-04-23T18:33:07.898340+0000","last_clean":"2024-04-23T18:33:07.898340+0000","last_became_active":"2024-04-23T18:29:13.495743+0000","last_became_peered":"2024-04-23T18:29:13.495743+0000","last_unstale":"2024-04-23T18:33:07.898340+0000","last_undegraded":"2024-04-23T18:33:07.898340+0000","last_fullsized":"2024-04-23T18:33:07.898340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:33:07.898227+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:33:07.898227+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.898227+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:29.453739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:21.772760+0000","last_change":"2024-04-23T18:33:21.772818+0000","last_active":"2024-04-23T18:33:21.772760+0000","last_peered":"2024-04-23T18:33:21.772760+0000","last_clean":"2024-04-23T18:33:21.772760+0000","last_became_active":"2024-04-23T18:29:11.493363+0000","last_became_peered":"2024-04-23T18:29:11.493363+0000","last_unstale":"2024-04-23T18:33:21.772760+0000","last_undegraded":"2024-04-23T18:33:21.772760+0000","last_fullsized":"2024-04-23T18:33:21.772760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:21.772658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:21.772658+0000","last_clean_scrub_stamp":"2024-04-23T18:33:21.772658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:27.453258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.223224+0000","last_change":"2024-04-23T18:33:01.223252+0000","last_active":"2024-04-23T18:33:01.223224+0000","last_peered":"2024-04-23T18:33:01.223224+0000","last_clean":"2024-04-23T18:33:01.223224+0000","last_became_active":"2024-04-23T18:29:13.501988+0000","last_became_peered":"2024-04-23T18:29:13.501988+0000","last_unstale":"2024-04-23T18:33:01.223224+0000","last_undegraded":"2024-04-23T18:33:01.223224+0000","last_fullsized":"2024-04-23T18:33:01.223224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:01.223122+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:01.223122+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.223122+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:46:24.673897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.881786+0000","last_change":"2024-04-23T18:33:06.881811+0000","last_active":"2024-04-23T18:33:06.881786+0000","last_peered":"2024-04-23T18:33:06.881786+0000","last_clean":"2024-04-23T18:33:06.881786+0000","last_became_active":"2024-04-23T18:29:11.502714+0000","last_became_peered":"2024-04-23T18:29:11.502714+0000","last_unstale":"2024-04-23T18:33:06.881786+0000","last_undegraded":"2024-04-23T18:33:06.881786+0000","last_fullsized":"2024-04-23T18:33:06.881786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:06.881695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:06.881695+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.881695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:02:23.976616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.408456+0000","last_change":"2024-04-23T18:32:56.408483+0000","last_active":"2024-04-23T18:32:56.408456+0000","last_peered":"2024-04-23T18:32:56.408456+0000","last_clean":"2024-04-23T18:32:56.408456+0000","last_became_active":"2024-04-23T18:29:13.498488+0000","last_became_peered":"2024-04-23T18:29:13.498488+0000","last_unstale":"2024-04-23T18:32:56.408456+0000","last_undegraded":"2024-04-23T18:32:56.408456+0000","last_fullsized":"2024-04-23T18:32:56.408456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:56.408370+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:56.408370+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.408370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:50:09.569283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.286138+0000","last_change":"2024-04-23T18:33:11.286165+0000","last_active":"2024-04-23T18:33:11.286138+0000","last_peered":"2024-04-23T18:33:11.286138+0000","last_clean":"2024-04-23T18:33:11.286138+0000","last_became_active":"2024-04-23T18:29:11.495025+0000","last_became_peered":"2024-04-23T18:29:11.495025+0000","last_unstale":"2024-04-23T18:33:11.286138+0000","last_undegraded":"2024-04-23T18:33:11.286138+0000","last_fullsized":"2024-04-23T18:33:11.286138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:11.286048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:11.286048+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.286048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:58.054788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.905112+0000","last_change":"2024-04-23T18:33:01.905141+0000","last_active":"2024-04-23T18:33:01.905112+0000","last_peered":"2024-04-23T18:33:01.905112+0000","last_clean":"2024-04-23T18:33:01.905112+0000","last_became_active":"2024-04-23T18:29:13.494080+0000","last_became_peered":"2024-04-23T18:29:13.494080+0000","last_unstale":"2024-04-23T18:33:01.905112+0000","last_undegraded":"2024-04-23T18:33:01.905112+0000","last_fullsized":"2024-04-23T18:33:01.905112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:01.905014+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:01.905014+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.905014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:34.294317+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:31.440603+0000","last_change":"2024-04-23T18:33:31.440603+0000","last_active":"2024-04-23T18:33:31.440603+0000","last_peered":"2024-04-23T18:33:31.440603+0000","last_clean":"2024-04-23T18:33:31.440603+0000","last_became_active":"2024-04-23T18:29:11.507336+0000","last_became_peered":"2024-04-23T18:29:11.507336+0000","last_unstale":"2024-04-23T18:33:31.440603+0000","last_undegraded":"2024-04-23T18:33:31.440603+0000","last_fullsized":"2024-04-23T18:33:31.440603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:31.440484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:31.440484+0000","last_clean_scrub_stamp":"2024-04-23T18:33:31.440484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:07.664670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'38","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.906998+0000","last_change":"2024-04-23T18:32:55.907029+0000","last_active":"2024-04-23T18:32:55.906998+0000","last_peered":"2024-04-23T18:32:55.906998+0000","last_clean":"2024-04-23T18:32:55.906998+0000","last_became_active":"2024-04-23T18:29:21.529771+0000","last_became_peered":"2024-04-23T18:29:21.529771+0000","last_unstale":"2024-04-23T18:32:55.906998+0000","last_undegraded":"2024-04-23T18:32:55.906998+0000","last_fullsized":"2024-04-23T18:32:55.906998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-04-23T18:32:55.906902+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-04-23T18:32:55.906902+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.906902+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:18.086470+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'22","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:25.481479+0000","last_change":"2024-04-23T18:33:25.481507+0000","last_active":"2024-04-23T18:33:25.481479+0000","last_peered":"2024-04-23T18:33:25.481479+0000","last_clean":"2024-04-23T18:33:25.481479+0000","last_became_active":"2024-04-23T18:29:52.549641+0000","last_became_peered":"2024-04-23T18:29:52.549641+0000","last_unstale":"2024-04-23T18:33:25.481479+0000","last_undegraded":"2024-04-23T18:33:25.481479+0000","last_fullsized":"2024-04-23T18:33:25.481479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-23T18:33:25.481391+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-23T18:33:25.481391+0000","last_clean_scrub_stamp":"2024-04-23T18:33:25.481391+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:34.798802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":69,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:22.457711+0000","last_change":"2024-04-23T18:33:22.457711+0000","last_active":"2024-04-23T18:33:22.457711+0000","last_peered":"2024-04-23T18:33:22.457711+0000","last_clean":"2024-04-23T18:33:22.457711+0000","last_became_active":"2024-04-23T18:29:11.512062+0000","last_became_peered":"2024-04-23T18:29:11.512062+0000","last_unstale":"2024-04-23T18:33:22.457711+0000","last_undegraded":"2024-04-23T18:33:22.457711+0000","last_fullsized":"2024-04-23T18:33:22.457711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:22.457594+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:22.457594+0000","last_clean_scrub_stamp":"2024-04-23T18:33:22.457594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:44.174801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.393499+0000","last_change":"2024-04-23T18:32:36.393525+0000","last_active":"2024-04-23T18:32:36.393499+0000","last_peered":"2024-04-23T18:32:36.393499+0000","last_clean":"2024-04-23T18:32:36.393499+0000","last_became_active":"2024-04-23T18:29:15.508100+0000","last_became_peered":"2024-04-23T18:29:15.508100+0000","last_unstale":"2024-04-23T18:32:36.393499+0000","last_undegraded":"2024-04-23T18:32:36.393499+0000","last_fullsized":"2024-04-23T18:32:36.393499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.393398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.393398+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.393398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:14.247382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.399695+0000","last_change":"2024-04-23T18:32:43.399750+0000","last_active":"2024-04-23T18:32:43.399695+0000","last_peered":"2024-04-23T18:32:43.399695+0000","last_clean":"2024-04-23T18:32:43.399695+0000","last_became_active":"2024-04-23T18:29:17.513368+0000","last_became_peered":"2024-04-23T18:29:17.513368+0000","last_unstale":"2024-04-23T18:32:43.399695+0000","last_undegraded":"2024-04-23T18:32:43.399695+0000","last_fullsized":"2024-04-23T18:32:43.399695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:43.399581+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:43.399581+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.399581+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:04.955093+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.915356+0000","last_change":"2024-04-23T18:32:35.915380+0000","last_active":"2024-04-23T18:32:35.915356+0000","last_peered":"2024-04-23T18:32:35.915356+0000","last_clean":"2024-04-23T18:32:35.915356+0000","last_became_active":"2024-04-23T18:29:19.520066+0000","last_became_peered":"2024-04-23T18:29:19.520066+0000","last_unstale":"2024-04-23T18:32:35.915356+0000","last_undegraded":"2024-04-23T18:32:35.915356+0000","last_fullsized":"2024-04-23T18:32:35.915356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.915263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.915263+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.915263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:33.026516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.878515+0000","last_change":"2024-04-23T18:32:51.878542+0000","last_active":"2024-04-23T18:32:51.878515+0000","last_peered":"2024-04-23T18:32:51.878515+0000","last_clean":"2024-04-23T18:32:51.878515+0000","last_became_active":"2024-04-23T18:29:21.529743+0000","last_became_peered":"2024-04-23T18:29:21.529743+0000","last_unstale":"2024-04-23T18:32:51.878515+0000","last_undegraded":"2024-04-23T18:32:51.878515+0000","last_fullsized":"2024-04-23T18:32:51.878515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-23T18:32:51.878417+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-23T18:32:51.878417+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.878417+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:39.785762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.444752+0000","last_change":"2024-04-23T18:33:10.444793+0000","last_active":"2024-04-23T18:33:10.444752+0000","last_peered":"2024-04-23T18:33:10.444752+0000","last_clean":"2024-04-23T18:33:10.444752+0000","last_became_active":"2024-04-23T18:29:13.496299+0000","last_became_peered":"2024-04-23T18:29:13.496299+0000","last_unstale":"2024-04-23T18:33:10.444752+0000","last_undegraded":"2024-04-23T18:33:10.444752+0000","last_fullsized":"2024-04-23T18:33:10.444752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:10.444658+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:10.444658+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.444658+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:35:16.256466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.324598+0000","last_change":"2024-04-23T18:33:00.324598+0000","last_active":"2024-04-23T18:33:00.324598+0000","last_peered":"2024-04-23T18:33:00.324598+0000","last_clean":"2024-04-23T18:33:00.324598+0000","last_became_active":"2024-04-23T18:29:11.496878+0000","last_became_peered":"2024-04-23T18:29:11.496878+0000","last_unstale":"2024-04-23T18:33:00.324598+0000","last_undegraded":"2024-04-23T18:33:00.324598+0000","last_fullsized":"2024-04-23T18:33:00.324598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:00.324482+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:00.324482+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.324482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:37:16.117012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.219481+0000","last_change":"2024-04-23T18:32:55.219506+0000","last_active":"2024-04-23T18:32:55.219481+0000","last_peered":"2024-04-23T18:32:55.219481+0000","last_clean":"2024-04-23T18:32:55.219481+0000","last_became_active":"2024-04-23T18:29:15.504744+0000","last_became_peered":"2024-04-23T18:29:15.504744+0000","last_unstale":"2024-04-23T18:32:55.219481+0000","last_undegraded":"2024-04-23T18:32:55.219481+0000","last_fullsized":"2024-04-23T18:32:55.219481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:55.219376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:55.219376+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.219376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:01:48.896771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.884623+0000","last_change":"2024-04-23T18:32:37.884678+0000","last_active":"2024-04-23T18:32:37.884623+0000","last_peered":"2024-04-23T18:32:37.884623+0000","last_clean":"2024-04-23T18:32:37.884623+0000","last_became_active":"2024-04-23T18:29:17.510201+0000","last_became_peered":"2024-04-23T18:29:17.510201+0000","last_unstale":"2024-04-23T18:32:37.884623+0000","last_undegraded":"2024-04-23T18:32:37.884623+0000","last_fullsized":"2024-04-23T18:32:37.884623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-23T18:32:37.884529+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-23T18:32:37.884529+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.884529+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.954621+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.869790+0000","last_change":"2024-04-23T18:32:43.869829+0000","last_active":"2024-04-23T18:32:43.869790+0000","last_peered":"2024-04-23T18:32:43.869790+0000","last_clean":"2024-04-23T18:32:43.869790+0000","last_became_active":"2024-04-23T18:29:19.527770+0000","last_became_peered":"2024-04-23T18:29:19.527770+0000","last_unstale":"2024-04-23T18:32:43.869790+0000","last_undegraded":"2024-04-23T18:32:43.869790+0000","last_fullsized":"2024-04-23T18:32:43.869790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:43.869698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:43.869698+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.869698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:06.080613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.191867+0000","last_change":"2024-04-23T18:33:00.191895+0000","last_active":"2024-04-23T18:33:00.191867+0000","last_peered":"2024-04-23T18:33:00.191867+0000","last_clean":"2024-04-23T18:33:00.191867+0000","last_became_active":"2024-04-23T18:29:21.525940+0000","last_became_peered":"2024-04-23T18:29:21.525940+0000","last_unstale":"2024-04-23T18:33:00.191867+0000","last_undegraded":"2024-04-23T18:33:00.191867+0000","last_fullsized":"2024-04-23T18:33:00.191867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:00.191774+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:00.191774+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.191774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:05:50.166534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:13.407412+0000","last_change":"2024-04-23T18:33:13.407434+0000","last_active":"2024-04-23T18:33:13.407412+0000","last_peered":"2024-04-23T18:33:13.407412+0000","last_clean":"2024-04-23T18:33:13.407412+0000","last_became_active":"2024-04-23T18:29:13.496142+0000","last_became_peered":"2024-04-23T18:29:13.496142+0000","last_unstale":"2024-04-23T18:33:13.407412+0000","last_undegraded":"2024-04-23T18:33:13.407412+0000","last_fullsized":"2024-04-23T18:33:13.407412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:13.407310+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:13.407310+0000","last_clean_scrub_stamp":"2024-04-23T18:33:13.407310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:15:28.507825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:34.414949+0000","last_change":"2024-04-23T18:33:34.414949+0000","last_active":"2024-04-23T18:33:34.414949+0000","last_peered":"2024-04-23T18:33:34.414949+0000","last_clean":"2024-04-23T18:33:34.414949+0000","last_became_active":"2024-04-23T18:29:11.504534+0000","last_became_peered":"2024-04-23T18:29:11.504534+0000","last_unstale":"2024-04-23T18:33:34.414949+0000","last_undegraded":"2024-04-23T18:33:34.414949+0000","last_fullsized":"2024-04-23T18:33:34.414949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:34.414792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:34.414792+0000","last_clean_scrub_stamp":"2024-04-23T18:33:34.414792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:15:29.372141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.226403+0000","last_change":"2024-04-23T18:32:51.226428+0000","last_active":"2024-04-23T18:32:51.226403+0000","last_peered":"2024-04-23T18:32:51.226403+0000","last_clean":"2024-04-23T18:32:51.226403+0000","last_became_active":"2024-04-23T18:29:15.510018+0000","last_became_peered":"2024-04-23T18:29:15.510018+0000","last_unstale":"2024-04-23T18:32:51.226403+0000","last_undegraded":"2024-04-23T18:32:51.226403+0000","last_fullsized":"2024-04-23T18:32:51.226403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:51.226310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:51.226310+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.226310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:48.331725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.411781+0000","last_change":"2024-04-23T18:32:39.411841+0000","last_active":"2024-04-23T18:32:39.411781+0000","last_peered":"2024-04-23T18:32:39.411781+0000","last_clean":"2024-04-23T18:32:39.411781+0000","last_became_active":"2024-04-23T18:29:17.517679+0000","last_became_peered":"2024-04-23T18:29:17.517679+0000","last_unstale":"2024-04-23T18:32:39.411781+0000","last_undegraded":"2024-04-23T18:32:39.411781+0000","last_fullsized":"2024-04-23T18:32:39.411781+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:32:39.411679+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:32:39.411679+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.411679+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:33:43.011129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":394,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.433045+0000","last_change":"2024-04-23T18:32:59.433088+0000","last_active":"2024-04-23T18:32:59.433045+0000","last_peered":"2024-04-23T18:32:59.433045+0000","last_clean":"2024-04-23T18:32:59.433045+0000","last_became_active":"2024-04-23T18:29:19.522434+0000","last_became_peered":"2024-04-23T18:29:19.522434+0000","last_unstale":"2024-04-23T18:32:59.433045+0000","last_undegraded":"2024-04-23T18:32:59.433045+0000","last_fullsized":"2024-04-23T18:32:59.433045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-04-23T18:32:59.432941+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-04-23T18:32:59.432941+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.432941+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:33.938084+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.484842+0000","last_change":"2024-04-23T18:32:45.484880+0000","last_active":"2024-04-23T18:32:45.484842+0000","last_peered":"2024-04-23T18:32:45.484842+0000","last_clean":"2024-04-23T18:32:45.484842+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:32:45.484842+0000","last_undegraded":"2024-04-23T18:32:45.484842+0000","last_fullsized":"2024-04-23T18:32:45.484842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:45.484750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:45.484750+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.484750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:44.554843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:26.421725+0000","last_change":"2024-04-23T18:33:26.421752+0000","last_active":"2024-04-23T18:33:26.421725+0000","last_peered":"2024-04-23T18:33:26.421725+0000","last_clean":"2024-04-23T18:33:26.421725+0000","last_became_active":"2024-04-23T18:29:13.499248+0000","last_became_peered":"2024-04-23T18:29:13.499248+0000","last_unstale":"2024-04-23T18:33:26.421725+0000","last_undegraded":"2024-04-23T18:33:26.421725+0000","last_fullsized":"2024-04-23T18:33:26.421725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:26.421630+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:26.421630+0000","last_clean_scrub_stamp":"2024-04-23T18:33:26.421630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:04:38.089082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:18.796628+0000","last_change":"2024-04-23T18:33:18.796628+0000","last_active":"2024-04-23T18:33:18.796628+0000","last_peered":"2024-04-23T18:33:18.796628+0000","last_clean":"2024-04-23T18:33:18.796628+0000","last_became_active":"2024-04-23T18:29:11.488531+0000","last_became_peered":"2024-04-23T18:29:11.488531+0000","last_unstale":"2024-04-23T18:33:18.796628+0000","last_undegraded":"2024-04-23T18:33:18.796628+0000","last_fullsized":"2024-04-23T18:33:18.796628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:18.796499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:18.796499+0000","last_clean_scrub_stamp":"2024-04-23T18:33:18.796499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:01.729188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.385497+0000","last_change":"2024-04-23T18:32:33.385539+0000","last_active":"2024-04-23T18:32:33.385497+0000","last_peered":"2024-04-23T18:32:33.385497+0000","last_clean":"2024-04-23T18:32:33.385497+0000","last_became_active":"2024-04-23T18:29:15.511249+0000","last_became_peered":"2024-04-23T18:29:15.511249+0000","last_unstale":"2024-04-23T18:32:33.385497+0000","last_undegraded":"2024-04-23T18:32:33.385497+0000","last_fullsized":"2024-04-23T18:32:33.385497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.385380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.385380+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.385380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:14.265560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.451350+0000","last_change":"2024-04-23T18:32:38.451387+0000","last_active":"2024-04-23T18:32:38.451350+0000","last_peered":"2024-04-23T18:32:38.451350+0000","last_clean":"2024-04-23T18:32:38.451350+0000","last_became_active":"2024-04-23T18:29:17.517964+0000","last_became_peered":"2024-04-23T18:29:17.517964+0000","last_unstale":"2024-04-23T18:32:38.451350+0000","last_undegraded":"2024-04-23T18:32:38.451350+0000","last_fullsized":"2024-04-23T18:32:38.451350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-04-23T18:32:38.451267+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-04-23T18:32:38.451267+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.451267+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:18:00.657607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":453,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.248993+0000","last_change":"2024-04-23T18:32:44.249059+0000","last_active":"2024-04-23T18:32:44.248993+0000","last_peered":"2024-04-23T18:32:44.248993+0000","last_clean":"2024-04-23T18:32:44.248993+0000","last_became_active":"2024-04-23T18:29:19.524881+0000","last_became_peered":"2024-04-23T18:29:19.524881+0000","last_unstale":"2024-04-23T18:32:44.248993+0000","last_undegraded":"2024-04-23T18:32:44.248993+0000","last_fullsized":"2024-04-23T18:32:44.248993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:44.248886+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:44.248886+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.248886+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:27.941657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.427187+0000","last_change":"2024-04-23T18:32:52.427187+0000","last_active":"2024-04-23T18:32:52.427187+0000","last_peered":"2024-04-23T18:32:52.427187+0000","last_clean":"2024-04-23T18:32:52.427187+0000","last_became_active":"2024-04-23T18:29:13.501472+0000","last_became_peered":"2024-04-23T18:29:13.501472+0000","last_unstale":"2024-04-23T18:32:52.427187+0000","last_undegraded":"2024-04-23T18:32:52.427187+0000","last_fullsized":"2024-04-23T18:32:52.427187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:32:52.427080+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:32:52.427080+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.427080+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:43:34.900178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'5","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:16.478425+0000","last_change":"2024-04-23T18:33:16.478425+0000","last_active":"2024-04-23T18:33:16.478425+0000","last_peered":"2024-04-23T18:33:16.478425+0000","last_clean":"2024-04-23T18:33:16.478425+0000","last_became_active":"2024-04-23T18:29:11.481977+0000","last_became_peered":"2024-04-23T18:29:11.481977+0000","last_unstale":"2024-04-23T18:33:16.478425+0000","last_undegraded":"2024-04-23T18:33:16.478425+0000","last_fullsized":"2024-04-23T18:33:16.478425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:33:16.478310+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:33:16.478310+0000","last_clean_scrub_stamp":"2024-04-23T18:33:16.478310+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:51.551514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.905482+0000","last_change":"2024-04-23T18:32:45.905482+0000","last_active":"2024-04-23T18:32:45.905482+0000","last_peered":"2024-04-23T18:32:45.905482+0000","last_clean":"2024-04-23T18:32:45.905482+0000","last_became_active":"2024-04-23T18:29:15.509711+0000","last_became_peered":"2024-04-23T18:29:15.509711+0000","last_unstale":"2024-04-23T18:32:45.905482+0000","last_undegraded":"2024-04-23T18:32:45.905482+0000","last_fullsized":"2024-04-23T18:32:45.905482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:45.905366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:45.905366+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.905366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:55:07.535829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'51","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.525489+0000","last_change":"2024-04-23T18:32:46.525489+0000","last_active":"2024-04-23T18:32:46.525489+0000","last_peered":"2024-04-23T18:32:46.525489+0000","last_clean":"2024-04-23T18:32:46.525489+0000","last_became_active":"2024-04-23T18:29:17.511085+0000","last_became_peered":"2024-04-23T18:29:17.511085+0000","last_unstale":"2024-04-23T18:32:46.525489+0000","last_undegraded":"2024-04-23T18:32:46.525489+0000","last_fullsized":"2024-04-23T18:32:46.525489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-04-23T18:32:46.525299+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-04-23T18:32:46.525299+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.525299+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:46:11.482573+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.255269+0000","last_change":"2024-04-23T18:32:52.255269+0000","last_active":"2024-04-23T18:32:52.255269+0000","last_peered":"2024-04-23T18:32:52.255269+0000","last_clean":"2024-04-23T18:32:52.255269+0000","last_became_active":"2024-04-23T18:29:19.527505+0000","last_became_peered":"2024-04-23T18:29:19.527505+0000","last_unstale":"2024-04-23T18:32:52.255269+0000","last_undegraded":"2024-04-23T18:32:52.255269+0000","last_fullsized":"2024-04-23T18:32:52.255269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:52.255147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:52.255147+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.255147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:39:47.960787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'13","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:21.502813+0000","last_change":"2024-04-23T18:33:21.502813+0000","last_active":"2024-04-23T18:33:21.502813+0000","last_peered":"2024-04-23T18:33:21.502813+0000","last_clean":"2024-04-23T18:33:21.502813+0000","last_became_active":"2024-04-23T18:29:21.532163+0000","last_became_peered":"2024-04-23T18:29:21.532163+0000","last_unstale":"2024-04-23T18:33:21.502813+0000","last_undegraded":"2024-04-23T18:33:21.502813+0000","last_fullsized":"2024-04-23T18:33:21.502813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-04-23T18:33:21.502620+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-04-23T18:33:21.502620+0000","last_clean_scrub_stamp":"2024-04-23T18:33:21.502620+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:49:58.491159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.935115+0000","last_change":"2024-04-23T18:33:03.935115+0000","last_active":"2024-04-23T18:33:03.935115+0000","last_peered":"2024-04-23T18:33:03.935115+0000","last_clean":"2024-04-23T18:33:03.935115+0000","last_became_active":"2024-04-23T18:29:13.494108+0000","last_became_peered":"2024-04-23T18:29:13.494108+0000","last_unstale":"2024-04-23T18:33:03.935115+0000","last_undegraded":"2024-04-23T18:33:03.935115+0000","last_fullsized":"2024-04-23T18:33:03.935115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:03.934976+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:03.934976+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.934976+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:46.714997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:12.356679+0000","last_change":"2024-04-23T18:33:12.356679+0000","last_active":"2024-04-23T18:33:12.356679+0000","last_peered":"2024-04-23T18:33:12.356679+0000","last_clean":"2024-04-23T18:33:12.356679+0000","last_became_active":"2024-04-23T18:29:11.481419+0000","last_became_peered":"2024-04-23T18:29:11.481419+0000","last_unstale":"2024-04-23T18:33:12.356679+0000","last_undegraded":"2024-04-23T18:33:12.356679+0000","last_fullsized":"2024-04-23T18:33:12.356679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:12.356553+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:12.356553+0000","last_clean_scrub_stamp":"2024-04-23T18:33:12.356553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:48.659583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.197825+0000","last_change":"2024-04-23T18:32:49.197825+0000","last_active":"2024-04-23T18:32:49.197825+0000","last_peered":"2024-04-23T18:32:49.197825+0000","last_clean":"2024-04-23T18:32:49.197825+0000","last_became_active":"2024-04-23T18:29:15.510135+0000","last_became_peered":"2024-04-23T18:29:15.510135+0000","last_unstale":"2024-04-23T18:32:49.197825+0000","last_undegraded":"2024-04-23T18:32:49.197825+0000","last_fullsized":"2024-04-23T18:32:49.197825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:49.197658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:49.197658+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.197658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:11:00.797470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.367999+0000","last_change":"2024-04-23T18:32:45.367999+0000","last_active":"2024-04-23T18:32:45.367999+0000","last_peered":"2024-04-23T18:32:45.367999+0000","last_clean":"2024-04-23T18:32:45.367999+0000","last_became_active":"2024-04-23T18:29:17.513447+0000","last_became_peered":"2024-04-23T18:29:17.513447+0000","last_unstale":"2024-04-23T18:32:45.367999+0000","last_undegraded":"2024-04-23T18:32:45.367999+0000","last_fullsized":"2024-04-23T18:32:45.367999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:45.367847+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:45.367847+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.367847+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:39.796664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.422658+0000","last_change":"2024-04-23T18:32:33.422658+0000","last_active":"2024-04-23T18:32:33.422658+0000","last_peered":"2024-04-23T18:32:33.422658+0000","last_clean":"2024-04-23T18:32:33.422658+0000","last_became_active":"2024-04-23T18:29:19.518695+0000","last_became_peered":"2024-04-23T18:29:19.518695+0000","last_unstale":"2024-04-23T18:32:33.422658+0000","last_undegraded":"2024-04-23T18:32:33.422658+0000","last_fullsized":"2024-04-23T18:32:33.422658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.422540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.422540+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.422540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:19.231250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'6","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:27.728063+0000","last_change":"2024-04-23T18:33:27.728063+0000","last_active":"2024-04-23T18:33:27.728063+0000","last_peered":"2024-04-23T18:33:27.728063+0000","last_clean":"2024-04-23T18:33:27.728063+0000","last_became_active":"2024-04-23T18:29:21.533103+0000","last_became_peered":"2024-04-23T18:29:21.533103+0000","last_unstale":"2024-04-23T18:33:27.728063+0000","last_undegraded":"2024-04-23T18:33:27.728063+0000","last_fullsized":"2024-04-23T18:33:27.728063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:27.727942+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:27.727942+0000","last_clean_scrub_stamp":"2024-04-23T18:33:27.727942+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:42.711771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'12","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.333394+0000","last_change":"2024-04-23T18:33:01.333394+0000","last_active":"2024-04-23T18:33:01.333394+0000","last_peered":"2024-04-23T18:33:01.333394+0000","last_clean":"2024-04-23T18:33:01.333394+0000","last_became_active":"2024-04-23T18:29:13.499795+0000","last_became_peered":"2024-04-23T18:29:13.499795+0000","last_unstale":"2024-04-23T18:33:01.333394+0000","last_undegraded":"2024-04-23T18:33:01.333394+0000","last_fullsized":"2024-04-23T18:33:01.333394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:33:01.333276+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:33:01.333276+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.333276+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:19.961956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:36.440118+0000","last_change":"2024-04-23T18:33:36.440118+0000","last_active":"2024-04-23T18:33:36.440118+0000","last_peered":"2024-04-23T18:33:36.440118+0000","last_clean":"2024-04-23T18:33:36.440118+0000","last_became_active":"2024-04-23T18:29:11.503228+0000","last_became_peered":"2024-04-23T18:29:11.503228+0000","last_unstale":"2024-04-23T18:33:36.440118+0000","last_undegraded":"2024-04-23T18:33:36.440118+0000","last_fullsized":"2024-04-23T18:33:36.440118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:36.440004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:36.440004+0000","last_clean_scrub_stamp":"2024-04-23T18:33:36.440004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:02.976506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.210518+0000","last_change":"2024-04-23T18:32:50.210518+0000","last_active":"2024-04-23T18:32:50.210518+0000","last_peered":"2024-04-23T18:32:50.210518+0000","last_clean":"2024-04-23T18:32:50.210518+0000","last_became_active":"2024-04-23T18:29:15.509856+0000","last_became_peered":"2024-04-23T18:29:15.509856+0000","last_unstale":"2024-04-23T18:32:50.210518+0000","last_undegraded":"2024-04-23T18:32:50.210518+0000","last_fullsized":"2024-04-23T18:32:50.210518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.210358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.210358+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.210358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:56.040362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.397630+0000","last_change":"2024-04-23T18:32:56.397630+0000","last_active":"2024-04-23T18:32:56.397630+0000","last_peered":"2024-04-23T18:32:56.397630+0000","last_clean":"2024-04-23T18:32:56.397630+0000","last_became_active":"2024-04-23T18:29:17.517116+0000","last_became_peered":"2024-04-23T18:29:17.517116+0000","last_unstale":"2024-04-23T18:32:56.397630+0000","last_undegraded":"2024-04-23T18:32:56.397630+0000","last_fullsized":"2024-04-23T18:32:56.397630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:56.397494+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:56.397494+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.397494+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:45.517482+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.374033+0000","last_change":"2024-04-23T18:32:34.374033+0000","last_active":"2024-04-23T18:32:34.374033+0000","last_peered":"2024-04-23T18:32:34.374033+0000","last_clean":"2024-04-23T18:32:34.374033+0000","last_became_active":"2024-04-23T18:29:19.518519+0000","last_became_peered":"2024-04-23T18:29:19.518519+0000","last_unstale":"2024-04-23T18:32:34.374033+0000","last_undegraded":"2024-04-23T18:32:34.374033+0000","last_fullsized":"2024-04-23T18:32:34.374033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:34.373847+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:34.373847+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.373847+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:40:46.115582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:30.442179+0000","last_change":"2024-04-23T18:33:30.442179+0000","last_active":"2024-04-23T18:33:30.442179+0000","last_peered":"2024-04-23T18:33:30.442179+0000","last_clean":"2024-04-23T18:33:30.442179+0000","last_became_active":"2024-04-23T18:29:21.528917+0000","last_became_peered":"2024-04-23T18:29:21.528917+0000","last_unstale":"2024-04-23T18:33:30.442179+0000","last_undegraded":"2024-04-23T18:33:30.442179+0000","last_fullsized":"2024-04-23T18:33:30.442179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:30.442064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:30.442064+0000","last_clean_scrub_stamp":"2024-04-23T18:33:30.442064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:13.897681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.456298+0000","last_change":"2024-04-23T18:32:55.456298+0000","last_active":"2024-04-23T18:32:55.456298+0000","last_peered":"2024-04-23T18:32:55.456298+0000","last_clean":"2024-04-23T18:32:55.456298+0000","last_became_active":"2024-04-23T18:29:13.499216+0000","last_became_peered":"2024-04-23T18:29:13.499216+0000","last_unstale":"2024-04-23T18:32:55.456298+0000","last_undegraded":"2024-04-23T18:32:55.456298+0000","last_fullsized":"2024-04-23T18:32:55.456298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:55.456182+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:55.456182+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.456182+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:19.038136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:49.450373+0000","last_change":"2024-04-23T18:33:49.450398+0000","last_active":"2024-04-23T18:33:49.450373+0000","last_peered":"2024-04-23T18:33:49.450373+0000","last_clean":"2024-04-23T18:33:49.450373+0000","last_became_active":"2024-04-23T18:29:11.511211+0000","last_became_peered":"2024-04-23T18:29:11.511211+0000","last_unstale":"2024-04-23T18:33:49.450373+0000","last_undegraded":"2024-04-23T18:33:49.450373+0000","last_fullsized":"2024-04-23T18:33:49.450373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:49.450276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:49.450276+0000","last_clean_scrub_stamp":"2024-04-23T18:33:49.450276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:45.449379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.217082+0000","last_change":"2024-04-23T18:32:47.217082+0000","last_active":"2024-04-23T18:32:47.217082+0000","last_peered":"2024-04-23T18:32:47.217082+0000","last_clean":"2024-04-23T18:32:47.217082+0000","last_became_active":"2024-04-23T18:29:15.510350+0000","last_became_peered":"2024-04-23T18:29:15.510350+0000","last_unstale":"2024-04-23T18:32:47.217082+0000","last_undegraded":"2024-04-23T18:32:47.217082+0000","last_fullsized":"2024-04-23T18:32:47.217082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:47.216965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:47.216965+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.216965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:24.954770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'63","reported_seq":137,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.448618+0000","last_change":"2024-04-23T18:32:51.448618+0000","last_active":"2024-04-23T18:32:51.448618+0000","last_peered":"2024-04-23T18:32:51.448618+0000","last_clean":"2024-04-23T18:32:51.448618+0000","last_became_active":"2024-04-23T18:29:17.513298+0000","last_became_peered":"2024-04-23T18:29:17.513298+0000","last_unstale":"2024-04-23T18:32:51.448618+0000","last_undegraded":"2024-04-23T18:32:51.448618+0000","last_fullsized":"2024-04-23T18:32:51.448618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'63","last_scrub_stamp":"2024-04-23T18:32:51.448483+0000","last_deep_scrub":"34'63","last_deep_scrub_stamp":"2024-04-23T18:32:51.448483+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.448483+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:25.305379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.325849+0000","last_change":"2024-04-23T18:32:35.325849+0000","last_active":"2024-04-23T18:32:35.325849+0000","last_peered":"2024-04-23T18:32:35.325849+0000","last_clean":"2024-04-23T18:32:35.325849+0000","last_became_active":"2024-04-23T18:29:19.518015+0000","last_became_peered":"2024-04-23T18:29:19.518015+0000","last_unstale":"2024-04-23T18:32:35.325849+0000","last_undegraded":"2024-04-23T18:32:35.325849+0000","last_fullsized":"2024-04-23T18:32:35.325849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.325670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.325670+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.325670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:51.615968+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'24","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:31.430618+0000","last_change":"2024-04-23T18:33:31.430618+0000","last_active":"2024-04-23T18:33:31.430618+0000","last_peered":"2024-04-23T18:33:31.430618+0000","last_clean":"2024-04-23T18:33:31.430618+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:33:31.430618+0000","last_undegraded":"2024-04-23T18:33:31.430618+0000","last_fullsized":"2024-04-23T18:33:31.430618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-04-23T18:33:31.430489+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-04-23T18:33:31.430489+0000","last_clean_scrub_stamp":"2024-04-23T18:33:31.430489+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:19:24.010938+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:31.696980+0000","last_change":"2024-04-23T18:33:31.696980+0000","last_active":"2024-04-23T18:33:31.696980+0000","last_peered":"2024-04-23T18:33:31.696980+0000","last_clean":"2024-04-23T18:33:31.696980+0000","last_became_active":"2024-04-23T18:29:52.550778+0000","last_became_peered":"2024-04-23T18:29:52.550778+0000","last_unstale":"2024-04-23T18:33:31.696980+0000","last_undegraded":"2024-04-23T18:33:31.696980+0000","last_fullsized":"2024-04-23T18:33:31.696980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:31.696847+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:31.696847+0000","last_clean_scrub_stamp":"2024-04-23T18:33:31.696847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:42.394104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:20.282753+0000","last_change":"2024-04-23T18:33:20.282753+0000","last_active":"2024-04-23T18:33:20.282753+0000","last_peered":"2024-04-23T18:33:20.282753+0000","last_clean":"2024-04-23T18:33:20.282753+0000","last_became_active":"2024-04-23T18:29:11.485899+0000","last_became_peered":"2024-04-23T18:29:11.485899+0000","last_unstale":"2024-04-23T18:33:20.282753+0000","last_undegraded":"2024-04-23T18:33:20.282753+0000","last_fullsized":"2024-04-23T18:33:20.282753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:20.282575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:20.282575+0000","last_clean_scrub_stamp":"2024-04-23T18:33:20.282575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:36:57.269431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.488240+0000","last_change":"2024-04-23T18:32:48.488240+0000","last_active":"2024-04-23T18:32:48.488240+0000","last_peered":"2024-04-23T18:32:48.488240+0000","last_clean":"2024-04-23T18:32:48.488240+0000","last_became_active":"2024-04-23T18:29:15.506940+0000","last_became_peered":"2024-04-23T18:29:15.506940+0000","last_unstale":"2024-04-23T18:32:48.488240+0000","last_undegraded":"2024-04-23T18:32:48.488240+0000","last_fullsized":"2024-04-23T18:32:48.488240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:32:48.488120+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:32:48.488120+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.488120+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:48.524111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.911658+0000","last_change":"2024-04-23T18:32:38.911658+0000","last_active":"2024-04-23T18:32:38.911658+0000","last_peered":"2024-04-23T18:32:38.911658+0000","last_clean":"2024-04-23T18:32:38.911658+0000","last_became_active":"2024-04-23T18:29:17.509586+0000","last_became_peered":"2024-04-23T18:29:17.509586+0000","last_unstale":"2024-04-23T18:32:38.911658+0000","last_undegraded":"2024-04-23T18:32:38.911658+0000","last_fullsized":"2024-04-23T18:32:38.911658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:38.911496+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:38.911496+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.911496+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:46:03.868770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.434051+0000","last_change":"2024-04-23T18:32:53.434051+0000","last_active":"2024-04-23T18:32:53.434051+0000","last_peered":"2024-04-23T18:32:53.434051+0000","last_clean":"2024-04-23T18:32:53.434051+0000","last_became_active":"2024-04-23T18:29:19.521939+0000","last_became_peered":"2024-04-23T18:29:19.521939+0000","last_unstale":"2024-04-23T18:32:53.434051+0000","last_undegraded":"2024-04-23T18:32:53.434051+0000","last_fullsized":"2024-04-23T18:32:53.434051+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:53.433929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:53.433929+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.433929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:02.751340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:23.498478+0000","last_change":"2024-04-23T18:33:23.498510+0000","last_active":"2024-04-23T18:33:23.498478+0000","last_peered":"2024-04-23T18:33:23.498478+0000","last_clean":"2024-04-23T18:33:23.498478+0000","last_became_active":"2024-04-23T18:29:21.530270+0000","last_became_peered":"2024-04-23T18:29:21.530270+0000","last_unstale":"2024-04-23T18:33:23.498478+0000","last_undegraded":"2024-04-23T18:33:23.498478+0000","last_fullsized":"2024-04-23T18:33:23.498478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:23.498381+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:23.498381+0000","last_clean_scrub_stamp":"2024-04-23T18:33:23.498381+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:25.752665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.397470+0000","last_change":"2024-04-23T18:32:46.397470+0000","last_active":"2024-04-23T18:32:46.397470+0000","last_peered":"2024-04-23T18:32:46.397470+0000","last_clean":"2024-04-23T18:32:46.397470+0000","last_became_active":"2024-04-23T18:29:13.501430+0000","last_became_peered":"2024-04-23T18:29:13.501430+0000","last_unstale":"2024-04-23T18:32:46.397470+0000","last_undegraded":"2024-04-23T18:32:46.397470+0000","last_fullsized":"2024-04-23T18:32:46.397470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:46.397327+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:46.397327+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.397327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:08.260300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:33.448137+0000","last_change":"2024-04-23T18:33:33.448164+0000","last_active":"2024-04-23T18:33:33.448137+0000","last_peered":"2024-04-23T18:33:33.448137+0000","last_clean":"2024-04-23T18:33:33.448137+0000","last_became_active":"2024-04-23T18:29:11.507633+0000","last_became_peered":"2024-04-23T18:29:11.507633+0000","last_unstale":"2024-04-23T18:33:33.448137+0000","last_undegraded":"2024-04-23T18:33:33.448137+0000","last_fullsized":"2024-04-23T18:33:33.448137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:33.448049+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:33.448049+0000","last_clean_scrub_stamp":"2024-04-23T18:33:33.448049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:16.681365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.266134+0000","last_change":"2024-04-23T18:32:46.266134+0000","last_active":"2024-04-23T18:32:46.266134+0000","last_peered":"2024-04-23T18:32:46.266134+0000","last_clean":"2024-04-23T18:32:46.266134+0000","last_became_active":"2024-04-23T18:29:15.510579+0000","last_became_peered":"2024-04-23T18:29:15.510579+0000","last_unstale":"2024-04-23T18:32:46.266134+0000","last_undegraded":"2024-04-23T18:32:46.266134+0000","last_fullsized":"2024-04-23T18:32:46.266134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:46.265967+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:46.265967+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.265967+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:25:58.382875+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.452506+0000","last_change":"2024-04-23T18:32:44.452506+0000","last_active":"2024-04-23T18:32:44.452506+0000","last_peered":"2024-04-23T18:32:44.452506+0000","last_clean":"2024-04-23T18:32:44.452506+0000","last_became_active":"2024-04-23T18:29:17.512935+0000","last_became_peered":"2024-04-23T18:29:17.512935+0000","last_unstale":"2024-04-23T18:32:44.452506+0000","last_undegraded":"2024-04-23T18:32:44.452506+0000","last_fullsized":"2024-04-23T18:32:44.452506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-23T18:32:44.452352+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-23T18:32:44.452352+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.452352+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:05.628659+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":444,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.342946+0000","last_change":"2024-04-23T18:32:32.342946+0000","last_active":"2024-04-23T18:32:32.342946+0000","last_peered":"2024-04-23T18:32:32.342946+0000","last_clean":"2024-04-23T18:32:32.342946+0000","last_became_active":"2024-04-23T18:29:19.526260+0000","last_became_peered":"2024-04-23T18:29:19.526260+0000","last_unstale":"2024-04-23T18:32:32.342946+0000","last_undegraded":"2024-04-23T18:32:32.342946+0000","last_fullsized":"2024-04-23T18:32:32.342946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:32.342765+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:32.342765+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.342765+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:52.808626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:27.404270+0000","last_change":"2024-04-23T18:33:27.404270+0000","last_active":"2024-04-23T18:33:27.404270+0000","last_peered":"2024-04-23T18:33:27.404270+0000","last_clean":"2024-04-23T18:33:27.404270+0000","last_became_active":"2024-04-23T18:29:21.527108+0000","last_became_peered":"2024-04-23T18:29:21.527108+0000","last_unstale":"2024-04-23T18:33:27.404270+0000","last_undegraded":"2024-04-23T18:33:27.404270+0000","last_fullsized":"2024-04-23T18:33:27.404270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-04-23T18:33:27.404098+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-04-23T18:33:27.404098+0000","last_clean_scrub_stamp":"2024-04-23T18:33:27.404098+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:24:28.051984+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:19.477996+0000","last_change":"2024-04-23T18:33:19.477996+0000","last_active":"2024-04-23T18:33:19.477996+0000","last_peered":"2024-04-23T18:33:19.477996+0000","last_clean":"2024-04-23T18:33:19.477996+0000","last_became_active":"2024-04-23T18:29:13.504570+0000","last_became_peered":"2024-04-23T18:29:13.504570+0000","last_unstale":"2024-04-23T18:33:19.477996+0000","last_undegraded":"2024-04-23T18:33:19.477996+0000","last_fullsized":"2024-04-23T18:33:19.477996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:19.477867+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:19.477867+0000","last_clean_scrub_stamp":"2024-04-23T18:33:19.477867+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:24:04.002849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:26.536102+0000","last_change":"2024-04-23T18:33:26.536102+0000","last_active":"2024-04-23T18:33:26.536102+0000","last_peered":"2024-04-23T18:33:26.536102+0000","last_clean":"2024-04-23T18:33:26.536102+0000","last_became_active":"2024-04-23T18:29:11.505531+0000","last_became_peered":"2024-04-23T18:29:11.505531+0000","last_unstale":"2024-04-23T18:33:26.536102+0000","last_undegraded":"2024-04-23T18:33:26.536102+0000","last_fullsized":"2024-04-23T18:33:26.536102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:26.535971+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:26.535971+0000","last_clean_scrub_stamp":"2024-04-23T18:33:26.535971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:50:25.840864+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.926526+0000","last_change":"2024-04-23T18:32:49.926526+0000","last_active":"2024-04-23T18:32:49.926526+0000","last_peered":"2024-04-23T18:32:49.926526+0000","last_clean":"2024-04-23T18:32:49.926526+0000","last_became_active":"2024-04-23T18:29:15.505983+0000","last_became_peered":"2024-04-23T18:29:15.505983+0000","last_unstale":"2024-04-23T18:32:49.926526+0000","last_undegraded":"2024-04-23T18:32:49.926526+0000","last_fullsized":"2024-04-23T18:32:49.926526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:32:49.926413+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:32:49.926413+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.926413+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:14.338142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.465286+0000","last_change":"2024-04-23T18:32:39.465286+0000","last_active":"2024-04-23T18:32:39.465286+0000","last_peered":"2024-04-23T18:32:39.465286+0000","last_clean":"2024-04-23T18:32:39.465286+0000","last_became_active":"2024-04-23T18:29:17.513213+0000","last_became_peered":"2024-04-23T18:29:17.513213+0000","last_unstale":"2024-04-23T18:32:39.465286+0000","last_undegraded":"2024-04-23T18:32:39.465286+0000","last_fullsized":"2024-04-23T18:32:39.465286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-23T18:32:39.465155+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-23T18:32:39.465155+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.465155+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:22.245175+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":481,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.880054+0000","last_change":"2024-04-23T18:32:39.880054+0000","last_active":"2024-04-23T18:32:39.880054+0000","last_peered":"2024-04-23T18:32:39.880054+0000","last_clean":"2024-04-23T18:32:39.880054+0000","last_became_active":"2024-04-23T18:29:19.518528+0000","last_became_peered":"2024-04-23T18:29:19.518528+0000","last_unstale":"2024-04-23T18:32:39.880054+0000","last_undegraded":"2024-04-23T18:32:39.880054+0000","last_fullsized":"2024-04-23T18:32:39.880054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:39.879912+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:39.879912+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.879912+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:36.345360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.480613+0000","last_change":"2024-04-23T18:32:49.480613+0000","last_active":"2024-04-23T18:32:49.480613+0000","last_peered":"2024-04-23T18:32:49.480613+0000","last_clean":"2024-04-23T18:32:49.480613+0000","last_became_active":"2024-04-23T18:29:21.530946+0000","last_became_peered":"2024-04-23T18:29:21.530946+0000","last_unstale":"2024-04-23T18:32:49.480613+0000","last_undegraded":"2024-04-23T18:32:49.480613+0000","last_fullsized":"2024-04-23T18:32:49.480613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:49.480502+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:49.480502+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.480502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:18.888990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.873980+0000","last_change":"2024-04-23T18:32:52.873980+0000","last_active":"2024-04-23T18:32:52.873980+0000","last_peered":"2024-04-23T18:32:52.873980+0000","last_clean":"2024-04-23T18:32:52.873980+0000","last_became_active":"2024-04-23T18:29:13.507813+0000","last_became_peered":"2024-04-23T18:29:13.507813+0000","last_unstale":"2024-04-23T18:32:52.873980+0000","last_undegraded":"2024-04-23T18:32:52.873980+0000","last_fullsized":"2024-04-23T18:32:52.873980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:52.873850+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:52.873850+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.873850+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:37:08.666381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:38.474882+0000","last_change":"2024-04-23T18:33:38.474926+0000","last_active":"2024-04-23T18:33:38.474882+0000","last_peered":"2024-04-23T18:33:38.474882+0000","last_clean":"2024-04-23T18:33:38.474882+0000","last_became_active":"2024-04-23T18:29:11.501432+0000","last_became_peered":"2024-04-23T18:29:11.501432+0000","last_unstale":"2024-04-23T18:33:38.474882+0000","last_undegraded":"2024-04-23T18:33:38.474882+0000","last_fullsized":"2024-04-23T18:33:38.474882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:38.474779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:38.474779+0000","last_clean_scrub_stamp":"2024-04-23T18:33:38.474779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:57:20.271284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.427490+0000","last_change":"2024-04-23T18:32:34.427490+0000","last_active":"2024-04-23T18:32:34.427490+0000","last_peered":"2024-04-23T18:32:34.427490+0000","last_clean":"2024-04-23T18:32:34.427490+0000","last_became_active":"2024-04-23T18:29:15.509701+0000","last_became_peered":"2024-04-23T18:29:15.509701+0000","last_unstale":"2024-04-23T18:32:34.427490+0000","last_undegraded":"2024-04-23T18:32:34.427490+0000","last_fullsized":"2024-04-23T18:32:34.427490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:34.427372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:34.427372+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.427372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:27.299606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.866441+0000","last_change":"2024-04-23T18:32:40.866441+0000","last_active":"2024-04-23T18:32:40.866441+0000","last_peered":"2024-04-23T18:32:40.866441+0000","last_clean":"2024-04-23T18:32:40.866441+0000","last_became_active":"2024-04-23T18:29:17.509672+0000","last_became_peered":"2024-04-23T18:29:17.509672+0000","last_unstale":"2024-04-23T18:32:40.866441+0000","last_undegraded":"2024-04-23T18:32:40.866441+0000","last_fullsized":"2024-04-23T18:32:40.866441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:40.866301+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:40.866301+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.866301+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:40.902292+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.357709+0000","last_change":"2024-04-23T18:32:33.357709+0000","last_active":"2024-04-23T18:32:33.357709+0000","last_peered":"2024-04-23T18:32:33.357709+0000","last_clean":"2024-04-23T18:32:33.357709+0000","last_became_active":"2024-04-23T18:29:19.526861+0000","last_became_peered":"2024-04-23T18:29:19.526861+0000","last_unstale":"2024-04-23T18:32:33.357709+0000","last_undegraded":"2024-04-23T18:32:33.357709+0000","last_fullsized":"2024-04-23T18:32:33.357709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.357572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.357572+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.357572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:35:59.244732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.921133+0000","last_change":"2024-04-23T18:32:59.921133+0000","last_active":"2024-04-23T18:32:59.921133+0000","last_peered":"2024-04-23T18:32:59.921133+0000","last_clean":"2024-04-23T18:32:59.921133+0000","last_became_active":"2024-04-23T18:29:21.530612+0000","last_became_peered":"2024-04-23T18:29:21.530612+0000","last_unstale":"2024-04-23T18:32:59.921133+0000","last_undegraded":"2024-04-23T18:32:59.921133+0000","last_fullsized":"2024-04-23T18:32:59.921133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-23T18:32:59.921013+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-23T18:32:59.921013+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.921013+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:38.050899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.476924+0000","last_change":"2024-04-23T18:32:50.476924+0000","last_active":"2024-04-23T18:32:50.476924+0000","last_peered":"2024-04-23T18:32:50.476924+0000","last_clean":"2024-04-23T18:32:50.476924+0000","last_became_active":"2024-04-23T18:29:13.501636+0000","last_became_peered":"2024-04-23T18:29:13.501636+0000","last_unstale":"2024-04-23T18:32:50.476924+0000","last_undegraded":"2024-04-23T18:32:50.476924+0000","last_fullsized":"2024-04-23T18:32:50.476924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:50.476795+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:50.476795+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.476795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:25.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":214,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:17.830353+0000","last_change":"2024-04-23T18:33:17.830409+0000","last_active":"2024-04-23T18:33:17.830353+0000","last_peered":"2024-04-23T18:33:17.830353+0000","last_clean":"2024-04-23T18:33:17.830353+0000","last_became_active":"2024-04-23T18:28:58.798001+0000","last_became_peered":"2024-04-23T18:28:58.798001+0000","last_unstale":"2024-04-23T18:33:17.830353+0000","last_undegraded":"2024-04-23T18:33:17.830353+0000","last_fullsized":"2024-04-23T18:33:17.830353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-04-23T18:33:17.830243+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-04-23T18:33:17.830243+0000","last_clean_scrub_stamp":"2024-04-23T18:33:17.830243+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:27.147654+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:41.554660+0000","last_change":"2024-04-23T18:33:41.554695+0000","last_active":"2024-04-23T18:33:41.554660+0000","last_peered":"2024-04-23T18:33:41.554660+0000","last_clean":"2024-04-23T18:33:41.554660+0000","last_became_active":"2024-04-23T18:29:03.446324+0000","last_became_peered":"2024-04-23T18:29:03.446324+0000","last_unstale":"2024-04-23T18:33:41.554660+0000","last_undegraded":"2024-04-23T18:33:41.554660+0000","last_fullsized":"2024-04-23T18:33:41.554660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:41.554569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:41.554569+0000","last_clean_scrub_stamp":"2024-04-23T18:33:41.554569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:52.749775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:21.454345+0000","last_change":"2024-04-23T18:33:21.454345+0000","last_active":"2024-04-23T18:33:21.454345+0000","last_peered":"2024-04-23T18:33:21.454345+0000","last_clean":"2024-04-23T18:33:21.454345+0000","last_became_active":"2024-04-23T18:29:11.512684+0000","last_became_peered":"2024-04-23T18:29:11.512684+0000","last_unstale":"2024-04-23T18:33:21.454345+0000","last_undegraded":"2024-04-23T18:33:21.454345+0000","last_fullsized":"2024-04-23T18:33:21.454345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:21.454232+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:21.454232+0000","last_clean_scrub_stamp":"2024-04-23T18:33:21.454232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:01.167381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.866824+0000","last_change":"2024-04-23T18:32:46.866824+0000","last_active":"2024-04-23T18:32:46.866824+0000","last_peered":"2024-04-23T18:32:46.866824+0000","last_clean":"2024-04-23T18:32:46.866824+0000","last_became_active":"2024-04-23T18:29:15.509209+0000","last_became_peered":"2024-04-23T18:29:15.509209+0000","last_unstale":"2024-04-23T18:32:46.866824+0000","last_undegraded":"2024-04-23T18:32:46.866824+0000","last_fullsized":"2024-04-23T18:32:46.866824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:46.866699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:46.866699+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.866699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:45.485566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'87","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.423434+0000","last_change":"2024-04-23T18:32:47.423434+0000","last_active":"2024-04-23T18:32:47.423434+0000","last_peered":"2024-04-23T18:32:47.423434+0000","last_clean":"2024-04-23T18:32:47.423434+0000","last_became_active":"2024-04-23T18:29:17.513504+0000","last_became_peered":"2024-04-23T18:29:17.513504+0000","last_unstale":"2024-04-23T18:32:47.423434+0000","last_undegraded":"2024-04-23T18:32:47.423434+0000","last_fullsized":"2024-04-23T18:32:47.423434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-04-23T18:32:47.423269+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-04-23T18:32:47.423269+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.423269+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:31.948251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.310603+0000","last_change":"2024-04-23T18:32:36.310603+0000","last_active":"2024-04-23T18:32:36.310603+0000","last_peered":"2024-04-23T18:32:36.310603+0000","last_clean":"2024-04-23T18:32:36.310603+0000","last_became_active":"2024-04-23T18:29:19.518974+0000","last_became_peered":"2024-04-23T18:29:19.518974+0000","last_unstale":"2024-04-23T18:32:36.310603+0000","last_undegraded":"2024-04-23T18:32:36.310603+0000","last_fullsized":"2024-04-23T18:32:36.310603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.310468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.310468+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.310468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:09:49.509664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":172,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:20.467879+0000","last_change":"2024-04-23T18:33:20.467879+0000","last_active":"2024-04-23T18:33:20.467879+0000","last_peered":"2024-04-23T18:33:20.467879+0000","last_clean":"2024-04-23T18:33:20.467879+0000","last_became_active":"2024-04-23T18:29:21.531725+0000","last_became_peered":"2024-04-23T18:29:21.531725+0000","last_unstale":"2024-04-23T18:33:20.467879+0000","last_undegraded":"2024-04-23T18:33:20.467879+0000","last_fullsized":"2024-04-23T18:33:20.467879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-04-23T18:33:20.467729+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-04-23T18:33:20.467729+0000","last_clean_scrub_stamp":"2024-04-23T18:33:20.467729+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:53.257286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.478908+0000","last_change":"2024-04-23T18:33:09.478908+0000","last_active":"2024-04-23T18:33:09.478908+0000","last_peered":"2024-04-23T18:33:09.478908+0000","last_clean":"2024-04-23T18:33:09.478908+0000","last_became_active":"2024-04-23T18:29:13.497008+0000","last_became_peered":"2024-04-23T18:29:13.497008+0000","last_unstale":"2024-04-23T18:33:09.478908+0000","last_undegraded":"2024-04-23T18:33:09.478908+0000","last_fullsized":"2024-04-23T18:33:09.478908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:09.478793+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:09.478793+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.478793+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:03.219719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:44.503147+0000","last_change":"2024-04-23T18:33:44.503169+0000","last_active":"2024-04-23T18:33:44.503147+0000","last_peered":"2024-04-23T18:33:44.503147+0000","last_clean":"2024-04-23T18:33:44.503147+0000","last_became_active":"2024-04-23T18:29:03.447404+0000","last_became_peered":"2024-04-23T18:29:03.447404+0000","last_unstale":"2024-04-23T18:33:44.503147+0000","last_undegraded":"2024-04-23T18:33:44.503147+0000","last_fullsized":"2024-04-23T18:33:44.503147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:44.503050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:44.503050+0000","last_clean_scrub_stamp":"2024-04-23T18:33:44.503050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:30:56.816204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:22.326866+0000","last_change":"2024-04-23T18:33:22.326866+0000","last_active":"2024-04-23T18:33:22.326866+0000","last_peered":"2024-04-23T18:33:22.326866+0000","last_clean":"2024-04-23T18:33:22.326866+0000","last_became_active":"2024-04-23T18:29:11.486538+0000","last_became_peered":"2024-04-23T18:29:11.486538+0000","last_unstale":"2024-04-23T18:33:22.326866+0000","last_undegraded":"2024-04-23T18:33:22.326866+0000","last_fullsized":"2024-04-23T18:33:22.326866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:22.326686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:22.326686+0000","last_clean_scrub_stamp":"2024-04-23T18:33:22.326686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:11:21.758841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.435765+0000","last_change":"2024-04-23T18:32:40.435765+0000","last_active":"2024-04-23T18:32:40.435765+0000","last_peered":"2024-04-23T18:32:40.435765+0000","last_clean":"2024-04-23T18:32:40.435765+0000","last_became_active":"2024-04-23T18:29:15.508020+0000","last_became_peered":"2024-04-23T18:29:15.508020+0000","last_unstale":"2024-04-23T18:32:40.435765+0000","last_undegraded":"2024-04-23T18:32:40.435765+0000","last_fullsized":"2024-04-23T18:32:40.435765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:40.435654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:40.435654+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.435654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:16.738684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'291","reported_seq":517,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.927476+0000","last_change":"2024-04-23T18:32:36.927476+0000","last_active":"2024-04-23T18:32:36.927476+0000","last_peered":"2024-04-23T18:32:36.927476+0000","last_clean":"2024-04-23T18:32:36.927476+0000","last_became_active":"2024-04-23T18:29:17.515023+0000","last_became_peered":"2024-04-23T18:29:17.515023+0000","last_unstale":"2024-04-23T18:32:36.927476+0000","last_undegraded":"2024-04-23T18:32:36.927476+0000","last_fullsized":"2024-04-23T18:32:36.927476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'291","last_scrub_stamp":"2024-04-23T18:32:36.927295+0000","last_deep_scrub":"34'291","last_deep_scrub_stamp":"2024-04-23T18:32:36.927295+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.927295+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:58.103602+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.428147+0000","last_change":"2024-04-23T18:32:55.428147+0000","last_active":"2024-04-23T18:32:55.428147+0000","last_peered":"2024-04-23T18:32:55.428147+0000","last_clean":"2024-04-23T18:32:55.428147+0000","last_became_active":"2024-04-23T18:29:19.522105+0000","last_became_peered":"2024-04-23T18:29:19.522105+0000","last_unstale":"2024-04-23T18:32:55.428147+0000","last_undegraded":"2024-04-23T18:32:55.428147+0000","last_fullsized":"2024-04-23T18:32:55.428147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:55.428038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:55.428038+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.428038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:30:42.649870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:28.757941+0000","last_change":"2024-04-23T18:33:28.757941+0000","last_active":"2024-04-23T18:33:28.757941+0000","last_peered":"2024-04-23T18:33:28.757941+0000","last_clean":"2024-04-23T18:33:28.757941+0000","last_became_active":"2024-04-23T18:29:21.532867+0000","last_became_peered":"2024-04-23T18:29:21.532867+0000","last_unstale":"2024-04-23T18:33:28.757941+0000","last_undegraded":"2024-04-23T18:33:28.757941+0000","last_fullsized":"2024-04-23T18:33:28.757941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-23T18:33:28.757767+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-23T18:33:28.757767+0000","last_clean_scrub_stamp":"2024-04-23T18:33:28.757767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:37.761007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:16.247567+0000","last_change":"2024-04-23T18:33:16.247567+0000","last_active":"2024-04-23T18:33:16.247567+0000","last_peered":"2024-04-23T18:33:16.247567+0000","last_clean":"2024-04-23T18:33:16.247567+0000","last_became_active":"2024-04-23T18:29:13.499253+0000","last_became_peered":"2024-04-23T18:29:13.499253+0000","last_unstale":"2024-04-23T18:33:16.247567+0000","last_undegraded":"2024-04-23T18:33:16.247567+0000","last_fullsized":"2024-04-23T18:33:16.247567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-23T18:33:16.247440+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-23T18:33:16.247440+0000","last_clean_scrub_stamp":"2024-04-23T18:33:16.247440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:40:13.131062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.337306+0000","last_change":"2024-04-23T18:33:11.337306+0000","last_active":"2024-04-23T18:33:11.337306+0000","last_peered":"2024-04-23T18:33:11.337306+0000","last_clean":"2024-04-23T18:33:11.337306+0000","last_became_active":"2024-04-23T18:29:03.446647+0000","last_became_peered":"2024-04-23T18:29:03.446647+0000","last_unstale":"2024-04-23T18:33:11.337306+0000","last_undegraded":"2024-04-23T18:33:11.337306+0000","last_fullsized":"2024-04-23T18:33:11.337306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:11.337177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:11.337177+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.337177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:54.117197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:17.242431+0000","last_change":"2024-04-23T18:33:17.242458+0000","last_active":"2024-04-23T18:33:17.242431+0000","last_peered":"2024-04-23T18:33:17.242431+0000","last_clean":"2024-04-23T18:33:17.242431+0000","last_became_active":"2024-04-23T18:29:11.491953+0000","last_became_peered":"2024-04-23T18:29:11.491953+0000","last_unstale":"2024-04-23T18:33:17.242431+0000","last_undegraded":"2024-04-23T18:33:17.242431+0000","last_fullsized":"2024-04-23T18:33:17.242431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:17.242339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:17.242339+0000","last_clean_scrub_stamp":"2024-04-23T18:33:17.242339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:01.349691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:26.435087+0000","last_change":"2024-04-23T18:33:26.435087+0000","last_active":"2024-04-23T18:33:26.435087+0000","last_peered":"2024-04-23T18:33:26.435087+0000","last_clean":"2024-04-23T18:33:26.435087+0000","last_became_active":"2024-04-23T18:29:52.551265+0000","last_became_peered":"2024-04-23T18:29:52.551265+0000","last_unstale":"2024-04-23T18:33:26.435087+0000","last_undegraded":"2024-04-23T18:33:26.435087+0000","last_fullsized":"2024-04-23T18:33:26.435087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:26.434912+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:26.434912+0000","last_clean_scrub_stamp":"2024-04-23T18:33:26.434912+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:09.367601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.370172+0000","last_change":"2024-04-23T18:32:42.370172+0000","last_active":"2024-04-23T18:32:42.370172+0000","last_peered":"2024-04-23T18:32:42.370172+0000","last_clean":"2024-04-23T18:32:42.370172+0000","last_became_active":"2024-04-23T18:29:17.513875+0000","last_became_peered":"2024-04-23T18:29:17.513875+0000","last_unstale":"2024-04-23T18:32:42.370172+0000","last_undegraded":"2024-04-23T18:32:42.370172+0000","last_fullsized":"2024-04-23T18:32:42.370172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-23T18:32:42.370053+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-23T18:32:42.370053+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.370053+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:16:11.051682+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:31.497737+0000","last_change":"2024-04-23T18:32:31.497737+0000","last_active":"2024-04-23T18:32:31.497737+0000","last_peered":"2024-04-23T18:32:31.497737+0000","last_clean":"2024-04-23T18:32:31.497737+0000","last_became_active":"2024-04-23T18:29:19.518744+0000","last_became_peered":"2024-04-23T18:29:19.518744+0000","last_unstale":"2024-04-23T18:32:31.497737+0000","last_undegraded":"2024-04-23T18:32:31.497737+0000","last_fullsized":"2024-04-23T18:32:31.497737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:31.497603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:31.497603+0000","last_clean_scrub_stamp":"2024-04-23T18:32:31.497603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:37.446181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.123757+0000","last_change":"2024-04-23T18:29:21.533685+0000","last_active":"2024-04-23T18:32:32.123757+0000","last_peered":"2024-04-23T18:32:32.123757+0000","last_clean":"2024-04-23T18:32:32.123757+0000","last_became_active":"2024-04-23T18:29:21.533358+0000","last_became_peered":"2024-04-23T18:29:21.533358+0000","last_unstale":"2024-04-23T18:32:32.123757+0000","last_undegraded":"2024-04-23T18:32:32.123757+0000","last_fullsized":"2024-04-23T18:32:32.123757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.247736+0000","last_change":"2024-04-23T18:33:02.247736+0000","last_active":"2024-04-23T18:33:02.247736+0000","last_peered":"2024-04-23T18:33:02.247736+0000","last_clean":"2024-04-23T18:33:02.247736+0000","last_became_active":"2024-04-23T18:29:13.493321+0000","last_became_peered":"2024-04-23T18:29:13.493321+0000","last_unstale":"2024-04-23T18:33:02.247736+0000","last_undegraded":"2024-04-23T18:33:02.247736+0000","last_fullsized":"2024-04-23T18:33:02.247736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:02.247619+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:02.247619+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.247619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:16.283269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:42.545642+0000","last_change":"2024-04-23T18:33:42.545667+0000","last_active":"2024-04-23T18:33:42.545642+0000","last_peered":"2024-04-23T18:33:42.545642+0000","last_clean":"2024-04-23T18:33:42.545642+0000","last_became_active":"2024-04-23T18:29:03.446457+0000","last_became_peered":"2024-04-23T18:29:03.446457+0000","last_unstale":"2024-04-23T18:33:42.545642+0000","last_undegraded":"2024-04-23T18:33:42.545642+0000","last_fullsized":"2024-04-23T18:33:42.545642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:42.545537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:42.545537+0000","last_clean_scrub_stamp":"2024-04-23T18:33:42.545537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:41:29.719408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:14.439946+0000","last_change":"2024-04-23T18:33:14.439946+0000","last_active":"2024-04-23T18:33:14.439946+0000","last_peered":"2024-04-23T18:33:14.439946+0000","last_clean":"2024-04-23T18:33:14.439946+0000","last_became_active":"2024-04-23T18:29:11.482896+0000","last_became_peered":"2024-04-23T18:29:11.482896+0000","last_unstale":"2024-04-23T18:33:14.439946+0000","last_undegraded":"2024-04-23T18:33:14.439946+0000","last_fullsized":"2024-04-23T18:33:14.439946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:14.439753+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:14.439753+0000","last_clean_scrub_stamp":"2024-04-23T18:33:14.439753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:02:31.534674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.239612+0000","last_change":"2024-04-23T18:32:53.239612+0000","last_active":"2024-04-23T18:32:53.239612+0000","last_peered":"2024-04-23T18:32:53.239612+0000","last_clean":"2024-04-23T18:32:53.239612+0000","last_became_active":"2024-04-23T18:29:15.507357+0000","last_became_peered":"2024-04-23T18:29:15.507357+0000","last_unstale":"2024-04-23T18:32:53.239612+0000","last_undegraded":"2024-04-23T18:32:53.239612+0000","last_fullsized":"2024-04-23T18:32:53.239612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:53.239511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:53.239511+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.239511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:19:54.363767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.488473+0000","last_change":"2024-04-23T18:33:04.488473+0000","last_active":"2024-04-23T18:33:04.488473+0000","last_peered":"2024-04-23T18:33:04.488473+0000","last_clean":"2024-04-23T18:33:04.488473+0000","last_became_active":"2024-04-23T18:29:17.513393+0000","last_became_peered":"2024-04-23T18:29:17.513393+0000","last_unstale":"2024-04-23T18:33:04.488473+0000","last_undegraded":"2024-04-23T18:33:04.488473+0000","last_fullsized":"2024-04-23T18:33:04.488473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-04-23T18:33:04.488295+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-04-23T18:33:04.488295+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.488295+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:35:28.849946+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.456665+0000","last_change":"2024-04-23T18:33:03.456665+0000","last_active":"2024-04-23T18:33:03.456665+0000","last_peered":"2024-04-23T18:33:03.456665+0000","last_clean":"2024-04-23T18:33:03.456665+0000","last_became_active":"2024-04-23T18:29:19.523070+0000","last_became_peered":"2024-04-23T18:29:19.523070+0000","last_unstale":"2024-04-23T18:33:03.456665+0000","last_undegraded":"2024-04-23T18:33:03.456665+0000","last_fullsized":"2024-04-23T18:33:03.456665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:03.456548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:03.456548+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.456548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:18.440377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.889033+0000","last_change":"2024-04-23T18:32:47.889033+0000","last_active":"2024-04-23T18:32:47.889033+0000","last_peered":"2024-04-23T18:32:47.889033+0000","last_clean":"2024-04-23T18:32:47.889033+0000","last_became_active":"2024-04-23T18:29:21.528764+0000","last_became_peered":"2024-04-23T18:29:21.528764+0000","last_unstale":"2024-04-23T18:32:47.889033+0000","last_undegraded":"2024-04-23T18:32:47.889033+0000","last_fullsized":"2024-04-23T18:32:47.889033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:47.888900+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:47.888900+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.888900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:11.470854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.869141+0000","last_change":"2024-04-23T18:32:54.869141+0000","last_active":"2024-04-23T18:32:54.869141+0000","last_peered":"2024-04-23T18:32:54.869141+0000","last_clean":"2024-04-23T18:32:54.869141+0000","last_became_active":"2024-04-23T18:29:13.507496+0000","last_became_peered":"2024-04-23T18:29:13.507496+0000","last_unstale":"2024-04-23T18:32:54.869141+0000","last_undegraded":"2024-04-23T18:32:54.869141+0000","last_fullsized":"2024-04-23T18:32:54.869141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:32:54.869026+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:32:54.869026+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.869026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:13.533697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:15.480660+0000","last_change":"2024-04-23T18:33:15.480660+0000","last_active":"2024-04-23T18:33:15.480660+0000","last_peered":"2024-04-23T18:33:15.480660+0000","last_clean":"2024-04-23T18:33:15.480660+0000","last_became_active":"2024-04-23T18:29:11.482348+0000","last_became_peered":"2024-04-23T18:29:11.482348+0000","last_unstale":"2024-04-23T18:33:15.480660+0000","last_undegraded":"2024-04-23T18:33:15.480660+0000","last_fullsized":"2024-04-23T18:33:15.480660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:15.480495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:15.480495+0000","last_clean_scrub_stamp":"2024-04-23T18:33:15.480495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.036007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:19.264717+0000","last_change":"2024-04-23T18:33:19.264738+0000","last_active":"2024-04-23T18:33:19.264717+0000","last_peered":"2024-04-23T18:33:19.264717+0000","last_clean":"2024-04-23T18:33:19.264717+0000","last_became_active":"2024-04-23T18:29:03.446286+0000","last_became_peered":"2024-04-23T18:29:03.446286+0000","last_unstale":"2024-04-23T18:33:19.264717+0000","last_undegraded":"2024-04-23T18:33:19.264717+0000","last_fullsized":"2024-04-23T18:33:19.264717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:19.264632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:19.264632+0000","last_clean_scrub_stamp":"2024-04-23T18:33:19.264632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:25:21.621895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:23.502004+0000","last_change":"2024-04-23T18:33:23.502032+0000","last_active":"2024-04-23T18:33:23.502004+0000","last_peered":"2024-04-23T18:33:23.502004+0000","last_clean":"2024-04-23T18:33:23.502004+0000","last_became_active":"2024-04-23T18:29:52.553851+0000","last_became_peered":"2024-04-23T18:29:52.553851+0000","last_unstale":"2024-04-23T18:33:23.502004+0000","last_undegraded":"2024-04-23T18:33:23.502004+0000","last_fullsized":"2024-04-23T18:33:23.502004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:23.501922+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:23.501922+0000","last_clean_scrub_stamp":"2024-04-23T18:33:23.501922+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:57.358817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'73","reported_seq":150,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.321101+0000","last_change":"2024-04-23T18:32:41.321101+0000","last_active":"2024-04-23T18:32:41.321101+0000","last_peered":"2024-04-23T18:32:41.321101+0000","last_clean":"2024-04-23T18:32:41.321101+0000","last_became_active":"2024-04-23T18:29:17.513599+0000","last_became_peered":"2024-04-23T18:29:17.513599+0000","last_unstale":"2024-04-23T18:32:41.321101+0000","last_undegraded":"2024-04-23T18:32:41.321101+0000","last_fullsized":"2024-04-23T18:32:41.321101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'73","last_scrub_stamp":"2024-04-23T18:32:41.320952+0000","last_deep_scrub":"34'73","last_deep_scrub_stamp":"2024-04-23T18:32:41.320952+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.320952+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:13:39.361578+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.404932+0000","last_change":"2024-04-23T18:32:34.404932+0000","last_active":"2024-04-23T18:32:34.404932+0000","last_peered":"2024-04-23T18:32:34.404932+0000","last_clean":"2024-04-23T18:32:34.404932+0000","last_became_active":"2024-04-23T18:29:19.526192+0000","last_became_peered":"2024-04-23T18:29:19.526192+0000","last_unstale":"2024-04-23T18:32:34.404932+0000","last_undegraded":"2024-04-23T18:32:34.404932+0000","last_fullsized":"2024-04-23T18:32:34.404932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:34.404810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:34.404810+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.404810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:37.587320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:33.336008+0000","last_change":"2024-04-23T18:33:33.336035+0000","last_active":"2024-04-23T18:33:33.336008+0000","last_peered":"2024-04-23T18:33:33.336008+0000","last_clean":"2024-04-23T18:33:33.336008+0000","last_became_active":"2024-04-23T18:29:21.533202+0000","last_became_peered":"2024-04-23T18:29:21.533202+0000","last_unstale":"2024-04-23T18:33:33.336008+0000","last_undegraded":"2024-04-23T18:33:33.336008+0000","last_fullsized":"2024-04-23T18:33:33.336008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-04-23T18:33:33.335920+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-04-23T18:33:33.335920+0000","last_clean_scrub_stamp":"2024-04-23T18:33:33.335920+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:48:28.147432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":32,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.935822+0000","last_change":"2024-04-23T18:32:57.935822+0000","last_active":"2024-04-23T18:32:57.935822+0000","last_peered":"2024-04-23T18:32:57.935822+0000","last_clean":"2024-04-23T18:32:57.935822+0000","last_became_active":"2024-04-23T18:29:13.506795+0000","last_became_peered":"2024-04-23T18:29:13.506795+0000","last_unstale":"2024-04-23T18:32:57.935822+0000","last_undegraded":"2024-04-23T18:32:57.935822+0000","last_fullsized":"2024-04-23T18:32:57.935822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:57.935674+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:57.935674+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.935674+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:38.815854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:24.380541+0000","last_change":"2024-04-23T18:33:24.380541+0000","last_active":"2024-04-23T18:33:24.380541+0000","last_peered":"2024-04-23T18:33:24.380541+0000","last_clean":"2024-04-23T18:33:24.380541+0000","last_became_active":"2024-04-23T18:29:11.491882+0000","last_became_peered":"2024-04-23T18:29:11.491882+0000","last_unstale":"2024-04-23T18:33:24.380541+0000","last_undegraded":"2024-04-23T18:33:24.380541+0000","last_fullsized":"2024-04-23T18:33:24.380541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:24.380405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:24.380405+0000","last_clean_scrub_stamp":"2024-04-23T18:33:24.380405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:02:59.746649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:43.520837+0000","last_change":"2024-04-23T18:33:43.520869+0000","last_active":"2024-04-23T18:33:43.520837+0000","last_peered":"2024-04-23T18:33:43.520837+0000","last_clean":"2024-04-23T18:33:43.520837+0000","last_became_active":"2024-04-23T18:29:03.447265+0000","last_became_peered":"2024-04-23T18:29:03.447265+0000","last_unstale":"2024-04-23T18:33:43.520837+0000","last_undegraded":"2024-04-23T18:33:43.520837+0000","last_fullsized":"2024-04-23T18:33:43.520837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:43.520709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:43.520709+0000","last_clean_scrub_stamp":"2024-04-23T18:33:43.520709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:02.689963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.440839+0000","last_change":"2024-04-23T18:32:42.440839+0000","last_active":"2024-04-23T18:32:42.440839+0000","last_peered":"2024-04-23T18:32:42.440839+0000","last_clean":"2024-04-23T18:32:42.440839+0000","last_became_active":"2024-04-23T18:29:15.506394+0000","last_became_peered":"2024-04-23T18:29:15.506394+0000","last_unstale":"2024-04-23T18:32:42.440839+0000","last_undegraded":"2024-04-23T18:32:42.440839+0000","last_fullsized":"2024-04-23T18:32:42.440839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:42.440734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:42.440734+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.440734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:59.535655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.939954+0000","last_change":"2024-04-23T18:32:34.939954+0000","last_active":"2024-04-23T18:32:34.939954+0000","last_peered":"2024-04-23T18:32:34.939954+0000","last_clean":"2024-04-23T18:32:34.939954+0000","last_became_active":"2024-04-23T18:29:17.515048+0000","last_became_peered":"2024-04-23T18:29:17.515048+0000","last_unstale":"2024-04-23T18:32:34.939954+0000","last_undegraded":"2024-04-23T18:32:34.939954+0000","last_fullsized":"2024-04-23T18:32:34.939954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-04-23T18:32:34.939820+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-04-23T18:32:34.939820+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.939820+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:16:03.621449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":382,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.962456+0000","last_change":"2024-04-23T18:32:33.962456+0000","last_active":"2024-04-23T18:32:33.962456+0000","last_peered":"2024-04-23T18:32:33.962456+0000","last_clean":"2024-04-23T18:32:33.962456+0000","last_became_active":"2024-04-23T18:29:19.518668+0000","last_became_peered":"2024-04-23T18:29:19.518668+0000","last_unstale":"2024-04-23T18:32:33.962456+0000","last_undegraded":"2024-04-23T18:32:33.962456+0000","last_fullsized":"2024-04-23T18:32:33.962456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:33.962317+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:33.962317+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.962317+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:24:53.232240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:50.476079+0000","last_change":"2024-04-23T18:33:50.476079+0000","last_active":"2024-04-23T18:33:50.476079+0000","last_peered":"2024-04-23T18:33:50.476079+0000","last_clean":"2024-04-23T18:33:50.476079+0000","last_became_active":"2024-04-23T18:29:21.531185+0000","last_became_peered":"2024-04-23T18:29:21.531185+0000","last_unstale":"2024-04-23T18:33:50.476079+0000","last_undegraded":"2024-04-23T18:33:50.476079+0000","last_fullsized":"2024-04-23T18:33:50.476079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:50.475966+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:50.475966+0000","last_clean_scrub_stamp":"2024-04-23T18:33:50.475966+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:38:40.540587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.354121+0000","last_change":"2024-04-23T18:32:44.354121+0000","last_active":"2024-04-23T18:32:44.354121+0000","last_peered":"2024-04-23T18:32:44.354121+0000","last_clean":"2024-04-23T18:32:44.354121+0000","last_became_active":"2024-04-23T18:29:13.503543+0000","last_became_peered":"2024-04-23T18:29:13.503543+0000","last_unstale":"2024-04-23T18:32:44.354121+0000","last_undegraded":"2024-04-23T18:32:44.354121+0000","last_fullsized":"2024-04-23T18:32:44.354121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:44.353948+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:44.353948+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.353948+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:19.427152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:25.489126+0000","last_change":"2024-04-23T18:33:25.489126+0000","last_active":"2024-04-23T18:33:25.489126+0000","last_peered":"2024-04-23T18:33:25.489126+0000","last_clean":"2024-04-23T18:33:25.489126+0000","last_became_active":"2024-04-23T18:29:11.505604+0000","last_became_peered":"2024-04-23T18:29:11.505604+0000","last_unstale":"2024-04-23T18:33:25.489126+0000","last_undegraded":"2024-04-23T18:33:25.489126+0000","last_fullsized":"2024-04-23T18:33:25.489126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:25.489010+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:25.489010+0000","last_clean_scrub_stamp":"2024-04-23T18:33:25.489010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:02.186513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:18.275506+0000","last_change":"2024-04-23T18:33:18.275506+0000","last_active":"2024-04-23T18:33:18.275506+0000","last_peered":"2024-04-23T18:33:18.275506+0000","last_clean":"2024-04-23T18:33:18.275506+0000","last_became_active":"2024-04-23T18:29:03.445715+0000","last_became_peered":"2024-04-23T18:29:03.445715+0000","last_unstale":"2024-04-23T18:33:18.275506+0000","last_undegraded":"2024-04-23T18:33:18.275506+0000","last_fullsized":"2024-04-23T18:33:18.275506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:18.275380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:18.275380+0000","last_clean_scrub_stamp":"2024-04-23T18:33:18.275380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:49.220282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.423670+0000","last_change":"2024-04-23T18:32:32.423670+0000","last_active":"2024-04-23T18:32:32.423670+0000","last_peered":"2024-04-23T18:32:32.423670+0000","last_clean":"2024-04-23T18:32:32.423670+0000","last_became_active":"2024-04-23T18:29:15.511553+0000","last_became_peered":"2024-04-23T18:29:15.511553+0000","last_unstale":"2024-04-23T18:32:32.423670+0000","last_undegraded":"2024-04-23T18:32:32.423670+0000","last_fullsized":"2024-04-23T18:32:32.423670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.423553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.423553+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.423553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:27:15.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.450404+0000","last_change":"2024-04-23T18:33:01.450404+0000","last_active":"2024-04-23T18:33:01.450404+0000","last_peered":"2024-04-23T18:33:01.450404+0000","last_clean":"2024-04-23T18:33:01.450404+0000","last_became_active":"2024-04-23T18:29:17.515741+0000","last_became_peered":"2024-04-23T18:29:17.515741+0000","last_unstale":"2024-04-23T18:33:01.450404+0000","last_undegraded":"2024-04-23T18:33:01.450404+0000","last_fullsized":"2024-04-23T18:33:01.450404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:33:01.450263+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:33:01.450263+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.450263+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:17:37.262459+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":412,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.172218+0000","last_change":"2024-04-23T18:32:48.172218+0000","last_active":"2024-04-23T18:32:48.172218+0000","last_peered":"2024-04-23T18:32:48.172218+0000","last_clean":"2024-04-23T18:32:48.172218+0000","last_became_active":"2024-04-23T18:29:19.526375+0000","last_became_peered":"2024-04-23T18:29:19.526375+0000","last_unstale":"2024-04-23T18:32:48.172218+0000","last_undegraded":"2024-04-23T18:32:48.172218+0000","last_fullsized":"2024-04-23T18:32:48.172218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:48.172046+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:48.172046+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.172046+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:32:02.059338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:26.749078+0000","last_change":"2024-04-23T18:33:26.749078+0000","last_active":"2024-04-23T18:33:26.749078+0000","last_peered":"2024-04-23T18:33:26.749078+0000","last_clean":"2024-04-23T18:33:26.749078+0000","last_became_active":"2024-04-23T18:29:21.530911+0000","last_became_peered":"2024-04-23T18:29:21.530911+0000","last_unstale":"2024-04-23T18:33:26.749078+0000","last_undegraded":"2024-04-23T18:33:26.749078+0000","last_fullsized":"2024-04-23T18:33:26.749078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:33:26.748927+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:33:26.748927+0000","last_clean_scrub_stamp":"2024-04-23T18:33:26.748927+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:42.708158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'16","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.310357+0000","last_change":"2024-04-23T18:32:59.310357+0000","last_active":"2024-04-23T18:32:59.310357+0000","last_peered":"2024-04-23T18:32:59.310357+0000","last_clean":"2024-04-23T18:32:59.310357+0000","last_became_active":"2024-04-23T18:29:13.499603+0000","last_became_peered":"2024-04-23T18:29:13.499603+0000","last_unstale":"2024-04-23T18:32:59.310357+0000","last_undegraded":"2024-04-23T18:32:59.310357+0000","last_fullsized":"2024-04-23T18:32:59.310357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:32:59.310197+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:32:59.310197+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.310197+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:47.217542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:19.752875+0000","last_change":"2024-04-23T18:33:19.752875+0000","last_active":"2024-04-23T18:33:19.752875+0000","last_peered":"2024-04-23T18:33:19.752875+0000","last_clean":"2024-04-23T18:33:19.752875+0000","last_became_active":"2024-04-23T18:29:11.488500+0000","last_became_peered":"2024-04-23T18:29:11.488500+0000","last_unstale":"2024-04-23T18:33:19.752875+0000","last_undegraded":"2024-04-23T18:33:19.752875+0000","last_fullsized":"2024-04-23T18:33:19.752875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:19.752732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:19.752732+0000","last_clean_scrub_stamp":"2024-04-23T18:33:19.752732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:31:06.974564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:45.504512+0000","last_change":"2024-04-23T18:33:45.504553+0000","last_active":"2024-04-23T18:33:45.504512+0000","last_peered":"2024-04-23T18:33:45.504512+0000","last_clean":"2024-04-23T18:33:45.504512+0000","last_became_active":"2024-04-23T18:29:03.593691+0000","last_became_peered":"2024-04-23T18:29:03.593691+0000","last_unstale":"2024-04-23T18:33:45.504512+0000","last_undegraded":"2024-04-23T18:33:45.504512+0000","last_fullsized":"2024-04-23T18:33:45.504512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:45.504391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:45.504391+0000","last_clean_scrub_stamp":"2024-04-23T18:33:45.504391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:26.914362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.430553+0000","last_change":"2024-04-23T18:32:35.430553+0000","last_active":"2024-04-23T18:32:35.430553+0000","last_peered":"2024-04-23T18:32:35.430553+0000","last_clean":"2024-04-23T18:32:35.430553+0000","last_became_active":"2024-04-23T18:29:15.511207+0000","last_became_peered":"2024-04-23T18:29:15.511207+0000","last_unstale":"2024-04-23T18:32:35.430553+0000","last_undegraded":"2024-04-23T18:32:35.430553+0000","last_fullsized":"2024-04-23T18:32:35.430553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.430424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.430424+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.430424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:13.560310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.411316+0000","last_change":"2024-04-23T18:32:40.411316+0000","last_active":"2024-04-23T18:32:40.411316+0000","last_peered":"2024-04-23T18:32:40.411316+0000","last_clean":"2024-04-23T18:32:40.411316+0000","last_became_active":"2024-04-23T18:29:17.515004+0000","last_became_peered":"2024-04-23T18:29:17.515004+0000","last_unstale":"2024-04-23T18:32:40.411316+0000","last_undegraded":"2024-04-23T18:32:40.411316+0000","last_fullsized":"2024-04-23T18:32:40.411316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-04-23T18:32:40.411192+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-04-23T18:32:40.411192+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.411192+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:44.354254+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.340779+0000","last_change":"2024-04-23T18:32:37.340779+0000","last_active":"2024-04-23T18:32:37.340779+0000","last_peered":"2024-04-23T18:32:37.340779+0000","last_clean":"2024-04-23T18:32:37.340779+0000","last_became_active":"2024-04-23T18:29:19.517903+0000","last_became_peered":"2024-04-23T18:29:19.517903+0000","last_unstale":"2024-04-23T18:32:37.340779+0000","last_undegraded":"2024-04-23T18:32:37.340779+0000","last_fullsized":"2024-04-23T18:32:37.340779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:37.340641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:37.340641+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.340641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:57:08.789904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.486399+0000","last_change":"2024-04-23T18:32:53.486399+0000","last_active":"2024-04-23T18:32:53.486399+0000","last_peered":"2024-04-23T18:32:53.486399+0000","last_clean":"2024-04-23T18:32:53.486399+0000","last_became_active":"2024-04-23T18:29:21.530980+0000","last_became_peered":"2024-04-23T18:29:21.530980+0000","last_unstale":"2024-04-23T18:32:53.486399+0000","last_undegraded":"2024-04-23T18:32:53.486399+0000","last_fullsized":"2024-04-23T18:32:53.486399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:53.486278+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:53.486278+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.486278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:55:15.116741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:22.456065+0000","last_change":"2024-04-23T18:33:22.456065+0000","last_active":"2024-04-23T18:33:22.456065+0000","last_peered":"2024-04-23T18:33:22.456065+0000","last_clean":"2024-04-23T18:33:22.456065+0000","last_became_active":"2024-04-23T18:29:21.534461+0000","last_became_peered":"2024-04-23T18:29:21.534461+0000","last_unstale":"2024-04-23T18:33:22.456065+0000","last_undegraded":"2024-04-23T18:33:22.456065+0000","last_fullsized":"2024-04-23T18:33:22.456065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:22.455900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:22.455900+0000","last_clean_scrub_stamp":"2024-04-23T18:33:22.455900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:57.978414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'10","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.344362+0000","last_change":"2024-04-23T18:33:09.344387+0000","last_active":"2024-04-23T18:33:09.344362+0000","last_peered":"2024-04-23T18:33:09.344362+0000","last_clean":"2024-04-23T18:33:09.344362+0000","last_became_active":"2024-04-23T18:29:13.504092+0000","last_became_peered":"2024-04-23T18:29:13.504092+0000","last_unstale":"2024-04-23T18:33:09.344362+0000","last_undegraded":"2024-04-23T18:33:09.344362+0000","last_fullsized":"2024-04-23T18:33:09.344362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:09.344276+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:09.344276+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.344276+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:41.733579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:35.450284+0000","last_change":"2024-04-23T18:33:35.450284+0000","last_active":"2024-04-23T18:33:35.450284+0000","last_peered":"2024-04-23T18:33:35.450284+0000","last_clean":"2024-04-23T18:33:35.450284+0000","last_became_active":"2024-04-23T18:29:11.510456+0000","last_became_peered":"2024-04-23T18:29:11.510456+0000","last_unstale":"2024-04-23T18:33:35.450284+0000","last_undegraded":"2024-04-23T18:33:35.450284+0000","last_fullsized":"2024-04-23T18:33:35.450284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:35.450161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:35.450161+0000","last_clean_scrub_stamp":"2024-04-23T18:33:35.450161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:35:17.286475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.935480+0000","last_change":"2024-04-23T18:32:48.935502+0000","last_active":"2024-04-23T18:32:48.935480+0000","last_peered":"2024-04-23T18:32:48.935480+0000","last_clean":"2024-04-23T18:32:48.935480+0000","last_became_active":"2024-04-23T18:29:15.506939+0000","last_became_peered":"2024-04-23T18:29:15.506939+0000","last_unstale":"2024-04-23T18:32:48.935480+0000","last_undegraded":"2024-04-23T18:32:48.935480+0000","last_fullsized":"2024-04-23T18:32:48.935480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:48.935390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:48.935390+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.935390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:50:02.096302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.400386+0000","last_change":"2024-04-23T18:32:37.400423+0000","last_active":"2024-04-23T18:32:37.400386+0000","last_peered":"2024-04-23T18:32:37.400386+0000","last_clean":"2024-04-23T18:32:37.400386+0000","last_became_active":"2024-04-23T18:29:17.511559+0000","last_became_peered":"2024-04-23T18:29:17.511559+0000","last_unstale":"2024-04-23T18:32:37.400386+0000","last_undegraded":"2024-04-23T18:32:37.400386+0000","last_fullsized":"2024-04-23T18:32:37.400386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:37.400296+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:37.400296+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.400296+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:51.584214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.480619+0000","last_change":"2024-04-23T18:33:07.480642+0000","last_active":"2024-04-23T18:33:07.480619+0000","last_peered":"2024-04-23T18:33:07.480619+0000","last_clean":"2024-04-23T18:33:07.480619+0000","last_became_active":"2024-04-23T18:29:19.525302+0000","last_became_peered":"2024-04-23T18:29:19.525302+0000","last_unstale":"2024-04-23T18:33:07.480619+0000","last_undegraded":"2024-04-23T18:33:07.480619+0000","last_fullsized":"2024-04-23T18:33:07.480619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:07.480534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:07.480534+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.480534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:35.271244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:32.376352+0000","last_change":"2024-04-23T18:33:32.376382+0000","last_active":"2024-04-23T18:33:32.376352+0000","last_peered":"2024-04-23T18:33:32.376352+0000","last_clean":"2024-04-23T18:33:32.376352+0000","last_became_active":"2024-04-23T18:29:21.530013+0000","last_became_peered":"2024-04-23T18:29:21.530013+0000","last_unstale":"2024-04-23T18:33:32.376352+0000","last_undegraded":"2024-04-23T18:33:32.376352+0000","last_fullsized":"2024-04-23T18:33:32.376352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-23T18:33:32.376252+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-23T18:33:32.376252+0000","last_clean_scrub_stamp":"2024-04-23T18:33:32.376252+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:44.790919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.936742+0000","last_change":"2024-04-23T18:32:58.936777+0000","last_active":"2024-04-23T18:32:58.936742+0000","last_peered":"2024-04-23T18:32:58.936742+0000","last_clean":"2024-04-23T18:32:58.936742+0000","last_became_active":"2024-04-23T18:29:13.506770+0000","last_became_peered":"2024-04-23T18:29:13.506770+0000","last_unstale":"2024-04-23T18:32:58.936742+0000","last_undegraded":"2024-04-23T18:32:58.936742+0000","last_fullsized":"2024-04-23T18:32:58.936742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:58.936659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:58.936659+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.936659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:56.612370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:13.402922+0000","last_change":"2024-04-23T18:33:13.402990+0000","last_active":"2024-04-23T18:33:13.402922+0000","last_peered":"2024-04-23T18:33:13.402922+0000","last_clean":"2024-04-23T18:33:13.402922+0000","last_became_active":"2024-04-23T18:29:11.481884+0000","last_became_peered":"2024-04-23T18:29:11.481884+0000","last_unstale":"2024-04-23T18:33:13.402922+0000","last_undegraded":"2024-04-23T18:33:13.402922+0000","last_fullsized":"2024-04-23T18:33:13.402922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:13.402815+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:13.402815+0000","last_clean_scrub_stamp":"2024-04-23T18:33:13.402815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:11.869076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.416384+0000","last_change":"2024-04-23T18:32:38.416412+0000","last_active":"2024-04-23T18:32:38.416384+0000","last_peered":"2024-04-23T18:32:38.416384+0000","last_clean":"2024-04-23T18:32:38.416384+0000","last_became_active":"2024-04-23T18:29:15.508018+0000","last_became_peered":"2024-04-23T18:29:15.508018+0000","last_unstale":"2024-04-23T18:32:38.416384+0000","last_undegraded":"2024-04-23T18:32:38.416384+0000","last_fullsized":"2024-04-23T18:32:38.416384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:38.416298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:38.416298+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.416298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:11.511574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.373264+0000","last_change":"2024-04-23T18:32:38.373308+0000","last_active":"2024-04-23T18:32:38.373264+0000","last_peered":"2024-04-23T18:32:38.373264+0000","last_clean":"2024-04-23T18:32:38.373264+0000","last_became_active":"2024-04-23T18:29:17.514836+0000","last_became_peered":"2024-04-23T18:29:17.514836+0000","last_unstale":"2024-04-23T18:32:38.373264+0000","last_undegraded":"2024-04-23T18:32:38.373264+0000","last_fullsized":"2024-04-23T18:32:38.373264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:38.373174+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:38.373174+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.373174+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:55.790896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.401686+0000","last_change":"2024-04-23T18:32:37.401709+0000","last_active":"2024-04-23T18:32:37.401686+0000","last_peered":"2024-04-23T18:32:37.401686+0000","last_clean":"2024-04-23T18:32:37.401686+0000","last_became_active":"2024-04-23T18:29:19.527461+0000","last_became_peered":"2024-04-23T18:29:19.527461+0000","last_unstale":"2024-04-23T18:32:37.401686+0000","last_undegraded":"2024-04-23T18:32:37.401686+0000","last_fullsized":"2024-04-23T18:32:37.401686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:37.401597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:37.401597+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.401597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:07:00.685354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:28.429617+0000","last_change":"2024-04-23T18:33:28.429639+0000","last_active":"2024-04-23T18:33:28.429617+0000","last_peered":"2024-04-23T18:33:28.429617+0000","last_clean":"2024-04-23T18:33:28.429617+0000","last_became_active":"2024-04-23T18:29:21.528772+0000","last_became_peered":"2024-04-23T18:29:21.528772+0000","last_unstale":"2024-04-23T18:33:28.429617+0000","last_undegraded":"2024-04-23T18:33:28.429617+0000","last_fullsized":"2024-04-23T18:33:28.429617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:28.429508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:28.429508+0000","last_clean_scrub_stamp":"2024-04-23T18:33:28.429508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:40.019004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.191516+0000","last_change":"2024-04-23T18:32:57.191542+0000","last_active":"2024-04-23T18:32:57.191516+0000","last_peered":"2024-04-23T18:32:57.191516+0000","last_clean":"2024-04-23T18:32:57.191516+0000","last_became_active":"2024-04-23T18:29:13.502849+0000","last_became_peered":"2024-04-23T18:29:13.502849+0000","last_unstale":"2024-04-23T18:32:57.191516+0000","last_undegraded":"2024-04-23T18:32:57.191516+0000","last_fullsized":"2024-04-23T18:32:57.191516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:57.191428+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:57.191428+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.191428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:28.194216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:17.429589+0000","last_change":"2024-04-23T18:33:17.429613+0000","last_active":"2024-04-23T18:33:17.429589+0000","last_peered":"2024-04-23T18:33:17.429589+0000","last_clean":"2024-04-23T18:33:17.429589+0000","last_became_active":"2024-04-23T18:29:11.483628+0000","last_became_peered":"2024-04-23T18:29:11.483628+0000","last_unstale":"2024-04-23T18:33:17.429589+0000","last_undegraded":"2024-04-23T18:33:17.429589+0000","last_fullsized":"2024-04-23T18:33:17.429589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:17.429501+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:17.429501+0000","last_clean_scrub_stamp":"2024-04-23T18:33:17.429501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:11.858318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.524247+0000","last_change":"2024-04-23T18:32:47.524270+0000","last_active":"2024-04-23T18:32:47.524247+0000","last_peered":"2024-04-23T18:32:47.524247+0000","last_clean":"2024-04-23T18:32:47.524247+0000","last_became_active":"2024-04-23T18:29:15.510130+0000","last_became_peered":"2024-04-23T18:29:15.510130+0000","last_unstale":"2024-04-23T18:32:47.524247+0000","last_undegraded":"2024-04-23T18:32:47.524247+0000","last_fullsized":"2024-04-23T18:32:47.524247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:47.524159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:47.524159+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.524159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:43.989607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.296594+0000","last_change":"2024-04-23T18:32:43.296633+0000","last_active":"2024-04-23T18:32:43.296594+0000","last_peered":"2024-04-23T18:32:43.296594+0000","last_clean":"2024-04-23T18:32:43.296594+0000","last_became_active":"2024-04-23T18:29:17.510429+0000","last_became_peered":"2024-04-23T18:29:17.510429+0000","last_unstale":"2024-04-23T18:32:43.296594+0000","last_undegraded":"2024-04-23T18:32:43.296594+0000","last_fullsized":"2024-04-23T18:32:43.296594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:43.296501+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:43.296501+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.296501+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:18.685380+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.936215+0000","last_change":"2024-04-23T18:32:32.936254+0000","last_active":"2024-04-23T18:32:32.936215+0000","last_peered":"2024-04-23T18:32:32.936215+0000","last_clean":"2024-04-23T18:32:32.936215+0000","last_became_active":"2024-04-23T18:29:19.518543+0000","last_became_peered":"2024-04-23T18:29:19.518543+0000","last_unstale":"2024-04-23T18:32:32.936215+0000","last_undegraded":"2024-04-23T18:32:32.936215+0000","last_fullsized":"2024-04-23T18:32:32.936215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.936101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.936101+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.936101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:36.879163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:51.764880+0000","last_change":"2024-04-23T18:29:21.534350+0000","last_active":"2024-04-23T18:31:51.764880+0000","last_peered":"2024-04-23T18:31:51.764880+0000","last_clean":"2024-04-23T18:31:51.764880+0000","last_became_active":"2024-04-23T18:29:21.534023+0000","last_became_peered":"2024-04-23T18:29:21.534023+0000","last_unstale":"2024-04-23T18:31:51.764880+0000","last_undegraded":"2024-04-23T18:31:51.764880+0000","last_fullsized":"2024-04-23T18:31:51.764880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'20","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.520369+0000","last_change":"2024-04-23T18:33:06.520421+0000","last_active":"2024-04-23T18:33:06.520369+0000","last_peered":"2024-04-23T18:33:06.520369+0000","last_clean":"2024-04-23T18:33:06.520369+0000","last_became_active":"2024-04-23T18:29:13.500877+0000","last_became_peered":"2024-04-23T18:29:13.500877+0000","last_unstale":"2024-04-23T18:33:06.520369+0000","last_undegraded":"2024-04-23T18:33:06.520369+0000","last_fullsized":"2024-04-23T18:33:06.520369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-04-23T18:33:06.520272+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-04-23T18:33:06.520272+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.520272+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:51.378293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":53,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:23.728121+0000","last_change":"2024-04-23T18:33:23.728149+0000","last_active":"2024-04-23T18:33:23.728121+0000","last_peered":"2024-04-23T18:33:23.728121+0000","last_clean":"2024-04-23T18:33:23.728121+0000","last_became_active":"2024-04-23T18:29:11.497953+0000","last_became_peered":"2024-04-23T18:29:11.497953+0000","last_unstale":"2024-04-23T18:33:23.728121+0000","last_undegraded":"2024-04-23T18:33:23.728121+0000","last_fullsized":"2024-04-23T18:33:23.728121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:23.728030+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:23.728030+0000","last_clean_scrub_stamp":"2024-04-23T18:33:23.728030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:58.233173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.458609+0000","last_change":"2024-04-23T18:32:41.458630+0000","last_active":"2024-04-23T18:32:41.458609+0000","last_peered":"2024-04-23T18:32:41.458609+0000","last_clean":"2024-04-23T18:32:41.458609+0000","last_became_active":"2024-04-23T18:29:15.507253+0000","last_became_peered":"2024-04-23T18:29:15.507253+0000","last_unstale":"2024-04-23T18:32:41.458609+0000","last_undegraded":"2024-04-23T18:32:41.458609+0000","last_fullsized":"2024-04-23T18:32:41.458609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:41.458516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:41.458516+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.458516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:55:39.924778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.406718+0000","last_change":"2024-04-23T18:32:43.406751+0000","last_active":"2024-04-23T18:32:43.406718+0000","last_peered":"2024-04-23T18:32:43.406718+0000","last_clean":"2024-04-23T18:32:43.406718+0000","last_became_active":"2024-04-23T18:29:17.512820+0000","last_became_peered":"2024-04-23T18:29:17.512820+0000","last_unstale":"2024-04-23T18:32:43.406718+0000","last_undegraded":"2024-04-23T18:32:43.406718+0000","last_fullsized":"2024-04-23T18:32:43.406718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:43.406635+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:43.406635+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.406635+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:40.517887+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.355989+0000","last_change":"2024-04-23T18:32:35.356012+0000","last_active":"2024-04-23T18:32:35.355989+0000","last_peered":"2024-04-23T18:32:35.355989+0000","last_clean":"2024-04-23T18:32:35.355989+0000","last_became_active":"2024-04-23T18:29:19.525424+0000","last_became_peered":"2024-04-23T18:29:19.525424+0000","last_unstale":"2024-04-23T18:32:35.355989+0000","last_undegraded":"2024-04-23T18:32:35.355989+0000","last_fullsized":"2024-04-23T18:32:35.355989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.355896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.355896+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.355896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:58:38.926439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:12.456113+0000","last_change":"2024-04-23T18:33:12.456113+0000","last_active":"2024-04-23T18:33:12.456113+0000","last_peered":"2024-04-23T18:33:12.456113+0000","last_clean":"2024-04-23T18:33:12.456113+0000","last_became_active":"2024-04-23T18:29:13.496179+0000","last_became_peered":"2024-04-23T18:29:13.496179+0000","last_unstale":"2024-04-23T18:33:12.456113+0000","last_undegraded":"2024-04-23T18:33:12.456113+0000","last_fullsized":"2024-04-23T18:33:12.456113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:12.455993+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:12.455993+0000","last_clean_scrub_stamp":"2024-04-23T18:33:12.455993+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:55:29.273245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:40.511569+0000","last_change":"2024-04-23T18:33:40.511613+0000","last_active":"2024-04-23T18:33:40.511569+0000","last_peered":"2024-04-23T18:33:40.511569+0000","last_clean":"2024-04-23T18:33:40.511569+0000","last_became_active":"2024-04-23T18:29:11.500118+0000","last_became_peered":"2024-04-23T18:29:11.500118+0000","last_unstale":"2024-04-23T18:33:40.511569+0000","last_undegraded":"2024-04-23T18:33:40.511569+0000","last_fullsized":"2024-04-23T18:33:40.511569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:40.511447+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:40.511447+0000","last_clean_scrub_stamp":"2024-04-23T18:33:40.511447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:47.976464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.230060+0000","last_change":"2024-04-23T18:32:54.230060+0000","last_active":"2024-04-23T18:32:54.230060+0000","last_peered":"2024-04-23T18:32:54.230060+0000","last_clean":"2024-04-23T18:32:54.230060+0000","last_became_active":"2024-04-23T18:29:15.506197+0000","last_became_peered":"2024-04-23T18:29:15.506197+0000","last_unstale":"2024-04-23T18:32:54.230060+0000","last_undegraded":"2024-04-23T18:32:54.230060+0000","last_fullsized":"2024-04-23T18:32:54.230060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:54.229932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:54.229932+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.229932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:45:57.110850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'66","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.328809+0000","last_change":"2024-04-23T18:32:39.328853+0000","last_active":"2024-04-23T18:32:39.328809+0000","last_peered":"2024-04-23T18:32:39.328809+0000","last_clean":"2024-04-23T18:32:39.328809+0000","last_became_active":"2024-04-23T18:29:17.514800+0000","last_became_peered":"2024-04-23T18:29:17.514800+0000","last_unstale":"2024-04-23T18:32:39.328809+0000","last_undegraded":"2024-04-23T18:32:39.328809+0000","last_fullsized":"2024-04-23T18:32:39.328809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-04-23T18:32:39.328706+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-04-23T18:32:39.328706+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.328706+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:44:56.598841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.370215+0000","last_change":"2024-04-23T18:32:36.370241+0000","last_active":"2024-04-23T18:32:36.370215+0000","last_peered":"2024-04-23T18:32:36.370215+0000","last_clean":"2024-04-23T18:32:36.370215+0000","last_became_active":"2024-04-23T18:29:19.524351+0000","last_became_peered":"2024-04-23T18:29:19.524351+0000","last_unstale":"2024-04-23T18:32:36.370215+0000","last_undegraded":"2024-04-23T18:32:36.370215+0000","last_fullsized":"2024-04-23T18:32:36.370215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.370129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.370129+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.370129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:58.907049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:29.460212+0000","last_change":"2024-04-23T18:33:29.460238+0000","last_active":"2024-04-23T18:33:29.460212+0000","last_peered":"2024-04-23T18:33:29.460212+0000","last_clean":"2024-04-23T18:33:29.460212+0000","last_became_active":"2024-04-23T18:29:21.528819+0000","last_became_peered":"2024-04-23T18:29:21.528819+0000","last_unstale":"2024-04-23T18:33:29.460212+0000","last_undegraded":"2024-04-23T18:33:29.460212+0000","last_fullsized":"2024-04-23T18:33:29.460212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-23T18:33:29.460103+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-23T18:33:29.460103+0000","last_clean_scrub_stamp":"2024-04-23T18:33:29.460103+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:13:37.061397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:12.313127+0000","last_change":"2024-04-23T18:33:12.313127+0000","last_active":"2024-04-23T18:33:12.313127+0000","last_peered":"2024-04-23T18:33:12.313127+0000","last_clean":"2024-04-23T18:33:12.313127+0000","last_became_active":"2024-04-23T18:29:13.499137+0000","last_became_peered":"2024-04-23T18:29:13.499137+0000","last_unstale":"2024-04-23T18:33:12.313127+0000","last_undegraded":"2024-04-23T18:33:12.313127+0000","last_fullsized":"2024-04-23T18:33:12.313127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:12.313012+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:12.313012+0000","last_clean_scrub_stamp":"2024-04-23T18:33:12.313012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:20:11.318686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:14.855537+0000","last_change":"2024-04-23T18:33:14.855562+0000","last_active":"2024-04-23T18:33:14.855537+0000","last_peered":"2024-04-23T18:33:14.855537+0000","last_clean":"2024-04-23T18:33:14.855537+0000","last_became_active":"2024-04-23T18:29:11.500584+0000","last_became_peered":"2024-04-23T18:29:11.500584+0000","last_unstale":"2024-04-23T18:33:14.855537+0000","last_undegraded":"2024-04-23T18:33:14.855537+0000","last_fullsized":"2024-04-23T18:33:14.855537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:14.855437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:14.855437+0000","last_clean_scrub_stamp":"2024-04-23T18:33:14.855437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:50.377951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.494521+0000","last_change":"2024-04-23T18:32:51.494521+0000","last_active":"2024-04-23T18:32:51.494521+0000","last_peered":"2024-04-23T18:32:51.494521+0000","last_clean":"2024-04-23T18:32:51.494521+0000","last_became_active":"2024-04-23T18:29:15.503315+0000","last_became_peered":"2024-04-23T18:29:15.503315+0000","last_unstale":"2024-04-23T18:32:51.494521+0000","last_undegraded":"2024-04-23T18:32:51.494521+0000","last_fullsized":"2024-04-23T18:32:51.494521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:51.494354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:51.494354+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.494354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:13.705269+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.449417+0000","last_change":"2024-04-23T18:33:00.449461+0000","last_active":"2024-04-23T18:33:00.449417+0000","last_peered":"2024-04-23T18:33:00.449417+0000","last_clean":"2024-04-23T18:33:00.449417+0000","last_became_active":"2024-04-23T18:29:17.516934+0000","last_became_peered":"2024-04-23T18:29:17.516934+0000","last_unstale":"2024-04-23T18:33:00.449417+0000","last_undegraded":"2024-04-23T18:33:00.449417+0000","last_fullsized":"2024-04-23T18:33:00.449417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-23T18:33:00.449324+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-23T18:33:00.449324+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.449324+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:16.722855+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:31.933324+0000","last_change":"2024-04-23T18:32:31.933350+0000","last_active":"2024-04-23T18:32:31.933324+0000","last_peered":"2024-04-23T18:32:31.933324+0000","last_clean":"2024-04-23T18:32:31.933324+0000","last_became_active":"2024-04-23T18:29:19.519854+0000","last_became_peered":"2024-04-23T18:29:19.519854+0000","last_unstale":"2024-04-23T18:32:31.933324+0000","last_undegraded":"2024-04-23T18:32:31.933324+0000","last_fullsized":"2024-04-23T18:32:31.933324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:31.933225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:31.933225+0000","last_clean_scrub_stamp":"2024-04-23T18:32:31.933225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:09.747281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763296+0000","last_change":"2024-04-23T18:29:21.534768+0000","last_active":"2024-04-23T18:31:41.763296+0000","last_peered":"2024-04-23T18:31:41.763296+0000","last_clean":"2024-04-23T18:31:41.763296+0000","last_became_active":"2024-04-23T18:29:21.534487+0000","last_became_peered":"2024-04-23T18:29:21.534487+0000","last_unstale":"2024-04-23T18:31:41.763296+0000","last_undegraded":"2024-04-23T18:31:41.763296+0000","last_fullsized":"2024-04-23T18:31:41.763296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.425530+0000","last_change":"2024-04-23T18:32:48.425557+0000","last_active":"2024-04-23T18:32:48.425530+0000","last_peered":"2024-04-23T18:32:48.425530+0000","last_clean":"2024-04-23T18:32:48.425530+0000","last_became_active":"2024-04-23T18:29:13.502710+0000","last_became_peered":"2024-04-23T18:29:13.502710+0000","last_unstale":"2024-04-23T18:32:48.425530+0000","last_undegraded":"2024-04-23T18:32:48.425530+0000","last_fullsized":"2024-04-23T18:32:48.425530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:48.425438+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:48.425438+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.425438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:21.214995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:24.712813+0000","last_change":"2024-04-23T18:33:24.712858+0000","last_active":"2024-04-23T18:33:24.712813+0000","last_peered":"2024-04-23T18:33:24.712813+0000","last_clean":"2024-04-23T18:33:24.712813+0000","last_became_active":"2024-04-23T18:29:11.497191+0000","last_became_peered":"2024-04-23T18:29:11.497191+0000","last_unstale":"2024-04-23T18:33:24.712813+0000","last_undegraded":"2024-04-23T18:33:24.712813+0000","last_fullsized":"2024-04-23T18:33:24.712813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:24.712698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:24.712698+0000","last_clean_scrub_stamp":"2024-04-23T18:33:24.712698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:40.986230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.464891+0000","last_change":"2024-04-23T18:32:52.464923+0000","last_active":"2024-04-23T18:32:52.464891+0000","last_peered":"2024-04-23T18:32:52.464891+0000","last_clean":"2024-04-23T18:32:52.464891+0000","last_became_active":"2024-04-23T18:29:15.501957+0000","last_became_peered":"2024-04-23T18:29:15.501957+0000","last_unstale":"2024-04-23T18:32:52.464891+0000","last_undegraded":"2024-04-23T18:32:52.464891+0000","last_fullsized":"2024-04-23T18:32:52.464891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:52.464769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:52.464769+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.464769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:12.012567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.245695+0000","last_change":"2024-04-23T18:32:45.245695+0000","last_active":"2024-04-23T18:32:45.245695+0000","last_peered":"2024-04-23T18:32:45.245695+0000","last_clean":"2024-04-23T18:32:45.245695+0000","last_became_active":"2024-04-23T18:29:17.503196+0000","last_became_peered":"2024-04-23T18:29:17.503196+0000","last_unstale":"2024-04-23T18:32:45.245695+0000","last_undegraded":"2024-04-23T18:32:45.245695+0000","last_fullsized":"2024-04-23T18:32:45.245695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:45.245551+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:45.245551+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.245551+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:00.152459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.211198+0000","last_change":"2024-04-23T18:32:56.211198+0000","last_active":"2024-04-23T18:32:56.211198+0000","last_peered":"2024-04-23T18:32:56.211198+0000","last_clean":"2024-04-23T18:32:56.211198+0000","last_became_active":"2024-04-23T18:29:19.527687+0000","last_became_peered":"2024-04-23T18:29:19.527687+0000","last_unstale":"2024-04-23T18:32:56.211198+0000","last_undegraded":"2024-04-23T18:32:56.211198+0000","last_fullsized":"2024-04-23T18:32:56.211198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:56.211082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:56.211082+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.211082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:29.050437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:41.763279+0000","last_change":"2024-04-23T18:29:21.534054+0000","last_active":"2024-04-23T18:31:41.763279+0000","last_peered":"2024-04-23T18:31:41.763279+0000","last_clean":"2024-04-23T18:31:41.763279+0000","last_became_active":"2024-04-23T18:29:21.533754+0000","last_became_peered":"2024-04-23T18:29:21.533754+0000","last_unstale":"2024-04-23T18:31:41.763279+0000","last_undegraded":"2024-04-23T18:31:41.763279+0000","last_fullsized":"2024-04-23T18:31:41.763279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.271342+0000","last_change":"2024-04-23T18:33:10.271368+0000","last_active":"2024-04-23T18:33:10.271342+0000","last_peered":"2024-04-23T18:33:10.271342+0000","last_clean":"2024-04-23T18:33:10.271342+0000","last_became_active":"2024-04-23T18:29:13.497121+0000","last_became_peered":"2024-04-23T18:29:13.497121+0000","last_unstale":"2024-04-23T18:33:10.271342+0000","last_undegraded":"2024-04-23T18:33:10.271342+0000","last_fullsized":"2024-04-23T18:33:10.271342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-23T18:33:10.271244+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-23T18:33:10.271244+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.271244+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:45.140086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:30.472246+0000","last_change":"2024-04-23T18:33:30.472292+0000","last_active":"2024-04-23T18:33:30.472246+0000","last_peered":"2024-04-23T18:33:30.472246+0000","last_clean":"2024-04-23T18:33:30.472246+0000","last_became_active":"2024-04-23T18:29:11.504564+0000","last_became_peered":"2024-04-23T18:29:11.504564+0000","last_unstale":"2024-04-23T18:33:30.472246+0000","last_undegraded":"2024-04-23T18:33:30.472246+0000","last_fullsized":"2024-04-23T18:33:30.472246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:30.472113+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:30.472113+0000","last_clean_scrub_stamp":"2024-04-23T18:33:30.472113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:08:02.467495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.918227+0000","last_change":"2024-04-23T18:32:50.918254+0000","last_active":"2024-04-23T18:32:50.918227+0000","last_peered":"2024-04-23T18:32:50.918227+0000","last_clean":"2024-04-23T18:32:50.918227+0000","last_became_active":"2024-04-23T18:29:15.506171+0000","last_became_peered":"2024-04-23T18:29:15.506171+0000","last_unstale":"2024-04-23T18:32:50.918227+0000","last_undegraded":"2024-04-23T18:32:50.918227+0000","last_fullsized":"2024-04-23T18:32:50.918227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.918119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.918119+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.918119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:12.800419+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.419573+0000","last_change":"2024-04-23T18:32:57.419573+0000","last_active":"2024-04-23T18:32:57.419573+0000","last_peered":"2024-04-23T18:32:57.419573+0000","last_clean":"2024-04-23T18:32:57.419573+0000","last_became_active":"2024-04-23T18:29:17.517051+0000","last_became_peered":"2024-04-23T18:29:17.517051+0000","last_unstale":"2024-04-23T18:32:57.419573+0000","last_undegraded":"2024-04-23T18:32:57.419573+0000","last_fullsized":"2024-04-23T18:32:57.419573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-23T18:32:57.419450+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-23T18:32:57.419450+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.419450+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:03.100050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":379,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.362652+0000","last_change":"2024-04-23T18:32:41.362652+0000","last_active":"2024-04-23T18:32:41.362652+0000","last_peered":"2024-04-23T18:32:41.362652+0000","last_clean":"2024-04-23T18:32:41.362652+0000","last_became_active":"2024-04-23T18:29:19.527614+0000","last_became_peered":"2024-04-23T18:29:19.527614+0000","last_unstale":"2024-04-23T18:32:41.362652+0000","last_undegraded":"2024-04-23T18:32:41.362652+0000","last_fullsized":"2024-04-23T18:32:41.362652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:41.362491+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:41.362491+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.362491+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:25:00.632414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:51.478321+0000","last_change":"2024-04-23T18:33:51.478350+0000","last_active":"2024-04-23T18:33:51.478321+0000","last_peered":"2024-04-23T18:33:51.478321+0000","last_clean":"2024-04-23T18:33:51.478321+0000","last_became_active":"2024-04-23T18:29:21.530619+0000","last_became_peered":"2024-04-23T18:29:21.530619+0000","last_unstale":"2024-04-23T18:33:51.478321+0000","last_undegraded":"2024-04-23T18:33:51.478321+0000","last_fullsized":"2024-04-23T18:33:51.478321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:51.478214+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:51.478214+0000","last_clean_scrub_stamp":"2024-04-23T18:33:51.478214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:33.921006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.394288+0000","last_change":"2024-04-23T18:33:03.394334+0000","last_active":"2024-04-23T18:33:03.394288+0000","last_peered":"2024-04-23T18:33:03.394288+0000","last_clean":"2024-04-23T18:33:03.394288+0000","last_became_active":"2024-04-23T18:29:13.501741+0000","last_became_peered":"2024-04-23T18:29:13.501741+0000","last_unstale":"2024-04-23T18:33:03.394288+0000","last_undegraded":"2024-04-23T18:33:03.394288+0000","last_fullsized":"2024-04-23T18:33:03.394288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:03.394147+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:03.394147+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.394147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:25.573714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:12.923491+0000","last_change":"2024-04-23T18:33:12.923516+0000","last_active":"2024-04-23T18:33:12.923491+0000","last_peered":"2024-04-23T18:33:12.923491+0000","last_clean":"2024-04-23T18:33:12.923491+0000","last_became_active":"2024-04-23T18:29:11.500781+0000","last_became_peered":"2024-04-23T18:29:11.500781+0000","last_unstale":"2024-04-23T18:33:12.923491+0000","last_undegraded":"2024-04-23T18:33:12.923491+0000","last_fullsized":"2024-04-23T18:33:12.923491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:12.923402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:12.923402+0000","last_clean_scrub_stamp":"2024-04-23T18:33:12.923402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:45.712959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:30.729921+0000","last_change":"2024-04-23T18:33:30.729968+0000","last_active":"2024-04-23T18:33:30.729921+0000","last_peered":"2024-04-23T18:33:30.729921+0000","last_clean":"2024-04-23T18:33:30.729921+0000","last_became_active":"2024-04-23T18:29:52.549944+0000","last_became_peered":"2024-04-23T18:29:52.549944+0000","last_unstale":"2024-04-23T18:33:30.729921+0000","last_undegraded":"2024-04-23T18:33:30.729921+0000","last_fullsized":"2024-04-23T18:33:30.729921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:30.729833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:30.729833+0000","last_clean_scrub_stamp":"2024-04-23T18:33:30.729833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:52.671500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.837445+0000","last_change":"2024-04-23T18:32:41.837483+0000","last_active":"2024-04-23T18:32:41.837445+0000","last_peered":"2024-04-23T18:32:41.837445+0000","last_clean":"2024-04-23T18:32:41.837445+0000","last_became_active":"2024-04-23T18:29:17.509076+0000","last_became_peered":"2024-04-23T18:29:17.509076+0000","last_unstale":"2024-04-23T18:32:41.837445+0000","last_undegraded":"2024-04-23T18:32:41.837445+0000","last_fullsized":"2024-04-23T18:32:41.837445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-23T18:32:41.837343+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-23T18:32:41.837343+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.837343+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:11.245831+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.466736+0000","last_change":"2024-04-23T18:32:32.466759+0000","last_active":"2024-04-23T18:32:32.466736+0000","last_peered":"2024-04-23T18:32:32.466736+0000","last_clean":"2024-04-23T18:32:32.466736+0000","last_became_active":"2024-04-23T18:29:19.518673+0000","last_became_peered":"2024-04-23T18:29:19.518673+0000","last_unstale":"2024-04-23T18:32:32.466736+0000","last_undegraded":"2024-04-23T18:32:32.466736+0000","last_fullsized":"2024-04-23T18:32:32.466736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.466649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.466649+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.466649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:22:40.471567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:29.749979+0000","last_change":"2024-04-23T18:33:29.750004+0000","last_active":"2024-04-23T18:33:29.749979+0000","last_peered":"2024-04-23T18:33:29.749979+0000","last_clean":"2024-04-23T18:33:29.749979+0000","last_became_active":"2024-04-23T18:29:21.533187+0000","last_became_peered":"2024-04-23T18:29:21.533187+0000","last_unstale":"2024-04-23T18:33:29.749979+0000","last_undegraded":"2024-04-23T18:33:29.749979+0000","last_fullsized":"2024-04-23T18:33:29.749979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:29.749876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:29.749876+0000","last_clean_scrub_stamp":"2024-04-23T18:33:29.749876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:01:05.290487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.441100+0000","last_change":"2024-04-23T18:33:05.441126+0000","last_active":"2024-04-23T18:33:05.441100+0000","last_peered":"2024-04-23T18:33:05.441100+0000","last_clean":"2024-04-23T18:33:05.441100+0000","last_became_active":"2024-04-23T18:29:13.501974+0000","last_became_peered":"2024-04-23T18:29:13.501974+0000","last_unstale":"2024-04-23T18:33:05.441100+0000","last_undegraded":"2024-04-23T18:33:05.441100+0000","last_fullsized":"2024-04-23T18:33:05.441100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:05.441015+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:05.441015+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.441015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:46.321194+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:24.451832+0000","last_change":"2024-04-23T18:33:24.451860+0000","last_active":"2024-04-23T18:33:24.451832+0000","last_peered":"2024-04-23T18:33:24.451832+0000","last_clean":"2024-04-23T18:33:24.451832+0000","last_became_active":"2024-04-23T18:29:11.511297+0000","last_became_peered":"2024-04-23T18:29:11.511297+0000","last_unstale":"2024-04-23T18:33:24.451832+0000","last_undegraded":"2024-04-23T18:33:24.451832+0000","last_fullsized":"2024-04-23T18:33:24.451832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:24.451739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:24.451739+0000","last_clean_scrub_stamp":"2024-04-23T18:33:24.451739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:02.322238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.503698+0000","last_change":"2024-04-23T18:32:50.503761+0000","last_active":"2024-04-23T18:32:50.503698+0000","last_peered":"2024-04-23T18:32:50.503698+0000","last_clean":"2024-04-23T18:32:50.503698+0000","last_became_active":"2024-04-23T18:29:15.504528+0000","last_became_peered":"2024-04-23T18:29:15.504528+0000","last_unstale":"2024-04-23T18:32:50.503698+0000","last_undegraded":"2024-04-23T18:32:50.503698+0000","last_fullsized":"2024-04-23T18:32:50.503698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.503597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.503597+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.503597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:20:31.588182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.345447+0000","last_change":"2024-04-23T18:32:42.345524+0000","last_active":"2024-04-23T18:32:42.345447+0000","last_peered":"2024-04-23T18:32:42.345447+0000","last_clean":"2024-04-23T18:32:42.345447+0000","last_became_active":"2024-04-23T18:29:17.513482+0000","last_became_peered":"2024-04-23T18:29:17.513482+0000","last_unstale":"2024-04-23T18:32:42.345447+0000","last_undegraded":"2024-04-23T18:32:42.345447+0000","last_fullsized":"2024-04-23T18:32:42.345447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:42.345340+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:42.345340+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.345340+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:11.159885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.418774+0000","last_change":"2024-04-23T18:33:11.418829+0000","last_active":"2024-04-23T18:33:11.418774+0000","last_peered":"2024-04-23T18:33:11.418774+0000","last_clean":"2024-04-23T18:33:11.418774+0000","last_became_active":"2024-04-23T18:29:19.525985+0000","last_became_peered":"2024-04-23T18:29:19.525985+0000","last_unstale":"2024-04-23T18:33:11.418774+0000","last_undegraded":"2024-04-23T18:33:11.418774+0000","last_fullsized":"2024-04-23T18:33:11.418774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:11.418670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:11.418670+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.418670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:53.730800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:15.396979+0000","last_change":"2024-04-23T18:33:15.397003+0000","last_active":"2024-04-23T18:33:15.396979+0000","last_peered":"2024-04-23T18:33:15.396979+0000","last_clean":"2024-04-23T18:33:15.396979+0000","last_became_active":"2024-04-23T18:29:21.528665+0000","last_became_peered":"2024-04-23T18:29:21.528665+0000","last_unstale":"2024-04-23T18:33:15.396979+0000","last_undegraded":"2024-04-23T18:33:15.396979+0000","last_fullsized":"2024-04-23T18:33:15.396979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:15.396887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:15.396887+0000","last_clean_scrub_stamp":"2024-04-23T18:33:15.396887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:59.736058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:18.427284+0000","last_change":"2024-04-23T18:33:18.427331+0000","last_active":"2024-04-23T18:33:18.427284+0000","last_peered":"2024-04-23T18:33:18.427284+0000","last_clean":"2024-04-23T18:33:18.427284+0000","last_became_active":"2024-04-23T18:29:13.494647+0000","last_became_peered":"2024-04-23T18:29:13.494647+0000","last_unstale":"2024-04-23T18:33:18.427284+0000","last_undegraded":"2024-04-23T18:33:18.427284+0000","last_fullsized":"2024-04-23T18:33:18.427284+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:18.427151+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:18.427151+0000","last_clean_scrub_stamp":"2024-04-23T18:33:18.427151+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:31:27.364438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.286325+0000","last_change":"2024-04-23T18:33:03.286325+0000","last_active":"2024-04-23T18:33:03.286325+0000","last_peered":"2024-04-23T18:33:03.286325+0000","last_clean":"2024-04-23T18:33:03.286325+0000","last_became_active":"2024-04-23T18:29:11.495723+0000","last_became_peered":"2024-04-23T18:29:11.495723+0000","last_unstale":"2024-04-23T18:33:03.286325+0000","last_undegraded":"2024-04-23T18:33:03.286325+0000","last_fullsized":"2024-04-23T18:33:03.286325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:03.286196+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:03.286196+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.286196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:59:50.509925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.847864+0000","last_change":"2024-04-23T18:32:42.847886+0000","last_active":"2024-04-23T18:32:42.847864+0000","last_peered":"2024-04-23T18:32:42.847864+0000","last_clean":"2024-04-23T18:32:42.847864+0000","last_became_active":"2024-04-23T18:29:15.510185+0000","last_became_peered":"2024-04-23T18:29:15.510185+0000","last_unstale":"2024-04-23T18:32:42.847864+0000","last_undegraded":"2024-04-23T18:32:42.847864+0000","last_fullsized":"2024-04-23T18:32:42.847864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:42.847777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:42.847777+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.847777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:20:23.932361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'34","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.386198+0000","last_change":"2024-04-23T18:32:58.386231+0000","last_active":"2024-04-23T18:32:58.386198+0000","last_peered":"2024-04-23T18:32:58.386198+0000","last_clean":"2024-04-23T18:32:58.386198+0000","last_became_active":"2024-04-23T18:29:17.516989+0000","last_became_peered":"2024-04-23T18:29:17.516989+0000","last_unstale":"2024-04-23T18:32:58.386198+0000","last_undegraded":"2024-04-23T18:32:58.386198+0000","last_fullsized":"2024-04-23T18:32:58.386198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-04-23T18:32:58.386098+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-04-23T18:32:58.386098+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.386098+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:39.139901+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":38,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.462758+0000","last_change":"2024-04-23T18:32:54.462797+0000","last_active":"2024-04-23T18:32:54.462758+0000","last_peered":"2024-04-23T18:32:54.462758+0000","last_clean":"2024-04-23T18:32:54.462758+0000","last_became_active":"2024-04-23T18:29:19.522217+0000","last_became_peered":"2024-04-23T18:29:19.522217+0000","last_unstale":"2024-04-23T18:32:54.462758+0000","last_undegraded":"2024-04-23T18:32:54.462758+0000","last_fullsized":"2024-04-23T18:32:54.462758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:54.462671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:54.462671+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.462671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:02:37.395360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:31:46.764140+0000","last_change":"2024-04-23T18:29:21.533465+0000","last_active":"2024-04-23T18:31:46.764140+0000","last_peered":"2024-04-23T18:31:46.764140+0000","last_clean":"2024-04-23T18:31:46.764140+0000","last_became_active":"2024-04-23T18:29:21.533152+0000","last_became_peered":"2024-04-23T18:29:21.533152+0000","last_unstale":"2024-04-23T18:31:46.764140+0000","last_undegraded":"2024-04-23T18:31:46.764140+0000","last_fullsized":"2024-04-23T18:31:46.764140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:29:20.506211+0000","last_clean_scrub_stamp":"2024-04-23T18:29:20.506211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.413635+0000","last_change":"2024-04-23T18:33:07.413678+0000","last_active":"2024-04-23T18:33:07.413635+0000","last_peered":"2024-04-23T18:33:07.413635+0000","last_clean":"2024-04-23T18:33:07.413635+0000","last_became_active":"2024-04-23T18:29:13.501782+0000","last_became_peered":"2024-04-23T18:29:13.501782+0000","last_unstale":"2024-04-23T18:33:07.413635+0000","last_undegraded":"2024-04-23T18:33:07.413635+0000","last_fullsized":"2024-04-23T18:33:07.413635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:07.413496+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:07.413496+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.413496+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:45.543382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.946596+0000","last_change":"2024-04-23T18:33:10.946596+0000","last_active":"2024-04-23T18:33:10.946596+0000","last_peered":"2024-04-23T18:33:10.946596+0000","last_clean":"2024-04-23T18:33:10.946596+0000","last_became_active":"2024-04-23T18:29:11.501648+0000","last_became_peered":"2024-04-23T18:29:11.501648+0000","last_unstale":"2024-04-23T18:33:10.946596+0000","last_undegraded":"2024-04-23T18:33:10.946596+0000","last_fullsized":"2024-04-23T18:33:10.946596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:10.946483+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:10.946483+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.946483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:32.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.904576+0000","last_change":"2024-04-23T18:32:44.904604+0000","last_active":"2024-04-23T18:32:44.904576+0000","last_peered":"2024-04-23T18:32:44.904576+0000","last_clean":"2024-04-23T18:32:44.904576+0000","last_became_active":"2024-04-23T18:29:15.509725+0000","last_became_peered":"2024-04-23T18:29:15.509725+0000","last_unstale":"2024-04-23T18:32:44.904576+0000","last_undegraded":"2024-04-23T18:32:44.904576+0000","last_fullsized":"2024-04-23T18:32:44.904576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-23T18:32:44.904494+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-23T18:32:44.904494+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.904494+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:04.452291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.413489+0000","last_change":"2024-04-23T18:33:02.413529+0000","last_active":"2024-04-23T18:33:02.413489+0000","last_peered":"2024-04-23T18:33:02.413489+0000","last_clean":"2024-04-23T18:33:02.413489+0000","last_became_active":"2024-04-23T18:29:17.514823+0000","last_became_peered":"2024-04-23T18:29:17.514823+0000","last_unstale":"2024-04-23T18:33:02.413489+0000","last_undegraded":"2024-04-23T18:33:02.413489+0000","last_fullsized":"2024-04-23T18:33:02.413489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-04-23T18:33:02.413401+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-04-23T18:33:02.413401+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.413401+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:18.372633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.280462+0000","last_change":"2024-04-23T18:32:40.280484+0000","last_active":"2024-04-23T18:32:40.280462+0000","last_peered":"2024-04-23T18:32:40.280462+0000","last_clean":"2024-04-23T18:32:40.280462+0000","last_became_active":"2024-04-23T18:29:19.519153+0000","last_became_peered":"2024-04-23T18:29:19.519153+0000","last_unstale":"2024-04-23T18:32:40.280462+0000","last_undegraded":"2024-04-23T18:32:40.280462+0000","last_fullsized":"2024-04-23T18:32:40.280462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:40.280370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:40.280370+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.280370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:40.211480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:19.447621+0000","last_change":"2024-04-23T18:33:19.447649+0000","last_active":"2024-04-23T18:33:19.447621+0000","last_peered":"2024-04-23T18:33:19.447621+0000","last_clean":"2024-04-23T18:33:19.447621+0000","last_became_active":"2024-04-23T18:29:21.529331+0000","last_became_peered":"2024-04-23T18:29:21.529331+0000","last_unstale":"2024-04-23T18:33:19.447621+0000","last_undegraded":"2024-04-23T18:33:19.447621+0000","last_fullsized":"2024-04-23T18:33:19.447621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:19.447542+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:19.447542+0000","last_clean_scrub_stamp":"2024-04-23T18:33:19.447542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:10.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:32.663491+0000","last_change":"2024-04-23T18:33:32.663491+0000","last_active":"2024-04-23T18:33:32.663491+0000","last_peered":"2024-04-23T18:33:32.663491+0000","last_clean":"2024-04-23T18:33:32.663491+0000","last_became_active":"2024-04-23T18:29:52.551523+0000","last_became_peered":"2024-04-23T18:29:52.551523+0000","last_unstale":"2024-04-23T18:33:32.663491+0000","last_undegraded":"2024-04-23T18:33:32.663491+0000","last_fullsized":"2024-04-23T18:33:32.663491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-23T18:33:32.663374+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-23T18:33:32.663374+0000","last_clean_scrub_stamp":"2024-04-23T18:33:32.663374+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:37.284332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.409650+0000","last_change":"2024-04-23T18:33:06.409650+0000","last_active":"2024-04-23T18:33:06.409650+0000","last_peered":"2024-04-23T18:33:06.409650+0000","last_clean":"2024-04-23T18:33:06.409650+0000","last_became_active":"2024-04-23T18:29:11.489284+0000","last_became_peered":"2024-04-23T18:29:11.489284+0000","last_unstale":"2024-04-23T18:33:06.409650+0000","last_undegraded":"2024-04-23T18:33:06.409650+0000","last_fullsized":"2024-04-23T18:33:06.409650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:06.409508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:06.409508+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.409508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.085219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.191207+0000","last_change":"2024-04-23T18:33:06.191207+0000","last_active":"2024-04-23T18:33:06.191207+0000","last_peered":"2024-04-23T18:33:06.191207+0000","last_clean":"2024-04-23T18:33:06.191207+0000","last_became_active":"2024-04-23T18:29:13.496958+0000","last_became_peered":"2024-04-23T18:29:13.496958+0000","last_unstale":"2024-04-23T18:33:06.191207+0000","last_undegraded":"2024-04-23T18:33:06.191207+0000","last_fullsized":"2024-04-23T18:33:06.191207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:06.191085+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:06.191085+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.191085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:46:01.648450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:23.363748+0000","last_change":"2024-04-23T18:33:23.363748+0000","last_active":"2024-04-23T18:33:23.363748+0000","last_peered":"2024-04-23T18:33:23.363748+0000","last_clean":"2024-04-23T18:33:23.363748+0000","last_became_active":"2024-04-23T18:29:11.486563+0000","last_became_peered":"2024-04-23T18:29:11.486563+0000","last_unstale":"2024-04-23T18:33:23.363748+0000","last_undegraded":"2024-04-23T18:33:23.363748+0000","last_fullsized":"2024-04-23T18:33:23.363748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:23.363565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:23.363565+0000","last_clean_scrub_stamp":"2024-04-23T18:33:23.363565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:08.265861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:20.467793+0000","last_change":"2024-04-23T18:33:20.467793+0000","last_active":"2024-04-23T18:33:20.467793+0000","last_peered":"2024-04-23T18:33:20.467793+0000","last_clean":"2024-04-23T18:33:20.467793+0000","last_became_active":"2024-04-23T18:29:13.494683+0000","last_became_peered":"2024-04-23T18:29:13.494683+0000","last_unstale":"2024-04-23T18:33:20.467793+0000","last_undegraded":"2024-04-23T18:33:20.467793+0000","last_fullsized":"2024-04-23T18:33:20.467793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:33:20.467687+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:33:20.467687+0000","last_clean_scrub_stamp":"2024-04-23T18:33:20.467687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:55.559898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:37.470078+0000","last_change":"2024-04-23T18:33:37.470103+0000","last_active":"2024-04-23T18:33:37.470078+0000","last_peered":"2024-04-23T18:33:37.470078+0000","last_clean":"2024-04-23T18:33:37.470078+0000","last_became_active":"2024-04-23T18:29:11.510971+0000","last_became_peered":"2024-04-23T18:29:11.510971+0000","last_unstale":"2024-04-23T18:33:37.470078+0000","last_undegraded":"2024-04-23T18:33:37.470078+0000","last_fullsized":"2024-04-23T18:33:37.470078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:37.469989+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:37.469989+0000","last_clean_scrub_stamp":"2024-04-23T18:33:37.469989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:31.535506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.219714+0000","last_change":"2024-04-23T18:33:08.219714+0000","last_active":"2024-04-23T18:33:08.219714+0000","last_peered":"2024-04-23T18:33:08.219714+0000","last_clean":"2024-04-23T18:33:08.219714+0000","last_became_active":"2024-04-23T18:29:13.497094+0000","last_became_peered":"2024-04-23T18:29:13.497094+0000","last_unstale":"2024-04-23T18:33:08.219714+0000","last_undegraded":"2024-04-23T18:33:08.219714+0000","last_fullsized":"2024-04-23T18:33:08.219714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:33:08.219588+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:33:08.219588+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.219588+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:10.922039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:25.388007+0000","last_change":"2024-04-23T18:33:25.388034+0000","last_active":"2024-04-23T18:33:25.388007+0000","last_peered":"2024-04-23T18:33:25.388007+0000","last_clean":"2024-04-23T18:33:25.388007+0000","last_became_active":"2024-04-23T18:29:11.492064+0000","last_became_peered":"2024-04-23T18:29:11.492064+0000","last_unstale":"2024-04-23T18:33:25.388007+0000","last_undegraded":"2024-04-23T18:33:25.388007+0000","last_fullsized":"2024-04-23T18:33:25.388007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:25.387886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:25.387886+0000","last_clean_scrub_stamp":"2024-04-23T18:33:25.387886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:45:22.119958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.172545+0000","last_change":"2024-04-23T18:32:59.172545+0000","last_active":"2024-04-23T18:32:59.172545+0000","last_peered":"2024-04-23T18:32:59.172545+0000","last_clean":"2024-04-23T18:32:59.172545+0000","last_became_active":"2024-04-23T18:29:13.502243+0000","last_became_peered":"2024-04-23T18:29:13.502243+0000","last_unstale":"2024-04-23T18:32:59.172545+0000","last_undegraded":"2024-04-23T18:32:59.172545+0000","last_fullsized":"2024-04-23T18:32:59.172545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:59.172373+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:59.172373+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.172373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:11.409328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:21.326080+0000","last_change":"2024-04-23T18:33:21.326080+0000","last_active":"2024-04-23T18:33:21.326080+0000","last_peered":"2024-04-23T18:33:21.326080+0000","last_clean":"2024-04-23T18:33:21.326080+0000","last_became_active":"2024-04-23T18:29:11.486452+0000","last_became_peered":"2024-04-23T18:29:11.486452+0000","last_unstale":"2024-04-23T18:33:21.326080+0000","last_undegraded":"2024-04-23T18:33:21.326080+0000","last_fullsized":"2024-04-23T18:33:21.326080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:21.325963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:21.325963+0000","last_clean_scrub_stamp":"2024-04-23T18:33:21.325963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:18.055667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.894295+0000","last_change":"2024-04-23T18:32:53.894295+0000","last_active":"2024-04-23T18:32:53.894295+0000","last_peered":"2024-04-23T18:32:53.894295+0000","last_clean":"2024-04-23T18:32:53.894295+0000","last_became_active":"2024-04-23T18:29:13.507582+0000","last_became_peered":"2024-04-23T18:29:13.507582+0000","last_unstale":"2024-04-23T18:32:53.894295+0000","last_undegraded":"2024-04-23T18:32:53.894295+0000","last_fullsized":"2024-04-23T18:32:53.894295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:53.894122+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:53.894122+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.894122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:12.522802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:22.759180+0000","last_change":"2024-04-23T18:33:22.759180+0000","last_active":"2024-04-23T18:33:22.759180+0000","last_peered":"2024-04-23T18:33:22.759180+0000","last_clean":"2024-04-23T18:33:22.759180+0000","last_became_active":"2024-04-23T18:29:11.493318+0000","last_became_peered":"2024-04-23T18:29:11.493318+0000","last_unstale":"2024-04-23T18:33:22.759180+0000","last_undegraded":"2024-04-23T18:33:22.759180+0000","last_fullsized":"2024-04-23T18:33:22.759180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:22.759052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:22.759052+0000","last_clean_scrub_stamp":"2024-04-23T18:33:22.759052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:54:03.512856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'22","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:14.304260+0000","last_change":"2024-04-23T18:33:14.304260+0000","last_active":"2024-04-23T18:33:14.304260+0000","last_peered":"2024-04-23T18:33:14.304260+0000","last_clean":"2024-04-23T18:33:14.304260+0000","last_became_active":"2024-04-23T18:29:13.499155+0000","last_became_peered":"2024-04-23T18:29:13.499155+0000","last_unstale":"2024-04-23T18:33:14.304260+0000","last_undegraded":"2024-04-23T18:33:14.304260+0000","last_fullsized":"2024-04-23T18:33:14.304260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-23T18:33:14.304134+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-23T18:33:14.304134+0000","last_clean_scrub_stamp":"2024-04-23T18:33:14.304134+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:54.060618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.369384+0000","last_change":"2024-04-23T18:33:08.369384+0000","last_active":"2024-04-23T18:33:08.369384+0000","last_peered":"2024-04-23T18:33:08.369384+0000","last_clean":"2024-04-23T18:33:08.369384+0000","last_became_active":"2024-04-23T18:29:11.485201+0000","last_became_peered":"2024-04-23T18:29:11.485201+0000","last_unstale":"2024-04-23T18:33:08.369384+0000","last_undegraded":"2024-04-23T18:33:08.369384+0000","last_fullsized":"2024-04-23T18:33:08.369384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:08.369275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:08.369275+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.369275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:55.252697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.937232+0000","last_change":"2024-04-23T18:33:09.937232+0000","last_active":"2024-04-23T18:33:09.937232+0000","last_peered":"2024-04-23T18:33:09.937232+0000","last_clean":"2024-04-23T18:33:09.937232+0000","last_became_active":"2024-04-23T18:29:13.495654+0000","last_became_peered":"2024-04-23T18:29:13.495654+0000","last_unstale":"2024-04-23T18:33:09.937232+0000","last_undegraded":"2024-04-23T18:33:09.937232+0000","last_fullsized":"2024-04-23T18:33:09.937232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:09.937116+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:09.937116+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.937116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:04.365933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.264085+0000","last_change":"2024-04-23T18:33:09.264085+0000","last_active":"2024-04-23T18:33:09.264085+0000","last_peered":"2024-04-23T18:33:09.264085+0000","last_clean":"2024-04-23T18:33:09.264085+0000","last_became_active":"2024-04-23T18:29:11.495224+0000","last_became_peered":"2024-04-23T18:29:11.495224+0000","last_unstale":"2024-04-23T18:33:09.264085+0000","last_undegraded":"2024-04-23T18:33:09.264085+0000","last_fullsized":"2024-04-23T18:33:09.264085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:09.263963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:09.263963+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.263963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:07.216912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:13.883476+0000","last_change":"2024-04-23T18:33:13.883502+0000","last_active":"2024-04-23T18:33:13.883476+0000","last_peered":"2024-04-23T18:33:13.883476+0000","last_clean":"2024-04-23T18:33:13.883476+0000","last_became_active":"2024-04-23T18:29:13.497588+0000","last_became_peered":"2024-04-23T18:29:13.497588+0000","last_unstale":"2024-04-23T18:33:13.883476+0000","last_undegraded":"2024-04-23T18:33:13.883476+0000","last_fullsized":"2024-04-23T18:33:13.883476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:13.883382+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:13.883382+0000","last_clean_scrub_stamp":"2024-04-23T18:33:13.883382+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:49:50.871921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:47.455304+0000","last_change":"2024-04-23T18:33:47.455332+0000","last_active":"2024-04-23T18:33:47.455304+0000","last_peered":"2024-04-23T18:33:47.455304+0000","last_clean":"2024-04-23T18:33:47.455304+0000","last_became_active":"2024-04-23T18:29:11.495948+0000","last_became_peered":"2024-04-23T18:29:11.495948+0000","last_unstale":"2024-04-23T18:33:47.455304+0000","last_undegraded":"2024-04-23T18:33:47.455304+0000","last_fullsized":"2024-04-23T18:33:47.455304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:47.455173+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:47.455173+0000","last_clean_scrub_stamp":"2024-04-23T18:33:47.455173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:20:55.895581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.513942+0000","last_change":"2024-04-23T18:33:08.514007+0000","last_active":"2024-04-23T18:33:08.513942+0000","last_peered":"2024-04-23T18:33:08.513942+0000","last_clean":"2024-04-23T18:33:08.513942+0000","last_became_active":"2024-04-23T18:29:13.500819+0000","last_became_peered":"2024-04-23T18:29:13.500819+0000","last_unstale":"2024-04-23T18:33:08.513942+0000","last_undegraded":"2024-04-23T18:33:08.513942+0000","last_fullsized":"2024-04-23T18:33:08.513942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:08.513818+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:08.513818+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.513818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:15:06.432888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:13.339368+0000","last_change":"2024-04-23T18:33:13.339368+0000","last_active":"2024-04-23T18:33:13.339368+0000","last_peered":"2024-04-23T18:33:13.339368+0000","last_clean":"2024-04-23T18:33:13.339368+0000","last_became_active":"2024-04-23T18:29:11.492727+0000","last_became_peered":"2024-04-23T18:29:11.492727+0000","last_unstale":"2024-04-23T18:33:13.339368+0000","last_undegraded":"2024-04-23T18:33:13.339368+0000","last_fullsized":"2024-04-23T18:33:13.339368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:13.339268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:13.339268+0000","last_clean_scrub_stamp":"2024-04-23T18:33:13.339268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:05:20.784588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.189982+0000","last_change":"2024-04-23T18:32:58.189982+0000","last_active":"2024-04-23T18:32:58.189982+0000","last_peered":"2024-04-23T18:32:58.189982+0000","last_clean":"2024-04-23T18:32:58.189982+0000","last_became_active":"2024-04-23T18:29:13.502835+0000","last_became_peered":"2024-04-23T18:29:13.502835+0000","last_unstale":"2024-04-23T18:32:58.189982+0000","last_undegraded":"2024-04-23T18:32:58.189982+0000","last_fullsized":"2024-04-23T18:32:58.189982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:58.189852+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:58.189852+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.189852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:33.304629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:16.842303+0000","last_change":"2024-04-23T18:33:16.842303+0000","last_active":"2024-04-23T18:33:16.842303+0000","last_peered":"2024-04-23T18:33:16.842303+0000","last_clean":"2024-04-23T18:33:16.842303+0000","last_became_active":"2024-04-23T18:29:11.498708+0000","last_became_peered":"2024-04-23T18:29:11.498708+0000","last_unstale":"2024-04-23T18:33:16.842303+0000","last_undegraded":"2024-04-23T18:33:16.842303+0000","last_fullsized":"2024-04-23T18:33:16.842303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:16.842178+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:16.842178+0000","last_clean_scrub_stamp":"2024-04-23T18:33:16.842178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:43:59.315276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.870040+0000","last_change":"2024-04-23T18:33:05.870040+0000","last_active":"2024-04-23T18:33:05.870040+0000","last_peered":"2024-04-23T18:33:05.870040+0000","last_clean":"2024-04-23T18:33:05.870040+0000","last_became_active":"2024-04-23T18:29:13.494121+0000","last_became_peered":"2024-04-23T18:29:13.494121+0000","last_unstale":"2024-04-23T18:33:05.870040+0000","last_undegraded":"2024-04-23T18:33:05.870040+0000","last_fullsized":"2024-04-23T18:33:05.870040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:05.869897+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:05.869897+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.869897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:04.336158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:20.766460+0000","last_change":"2024-04-23T18:33:20.766460+0000","last_active":"2024-04-23T18:33:20.766460+0000","last_peered":"2024-04-23T18:33:20.766460+0000","last_clean":"2024-04-23T18:33:20.766460+0000","last_became_active":"2024-04-23T18:29:11.489671+0000","last_became_peered":"2024-04-23T18:29:11.489671+0000","last_unstale":"2024-04-23T18:33:20.766460+0000","last_undegraded":"2024-04-23T18:33:20.766460+0000","last_fullsized":"2024-04-23T18:33:20.766460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:20.766326+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:20.766326+0000","last_clean_scrub_stamp":"2024-04-23T18:33:20.766326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:00:09.886314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.886490+0000","last_change":"2024-04-23T18:32:56.886490+0000","last_active":"2024-04-23T18:32:56.886490+0000","last_peered":"2024-04-23T18:32:56.886490+0000","last_clean":"2024-04-23T18:32:56.886490+0000","last_became_active":"2024-04-23T18:29:13.507438+0000","last_became_peered":"2024-04-23T18:29:13.507438+0000","last_unstale":"2024-04-23T18:32:56.886490+0000","last_undegraded":"2024-04-23T18:32:56.886490+0000","last_fullsized":"2024-04-23T18:32:56.886490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:56.886359+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:56.886359+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.886359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:27:39.704045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:39.477109+0000","last_change":"2024-04-23T18:33:39.477109+0000","last_active":"2024-04-23T18:33:39.477109+0000","last_peered":"2024-04-23T18:33:39.477109+0000","last_clean":"2024-04-23T18:33:39.477109+0000","last_became_active":"2024-04-23T18:29:11.510882+0000","last_became_peered":"2024-04-23T18:29:11.510882+0000","last_unstale":"2024-04-23T18:33:39.477109+0000","last_undegraded":"2024-04-23T18:33:39.477109+0000","last_fullsized":"2024-04-23T18:33:39.477109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:39.476993+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:39.476993+0000","last_clean_scrub_stamp":"2024-04-23T18:33:39.476993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:09.335384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.959774+0000","last_change":"2024-04-23T18:33:11.959774+0000","last_active":"2024-04-23T18:33:11.959774+0000","last_peered":"2024-04-23T18:33:11.959774+0000","last_clean":"2024-04-23T18:33:11.959774+0000","last_became_active":"2024-04-23T18:29:13.497271+0000","last_became_peered":"2024-04-23T18:29:13.497271+0000","last_unstale":"2024-04-23T18:33:11.959774+0000","last_undegraded":"2024-04-23T18:33:11.959774+0000","last_fullsized":"2024-04-23T18:33:11.959774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-23T18:33:11.959620+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-23T18:33:11.959620+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.959620+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:56.484601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:27.519246+0000","last_change":"2024-04-23T18:33:27.519246+0000","last_active":"2024-04-23T18:33:27.519246+0000","last_peered":"2024-04-23T18:33:27.519246+0000","last_clean":"2024-04-23T18:33:27.519246+0000","last_became_active":"2024-04-23T18:29:11.506749+0000","last_became_peered":"2024-04-23T18:29:11.506749+0000","last_unstale":"2024-04-23T18:33:27.519246+0000","last_undegraded":"2024-04-23T18:33:27.519246+0000","last_fullsized":"2024-04-23T18:33:27.519246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:27.519118+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:27.519118+0000","last_clean_scrub_stamp":"2024-04-23T18:33:27.519118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:55.534154+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.488245+0000","last_change":"2024-04-23T18:33:05.488245+0000","last_active":"2024-04-23T18:33:05.488245+0000","last_peered":"2024-04-23T18:33:05.488245+0000","last_clean":"2024-04-23T18:33:05.488245+0000","last_became_active":"2024-04-23T18:29:13.501177+0000","last_became_peered":"2024-04-23T18:29:13.501177+0000","last_unstale":"2024-04-23T18:33:05.488245+0000","last_undegraded":"2024-04-23T18:33:05.488245+0000","last_fullsized":"2024-04-23T18:33:05.488245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:05.488136+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:05.488136+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.488136+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:00:41.028747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:18.427433+0000","last_change":"2024-04-23T18:33:18.427433+0000","last_active":"2024-04-23T18:33:18.427433+0000","last_peered":"2024-04-23T18:33:18.427433+0000","last_clean":"2024-04-23T18:33:18.427433+0000","last_became_active":"2024-04-23T18:29:11.484137+0000","last_became_peered":"2024-04-23T18:29:11.484137+0000","last_unstale":"2024-04-23T18:33:18.427433+0000","last_undegraded":"2024-04-23T18:33:18.427433+0000","last_fullsized":"2024-04-23T18:33:18.427433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:18.427238+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:18.427238+0000","last_clean_scrub_stamp":"2024-04-23T18:33:18.427238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:40.290211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:15.855624+0000","last_change":"2024-04-23T18:33:15.855624+0000","last_active":"2024-04-23T18:33:15.855624+0000","last_peered":"2024-04-23T18:33:15.855624+0000","last_clean":"2024-04-23T18:33:15.855624+0000","last_became_active":"2024-04-23T18:29:13.494034+0000","last_became_peered":"2024-04-23T18:29:13.494034+0000","last_unstale":"2024-04-23T18:33:15.855624+0000","last_undegraded":"2024-04-23T18:33:15.855624+0000","last_fullsized":"2024-04-23T18:33:15.855624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:15.855512+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:15.855512+0000","last_clean_scrub_stamp":"2024-04-23T18:33:15.855512+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:49.712408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:29.447216+0000","last_change":"2024-04-23T18:33:29.447216+0000","last_active":"2024-04-23T18:33:29.447216+0000","last_peered":"2024-04-23T18:33:29.447216+0000","last_clean":"2024-04-23T18:33:29.447216+0000","last_became_active":"2024-04-23T18:29:11.506801+0000","last_became_peered":"2024-04-23T18:29:11.506801+0000","last_unstale":"2024-04-23T18:33:29.447216+0000","last_undegraded":"2024-04-23T18:33:29.447216+0000","last_fullsized":"2024-04-23T18:33:29.447216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:29.447095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:29.447095+0000","last_clean_scrub_stamp":"2024-04-23T18:33:29.447095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:41.471117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:46.503071+0000","last_change":"2024-04-23T18:33:46.503071+0000","last_active":"2024-04-23T18:33:46.503071+0000","last_peered":"2024-04-23T18:33:46.503071+0000","last_clean":"2024-04-23T18:33:46.503071+0000","last_became_active":"2024-04-23T18:29:11.494891+0000","last_became_peered":"2024-04-23T18:29:11.494891+0000","last_unstale":"2024-04-23T18:33:46.503071+0000","last_undegraded":"2024-04-23T18:33:46.503071+0000","last_fullsized":"2024-04-23T18:33:46.503071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:46.502937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:46.502937+0000","last_clean_scrub_stamp":"2024-04-23T18:33:46.502937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:38:59.985997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.263490+0000","last_change":"2024-04-23T18:33:04.263523+0000","last_active":"2024-04-23T18:33:04.263490+0000","last_peered":"2024-04-23T18:33:04.263490+0000","last_clean":"2024-04-23T18:33:04.263490+0000","last_became_active":"2024-04-23T18:29:13.494850+0000","last_became_peered":"2024-04-23T18:29:13.494850+0000","last_unstale":"2024-04-23T18:33:04.263490+0000","last_undegraded":"2024-04-23T18:33:04.263490+0000","last_fullsized":"2024-04-23T18:33:04.263490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:04.263392+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:04.263392+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.263392+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:45:01.339824+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.217798+0000","last_change":"2024-04-23T18:33:07.217825+0000","last_active":"2024-04-23T18:33:07.217798+0000","last_peered":"2024-04-23T18:33:07.217798+0000","last_clean":"2024-04-23T18:33:07.217798+0000","last_became_active":"2024-04-23T18:29:11.495173+0000","last_became_peered":"2024-04-23T18:29:11.495173+0000","last_unstale":"2024-04-23T18:33:07.217798+0000","last_undegraded":"2024-04-23T18:33:07.217798+0000","last_fullsized":"2024-04-23T18:33:07.217798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:07.217709+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:07.217709+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.217709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:39:38.244409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.919274+0000","last_change":"2024-04-23T18:33:00.919303+0000","last_active":"2024-04-23T18:33:00.919274+0000","last_peered":"2024-04-23T18:33:00.919274+0000","last_clean":"2024-04-23T18:33:00.919274+0000","last_became_active":"2024-04-23T18:29:13.506122+0000","last_became_peered":"2024-04-23T18:29:13.506122+0000","last_unstale":"2024-04-23T18:33:00.919274+0000","last_undegraded":"2024-04-23T18:33:00.919274+0000","last_fullsized":"2024-04-23T18:33:00.919274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:00.919186+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:00.919186+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.919186+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:47.802608+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1524,"ondisk_log_size":1524,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1604,"num_read_kb":1494,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640319,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39968,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331872,"statfs":{"total":96636764160,"available":96595836928,"internally_reserved":0,"allocated":483328,"data_stored":150732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640319,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":738603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640320,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":738249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44088,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327752,"statfs":{"total":96636764160,"available":96591618048,"internally_reserved":0,"allocated":442368,"data_stored":148938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:33:53.976 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:53.977 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:53.977 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:53.977 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:53.977 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-23T18:29:20.506211+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=29, tm_sec=20, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=18, tm_min=32, tm_sec=29, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T18:33:53.978 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T18:34:13.979 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T18:34:14.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.100+0000 7f3e1d68c640 1 Processor -- start 2024-04-23T18:34:14.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.100+0000 7f3e1d68c640 1 -- start start 2024-04-23T18:34:14.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.100+0000 7f3e1d68c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3e1812fa30 0x7f3e18131e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:34:14.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.100+0000 7f3e1d68c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e18098fd0 con 0x7f3e180933f0 2024-04-23T18:34:14.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.100+0000 7f3e1d68c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f3e180967a0 con 0x7f3e1812fa30 2024-04-23T18:34:14.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.100+0000 7f3e0e7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3e1812fa30 0x7f3e18131e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:34:14.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.100+0000 7f3e16ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3e180933f0 0x7f3e180937d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44880/0 (socket says 172.21.15.62:44880) 2024-04-23T18:34:14.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.100+0000 7f3e16ffd640 1 -- 172.21.15.62:0/1696152969 learned_addr learned my addr 172.21.15.62:0/1696152969 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:34:14.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.101+0000 7f3e0e7fc640 1 -- 172.21.15.62:0/1696152969 >> v1:172.21.15.62:6789/0 conn(0x7f3e180933f0 legacy=0x7f3e180937d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:34:14.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.101+0000 7f3e0e7fc640 1 -- 172.21.15.62:0/1696152969 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e180970e0 con 0x7f3e1812fa30 2024-04-23T18:34:14.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.101+0000 7f3e167fc640 1 -- 172.21.15.62:0/1696152969 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 126331455 0 0) 0x7f3e18098fd0 con 0x7f3e180933f0 2024-04-23T18:34:14.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.101+0000 7f3e0e7fc640 1 --2- 172.21.15.62:0/1696152969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e1812fa30 0x7f3e18131e20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009720 tx=0x7f3e0002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e13f9bd6aaf841 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:34:14.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.102+0000 7f3e167fc640 1 -- 172.21.15.62:0/1696152969 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e000316d0 con 0x7f3e1812fa30 2024-04-23T18:34:14.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.102+0000 7f3e167fc640 1 -- 172.21.15.62:0/1696152969 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e00037070 con 0x7f3e1812fa30 2024-04-23T18:34:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.102+0000 7f3e167fc640 1 -- 172.21.15.62:0/1696152969 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e000319c0 con 0x7f3e1812fa30 2024-04-23T18:34:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.102+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1696152969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e1812fa30 msgr2=0x7f3e18131e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:34:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.102+0000 7f3e1d68c640 1 --2- 172.21.15.62:0/1696152969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e1812fa30 0x7f3e18131e20 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009720 tx=0x7f3e0002b840 comp rx=0 tx=0).stop 2024-04-23T18:34:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.102+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1696152969 shutdown_connections 2024-04-23T18:34:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.102+0000 7f3e1d68c640 1 --2- 172.21.15.62:0/1696152969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e1812fa30 0x7f3e18131e20 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:34:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.102+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1696152969 >> 172.21.15.62:0/1696152969 conn(0x7f3e18099d70 msgr2=0x7f3e18097640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:34:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.102+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1696152969 shutdown_connections 2024-04-23T18:34:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.102+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1696152969 wait complete. 2024-04-23T18:34:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.103+0000 7f3e1d68c640 1 Processor -- start 2024-04-23T18:34:14.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.103+0000 7f3e1d68c640 1 -- start start 2024-04-23T18:34:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.104+0000 7f3e1d68c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e180933f0 0x7f3e181c1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:34:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.104+0000 7f3e1d68c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3e18132360 con 0x7f3e180933f0 2024-04-23T18:34:14.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.104+0000 7f3e16ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e180933f0 0x7f3e181c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.104+0000 7f3e16ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e180933f0 0x7f3e181c1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58962/0 (socket says 172.21.15.62:58962) 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.104+0000 7f3e16ffd640 1 -- 172.21.15.62:0/1788551750 learned_addr learned my addr 172.21.15.62:0/1788551750 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.104+0000 7f3e16ffd640 1 -- 172.21.15.62:0/1788551750 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1812df00 con 0x7f3e180933f0 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.104+0000 7f3e16ffd640 1 --2- 172.21.15.62:0/1788551750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e180933f0 0x7f3e181c1680 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800c370 tx=0x7f3e0800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.104+0000 7f3e0ffff640 1 -- 172.21.15.62:0/1788551750 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e08007410 con 0x7f3e180933f0 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.104+0000 7f3e0ffff640 1 -- 172.21.15.62:0/1788551750 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e080075d0 con 0x7f3e180933f0 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.104+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1788551750 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1812ca80 con 0x7f3e180933f0 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.104+0000 7f3e0ffff640 1 -- 172.21.15.62:0/1788551750 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e08004950 con 0x7f3e180933f0 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.104+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1788551750 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1812f480 con 0x7f3e180933f0 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.105+0000 7f3e0ffff640 1 -- 172.21.15.62:0/1788551750 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7f3e08011070 con 0x7f3e180933f0 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.105+0000 7f3e0ffff640 1 --2- 172.21.15.62:0/1788551750 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3df80385c0 0x7f3df803aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.105+0000 7f3e0ffff640 1 -- 172.21.15.62:0/1788551750 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7f3e0804bca0 con 0x7f3e180933f0 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.105+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1788551750 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e180505b0 con 0x7f3e180933f0 2024-04-23T18:34:14.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.106+0000 7f3e0e7fc640 1 --2- 172.21.15.62:0/1788551750 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3df80385c0 0x7f3df803aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:34:14.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.106+0000 7f3e0e7fc640 1 --2- 172.21.15.62:0/1788551750 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3df80385c0 0x7f3df803aa80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009720 tx=0x7f3e00008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:34:14.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.110+0000 7f3e0ffff640 1 -- 172.21.15.62:0/1788551750 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3e0801cbd0 con 0x7f3e180933f0 2024-04-23T18:34:14.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.291+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1788551750 --> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e1806bae0 con 0x7f3df80385c0 2024-04-23T18:34:14.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.306+0000 7f3e0ffff640 1 -- 172.21.15.62:0/1788551750 <== mgr.4102 v2:172.21.15.119:6824/3704082436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666062 (secure 0 0 0) 0x7f3e1806bae0 con 0x7f3df80385c0 2024-04-23T18:34:14.306 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-04-23T18:34:14.311 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-04-23T18:34:14.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.311+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1788551750 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3df80385c0 msgr2=0x7f3df803aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:34:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.311+0000 7f3e1d68c640 1 --2- 172.21.15.62:0/1788551750 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3df80385c0 0x7f3df803aa80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009720 tx=0x7f3e00008030 comp rx=0 tx=0).stop 2024-04-23T18:34:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.311+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1788551750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e180933f0 msgr2=0x7f3e181c1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:34:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.311+0000 7f3e1d68c640 1 --2- 172.21.15.62:0/1788551750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e180933f0 0x7f3e181c1680 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800c370 tx=0x7f3e0800c830 comp rx=0 tx=0).stop 2024-04-23T18:34:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.311+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1788551750 shutdown_connections 2024-04-23T18:34:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.311+0000 7f3e1d68c640 1 --2- 172.21.15.62:0/1788551750 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7f3df80385c0 0x7f3df803aa80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:34:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.311+0000 7f3e1d68c640 1 --2- 172.21.15.62:0/1788551750 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3e180933f0 0x7f3e181c1680 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:34:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.311+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1788551750 >> 172.21.15.62:0/1788551750 conn(0x7f3e18099d70 msgr2=0x7f3e1809aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:34:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.311+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1788551750 shutdown_connections 2024-04-23T18:34:14.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.311+0000 7f3e1d68c640 1 -- 172.21.15.62:0/1788551750 wait complete. 2024-04-23T18:34:14.315 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-04-23T18:34:12.778685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5092,"num_read_kb":4673,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4786,"ondisk_log_size":4786,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165048,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322312,"statfs":{"total":386547056640,"available":386378047488,"internally_reserved":0,"allocated":2973696,"data_stored":1776522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":165996311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003876"},"pg_stats":[{"pgid":"3.3f","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.427995+0000","last_change":"2024-04-23T18:33:04.427995+0000","last_active":"2024-04-23T18:33:04.427995+0000","last_peered":"2024-04-23T18:33:04.427995+0000","last_clean":"2024-04-23T18:33:04.427995+0000","last_became_active":"2024-04-23T18:29:11.495610+0000","last_became_peered":"2024-04-23T18:29:11.495610+0000","last_unstale":"2024-04-23T18:33:04.427995+0000","last_undegraded":"2024-04-23T18:33:04.427995+0000","last_fullsized":"2024-04-23T18:33:04.427995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:04.427875+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:04.427875+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.427875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:27:47.245561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.888297+0000","last_change":"2024-04-23T18:33:02.888343+0000","last_active":"2024-04-23T18:33:02.888297+0000","last_peered":"2024-04-23T18:33:02.888297+0000","last_clean":"2024-04-23T18:33:02.888297+0000","last_became_active":"2024-04-23T18:29:13.492771+0000","last_became_peered":"2024-04-23T18:29:13.492771+0000","last_unstale":"2024-04-23T18:33:02.888297+0000","last_undegraded":"2024-04-23T18:33:02.888297+0000","last_fullsized":"2024-04-23T18:33:02.888297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:02.888182+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:02.888182+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.888182+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:35.983458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.220961+0000","last_change":"2024-04-23T18:33:05.220961+0000","last_active":"2024-04-23T18:33:05.220961+0000","last_peered":"2024-04-23T18:33:05.220961+0000","last_clean":"2024-04-23T18:33:05.220961+0000","last_became_active":"2024-04-23T18:29:11.495272+0000","last_became_peered":"2024-04-23T18:29:11.495272+0000","last_unstale":"2024-04-23T18:33:05.220961+0000","last_undegraded":"2024-04-23T18:33:05.220961+0000","last_fullsized":"2024-04-23T18:33:05.220961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:05.220836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:05.220836+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.220836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:05.041452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:17.405494+0000","last_change":"2024-04-23T18:33:17.405529+0000","last_active":"2024-04-23T18:33:17.405494+0000","last_peered":"2024-04-23T18:33:17.405494+0000","last_clean":"2024-04-23T18:33:17.405494+0000","last_became_active":"2024-04-23T18:29:13.494969+0000","last_became_peered":"2024-04-23T18:29:13.494969+0000","last_unstale":"2024-04-23T18:33:17.405494+0000","last_undegraded":"2024-04-23T18:33:17.405494+0000","last_fullsized":"2024-04-23T18:33:17.405494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:17.405400+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:17.405400+0000","last_clean_scrub_stamp":"2024-04-23T18:33:17.405400+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:56:01.377480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:28.493450+0000","last_change":"2024-04-23T18:33:28.493481+0000","last_active":"2024-04-23T18:33:28.493450+0000","last_peered":"2024-04-23T18:33:28.493450+0000","last_clean":"2024-04-23T18:33:28.493450+0000","last_became_active":"2024-04-23T18:29:11.505283+0000","last_became_peered":"2024-04-23T18:29:11.505283+0000","last_unstale":"2024-04-23T18:33:28.493450+0000","last_undegraded":"2024-04-23T18:33:28.493450+0000","last_fullsized":"2024-04-23T18:33:28.493450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:28.493354+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:28.493354+0000","last_clean_scrub_stamp":"2024-04-23T18:33:28.493354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:17:11.204043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:16.359353+0000","last_change":"2024-04-23T18:33:16.359380+0000","last_active":"2024-04-23T18:33:16.359353+0000","last_peered":"2024-04-23T18:33:16.359353+0000","last_clean":"2024-04-23T18:33:16.359353+0000","last_became_active":"2024-04-23T18:29:13.495367+0000","last_became_peered":"2024-04-23T18:29:13.495367+0000","last_unstale":"2024-04-23T18:33:16.359353+0000","last_undegraded":"2024-04-23T18:33:16.359353+0000","last_fullsized":"2024-04-23T18:33:16.359353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:16.359245+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:16.359245+0000","last_clean_scrub_stamp":"2024-04-23T18:33:16.359245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:36.330626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.345316+0000","last_change":"2024-04-23T18:33:02.345316+0000","last_active":"2024-04-23T18:33:02.345316+0000","last_peered":"2024-04-23T18:33:02.345316+0000","last_clean":"2024-04-23T18:33:02.345316+0000","last_became_active":"2024-04-23T18:29:11.495677+0000","last_became_peered":"2024-04-23T18:29:11.495677+0000","last_unstale":"2024-04-23T18:33:02.345316+0000","last_undegraded":"2024-04-23T18:33:02.345316+0000","last_fullsized":"2024-04-23T18:33:02.345316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:02.345200+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:02.345200+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.345200+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:21.009871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:24.523189+0000","last_change":"2024-04-23T18:33:24.523220+0000","last_active":"2024-04-23T18:33:24.523189+0000","last_peered":"2024-04-23T18:33:24.523189+0000","last_clean":"2024-04-23T18:33:24.523189+0000","last_became_active":"2024-04-23T18:29:52.548291+0000","last_became_peered":"2024-04-23T18:29:52.548291+0000","last_unstale":"2024-04-23T18:33:24.523189+0000","last_undegraded":"2024-04-23T18:33:24.523189+0000","last_fullsized":"2024-04-23T18:33:24.523189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:24.523097+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:24.523097+0000","last_clean_scrub_stamp":"2024-04-23T18:33:24.523097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:44:06.996195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:32.428143+0000","last_change":"2024-04-23T18:33:32.428143+0000","last_active":"2024-04-23T18:33:32.428143+0000","last_peered":"2024-04-23T18:33:32.428143+0000","last_clean":"2024-04-23T18:33:32.428143+0000","last_became_active":"2024-04-23T18:29:11.504554+0000","last_became_peered":"2024-04-23T18:29:11.504554+0000","last_unstale":"2024-04-23T18:33:32.428143+0000","last_undegraded":"2024-04-23T18:33:32.428143+0000","last_fullsized":"2024-04-23T18:33:32.428143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:32.428020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:32.428020+0000","last_clean_scrub_stamp":"2024-04-23T18:33:32.428020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:56:59.459014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:25.736601+0000","last_change":"2024-04-23T18:33:25.736628+0000","last_active":"2024-04-23T18:33:25.736601+0000","last_peered":"2024-04-23T18:33:25.736601+0000","last_clean":"2024-04-23T18:33:25.736601+0000","last_became_active":"2024-04-23T18:29:13.498378+0000","last_became_peered":"2024-04-23T18:29:13.498378+0000","last_unstale":"2024-04-23T18:33:25.736601+0000","last_undegraded":"2024-04-23T18:33:25.736601+0000","last_fullsized":"2024-04-23T18:33:25.736601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:25.736493+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:25.736493+0000","last_clean_scrub_stamp":"2024-04-23T18:33:25.736493+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:18:01.548689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.354787+0000","last_change":"2024-04-23T18:32:58.354787+0000","last_active":"2024-04-23T18:32:58.354787+0000","last_peered":"2024-04-23T18:32:58.354787+0000","last_clean":"2024-04-23T18:32:58.354787+0000","last_became_active":"2024-04-23T18:29:11.496923+0000","last_became_peered":"2024-04-23T18:29:11.496923+0000","last_unstale":"2024-04-23T18:32:58.354787+0000","last_undegraded":"2024-04-23T18:32:58.354787+0000","last_fullsized":"2024-04-23T18:32:58.354787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:58.354674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:58.354674+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.354674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:20.236974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.469206+0000","last_change":"2024-04-23T18:32:49.469206+0000","last_active":"2024-04-23T18:32:49.469206+0000","last_peered":"2024-04-23T18:32:49.469206+0000","last_clean":"2024-04-23T18:32:49.469206+0000","last_became_active":"2024-04-23T18:29:13.502401+0000","last_became_peered":"2024-04-23T18:29:13.502401+0000","last_unstale":"2024-04-23T18:32:49.469206+0000","last_undegraded":"2024-04-23T18:32:49.469206+0000","last_fullsized":"2024-04-23T18:32:49.469206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:49.469055+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:49.469055+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.469055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:49:26.457594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:48.482903+0000","last_change":"2024-04-23T18:33:48.482903+0000","last_active":"2024-04-23T18:33:48.482903+0000","last_peered":"2024-04-23T18:33:48.482903+0000","last_clean":"2024-04-23T18:33:48.482903+0000","last_became_active":"2024-04-23T18:29:11.499772+0000","last_became_peered":"2024-04-23T18:29:11.499772+0000","last_unstale":"2024-04-23T18:33:48.482903+0000","last_undegraded":"2024-04-23T18:33:48.482903+0000","last_fullsized":"2024-04-23T18:33:48.482903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:48.482779+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:48.482779+0000","last_clean_scrub_stamp":"2024-04-23T18:33:48.482779+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:07:11.786408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.372456+0000","last_change":"2024-04-23T18:32:57.372456+0000","last_active":"2024-04-23T18:32:57.372456+0000","last_peered":"2024-04-23T18:32:57.372456+0000","last_clean":"2024-04-23T18:32:57.372456+0000","last_became_active":"2024-04-23T18:29:13.498965+0000","last_became_peered":"2024-04-23T18:29:13.498965+0000","last_unstale":"2024-04-23T18:32:57.372456+0000","last_undegraded":"2024-04-23T18:32:57.372456+0000","last_fullsized":"2024-04-23T18:32:57.372456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:57.372339+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:57.372339+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.372339+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:21.784067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:15.259959+0000","last_change":"2024-04-23T18:33:15.259986+0000","last_active":"2024-04-23T18:33:15.259959+0000","last_peered":"2024-04-23T18:33:15.259959+0000","last_clean":"2024-04-23T18:33:15.259959+0000","last_became_active":"2024-04-23T18:29:11.491840+0000","last_became_peered":"2024-04-23T18:29:11.491840+0000","last_unstale":"2024-04-23T18:33:15.259959+0000","last_undegraded":"2024-04-23T18:33:15.259959+0000","last_fullsized":"2024-04-23T18:33:15.259959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:15.259869+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:15.259869+0000","last_clean_scrub_stamp":"2024-04-23T18:33:15.259869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:59.645930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.481145+0000","last_change":"2024-04-23T18:32:54.481145+0000","last_active":"2024-04-23T18:32:54.481145+0000","last_peered":"2024-04-23T18:32:54.481145+0000","last_clean":"2024-04-23T18:32:54.481145+0000","last_became_active":"2024-04-23T18:29:13.505348+0000","last_became_peered":"2024-04-23T18:29:13.505348+0000","last_unstale":"2024-04-23T18:32:54.481145+0000","last_undegraded":"2024-04-23T18:32:54.481145+0000","last_fullsized":"2024-04-23T18:32:54.481145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:54.481024+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:54.481024+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.481024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:53.099891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:14.423963+0000","last_change":"2024-04-23T18:33:14.423963+0000","last_active":"2024-04-23T18:33:14.423963+0000","last_peered":"2024-04-23T18:33:14.423963+0000","last_clean":"2024-04-23T18:33:14.423963+0000","last_became_active":"2024-04-23T18:29:13.495337+0000","last_became_peered":"2024-04-23T18:29:13.495337+0000","last_unstale":"2024-04-23T18:33:14.423963+0000","last_undegraded":"2024-04-23T18:33:14.423963+0000","last_fullsized":"2024-04-23T18:33:14.423963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:14.423840+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:14.423840+0000","last_clean_scrub_stamp":"2024-04-23T18:33:14.423840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:42.803799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.931210+0000","last_change":"2024-04-23T18:33:08.931210+0000","last_active":"2024-04-23T18:33:08.931210+0000","last_peered":"2024-04-23T18:33:08.931210+0000","last_clean":"2024-04-23T18:33:08.931210+0000","last_became_active":"2024-04-23T18:29:11.501773+0000","last_became_peered":"2024-04-23T18:29:11.501773+0000","last_unstale":"2024-04-23T18:33:08.931210+0000","last_undegraded":"2024-04-23T18:33:08.931210+0000","last_fullsized":"2024-04-23T18:33:08.931210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:08.931040+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:08.931040+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.931040+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:44.004243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.887572+0000","last_change":"2024-04-23T18:33:04.887572+0000","last_active":"2024-04-23T18:33:04.887572+0000","last_peered":"2024-04-23T18:33:04.887572+0000","last_clean":"2024-04-23T18:33:04.887572+0000","last_became_active":"2024-04-23T18:29:13.492366+0000","last_became_peered":"2024-04-23T18:29:13.492366+0000","last_unstale":"2024-04-23T18:33:04.887572+0000","last_undegraded":"2024-04-23T18:33:04.887572+0000","last_fullsized":"2024-04-23T18:33:04.887572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:04.887454+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:04.887454+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.887454+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:41.190483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.372871+0000","last_change":"2024-04-23T18:33:10.372871+0000","last_active":"2024-04-23T18:33:10.372871+0000","last_peered":"2024-04-23T18:33:10.372871+0000","last_clean":"2024-04-23T18:33:10.372871+0000","last_became_active":"2024-04-23T18:29:11.484620+0000","last_became_peered":"2024-04-23T18:29:11.484620+0000","last_unstale":"2024-04-23T18:33:10.372871+0000","last_undegraded":"2024-04-23T18:33:10.372871+0000","last_fullsized":"2024-04-23T18:33:10.372871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:10.372753+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:10.372753+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.372753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:43.468029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'16","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.898374+0000","last_change":"2024-04-23T18:33:07.898374+0000","last_active":"2024-04-23T18:33:07.898374+0000","last_peered":"2024-04-23T18:33:07.898374+0000","last_clean":"2024-04-23T18:33:07.898374+0000","last_became_active":"2024-04-23T18:29:13.495743+0000","last_became_peered":"2024-04-23T18:29:13.495743+0000","last_unstale":"2024-04-23T18:33:07.898374+0000","last_undegraded":"2024-04-23T18:33:07.898374+0000","last_fullsized":"2024-04-23T18:33:07.898374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:33:07.898227+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:33:07.898227+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.898227+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:29.453739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:21.772818+0000","last_change":"2024-04-23T18:33:21.772818+0000","last_active":"2024-04-23T18:33:21.772818+0000","last_peered":"2024-04-23T18:33:21.772818+0000","last_clean":"2024-04-23T18:33:21.772818+0000","last_became_active":"2024-04-23T18:29:11.493363+0000","last_became_peered":"2024-04-23T18:29:11.493363+0000","last_unstale":"2024-04-23T18:33:21.772818+0000","last_undegraded":"2024-04-23T18:33:21.772818+0000","last_fullsized":"2024-04-23T18:33:21.772818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:21.772658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:21.772658+0000","last_clean_scrub_stamp":"2024-04-23T18:33:21.772658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:27.453258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.223252+0000","last_change":"2024-04-23T18:33:01.223252+0000","last_active":"2024-04-23T18:33:01.223252+0000","last_peered":"2024-04-23T18:33:01.223252+0000","last_clean":"2024-04-23T18:33:01.223252+0000","last_became_active":"2024-04-23T18:29:13.501988+0000","last_became_peered":"2024-04-23T18:29:13.501988+0000","last_unstale":"2024-04-23T18:33:01.223252+0000","last_undegraded":"2024-04-23T18:33:01.223252+0000","last_fullsized":"2024-04-23T18:33:01.223252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:01.223122+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:01.223122+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.223122+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:46:24.673897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.881811+0000","last_change":"2024-04-23T18:33:06.881811+0000","last_active":"2024-04-23T18:33:06.881811+0000","last_peered":"2024-04-23T18:33:06.881811+0000","last_clean":"2024-04-23T18:33:06.881811+0000","last_became_active":"2024-04-23T18:29:11.502714+0000","last_became_peered":"2024-04-23T18:29:11.502714+0000","last_unstale":"2024-04-23T18:33:06.881811+0000","last_undegraded":"2024-04-23T18:33:06.881811+0000","last_fullsized":"2024-04-23T18:33:06.881811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:06.881695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:06.881695+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.881695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:02:23.976616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.408483+0000","last_change":"2024-04-23T18:32:56.408483+0000","last_active":"2024-04-23T18:32:56.408483+0000","last_peered":"2024-04-23T18:32:56.408483+0000","last_clean":"2024-04-23T18:32:56.408483+0000","last_became_active":"2024-04-23T18:29:13.498488+0000","last_became_peered":"2024-04-23T18:29:13.498488+0000","last_unstale":"2024-04-23T18:32:56.408483+0000","last_undegraded":"2024-04-23T18:32:56.408483+0000","last_fullsized":"2024-04-23T18:32:56.408483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:56.408370+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:56.408370+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.408370+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:50:09.569283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.286165+0000","last_change":"2024-04-23T18:33:11.286165+0000","last_active":"2024-04-23T18:33:11.286165+0000","last_peered":"2024-04-23T18:33:11.286165+0000","last_clean":"2024-04-23T18:33:11.286165+0000","last_became_active":"2024-04-23T18:29:11.495025+0000","last_became_peered":"2024-04-23T18:29:11.495025+0000","last_unstale":"2024-04-23T18:33:11.286165+0000","last_undegraded":"2024-04-23T18:33:11.286165+0000","last_fullsized":"2024-04-23T18:33:11.286165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:11.286048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:11.286048+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.286048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:58.054788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.905141+0000","last_change":"2024-04-23T18:33:01.905141+0000","last_active":"2024-04-23T18:33:01.905141+0000","last_peered":"2024-04-23T18:33:01.905141+0000","last_clean":"2024-04-23T18:33:01.905141+0000","last_became_active":"2024-04-23T18:29:13.494080+0000","last_became_peered":"2024-04-23T18:29:13.494080+0000","last_unstale":"2024-04-23T18:33:01.905141+0000","last_undegraded":"2024-04-23T18:33:01.905141+0000","last_fullsized":"2024-04-23T18:33:01.905141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:01.905014+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:01.905014+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.905014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:34.294317+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:31.440603+0000","last_change":"2024-04-23T18:33:31.440603+0000","last_active":"2024-04-23T18:33:31.440603+0000","last_peered":"2024-04-23T18:33:31.440603+0000","last_clean":"2024-04-23T18:33:31.440603+0000","last_became_active":"2024-04-23T18:29:11.507336+0000","last_became_peered":"2024-04-23T18:29:11.507336+0000","last_unstale":"2024-04-23T18:33:31.440603+0000","last_undegraded":"2024-04-23T18:33:31.440603+0000","last_fullsized":"2024-04-23T18:33:31.440603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:31.440484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:31.440484+0000","last_clean_scrub_stamp":"2024-04-23T18:33:31.440484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:07.664670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'38","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.907029+0000","last_change":"2024-04-23T18:32:55.907029+0000","last_active":"2024-04-23T18:32:55.907029+0000","last_peered":"2024-04-23T18:32:55.907029+0000","last_clean":"2024-04-23T18:32:55.907029+0000","last_became_active":"2024-04-23T18:29:21.529771+0000","last_became_peered":"2024-04-23T18:29:21.529771+0000","last_unstale":"2024-04-23T18:32:55.907029+0000","last_undegraded":"2024-04-23T18:32:55.907029+0000","last_fullsized":"2024-04-23T18:32:55.907029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-04-23T18:32:55.906902+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-04-23T18:32:55.906902+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.906902+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:18.086470+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":174,"num_write":103,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'22","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:25.481479+0000","last_change":"2024-04-23T18:33:25.481507+0000","last_active":"2024-04-23T18:33:25.481479+0000","last_peered":"2024-04-23T18:33:25.481479+0000","last_clean":"2024-04-23T18:33:25.481479+0000","last_became_active":"2024-04-23T18:29:52.549641+0000","last_became_peered":"2024-04-23T18:29:52.549641+0000","last_unstale":"2024-04-23T18:33:25.481479+0000","last_undegraded":"2024-04-23T18:33:25.481479+0000","last_fullsized":"2024-04-23T18:33:25.481479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-23T18:33:25.481391+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-23T18:33:25.481391+0000","last_clean_scrub_stamp":"2024-04-23T18:33:25.481391+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:34.798802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":69,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:22.457711+0000","last_change":"2024-04-23T18:33:22.457711+0000","last_active":"2024-04-23T18:33:22.457711+0000","last_peered":"2024-04-23T18:33:22.457711+0000","last_clean":"2024-04-23T18:33:22.457711+0000","last_became_active":"2024-04-23T18:29:11.512062+0000","last_became_peered":"2024-04-23T18:29:11.512062+0000","last_unstale":"2024-04-23T18:33:22.457711+0000","last_undegraded":"2024-04-23T18:33:22.457711+0000","last_fullsized":"2024-04-23T18:33:22.457711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:22.457594+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:22.457594+0000","last_clean_scrub_stamp":"2024-04-23T18:33:22.457594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:44.174801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.393525+0000","last_change":"2024-04-23T18:32:36.393525+0000","last_active":"2024-04-23T18:32:36.393525+0000","last_peered":"2024-04-23T18:32:36.393525+0000","last_clean":"2024-04-23T18:32:36.393525+0000","last_became_active":"2024-04-23T18:29:15.508100+0000","last_became_peered":"2024-04-23T18:29:15.508100+0000","last_unstale":"2024-04-23T18:32:36.393525+0000","last_undegraded":"2024-04-23T18:32:36.393525+0000","last_fullsized":"2024-04-23T18:32:36.393525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.393398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.393398+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.393398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:58:14.247382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.399750+0000","last_change":"2024-04-23T18:32:43.399750+0000","last_active":"2024-04-23T18:32:43.399750+0000","last_peered":"2024-04-23T18:32:43.399750+0000","last_clean":"2024-04-23T18:32:43.399750+0000","last_became_active":"2024-04-23T18:29:17.513368+0000","last_became_peered":"2024-04-23T18:29:17.513368+0000","last_unstale":"2024-04-23T18:32:43.399750+0000","last_undegraded":"2024-04-23T18:32:43.399750+0000","last_fullsized":"2024-04-23T18:32:43.399750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:43.399581+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:43.399581+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.399581+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:04.955093+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.915380+0000","last_change":"2024-04-23T18:32:35.915380+0000","last_active":"2024-04-23T18:32:35.915380+0000","last_peered":"2024-04-23T18:32:35.915380+0000","last_clean":"2024-04-23T18:32:35.915380+0000","last_became_active":"2024-04-23T18:29:19.520066+0000","last_became_peered":"2024-04-23T18:29:19.520066+0000","last_unstale":"2024-04-23T18:32:35.915380+0000","last_undegraded":"2024-04-23T18:32:35.915380+0000","last_fullsized":"2024-04-23T18:32:35.915380+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.915263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.915263+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.915263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:33.026516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.878542+0000","last_change":"2024-04-23T18:32:51.878542+0000","last_active":"2024-04-23T18:32:51.878542+0000","last_peered":"2024-04-23T18:32:51.878542+0000","last_clean":"2024-04-23T18:32:51.878542+0000","last_became_active":"2024-04-23T18:29:21.529743+0000","last_became_peered":"2024-04-23T18:29:21.529743+0000","last_unstale":"2024-04-23T18:32:51.878542+0000","last_undegraded":"2024-04-23T18:32:51.878542+0000","last_fullsized":"2024-04-23T18:32:51.878542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-23T18:32:51.878417+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-23T18:32:51.878417+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.878417+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:39.785762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.444793+0000","last_change":"2024-04-23T18:33:10.444793+0000","last_active":"2024-04-23T18:33:10.444793+0000","last_peered":"2024-04-23T18:33:10.444793+0000","last_clean":"2024-04-23T18:33:10.444793+0000","last_became_active":"2024-04-23T18:29:13.496299+0000","last_became_peered":"2024-04-23T18:29:13.496299+0000","last_unstale":"2024-04-23T18:33:10.444793+0000","last_undegraded":"2024-04-23T18:33:10.444793+0000","last_fullsized":"2024-04-23T18:33:10.444793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:10.444658+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:10.444658+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.444658+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:35:16.256466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.324598+0000","last_change":"2024-04-23T18:33:00.324598+0000","last_active":"2024-04-23T18:33:00.324598+0000","last_peered":"2024-04-23T18:33:00.324598+0000","last_clean":"2024-04-23T18:33:00.324598+0000","last_became_active":"2024-04-23T18:29:11.496878+0000","last_became_peered":"2024-04-23T18:29:11.496878+0000","last_unstale":"2024-04-23T18:33:00.324598+0000","last_undegraded":"2024-04-23T18:33:00.324598+0000","last_fullsized":"2024-04-23T18:33:00.324598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:00.324482+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:00.324482+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.324482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:37:16.117012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.219506+0000","last_change":"2024-04-23T18:32:55.219506+0000","last_active":"2024-04-23T18:32:55.219506+0000","last_peered":"2024-04-23T18:32:55.219506+0000","last_clean":"2024-04-23T18:32:55.219506+0000","last_became_active":"2024-04-23T18:29:15.504744+0000","last_became_peered":"2024-04-23T18:29:15.504744+0000","last_unstale":"2024-04-23T18:32:55.219506+0000","last_undegraded":"2024-04-23T18:32:55.219506+0000","last_fullsized":"2024-04-23T18:32:55.219506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:55.219376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:55.219376+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.219376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:01:48.896771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.884678+0000","last_change":"2024-04-23T18:32:37.884678+0000","last_active":"2024-04-23T18:32:37.884678+0000","last_peered":"2024-04-23T18:32:37.884678+0000","last_clean":"2024-04-23T18:32:37.884678+0000","last_became_active":"2024-04-23T18:29:17.510201+0000","last_became_peered":"2024-04-23T18:29:17.510201+0000","last_unstale":"2024-04-23T18:32:37.884678+0000","last_undegraded":"2024-04-23T18:32:37.884678+0000","last_fullsized":"2024-04-23T18:32:37.884678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-23T18:32:37.884529+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-23T18:32:37.884529+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.884529+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:36.954621+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.869829+0000","last_change":"2024-04-23T18:32:43.869829+0000","last_active":"2024-04-23T18:32:43.869829+0000","last_peered":"2024-04-23T18:32:43.869829+0000","last_clean":"2024-04-23T18:32:43.869829+0000","last_became_active":"2024-04-23T18:29:19.527770+0000","last_became_peered":"2024-04-23T18:29:19.527770+0000","last_unstale":"2024-04-23T18:32:43.869829+0000","last_undegraded":"2024-04-23T18:32:43.869829+0000","last_fullsized":"2024-04-23T18:32:43.869829+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:43.869698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:43.869698+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.869698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:06.080613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.191867+0000","last_change":"2024-04-23T18:33:00.191895+0000","last_active":"2024-04-23T18:33:00.191867+0000","last_peered":"2024-04-23T18:33:00.191867+0000","last_clean":"2024-04-23T18:33:00.191867+0000","last_became_active":"2024-04-23T18:29:21.525940+0000","last_became_peered":"2024-04-23T18:29:21.525940+0000","last_unstale":"2024-04-23T18:33:00.191867+0000","last_undegraded":"2024-04-23T18:33:00.191867+0000","last_fullsized":"2024-04-23T18:33:00.191867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:00.191774+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:00.191774+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.191774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:05:50.166534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:13.407434+0000","last_change":"2024-04-23T18:33:13.407434+0000","last_active":"2024-04-23T18:33:13.407434+0000","last_peered":"2024-04-23T18:33:13.407434+0000","last_clean":"2024-04-23T18:33:13.407434+0000","last_became_active":"2024-04-23T18:29:13.496142+0000","last_became_peered":"2024-04-23T18:29:13.496142+0000","last_unstale":"2024-04-23T18:33:13.407434+0000","last_undegraded":"2024-04-23T18:33:13.407434+0000","last_fullsized":"2024-04-23T18:33:13.407434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:13.407310+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:13.407310+0000","last_clean_scrub_stamp":"2024-04-23T18:33:13.407310+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:15:28.507825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:34.414949+0000","last_change":"2024-04-23T18:33:34.414949+0000","last_active":"2024-04-23T18:33:34.414949+0000","last_peered":"2024-04-23T18:33:34.414949+0000","last_clean":"2024-04-23T18:33:34.414949+0000","last_became_active":"2024-04-23T18:29:11.504534+0000","last_became_peered":"2024-04-23T18:29:11.504534+0000","last_unstale":"2024-04-23T18:33:34.414949+0000","last_undegraded":"2024-04-23T18:33:34.414949+0000","last_fullsized":"2024-04-23T18:33:34.414949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:34.414792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:34.414792+0000","last_clean_scrub_stamp":"2024-04-23T18:33:34.414792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:15:29.372141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.226428+0000","last_change":"2024-04-23T18:32:51.226428+0000","last_active":"2024-04-23T18:32:51.226428+0000","last_peered":"2024-04-23T18:32:51.226428+0000","last_clean":"2024-04-23T18:32:51.226428+0000","last_became_active":"2024-04-23T18:29:15.510018+0000","last_became_peered":"2024-04-23T18:29:15.510018+0000","last_unstale":"2024-04-23T18:32:51.226428+0000","last_undegraded":"2024-04-23T18:32:51.226428+0000","last_fullsized":"2024-04-23T18:32:51.226428+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:51.226310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:51.226310+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.226310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:48.331725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.411841+0000","last_change":"2024-04-23T18:32:39.411841+0000","last_active":"2024-04-23T18:32:39.411841+0000","last_peered":"2024-04-23T18:32:39.411841+0000","last_clean":"2024-04-23T18:32:39.411841+0000","last_became_active":"2024-04-23T18:29:17.517679+0000","last_became_peered":"2024-04-23T18:29:17.517679+0000","last_unstale":"2024-04-23T18:32:39.411841+0000","last_undegraded":"2024-04-23T18:32:39.411841+0000","last_fullsized":"2024-04-23T18:32:39.411841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:32:39.411679+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:32:39.411679+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.411679+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:33:43.011129+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":395,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.433088+0000","last_change":"2024-04-23T18:32:59.433088+0000","last_active":"2024-04-23T18:32:59.433088+0000","last_peered":"2024-04-23T18:32:59.433088+0000","last_clean":"2024-04-23T18:32:59.433088+0000","last_became_active":"2024-04-23T18:29:19.522434+0000","last_became_peered":"2024-04-23T18:29:19.522434+0000","last_unstale":"2024-04-23T18:32:59.433088+0000","last_undegraded":"2024-04-23T18:32:59.433088+0000","last_fullsized":"2024-04-23T18:32:59.433088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-04-23T18:32:59.432941+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-04-23T18:32:59.432941+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.432941+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:33.938084+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.484842+0000","last_change":"2024-04-23T18:32:45.484880+0000","last_active":"2024-04-23T18:32:45.484842+0000","last_peered":"2024-04-23T18:32:45.484842+0000","last_clean":"2024-04-23T18:32:45.484842+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:32:45.484842+0000","last_undegraded":"2024-04-23T18:32:45.484842+0000","last_fullsized":"2024-04-23T18:32:45.484842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:45.484750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:45.484750+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.484750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:42:44.554843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:26.421752+0000","last_change":"2024-04-23T18:33:26.421752+0000","last_active":"2024-04-23T18:33:26.421752+0000","last_peered":"2024-04-23T18:33:26.421752+0000","last_clean":"2024-04-23T18:33:26.421752+0000","last_became_active":"2024-04-23T18:29:13.499248+0000","last_became_peered":"2024-04-23T18:29:13.499248+0000","last_unstale":"2024-04-23T18:33:26.421752+0000","last_undegraded":"2024-04-23T18:33:26.421752+0000","last_fullsized":"2024-04-23T18:33:26.421752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:26.421630+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:26.421630+0000","last_clean_scrub_stamp":"2024-04-23T18:33:26.421630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:04:38.089082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:18.796628+0000","last_change":"2024-04-23T18:33:18.796628+0000","last_active":"2024-04-23T18:33:18.796628+0000","last_peered":"2024-04-23T18:33:18.796628+0000","last_clean":"2024-04-23T18:33:18.796628+0000","last_became_active":"2024-04-23T18:29:11.488531+0000","last_became_peered":"2024-04-23T18:29:11.488531+0000","last_unstale":"2024-04-23T18:33:18.796628+0000","last_undegraded":"2024-04-23T18:33:18.796628+0000","last_fullsized":"2024-04-23T18:33:18.796628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:18.796499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:18.796499+0000","last_clean_scrub_stamp":"2024-04-23T18:33:18.796499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:01.729188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.385539+0000","last_change":"2024-04-23T18:32:33.385539+0000","last_active":"2024-04-23T18:32:33.385539+0000","last_peered":"2024-04-23T18:32:33.385539+0000","last_clean":"2024-04-23T18:32:33.385539+0000","last_became_active":"2024-04-23T18:29:15.511249+0000","last_became_peered":"2024-04-23T18:29:15.511249+0000","last_unstale":"2024-04-23T18:32:33.385539+0000","last_undegraded":"2024-04-23T18:32:33.385539+0000","last_fullsized":"2024-04-23T18:32:33.385539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.385380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.385380+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.385380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:14.265560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.451387+0000","last_change":"2024-04-23T18:32:38.451387+0000","last_active":"2024-04-23T18:32:38.451387+0000","last_peered":"2024-04-23T18:32:38.451387+0000","last_clean":"2024-04-23T18:32:38.451387+0000","last_became_active":"2024-04-23T18:29:17.517964+0000","last_became_peered":"2024-04-23T18:29:17.517964+0000","last_unstale":"2024-04-23T18:32:38.451387+0000","last_undegraded":"2024-04-23T18:32:38.451387+0000","last_fullsized":"2024-04-23T18:32:38.451387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-04-23T18:32:38.451267+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-04-23T18:32:38.451267+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.451267+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:18:00.657607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":454,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.249059+0000","last_change":"2024-04-23T18:32:44.249059+0000","last_active":"2024-04-23T18:32:44.249059+0000","last_peered":"2024-04-23T18:32:44.249059+0000","last_clean":"2024-04-23T18:32:44.249059+0000","last_became_active":"2024-04-23T18:29:19.524881+0000","last_became_peered":"2024-04-23T18:29:19.524881+0000","last_unstale":"2024-04-23T18:32:44.249059+0000","last_undegraded":"2024-04-23T18:32:44.249059+0000","last_fullsized":"2024-04-23T18:32:44.249059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:44.248886+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:44.248886+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.248886+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:27.941657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'12","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.427187+0000","last_change":"2024-04-23T18:32:52.427187+0000","last_active":"2024-04-23T18:32:52.427187+0000","last_peered":"2024-04-23T18:32:52.427187+0000","last_clean":"2024-04-23T18:32:52.427187+0000","last_became_active":"2024-04-23T18:29:13.501472+0000","last_became_peered":"2024-04-23T18:29:13.501472+0000","last_unstale":"2024-04-23T18:32:52.427187+0000","last_undegraded":"2024-04-23T18:32:52.427187+0000","last_fullsized":"2024-04-23T18:32:52.427187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:32:52.427080+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:32:52.427080+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.427080+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:43:34.900178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'5","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:16.478425+0000","last_change":"2024-04-23T18:33:16.478425+0000","last_active":"2024-04-23T18:33:16.478425+0000","last_peered":"2024-04-23T18:33:16.478425+0000","last_clean":"2024-04-23T18:33:16.478425+0000","last_became_active":"2024-04-23T18:29:11.481977+0000","last_became_peered":"2024-04-23T18:29:11.481977+0000","last_unstale":"2024-04-23T18:33:16.478425+0000","last_undegraded":"2024-04-23T18:33:16.478425+0000","last_fullsized":"2024-04-23T18:33:16.478425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:33:16.478310+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:33:16.478310+0000","last_clean_scrub_stamp":"2024-04-23T18:33:16.478310+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:51.551514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.905482+0000","last_change":"2024-04-23T18:32:45.905482+0000","last_active":"2024-04-23T18:32:45.905482+0000","last_peered":"2024-04-23T18:32:45.905482+0000","last_clean":"2024-04-23T18:32:45.905482+0000","last_became_active":"2024-04-23T18:29:15.509711+0000","last_became_peered":"2024-04-23T18:29:15.509711+0000","last_unstale":"2024-04-23T18:32:45.905482+0000","last_undegraded":"2024-04-23T18:32:45.905482+0000","last_fullsized":"2024-04-23T18:32:45.905482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:45.905366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:45.905366+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.905366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:55:07.535829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'51","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.525489+0000","last_change":"2024-04-23T18:32:46.525489+0000","last_active":"2024-04-23T18:32:46.525489+0000","last_peered":"2024-04-23T18:32:46.525489+0000","last_clean":"2024-04-23T18:32:46.525489+0000","last_became_active":"2024-04-23T18:29:17.511085+0000","last_became_peered":"2024-04-23T18:29:17.511085+0000","last_unstale":"2024-04-23T18:32:46.525489+0000","last_undegraded":"2024-04-23T18:32:46.525489+0000","last_fullsized":"2024-04-23T18:32:46.525489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'51","last_scrub_stamp":"2024-04-23T18:32:46.525299+0000","last_deep_scrub":"34'51","last_deep_scrub_stamp":"2024-04-23T18:32:46.525299+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.525299+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:46:11.482573+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.255269+0000","last_change":"2024-04-23T18:32:52.255269+0000","last_active":"2024-04-23T18:32:52.255269+0000","last_peered":"2024-04-23T18:32:52.255269+0000","last_clean":"2024-04-23T18:32:52.255269+0000","last_became_active":"2024-04-23T18:29:19.527505+0000","last_became_peered":"2024-04-23T18:29:19.527505+0000","last_unstale":"2024-04-23T18:32:52.255269+0000","last_undegraded":"2024-04-23T18:32:52.255269+0000","last_fullsized":"2024-04-23T18:32:52.255269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:52.255147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:52.255147+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.255147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:39:47.960787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'13","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:21.502813+0000","last_change":"2024-04-23T18:33:21.502813+0000","last_active":"2024-04-23T18:33:21.502813+0000","last_peered":"2024-04-23T18:33:21.502813+0000","last_clean":"2024-04-23T18:33:21.502813+0000","last_became_active":"2024-04-23T18:29:21.532163+0000","last_became_peered":"2024-04-23T18:29:21.532163+0000","last_unstale":"2024-04-23T18:33:21.502813+0000","last_undegraded":"2024-04-23T18:33:21.502813+0000","last_fullsized":"2024-04-23T18:33:21.502813+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-04-23T18:33:21.502620+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-04-23T18:33:21.502620+0000","last_clean_scrub_stamp":"2024-04-23T18:33:21.502620+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:49:58.491159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":20,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.935115+0000","last_change":"2024-04-23T18:33:03.935115+0000","last_active":"2024-04-23T18:33:03.935115+0000","last_peered":"2024-04-23T18:33:03.935115+0000","last_clean":"2024-04-23T18:33:03.935115+0000","last_became_active":"2024-04-23T18:29:13.494108+0000","last_became_peered":"2024-04-23T18:29:13.494108+0000","last_unstale":"2024-04-23T18:33:03.935115+0000","last_undegraded":"2024-04-23T18:33:03.935115+0000","last_fullsized":"2024-04-23T18:33:03.935115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:03.934976+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:03.934976+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.934976+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:46.714997+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:12.356679+0000","last_change":"2024-04-23T18:33:12.356679+0000","last_active":"2024-04-23T18:33:12.356679+0000","last_peered":"2024-04-23T18:33:12.356679+0000","last_clean":"2024-04-23T18:33:12.356679+0000","last_became_active":"2024-04-23T18:29:11.481419+0000","last_became_peered":"2024-04-23T18:29:11.481419+0000","last_unstale":"2024-04-23T18:33:12.356679+0000","last_undegraded":"2024-04-23T18:33:12.356679+0000","last_fullsized":"2024-04-23T18:33:12.356679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:12.356553+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:12.356553+0000","last_clean_scrub_stamp":"2024-04-23T18:33:12.356553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:48.659583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.197825+0000","last_change":"2024-04-23T18:32:49.197825+0000","last_active":"2024-04-23T18:32:49.197825+0000","last_peered":"2024-04-23T18:32:49.197825+0000","last_clean":"2024-04-23T18:32:49.197825+0000","last_became_active":"2024-04-23T18:29:15.510135+0000","last_became_peered":"2024-04-23T18:29:15.510135+0000","last_unstale":"2024-04-23T18:32:49.197825+0000","last_undegraded":"2024-04-23T18:32:49.197825+0000","last_fullsized":"2024-04-23T18:32:49.197825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:49.197658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:49.197658+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.197658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:11:00.797470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.367999+0000","last_change":"2024-04-23T18:32:45.367999+0000","last_active":"2024-04-23T18:32:45.367999+0000","last_peered":"2024-04-23T18:32:45.367999+0000","last_clean":"2024-04-23T18:32:45.367999+0000","last_became_active":"2024-04-23T18:29:17.513447+0000","last_became_peered":"2024-04-23T18:29:17.513447+0000","last_unstale":"2024-04-23T18:32:45.367999+0000","last_undegraded":"2024-04-23T18:32:45.367999+0000","last_fullsized":"2024-04-23T18:32:45.367999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:45.367847+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:45.367847+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.367847+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:39.796664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.422658+0000","last_change":"2024-04-23T18:32:33.422658+0000","last_active":"2024-04-23T18:32:33.422658+0000","last_peered":"2024-04-23T18:32:33.422658+0000","last_clean":"2024-04-23T18:32:33.422658+0000","last_became_active":"2024-04-23T18:29:19.518695+0000","last_became_peered":"2024-04-23T18:29:19.518695+0000","last_unstale":"2024-04-23T18:32:33.422658+0000","last_undegraded":"2024-04-23T18:32:33.422658+0000","last_fullsized":"2024-04-23T18:32:33.422658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.422540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.422540+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.422540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:19.231250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'6","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:27.728063+0000","last_change":"2024-04-23T18:33:27.728063+0000","last_active":"2024-04-23T18:33:27.728063+0000","last_peered":"2024-04-23T18:33:27.728063+0000","last_clean":"2024-04-23T18:33:27.728063+0000","last_became_active":"2024-04-23T18:29:21.533103+0000","last_became_peered":"2024-04-23T18:29:21.533103+0000","last_unstale":"2024-04-23T18:33:27.728063+0000","last_undegraded":"2024-04-23T18:33:27.728063+0000","last_fullsized":"2024-04-23T18:33:27.728063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:27.727942+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:27.727942+0000","last_clean_scrub_stamp":"2024-04-23T18:33:27.727942+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:42.711771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'12","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.333394+0000","last_change":"2024-04-23T18:33:01.333394+0000","last_active":"2024-04-23T18:33:01.333394+0000","last_peered":"2024-04-23T18:33:01.333394+0000","last_clean":"2024-04-23T18:33:01.333394+0000","last_became_active":"2024-04-23T18:29:13.499795+0000","last_became_peered":"2024-04-23T18:29:13.499795+0000","last_unstale":"2024-04-23T18:33:01.333394+0000","last_undegraded":"2024-04-23T18:33:01.333394+0000","last_fullsized":"2024-04-23T18:33:01.333394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:33:01.333276+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:33:01.333276+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.333276+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:19.961956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:36.440118+0000","last_change":"2024-04-23T18:33:36.440118+0000","last_active":"2024-04-23T18:33:36.440118+0000","last_peered":"2024-04-23T18:33:36.440118+0000","last_clean":"2024-04-23T18:33:36.440118+0000","last_became_active":"2024-04-23T18:29:11.503228+0000","last_became_peered":"2024-04-23T18:29:11.503228+0000","last_unstale":"2024-04-23T18:33:36.440118+0000","last_undegraded":"2024-04-23T18:33:36.440118+0000","last_fullsized":"2024-04-23T18:33:36.440118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:36.440004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:36.440004+0000","last_clean_scrub_stamp":"2024-04-23T18:33:36.440004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:02.976506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.210518+0000","last_change":"2024-04-23T18:32:50.210518+0000","last_active":"2024-04-23T18:32:50.210518+0000","last_peered":"2024-04-23T18:32:50.210518+0000","last_clean":"2024-04-23T18:32:50.210518+0000","last_became_active":"2024-04-23T18:29:15.509856+0000","last_became_peered":"2024-04-23T18:29:15.509856+0000","last_unstale":"2024-04-23T18:32:50.210518+0000","last_undegraded":"2024-04-23T18:32:50.210518+0000","last_fullsized":"2024-04-23T18:32:50.210518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.210358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.210358+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.210358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:56.040362+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.397630+0000","last_change":"2024-04-23T18:32:56.397630+0000","last_active":"2024-04-23T18:32:56.397630+0000","last_peered":"2024-04-23T18:32:56.397630+0000","last_clean":"2024-04-23T18:32:56.397630+0000","last_became_active":"2024-04-23T18:29:17.517116+0000","last_became_peered":"2024-04-23T18:29:17.517116+0000","last_unstale":"2024-04-23T18:32:56.397630+0000","last_undegraded":"2024-04-23T18:32:56.397630+0000","last_fullsized":"2024-04-23T18:32:56.397630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:56.397494+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:56.397494+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.397494+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:45.517482+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":361,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.374033+0000","last_change":"2024-04-23T18:32:34.374033+0000","last_active":"2024-04-23T18:32:34.374033+0000","last_peered":"2024-04-23T18:32:34.374033+0000","last_clean":"2024-04-23T18:32:34.374033+0000","last_became_active":"2024-04-23T18:29:19.518519+0000","last_became_peered":"2024-04-23T18:29:19.518519+0000","last_unstale":"2024-04-23T18:32:34.374033+0000","last_undegraded":"2024-04-23T18:32:34.374033+0000","last_fullsized":"2024-04-23T18:32:34.374033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:34.373847+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:34.373847+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.373847+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:40:46.115582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:30.442179+0000","last_change":"2024-04-23T18:33:30.442179+0000","last_active":"2024-04-23T18:33:30.442179+0000","last_peered":"2024-04-23T18:33:30.442179+0000","last_clean":"2024-04-23T18:33:30.442179+0000","last_became_active":"2024-04-23T18:29:21.528917+0000","last_became_peered":"2024-04-23T18:29:21.528917+0000","last_unstale":"2024-04-23T18:33:30.442179+0000","last_undegraded":"2024-04-23T18:33:30.442179+0000","last_fullsized":"2024-04-23T18:33:30.442179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:30.442064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:30.442064+0000","last_clean_scrub_stamp":"2024-04-23T18:33:30.442064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:28:13.897681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.456298+0000","last_change":"2024-04-23T18:32:55.456298+0000","last_active":"2024-04-23T18:32:55.456298+0000","last_peered":"2024-04-23T18:32:55.456298+0000","last_clean":"2024-04-23T18:32:55.456298+0000","last_became_active":"2024-04-23T18:29:13.499216+0000","last_became_peered":"2024-04-23T18:29:13.499216+0000","last_unstale":"2024-04-23T18:32:55.456298+0000","last_undegraded":"2024-04-23T18:32:55.456298+0000","last_fullsized":"2024-04-23T18:32:55.456298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:55.456182+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:55.456182+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.456182+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:19.038136+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:49.450373+0000","last_change":"2024-04-23T18:33:49.450398+0000","last_active":"2024-04-23T18:33:49.450373+0000","last_peered":"2024-04-23T18:33:49.450373+0000","last_clean":"2024-04-23T18:33:49.450373+0000","last_became_active":"2024-04-23T18:29:11.511211+0000","last_became_peered":"2024-04-23T18:29:11.511211+0000","last_unstale":"2024-04-23T18:33:49.450373+0000","last_undegraded":"2024-04-23T18:33:49.450373+0000","last_fullsized":"2024-04-23T18:33:49.450373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:49.450276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:49.450276+0000","last_clean_scrub_stamp":"2024-04-23T18:33:49.450276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:45.449379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.217082+0000","last_change":"2024-04-23T18:32:47.217082+0000","last_active":"2024-04-23T18:32:47.217082+0000","last_peered":"2024-04-23T18:32:47.217082+0000","last_clean":"2024-04-23T18:32:47.217082+0000","last_became_active":"2024-04-23T18:29:15.510350+0000","last_became_peered":"2024-04-23T18:29:15.510350+0000","last_unstale":"2024-04-23T18:32:47.217082+0000","last_undegraded":"2024-04-23T18:32:47.217082+0000","last_fullsized":"2024-04-23T18:32:47.217082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:47.216965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:47.216965+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.216965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:00:24.954770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'63","reported_seq":137,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.448618+0000","last_change":"2024-04-23T18:32:51.448618+0000","last_active":"2024-04-23T18:32:51.448618+0000","last_peered":"2024-04-23T18:32:51.448618+0000","last_clean":"2024-04-23T18:32:51.448618+0000","last_became_active":"2024-04-23T18:29:17.513298+0000","last_became_peered":"2024-04-23T18:29:17.513298+0000","last_unstale":"2024-04-23T18:32:51.448618+0000","last_undegraded":"2024-04-23T18:32:51.448618+0000","last_fullsized":"2024-04-23T18:32:51.448618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'63","last_scrub_stamp":"2024-04-23T18:32:51.448483+0000","last_deep_scrub":"34'63","last_deep_scrub_stamp":"2024-04-23T18:32:51.448483+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.448483+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:25.305379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.325849+0000","last_change":"2024-04-23T18:32:35.325849+0000","last_active":"2024-04-23T18:32:35.325849+0000","last_peered":"2024-04-23T18:32:35.325849+0000","last_clean":"2024-04-23T18:32:35.325849+0000","last_became_active":"2024-04-23T18:29:19.518015+0000","last_became_peered":"2024-04-23T18:29:19.518015+0000","last_unstale":"2024-04-23T18:32:35.325849+0000","last_undegraded":"2024-04-23T18:32:35.325849+0000","last_fullsized":"2024-04-23T18:32:35.325849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.325670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.325670+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.325670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:51.615968+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'24","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:31.430618+0000","last_change":"2024-04-23T18:33:31.430618+0000","last_active":"2024-04-23T18:33:31.430618+0000","last_peered":"2024-04-23T18:33:31.430618+0000","last_clean":"2024-04-23T18:33:31.430618+0000","last_became_active":"2024-04-23T18:29:21.529498+0000","last_became_peered":"2024-04-23T18:29:21.529498+0000","last_unstale":"2024-04-23T18:33:31.430618+0000","last_undegraded":"2024-04-23T18:33:31.430618+0000","last_fullsized":"2024-04-23T18:33:31.430618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-04-23T18:33:31.430489+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-04-23T18:33:31.430489+0000","last_clean_scrub_stamp":"2024-04-23T18:33:31.430489+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:19:24.010938+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1317,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:31.696980+0000","last_change":"2024-04-23T18:33:31.696980+0000","last_active":"2024-04-23T18:33:31.696980+0000","last_peered":"2024-04-23T18:33:31.696980+0000","last_clean":"2024-04-23T18:33:31.696980+0000","last_became_active":"2024-04-23T18:29:52.550778+0000","last_became_peered":"2024-04-23T18:29:52.550778+0000","last_unstale":"2024-04-23T18:33:31.696980+0000","last_undegraded":"2024-04-23T18:33:31.696980+0000","last_fullsized":"2024-04-23T18:33:31.696980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:31.696847+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:31.696847+0000","last_clean_scrub_stamp":"2024-04-23T18:33:31.696847+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:42.394104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:20.282753+0000","last_change":"2024-04-23T18:33:20.282753+0000","last_active":"2024-04-23T18:33:20.282753+0000","last_peered":"2024-04-23T18:33:20.282753+0000","last_clean":"2024-04-23T18:33:20.282753+0000","last_became_active":"2024-04-23T18:29:11.485899+0000","last_became_peered":"2024-04-23T18:29:11.485899+0000","last_unstale":"2024-04-23T18:33:20.282753+0000","last_undegraded":"2024-04-23T18:33:20.282753+0000","last_fullsized":"2024-04-23T18:33:20.282753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:20.282575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:20.282575+0000","last_clean_scrub_stamp":"2024-04-23T18:33:20.282575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:36:57.269431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.488240+0000","last_change":"2024-04-23T18:32:48.488240+0000","last_active":"2024-04-23T18:32:48.488240+0000","last_peered":"2024-04-23T18:32:48.488240+0000","last_clean":"2024-04-23T18:32:48.488240+0000","last_became_active":"2024-04-23T18:29:15.506940+0000","last_became_peered":"2024-04-23T18:29:15.506940+0000","last_unstale":"2024-04-23T18:32:48.488240+0000","last_undegraded":"2024-04-23T18:32:48.488240+0000","last_fullsized":"2024-04-23T18:32:48.488240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:32:48.488120+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:32:48.488120+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.488120+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:48.524111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.911658+0000","last_change":"2024-04-23T18:32:38.911658+0000","last_active":"2024-04-23T18:32:38.911658+0000","last_peered":"2024-04-23T18:32:38.911658+0000","last_clean":"2024-04-23T18:32:38.911658+0000","last_became_active":"2024-04-23T18:29:17.509586+0000","last_became_peered":"2024-04-23T18:29:17.509586+0000","last_unstale":"2024-04-23T18:32:38.911658+0000","last_undegraded":"2024-04-23T18:32:38.911658+0000","last_fullsized":"2024-04-23T18:32:38.911658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:38.911496+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:38.911496+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.911496+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:46:03.868770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.434051+0000","last_change":"2024-04-23T18:32:53.434051+0000","last_active":"2024-04-23T18:32:53.434051+0000","last_peered":"2024-04-23T18:32:53.434051+0000","last_clean":"2024-04-23T18:32:53.434051+0000","last_became_active":"2024-04-23T18:29:19.521939+0000","last_became_peered":"2024-04-23T18:29:19.521939+0000","last_unstale":"2024-04-23T18:32:53.434051+0000","last_undegraded":"2024-04-23T18:32:53.434051+0000","last_fullsized":"2024-04-23T18:32:53.434051+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:53.433929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:53.433929+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.433929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:02.751340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:23.498478+0000","last_change":"2024-04-23T18:33:23.498510+0000","last_active":"2024-04-23T18:33:23.498478+0000","last_peered":"2024-04-23T18:33:23.498478+0000","last_clean":"2024-04-23T18:33:23.498478+0000","last_became_active":"2024-04-23T18:29:21.530270+0000","last_became_peered":"2024-04-23T18:29:21.530270+0000","last_unstale":"2024-04-23T18:33:23.498478+0000","last_undegraded":"2024-04-23T18:33:23.498478+0000","last_fullsized":"2024-04-23T18:33:23.498478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:23.498381+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:23.498381+0000","last_clean_scrub_stamp":"2024-04-23T18:33:23.498381+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:25.752665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.397470+0000","last_change":"2024-04-23T18:32:46.397470+0000","last_active":"2024-04-23T18:32:46.397470+0000","last_peered":"2024-04-23T18:32:46.397470+0000","last_clean":"2024-04-23T18:32:46.397470+0000","last_became_active":"2024-04-23T18:29:13.501430+0000","last_became_peered":"2024-04-23T18:29:13.501430+0000","last_unstale":"2024-04-23T18:32:46.397470+0000","last_undegraded":"2024-04-23T18:32:46.397470+0000","last_fullsized":"2024-04-23T18:32:46.397470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:46.397327+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:46.397327+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.397327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:08.260300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:33.448137+0000","last_change":"2024-04-23T18:33:33.448164+0000","last_active":"2024-04-23T18:33:33.448137+0000","last_peered":"2024-04-23T18:33:33.448137+0000","last_clean":"2024-04-23T18:33:33.448137+0000","last_became_active":"2024-04-23T18:29:11.507633+0000","last_became_peered":"2024-04-23T18:29:11.507633+0000","last_unstale":"2024-04-23T18:33:33.448137+0000","last_undegraded":"2024-04-23T18:33:33.448137+0000","last_fullsized":"2024-04-23T18:33:33.448137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:33.448049+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:33.448049+0000","last_clean_scrub_stamp":"2024-04-23T18:33:33.448049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:21:16.681365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.266134+0000","last_change":"2024-04-23T18:32:46.266134+0000","last_active":"2024-04-23T18:32:46.266134+0000","last_peered":"2024-04-23T18:32:46.266134+0000","last_clean":"2024-04-23T18:32:46.266134+0000","last_became_active":"2024-04-23T18:29:15.510579+0000","last_became_peered":"2024-04-23T18:29:15.510579+0000","last_unstale":"2024-04-23T18:32:46.266134+0000","last_undegraded":"2024-04-23T18:32:46.266134+0000","last_fullsized":"2024-04-23T18:32:46.266134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:46.265967+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:46.265967+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.265967+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:25:58.382875+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.452506+0000","last_change":"2024-04-23T18:32:44.452506+0000","last_active":"2024-04-23T18:32:44.452506+0000","last_peered":"2024-04-23T18:32:44.452506+0000","last_clean":"2024-04-23T18:32:44.452506+0000","last_became_active":"2024-04-23T18:29:17.512935+0000","last_became_peered":"2024-04-23T18:29:17.512935+0000","last_unstale":"2024-04-23T18:32:44.452506+0000","last_undegraded":"2024-04-23T18:32:44.452506+0000","last_fullsized":"2024-04-23T18:32:44.452506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-23T18:32:44.452352+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-23T18:32:44.452352+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.452352+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:05.628659+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":444,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.342946+0000","last_change":"2024-04-23T18:32:32.342946+0000","last_active":"2024-04-23T18:32:32.342946+0000","last_peered":"2024-04-23T18:32:32.342946+0000","last_clean":"2024-04-23T18:32:32.342946+0000","last_became_active":"2024-04-23T18:29:19.526260+0000","last_became_peered":"2024-04-23T18:29:19.526260+0000","last_unstale":"2024-04-23T18:32:32.342946+0000","last_undegraded":"2024-04-23T18:32:32.342946+0000","last_fullsized":"2024-04-23T18:32:32.342946+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:32.342765+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:32.342765+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.342765+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:52.808626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:27.404270+0000","last_change":"2024-04-23T18:33:27.404270+0000","last_active":"2024-04-23T18:33:27.404270+0000","last_peered":"2024-04-23T18:33:27.404270+0000","last_clean":"2024-04-23T18:33:27.404270+0000","last_became_active":"2024-04-23T18:29:21.527108+0000","last_became_peered":"2024-04-23T18:29:21.527108+0000","last_unstale":"2024-04-23T18:33:27.404270+0000","last_undegraded":"2024-04-23T18:33:27.404270+0000","last_fullsized":"2024-04-23T18:33:27.404270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-04-23T18:33:27.404098+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-04-23T18:33:27.404098+0000","last_clean_scrub_stamp":"2024-04-23T18:33:27.404098+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:24:28.051984+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:19.477996+0000","last_change":"2024-04-23T18:33:19.477996+0000","last_active":"2024-04-23T18:33:19.477996+0000","last_peered":"2024-04-23T18:33:19.477996+0000","last_clean":"2024-04-23T18:33:19.477996+0000","last_became_active":"2024-04-23T18:29:13.504570+0000","last_became_peered":"2024-04-23T18:29:13.504570+0000","last_unstale":"2024-04-23T18:33:19.477996+0000","last_undegraded":"2024-04-23T18:33:19.477996+0000","last_fullsized":"2024-04-23T18:33:19.477996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:19.477867+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:19.477867+0000","last_clean_scrub_stamp":"2024-04-23T18:33:19.477867+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:24:04.002849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:26.536102+0000","last_change":"2024-04-23T18:33:26.536102+0000","last_active":"2024-04-23T18:33:26.536102+0000","last_peered":"2024-04-23T18:33:26.536102+0000","last_clean":"2024-04-23T18:33:26.536102+0000","last_became_active":"2024-04-23T18:29:11.505531+0000","last_became_peered":"2024-04-23T18:29:11.505531+0000","last_unstale":"2024-04-23T18:33:26.536102+0000","last_undegraded":"2024-04-23T18:33:26.536102+0000","last_fullsized":"2024-04-23T18:33:26.536102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:26.535971+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:26.535971+0000","last_clean_scrub_stamp":"2024-04-23T18:33:26.535971+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:50:25.840864+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.926526+0000","last_change":"2024-04-23T18:32:49.926526+0000","last_active":"2024-04-23T18:32:49.926526+0000","last_peered":"2024-04-23T18:32:49.926526+0000","last_clean":"2024-04-23T18:32:49.926526+0000","last_became_active":"2024-04-23T18:29:15.505983+0000","last_became_peered":"2024-04-23T18:29:15.505983+0000","last_unstale":"2024-04-23T18:32:49.926526+0000","last_undegraded":"2024-04-23T18:32:49.926526+0000","last_fullsized":"2024-04-23T18:32:49.926526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:32:49.926413+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:32:49.926413+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.926413+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:58:14.338142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.465286+0000","last_change":"2024-04-23T18:32:39.465286+0000","last_active":"2024-04-23T18:32:39.465286+0000","last_peered":"2024-04-23T18:32:39.465286+0000","last_clean":"2024-04-23T18:32:39.465286+0000","last_became_active":"2024-04-23T18:29:17.513213+0000","last_became_peered":"2024-04-23T18:29:17.513213+0000","last_unstale":"2024-04-23T18:32:39.465286+0000","last_undegraded":"2024-04-23T18:32:39.465286+0000","last_fullsized":"2024-04-23T18:32:39.465286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-23T18:32:39.465155+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-23T18:32:39.465155+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.465155+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:22.245175+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":481,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.880054+0000","last_change":"2024-04-23T18:32:39.880054+0000","last_active":"2024-04-23T18:32:39.880054+0000","last_peered":"2024-04-23T18:32:39.880054+0000","last_clean":"2024-04-23T18:32:39.880054+0000","last_became_active":"2024-04-23T18:29:19.518528+0000","last_became_peered":"2024-04-23T18:29:19.518528+0000","last_unstale":"2024-04-23T18:32:39.880054+0000","last_undegraded":"2024-04-23T18:32:39.880054+0000","last_fullsized":"2024-04-23T18:32:39.880054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:39.879912+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:39.879912+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.879912+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:36.345360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:49.480613+0000","last_change":"2024-04-23T18:32:49.480613+0000","last_active":"2024-04-23T18:32:49.480613+0000","last_peered":"2024-04-23T18:32:49.480613+0000","last_clean":"2024-04-23T18:32:49.480613+0000","last_became_active":"2024-04-23T18:29:21.530946+0000","last_became_peered":"2024-04-23T18:29:21.530946+0000","last_unstale":"2024-04-23T18:32:49.480613+0000","last_undegraded":"2024-04-23T18:32:49.480613+0000","last_fullsized":"2024-04-23T18:32:49.480613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:49.480502+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:49.480502+0000","last_clean_scrub_stamp":"2024-04-23T18:32:49.480502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:18.888990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.873980+0000","last_change":"2024-04-23T18:32:52.873980+0000","last_active":"2024-04-23T18:32:52.873980+0000","last_peered":"2024-04-23T18:32:52.873980+0000","last_clean":"2024-04-23T18:32:52.873980+0000","last_became_active":"2024-04-23T18:29:13.507813+0000","last_became_peered":"2024-04-23T18:29:13.507813+0000","last_unstale":"2024-04-23T18:32:52.873980+0000","last_undegraded":"2024-04-23T18:32:52.873980+0000","last_fullsized":"2024-04-23T18:32:52.873980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:52.873850+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:52.873850+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.873850+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:37:08.666381+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:38.474882+0000","last_change":"2024-04-23T18:33:38.474926+0000","last_active":"2024-04-23T18:33:38.474882+0000","last_peered":"2024-04-23T18:33:38.474882+0000","last_clean":"2024-04-23T18:33:38.474882+0000","last_became_active":"2024-04-23T18:29:11.501432+0000","last_became_peered":"2024-04-23T18:29:11.501432+0000","last_unstale":"2024-04-23T18:33:38.474882+0000","last_undegraded":"2024-04-23T18:33:38.474882+0000","last_fullsized":"2024-04-23T18:33:38.474882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:38.474779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:38.474779+0000","last_clean_scrub_stamp":"2024-04-23T18:33:38.474779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:57:20.271284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.427490+0000","last_change":"2024-04-23T18:32:34.427490+0000","last_active":"2024-04-23T18:32:34.427490+0000","last_peered":"2024-04-23T18:32:34.427490+0000","last_clean":"2024-04-23T18:32:34.427490+0000","last_became_active":"2024-04-23T18:29:15.509701+0000","last_became_peered":"2024-04-23T18:29:15.509701+0000","last_unstale":"2024-04-23T18:32:34.427490+0000","last_undegraded":"2024-04-23T18:32:34.427490+0000","last_fullsized":"2024-04-23T18:32:34.427490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:34.427372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:34.427372+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.427372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:27.299606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'48","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.866441+0000","last_change":"2024-04-23T18:32:40.866441+0000","last_active":"2024-04-23T18:32:40.866441+0000","last_peered":"2024-04-23T18:32:40.866441+0000","last_clean":"2024-04-23T18:32:40.866441+0000","last_became_active":"2024-04-23T18:29:17.509672+0000","last_became_peered":"2024-04-23T18:29:17.509672+0000","last_unstale":"2024-04-23T18:32:40.866441+0000","last_undegraded":"2024-04-23T18:32:40.866441+0000","last_fullsized":"2024-04-23T18:32:40.866441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:40.866301+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:40.866301+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.866301+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:40.902292+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.357709+0000","last_change":"2024-04-23T18:32:33.357709+0000","last_active":"2024-04-23T18:32:33.357709+0000","last_peered":"2024-04-23T18:32:33.357709+0000","last_clean":"2024-04-23T18:32:33.357709+0000","last_became_active":"2024-04-23T18:29:19.526861+0000","last_became_peered":"2024-04-23T18:29:19.526861+0000","last_unstale":"2024-04-23T18:32:33.357709+0000","last_undegraded":"2024-04-23T18:32:33.357709+0000","last_fullsized":"2024-04-23T18:32:33.357709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:33.357572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:33.357572+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.357572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:35:59.244732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.921133+0000","last_change":"2024-04-23T18:32:59.921133+0000","last_active":"2024-04-23T18:32:59.921133+0000","last_peered":"2024-04-23T18:32:59.921133+0000","last_clean":"2024-04-23T18:32:59.921133+0000","last_became_active":"2024-04-23T18:29:21.530612+0000","last_became_peered":"2024-04-23T18:29:21.530612+0000","last_unstale":"2024-04-23T18:32:59.921133+0000","last_undegraded":"2024-04-23T18:32:59.921133+0000","last_fullsized":"2024-04-23T18:32:59.921133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-23T18:32:59.921013+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-23T18:32:59.921013+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.921013+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:38.050899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.476924+0000","last_change":"2024-04-23T18:32:50.476924+0000","last_active":"2024-04-23T18:32:50.476924+0000","last_peered":"2024-04-23T18:32:50.476924+0000","last_clean":"2024-04-23T18:32:50.476924+0000","last_became_active":"2024-04-23T18:29:13.501636+0000","last_became_peered":"2024-04-23T18:29:13.501636+0000","last_unstale":"2024-04-23T18:32:50.476924+0000","last_undegraded":"2024-04-23T18:32:50.476924+0000","last_fullsized":"2024-04-23T18:32:50.476924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:50.476795+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:50.476795+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.476795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:25.999309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":214,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:17.830353+0000","last_change":"2024-04-23T18:33:17.830409+0000","last_active":"2024-04-23T18:33:17.830353+0000","last_peered":"2024-04-23T18:33:17.830353+0000","last_clean":"2024-04-23T18:33:17.830353+0000","last_became_active":"2024-04-23T18:28:58.798001+0000","last_became_peered":"2024-04-23T18:28:58.798001+0000","last_unstale":"2024-04-23T18:33:17.830353+0000","last_undegraded":"2024-04-23T18:33:17.830353+0000","last_fullsized":"2024-04-23T18:33:17.830353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-04-23T18:33:17.830243+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-04-23T18:33:17.830243+0000","last_clean_scrub_stamp":"2024-04-23T18:33:17.830243+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:48:27.147654+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:41.554660+0000","last_change":"2024-04-23T18:33:41.554695+0000","last_active":"2024-04-23T18:33:41.554660+0000","last_peered":"2024-04-23T18:33:41.554660+0000","last_clean":"2024-04-23T18:33:41.554660+0000","last_became_active":"2024-04-23T18:29:03.446324+0000","last_became_peered":"2024-04-23T18:29:03.446324+0000","last_unstale":"2024-04-23T18:33:41.554660+0000","last_undegraded":"2024-04-23T18:33:41.554660+0000","last_fullsized":"2024-04-23T18:33:41.554660+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:41.554569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:41.554569+0000","last_clean_scrub_stamp":"2024-04-23T18:33:41.554569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:52.749775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:21.454345+0000","last_change":"2024-04-23T18:33:21.454345+0000","last_active":"2024-04-23T18:33:21.454345+0000","last_peered":"2024-04-23T18:33:21.454345+0000","last_clean":"2024-04-23T18:33:21.454345+0000","last_became_active":"2024-04-23T18:29:11.512684+0000","last_became_peered":"2024-04-23T18:29:11.512684+0000","last_unstale":"2024-04-23T18:33:21.454345+0000","last_undegraded":"2024-04-23T18:33:21.454345+0000","last_fullsized":"2024-04-23T18:33:21.454345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:21.454232+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:21.454232+0000","last_clean_scrub_stamp":"2024-04-23T18:33:21.454232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:01.167381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:46.866824+0000","last_change":"2024-04-23T18:32:46.866824+0000","last_active":"2024-04-23T18:32:46.866824+0000","last_peered":"2024-04-23T18:32:46.866824+0000","last_clean":"2024-04-23T18:32:46.866824+0000","last_became_active":"2024-04-23T18:29:15.509209+0000","last_became_peered":"2024-04-23T18:29:15.509209+0000","last_unstale":"2024-04-23T18:32:46.866824+0000","last_undegraded":"2024-04-23T18:32:46.866824+0000","last_fullsized":"2024-04-23T18:32:46.866824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:46.866699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:46.866699+0000","last_clean_scrub_stamp":"2024-04-23T18:32:46.866699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:45.485566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'87","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.423434+0000","last_change":"2024-04-23T18:32:47.423434+0000","last_active":"2024-04-23T18:32:47.423434+0000","last_peered":"2024-04-23T18:32:47.423434+0000","last_clean":"2024-04-23T18:32:47.423434+0000","last_became_active":"2024-04-23T18:29:17.513504+0000","last_became_peered":"2024-04-23T18:29:17.513504+0000","last_unstale":"2024-04-23T18:32:47.423434+0000","last_undegraded":"2024-04-23T18:32:47.423434+0000","last_fullsized":"2024-04-23T18:32:47.423434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-04-23T18:32:47.423269+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-04-23T18:32:47.423269+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.423269+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:31.948251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.310603+0000","last_change":"2024-04-23T18:32:36.310603+0000","last_active":"2024-04-23T18:32:36.310603+0000","last_peered":"2024-04-23T18:32:36.310603+0000","last_clean":"2024-04-23T18:32:36.310603+0000","last_became_active":"2024-04-23T18:29:19.518974+0000","last_became_peered":"2024-04-23T18:29:19.518974+0000","last_unstale":"2024-04-23T18:32:36.310603+0000","last_undegraded":"2024-04-23T18:32:36.310603+0000","last_fullsized":"2024-04-23T18:32:36.310603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.310468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.310468+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.310468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:09:49.509664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'81","reported_seq":172,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:20.467879+0000","last_change":"2024-04-23T18:33:20.467879+0000","last_active":"2024-04-23T18:33:20.467879+0000","last_peered":"2024-04-23T18:33:20.467879+0000","last_clean":"2024-04-23T18:33:20.467879+0000","last_became_active":"2024-04-23T18:29:21.531725+0000","last_became_peered":"2024-04-23T18:29:21.531725+0000","last_unstale":"2024-04-23T18:33:20.467879+0000","last_undegraded":"2024-04-23T18:33:20.467879+0000","last_fullsized":"2024-04-23T18:33:20.467879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'81","last_scrub_stamp":"2024-04-23T18:33:20.467729+0000","last_deep_scrub":"34'81","last_deep_scrub_stamp":"2024-04-23T18:33:20.467729+0000","last_clean_scrub_stamp":"2024-04-23T18:33:20.467729+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:53.257286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.478908+0000","last_change":"2024-04-23T18:33:09.478908+0000","last_active":"2024-04-23T18:33:09.478908+0000","last_peered":"2024-04-23T18:33:09.478908+0000","last_clean":"2024-04-23T18:33:09.478908+0000","last_became_active":"2024-04-23T18:29:13.497008+0000","last_became_peered":"2024-04-23T18:29:13.497008+0000","last_unstale":"2024-04-23T18:33:09.478908+0000","last_undegraded":"2024-04-23T18:33:09.478908+0000","last_fullsized":"2024-04-23T18:33:09.478908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:09.478793+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:09.478793+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.478793+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:03:03.219719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:44.503147+0000","last_change":"2024-04-23T18:33:44.503169+0000","last_active":"2024-04-23T18:33:44.503147+0000","last_peered":"2024-04-23T18:33:44.503147+0000","last_clean":"2024-04-23T18:33:44.503147+0000","last_became_active":"2024-04-23T18:29:03.447404+0000","last_became_peered":"2024-04-23T18:29:03.447404+0000","last_unstale":"2024-04-23T18:33:44.503147+0000","last_undegraded":"2024-04-23T18:33:44.503147+0000","last_fullsized":"2024-04-23T18:33:44.503147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:44.503050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:44.503050+0000","last_clean_scrub_stamp":"2024-04-23T18:33:44.503050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:30:56.816204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:22.326866+0000","last_change":"2024-04-23T18:33:22.326866+0000","last_active":"2024-04-23T18:33:22.326866+0000","last_peered":"2024-04-23T18:33:22.326866+0000","last_clean":"2024-04-23T18:33:22.326866+0000","last_became_active":"2024-04-23T18:29:11.486538+0000","last_became_peered":"2024-04-23T18:29:11.486538+0000","last_unstale":"2024-04-23T18:33:22.326866+0000","last_undegraded":"2024-04-23T18:33:22.326866+0000","last_fullsized":"2024-04-23T18:33:22.326866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:22.326686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:22.326686+0000","last_clean_scrub_stamp":"2024-04-23T18:33:22.326686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:11:21.758841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.435765+0000","last_change":"2024-04-23T18:32:40.435765+0000","last_active":"2024-04-23T18:32:40.435765+0000","last_peered":"2024-04-23T18:32:40.435765+0000","last_clean":"2024-04-23T18:32:40.435765+0000","last_became_active":"2024-04-23T18:29:15.508020+0000","last_became_peered":"2024-04-23T18:29:15.508020+0000","last_unstale":"2024-04-23T18:32:40.435765+0000","last_undegraded":"2024-04-23T18:32:40.435765+0000","last_fullsized":"2024-04-23T18:32:40.435765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:40.435654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:40.435654+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.435654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:16.738684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'291","reported_seq":517,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.927476+0000","last_change":"2024-04-23T18:32:36.927476+0000","last_active":"2024-04-23T18:32:36.927476+0000","last_peered":"2024-04-23T18:32:36.927476+0000","last_clean":"2024-04-23T18:32:36.927476+0000","last_became_active":"2024-04-23T18:29:17.515023+0000","last_became_peered":"2024-04-23T18:29:17.515023+0000","last_unstale":"2024-04-23T18:32:36.927476+0000","last_undegraded":"2024-04-23T18:32:36.927476+0000","last_fullsized":"2024-04-23T18:32:36.927476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'291","last_scrub_stamp":"2024-04-23T18:32:36.927295+0000","last_deep_scrub":"34'291","last_deep_scrub_stamp":"2024-04-23T18:32:36.927295+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.927295+0000","objects_scrubbed":10,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:58.103602+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:55.428147+0000","last_change":"2024-04-23T18:32:55.428147+0000","last_active":"2024-04-23T18:32:55.428147+0000","last_peered":"2024-04-23T18:32:55.428147+0000","last_clean":"2024-04-23T18:32:55.428147+0000","last_became_active":"2024-04-23T18:29:19.522105+0000","last_became_peered":"2024-04-23T18:29:19.522105+0000","last_unstale":"2024-04-23T18:32:55.428147+0000","last_undegraded":"2024-04-23T18:32:55.428147+0000","last_fullsized":"2024-04-23T18:32:55.428147+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:55.428038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:55.428038+0000","last_clean_scrub_stamp":"2024-04-23T18:32:55.428038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:30:42.649870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:28.757941+0000","last_change":"2024-04-23T18:33:28.757941+0000","last_active":"2024-04-23T18:33:28.757941+0000","last_peered":"2024-04-23T18:33:28.757941+0000","last_clean":"2024-04-23T18:33:28.757941+0000","last_became_active":"2024-04-23T18:29:21.532867+0000","last_became_peered":"2024-04-23T18:29:21.532867+0000","last_unstale":"2024-04-23T18:33:28.757941+0000","last_undegraded":"2024-04-23T18:33:28.757941+0000","last_fullsized":"2024-04-23T18:33:28.757941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-23T18:33:28.757767+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-23T18:33:28.757767+0000","last_clean_scrub_stamp":"2024-04-23T18:33:28.757767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:09:37.761007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:16.247567+0000","last_change":"2024-04-23T18:33:16.247567+0000","last_active":"2024-04-23T18:33:16.247567+0000","last_peered":"2024-04-23T18:33:16.247567+0000","last_clean":"2024-04-23T18:33:16.247567+0000","last_became_active":"2024-04-23T18:29:13.499253+0000","last_became_peered":"2024-04-23T18:29:13.499253+0000","last_unstale":"2024-04-23T18:33:16.247567+0000","last_undegraded":"2024-04-23T18:33:16.247567+0000","last_fullsized":"2024-04-23T18:33:16.247567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-04-23T18:33:16.247440+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-04-23T18:33:16.247440+0000","last_clean_scrub_stamp":"2024-04-23T18:33:16.247440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:40:13.131062+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.337306+0000","last_change":"2024-04-23T18:33:11.337306+0000","last_active":"2024-04-23T18:33:11.337306+0000","last_peered":"2024-04-23T18:33:11.337306+0000","last_clean":"2024-04-23T18:33:11.337306+0000","last_became_active":"2024-04-23T18:29:03.446647+0000","last_became_peered":"2024-04-23T18:29:03.446647+0000","last_unstale":"2024-04-23T18:33:11.337306+0000","last_undegraded":"2024-04-23T18:33:11.337306+0000","last_fullsized":"2024-04-23T18:33:11.337306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:11.337177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:11.337177+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.337177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:54.117197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:17.242431+0000","last_change":"2024-04-23T18:33:17.242458+0000","last_active":"2024-04-23T18:33:17.242431+0000","last_peered":"2024-04-23T18:33:17.242431+0000","last_clean":"2024-04-23T18:33:17.242431+0000","last_became_active":"2024-04-23T18:29:11.491953+0000","last_became_peered":"2024-04-23T18:29:11.491953+0000","last_unstale":"2024-04-23T18:33:17.242431+0000","last_undegraded":"2024-04-23T18:33:17.242431+0000","last_fullsized":"2024-04-23T18:33:17.242431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:17.242339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:17.242339+0000","last_clean_scrub_stamp":"2024-04-23T18:33:17.242339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:07:01.349691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:26.435087+0000","last_change":"2024-04-23T18:33:26.435087+0000","last_active":"2024-04-23T18:33:26.435087+0000","last_peered":"2024-04-23T18:33:26.435087+0000","last_clean":"2024-04-23T18:33:26.435087+0000","last_became_active":"2024-04-23T18:29:52.551265+0000","last_became_peered":"2024-04-23T18:29:52.551265+0000","last_unstale":"2024-04-23T18:33:26.435087+0000","last_undegraded":"2024-04-23T18:33:26.435087+0000","last_fullsized":"2024-04-23T18:33:26.435087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:26.434912+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:26.434912+0000","last_clean_scrub_stamp":"2024-04-23T18:33:26.434912+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:03:09.367601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.370172+0000","last_change":"2024-04-23T18:32:42.370172+0000","last_active":"2024-04-23T18:32:42.370172+0000","last_peered":"2024-04-23T18:32:42.370172+0000","last_clean":"2024-04-23T18:32:42.370172+0000","last_became_active":"2024-04-23T18:29:17.513875+0000","last_became_peered":"2024-04-23T18:29:17.513875+0000","last_unstale":"2024-04-23T18:32:42.370172+0000","last_undegraded":"2024-04-23T18:32:42.370172+0000","last_fullsized":"2024-04-23T18:32:42.370172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-23T18:32:42.370053+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-23T18:32:42.370053+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.370053+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:16:11.051682+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:31.497737+0000","last_change":"2024-04-23T18:32:31.497737+0000","last_active":"2024-04-23T18:32:31.497737+0000","last_peered":"2024-04-23T18:32:31.497737+0000","last_clean":"2024-04-23T18:32:31.497737+0000","last_became_active":"2024-04-23T18:29:19.518744+0000","last_became_peered":"2024-04-23T18:29:19.518744+0000","last_unstale":"2024-04-23T18:32:31.497737+0000","last_undegraded":"2024-04-23T18:32:31.497737+0000","last_fullsized":"2024-04-23T18:32:31.497737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:31.497603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:31.497603+0000","last_clean_scrub_stamp":"2024-04-23T18:32:31.497603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:37.446181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"34'8","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:53.452740+0000","last_change":"2024-04-23T18:33:53.452770+0000","last_active":"2024-04-23T18:33:53.452740+0000","last_peered":"2024-04-23T18:33:53.452740+0000","last_clean":"2024-04-23T18:33:53.452740+0000","last_became_active":"2024-04-23T18:29:21.533358+0000","last_became_peered":"2024-04-23T18:29:21.533358+0000","last_unstale":"2024-04-23T18:33:53.452740+0000","last_undegraded":"2024-04-23T18:33:53.452740+0000","last_fullsized":"2024-04-23T18:33:53.452740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:53.452639+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:53.452639+0000","last_clean_scrub_stamp":"2024-04-23T18:33:53.452639+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:59.142401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.247736+0000","last_change":"2024-04-23T18:33:02.247736+0000","last_active":"2024-04-23T18:33:02.247736+0000","last_peered":"2024-04-23T18:33:02.247736+0000","last_clean":"2024-04-23T18:33:02.247736+0000","last_became_active":"2024-04-23T18:29:13.493321+0000","last_became_peered":"2024-04-23T18:29:13.493321+0000","last_unstale":"2024-04-23T18:33:02.247736+0000","last_undegraded":"2024-04-23T18:33:02.247736+0000","last_fullsized":"2024-04-23T18:33:02.247736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:02.247619+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:02.247619+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.247619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:47:16.283269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:42.545642+0000","last_change":"2024-04-23T18:33:42.545667+0000","last_active":"2024-04-23T18:33:42.545642+0000","last_peered":"2024-04-23T18:33:42.545642+0000","last_clean":"2024-04-23T18:33:42.545642+0000","last_became_active":"2024-04-23T18:29:03.446457+0000","last_became_peered":"2024-04-23T18:29:03.446457+0000","last_unstale":"2024-04-23T18:33:42.545642+0000","last_undegraded":"2024-04-23T18:33:42.545642+0000","last_fullsized":"2024-04-23T18:33:42.545642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:42.545537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:42.545537+0000","last_clean_scrub_stamp":"2024-04-23T18:33:42.545537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:41:29.719408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:14.439946+0000","last_change":"2024-04-23T18:33:14.439946+0000","last_active":"2024-04-23T18:33:14.439946+0000","last_peered":"2024-04-23T18:33:14.439946+0000","last_clean":"2024-04-23T18:33:14.439946+0000","last_became_active":"2024-04-23T18:29:11.482896+0000","last_became_peered":"2024-04-23T18:29:11.482896+0000","last_unstale":"2024-04-23T18:33:14.439946+0000","last_undegraded":"2024-04-23T18:33:14.439946+0000","last_fullsized":"2024-04-23T18:33:14.439946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:14.439753+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:14.439753+0000","last_clean_scrub_stamp":"2024-04-23T18:33:14.439753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:02:31.534674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.239612+0000","last_change":"2024-04-23T18:32:53.239612+0000","last_active":"2024-04-23T18:32:53.239612+0000","last_peered":"2024-04-23T18:32:53.239612+0000","last_clean":"2024-04-23T18:32:53.239612+0000","last_became_active":"2024-04-23T18:29:15.507357+0000","last_became_peered":"2024-04-23T18:29:15.507357+0000","last_unstale":"2024-04-23T18:32:53.239612+0000","last_undegraded":"2024-04-23T18:32:53.239612+0000","last_fullsized":"2024-04-23T18:32:53.239612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:53.239511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:53.239511+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.239511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:19:54.363767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.488473+0000","last_change":"2024-04-23T18:33:04.488473+0000","last_active":"2024-04-23T18:33:04.488473+0000","last_peered":"2024-04-23T18:33:04.488473+0000","last_clean":"2024-04-23T18:33:04.488473+0000","last_became_active":"2024-04-23T18:29:17.513393+0000","last_became_peered":"2024-04-23T18:29:17.513393+0000","last_unstale":"2024-04-23T18:33:04.488473+0000","last_undegraded":"2024-04-23T18:33:04.488473+0000","last_fullsized":"2024-04-23T18:33:04.488473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-04-23T18:33:04.488295+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-04-23T18:33:04.488295+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.488295+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:35:28.849946+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.456665+0000","last_change":"2024-04-23T18:33:03.456665+0000","last_active":"2024-04-23T18:33:03.456665+0000","last_peered":"2024-04-23T18:33:03.456665+0000","last_clean":"2024-04-23T18:33:03.456665+0000","last_became_active":"2024-04-23T18:29:19.523070+0000","last_became_peered":"2024-04-23T18:29:19.523070+0000","last_unstale":"2024-04-23T18:33:03.456665+0000","last_undegraded":"2024-04-23T18:33:03.456665+0000","last_fullsized":"2024-04-23T18:33:03.456665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:03.456548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:03.456548+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.456548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:18.440377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.889033+0000","last_change":"2024-04-23T18:32:47.889033+0000","last_active":"2024-04-23T18:32:47.889033+0000","last_peered":"2024-04-23T18:32:47.889033+0000","last_clean":"2024-04-23T18:32:47.889033+0000","last_became_active":"2024-04-23T18:29:21.528764+0000","last_became_peered":"2024-04-23T18:29:21.528764+0000","last_unstale":"2024-04-23T18:32:47.889033+0000","last_undegraded":"2024-04-23T18:32:47.889033+0000","last_fullsized":"2024-04-23T18:32:47.889033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:47.888900+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:47.888900+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.888900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:13:11.470854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.869141+0000","last_change":"2024-04-23T18:32:54.869141+0000","last_active":"2024-04-23T18:32:54.869141+0000","last_peered":"2024-04-23T18:32:54.869141+0000","last_clean":"2024-04-23T18:32:54.869141+0000","last_became_active":"2024-04-23T18:29:13.507496+0000","last_became_peered":"2024-04-23T18:29:13.507496+0000","last_unstale":"2024-04-23T18:32:54.869141+0000","last_undegraded":"2024-04-23T18:32:54.869141+0000","last_fullsized":"2024-04-23T18:32:54.869141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:32:54.869026+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:32:54.869026+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.869026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:00:13.533697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:15.480660+0000","last_change":"2024-04-23T18:33:15.480660+0000","last_active":"2024-04-23T18:33:15.480660+0000","last_peered":"2024-04-23T18:33:15.480660+0000","last_clean":"2024-04-23T18:33:15.480660+0000","last_became_active":"2024-04-23T18:29:11.482348+0000","last_became_peered":"2024-04-23T18:29:11.482348+0000","last_unstale":"2024-04-23T18:33:15.480660+0000","last_undegraded":"2024-04-23T18:33:15.480660+0000","last_fullsized":"2024-04-23T18:33:15.480660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:15.480495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:15.480495+0000","last_clean_scrub_stamp":"2024-04-23T18:33:15.480495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:53:37.036007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:19.264717+0000","last_change":"2024-04-23T18:33:19.264738+0000","last_active":"2024-04-23T18:33:19.264717+0000","last_peered":"2024-04-23T18:33:19.264717+0000","last_clean":"2024-04-23T18:33:19.264717+0000","last_became_active":"2024-04-23T18:29:03.446286+0000","last_became_peered":"2024-04-23T18:29:03.446286+0000","last_unstale":"2024-04-23T18:33:19.264717+0000","last_undegraded":"2024-04-23T18:33:19.264717+0000","last_fullsized":"2024-04-23T18:33:19.264717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:19.264632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:19.264632+0000","last_clean_scrub_stamp":"2024-04-23T18:33:19.264632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:25:21.621895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:23.502032+0000","last_change":"2024-04-23T18:33:23.502032+0000","last_active":"2024-04-23T18:33:23.502032+0000","last_peered":"2024-04-23T18:33:23.502032+0000","last_clean":"2024-04-23T18:33:23.502032+0000","last_became_active":"2024-04-23T18:29:52.553851+0000","last_became_peered":"2024-04-23T18:29:52.553851+0000","last_unstale":"2024-04-23T18:33:23.502032+0000","last_undegraded":"2024-04-23T18:33:23.502032+0000","last_fullsized":"2024-04-23T18:33:23.502032+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:23.501922+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:23.501922+0000","last_clean_scrub_stamp":"2024-04-23T18:33:23.501922+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:57.358817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"34'73","reported_seq":150,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.321101+0000","last_change":"2024-04-23T18:32:41.321101+0000","last_active":"2024-04-23T18:32:41.321101+0000","last_peered":"2024-04-23T18:32:41.321101+0000","last_clean":"2024-04-23T18:32:41.321101+0000","last_became_active":"2024-04-23T18:29:17.513599+0000","last_became_peered":"2024-04-23T18:29:17.513599+0000","last_unstale":"2024-04-23T18:32:41.321101+0000","last_undegraded":"2024-04-23T18:32:41.321101+0000","last_fullsized":"2024-04-23T18:32:41.321101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'73","last_scrub_stamp":"2024-04-23T18:32:41.320952+0000","last_deep_scrub":"34'73","last_deep_scrub_stamp":"2024-04-23T18:32:41.320952+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.320952+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:13:39.361578+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.404932+0000","last_change":"2024-04-23T18:32:34.404932+0000","last_active":"2024-04-23T18:32:34.404932+0000","last_peered":"2024-04-23T18:32:34.404932+0000","last_clean":"2024-04-23T18:32:34.404932+0000","last_became_active":"2024-04-23T18:29:19.526192+0000","last_became_peered":"2024-04-23T18:29:19.526192+0000","last_unstale":"2024-04-23T18:32:34.404932+0000","last_undegraded":"2024-04-23T18:32:34.404932+0000","last_fullsized":"2024-04-23T18:32:34.404932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:34.404810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:34.404810+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.404810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:37.587320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:33.336035+0000","last_change":"2024-04-23T18:33:33.336035+0000","last_active":"2024-04-23T18:33:33.336035+0000","last_peered":"2024-04-23T18:33:33.336035+0000","last_clean":"2024-04-23T18:33:33.336035+0000","last_became_active":"2024-04-23T18:29:21.533202+0000","last_became_peered":"2024-04-23T18:29:21.533202+0000","last_unstale":"2024-04-23T18:33:33.336035+0000","last_undegraded":"2024-04-23T18:33:33.336035+0000","last_fullsized":"2024-04-23T18:33:33.336035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-04-23T18:33:33.335920+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-04-23T18:33:33.335920+0000","last_clean_scrub_stamp":"2024-04-23T18:33:33.335920+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:48:28.147432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":32,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.935822+0000","last_change":"2024-04-23T18:32:57.935822+0000","last_active":"2024-04-23T18:32:57.935822+0000","last_peered":"2024-04-23T18:32:57.935822+0000","last_clean":"2024-04-23T18:32:57.935822+0000","last_became_active":"2024-04-23T18:29:13.506795+0000","last_became_peered":"2024-04-23T18:29:13.506795+0000","last_unstale":"2024-04-23T18:32:57.935822+0000","last_undegraded":"2024-04-23T18:32:57.935822+0000","last_fullsized":"2024-04-23T18:32:57.935822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:57.935674+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:57.935674+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.935674+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:38.815854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:24.380541+0000","last_change":"2024-04-23T18:33:24.380541+0000","last_active":"2024-04-23T18:33:24.380541+0000","last_peered":"2024-04-23T18:33:24.380541+0000","last_clean":"2024-04-23T18:33:24.380541+0000","last_became_active":"2024-04-23T18:29:11.491882+0000","last_became_peered":"2024-04-23T18:29:11.491882+0000","last_unstale":"2024-04-23T18:33:24.380541+0000","last_undegraded":"2024-04-23T18:33:24.380541+0000","last_fullsized":"2024-04-23T18:33:24.380541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:24.380405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:24.380405+0000","last_clean_scrub_stamp":"2024-04-23T18:33:24.380405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:02:59.746649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:43.520837+0000","last_change":"2024-04-23T18:33:43.520869+0000","last_active":"2024-04-23T18:33:43.520837+0000","last_peered":"2024-04-23T18:33:43.520837+0000","last_clean":"2024-04-23T18:33:43.520837+0000","last_became_active":"2024-04-23T18:29:03.447265+0000","last_became_peered":"2024-04-23T18:29:03.447265+0000","last_unstale":"2024-04-23T18:33:43.520837+0000","last_undegraded":"2024-04-23T18:33:43.520837+0000","last_fullsized":"2024-04-23T18:33:43.520837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:43.520709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:43.520709+0000","last_clean_scrub_stamp":"2024-04-23T18:33:43.520709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:02.689963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.440839+0000","last_change":"2024-04-23T18:32:42.440839+0000","last_active":"2024-04-23T18:32:42.440839+0000","last_peered":"2024-04-23T18:32:42.440839+0000","last_clean":"2024-04-23T18:32:42.440839+0000","last_became_active":"2024-04-23T18:29:15.506394+0000","last_became_peered":"2024-04-23T18:29:15.506394+0000","last_unstale":"2024-04-23T18:32:42.440839+0000","last_undegraded":"2024-04-23T18:32:42.440839+0000","last_fullsized":"2024-04-23T18:32:42.440839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:42.440734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:42.440734+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.440734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:01:59.535655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:34.939954+0000","last_change":"2024-04-23T18:32:34.939954+0000","last_active":"2024-04-23T18:32:34.939954+0000","last_peered":"2024-04-23T18:32:34.939954+0000","last_clean":"2024-04-23T18:32:34.939954+0000","last_became_active":"2024-04-23T18:29:17.515048+0000","last_became_peered":"2024-04-23T18:29:17.515048+0000","last_unstale":"2024-04-23T18:32:34.939954+0000","last_undegraded":"2024-04-23T18:32:34.939954+0000","last_fullsized":"2024-04-23T18:32:34.939954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-04-23T18:32:34.939820+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-04-23T18:32:34.939820+0000","last_clean_scrub_stamp":"2024-04-23T18:32:34.939820+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:16:03.621449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":382,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:33.962456+0000","last_change":"2024-04-23T18:32:33.962456+0000","last_active":"2024-04-23T18:32:33.962456+0000","last_peered":"2024-04-23T18:32:33.962456+0000","last_clean":"2024-04-23T18:32:33.962456+0000","last_became_active":"2024-04-23T18:29:19.518668+0000","last_became_peered":"2024-04-23T18:29:19.518668+0000","last_unstale":"2024-04-23T18:32:33.962456+0000","last_undegraded":"2024-04-23T18:32:33.962456+0000","last_fullsized":"2024-04-23T18:32:33.962456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:33.962317+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:33.962317+0000","last_clean_scrub_stamp":"2024-04-23T18:32:33.962317+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:24:53.232240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:50.476079+0000","last_change":"2024-04-23T18:33:50.476079+0000","last_active":"2024-04-23T18:33:50.476079+0000","last_peered":"2024-04-23T18:33:50.476079+0000","last_clean":"2024-04-23T18:33:50.476079+0000","last_became_active":"2024-04-23T18:29:21.531185+0000","last_became_peered":"2024-04-23T18:29:21.531185+0000","last_unstale":"2024-04-23T18:33:50.476079+0000","last_undegraded":"2024-04-23T18:33:50.476079+0000","last_fullsized":"2024-04-23T18:33:50.476079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:50.475966+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:50.475966+0000","last_clean_scrub_stamp":"2024-04-23T18:33:50.475966+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:38:40.540587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.354121+0000","last_change":"2024-04-23T18:32:44.354121+0000","last_active":"2024-04-23T18:32:44.354121+0000","last_peered":"2024-04-23T18:32:44.354121+0000","last_clean":"2024-04-23T18:32:44.354121+0000","last_became_active":"2024-04-23T18:29:13.503543+0000","last_became_peered":"2024-04-23T18:29:13.503543+0000","last_unstale":"2024-04-23T18:32:44.354121+0000","last_undegraded":"2024-04-23T18:32:44.354121+0000","last_fullsized":"2024-04-23T18:32:44.354121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:44.353948+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:44.353948+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.353948+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:19.427152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:25.489126+0000","last_change":"2024-04-23T18:33:25.489126+0000","last_active":"2024-04-23T18:33:25.489126+0000","last_peered":"2024-04-23T18:33:25.489126+0000","last_clean":"2024-04-23T18:33:25.489126+0000","last_became_active":"2024-04-23T18:29:11.505604+0000","last_became_peered":"2024-04-23T18:29:11.505604+0000","last_unstale":"2024-04-23T18:33:25.489126+0000","last_undegraded":"2024-04-23T18:33:25.489126+0000","last_fullsized":"2024-04-23T18:33:25.489126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:25.489010+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:25.489010+0000","last_clean_scrub_stamp":"2024-04-23T18:33:25.489010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:02.186513+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:18.275506+0000","last_change":"2024-04-23T18:33:18.275506+0000","last_active":"2024-04-23T18:33:18.275506+0000","last_peered":"2024-04-23T18:33:18.275506+0000","last_clean":"2024-04-23T18:33:18.275506+0000","last_became_active":"2024-04-23T18:29:03.445715+0000","last_became_peered":"2024-04-23T18:29:03.445715+0000","last_unstale":"2024-04-23T18:33:18.275506+0000","last_undegraded":"2024-04-23T18:33:18.275506+0000","last_fullsized":"2024-04-23T18:33:18.275506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:18.275380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:18.275380+0000","last_clean_scrub_stamp":"2024-04-23T18:33:18.275380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:29:49.220282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.423670+0000","last_change":"2024-04-23T18:32:32.423670+0000","last_active":"2024-04-23T18:32:32.423670+0000","last_peered":"2024-04-23T18:32:32.423670+0000","last_clean":"2024-04-23T18:32:32.423670+0000","last_became_active":"2024-04-23T18:29:15.511553+0000","last_became_peered":"2024-04-23T18:29:15.511553+0000","last_unstale":"2024-04-23T18:32:32.423670+0000","last_undegraded":"2024-04-23T18:32:32.423670+0000","last_fullsized":"2024-04-23T18:32:32.423670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.423553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.423553+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.423553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:27:15.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:01.450404+0000","last_change":"2024-04-23T18:33:01.450404+0000","last_active":"2024-04-23T18:33:01.450404+0000","last_peered":"2024-04-23T18:33:01.450404+0000","last_clean":"2024-04-23T18:33:01.450404+0000","last_became_active":"2024-04-23T18:29:17.515741+0000","last_became_peered":"2024-04-23T18:29:17.515741+0000","last_unstale":"2024-04-23T18:33:01.450404+0000","last_undegraded":"2024-04-23T18:33:01.450404+0000","last_fullsized":"2024-04-23T18:33:01.450404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:33:01.450263+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:33:01.450263+0000","last_clean_scrub_stamp":"2024-04-23T18:33:01.450263+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:17:37.262459+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":412,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.172218+0000","last_change":"2024-04-23T18:32:48.172218+0000","last_active":"2024-04-23T18:32:48.172218+0000","last_peered":"2024-04-23T18:32:48.172218+0000","last_clean":"2024-04-23T18:32:48.172218+0000","last_became_active":"2024-04-23T18:29:19.526375+0000","last_became_peered":"2024-04-23T18:29:19.526375+0000","last_unstale":"2024-04-23T18:32:48.172218+0000","last_undegraded":"2024-04-23T18:32:48.172218+0000","last_fullsized":"2024-04-23T18:32:48.172218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:48.172046+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:48.172046+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.172046+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:32:02.059338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:26.749078+0000","last_change":"2024-04-23T18:33:26.749078+0000","last_active":"2024-04-23T18:33:26.749078+0000","last_peered":"2024-04-23T18:33:26.749078+0000","last_clean":"2024-04-23T18:33:26.749078+0000","last_became_active":"2024-04-23T18:29:21.530911+0000","last_became_peered":"2024-04-23T18:29:21.530911+0000","last_unstale":"2024-04-23T18:33:26.749078+0000","last_undegraded":"2024-04-23T18:33:26.749078+0000","last_fullsized":"2024-04-23T18:33:26.749078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-23T18:33:26.748927+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-23T18:33:26.748927+0000","last_clean_scrub_stamp":"2024-04-23T18:33:26.748927+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:42.708158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'16","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.310357+0000","last_change":"2024-04-23T18:32:59.310357+0000","last_active":"2024-04-23T18:32:59.310357+0000","last_peered":"2024-04-23T18:32:59.310357+0000","last_clean":"2024-04-23T18:32:59.310357+0000","last_became_active":"2024-04-23T18:29:13.499603+0000","last_became_peered":"2024-04-23T18:29:13.499603+0000","last_unstale":"2024-04-23T18:32:59.310357+0000","last_undegraded":"2024-04-23T18:32:59.310357+0000","last_fullsized":"2024-04-23T18:32:59.310357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-23T18:32:59.310197+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-23T18:32:59.310197+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.310197+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:47.217542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":55,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:19.752875+0000","last_change":"2024-04-23T18:33:19.752875+0000","last_active":"2024-04-23T18:33:19.752875+0000","last_peered":"2024-04-23T18:33:19.752875+0000","last_clean":"2024-04-23T18:33:19.752875+0000","last_became_active":"2024-04-23T18:29:11.488500+0000","last_became_peered":"2024-04-23T18:29:11.488500+0000","last_unstale":"2024-04-23T18:33:19.752875+0000","last_undegraded":"2024-04-23T18:33:19.752875+0000","last_fullsized":"2024-04-23T18:33:19.752875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:19.752732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:19.752732+0000","last_clean_scrub_stamp":"2024-04-23T18:33:19.752732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:31:06.974564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:45.504512+0000","last_change":"2024-04-23T18:33:45.504553+0000","last_active":"2024-04-23T18:33:45.504512+0000","last_peered":"2024-04-23T18:33:45.504512+0000","last_clean":"2024-04-23T18:33:45.504512+0000","last_became_active":"2024-04-23T18:29:03.593691+0000","last_became_peered":"2024-04-23T18:29:03.593691+0000","last_unstale":"2024-04-23T18:33:45.504512+0000","last_undegraded":"2024-04-23T18:33:45.504512+0000","last_fullsized":"2024-04-23T18:33:45.504512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:45.504391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:45.504391+0000","last_clean_scrub_stamp":"2024-04-23T18:33:45.504391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:26.914362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.430553+0000","last_change":"2024-04-23T18:32:35.430553+0000","last_active":"2024-04-23T18:32:35.430553+0000","last_peered":"2024-04-23T18:32:35.430553+0000","last_clean":"2024-04-23T18:32:35.430553+0000","last_became_active":"2024-04-23T18:29:15.511207+0000","last_became_peered":"2024-04-23T18:29:15.511207+0000","last_unstale":"2024-04-23T18:32:35.430553+0000","last_undegraded":"2024-04-23T18:32:35.430553+0000","last_fullsized":"2024-04-23T18:32:35.430553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.430424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.430424+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.430424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:13.560310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.411316+0000","last_change":"2024-04-23T18:32:40.411316+0000","last_active":"2024-04-23T18:32:40.411316+0000","last_peered":"2024-04-23T18:32:40.411316+0000","last_clean":"2024-04-23T18:32:40.411316+0000","last_became_active":"2024-04-23T18:29:17.515004+0000","last_became_peered":"2024-04-23T18:29:17.515004+0000","last_unstale":"2024-04-23T18:32:40.411316+0000","last_undegraded":"2024-04-23T18:32:40.411316+0000","last_fullsized":"2024-04-23T18:32:40.411316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-04-23T18:32:40.411192+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-04-23T18:32:40.411192+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.411192+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:44.354254+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.340779+0000","last_change":"2024-04-23T18:32:37.340779+0000","last_active":"2024-04-23T18:32:37.340779+0000","last_peered":"2024-04-23T18:32:37.340779+0000","last_clean":"2024-04-23T18:32:37.340779+0000","last_became_active":"2024-04-23T18:29:19.517903+0000","last_became_peered":"2024-04-23T18:29:19.517903+0000","last_unstale":"2024-04-23T18:32:37.340779+0000","last_undegraded":"2024-04-23T18:32:37.340779+0000","last_fullsized":"2024-04-23T18:32:37.340779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:37.340641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:37.340641+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.340641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:57:08.789904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.486399+0000","last_change":"2024-04-23T18:32:53.486399+0000","last_active":"2024-04-23T18:32:53.486399+0000","last_peered":"2024-04-23T18:32:53.486399+0000","last_clean":"2024-04-23T18:32:53.486399+0000","last_became_active":"2024-04-23T18:29:21.530980+0000","last_became_peered":"2024-04-23T18:29:21.530980+0000","last_unstale":"2024-04-23T18:32:53.486399+0000","last_undegraded":"2024-04-23T18:32:53.486399+0000","last_fullsized":"2024-04-23T18:32:53.486399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:53.486278+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:53.486278+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.486278+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:55:15.116741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:22.456065+0000","last_change":"2024-04-23T18:33:22.456065+0000","last_active":"2024-04-23T18:33:22.456065+0000","last_peered":"2024-04-23T18:33:22.456065+0000","last_clean":"2024-04-23T18:33:22.456065+0000","last_became_active":"2024-04-23T18:29:21.534461+0000","last_became_peered":"2024-04-23T18:29:21.534461+0000","last_unstale":"2024-04-23T18:33:22.456065+0000","last_undegraded":"2024-04-23T18:33:22.456065+0000","last_fullsized":"2024-04-23T18:33:22.456065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:22.455900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:22.455900+0000","last_clean_scrub_stamp":"2024-04-23T18:33:22.455900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:57.978414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'10","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.344387+0000","last_change":"2024-04-23T18:33:09.344387+0000","last_active":"2024-04-23T18:33:09.344387+0000","last_peered":"2024-04-23T18:33:09.344387+0000","last_clean":"2024-04-23T18:33:09.344387+0000","last_became_active":"2024-04-23T18:29:13.504092+0000","last_became_peered":"2024-04-23T18:29:13.504092+0000","last_unstale":"2024-04-23T18:33:09.344387+0000","last_undegraded":"2024-04-23T18:33:09.344387+0000","last_fullsized":"2024-04-23T18:33:09.344387+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:09.344276+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:09.344276+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.344276+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:41.733579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:35.450284+0000","last_change":"2024-04-23T18:33:35.450284+0000","last_active":"2024-04-23T18:33:35.450284+0000","last_peered":"2024-04-23T18:33:35.450284+0000","last_clean":"2024-04-23T18:33:35.450284+0000","last_became_active":"2024-04-23T18:29:11.510456+0000","last_became_peered":"2024-04-23T18:29:11.510456+0000","last_unstale":"2024-04-23T18:33:35.450284+0000","last_undegraded":"2024-04-23T18:33:35.450284+0000","last_fullsized":"2024-04-23T18:33:35.450284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:35.450161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:35.450161+0000","last_clean_scrub_stamp":"2024-04-23T18:33:35.450161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:35:17.286475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.935502+0000","last_change":"2024-04-23T18:32:48.935502+0000","last_active":"2024-04-23T18:32:48.935502+0000","last_peered":"2024-04-23T18:32:48.935502+0000","last_clean":"2024-04-23T18:32:48.935502+0000","last_became_active":"2024-04-23T18:29:15.506939+0000","last_became_peered":"2024-04-23T18:29:15.506939+0000","last_unstale":"2024-04-23T18:32:48.935502+0000","last_undegraded":"2024-04-23T18:32:48.935502+0000","last_fullsized":"2024-04-23T18:32:48.935502+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:48.935390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:48.935390+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.935390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:50:02.096302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.400423+0000","last_change":"2024-04-23T18:32:37.400423+0000","last_active":"2024-04-23T18:32:37.400423+0000","last_peered":"2024-04-23T18:32:37.400423+0000","last_clean":"2024-04-23T18:32:37.400423+0000","last_became_active":"2024-04-23T18:29:17.511559+0000","last_became_peered":"2024-04-23T18:29:17.511559+0000","last_unstale":"2024-04-23T18:32:37.400423+0000","last_undegraded":"2024-04-23T18:32:37.400423+0000","last_fullsized":"2024-04-23T18:32:37.400423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:37.400296+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:37.400296+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.400296+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:51.584214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.480642+0000","last_change":"2024-04-23T18:33:07.480642+0000","last_active":"2024-04-23T18:33:07.480642+0000","last_peered":"2024-04-23T18:33:07.480642+0000","last_clean":"2024-04-23T18:33:07.480642+0000","last_became_active":"2024-04-23T18:29:19.525302+0000","last_became_peered":"2024-04-23T18:29:19.525302+0000","last_unstale":"2024-04-23T18:33:07.480642+0000","last_undegraded":"2024-04-23T18:33:07.480642+0000","last_fullsized":"2024-04-23T18:33:07.480642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:07.480534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:07.480534+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.480534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:45:35.271244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:32.376352+0000","last_change":"2024-04-23T18:33:32.376382+0000","last_active":"2024-04-23T18:33:32.376352+0000","last_peered":"2024-04-23T18:33:32.376352+0000","last_clean":"2024-04-23T18:33:32.376352+0000","last_became_active":"2024-04-23T18:29:21.530013+0000","last_became_peered":"2024-04-23T18:29:21.530013+0000","last_unstale":"2024-04-23T18:33:32.376352+0000","last_undegraded":"2024-04-23T18:33:32.376352+0000","last_fullsized":"2024-04-23T18:33:32.376352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-23T18:33:32.376252+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-23T18:33:32.376252+0000","last_clean_scrub_stamp":"2024-04-23T18:33:32.376252+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:44.790919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.936777+0000","last_change":"2024-04-23T18:32:58.936777+0000","last_active":"2024-04-23T18:32:58.936777+0000","last_peered":"2024-04-23T18:32:58.936777+0000","last_clean":"2024-04-23T18:32:58.936777+0000","last_became_active":"2024-04-23T18:29:13.506770+0000","last_became_peered":"2024-04-23T18:29:13.506770+0000","last_unstale":"2024-04-23T18:32:58.936777+0000","last_undegraded":"2024-04-23T18:32:58.936777+0000","last_fullsized":"2024-04-23T18:32:58.936777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:58.936659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:58.936659+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.936659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:56.612370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:13.402990+0000","last_change":"2024-04-23T18:33:13.402990+0000","last_active":"2024-04-23T18:33:13.402990+0000","last_peered":"2024-04-23T18:33:13.402990+0000","last_clean":"2024-04-23T18:33:13.402990+0000","last_became_active":"2024-04-23T18:29:11.481884+0000","last_became_peered":"2024-04-23T18:29:11.481884+0000","last_unstale":"2024-04-23T18:33:13.402990+0000","last_undegraded":"2024-04-23T18:33:13.402990+0000","last_fullsized":"2024-04-23T18:33:13.402990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:13.402815+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:13.402815+0000","last_clean_scrub_stamp":"2024-04-23T18:33:13.402815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:11.869076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.416412+0000","last_change":"2024-04-23T18:32:38.416412+0000","last_active":"2024-04-23T18:32:38.416412+0000","last_peered":"2024-04-23T18:32:38.416412+0000","last_clean":"2024-04-23T18:32:38.416412+0000","last_became_active":"2024-04-23T18:29:15.508018+0000","last_became_peered":"2024-04-23T18:29:15.508018+0000","last_unstale":"2024-04-23T18:32:38.416412+0000","last_undegraded":"2024-04-23T18:32:38.416412+0000","last_fullsized":"2024-04-23T18:32:38.416412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:38.416298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:38.416298+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.416298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:11.511574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:38.373308+0000","last_change":"2024-04-23T18:32:38.373308+0000","last_active":"2024-04-23T18:32:38.373308+0000","last_peered":"2024-04-23T18:32:38.373308+0000","last_clean":"2024-04-23T18:32:38.373308+0000","last_became_active":"2024-04-23T18:29:17.514836+0000","last_became_peered":"2024-04-23T18:29:17.514836+0000","last_unstale":"2024-04-23T18:32:38.373308+0000","last_undegraded":"2024-04-23T18:32:38.373308+0000","last_fullsized":"2024-04-23T18:32:38.373308+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:38.373174+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:38.373174+0000","last_clean_scrub_stamp":"2024-04-23T18:32:38.373174+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:55.790896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:37.401709+0000","last_change":"2024-04-23T18:32:37.401709+0000","last_active":"2024-04-23T18:32:37.401709+0000","last_peered":"2024-04-23T18:32:37.401709+0000","last_clean":"2024-04-23T18:32:37.401709+0000","last_became_active":"2024-04-23T18:29:19.527461+0000","last_became_peered":"2024-04-23T18:29:19.527461+0000","last_unstale":"2024-04-23T18:32:37.401709+0000","last_undegraded":"2024-04-23T18:32:37.401709+0000","last_fullsized":"2024-04-23T18:32:37.401709+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:37.401597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:37.401597+0000","last_clean_scrub_stamp":"2024-04-23T18:32:37.401597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:07:00.685354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:28.429617+0000","last_change":"2024-04-23T18:33:28.429639+0000","last_active":"2024-04-23T18:33:28.429617+0000","last_peered":"2024-04-23T18:33:28.429617+0000","last_clean":"2024-04-23T18:33:28.429617+0000","last_became_active":"2024-04-23T18:29:21.528772+0000","last_became_peered":"2024-04-23T18:29:21.528772+0000","last_unstale":"2024-04-23T18:33:28.429617+0000","last_undegraded":"2024-04-23T18:33:28.429617+0000","last_fullsized":"2024-04-23T18:33:28.429617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:28.429508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:28.429508+0000","last_clean_scrub_stamp":"2024-04-23T18:33:28.429508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:40.019004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.191542+0000","last_change":"2024-04-23T18:32:57.191542+0000","last_active":"2024-04-23T18:32:57.191542+0000","last_peered":"2024-04-23T18:32:57.191542+0000","last_clean":"2024-04-23T18:32:57.191542+0000","last_became_active":"2024-04-23T18:29:13.502849+0000","last_became_peered":"2024-04-23T18:29:13.502849+0000","last_unstale":"2024-04-23T18:32:57.191542+0000","last_undegraded":"2024-04-23T18:32:57.191542+0000","last_fullsized":"2024-04-23T18:32:57.191542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:57.191428+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:57.191428+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.191428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:28.194216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:17.429613+0000","last_change":"2024-04-23T18:33:17.429613+0000","last_active":"2024-04-23T18:33:17.429613+0000","last_peered":"2024-04-23T18:33:17.429613+0000","last_clean":"2024-04-23T18:33:17.429613+0000","last_became_active":"2024-04-23T18:29:11.483628+0000","last_became_peered":"2024-04-23T18:29:11.483628+0000","last_unstale":"2024-04-23T18:33:17.429613+0000","last_undegraded":"2024-04-23T18:33:17.429613+0000","last_fullsized":"2024-04-23T18:33:17.429613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:17.429501+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:17.429501+0000","last_clean_scrub_stamp":"2024-04-23T18:33:17.429501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:11.858318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:47.524270+0000","last_change":"2024-04-23T18:32:47.524270+0000","last_active":"2024-04-23T18:32:47.524270+0000","last_peered":"2024-04-23T18:32:47.524270+0000","last_clean":"2024-04-23T18:32:47.524270+0000","last_became_active":"2024-04-23T18:29:15.510130+0000","last_became_peered":"2024-04-23T18:29:15.510130+0000","last_unstale":"2024-04-23T18:32:47.524270+0000","last_undegraded":"2024-04-23T18:32:47.524270+0000","last_fullsized":"2024-04-23T18:32:47.524270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:47.524159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:47.524159+0000","last_clean_scrub_stamp":"2024-04-23T18:32:47.524159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:27:43.989607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":121,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.296633+0000","last_change":"2024-04-23T18:32:43.296633+0000","last_active":"2024-04-23T18:32:43.296633+0000","last_peered":"2024-04-23T18:32:43.296633+0000","last_clean":"2024-04-23T18:32:43.296633+0000","last_became_active":"2024-04-23T18:29:17.510429+0000","last_became_peered":"2024-04-23T18:29:17.510429+0000","last_unstale":"2024-04-23T18:32:43.296633+0000","last_undegraded":"2024-04-23T18:32:43.296633+0000","last_fullsized":"2024-04-23T18:32:43.296633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-23T18:32:43.296501+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-23T18:32:43.296501+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.296501+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:18.685380+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.936254+0000","last_change":"2024-04-23T18:32:32.936254+0000","last_active":"2024-04-23T18:32:32.936254+0000","last_peered":"2024-04-23T18:32:32.936254+0000","last_clean":"2024-04-23T18:32:32.936254+0000","last_became_active":"2024-04-23T18:29:19.518543+0000","last_became_peered":"2024-04-23T18:29:19.518543+0000","last_unstale":"2024-04-23T18:32:32.936254+0000","last_undegraded":"2024-04-23T18:32:32.936254+0000","last_fullsized":"2024-04-23T18:32:32.936254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.936101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.936101+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.936101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:36.879163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:55.485091+0000","last_change":"2024-04-23T18:33:55.485119+0000","last_active":"2024-04-23T18:33:55.485091+0000","last_peered":"2024-04-23T18:33:55.485091+0000","last_clean":"2024-04-23T18:33:55.485091+0000","last_became_active":"2024-04-23T18:29:21.534023+0000","last_became_peered":"2024-04-23T18:29:21.534023+0000","last_unstale":"2024-04-23T18:33:55.485091+0000","last_undegraded":"2024-04-23T18:33:55.485091+0000","last_fullsized":"2024-04-23T18:33:55.485091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:55.484994+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:55.484994+0000","last_clean_scrub_stamp":"2024-04-23T18:33:55.484994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:38:16.140024+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'20","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.520421+0000","last_change":"2024-04-23T18:33:06.520421+0000","last_active":"2024-04-23T18:33:06.520421+0000","last_peered":"2024-04-23T18:33:06.520421+0000","last_clean":"2024-04-23T18:33:06.520421+0000","last_became_active":"2024-04-23T18:29:13.500877+0000","last_became_peered":"2024-04-23T18:29:13.500877+0000","last_unstale":"2024-04-23T18:33:06.520421+0000","last_undegraded":"2024-04-23T18:33:06.520421+0000","last_fullsized":"2024-04-23T18:33:06.520421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-04-23T18:33:06.520272+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-04-23T18:33:06.520272+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.520272+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:51.378293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":53,"num_write":25,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:23.728149+0000","last_change":"2024-04-23T18:33:23.728149+0000","last_active":"2024-04-23T18:33:23.728149+0000","last_peered":"2024-04-23T18:33:23.728149+0000","last_clean":"2024-04-23T18:33:23.728149+0000","last_became_active":"2024-04-23T18:29:11.497953+0000","last_became_peered":"2024-04-23T18:29:11.497953+0000","last_unstale":"2024-04-23T18:33:23.728149+0000","last_undegraded":"2024-04-23T18:33:23.728149+0000","last_fullsized":"2024-04-23T18:33:23.728149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:23.728030+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:23.728030+0000","last_clean_scrub_stamp":"2024-04-23T18:33:23.728030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:22:58.233173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.458630+0000","last_change":"2024-04-23T18:32:41.458630+0000","last_active":"2024-04-23T18:32:41.458630+0000","last_peered":"2024-04-23T18:32:41.458630+0000","last_clean":"2024-04-23T18:32:41.458630+0000","last_became_active":"2024-04-23T18:29:15.507253+0000","last_became_peered":"2024-04-23T18:29:15.507253+0000","last_unstale":"2024-04-23T18:32:41.458630+0000","last_undegraded":"2024-04-23T18:32:41.458630+0000","last_fullsized":"2024-04-23T18:32:41.458630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:41.458516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:41.458516+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.458516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:55:39.924778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:43.406751+0000","last_change":"2024-04-23T18:32:43.406751+0000","last_active":"2024-04-23T18:32:43.406751+0000","last_peered":"2024-04-23T18:32:43.406751+0000","last_clean":"2024-04-23T18:32:43.406751+0000","last_became_active":"2024-04-23T18:29:17.512820+0000","last_became_peered":"2024-04-23T18:29:17.512820+0000","last_unstale":"2024-04-23T18:32:43.406751+0000","last_undegraded":"2024-04-23T18:32:43.406751+0000","last_fullsized":"2024-04-23T18:32:43.406751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:43.406635+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:43.406635+0000","last_clean_scrub_stamp":"2024-04-23T18:32:43.406635+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:40.517887+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:35.356012+0000","last_change":"2024-04-23T18:32:35.356012+0000","last_active":"2024-04-23T18:32:35.356012+0000","last_peered":"2024-04-23T18:32:35.356012+0000","last_clean":"2024-04-23T18:32:35.356012+0000","last_became_active":"2024-04-23T18:29:19.525424+0000","last_became_peered":"2024-04-23T18:29:19.525424+0000","last_unstale":"2024-04-23T18:32:35.356012+0000","last_undegraded":"2024-04-23T18:32:35.356012+0000","last_fullsized":"2024-04-23T18:32:35.356012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:35.355896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:35.355896+0000","last_clean_scrub_stamp":"2024-04-23T18:32:35.355896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:58:38.926439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:12.456113+0000","last_change":"2024-04-23T18:33:12.456113+0000","last_active":"2024-04-23T18:33:12.456113+0000","last_peered":"2024-04-23T18:33:12.456113+0000","last_clean":"2024-04-23T18:33:12.456113+0000","last_became_active":"2024-04-23T18:29:13.496179+0000","last_became_peered":"2024-04-23T18:29:13.496179+0000","last_unstale":"2024-04-23T18:33:12.456113+0000","last_undegraded":"2024-04-23T18:33:12.456113+0000","last_fullsized":"2024-04-23T18:33:12.456113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:12.455993+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:12.455993+0000","last_clean_scrub_stamp":"2024-04-23T18:33:12.455993+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:55:29.273245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:40.511613+0000","last_change":"2024-04-23T18:33:40.511613+0000","last_active":"2024-04-23T18:33:40.511613+0000","last_peered":"2024-04-23T18:33:40.511613+0000","last_clean":"2024-04-23T18:33:40.511613+0000","last_became_active":"2024-04-23T18:29:11.500118+0000","last_became_peered":"2024-04-23T18:29:11.500118+0000","last_unstale":"2024-04-23T18:33:40.511613+0000","last_undegraded":"2024-04-23T18:33:40.511613+0000","last_fullsized":"2024-04-23T18:33:40.511613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:40.511447+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:40.511447+0000","last_clean_scrub_stamp":"2024-04-23T18:33:40.511447+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:41:47.976464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.230060+0000","last_change":"2024-04-23T18:32:54.230060+0000","last_active":"2024-04-23T18:32:54.230060+0000","last_peered":"2024-04-23T18:32:54.230060+0000","last_clean":"2024-04-23T18:32:54.230060+0000","last_became_active":"2024-04-23T18:29:15.506197+0000","last_became_peered":"2024-04-23T18:29:15.506197+0000","last_unstale":"2024-04-23T18:32:54.230060+0000","last_undegraded":"2024-04-23T18:32:54.230060+0000","last_fullsized":"2024-04-23T18:32:54.230060+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:54.229932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:54.229932+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.229932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:45:57.110850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'66","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:39.328809+0000","last_change":"2024-04-23T18:32:39.328853+0000","last_active":"2024-04-23T18:32:39.328809+0000","last_peered":"2024-04-23T18:32:39.328809+0000","last_clean":"2024-04-23T18:32:39.328809+0000","last_became_active":"2024-04-23T18:29:17.514800+0000","last_became_peered":"2024-04-23T18:29:17.514800+0000","last_unstale":"2024-04-23T18:32:39.328809+0000","last_undegraded":"2024-04-23T18:32:39.328809+0000","last_fullsized":"2024-04-23T18:32:39.328809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-04-23T18:32:39.328706+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-04-23T18:32:39.328706+0000","last_clean_scrub_stamp":"2024-04-23T18:32:39.328706+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:44:56.598841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:36.370215+0000","last_change":"2024-04-23T18:32:36.370241+0000","last_active":"2024-04-23T18:32:36.370215+0000","last_peered":"2024-04-23T18:32:36.370215+0000","last_clean":"2024-04-23T18:32:36.370215+0000","last_became_active":"2024-04-23T18:29:19.524351+0000","last_became_peered":"2024-04-23T18:29:19.524351+0000","last_unstale":"2024-04-23T18:32:36.370215+0000","last_undegraded":"2024-04-23T18:32:36.370215+0000","last_fullsized":"2024-04-23T18:32:36.370215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:36.370129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:36.370129+0000","last_clean_scrub_stamp":"2024-04-23T18:32:36.370129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:58.907049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:29.460238+0000","last_change":"2024-04-23T18:33:29.460238+0000","last_active":"2024-04-23T18:33:29.460238+0000","last_peered":"2024-04-23T18:33:29.460238+0000","last_clean":"2024-04-23T18:33:29.460238+0000","last_became_active":"2024-04-23T18:29:21.528819+0000","last_became_peered":"2024-04-23T18:29:21.528819+0000","last_unstale":"2024-04-23T18:33:29.460238+0000","last_undegraded":"2024-04-23T18:33:29.460238+0000","last_fullsized":"2024-04-23T18:33:29.460238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-23T18:33:29.460103+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-23T18:33:29.460103+0000","last_clean_scrub_stamp":"2024-04-23T18:33:29.460103+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:13:37.061397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:12.313127+0000","last_change":"2024-04-23T18:33:12.313127+0000","last_active":"2024-04-23T18:33:12.313127+0000","last_peered":"2024-04-23T18:33:12.313127+0000","last_clean":"2024-04-23T18:33:12.313127+0000","last_became_active":"2024-04-23T18:29:13.499137+0000","last_became_peered":"2024-04-23T18:29:13.499137+0000","last_unstale":"2024-04-23T18:33:12.313127+0000","last_undegraded":"2024-04-23T18:33:12.313127+0000","last_fullsized":"2024-04-23T18:33:12.313127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:12.313012+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:12.313012+0000","last_clean_scrub_stamp":"2024-04-23T18:33:12.313012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:20:11.318686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:14.855562+0000","last_change":"2024-04-23T18:33:14.855562+0000","last_active":"2024-04-23T18:33:14.855562+0000","last_peered":"2024-04-23T18:33:14.855562+0000","last_clean":"2024-04-23T18:33:14.855562+0000","last_became_active":"2024-04-23T18:29:11.500584+0000","last_became_peered":"2024-04-23T18:29:11.500584+0000","last_unstale":"2024-04-23T18:33:14.855562+0000","last_undegraded":"2024-04-23T18:33:14.855562+0000","last_fullsized":"2024-04-23T18:33:14.855562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:14.855437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:14.855437+0000","last_clean_scrub_stamp":"2024-04-23T18:33:14.855437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:41:50.377951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:51.494521+0000","last_change":"2024-04-23T18:32:51.494521+0000","last_active":"2024-04-23T18:32:51.494521+0000","last_peered":"2024-04-23T18:32:51.494521+0000","last_clean":"2024-04-23T18:32:51.494521+0000","last_became_active":"2024-04-23T18:29:15.503315+0000","last_became_peered":"2024-04-23T18:29:15.503315+0000","last_unstale":"2024-04-23T18:32:51.494521+0000","last_undegraded":"2024-04-23T18:32:51.494521+0000","last_fullsized":"2024-04-23T18:32:51.494521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:51.494354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:51.494354+0000","last_clean_scrub_stamp":"2024-04-23T18:32:51.494354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:20:13.705269+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.449417+0000","last_change":"2024-04-23T18:33:00.449461+0000","last_active":"2024-04-23T18:33:00.449417+0000","last_peered":"2024-04-23T18:33:00.449417+0000","last_clean":"2024-04-23T18:33:00.449417+0000","last_became_active":"2024-04-23T18:29:17.516934+0000","last_became_peered":"2024-04-23T18:29:17.516934+0000","last_unstale":"2024-04-23T18:33:00.449417+0000","last_undegraded":"2024-04-23T18:33:00.449417+0000","last_fullsized":"2024-04-23T18:33:00.449417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-23T18:33:00.449324+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-23T18:33:00.449324+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.449324+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:16.722855+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:31.933324+0000","last_change":"2024-04-23T18:32:31.933350+0000","last_active":"2024-04-23T18:32:31.933324+0000","last_peered":"2024-04-23T18:32:31.933324+0000","last_clean":"2024-04-23T18:32:31.933324+0000","last_became_active":"2024-04-23T18:29:19.519854+0000","last_became_peered":"2024-04-23T18:29:19.519854+0000","last_unstale":"2024-04-23T18:32:31.933324+0000","last_undegraded":"2024-04-23T18:32:31.933324+0000","last_fullsized":"2024-04-23T18:32:31.933324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:31.933225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:31.933225+0000","last_clean_scrub_stamp":"2024-04-23T18:32:31.933225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:13:09.747281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:56.470630+0000","last_change":"2024-04-23T18:33:56.470630+0000","last_active":"2024-04-23T18:33:56.470630+0000","last_peered":"2024-04-23T18:33:56.470630+0000","last_clean":"2024-04-23T18:33:56.470630+0000","last_became_active":"2024-04-23T18:29:21.534487+0000","last_became_peered":"2024-04-23T18:29:21.534487+0000","last_unstale":"2024-04-23T18:33:56.470630+0000","last_undegraded":"2024-04-23T18:33:56.470630+0000","last_fullsized":"2024-04-23T18:33:56.470630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:56.470522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:56.470522+0000","last_clean_scrub_stamp":"2024-04-23T18:33:56.470522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:35.578427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:48.425530+0000","last_change":"2024-04-23T18:32:48.425557+0000","last_active":"2024-04-23T18:32:48.425530+0000","last_peered":"2024-04-23T18:32:48.425530+0000","last_clean":"2024-04-23T18:32:48.425530+0000","last_became_active":"2024-04-23T18:29:13.502710+0000","last_became_peered":"2024-04-23T18:29:13.502710+0000","last_unstale":"2024-04-23T18:32:48.425530+0000","last_undegraded":"2024-04-23T18:32:48.425530+0000","last_fullsized":"2024-04-23T18:32:48.425530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:32:48.425438+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:32:48.425438+0000","last_clean_scrub_stamp":"2024-04-23T18:32:48.425438+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:21.214995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:24.712858+0000","last_change":"2024-04-23T18:33:24.712858+0000","last_active":"2024-04-23T18:33:24.712858+0000","last_peered":"2024-04-23T18:33:24.712858+0000","last_clean":"2024-04-23T18:33:24.712858+0000","last_became_active":"2024-04-23T18:29:11.497191+0000","last_became_peered":"2024-04-23T18:29:11.497191+0000","last_unstale":"2024-04-23T18:33:24.712858+0000","last_undegraded":"2024-04-23T18:33:24.712858+0000","last_fullsized":"2024-04-23T18:33:24.712858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:24.712698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:24.712698+0000","last_clean_scrub_stamp":"2024-04-23T18:33:24.712698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:18:40.986230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:52.464891+0000","last_change":"2024-04-23T18:32:52.464923+0000","last_active":"2024-04-23T18:32:52.464891+0000","last_peered":"2024-04-23T18:32:52.464891+0000","last_clean":"2024-04-23T18:32:52.464891+0000","last_became_active":"2024-04-23T18:29:15.501957+0000","last_became_peered":"2024-04-23T18:29:15.501957+0000","last_unstale":"2024-04-23T18:32:52.464891+0000","last_undegraded":"2024-04-23T18:32:52.464891+0000","last_fullsized":"2024-04-23T18:32:52.464891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:52.464769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:52.464769+0000","last_clean_scrub_stamp":"2024-04-23T18:32:52.464769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:12.012567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:45.245695+0000","last_change":"2024-04-23T18:32:45.245695+0000","last_active":"2024-04-23T18:32:45.245695+0000","last_peered":"2024-04-23T18:32:45.245695+0000","last_clean":"2024-04-23T18:32:45.245695+0000","last_became_active":"2024-04-23T18:29:17.503196+0000","last_became_peered":"2024-04-23T18:29:17.503196+0000","last_unstale":"2024-04-23T18:32:45.245695+0000","last_undegraded":"2024-04-23T18:32:45.245695+0000","last_fullsized":"2024-04-23T18:32:45.245695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-04-23T18:32:45.245551+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-04-23T18:32:45.245551+0000","last_clean_scrub_stamp":"2024-04-23T18:32:45.245551+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:49:00.152459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.211198+0000","last_change":"2024-04-23T18:32:56.211198+0000","last_active":"2024-04-23T18:32:56.211198+0000","last_peered":"2024-04-23T18:32:56.211198+0000","last_clean":"2024-04-23T18:32:56.211198+0000","last_became_active":"2024-04-23T18:29:19.527687+0000","last_became_peered":"2024-04-23T18:29:19.527687+0000","last_unstale":"2024-04-23T18:32:56.211198+0000","last_undegraded":"2024-04-23T18:32:56.211198+0000","last_fullsized":"2024-04-23T18:32:56.211198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:56.211082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:56.211082+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.211082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:22:29.050437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:54.482421+0000","last_change":"2024-04-23T18:33:54.482421+0000","last_active":"2024-04-23T18:33:54.482421+0000","last_peered":"2024-04-23T18:33:54.482421+0000","last_clean":"2024-04-23T18:33:54.482421+0000","last_became_active":"2024-04-23T18:29:21.533754+0000","last_became_peered":"2024-04-23T18:29:21.533754+0000","last_unstale":"2024-04-23T18:33:54.482421+0000","last_undegraded":"2024-04-23T18:33:54.482421+0000","last_fullsized":"2024-04-23T18:33:54.482421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-23T18:33:54.482300+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-23T18:33:54.482300+0000","last_clean_scrub_stamp":"2024-04-23T18:33:54.482300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:26:35.321911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'14","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.271342+0000","last_change":"2024-04-23T18:33:10.271368+0000","last_active":"2024-04-23T18:33:10.271342+0000","last_peered":"2024-04-23T18:33:10.271342+0000","last_clean":"2024-04-23T18:33:10.271342+0000","last_became_active":"2024-04-23T18:29:13.497121+0000","last_became_peered":"2024-04-23T18:29:13.497121+0000","last_unstale":"2024-04-23T18:33:10.271342+0000","last_undegraded":"2024-04-23T18:33:10.271342+0000","last_fullsized":"2024-04-23T18:33:10.271342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-23T18:33:10.271244+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-23T18:33:10.271244+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.271244+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:45.140086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:30.472292+0000","last_change":"2024-04-23T18:33:30.472292+0000","last_active":"2024-04-23T18:33:30.472292+0000","last_peered":"2024-04-23T18:33:30.472292+0000","last_clean":"2024-04-23T18:33:30.472292+0000","last_became_active":"2024-04-23T18:29:11.504564+0000","last_became_peered":"2024-04-23T18:29:11.504564+0000","last_unstale":"2024-04-23T18:33:30.472292+0000","last_undegraded":"2024-04-23T18:33:30.472292+0000","last_fullsized":"2024-04-23T18:33:30.472292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:30.472113+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:30.472113+0000","last_clean_scrub_stamp":"2024-04-23T18:33:30.472113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:08:02.467495+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.918227+0000","last_change":"2024-04-23T18:32:50.918254+0000","last_active":"2024-04-23T18:32:50.918227+0000","last_peered":"2024-04-23T18:32:50.918227+0000","last_clean":"2024-04-23T18:32:50.918227+0000","last_became_active":"2024-04-23T18:29:15.506171+0000","last_became_peered":"2024-04-23T18:29:15.506171+0000","last_unstale":"2024-04-23T18:32:50.918227+0000","last_undegraded":"2024-04-23T18:32:50.918227+0000","last_fullsized":"2024-04-23T18:32:50.918227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.918119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.918119+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.918119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:21:12.800419+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:57.419573+0000","last_change":"2024-04-23T18:32:57.419573+0000","last_active":"2024-04-23T18:32:57.419573+0000","last_peered":"2024-04-23T18:32:57.419573+0000","last_clean":"2024-04-23T18:32:57.419573+0000","last_became_active":"2024-04-23T18:29:17.517051+0000","last_became_peered":"2024-04-23T18:29:17.517051+0000","last_unstale":"2024-04-23T18:32:57.419573+0000","last_undegraded":"2024-04-23T18:32:57.419573+0000","last_fullsized":"2024-04-23T18:32:57.419573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-23T18:32:57.419450+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-23T18:32:57.419450+0000","last_clean_scrub_stamp":"2024-04-23T18:32:57.419450+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:03.100050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":379,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.362652+0000","last_change":"2024-04-23T18:32:41.362652+0000","last_active":"2024-04-23T18:32:41.362652+0000","last_peered":"2024-04-23T18:32:41.362652+0000","last_clean":"2024-04-23T18:32:41.362652+0000","last_became_active":"2024-04-23T18:29:19.527614+0000","last_became_peered":"2024-04-23T18:29:19.527614+0000","last_unstale":"2024-04-23T18:32:41.362652+0000","last_undegraded":"2024-04-23T18:32:41.362652+0000","last_fullsized":"2024-04-23T18:32:41.362652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-23T18:32:41.362491+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-23T18:32:41.362491+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.362491+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:25:00.632414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:51.478350+0000","last_change":"2024-04-23T18:33:51.478350+0000","last_active":"2024-04-23T18:33:51.478350+0000","last_peered":"2024-04-23T18:33:51.478350+0000","last_clean":"2024-04-23T18:33:51.478350+0000","last_became_active":"2024-04-23T18:29:21.530619+0000","last_became_peered":"2024-04-23T18:29:21.530619+0000","last_unstale":"2024-04-23T18:33:51.478350+0000","last_undegraded":"2024-04-23T18:33:51.478350+0000","last_fullsized":"2024-04-23T18:33:51.478350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:51.478214+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:51.478214+0000","last_clean_scrub_stamp":"2024-04-23T18:33:51.478214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:33.921006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.394288+0000","last_change":"2024-04-23T18:33:03.394334+0000","last_active":"2024-04-23T18:33:03.394288+0000","last_peered":"2024-04-23T18:33:03.394288+0000","last_clean":"2024-04-23T18:33:03.394288+0000","last_became_active":"2024-04-23T18:29:13.501741+0000","last_became_peered":"2024-04-23T18:29:13.501741+0000","last_unstale":"2024-04-23T18:33:03.394288+0000","last_undegraded":"2024-04-23T18:33:03.394288+0000","last_fullsized":"2024-04-23T18:33:03.394288+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:03.394147+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:03.394147+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.394147+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:25.573714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:12.923516+0000","last_change":"2024-04-23T18:33:12.923516+0000","last_active":"2024-04-23T18:33:12.923516+0000","last_peered":"2024-04-23T18:33:12.923516+0000","last_clean":"2024-04-23T18:33:12.923516+0000","last_became_active":"2024-04-23T18:29:11.500781+0000","last_became_peered":"2024-04-23T18:29:11.500781+0000","last_unstale":"2024-04-23T18:33:12.923516+0000","last_undegraded":"2024-04-23T18:33:12.923516+0000","last_fullsized":"2024-04-23T18:33:12.923516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:12.923402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:12.923402+0000","last_clean_scrub_stamp":"2024-04-23T18:33:12.923402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:45.712959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:30.729921+0000","last_change":"2024-04-23T18:33:30.729968+0000","last_active":"2024-04-23T18:33:30.729921+0000","last_peered":"2024-04-23T18:33:30.729921+0000","last_clean":"2024-04-23T18:33:30.729921+0000","last_became_active":"2024-04-23T18:29:52.549944+0000","last_became_peered":"2024-04-23T18:29:52.549944+0000","last_unstale":"2024-04-23T18:33:30.729921+0000","last_undegraded":"2024-04-23T18:33:30.729921+0000","last_fullsized":"2024-04-23T18:33:30.729921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:30.729833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:30.729833+0000","last_clean_scrub_stamp":"2024-04-23T18:33:30.729833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:52.671500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'45","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:41.837483+0000","last_change":"2024-04-23T18:32:41.837483+0000","last_active":"2024-04-23T18:32:41.837483+0000","last_peered":"2024-04-23T18:32:41.837483+0000","last_clean":"2024-04-23T18:32:41.837483+0000","last_became_active":"2024-04-23T18:29:17.509076+0000","last_became_peered":"2024-04-23T18:29:17.509076+0000","last_unstale":"2024-04-23T18:32:41.837483+0000","last_undegraded":"2024-04-23T18:32:41.837483+0000","last_fullsized":"2024-04-23T18:32:41.837483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-23T18:32:41.837343+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-23T18:32:41.837343+0000","last_clean_scrub_stamp":"2024-04-23T18:32:41.837343+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:20:11.245831+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:32.466759+0000","last_change":"2024-04-23T18:32:32.466759+0000","last_active":"2024-04-23T18:32:32.466759+0000","last_peered":"2024-04-23T18:32:32.466759+0000","last_clean":"2024-04-23T18:32:32.466759+0000","last_became_active":"2024-04-23T18:29:19.518673+0000","last_became_peered":"2024-04-23T18:29:19.518673+0000","last_unstale":"2024-04-23T18:32:32.466759+0000","last_undegraded":"2024-04-23T18:32:32.466759+0000","last_fullsized":"2024-04-23T18:32:32.466759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:32.466649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:32.466649+0000","last_clean_scrub_stamp":"2024-04-23T18:32:32.466649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:22:40.471567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:29.750004+0000","last_change":"2024-04-23T18:33:29.750004+0000","last_active":"2024-04-23T18:33:29.750004+0000","last_peered":"2024-04-23T18:33:29.750004+0000","last_clean":"2024-04-23T18:33:29.750004+0000","last_became_active":"2024-04-23T18:29:21.533187+0000","last_became_peered":"2024-04-23T18:29:21.533187+0000","last_unstale":"2024-04-23T18:33:29.750004+0000","last_undegraded":"2024-04-23T18:33:29.750004+0000","last_fullsized":"2024-04-23T18:33:29.750004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:29.749876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:29.749876+0000","last_clean_scrub_stamp":"2024-04-23T18:33:29.749876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:01:05.290487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.441100+0000","last_change":"2024-04-23T18:33:05.441126+0000","last_active":"2024-04-23T18:33:05.441100+0000","last_peered":"2024-04-23T18:33:05.441100+0000","last_clean":"2024-04-23T18:33:05.441100+0000","last_became_active":"2024-04-23T18:29:13.501974+0000","last_became_peered":"2024-04-23T18:29:13.501974+0000","last_unstale":"2024-04-23T18:33:05.441100+0000","last_undegraded":"2024-04-23T18:33:05.441100+0000","last_fullsized":"2024-04-23T18:33:05.441100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:05.441015+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:05.441015+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.441015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:46.321194+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:24.451860+0000","last_change":"2024-04-23T18:33:24.451860+0000","last_active":"2024-04-23T18:33:24.451860+0000","last_peered":"2024-04-23T18:33:24.451860+0000","last_clean":"2024-04-23T18:33:24.451860+0000","last_became_active":"2024-04-23T18:29:11.511297+0000","last_became_peered":"2024-04-23T18:29:11.511297+0000","last_unstale":"2024-04-23T18:33:24.451860+0000","last_undegraded":"2024-04-23T18:33:24.451860+0000","last_fullsized":"2024-04-23T18:33:24.451860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:24.451739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:24.451739+0000","last_clean_scrub_stamp":"2024-04-23T18:33:24.451739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:11:02.322238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:50.503698+0000","last_change":"2024-04-23T18:32:50.503761+0000","last_active":"2024-04-23T18:32:50.503698+0000","last_peered":"2024-04-23T18:32:50.503698+0000","last_clean":"2024-04-23T18:32:50.503698+0000","last_became_active":"2024-04-23T18:29:15.504528+0000","last_became_peered":"2024-04-23T18:29:15.504528+0000","last_unstale":"2024-04-23T18:32:50.503698+0000","last_undegraded":"2024-04-23T18:32:50.503698+0000","last_fullsized":"2024-04-23T18:32:50.503698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:50.503597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:50.503597+0000","last_clean_scrub_stamp":"2024-04-23T18:32:50.503597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:20:31.588182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.345524+0000","last_change":"2024-04-23T18:32:42.345524+0000","last_active":"2024-04-23T18:32:42.345524+0000","last_peered":"2024-04-23T18:32:42.345524+0000","last_clean":"2024-04-23T18:32:42.345524+0000","last_became_active":"2024-04-23T18:29:17.513482+0000","last_became_peered":"2024-04-23T18:29:17.513482+0000","last_unstale":"2024-04-23T18:32:42.345524+0000","last_undegraded":"2024-04-23T18:32:42.345524+0000","last_fullsized":"2024-04-23T18:32:42.345524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-23T18:32:42.345340+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-23T18:32:42.345340+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.345340+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:11.159885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.418829+0000","last_change":"2024-04-23T18:33:11.418829+0000","last_active":"2024-04-23T18:33:11.418829+0000","last_peered":"2024-04-23T18:33:11.418829+0000","last_clean":"2024-04-23T18:33:11.418829+0000","last_became_active":"2024-04-23T18:29:19.525985+0000","last_became_peered":"2024-04-23T18:29:19.525985+0000","last_unstale":"2024-04-23T18:33:11.418829+0000","last_undegraded":"2024-04-23T18:33:11.418829+0000","last_fullsized":"2024-04-23T18:33:11.418829+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:11.418670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:11.418670+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.418670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:05:53.730800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:15.397003+0000","last_change":"2024-04-23T18:33:15.397003+0000","last_active":"2024-04-23T18:33:15.397003+0000","last_peered":"2024-04-23T18:33:15.397003+0000","last_clean":"2024-04-23T18:33:15.397003+0000","last_became_active":"2024-04-23T18:29:21.528665+0000","last_became_peered":"2024-04-23T18:29:21.528665+0000","last_unstale":"2024-04-23T18:33:15.397003+0000","last_undegraded":"2024-04-23T18:33:15.397003+0000","last_fullsized":"2024-04-23T18:33:15.397003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:15.396887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:15.396887+0000","last_clean_scrub_stamp":"2024-04-23T18:33:15.396887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:11:59.736058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:18.427331+0000","last_change":"2024-04-23T18:33:18.427331+0000","last_active":"2024-04-23T18:33:18.427331+0000","last_peered":"2024-04-23T18:33:18.427331+0000","last_clean":"2024-04-23T18:33:18.427331+0000","last_became_active":"2024-04-23T18:29:13.494647+0000","last_became_peered":"2024-04-23T18:29:13.494647+0000","last_unstale":"2024-04-23T18:33:18.427331+0000","last_undegraded":"2024-04-23T18:33:18.427331+0000","last_fullsized":"2024-04-23T18:33:18.427331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:18.427151+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:18.427151+0000","last_clean_scrub_stamp":"2024-04-23T18:33:18.427151+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:31:27.364438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:03.286325+0000","last_change":"2024-04-23T18:33:03.286325+0000","last_active":"2024-04-23T18:33:03.286325+0000","last_peered":"2024-04-23T18:33:03.286325+0000","last_clean":"2024-04-23T18:33:03.286325+0000","last_became_active":"2024-04-23T18:29:11.495723+0000","last_became_peered":"2024-04-23T18:29:11.495723+0000","last_unstale":"2024-04-23T18:33:03.286325+0000","last_undegraded":"2024-04-23T18:33:03.286325+0000","last_fullsized":"2024-04-23T18:33:03.286325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:03.286196+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:03.286196+0000","last_clean_scrub_stamp":"2024-04-23T18:33:03.286196+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:59:50.509925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:42.847886+0000","last_change":"2024-04-23T18:32:42.847886+0000","last_active":"2024-04-23T18:32:42.847886+0000","last_peered":"2024-04-23T18:32:42.847886+0000","last_clean":"2024-04-23T18:32:42.847886+0000","last_became_active":"2024-04-23T18:29:15.510185+0000","last_became_peered":"2024-04-23T18:29:15.510185+0000","last_unstale":"2024-04-23T18:32:42.847886+0000","last_undegraded":"2024-04-23T18:32:42.847886+0000","last_fullsized":"2024-04-23T18:32:42.847886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:42.847777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:42.847777+0000","last_clean_scrub_stamp":"2024-04-23T18:32:42.847777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:20:23.932361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'34","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.386198+0000","last_change":"2024-04-23T18:32:58.386231+0000","last_active":"2024-04-23T18:32:58.386198+0000","last_peered":"2024-04-23T18:32:58.386198+0000","last_clean":"2024-04-23T18:32:58.386198+0000","last_became_active":"2024-04-23T18:29:17.516989+0000","last_became_peered":"2024-04-23T18:29:17.516989+0000","last_unstale":"2024-04-23T18:32:58.386198+0000","last_undegraded":"2024-04-23T18:32:58.386198+0000","last_fullsized":"2024-04-23T18:32:58.386198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'34","last_scrub_stamp":"2024-04-23T18:32:58.386098+0000","last_deep_scrub":"34'34","last_deep_scrub_stamp":"2024-04-23T18:32:58.386098+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.386098+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:53:39.139901+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":38,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:54.462758+0000","last_change":"2024-04-23T18:32:54.462797+0000","last_active":"2024-04-23T18:32:54.462758+0000","last_peered":"2024-04-23T18:32:54.462758+0000","last_clean":"2024-04-23T18:32:54.462758+0000","last_became_active":"2024-04-23T18:29:19.522217+0000","last_became_peered":"2024-04-23T18:29:19.522217+0000","last_unstale":"2024-04-23T18:32:54.462758+0000","last_undegraded":"2024-04-23T18:32:54.462758+0000","last_fullsized":"2024-04-23T18:32:54.462758+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:54.462671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:54.462671+0000","last_clean_scrub_stamp":"2024-04-23T18:32:54.462671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:02:37.395360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:52.496093+0000","last_change":"2024-04-23T18:33:52.496093+0000","last_active":"2024-04-23T18:33:52.496093+0000","last_peered":"2024-04-23T18:33:52.496093+0000","last_clean":"2024-04-23T18:33:52.496093+0000","last_became_active":"2024-04-23T18:29:21.533152+0000","last_became_peered":"2024-04-23T18:29:21.533152+0000","last_unstale":"2024-04-23T18:33:52.496093+0000","last_undegraded":"2024-04-23T18:33:52.496093+0000","last_fullsized":"2024-04-23T18:33:52.496093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:52.495976+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:52.495976+0000","last_clean_scrub_stamp":"2024-04-23T18:33:52.495976+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:54.109294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.413678+0000","last_change":"2024-04-23T18:33:07.413678+0000","last_active":"2024-04-23T18:33:07.413678+0000","last_peered":"2024-04-23T18:33:07.413678+0000","last_clean":"2024-04-23T18:33:07.413678+0000","last_became_active":"2024-04-23T18:29:13.501782+0000","last_became_peered":"2024-04-23T18:29:13.501782+0000","last_unstale":"2024-04-23T18:33:07.413678+0000","last_undegraded":"2024-04-23T18:33:07.413678+0000","last_fullsized":"2024-04-23T18:33:07.413678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:07.413496+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:07.413496+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.413496+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:16:45.543382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:10.946596+0000","last_change":"2024-04-23T18:33:10.946596+0000","last_active":"2024-04-23T18:33:10.946596+0000","last_peered":"2024-04-23T18:33:10.946596+0000","last_clean":"2024-04-23T18:33:10.946596+0000","last_became_active":"2024-04-23T18:29:11.501648+0000","last_became_peered":"2024-04-23T18:29:11.501648+0000","last_unstale":"2024-04-23T18:33:10.946596+0000","last_undegraded":"2024-04-23T18:33:10.946596+0000","last_fullsized":"2024-04-23T18:33:10.946596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:10.946483+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:10.946483+0000","last_clean_scrub_stamp":"2024-04-23T18:33:10.946483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:32.809456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:44.904604+0000","last_change":"2024-04-23T18:32:44.904604+0000","last_active":"2024-04-23T18:32:44.904604+0000","last_peered":"2024-04-23T18:32:44.904604+0000","last_clean":"2024-04-23T18:32:44.904604+0000","last_became_active":"2024-04-23T18:29:15.509725+0000","last_became_peered":"2024-04-23T18:29:15.509725+0000","last_unstale":"2024-04-23T18:32:44.904604+0000","last_undegraded":"2024-04-23T18:32:44.904604+0000","last_fullsized":"2024-04-23T18:32:44.904604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-23T18:32:44.904494+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-23T18:32:44.904494+0000","last_clean_scrub_stamp":"2024-04-23T18:32:44.904494+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:04.452291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:02.413489+0000","last_change":"2024-04-23T18:33:02.413529+0000","last_active":"2024-04-23T18:33:02.413489+0000","last_peered":"2024-04-23T18:33:02.413489+0000","last_clean":"2024-04-23T18:33:02.413489+0000","last_became_active":"2024-04-23T18:29:17.514823+0000","last_became_peered":"2024-04-23T18:29:17.514823+0000","last_unstale":"2024-04-23T18:33:02.413489+0000","last_undegraded":"2024-04-23T18:33:02.413489+0000","last_fullsized":"2024-04-23T18:33:02.413489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-04-23T18:33:02.413401+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-04-23T18:33:02.413401+0000","last_clean_scrub_stamp":"2024-04-23T18:33:02.413401+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:18.372633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:40.280462+0000","last_change":"2024-04-23T18:32:40.280484+0000","last_active":"2024-04-23T18:32:40.280462+0000","last_peered":"2024-04-23T18:32:40.280462+0000","last_clean":"2024-04-23T18:32:40.280462+0000","last_became_active":"2024-04-23T18:29:19.519153+0000","last_became_peered":"2024-04-23T18:29:19.519153+0000","last_unstale":"2024-04-23T18:32:40.280462+0000","last_undegraded":"2024-04-23T18:32:40.280462+0000","last_fullsized":"2024-04-23T18:32:40.280462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:32:40.280370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:32:40.280370+0000","last_clean_scrub_stamp":"2024-04-23T18:32:40.280370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:13:40.211480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:19.447649+0000","last_change":"2024-04-23T18:33:19.447649+0000","last_active":"2024-04-23T18:33:19.447649+0000","last_peered":"2024-04-23T18:33:19.447649+0000","last_clean":"2024-04-23T18:33:19.447649+0000","last_became_active":"2024-04-23T18:29:21.529331+0000","last_became_peered":"2024-04-23T18:29:21.529331+0000","last_unstale":"2024-04-23T18:33:19.447649+0000","last_undegraded":"2024-04-23T18:33:19.447649+0000","last_fullsized":"2024-04-23T18:33:19.447649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:19.447542+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:19.447542+0000","last_clean_scrub_stamp":"2024-04-23T18:33:19.447542+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:44:10.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'14","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:32.663491+0000","last_change":"2024-04-23T18:33:32.663491+0000","last_active":"2024-04-23T18:33:32.663491+0000","last_peered":"2024-04-23T18:33:32.663491+0000","last_clean":"2024-04-23T18:33:32.663491+0000","last_became_active":"2024-04-23T18:29:52.551523+0000","last_became_peered":"2024-04-23T18:29:52.551523+0000","last_unstale":"2024-04-23T18:33:32.663491+0000","last_undegraded":"2024-04-23T18:33:32.663491+0000","last_fullsized":"2024-04-23T18:33:32.663491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-23T18:33:32.663374+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-23T18:33:32.663374+0000","last_clean_scrub_stamp":"2024-04-23T18:33:32.663374+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:36:37.284332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.409650+0000","last_change":"2024-04-23T18:33:06.409650+0000","last_active":"2024-04-23T18:33:06.409650+0000","last_peered":"2024-04-23T18:33:06.409650+0000","last_clean":"2024-04-23T18:33:06.409650+0000","last_became_active":"2024-04-23T18:29:11.489284+0000","last_became_peered":"2024-04-23T18:29:11.489284+0000","last_unstale":"2024-04-23T18:33:06.409650+0000","last_undegraded":"2024-04-23T18:33:06.409650+0000","last_fullsized":"2024-04-23T18:33:06.409650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:06.409508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:06.409508+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.409508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:27:04.085219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:06.191207+0000","last_change":"2024-04-23T18:33:06.191207+0000","last_active":"2024-04-23T18:33:06.191207+0000","last_peered":"2024-04-23T18:33:06.191207+0000","last_clean":"2024-04-23T18:33:06.191207+0000","last_became_active":"2024-04-23T18:29:13.496958+0000","last_became_peered":"2024-04-23T18:29:13.496958+0000","last_unstale":"2024-04-23T18:33:06.191207+0000","last_undegraded":"2024-04-23T18:33:06.191207+0000","last_fullsized":"2024-04-23T18:33:06.191207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:06.191085+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:06.191085+0000","last_clean_scrub_stamp":"2024-04-23T18:33:06.191085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:46:01.648450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:23.363748+0000","last_change":"2024-04-23T18:33:23.363748+0000","last_active":"2024-04-23T18:33:23.363748+0000","last_peered":"2024-04-23T18:33:23.363748+0000","last_clean":"2024-04-23T18:33:23.363748+0000","last_became_active":"2024-04-23T18:29:11.486563+0000","last_became_peered":"2024-04-23T18:29:11.486563+0000","last_unstale":"2024-04-23T18:33:23.363748+0000","last_undegraded":"2024-04-23T18:33:23.363748+0000","last_fullsized":"2024-04-23T18:33:23.363748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:23.363565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:23.363565+0000","last_clean_scrub_stamp":"2024-04-23T18:33:23.363565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:08.265861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'12","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:20.467793+0000","last_change":"2024-04-23T18:33:20.467793+0000","last_active":"2024-04-23T18:33:20.467793+0000","last_peered":"2024-04-23T18:33:20.467793+0000","last_clean":"2024-04-23T18:33:20.467793+0000","last_became_active":"2024-04-23T18:29:13.494683+0000","last_became_peered":"2024-04-23T18:29:13.494683+0000","last_unstale":"2024-04-23T18:33:20.467793+0000","last_undegraded":"2024-04-23T18:33:20.467793+0000","last_fullsized":"2024-04-23T18:33:20.467793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:33:20.467687+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:33:20.467687+0000","last_clean_scrub_stamp":"2024-04-23T18:33:20.467687+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:55.559898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:37.470078+0000","last_change":"2024-04-23T18:33:37.470103+0000","last_active":"2024-04-23T18:33:37.470078+0000","last_peered":"2024-04-23T18:33:37.470078+0000","last_clean":"2024-04-23T18:33:37.470078+0000","last_became_active":"2024-04-23T18:29:11.510971+0000","last_became_peered":"2024-04-23T18:29:11.510971+0000","last_unstale":"2024-04-23T18:33:37.470078+0000","last_undegraded":"2024-04-23T18:33:37.470078+0000","last_fullsized":"2024-04-23T18:33:37.470078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:37.469989+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:37.469989+0000","last_clean_scrub_stamp":"2024-04-23T18:33:37.469989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:31.535506+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.219714+0000","last_change":"2024-04-23T18:33:08.219714+0000","last_active":"2024-04-23T18:33:08.219714+0000","last_peered":"2024-04-23T18:33:08.219714+0000","last_clean":"2024-04-23T18:33:08.219714+0000","last_became_active":"2024-04-23T18:29:13.497094+0000","last_became_peered":"2024-04-23T18:29:13.497094+0000","last_unstale":"2024-04-23T18:33:08.219714+0000","last_undegraded":"2024-04-23T18:33:08.219714+0000","last_fullsized":"2024-04-23T18:33:08.219714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-23T18:33:08.219588+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-23T18:33:08.219588+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.219588+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:10.922039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:25.388007+0000","last_change":"2024-04-23T18:33:25.388034+0000","last_active":"2024-04-23T18:33:25.388007+0000","last_peered":"2024-04-23T18:33:25.388007+0000","last_clean":"2024-04-23T18:33:25.388007+0000","last_became_active":"2024-04-23T18:29:11.492064+0000","last_became_peered":"2024-04-23T18:29:11.492064+0000","last_unstale":"2024-04-23T18:33:25.388007+0000","last_undegraded":"2024-04-23T18:33:25.388007+0000","last_fullsized":"2024-04-23T18:33:25.388007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:25.387886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:25.387886+0000","last_clean_scrub_stamp":"2024-04-23T18:33:25.387886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:45:22.119958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:59.172545+0000","last_change":"2024-04-23T18:32:59.172545+0000","last_active":"2024-04-23T18:32:59.172545+0000","last_peered":"2024-04-23T18:32:59.172545+0000","last_clean":"2024-04-23T18:32:59.172545+0000","last_became_active":"2024-04-23T18:29:13.502243+0000","last_became_peered":"2024-04-23T18:29:13.502243+0000","last_unstale":"2024-04-23T18:32:59.172545+0000","last_undegraded":"2024-04-23T18:32:59.172545+0000","last_fullsized":"2024-04-23T18:32:59.172545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:32:59.172373+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:32:59.172373+0000","last_clean_scrub_stamp":"2024-04-23T18:32:59.172373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:11.409328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:21.326080+0000","last_change":"2024-04-23T18:33:21.326080+0000","last_active":"2024-04-23T18:33:21.326080+0000","last_peered":"2024-04-23T18:33:21.326080+0000","last_clean":"2024-04-23T18:33:21.326080+0000","last_became_active":"2024-04-23T18:29:11.486452+0000","last_became_peered":"2024-04-23T18:29:11.486452+0000","last_unstale":"2024-04-23T18:33:21.326080+0000","last_undegraded":"2024-04-23T18:33:21.326080+0000","last_fullsized":"2024-04-23T18:33:21.326080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:21.325963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:21.325963+0000","last_clean_scrub_stamp":"2024-04-23T18:33:21.325963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:37:18.055667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:53.894295+0000","last_change":"2024-04-23T18:32:53.894295+0000","last_active":"2024-04-23T18:32:53.894295+0000","last_peered":"2024-04-23T18:32:53.894295+0000","last_clean":"2024-04-23T18:32:53.894295+0000","last_became_active":"2024-04-23T18:29:13.507582+0000","last_became_peered":"2024-04-23T18:29:13.507582+0000","last_unstale":"2024-04-23T18:32:53.894295+0000","last_undegraded":"2024-04-23T18:32:53.894295+0000","last_fullsized":"2024-04-23T18:32:53.894295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:32:53.894122+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:32:53.894122+0000","last_clean_scrub_stamp":"2024-04-23T18:32:53.894122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:12.522802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:22.759180+0000","last_change":"2024-04-23T18:33:22.759180+0000","last_active":"2024-04-23T18:33:22.759180+0000","last_peered":"2024-04-23T18:33:22.759180+0000","last_clean":"2024-04-23T18:33:22.759180+0000","last_became_active":"2024-04-23T18:29:11.493318+0000","last_became_peered":"2024-04-23T18:29:11.493318+0000","last_unstale":"2024-04-23T18:33:22.759180+0000","last_undegraded":"2024-04-23T18:33:22.759180+0000","last_fullsized":"2024-04-23T18:33:22.759180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:22.759052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:22.759052+0000","last_clean_scrub_stamp":"2024-04-23T18:33:22.759052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:54:03.512856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'22","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:14.304260+0000","last_change":"2024-04-23T18:33:14.304260+0000","last_active":"2024-04-23T18:33:14.304260+0000","last_peered":"2024-04-23T18:33:14.304260+0000","last_clean":"2024-04-23T18:33:14.304260+0000","last_became_active":"2024-04-23T18:29:13.499155+0000","last_became_peered":"2024-04-23T18:29:13.499155+0000","last_unstale":"2024-04-23T18:33:14.304260+0000","last_undegraded":"2024-04-23T18:33:14.304260+0000","last_fullsized":"2024-04-23T18:33:14.304260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-23T18:33:14.304134+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-23T18:33:14.304134+0000","last_clean_scrub_stamp":"2024-04-23T18:33:14.304134+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:54.060618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.369384+0000","last_change":"2024-04-23T18:33:08.369384+0000","last_active":"2024-04-23T18:33:08.369384+0000","last_peered":"2024-04-23T18:33:08.369384+0000","last_clean":"2024-04-23T18:33:08.369384+0000","last_became_active":"2024-04-23T18:29:11.485201+0000","last_became_peered":"2024-04-23T18:29:11.485201+0000","last_unstale":"2024-04-23T18:33:08.369384+0000","last_undegraded":"2024-04-23T18:33:08.369384+0000","last_fullsized":"2024-04-23T18:33:08.369384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:08.369275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:08.369275+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.369275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:55.252697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.937232+0000","last_change":"2024-04-23T18:33:09.937232+0000","last_active":"2024-04-23T18:33:09.937232+0000","last_peered":"2024-04-23T18:33:09.937232+0000","last_clean":"2024-04-23T18:33:09.937232+0000","last_became_active":"2024-04-23T18:29:13.495654+0000","last_became_peered":"2024-04-23T18:29:13.495654+0000","last_unstale":"2024-04-23T18:33:09.937232+0000","last_undegraded":"2024-04-23T18:33:09.937232+0000","last_fullsized":"2024-04-23T18:33:09.937232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-23T18:33:09.937116+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-23T18:33:09.937116+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.937116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:59:04.365933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:09.264085+0000","last_change":"2024-04-23T18:33:09.264085+0000","last_active":"2024-04-23T18:33:09.264085+0000","last_peered":"2024-04-23T18:33:09.264085+0000","last_clean":"2024-04-23T18:33:09.264085+0000","last_became_active":"2024-04-23T18:29:11.495224+0000","last_became_peered":"2024-04-23T18:29:11.495224+0000","last_unstale":"2024-04-23T18:33:09.264085+0000","last_undegraded":"2024-04-23T18:33:09.264085+0000","last_fullsized":"2024-04-23T18:33:09.264085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:09.263963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:09.263963+0000","last_clean_scrub_stamp":"2024-04-23T18:33:09.263963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:07.216912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:13.883502+0000","last_change":"2024-04-23T18:33:13.883502+0000","last_active":"2024-04-23T18:33:13.883502+0000","last_peered":"2024-04-23T18:33:13.883502+0000","last_clean":"2024-04-23T18:33:13.883502+0000","last_became_active":"2024-04-23T18:29:13.497588+0000","last_became_peered":"2024-04-23T18:29:13.497588+0000","last_unstale":"2024-04-23T18:33:13.883502+0000","last_undegraded":"2024-04-23T18:33:13.883502+0000","last_fullsized":"2024-04-23T18:33:13.883502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:13.883382+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:13.883382+0000","last_clean_scrub_stamp":"2024-04-23T18:33:13.883382+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:49:50.871921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:47.455304+0000","last_change":"2024-04-23T18:33:47.455332+0000","last_active":"2024-04-23T18:33:47.455304+0000","last_peered":"2024-04-23T18:33:47.455304+0000","last_clean":"2024-04-23T18:33:47.455304+0000","last_became_active":"2024-04-23T18:29:11.495948+0000","last_became_peered":"2024-04-23T18:29:11.495948+0000","last_unstale":"2024-04-23T18:33:47.455304+0000","last_undegraded":"2024-04-23T18:33:47.455304+0000","last_fullsized":"2024-04-23T18:33:47.455304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:47.455173+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:47.455173+0000","last_clean_scrub_stamp":"2024-04-23T18:33:47.455173+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:20:55.895581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:08.514007+0000","last_change":"2024-04-23T18:33:08.514007+0000","last_active":"2024-04-23T18:33:08.514007+0000","last_peered":"2024-04-23T18:33:08.514007+0000","last_clean":"2024-04-23T18:33:08.514007+0000","last_became_active":"2024-04-23T18:29:13.500819+0000","last_became_peered":"2024-04-23T18:29:13.500819+0000","last_unstale":"2024-04-23T18:33:08.514007+0000","last_undegraded":"2024-04-23T18:33:08.514007+0000","last_fullsized":"2024-04-23T18:33:08.514007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:08.513818+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:08.513818+0000","last_clean_scrub_stamp":"2024-04-23T18:33:08.513818+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:15:06.432888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:13.339368+0000","last_change":"2024-04-23T18:33:13.339368+0000","last_active":"2024-04-23T18:33:13.339368+0000","last_peered":"2024-04-23T18:33:13.339368+0000","last_clean":"2024-04-23T18:33:13.339368+0000","last_became_active":"2024-04-23T18:29:11.492727+0000","last_became_peered":"2024-04-23T18:29:11.492727+0000","last_unstale":"2024-04-23T18:33:13.339368+0000","last_undegraded":"2024-04-23T18:33:13.339368+0000","last_fullsized":"2024-04-23T18:33:13.339368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:13.339268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:13.339268+0000","last_clean_scrub_stamp":"2024-04-23T18:33:13.339268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:05:20.784588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:58.189982+0000","last_change":"2024-04-23T18:32:58.189982+0000","last_active":"2024-04-23T18:32:58.189982+0000","last_peered":"2024-04-23T18:32:58.189982+0000","last_clean":"2024-04-23T18:32:58.189982+0000","last_became_active":"2024-04-23T18:29:13.502835+0000","last_became_peered":"2024-04-23T18:29:13.502835+0000","last_unstale":"2024-04-23T18:32:58.189982+0000","last_undegraded":"2024-04-23T18:32:58.189982+0000","last_fullsized":"2024-04-23T18:32:58.189982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:32:58.189852+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:32:58.189852+0000","last_clean_scrub_stamp":"2024-04-23T18:32:58.189852+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:33.304629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:16.842303+0000","last_change":"2024-04-23T18:33:16.842303+0000","last_active":"2024-04-23T18:33:16.842303+0000","last_peered":"2024-04-23T18:33:16.842303+0000","last_clean":"2024-04-23T18:33:16.842303+0000","last_became_active":"2024-04-23T18:29:11.498708+0000","last_became_peered":"2024-04-23T18:29:11.498708+0000","last_unstale":"2024-04-23T18:33:16.842303+0000","last_undegraded":"2024-04-23T18:33:16.842303+0000","last_fullsized":"2024-04-23T18:33:16.842303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:16.842178+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:16.842178+0000","last_clean_scrub_stamp":"2024-04-23T18:33:16.842178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:43:59.315276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.870040+0000","last_change":"2024-04-23T18:33:05.870040+0000","last_active":"2024-04-23T18:33:05.870040+0000","last_peered":"2024-04-23T18:33:05.870040+0000","last_clean":"2024-04-23T18:33:05.870040+0000","last_became_active":"2024-04-23T18:29:13.494121+0000","last_became_peered":"2024-04-23T18:29:13.494121+0000","last_unstale":"2024-04-23T18:33:05.870040+0000","last_undegraded":"2024-04-23T18:33:05.870040+0000","last_fullsized":"2024-04-23T18:33:05.870040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:05.869897+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:05.869897+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.869897+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:56:04.336158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:20.766460+0000","last_change":"2024-04-23T18:33:20.766460+0000","last_active":"2024-04-23T18:33:20.766460+0000","last_peered":"2024-04-23T18:33:20.766460+0000","last_clean":"2024-04-23T18:33:20.766460+0000","last_became_active":"2024-04-23T18:29:11.489671+0000","last_became_peered":"2024-04-23T18:29:11.489671+0000","last_unstale":"2024-04-23T18:33:20.766460+0000","last_undegraded":"2024-04-23T18:33:20.766460+0000","last_fullsized":"2024-04-23T18:33:20.766460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:20.766326+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:20.766326+0000","last_clean_scrub_stamp":"2024-04-23T18:33:20.766326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:00:09.886314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:32:56.886490+0000","last_change":"2024-04-23T18:32:56.886490+0000","last_active":"2024-04-23T18:32:56.886490+0000","last_peered":"2024-04-23T18:32:56.886490+0000","last_clean":"2024-04-23T18:32:56.886490+0000","last_became_active":"2024-04-23T18:29:13.507438+0000","last_became_peered":"2024-04-23T18:29:13.507438+0000","last_unstale":"2024-04-23T18:32:56.886490+0000","last_undegraded":"2024-04-23T18:32:56.886490+0000","last_fullsized":"2024-04-23T18:32:56.886490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:32:56.886359+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:32:56.886359+0000","last_clean_scrub_stamp":"2024-04-23T18:32:56.886359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:27:39.704045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:39.477109+0000","last_change":"2024-04-23T18:33:39.477109+0000","last_active":"2024-04-23T18:33:39.477109+0000","last_peered":"2024-04-23T18:33:39.477109+0000","last_clean":"2024-04-23T18:33:39.477109+0000","last_became_active":"2024-04-23T18:29:11.510882+0000","last_became_peered":"2024-04-23T18:29:11.510882+0000","last_unstale":"2024-04-23T18:33:39.477109+0000","last_undegraded":"2024-04-23T18:33:39.477109+0000","last_fullsized":"2024-04-23T18:33:39.477109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:39.476993+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:39.476993+0000","last_clean_scrub_stamp":"2024-04-23T18:33:39.476993+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:08:09.335384+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:11.959774+0000","last_change":"2024-04-23T18:33:11.959774+0000","last_active":"2024-04-23T18:33:11.959774+0000","last_peered":"2024-04-23T18:33:11.959774+0000","last_clean":"2024-04-23T18:33:11.959774+0000","last_became_active":"2024-04-23T18:29:13.497271+0000","last_became_peered":"2024-04-23T18:29:13.497271+0000","last_unstale":"2024-04-23T18:33:11.959774+0000","last_undegraded":"2024-04-23T18:33:11.959774+0000","last_fullsized":"2024-04-23T18:33:11.959774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-23T18:33:11.959620+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-23T18:33:11.959620+0000","last_clean_scrub_stamp":"2024-04-23T18:33:11.959620+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:23:56.484601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:27.519246+0000","last_change":"2024-04-23T18:33:27.519246+0000","last_active":"2024-04-23T18:33:27.519246+0000","last_peered":"2024-04-23T18:33:27.519246+0000","last_clean":"2024-04-23T18:33:27.519246+0000","last_became_active":"2024-04-23T18:29:11.506749+0000","last_became_peered":"2024-04-23T18:29:11.506749+0000","last_unstale":"2024-04-23T18:33:27.519246+0000","last_undegraded":"2024-04-23T18:33:27.519246+0000","last_fullsized":"2024-04-23T18:33:27.519246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-23T18:33:27.519118+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-23T18:33:27.519118+0000","last_clean_scrub_stamp":"2024-04-23T18:33:27.519118+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:55.534154+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:05.488245+0000","last_change":"2024-04-23T18:33:05.488245+0000","last_active":"2024-04-23T18:33:05.488245+0000","last_peered":"2024-04-23T18:33:05.488245+0000","last_clean":"2024-04-23T18:33:05.488245+0000","last_became_active":"2024-04-23T18:29:13.501177+0000","last_became_peered":"2024-04-23T18:29:13.501177+0000","last_unstale":"2024-04-23T18:33:05.488245+0000","last_undegraded":"2024-04-23T18:33:05.488245+0000","last_fullsized":"2024-04-23T18:33:05.488245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:05.488136+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:05.488136+0000","last_clean_scrub_stamp":"2024-04-23T18:33:05.488136+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:00:41.028747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:18.427433+0000","last_change":"2024-04-23T18:33:18.427433+0000","last_active":"2024-04-23T18:33:18.427433+0000","last_peered":"2024-04-23T18:33:18.427433+0000","last_clean":"2024-04-23T18:33:18.427433+0000","last_became_active":"2024-04-23T18:29:11.484137+0000","last_became_peered":"2024-04-23T18:29:11.484137+0000","last_unstale":"2024-04-23T18:33:18.427433+0000","last_undegraded":"2024-04-23T18:33:18.427433+0000","last_fullsized":"2024-04-23T18:33:18.427433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:18.427238+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:18.427238+0000","last_clean_scrub_stamp":"2024-04-23T18:33:18.427238+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:40.290211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:15.855624+0000","last_change":"2024-04-23T18:33:15.855624+0000","last_active":"2024-04-23T18:33:15.855624+0000","last_peered":"2024-04-23T18:33:15.855624+0000","last_clean":"2024-04-23T18:33:15.855624+0000","last_became_active":"2024-04-23T18:29:13.494034+0000","last_became_peered":"2024-04-23T18:29:13.494034+0000","last_unstale":"2024-04-23T18:33:15.855624+0000","last_undegraded":"2024-04-23T18:33:15.855624+0000","last_fullsized":"2024-04-23T18:33:15.855624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-23T18:33:15.855512+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-23T18:33:15.855512+0000","last_clean_scrub_stamp":"2024-04-23T18:33:15.855512+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:42:49.712408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:29.447216+0000","last_change":"2024-04-23T18:33:29.447216+0000","last_active":"2024-04-23T18:33:29.447216+0000","last_peered":"2024-04-23T18:33:29.447216+0000","last_clean":"2024-04-23T18:33:29.447216+0000","last_became_active":"2024-04-23T18:29:11.506801+0000","last_became_peered":"2024-04-23T18:29:11.506801+0000","last_unstale":"2024-04-23T18:33:29.447216+0000","last_undegraded":"2024-04-23T18:33:29.447216+0000","last_fullsized":"2024-04-23T18:33:29.447216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:29.447095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:29.447095+0000","last_clean_scrub_stamp":"2024-04-23T18:33:29.447095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:41.471117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:46.503071+0000","last_change":"2024-04-23T18:33:46.503071+0000","last_active":"2024-04-23T18:33:46.503071+0000","last_peered":"2024-04-23T18:33:46.503071+0000","last_clean":"2024-04-23T18:33:46.503071+0000","last_became_active":"2024-04-23T18:29:11.494891+0000","last_became_peered":"2024-04-23T18:29:11.494891+0000","last_unstale":"2024-04-23T18:33:46.503071+0000","last_undegraded":"2024-04-23T18:33:46.503071+0000","last_fullsized":"2024-04-23T18:33:46.503071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T18:33:46.502937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T18:33:46.502937+0000","last_clean_scrub_stamp":"2024-04-23T18:33:46.502937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:38:59.985997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:04.263523+0000","last_change":"2024-04-23T18:33:04.263523+0000","last_active":"2024-04-23T18:33:04.263523+0000","last_peered":"2024-04-23T18:33:04.263523+0000","last_clean":"2024-04-23T18:33:04.263523+0000","last_became_active":"2024-04-23T18:29:13.494850+0000","last_became_peered":"2024-04-23T18:29:13.494850+0000","last_unstale":"2024-04-23T18:33:04.263523+0000","last_undegraded":"2024-04-23T18:33:04.263523+0000","last_fullsized":"2024-04-23T18:33:04.263523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-23T18:33:04.263392+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-23T18:33:04.263392+0000","last_clean_scrub_stamp":"2024-04-23T18:33:04.263392+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:45:01.339824+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:07.217825+0000","last_change":"2024-04-23T18:33:07.217825+0000","last_active":"2024-04-23T18:33:07.217825+0000","last_peered":"2024-04-23T18:33:07.217825+0000","last_clean":"2024-04-23T18:33:07.217825+0000","last_became_active":"2024-04-23T18:29:11.495173+0000","last_became_peered":"2024-04-23T18:29:11.495173+0000","last_unstale":"2024-04-23T18:33:07.217825+0000","last_undegraded":"2024-04-23T18:33:07.217825+0000","last_fullsized":"2024-04-23T18:33:07.217825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-23T18:33:07.217709+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-23T18:33:07.217709+0000","last_clean_scrub_stamp":"2024-04-23T18:33:07.217709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:39:38.244409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-23T18:33:00.919303+0000","last_change":"2024-04-23T18:33:00.919303+0000","last_active":"2024-04-23T18:33:00.919303+0000","last_peered":"2024-04-23T18:33:00.919303+0000","last_clean":"2024-04-23T18:33:00.919303+0000","last_became_active":"2024-04-23T18:29:13.506122+0000","last_became_peered":"2024-04-23T18:29:13.506122+0000","last_unstale":"2024-04-23T18:33:00.919303+0000","last_undegraded":"2024-04-23T18:33:00.919303+0000","last_fullsized":"2024-04-23T18:33:00.919303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-23T18:33:00.919186+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-23T18:33:00.919186+0000","last_clean_scrub_stamp":"2024-04-23T18:33:00.919186+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:04:47.802608+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1524,"ondisk_log_size":1524,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1604,"num_read_kb":1494,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640323,"num_pgs":167,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39968,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331872,"statfs":{"total":96636764160,"available":96595836928,"internally_reserved":0,"allocated":483328,"data_stored":150732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640323,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":738603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640324,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":1036288,"data_stored":738249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44088,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327752,"statfs":{"total":96636764160,"available":96591618048,"internally_reserved":0,"allocated":442368,"data_stored":148938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T18:34:14.329 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-23T18:34:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.462+0000 7fb7e43ac640 1 Processor -- start 2024-04-23T18:34:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.462+0000 7fb7e43ac640 1 -- start start 2024-04-23T18:34:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.463+0000 7fb7e43ac640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7dc12fa60 0x7fb7dc131e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:34:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.463+0000 7fb7e43ac640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc093e70 con 0x7fb7dc093380 2024-04-23T18:34:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.463+0000 7fb7e43ac640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb7dc098f60 con 0x7fb7dc12fa60 2024-04-23T18:34:14.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.463+0000 7fb7e1947640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7dc12fa60 0x7fb7dc131e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:34:14.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.463+0000 7fb7e2148640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb7dc093380 0x7fb7dc093760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44888/0 (socket says 172.21.15.62:44888) 2024-04-23T18:34:14.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.463+0000 7fb7e2148640 1 -- 172.21.15.62:0/343750488 learned_addr learned my addr 172.21.15.62:0/343750488 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-04-23T18:34:14.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.463+0000 7fb7e1947640 1 -- 172.21.15.62:0/343750488 >> v1:172.21.15.62:6789/0 conn(0x7fb7dc093380 legacy=0x7fb7dc093760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:34:14.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.463+0000 7fb7e1947640 1 -- 172.21.15.62:0/343750488 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc096730 con 0x7fb7dc12fa60 2024-04-23T18:34:14.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.463+0000 7fb7e1146640 1 -- 172.21.15.62:0/343750488 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2761683682 0 0) 0x7fb7dc093e70 con 0x7fb7dc093380 2024-04-23T18:34:14.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.464+0000 7fb7e1947640 1 --2- 172.21.15.62:0/343750488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc12fa60 0x7fb7dc131e50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009720 tx=0x7fb7cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844fcc9b14c6c911 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:34:14.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.464+0000 7fb7e1146640 1 -- 172.21.15.62:0/343750488 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7cc0316d0 con 0x7fb7dc12fa60 2024-04-23T18:34:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.464+0000 7fb7e1146640 1 -- 172.21.15.62:0/343750488 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7cc037070 con 0x7fb7dc12fa60 2024-04-23T18:34:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.464+0000 7fb7e1146640 1 -- 172.21.15.62:0/343750488 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7cc0319c0 con 0x7fb7dc12fa60 2024-04-23T18:34:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.465+0000 7fb7e43ac640 1 -- 172.21.15.62:0/343750488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc12fa60 msgr2=0x7fb7dc131e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:34:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.465+0000 7fb7e43ac640 1 --2- 172.21.15.62:0/343750488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc12fa60 0x7fb7dc131e50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc009720 tx=0x7fb7cc02b840 comp rx=0 tx=0).stop 2024-04-23T18:34:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.465+0000 7fb7e43ac640 1 -- 172.21.15.62:0/343750488 shutdown_connections 2024-04-23T18:34:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.465+0000 7fb7e43ac640 1 --2- 172.21.15.62:0/343750488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc12fa60 0x7fb7dc131e50 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:34:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.465+0000 7fb7e43ac640 1 -- 172.21.15.62:0/343750488 >> 172.21.15.62:0/343750488 conn(0x7fb7dc099d00 msgr2=0x7fb7dc0975d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:34:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.465+0000 7fb7e43ac640 1 -- 172.21.15.62:0/343750488 shutdown_connections 2024-04-23T18:34:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.465+0000 7fb7e43ac640 1 -- 172.21.15.62:0/343750488 wait complete. 2024-04-23T18:34:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.466+0000 7fb7e43ac640 1 Processor -- start 2024-04-23T18:34:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.466+0000 7fb7e43ac640 1 -- start start 2024-04-23T18:34:14.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.466+0000 7fb7e43ac640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc093380 0x7fb7dc1c15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:34:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.466+0000 7fb7e43ac640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc096110 con 0x7fb7dc093380 2024-04-23T18:34:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.466+0000 7fb7e2148640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc093380 0x7fb7dc1c15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:34:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.466+0000 7fb7e2148640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc093380 0x7fb7dc1c15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58990/0 (socket says 172.21.15.62:58990) 2024-04-23T18:34:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.466+0000 7fb7e2148640 1 -- 172.21.15.62:0/3616119123 learned_addr learned my addr 172.21.15.62:0/3616119123 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-04-23T18:34:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.467+0000 7fb7e2148640 1 -- 172.21.15.62:0/3616119123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc071a50 con 0x7fb7dc093380 2024-04-23T18:34:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.467+0000 7fb7e2148640 1 --2- 172.21.15.62:0/3616119123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc093380 0x7fb7dc1c15c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c420 tx=0x7fb7d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:34:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.467+0000 7fb7d2ffd640 1 -- 172.21.15.62:0/3616119123 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7d8018070 con 0x7fb7dc093380 2024-04-23T18:34:14.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.467+0000 7fb7d2ffd640 1 -- 172.21.15.62:0/3616119123 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7d80074d0 con 0x7fb7dc093380 2024-04-23T18:34:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.467+0000 7fb7e43ac640 1 -- 172.21.15.62:0/3616119123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7dc0723b0 con 0x7fb7dc093380 2024-04-23T18:34:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.467+0000 7fb7d2ffd640 1 -- 172.21.15.62:0/3616119123 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7d8004950 con 0x7fb7dc093380 2024-04-23T18:34:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.467+0000 7fb7e43ac640 1 -- 172.21.15.62:0/3616119123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7dc1c1ce0 con 0x7fb7dc093380 2024-04-23T18:34:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.468+0000 7fb7d2ffd640 1 -- 172.21.15.62:0/3616119123 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (secure 0 0 0) 0x7fb7d801b070 con 0x7fb7dc093380 2024-04-23T18:34:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.468+0000 7fb7d2ffd640 1 --2- 172.21.15.62:0/3616119123 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb7c00385c0 0x7fb7c003aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T18:34:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.468+0000 7fb7d2ffd640 1 -- 172.21.15.62:0/3616119123 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6313+0+0 (secure 0 0 0) 0x7fb7d804b470 con 0x7fb7dc093380 2024-04-23T18:34:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.468+0000 7fb7e43ac640 1 -- 172.21.15.62:0/3616119123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7dc0505b0 con 0x7fb7dc093380 2024-04-23T18:34:14.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.468+0000 7fb7e1947640 1 --2- 172.21.15.62:0/3616119123 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb7c00385c0 0x7fb7c003aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T18:34:14.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.469+0000 7fb7e1947640 1 --2- 172.21.15.62:0/3616119123 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb7c00385c0 0x7fb7c003aa80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc036000 tx=0x7fb7cc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T18:34:14.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.473+0000 7fb7d2ffd640 1 -- 172.21.15.62:0/3616119123 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb7d801c9d0 con 0x7fb7dc093380 2024-04-23T18:34:14.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.656+0000 7fb7e43ac640 1 -- 172.21.15.62:0/3616119123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fb7dc0725e0 con 0x7fb7dc093380 2024-04-23T18:34:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.659+0000 7fb7d2ffd640 1 -- 172.21.15.62:0/3616119123 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fb7d801cc30 con 0x7fb7dc093380 2024-04-23T18:34:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.659+0000 7fb7d2ffd640 1 -- 172.21.15.62:0/3616119123 <== mon.0 v2:172.21.15.62:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb7d801b880 con 0x7fb7dc093380 2024-04-23T18:34:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.661+0000 7fb7e43ac640 1 -- 172.21.15.62:0/3616119123 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb7c00385c0 msgr2=0x7fb7c003aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:34:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.661+0000 7fb7e43ac640 1 --2- 172.21.15.62:0/3616119123 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb7c00385c0 0x7fb7c003aa80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc036000 tx=0x7fb7cc008030 comp rx=0 tx=0).stop 2024-04-23T18:34:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.661+0000 7fb7e43ac640 1 -- 172.21.15.62:0/3616119123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc093380 msgr2=0x7fb7dc1c15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T18:34:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.661+0000 7fb7e43ac640 1 --2- 172.21.15.62:0/3616119123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc093380 0x7fb7dc1c15c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c420 tx=0x7fb7d800c8e0 comp rx=0 tx=0).stop 2024-04-23T18:34:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.661+0000 7fb7e43ac640 1 -- 172.21.15.62:0/3616119123 shutdown_connections 2024-04-23T18:34:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.661+0000 7fb7e43ac640 1 --2- 172.21.15.62:0/3616119123 >> [v2:172.21.15.119:6824/3704082436,v1:172.21.15.119:6825/3704082436] conn(0x7fb7c00385c0 0x7fb7c003aa80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:34:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.661+0000 7fb7e43ac640 1 --2- 172.21.15.62:0/3616119123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7dc093380 0x7fb7dc1c15c0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T18:34:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.661+0000 7fb7e43ac640 1 -- 172.21.15.62:0/3616119123 >> 172.21.15.62:0/3616119123 conn(0x7fb7dc099d00 msgr2=0x7fb7dc12d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T18:34:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.661+0000 7fb7e43ac640 1 -- 172.21.15.62:0/3616119123 shutdown_connections 2024-04-23T18:34:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-04-23T18:34:14.661+0000 7fb7e43ac640 1 -- 172.21.15.62:0/3616119123 wait complete. 2024-04-23T18:34:14.664 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-23T18:34:14.664 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-23T18:34:14.664 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-23T18:34:14.664 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:34:14.701 INFO:tasks.ceph.osd.0:Stopped 2024-04-23T18:34:14.702 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-23T18:34:14.702 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:34:14.738 INFO:tasks.ceph.osd.1:Stopped 2024-04-23T18:34:14.738 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-23T18:34:14.738 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:34:14.811 INFO:tasks.ceph.osd.2:Stopped 2024-04-23T18:34:14.811 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-23T18:34:14.811 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:34:14.879 INFO:tasks.ceph.osd.3:Stopped 2024-04-23T18:34:14.879 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-23T18:34:14.880 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-23T18:34:14.880 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:34:14.949 INFO:tasks.ceph.mgr.x:Stopped 2024-04-23T18:34:14.949 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-23T18:34:14.949 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-23T18:34:14.949 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T18:34:14.961 INFO:tasks.ceph.mon.a:Stopped 2024-04-23T18:34:14.961 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-23T18:34:14.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-04-23T18:34:15.028 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi062.front.sepia.ceph.com 2024-04-23T18:34:15.028 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-23T18:34:15.159 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-23T18:34:15.159 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-23T18:34:15.317 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-23T18:34:15.317 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-23T18:34:15.406 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi119.front.sepia.ceph.com 2024-04-23T18:34:15.406 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-23T18:34:15.475 INFO:tasks.ceph:Archiving mon data... 2024-04-23T18:34:15.476 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi/7670059/data/mon.a.tgz 2024-04-23T18:34:15.476 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-04-23T18:34:15.492 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.W5A3F9wBhn 2024-04-23T18:34:15.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.W5A3F9wBhn 2024-04-23T18:34:15.627 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.W5A3F9wBhn 2024-04-23T18:34:15.709 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.W5A3F9wBhn is 273KB 2024-04-23T18:34:15.804 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.W5A3F9wBhn 2024-04-23T18:34:15.819 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-23T18:34:15.819 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T18:34:15.860 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T18:34:15.937 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T18:34:15.954 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T18:34:15.954 INFO:tasks.ceph:Archiving crash dumps... 2024-04-23T18:34:15.956 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi/7670059/remote/smithi062/crash 2024-04-23T18:34:15.957 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T18:34:16.000 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi/7670059/remote/smithi119/crash 2024-04-23T18:34:16.002 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T18:34:16.040 INFO:tasks.ceph:Compressing logs... 2024-04-23T18:34:16.041 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T18:34:16.045 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T18:34:16.092 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30637.log 2024-04-23T18:34:16.092 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29971.log 2024-04-23T18:34:16.093 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-23T18:34:16.093 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30637.log: /var/log/ceph/ceph-client.admin.29971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29842.log 2024-04-23T18:34:16.093 INFO:teuthology.orchestra.run.smithi062.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30637.log.gz 2024-04-23T18:34:16.093 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-23T18:34:16.093 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30889.log 2024-04-23T18:34:16.093 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31099.log 2024-04-23T18:34:16.093 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.29842.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29971.log.gz 2024-04-23T18:34:16.093 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.30889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29972.log 2024-04-23T18:34:16.093 INFO:teuthology.orchestra.run.smithi062.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29842.log.gz 2024-04-23T18:34:16.094 INFO:teuthology.orchestra.run.smithi062.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30889.log.gz 2024-04-23T18:34:16.094 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30973.log 2024-04-23T18:34:16.094 INFO:teuthology.orchestra.run.smithi062.stderr: 88.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-23T18:34:16.094 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29843.log 2024-04-23T18:34:16.094 INFO:teuthology.orchestra.run.smithi062.stderr: 85.7%/var/log/ceph/ceph-client.admin.29972.log: -- replaced with /var/log/ceph/ceph-client.admin.31099.log.gz 2024-04-23T18:34:16.094 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30847.log 2024-04-23T18:34:16.094 INFO:teuthology.orchestra.run.smithi062.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29972.log.gz 2024-04-23T18:34:16.094 INFO:teuthology.orchestra.run.smithi062.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30973.log.gz 2024-04-23T18:34:16.094 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29841.log 2024-04-23T18:34:16.095 INFO:teuthology.orchestra.run.smithi062.stderr: 86.3% 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-23T18:34:16.095 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29843.log.gz 2024-04-23T18:34:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29518.log 2024-04-23T18:34:16.095 INFO:teuthology.orchestra.run.smithi062.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30847.log.gz 2024-04-23T18:34:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29841.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-23T18:34:16.095 INFO:teuthology.orchestra.run.smithi062.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29841.log.gz 2024-04-23T18:34:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27958.log 2024-04-23T18:34:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30553.log 2024-04-23T18:34:16.095 INFO:teuthology.orchestra.run.smithi062.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29518.log.gz 2024-04-23T18:34:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30372.log 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.27958.log.gz 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30330.log 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30553.log.gz 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30288.log 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30330.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30372.log.gz 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30159.log 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.30330.log.gz 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30288.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.30288.log.gz 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30931.log 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.a.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30159.log.gz 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31015.log 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30012.log 2024-04-23T18:34:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30931.log: /var/log/ceph/ceph-client.admin.31015.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30931.log.gz 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26097.log 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31015.log.gz 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29461.log 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30012.log: /var/log/ceph/ceph.tmp-client.admin.26097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30679.log 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26097.log.gz 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30012.log.gz 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30160.log 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29461.log.gz 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30120.log 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30679.log.gz 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27800.log 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30160.log.gz 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31141.log 2024-04-23T18:34:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30120.log: /var/log/ceph/ceph-client.admin.27800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30595.log 2024-04-23T18:34:16.098 INFO:teuthology.orchestra.run.smithi062.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30120.log.gz 2024-04-23T18:34:16.098 INFO:teuthology.orchestra.run.smithi062.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.27800.log.gz 2024-04-23T18:34:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29658.log 2024-04-23T18:34:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- 85.6% /var/log/ceph/ceph-client.admin.31181.log 2024-04-23T18:34:16.098 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31141.log.gz 2024-04-23T18:34:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30595.log: /var/log/ceph/ceph-client.admin.29658.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30595.log.gz 2024-04-23T18:34:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30763.log 2024-04-23T18:34:16.098 INFO:teuthology.orchestra.run.smithi062.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29658.log.gz 2024-04-23T18:34:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29574.log 2024-04-23T18:34:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31181.log: /var/log/ceph/ceph-client.admin.30763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30469.log 2024-04-23T18:34:16.098 INFO:teuthology.orchestra.run.smithi062.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31181.log.gz 2024-04-23T18:34:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29574.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30763.log.gz 2024-04-23T18:34:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29844.log 2024-04-23T18:34:16.099 INFO:teuthology.orchestra.run.smithi062.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29574.log.gz 2024-04-23T18:34:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29616.log 2024-04-23T18:34:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30011.log 2024-04-23T18:34:16.099 INFO:teuthology.orchestra.run.smithi062.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30469.log.gz 2024-04-23T18:34:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29844.log: /var/log/ceph/ceph-client.admin.29616.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29844.log.gz 2024-04-23T18:34:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30805.log 2024-04-23T18:34:16.099 INFO:teuthology.orchestra.run.smithi062.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.29616.log.gz 2024-04-23T18:34:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30511.log 2024-04-23T18:34:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30011.log: /var/log/ceph/ceph-client.admin.30805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30721.log 2024-04-23T18:34:16.099 INFO:teuthology.orchestra.run.smithi062.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30011.log.gz 2024-04-23T18:34:16.099 INFO:teuthology.orchestra.run.smithi062.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30805.log.gz 2024-04-23T18:34:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30182.log 2024-04-23T18:34:16.099 INFO:teuthology.orchestra.run.smithi062.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30511.log.gz 2024-04-23T18:34:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30427.log 2024-04-23T18:34:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27918.log 2024-04-23T18:34:16.100 INFO:teuthology.orchestra.run.smithi062.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30721.log.gz 2024-04-23T18:34:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.30182.log: /var/log/ceph/ceph-client.admin.30427.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30182.log.gz 2024-04-23T18:34:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29742.log 2024-04-23T18:34:16.100 INFO:teuthology.orchestra.run.smithi062.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30427.log.gz 2024-04-23T18:34:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29700.log 2024-04-23T18:34:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.27918.log: /var/log/ceph/ceph-client.admin.29742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31057.log 2024-04-23T18:34:16.100 INFO:teuthology.orchestra.run.smithi062.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.27918.log.gz 2024-04-23T18:34:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.29700.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29742.log.gz 2024-04-23T18:34:16.100 INFO:teuthology.orchestra.run.smithi062.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29700.log.gz 2024-04-23T18:34:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.31057.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31057.log.gz 2024-04-23T18:34:16.107 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94551.log 2024-04-23T18:34:16.184 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30281.log 2024-04-23T18:34:16.185 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.94551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77035.log 2024-04-23T18:34:16.185 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.30281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82481.log 2024-04-23T18:34:16.185 INFO:teuthology.orchestra.run.smithi119.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.30281.log.gz 2024-04-23T18:34:16.185 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.77035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77640.log 2024-04-23T18:34:16.185 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.82481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34383.log 2024-04-23T18:34:16.185 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94551.log.gz 2024-04-23T18:34:16.185 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.77640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93341.log 2024-04-23T18:34:16.185 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60700.log 2024-04-23T18:34:16.185 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77035.log.gz 2024-04-23T18:34:16.185 INFO:teuthology.orchestra.run.smithi119.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.34383.log.gz 2024-04-23T18:34:16.185 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.93341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75220.log 2024-04-23T18:34:16.185 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.60700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74615.log 2024-04-23T18:34:16.186 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.75220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87896.log 2024-04-23T18:34:16.186 INFO:teuthology.orchestra.run.smithi119.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.77640.log.gz 2024-04-23T18:34:16.186 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.74615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55255.log 2024-04-23T18:34:16.186 INFO:teuthology.orchestra.run.smithi119.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.82481.log.gz 2024-04-23T18:34:16.186 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.87896.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93341.log.gz 2024-04-23T18:34:16.186 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52230.log 2024-04-23T18:34:16.186 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.55255.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-23T18:34:16.186 INFO:teuthology.orchestra.run.smithi119.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.60700.log.gz 2024-04-23T18:34:16.186 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75220.log.gz 2024-04-23T18:34:16.186 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.52230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41340.log 2024-04-23T18:34:16.186 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.74615.log.gz 2024-04-23T18:34:16.186 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73405.log 2024-04-23T18:34:16.186 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90316.log 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.87896.log.gz 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.41340.log: /var/log/ceph/ceph-client.0.73405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89711.log 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.90316.log: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81271.log 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.0.55255.log.gz 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.52230.log.gz 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.89711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36506.log 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr:gzip/var/log/ceph/ceph-client.0.81271.log: -5 --verbose 91.3% -- /var/log/ceph/ceph-client.0.75825.log 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.0.41340.log.gz 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.36506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84889.log 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73405.log.gz 91.1% -- replaced with /var/log/ceph/ceph-client.0.90316.log.gz 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.75825.log: 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42550.log 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.84889.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91526.log 2024-04-23T18:34:16.187 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.89711.log.gz 2024-04-23T18:34:16.188 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.0.81271.log.gz 2024-04-23T18:34:16.188 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.42550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71590.log 2024-04-23T18:34:16.188 INFO:teuthology.orchestra.run.smithi119.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.84889.log.gz 2024-04-23T18:34:16.188 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.91526.log: 91.3% 91.5% -- replaced with /var/log/ceph/ceph-client.0.75825.log.gz -- replaced with /var/log/ceph/ceph-client.0.36506.log.gz 2024-04-23T18:34:16.188 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-04-23T18:34:16.188 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81876.log 2024-04-23T18:34:16.188 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44365.log 2024-04-23T18:34:16.188 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.71590.log: /var/log/ceph/ceph-client.0.81876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35296.log 2024-04-23T18:34:16.188 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42550.log.gz 2024-04-23T18:34:16.188 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.44365.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91526.log.gz 2024-04-23T18:34:16.188 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87291.log 2024-04-23T18:34:16.188 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-23T18:34:16.188 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.35296.log: /var/log/ceph/ceph-client.0.87291.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34423.log 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.0.71590.log.gz 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.81876.log.gz 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60095.log 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34423.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.44365.log.gz 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr:gzip 86.2% -5 --verbose -- /var/log/ceph/ceph-client.0.70985.log 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34423.log.gz 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.35296.log.gz 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.60095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84290.log 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.87291.log.gz 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.70985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57675.log 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.84290.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.57675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59490.log 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 91.1%gzip -- replaced with /var/log/ceph/ceph-client.0.60095.log.gz -5 2024-04-23T18:34:16.189 INFO:teuthology.orchestra.run.smithi119.stderr: --verbose -- /var/log/ceph/ceph-client.0.65540.log 2024-04-23T18:34:16.190 INFO:teuthology.orchestra.run.smithi119.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.84290.log.gz 2024-04-23T18:34:16.190 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72800.log 2024-04-23T18:34:16.190 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.59490.log: /var/log/ceph/ceph-client.0.65540.log: 91.9%gzip -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-04-23T18:34:16.190 INFO:teuthology.orchestra.run.smithi119.stderr: -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-23T18:34:16.190 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.57675.log.gz 2024-04-23T18:34:16.190 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.72800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86087.log 2024-04-23T18:34:16.190 INFO:teuthology.orchestra.run.smithi119.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.70985.log.gz/var/log/ceph/rgw.ceph.client.0.log: 2024-04-23T18:34:16.190 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80666.log 2024-04-23T18:34:16.190 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-23T18:34:16.190 INFO:teuthology.orchestra.run.smithi119.stderr: 91.8%/var/log/ceph/ceph-client.0.80666.log: -- replaced with /var/log/ceph/ceph-client.0.65540.log.gz/var/log/ceph/ceph-client.0.86087.log: 2024-04-23T18:34:16.190 INFO:teuthology.orchestra.run.smithi119.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.59490.log.gz 2024-04-23T18:34:16.190 INFO:teuthology.orchestra.run.smithi119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72800.log.gz 2024-04-23T18:34:16.190 INFO:teuthology.orchestra.run.smithi119.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86087.log.gz 2024-04-23T18:34:16.191 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69775.log 2024-04-23T18:34:16.191 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39525.log 2024-04-23T18:34:16.191 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.69775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68565.log 2024-04-23T18:34:16.191 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.39525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63725.log 2024-04-23T18:34:16.191 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.68565.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.80666.log.gz 2024-04-23T18:34:16.191 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.69775.log.gz 2024-04-23T18:34:16.191 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67355.log 2024-04-23T18:34:16.191 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.39525.log.gz 2024-04-23T18:34:16.191 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.63725.log: 92.6% -- replaced with /var/log/ceph/ceph-client.0.68565.log.gz 2024-04-23T18:34:16.191 INFO:teuthology.orchestra.run.smithi119.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.63725.log.gz 2024-04-23T18:34:16.191 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43760.log 2024-04-23T18:34:16.191 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.67355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58885.log 2024-04-23T18:34:16.191 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.43760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49205.log 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.58885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69170.log 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.49205.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43760.log.gz 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.67355.log.gz 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.58885.log.gz 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.49205.log.gz 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54650.log 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.69170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89106.log 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.54650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34343.log 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.89106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90921.log 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34343.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.34343.log.gz 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.69170.log.gz 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.54650.log.gz 2024-04-23T18:34:16.192 INFO:teuthology.orchestra.run.smithi119.stderr:gzip 91.2% -5 --verbose -- /var/log/ceph/ceph-client.0.72195.log 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.90921.log: -- replaced with /var/log/ceph/ceph-client.0.89106.log.gz 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79456.log 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.72195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78245.log 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.79456.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.90921.log.gz 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72195.log.gz 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79456.log.gz 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47995.log 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.78245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38920.log 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.47995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88501.log 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.38920.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.47995.log.gz 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78245.log.gz 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- 91.7% -- replaced with /var/log/ceph/ceph-client.0.38920.log.gz 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr: /var/log/ceph/ceph-client.0.40735.log 2024-04-23T18:34:16.193 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.88501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92736.log 2024-04-23T18:34:16.194 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.40735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48600.log 2024-04-23T18:34:16.194 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.92736.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.88501.log.gz 2024-04-23T18:34:16.194 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.40735.log.gz 2024-04-23T18:34:16.194 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74010.log 2024-04-23T18:34:16.194 INFO:teuthology.orchestra.run.smithi119.stderr: 91.0%/var/log/ceph/ceph-client.0.48600.log: -- replaced with /var/log/ceph/ceph-client.0.92736.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.86686.log 2024-04-23T18:34:16.194 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-04-23T18:34:16.194 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.74010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47390.log 2024-04-23T18:34:16.194 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.86686.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48600.log.gz 2024-04-23T18:34:16.194 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37716.log 91.7% -- replaced with /var/log/ceph/ceph-client.0.74010.log.gz 2024-04-23T18:34:16.194 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-04-23T18:34:16.194 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.47390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34503.log 2024-04-23T18:34:16.194 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.37716.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.86686.log.gz 2024-04-23T18:34:16.194 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose 91.3% -- replaced with /var/log/ceph/ceph-client.0.47390.log.gz 2024-04-23T18:34:16.195 INFO:teuthology.orchestra.run.smithi119.stderr: -- /var/log/ceph/ceph-client.0.93946.log 2024-04-23T18:34:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61910.log 2024-04-23T18:34:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.93946.log: /var/log/ceph/ceph-client.admin.34503.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37716.log.gz 2024-04-23T18:34:16.195 INFO:teuthology.orchestra.run.smithi119.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.34503.log.gz 2024-04-23T18:34:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38321.log 2024-04-23T18:34:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49810.log 2024-04-23T18:34:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.38321.log: /var/log/ceph/ceph-client.0.61910.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93946.log.gz 2024-04-23T18:34:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose 90.4% -- replaced with /var/log/ceph/ceph-client.0.38321.log.gz 2024-04-23T18:34:16.195 INFO:teuthology.orchestra.run.smithi119.stderr: -- /var/log/ceph/ceph-client.0.56465.log 2024-04-23T18:34:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.49810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34463.log 2024-04-23T18:34:16.195 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.56465.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.61910.log.gz 2024-04-23T18:34:16.195 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67960.log 2024-04-23T18:34:16.195 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.0.49810.log.gz 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.34463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64330.log 91.0% 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.0.56465.log.gz 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.67960.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.34463.log.gz 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43155.log 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54045.log 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.43155.log: /var/log/ceph/ceph-client.0.64330.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.43155.log.gz 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64330.log.gz 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62515.log 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.67960.log.gz 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40130.log 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.54045.log: /var/log/ceph/ceph-client.0.62515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57070.log 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.40130.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.62515.log.gz 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54045.log.gz 2024-04-23T18:34:16.196 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40130.log.gz 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45575.log 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80061.log 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.57070.log: /var/log/ceph/ceph-client.0.45575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46180.log 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.80061.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.45575.log.gz 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.57070.log.gz 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52835.log 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51020.log 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.52835.log: /var/log/ceph/ceph-client.0.46180.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.80061.log.gz 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55860.log 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.51020.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52835.log.gz 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46180.log.gz 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95208.log 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51020.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.66750.log 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-04-23T18:34:16.197 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.55860.log: /var/log/ceph/ceph-client.0.95208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35901.log 2024-04-23T18:34:16.198 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.66750.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55860.log.gz 2024-04-23T18:34:16.198 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44970.log 2024-04-23T18:34:16.198 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.66750.log.gz 2024-04-23T18:34:16.198 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.35901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46785.log 2024-04-23T18:34:16.198 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.44970.log: 93.2% -- replaced with /var/log/ceph/ceph-client.0.95208.log.gz 2024-04-23T18:34:16.198 INFO:teuthology.orchestra.run.smithi119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44970.log.gz 2024-04-23T18:34:16.198 INFO:teuthology.orchestra.run.smithi119.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.35901.log.gz 2024-04-23T18:34:16.198 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78851.log 2024-04-23T18:34:16.198 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.46785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66145.log 2024-04-23T18:34:16.198 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.78851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92131.log 2024-04-23T18:34:16.198 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.66145.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.46785.log.gz 2024-04-23T18:34:16.198 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70380.log 2024-04-23T18:34:16.198 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1%/var/log/ceph/ceph-client.0.92131.log: -- replaced with /var/log/ceph/ceph-client.0.78851.log.gz 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58280.log 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.70380.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.66145.log.gz 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61305.log 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92131.log.gz 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.58280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83691.log 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.61305.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.70380.log.gz 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.58280.log.gz 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.61305.log.gz 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37111.log 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64935.log 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.83691.log: /var/log/ceph/ceph-client.0.37111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83086.log 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.64935.log: 92.1% 90.6% -- replaced with /var/log/ceph/ceph-client.0.83691.log.gz 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30161.log 2024-04-23T18:34:16.199 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.83086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76430.log 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37111.log.gz 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.30161.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.64935.log.gz 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.30161.log.gz 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50415.log 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.76430.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.83086.log.gz 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41945.log 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:gzip/var/log/ceph/ceph-client.0.50415.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30201.log 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.41945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85488.log 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.30201.log: 91.3% 85.4% -- replaced with /var/log/ceph/ceph-client.admin.30201.log.gz 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph-client.0.76430.log.gz 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.50415.log.gz 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51625.log 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:gzip 91.0% -5 --verbose -- /var/log/ceph/ceph-client.0.63120.log 2024-04-23T18:34:16.200 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.85488.log: -- replaced with /var/log/ceph/ceph-client.0.41945.log.gz 2024-04-23T18:34:16.201 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.51625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53440.log 2024-04-23T18:34:16.201 INFO:teuthology.orchestra.run.smithi119.stderr: 90.5%/var/log/ceph/ceph-client.0.63120.log: -- replaced with /var/log/ceph/ceph-client.0.85488.log.gz 2024-04-23T18:34:16.201 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30241.log 2024-04-23T18:34:16.201 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.0.53440.log: /var/log/ceph/ceph-client.admin.30241.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.51625.log.gz 2024-04-23T18:34:16.201 INFO:teuthology.orchestra.run.smithi119.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.30241.log.gz 2024-04-23T18:34:16.201 INFO:teuthology.orchestra.run.smithi119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.63120.log.gz 2024-04-23T18:34:16.201 INFO:teuthology.orchestra.run.smithi119.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.53440.log.gz 2024-04-23T18:34:16.201 INFO:teuthology.orchestra.run.smithi119.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-23T18:34:16.253 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-23T18:34:17.007 INFO:teuthology.orchestra.run.smithi119.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-23T18:34:17.067 INFO:teuthology.orchestra.run.smithi062.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-23T18:34:17.069 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-04-23T18:34:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m1.012s 2024-04-23T18:34:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m1.172s 2024-04-23T18:34:17.069 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m0.067s 2024-04-23T18:34:17.098 INFO:teuthology.orchestra.run.smithi119.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-23T18:34:17.114 INFO:teuthology.orchestra.run.smithi119.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-23T18:34:17.117 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-04-23T18:34:17.117 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m1.019s 2024-04-23T18:34:17.117 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m3.017s 2024-04-23T18:34:17.117 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m0.210s 2024-04-23T18:34:17.117 INFO:tasks.ceph:Archiving logs... 2024-04-23T18:34:17.117 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi/7670059/remote/smithi062/log 2024-04-23T18:34:17.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T18:34:17.346 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi/7670059/remote/smithi119/log 2024-04-23T18:34:17.347 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T18:34:17.887 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-23T18:34:17.897 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-23T18:34:17.897 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T18:34:17.900 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T18:34:17.973 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-23T18:34:17.982 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-23T18:34:17.982 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T18:34:17.985 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T18:34:17.998 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-04-23T18:34:17.999 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-04-23T18:34:18.004 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T18:34:18.004 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-04-23T18:34:18.004 INFO:teuthology.orchestra.run.smithi062.stdout:^- hv01.front.sepia.ceph.com 2 6 377 13 +1000us[+1000us] +/- 593ms 2024-04-23T18:34:18.004 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv02.front.sepia.ceph.com 3 6 377 14 -246us[ -221us] +/- 69ms 2024-04-23T18:34:18.004 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +328us[ +353us] +/- 83ms 2024-04-23T18:34:18.004 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T18:34:18.004 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T18:34:18.004 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-04-23T18:34:18.004 INFO:teuthology.orchestra.run.smithi119.stdout:^- hv01.front.sepia.ceph.com 2 6 377 14 +1001us[+1001us] +/- 593ms 2024-04-23T18:34:18.005 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv02.front.sepia.ceph.com 3 6 377 15 -249us[ -229us] +/- 69ms 2024-04-23T18:34:18.005 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +343us[ +343us] +/- 83ms 2024-04-23T18:34:18.005 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T18:34:18.005 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-23T18:34:18.014 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-23T18:34:18.014 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-23T18:34:18.022 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T18:34:18.106 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T18:34:18.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T18:34:18.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:34:18.189 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T18:34:18.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:34:18.215 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-23T18:34:18.225 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-23T18:34:18.236 INFO:teuthology.task.internal:Duration was 751.083042 seconds 2024-04-23T18:34:18.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-23T18:34:18.244 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-23T18:34:18.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T18:34:18.247 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T18:34:18.284 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T18:34:18.290 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T18:34:18.648 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-23T18:34:18.648 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-04-23T18:34:18.648 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T18:34:18.709 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-04-23T18:34:18.709 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T18:34:18.733 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-23T18:34:18.733 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T18:34:18.751 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T18:34:18.798 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-23T18:34:18.798 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T18:34:18.818 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T18:34:18.932 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-23T18:34:18.943 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-23T18:34:18.943 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T18:34:18.967 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T18:34:18.991 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-23T18:34:19.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T18:34:19.010 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T18:34:19.031 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-04-23T18:34:19.053 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-04-23T18:34:19.074 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T18:34:19.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:34:19.105 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T18:34:19.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T18:34:19.128 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-23T18:34:19.138 INFO:teuthology.task.internal:Transferring archived files... 2024-04-23T18:34:19.139 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi/7670059/remote/smithi062 2024-04-23T18:34:19.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T18:34:19.179 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-04-23_17:18:46-rgw-wip-skoduri-lc-stall-distro-default-smithi/7670059/remote/smithi119 2024-04-23T18:34:19.179 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T18:34:19.210 INFO:teuthology.task.internal:Removing archive directory... 2024-04-23T18:34:19.211 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T18:34:19.215 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T18:34:19.260 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-23T18:34:19.272 INFO:teuthology.task.internal:Not uploading archives. 2024-04-23T18:34:19.272 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-23T18:34:19.281 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-23T18:34:19.282 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T18:34:19.284 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T18:34:19.296 INFO:teuthology.orchestra.run.smithi062.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 18:34 /home/ubuntu/cephtest 2024-04-23T18:34:19.315 INFO:teuthology.orchestra.run.smithi119.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 18:34 /home/ubuntu/cephtest 2024-04-23T18:34:19.316 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-23T18:34:19.328 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-23T18:34:19.384 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} duration: 751.083042383194 flavor: default owner: scheduled_soumyakoduri@teuthology success: true 2024-04-23T18:34:19.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T18:34:19.462 INFO:teuthology.run:pass